[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 13:09:18.913328 28889 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.28.54.126:37903
I20260709 13:09:18.914841 28889 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 13:09:18.915840 28889 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:18.932193 28896 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:18.932217 28895 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:18.932509 28898 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:18.933194 28889 server_base.cc:1061] running on GCE node
I20260709 13:09:20.030441 28889 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:20.030704 28889 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:20.030906 28889 hybrid_clock.cc:648] HybridClock initialized: now 1783602560030885 us; error 0 us; skew 500 ppm
I20260709 13:09:20.031759 28889 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:20.036908 28889 webserver.cc:533] Webserver started at http://127.28.54.126:46045/ using document root <none> and password file <none>
I20260709 13:09:20.037739 28889 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:20.037989 28889 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:20.038420 28889 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:20.044085 28889 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602558744475-28889-0/minicluster-data/master-0-root/instance:
uuid: "a46242c1a0cd471a83e5a0a9c0c8e7d2"
format_stamp: "Formatted at 2026-07-09 13:09:20 on dist-test-slave-vpdx"
I20260709 13:09:20.051887 28889 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.009s	sys 0.000s
I20260709 13:09:20.056788 28904 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:20.057907 28889 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:09:20.058226 28889 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602558744475-28889-0/minicluster-data/master-0-root
uuid: "a46242c1a0cd471a83e5a0a9c0c8e7d2"
format_stamp: "Formatted at 2026-07-09 13:09:20 on dist-test-slave-vpdx"
I20260709 13:09:20.058538 28889 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602558744475-28889-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602558744475-28889-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602558744475-28889-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:20.107510 28889 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:20.109004 28889 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 13:09:20.109426 28889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:20.175844 28889 rpc_server.cc:307] RPC server started. Bound to: 127.28.54.126:37903
I20260709 13:09:20.175922 28955 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.54.126:37903 every 8 connection(s)
I20260709 13:09:20.183280 28956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:20.204006 28956 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a46242c1a0cd471a83e5a0a9c0c8e7d2: Bootstrap starting.
I20260709 13:09:20.209501 28956 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a46242c1a0cd471a83e5a0a9c0c8e7d2: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:20.211272 28956 log.cc:826] T 00000000000000000000000000000000 P a46242c1a0cd471a83e5a0a9c0c8e7d2: Log is configured to *not* fsync() on all Append() calls
I20260709 13:09:20.215569 28956 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a46242c1a0cd471a83e5a0a9c0c8e7d2: No bootstrap required, opened a new log
I20260709 13:09:20.235496 28956 raft_consensus.cc:359] T 00000000000000000000000000000000 P a46242c1a0cd471a83e5a0a9c0c8e7d2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a46242c1a0cd471a83e5a0a9c0c8e7d2" member_type: VOTER }
I20260709 13:09:20.236032 28956 raft_consensus.cc:385] T 00000000000000000000000000000000 P a46242c1a0cd471a83e5a0a9c0c8e7d2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:20.236227 28956 raft_consensus.cc:740] T 00000000000000000000000000000000 P a46242c1a0cd471a83e5a0a9c0c8e7d2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a46242c1a0cd471a83e5a0a9c0c8e7d2, State: Initialized, Role: FOLLOWER
I20260709 13:09:20.237053 28956 consensus_queue.cc:260] T 00000000000000000000000000000000 P a46242c1a0cd471a83e5a0a9c0c8e7d2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a46242c1a0cd471a83e5a0a9c0c8e7d2" member_type: VOTER }
I20260709 13:09:20.237486 28956 raft_consensus.cc:399] T 00000000000000000000000000000000 P a46242c1a0cd471a83e5a0a9c0c8e7d2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:09:20.237739 28956 raft_consensus.cc:493] T 00000000000000000000000000000000 P a46242c1a0cd471a83e5a0a9c0c8e7d2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:09:20.238039 28956 raft_consensus.cc:3060] T 00000000000000000000000000000000 P a46242c1a0cd471a83e5a0a9c0c8e7d2 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:20.241936 28956 raft_consensus.cc:515] T 00000000000000000000000000000000 P a46242c1a0cd471a83e5a0a9c0c8e7d2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a46242c1a0cd471a83e5a0a9c0c8e7d2" member_type: VOTER }
I20260709 13:09:20.242601 28956 leader_election.cc:304] T 00000000000000000000000000000000 P a46242c1a0cd471a83e5a0a9c0c8e7d2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: a46242c1a0cd471a83e5a0a9c0c8e7d2; no voters: 
I20260709 13:09:20.244179 28956 leader_election.cc:290] T 00000000000000000000000000000000 P a46242c1a0cd471a83e5a0a9c0c8e7d2 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:09:20.244470 28959 raft_consensus.cc:2804] T 00000000000000000000000000000000 P a46242c1a0cd471a83e5a0a9c0c8e7d2 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:20.246479 28959 raft_consensus.cc:697] T 00000000000000000000000000000000 P a46242c1a0cd471a83e5a0a9c0c8e7d2 [term 1 LEADER]: Becoming Leader. State: Replica: a46242c1a0cd471a83e5a0a9c0c8e7d2, State: Running, Role: LEADER
I20260709 13:09:20.247339 28959 consensus_queue.cc:237] T 00000000000000000000000000000000 P a46242c1a0cd471a83e5a0a9c0c8e7d2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a46242c1a0cd471a83e5a0a9c0c8e7d2" member_type: VOTER }
I20260709 13:09:20.248415 28956 sys_catalog.cc:565] T 00000000000000000000000000000000 P a46242c1a0cd471a83e5a0a9c0c8e7d2 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:09:20.256897 28960 sys_catalog.cc:455] T 00000000000000000000000000000000 P a46242c1a0cd471a83e5a0a9c0c8e7d2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "a46242c1a0cd471a83e5a0a9c0c8e7d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a46242c1a0cd471a83e5a0a9c0c8e7d2" member_type: VOTER } }
I20260709 13:09:20.256808 28961 sys_catalog.cc:455] T 00000000000000000000000000000000 P a46242c1a0cd471a83e5a0a9c0c8e7d2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader a46242c1a0cd471a83e5a0a9c0c8e7d2. Latest consensus state: current_term: 1 leader_uuid: "a46242c1a0cd471a83e5a0a9c0c8e7d2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "a46242c1a0cd471a83e5a0a9c0c8e7d2" member_type: VOTER } }
I20260709 13:09:20.257615 28960 sys_catalog.cc:458] T 00000000000000000000000000000000 P a46242c1a0cd471a83e5a0a9c0c8e7d2 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:20.257668 28961 sys_catalog.cc:458] T 00000000000000000000000000000000 P a46242c1a0cd471a83e5a0a9c0c8e7d2 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:20.263722 28967 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:09:20.273846 28967 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:09:20.275993 28889 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:09:20.289137 28967 catalog_manager.cc:1383] Generated new cluster ID: 44094dc8496b402bba73d31b672c9013
I20260709 13:09:20.289366 28967 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:09:20.308643 28967 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:09:20.310132 28967 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:09:20.326592 28967 catalog_manager.cc:6070] T 00000000000000000000000000000000 P a46242c1a0cd471a83e5a0a9c0c8e7d2: Generated new TSK 0
I20260709 13:09:20.327453 28967 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:09:20.342207 28889 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:20.350476 28978 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:20.351361 28979 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:20.355154 28981 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:20.355261 28889 server_base.cc:1061] running on GCE node
I20260709 13:09:20.356050 28889 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:20.356228 28889 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:20.356383 28889 hybrid_clock.cc:648] HybridClock initialized: now 1783602560356366 us; error 0 us; skew 500 ppm
I20260709 13:09:20.356940 28889 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:20.360562 28889 webserver.cc:533] Webserver started at http://127.28.54.65:34819/ using document root <none> and password file <none>
I20260709 13:09:20.361052 28889 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:20.361232 28889 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:20.361487 28889 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:20.362548 28889 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602558744475-28889-0/minicluster-data/ts-0-root/instance:
uuid: "ade6fdeec548419dafe0d8c727ea9db7"
format_stamp: "Formatted at 2026-07-09 13:09:20 on dist-test-slave-vpdx"
I20260709 13:09:20.367918 28889 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:09:20.372076 28986 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:20.372848 28889 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:09:20.373111 28889 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602558744475-28889-0/minicluster-data/ts-0-root
uuid: "ade6fdeec548419dafe0d8c727ea9db7"
format_stamp: "Formatted at 2026-07-09 13:09:20 on dist-test-slave-vpdx"
I20260709 13:09:20.373385 28889 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602558744475-28889-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602558744475-28889-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602558744475-28889-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:20.387024 28889 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:20.388232 28889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:20.390679 28889 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:20.394968 28889 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:20.395174 28889 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:20.395432 28889 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:20.395592 28889 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:20.488940 28889 rpc_server.cc:307] RPC server started. Bound to: 127.28.54.65:37211
I20260709 13:09:20.489005 29048 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.54.65:37211 every 8 connection(s)
I20260709 13:09:20.495826 28889 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:20.507359 29053 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:20.512243 29054 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:20.521413 29056 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:20.521624 28889 server_base.cc:1061] running on GCE node
I20260709 13:09:20.522702 28889 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:20.522953 28889 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:20.523159 28889 hybrid_clock.cc:648] HybridClock initialized: now 1783602560523139 us; error 0 us; skew 500 ppm
I20260709 13:09:20.523909 28889 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:20.526609 29049 heartbeater.cc:344] Connected to a master server at 127.28.54.126:37903
I20260709 13:09:20.527073 29049 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:20.528182 29049 heartbeater.cc:507] Master 127.28.54.126:37903 requested a full tablet report, sending...
I20260709 13:09:20.529871 28889 webserver.cc:533] Webserver started at http://127.28.54.66:39375/ using document root <none> and password file <none>
I20260709 13:09:20.530439 28889 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:20.530690 28889 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:20.531019 28889 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:20.531575 28921 ts_manager.cc:194] Registered new tserver with Master: ade6fdeec548419dafe0d8c727ea9db7 (127.28.54.65:37211)
I20260709 13:09:20.533563 28889 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602558744475-28889-0/minicluster-data/ts-1-root/instance:
uuid: "1b1cd51a6e4f49c88eb2d118d294d565"
format_stamp: "Formatted at 2026-07-09 13:09:20 on dist-test-slave-vpdx"
I20260709 13:09:20.534525 28921 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54210
I20260709 13:09:20.539928 28889 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:20.544061 29061 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:20.544822 28889 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 13:09:20.545091 28889 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602558744475-28889-0/minicluster-data/ts-1-root
uuid: "1b1cd51a6e4f49c88eb2d118d294d565"
format_stamp: "Formatted at 2026-07-09 13:09:20 on dist-test-slave-vpdx"
I20260709 13:09:20.545348 28889 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602558744475-28889-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602558744475-28889-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602558744475-28889-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:20.559299 28889 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:20.560470 28889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:20.561878 28889 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:20.564575 28889 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:20.564833 28889 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:20.565074 28889 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:20.565217 28889 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:20.651928 28889 rpc_server.cc:307] RPC server started. Bound to: 127.28.54.66:34329
I20260709 13:09:20.652052 29123 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.54.66:34329 every 8 connection(s)
I20260709 13:09:20.658751 28889 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:20.667950 29128 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:20.668890 29127 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:20.674870 29124 heartbeater.cc:344] Connected to a master server at 127.28.54.126:37903
I20260709 13:09:20.675359 29124 heartbeater.cc:461] Registering TS with master...
W20260709 13:09:20.675874 29130 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:20.676298 29124 heartbeater.cc:507] Master 127.28.54.126:37903 requested a full tablet report, sending...
I20260709 13:09:20.676854 28889 server_base.cc:1061] running on GCE node
I20260709 13:09:20.677814 28889 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:20.678061 28889 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:20.678222 28889 hybrid_clock.cc:648] HybridClock initialized: now 1783602560678203 us; error 0 us; skew 500 ppm
I20260709 13:09:20.678526 28921 ts_manager.cc:194] Registered new tserver with Master: 1b1cd51a6e4f49c88eb2d118d294d565 (127.28.54.66:34329)
I20260709 13:09:20.678715 28889 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:20.680209 28921 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54222
I20260709 13:09:20.681329 28889 webserver.cc:533] Webserver started at http://127.28.54.67:37941/ using document root <none> and password file <none>
I20260709 13:09:20.681895 28889 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:20.682147 28889 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:20.682459 28889 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:20.683523 28889 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602558744475-28889-0/minicluster-data/ts-2-root/instance:
uuid: "b675cc11b2dc4c9580b7b61dee8e4333"
format_stamp: "Formatted at 2026-07-09 13:09:20 on dist-test-slave-vpdx"
I20260709 13:09:20.687836 28889 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:09:20.691062 29135 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:20.691927 28889 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:09:20.692279 28889 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602558744475-28889-0/minicluster-data/ts-2-root
uuid: "b675cc11b2dc4c9580b7b61dee8e4333"
format_stamp: "Formatted at 2026-07-09 13:09:20 on dist-test-slave-vpdx"
I20260709 13:09:20.692625 28889 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602558744475-28889-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602558744475-28889-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783602558744475-28889-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:20.706616 28889 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:20.708207 28889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:20.710610 28889 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:20.714119 28889 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:20.714419 28889 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:20.714697 28889 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:20.714917 28889 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:20.795447 28889 rpc_server.cc:307] RPC server started. Bound to: 127.28.54.67:41555
I20260709 13:09:20.795514 29197 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.54.67:41555 every 8 connection(s)
I20260709 13:09:20.811527 29198 heartbeater.cc:344] Connected to a master server at 127.28.54.126:37903
I20260709 13:09:20.811888 29198 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:20.812635 29198 heartbeater.cc:507] Master 127.28.54.126:37903 requested a full tablet report, sending...
I20260709 13:09:20.814502 28921 ts_manager.cc:194] Registered new tserver with Master: b675cc11b2dc4c9580b7b61dee8e4333 (127.28.54.67:41555)
I20260709 13:09:20.815291 28889 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014480162s
I20260709 13:09:20.815814 28921 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54234
I20260709 13:09:20.862675 28921 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54244:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:09:20.866248 28921 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:09:20.957906 29014 tablet_service.cc:1511] Processing CreateTablet for tablet 22db5056ecf74660ba332b5eef197747 (DEFAULT_TABLE table=test-workload [id=1d455f6c68de428aa030cad900abb157]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:20.959483 29014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22db5056ecf74660ba332b5eef197747. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:20.965060 29013 tablet_service.cc:1511] Processing CreateTablet for tablet ccbfc50ea0d341fd975dd116645a8437 (DEFAULT_TABLE table=test-workload [id=1d455f6c68de428aa030cad900abb157]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:20.966419 29013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccbfc50ea0d341fd975dd116645a8437. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:20.969851 29012 tablet_service.cc:1511] Processing CreateTablet for tablet ca468a14f9ad47fc83c2fd8cca868e02 (DEFAULT_TABLE table=test-workload [id=1d455f6c68de428aa030cad900abb157]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:20.970914 29162 tablet_service.cc:1511] Processing CreateTablet for tablet ccbfc50ea0d341fd975dd116645a8437 (DEFAULT_TABLE table=test-workload [id=1d455f6c68de428aa030cad900abb157]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:20.971256 29163 tablet_service.cc:1511] Processing CreateTablet for tablet 22db5056ecf74660ba332b5eef197747 (DEFAULT_TABLE table=test-workload [id=1d455f6c68de428aa030cad900abb157]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:20.972266 29162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccbfc50ea0d341fd975dd116645a8437. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:20.972409 29011 tablet_service.cc:1511] Processing CreateTablet for tablet f593a7e12d394520ac84b9cb01f8a445 (DEFAULT_TABLE table=test-workload [id=1d455f6c68de428aa030cad900abb157]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:20.972903 29163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22db5056ecf74660ba332b5eef197747. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:20.971278 29012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca468a14f9ad47fc83c2fd8cca868e02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:20.975122 29011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f593a7e12d394520ac84b9cb01f8a445. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:20.977588 29161 tablet_service.cc:1511] Processing CreateTablet for tablet ca468a14f9ad47fc83c2fd8cca868e02 (DEFAULT_TABLE table=test-workload [id=1d455f6c68de428aa030cad900abb157]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:20.980351 29161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca468a14f9ad47fc83c2fd8cca868e02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:20.987447 29160 tablet_service.cc:1511] Processing CreateTablet for tablet f593a7e12d394520ac84b9cb01f8a445 (DEFAULT_TABLE table=test-workload [id=1d455f6c68de428aa030cad900abb157]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:20.991659 29160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f593a7e12d394520ac84b9cb01f8a445. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:20.991143 29010 tablet_service.cc:1511] Processing CreateTablet for tablet 8ef2753d7f6f46e68a0ec3be338f525b (DEFAULT_TABLE table=test-workload [id=1d455f6c68de428aa030cad900abb157]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:20.995790 29010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ef2753d7f6f46e68a0ec3be338f525b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:21.006565 29159 tablet_service.cc:1511] Processing CreateTablet for tablet 8ef2753d7f6f46e68a0ec3be338f525b (DEFAULT_TABLE table=test-workload [id=1d455f6c68de428aa030cad900abb157]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:21.010151 29159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ef2753d7f6f46e68a0ec3be338f525b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:21.036135 29009 tablet_service.cc:1511] Processing CreateTablet for tablet eadbdd1c8352482bbaeb320f048b6a27 (DEFAULT_TABLE table=test-workload [id=1d455f6c68de428aa030cad900abb157]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:21.047169 29087 tablet_service.cc:1511] Processing CreateTablet for tablet ca468a14f9ad47fc83c2fd8cca868e02 (DEFAULT_TABLE table=test-workload [id=1d455f6c68de428aa030cad900abb157]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:09:21.045744 29009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eadbdd1c8352482bbaeb320f048b6a27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:21.053954 29086 tablet_service.cc:1511] Processing CreateTablet for tablet f593a7e12d394520ac84b9cb01f8a445 (DEFAULT_TABLE table=test-workload [id=1d455f6c68de428aa030cad900abb157]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:09:21.058954 29087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca468a14f9ad47fc83c2fd8cca868e02. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:21.061455 29086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f593a7e12d394520ac84b9cb01f8a445. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:21.062918 29088 tablet_service.cc:1511] Processing CreateTablet for tablet ccbfc50ea0d341fd975dd116645a8437 (DEFAULT_TABLE table=test-workload [id=1d455f6c68de428aa030cad900abb157]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:09:21.063089 29089 tablet_service.cc:1511] Processing CreateTablet for tablet 22db5056ecf74660ba332b5eef197747 (DEFAULT_TABLE table=test-workload [id=1d455f6c68de428aa030cad900abb157]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:09:21.066425 29089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22db5056ecf74660ba332b5eef197747. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:21.061383 29085 tablet_service.cc:1511] Processing CreateTablet for tablet 8ef2753d7f6f46e68a0ec3be338f525b (DEFAULT_TABLE table=test-workload [id=1d455f6c68de428aa030cad900abb157]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:09:21.068622 29088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ccbfc50ea0d341fd975dd116645a8437. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:21.072242 29085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ef2753d7f6f46e68a0ec3be338f525b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:21.074718 29084 tablet_service.cc:1511] Processing CreateTablet for tablet eadbdd1c8352482bbaeb320f048b6a27 (DEFAULT_TABLE table=test-workload [id=1d455f6c68de428aa030cad900abb157]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:21.072247 29216 tablet_bootstrap.cc:492] T 22db5056ecf74660ba332b5eef197747 P ade6fdeec548419dafe0d8c727ea9db7: Bootstrap starting.
I20260709 13:09:21.080978 29084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eadbdd1c8352482bbaeb320f048b6a27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:21.083341 29158 tablet_service.cc:1511] Processing CreateTablet for tablet eadbdd1c8352482bbaeb320f048b6a27 (DEFAULT_TABLE table=test-workload [id=1d455f6c68de428aa030cad900abb157]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:09:21.085095 29158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eadbdd1c8352482bbaeb320f048b6a27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:21.126948 29010 tablet_service.cc:1511] Processing CreateTablet for tablet 64cf35d356a841d6875cbb4106b48f49 (DEFAULT_TABLE table=test-workload [id=1d455f6c68de428aa030cad900abb157]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:21.128707 29010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64cf35d356a841d6875cbb4106b48f49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:21.134729 29083 tablet_service.cc:1511] Processing CreateTablet for tablet 64cf35d356a841d6875cbb4106b48f49 (DEFAULT_TABLE table=test-workload [id=1d455f6c68de428aa030cad900abb157]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:21.136943 29083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64cf35d356a841d6875cbb4106b48f49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:21.138612 29159 tablet_service.cc:1511] Processing CreateTablet for tablet 64cf35d356a841d6875cbb4106b48f49 (DEFAULT_TABLE table=test-workload [id=1d455f6c68de428aa030cad900abb157]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:09:21.141321 29159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64cf35d356a841d6875cbb4106b48f49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:21.149083 29217 tablet_bootstrap.cc:492] T 8ef2753d7f6f46e68a0ec3be338f525b P b675cc11b2dc4c9580b7b61dee8e4333: Bootstrap starting.
I20260709 13:09:21.167186 29009 tablet_service.cc:1511] Processing CreateTablet for tablet 51c6d4bc6ab749eebcd70e632a6c8c08 (DEFAULT_TABLE table=test-workload [id=1d455f6c68de428aa030cad900abb157]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:21.168218 29009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51c6d4bc6ab749eebcd70e632a6c8c08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:21.168844 29085 tablet_service.cc:1511] Processing CreateTablet for tablet 51c6d4bc6ab749eebcd70e632a6c8c08 (DEFAULT_TABLE table=test-workload [id=1d455f6c68de428aa030cad900abb157]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:21.172441 29162 tablet_service.cc:1511] Processing CreateTablet for tablet 51c6d4bc6ab749eebcd70e632a6c8c08 (DEFAULT_TABLE table=test-workload [id=1d455f6c68de428aa030cad900abb157]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:09:21.173604 29216 tablet_bootstrap.cc:654] T 22db5056ecf74660ba332b5eef197747 P ade6fdeec548419dafe0d8c727ea9db7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:21.170015 29085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51c6d4bc6ab749eebcd70e632a6c8c08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:21.179137 29011 tablet_service.cc:1511] Processing CreateTablet for tablet 53af9481634c45f5a2cf52f3b93047d1 (DEFAULT_TABLE table=test-workload [id=1d455f6c68de428aa030cad900abb157]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:21.180914 29217 tablet_bootstrap.cc:654] T 8ef2753d7f6f46e68a0ec3be338f525b P b675cc11b2dc4c9580b7b61dee8e4333: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:21.181258 29011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53af9481634c45f5a2cf52f3b93047d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:21.182035 29089 tablet_service.cc:1511] Processing CreateTablet for tablet 53af9481634c45f5a2cf52f3b93047d1 (DEFAULT_TABLE table=test-workload [id=1d455f6c68de428aa030cad900abb157]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:21.185003 29089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53af9481634c45f5a2cf52f3b93047d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:21.183317 29163 tablet_service.cc:1511] Processing CreateTablet for tablet 53af9481634c45f5a2cf52f3b93047d1 (DEFAULT_TABLE table=test-workload [id=1d455f6c68de428aa030cad900abb157]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:09:21.186702 29218 tablet_bootstrap.cc:492] T 22db5056ecf74660ba332b5eef197747 P 1b1cd51a6e4f49c88eb2d118d294d565: Bootstrap starting.
I20260709 13:09:21.183594 29162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 51c6d4bc6ab749eebcd70e632a6c8c08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:21.195230 29163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 53af9481634c45f5a2cf52f3b93047d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:21.213114 29218 tablet_bootstrap.cc:654] T 22db5056ecf74660ba332b5eef197747 P 1b1cd51a6e4f49c88eb2d118d294d565: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:21.220520 29217 tablet_bootstrap.cc:492] T 8ef2753d7f6f46e68a0ec3be338f525b P b675cc11b2dc4c9580b7b61dee8e4333: No bootstrap required, opened a new log
I20260709 13:09:21.221585 29217 ts_tablet_manager.cc:1403] T 8ef2753d7f6f46e68a0ec3be338f525b P b675cc11b2dc4c9580b7b61dee8e4333: Time spent bootstrapping tablet: real 0.093s	user 0.016s	sys 0.000s
I20260709 13:09:21.225271 29217 raft_consensus.cc:359] T 8ef2753d7f6f46e68a0ec3be338f525b P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.226025 29217 raft_consensus.cc:385] T 8ef2753d7f6f46e68a0ec3be338f525b P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:21.226320 29217 raft_consensus.cc:740] T 8ef2753d7f6f46e68a0ec3be338f525b P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b675cc11b2dc4c9580b7b61dee8e4333, State: Initialized, Role: FOLLOWER
I20260709 13:09:21.227057 29217 consensus_queue.cc:260] T 8ef2753d7f6f46e68a0ec3be338f525b P b675cc11b2dc4c9580b7b61dee8e4333 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.231398 29216 tablet_bootstrap.cc:492] T 22db5056ecf74660ba332b5eef197747 P ade6fdeec548419dafe0d8c727ea9db7: No bootstrap required, opened a new log
I20260709 13:09:21.231834 29216 ts_tablet_manager.cc:1403] T 22db5056ecf74660ba332b5eef197747 P ade6fdeec548419dafe0d8c727ea9db7: Time spent bootstrapping tablet: real 0.176s	user 0.013s	sys 0.013s
I20260709 13:09:21.245649 29198 heartbeater.cc:499] Master 127.28.54.126:37903 was elected leader, sending a full tablet report...
I20260709 13:09:21.246838 29218 tablet_bootstrap.cc:492] T 22db5056ecf74660ba332b5eef197747 P 1b1cd51a6e4f49c88eb2d118d294d565: No bootstrap required, opened a new log
I20260709 13:09:21.247289 29218 ts_tablet_manager.cc:1403] T 22db5056ecf74660ba332b5eef197747 P 1b1cd51a6e4f49c88eb2d118d294d565: Time spent bootstrapping tablet: real 0.061s	user 0.016s	sys 0.010s
I20260709 13:09:21.248180 29217 ts_tablet_manager.cc:1434] T 8ef2753d7f6f46e68a0ec3be338f525b P b675cc11b2dc4c9580b7b61dee8e4333: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 13:09:21.249095 29217 tablet_bootstrap.cc:492] T ca468a14f9ad47fc83c2fd8cca868e02 P b675cc11b2dc4c9580b7b61dee8e4333: Bootstrap starting.
I20260709 13:09:21.250056 29218 raft_consensus.cc:359] T 22db5056ecf74660ba332b5eef197747 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } }
I20260709 13:09:21.250752 29218 raft_consensus.cc:385] T 22db5056ecf74660ba332b5eef197747 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:21.251048 29218 raft_consensus.cc:740] T 22db5056ecf74660ba332b5eef197747 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b1cd51a6e4f49c88eb2d118d294d565, State: Initialized, Role: FOLLOWER
I20260709 13:09:21.251761 29218 consensus_queue.cc:260] T 22db5056ecf74660ba332b5eef197747 P 1b1cd51a6e4f49c88eb2d118d294d565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } }
I20260709 13:09:21.255741 29217 tablet_bootstrap.cc:654] T ca468a14f9ad47fc83c2fd8cca868e02 P b675cc11b2dc4c9580b7b61dee8e4333: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:21.246820 29216 raft_consensus.cc:359] T 22db5056ecf74660ba332b5eef197747 P ade6fdeec548419dafe0d8c727ea9db7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } }
I20260709 13:09:21.260246 29216 raft_consensus.cc:385] T 22db5056ecf74660ba332b5eef197747 P ade6fdeec548419dafe0d8c727ea9db7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:21.260571 29216 raft_consensus.cc:740] T 22db5056ecf74660ba332b5eef197747 P ade6fdeec548419dafe0d8c727ea9db7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade6fdeec548419dafe0d8c727ea9db7, State: Initialized, Role: FOLLOWER
I20260709 13:09:21.261365 29216 consensus_queue.cc:260] T 22db5056ecf74660ba332b5eef197747 P ade6fdeec548419dafe0d8c727ea9db7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } }
W20260709 13:09:21.266252 28969 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:21.275887 29217 tablet_bootstrap.cc:492] T ca468a14f9ad47fc83c2fd8cca868e02 P b675cc11b2dc4c9580b7b61dee8e4333: No bootstrap required, opened a new log
I20260709 13:09:21.276402 29217 ts_tablet_manager.cc:1403] T ca468a14f9ad47fc83c2fd8cca868e02 P b675cc11b2dc4c9580b7b61dee8e4333: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.000s
I20260709 13:09:21.277299 29124 heartbeater.cc:499] Master 127.28.54.126:37903 was elected leader, sending a full tablet report...
I20260709 13:09:21.277892 29218 ts_tablet_manager.cc:1434] T 22db5056ecf74660ba332b5eef197747 P 1b1cd51a6e4f49c88eb2d118d294d565: Time spent starting tablet: real 0.030s	user 0.019s	sys 0.012s
I20260709 13:09:21.278849 29218 tablet_bootstrap.cc:492] T ca468a14f9ad47fc83c2fd8cca868e02 P 1b1cd51a6e4f49c88eb2d118d294d565: Bootstrap starting.
I20260709 13:09:21.279377 29217 raft_consensus.cc:359] T ca468a14f9ad47fc83c2fd8cca868e02 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.280135 29217 raft_consensus.cc:385] T ca468a14f9ad47fc83c2fd8cca868e02 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:21.280609 29217 raft_consensus.cc:740] T ca468a14f9ad47fc83c2fd8cca868e02 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b675cc11b2dc4c9580b7b61dee8e4333, State: Initialized, Role: FOLLOWER
I20260709 13:09:21.281355 29217 consensus_queue.cc:260] T ca468a14f9ad47fc83c2fd8cca868e02 P b675cc11b2dc4c9580b7b61dee8e4333 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.283706 29217 ts_tablet_manager.cc:1434] T ca468a14f9ad47fc83c2fd8cca868e02 P b675cc11b2dc4c9580b7b61dee8e4333: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:21.284559 29217 tablet_bootstrap.cc:492] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333: Bootstrap starting.
I20260709 13:09:21.285621 29218 tablet_bootstrap.cc:654] T ca468a14f9ad47fc83c2fd8cca868e02 P 1b1cd51a6e4f49c88eb2d118d294d565: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:21.290673 29217 tablet_bootstrap.cc:654] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:21.297511 29218 tablet_bootstrap.cc:492] T ca468a14f9ad47fc83c2fd8cca868e02 P 1b1cd51a6e4f49c88eb2d118d294d565: No bootstrap required, opened a new log
I20260709 13:09:21.298020 29218 ts_tablet_manager.cc:1403] T ca468a14f9ad47fc83c2fd8cca868e02 P 1b1cd51a6e4f49c88eb2d118d294d565: Time spent bootstrapping tablet: real 0.019s	user 0.007s	sys 0.011s
I20260709 13:09:21.301043 29218 raft_consensus.cc:359] T ca468a14f9ad47fc83c2fd8cca868e02 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.301923 29218 raft_consensus.cc:385] T ca468a14f9ad47fc83c2fd8cca868e02 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:21.302237 29218 raft_consensus.cc:740] T ca468a14f9ad47fc83c2fd8cca868e02 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b1cd51a6e4f49c88eb2d118d294d565, State: Initialized, Role: FOLLOWER
I20260709 13:09:21.302956 29218 consensus_queue.cc:260] T ca468a14f9ad47fc83c2fd8cca868e02 P 1b1cd51a6e4f49c88eb2d118d294d565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.305300 29218 ts_tablet_manager.cc:1434] T ca468a14f9ad47fc83c2fd8cca868e02 P 1b1cd51a6e4f49c88eb2d118d294d565: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:21.306234 29218 tablet_bootstrap.cc:492] T 8ef2753d7f6f46e68a0ec3be338f525b P 1b1cd51a6e4f49c88eb2d118d294d565: Bootstrap starting.
W20260709 13:09:21.306232 29199 tablet.cc:2406] T 8ef2753d7f6f46e68a0ec3be338f525b P b675cc11b2dc4c9580b7b61dee8e4333: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:09:21.312521 29217 tablet_bootstrap.cc:492] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333: No bootstrap required, opened a new log
I20260709 13:09:21.313012 29217 ts_tablet_manager.cc:1403] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.015s
I20260709 13:09:21.313151 29223 raft_consensus.cc:493] T ca468a14f9ad47fc83c2fd8cca868e02 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.313687 29223 raft_consensus.cc:515] T ca468a14f9ad47fc83c2fd8cca868e02 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.315090 29049 heartbeater.cc:499] Master 127.28.54.126:37903 was elected leader, sending a full tablet report...
I20260709 13:09:21.316787 29223 leader_election.cc:290] T ca468a14f9ad47fc83c2fd8cca868e02 P 1b1cd51a6e4f49c88eb2d118d294d565 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ade6fdeec548419dafe0d8c727ea9db7 (127.28.54.65:37211), b675cc11b2dc4c9580b7b61dee8e4333 (127.28.54.67:41555)
I20260709 13:09:21.319247 29218 tablet_bootstrap.cc:654] T 8ef2753d7f6f46e68a0ec3be338f525b P 1b1cd51a6e4f49c88eb2d118d294d565: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:21.319620 29216 ts_tablet_manager.cc:1434] T 22db5056ecf74660ba332b5eef197747 P ade6fdeec548419dafe0d8c727ea9db7: Time spent starting tablet: real 0.087s	user 0.033s	sys 0.022s
I20260709 13:09:21.326419 29216 tablet_bootstrap.cc:492] T ccbfc50ea0d341fd975dd116645a8437 P ade6fdeec548419dafe0d8c727ea9db7: Bootstrap starting.
I20260709 13:09:21.325491 29217 raft_consensus.cc:359] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.332542 29217 raft_consensus.cc:385] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:21.332840 29217 raft_consensus.cc:740] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b675cc11b2dc4c9580b7b61dee8e4333, State: Initialized, Role: FOLLOWER
I20260709 13:09:21.333567 29217 consensus_queue.cc:260] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.346119 29216 tablet_bootstrap.cc:654] T ccbfc50ea0d341fd975dd116645a8437 P ade6fdeec548419dafe0d8c727ea9db7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:21.348659 29217 ts_tablet_manager.cc:1434] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333: Time spent starting tablet: real 0.035s	user 0.000s	sys 0.007s
I20260709 13:09:21.349643 29217 tablet_bootstrap.cc:492] T ccbfc50ea0d341fd975dd116645a8437 P b675cc11b2dc4c9580b7b61dee8e4333: Bootstrap starting.
I20260709 13:09:21.365336 29024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca468a14f9ad47fc83c2fd8cca868e02" candidate_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade6fdeec548419dafe0d8c727ea9db7" is_pre_election: true
I20260709 13:09:21.366166 29216 tablet_bootstrap.cc:492] T ccbfc50ea0d341fd975dd116645a8437 P ade6fdeec548419dafe0d8c727ea9db7: No bootstrap required, opened a new log
I20260709 13:09:21.367077 29216 ts_tablet_manager.cc:1403] T ccbfc50ea0d341fd975dd116645a8437 P ade6fdeec548419dafe0d8c727ea9db7: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.005s
W20260709 13:09:21.367424 29063 leader_election.cc:343] T ca468a14f9ad47fc83c2fd8cca868e02 P 1b1cd51a6e4f49c88eb2d118d294d565 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ade6fdeec548419dafe0d8c727ea9db7 (127.28.54.65:37211): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:21.369514 29216 raft_consensus.cc:359] T ccbfc50ea0d341fd975dd116645a8437 P ade6fdeec548419dafe0d8c727ea9db7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.370208 29216 raft_consensus.cc:385] T ccbfc50ea0d341fd975dd116645a8437 P ade6fdeec548419dafe0d8c727ea9db7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:21.370492 29216 raft_consensus.cc:740] T ccbfc50ea0d341fd975dd116645a8437 P ade6fdeec548419dafe0d8c727ea9db7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade6fdeec548419dafe0d8c727ea9db7, State: Initialized, Role: FOLLOWER
I20260709 13:09:21.371533 29216 consensus_queue.cc:260] T ccbfc50ea0d341fd975dd116645a8437 P ade6fdeec548419dafe0d8c727ea9db7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.372332 29217 tablet_bootstrap.cc:654] T ccbfc50ea0d341fd975dd116645a8437 P b675cc11b2dc4c9580b7b61dee8e4333: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:21.373245 29173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca468a14f9ad47fc83c2fd8cca868e02" candidate_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" is_pre_election: true
I20260709 13:09:21.373521 29216 ts_tablet_manager.cc:1434] T ccbfc50ea0d341fd975dd116645a8437 P ade6fdeec548419dafe0d8c727ea9db7: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 13:09:21.374094 29173 raft_consensus.cc:2468] T ca468a14f9ad47fc83c2fd8cca868e02 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1b1cd51a6e4f49c88eb2d118d294d565 in term 0.
I20260709 13:09:21.374524 29216 tablet_bootstrap.cc:492] T ca468a14f9ad47fc83c2fd8cca868e02 P ade6fdeec548419dafe0d8c727ea9db7: Bootstrap starting.
I20260709 13:09:21.375721 29064 leader_election.cc:304] T ca468a14f9ad47fc83c2fd8cca868e02 P 1b1cd51a6e4f49c88eb2d118d294d565 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1b1cd51a6e4f49c88eb2d118d294d565, b675cc11b2dc4c9580b7b61dee8e4333; no voters: ade6fdeec548419dafe0d8c727ea9db7
I20260709 13:09:21.376529 29223 raft_consensus.cc:2804] T ca468a14f9ad47fc83c2fd8cca868e02 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:21.376868 29223 raft_consensus.cc:493] T ca468a14f9ad47fc83c2fd8cca868e02 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.377177 29223 raft_consensus.cc:3060] T ca468a14f9ad47fc83c2fd8cca868e02 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:21.378409 29218 tablet_bootstrap.cc:492] T 8ef2753d7f6f46e68a0ec3be338f525b P 1b1cd51a6e4f49c88eb2d118d294d565: No bootstrap required, opened a new log
I20260709 13:09:21.378882 29218 ts_tablet_manager.cc:1403] T 8ef2753d7f6f46e68a0ec3be338f525b P 1b1cd51a6e4f49c88eb2d118d294d565: Time spent bootstrapping tablet: real 0.073s	user 0.037s	sys 0.001s
I20260709 13:09:21.381711 29218 raft_consensus.cc:359] T 8ef2753d7f6f46e68a0ec3be338f525b P 1b1cd51a6e4f49c88eb2d118d294d565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.382439 29218 raft_consensus.cc:385] T 8ef2753d7f6f46e68a0ec3be338f525b P 1b1cd51a6e4f49c88eb2d118d294d565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:21.382737 29218 raft_consensus.cc:740] T 8ef2753d7f6f46e68a0ec3be338f525b P 1b1cd51a6e4f49c88eb2d118d294d565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b1cd51a6e4f49c88eb2d118d294d565, State: Initialized, Role: FOLLOWER
I20260709 13:09:21.383492 29223 raft_consensus.cc:515] T ca468a14f9ad47fc83c2fd8cca868e02 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.383517 29218 consensus_queue.cc:260] T 8ef2753d7f6f46e68a0ec3be338f525b P 1b1cd51a6e4f49c88eb2d118d294d565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.386089 29024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca468a14f9ad47fc83c2fd8cca868e02" candidate_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade6fdeec548419dafe0d8c727ea9db7"
W20260709 13:09:21.387401 29063 leader_election.cc:343] T ca468a14f9ad47fc83c2fd8cca868e02 P 1b1cd51a6e4f49c88eb2d118d294d565 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ade6fdeec548419dafe0d8c727ea9db7 (127.28.54.65:37211): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:21.388058 29223 leader_election.cc:290] T ca468a14f9ad47fc83c2fd8cca868e02 P 1b1cd51a6e4f49c88eb2d118d294d565 [CANDIDATE]: Term 1 election: Requested vote from peers ade6fdeec548419dafe0d8c727ea9db7 (127.28.54.65:37211), b675cc11b2dc4c9580b7b61dee8e4333 (127.28.54.67:41555)
I20260709 13:09:21.388178 29217 tablet_bootstrap.cc:492] T ccbfc50ea0d341fd975dd116645a8437 P b675cc11b2dc4c9580b7b61dee8e4333: No bootstrap required, opened a new log
I20260709 13:09:21.388989 29173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca468a14f9ad47fc83c2fd8cca868e02" candidate_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b675cc11b2dc4c9580b7b61dee8e4333"
I20260709 13:09:21.390413 29173 raft_consensus.cc:3060] T ca468a14f9ad47fc83c2fd8cca868e02 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:21.393183 29216 tablet_bootstrap.cc:654] T ca468a14f9ad47fc83c2fd8cca868e02 P ade6fdeec548419dafe0d8c727ea9db7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:21.397157 29173 raft_consensus.cc:2468] T ca468a14f9ad47fc83c2fd8cca868e02 P b675cc11b2dc4c9580b7b61dee8e4333 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b1cd51a6e4f49c88eb2d118d294d565 in term 1.
I20260709 13:09:21.398020 29218 ts_tablet_manager.cc:1434] T 8ef2753d7f6f46e68a0ec3be338f525b P 1b1cd51a6e4f49c88eb2d118d294d565: Time spent starting tablet: real 0.019s	user 0.012s	sys 0.000s
I20260709 13:09:21.398315 29064 leader_election.cc:304] T ca468a14f9ad47fc83c2fd8cca868e02 P 1b1cd51a6e4f49c88eb2d118d294d565 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1b1cd51a6e4f49c88eb2d118d294d565, b675cc11b2dc4c9580b7b61dee8e4333; no voters: ade6fdeec548419dafe0d8c727ea9db7
I20260709 13:09:21.399080 29218 tablet_bootstrap.cc:492] T eadbdd1c8352482bbaeb320f048b6a27 P 1b1cd51a6e4f49c88eb2d118d294d565: Bootstrap starting.
I20260709 13:09:21.399458 29217 ts_tablet_manager.cc:1403] T ccbfc50ea0d341fd975dd116645a8437 P b675cc11b2dc4c9580b7b61dee8e4333: Time spent bootstrapping tablet: real 0.050s	user 0.004s	sys 0.019s
I20260709 13:09:21.402225 29217 raft_consensus.cc:359] T ccbfc50ea0d341fd975dd116645a8437 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.402900 29217 raft_consensus.cc:385] T ccbfc50ea0d341fd975dd116645a8437 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:21.403213 29217 raft_consensus.cc:740] T ccbfc50ea0d341fd975dd116645a8437 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b675cc11b2dc4c9580b7b61dee8e4333, State: Initialized, Role: FOLLOWER
I20260709 13:09:21.403891 29223 raft_consensus.cc:2804] T ca468a14f9ad47fc83c2fd8cca868e02 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:21.404330 29223 raft_consensus.cc:697] T ca468a14f9ad47fc83c2fd8cca868e02 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 1 LEADER]: Becoming Leader. State: Replica: 1b1cd51a6e4f49c88eb2d118d294d565, State: Running, Role: LEADER
I20260709 13:09:21.405053 29223 consensus_queue.cc:237] T ca468a14f9ad47fc83c2fd8cca868e02 P 1b1cd51a6e4f49c88eb2d118d294d565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.405949 29216 tablet_bootstrap.cc:492] T ca468a14f9ad47fc83c2fd8cca868e02 P ade6fdeec548419dafe0d8c727ea9db7: No bootstrap required, opened a new log
I20260709 13:09:21.406364 29216 ts_tablet_manager.cc:1403] T ca468a14f9ad47fc83c2fd8cca868e02 P ade6fdeec548419dafe0d8c727ea9db7: Time spent bootstrapping tablet: real 0.032s	user 0.006s	sys 0.007s
I20260709 13:09:21.407719 29218 tablet_bootstrap.cc:654] T eadbdd1c8352482bbaeb320f048b6a27 P 1b1cd51a6e4f49c88eb2d118d294d565: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:21.409471 29216 raft_consensus.cc:359] T ca468a14f9ad47fc83c2fd8cca868e02 P ade6fdeec548419dafe0d8c727ea9db7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.410166 29216 raft_consensus.cc:385] T ca468a14f9ad47fc83c2fd8cca868e02 P ade6fdeec548419dafe0d8c727ea9db7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:21.410454 29216 raft_consensus.cc:740] T ca468a14f9ad47fc83c2fd8cca868e02 P ade6fdeec548419dafe0d8c727ea9db7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade6fdeec548419dafe0d8c727ea9db7, State: Initialized, Role: FOLLOWER
I20260709 13:09:21.411092 29217 consensus_queue.cc:260] T ccbfc50ea0d341fd975dd116645a8437 P b675cc11b2dc4c9580b7b61dee8e4333 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.411288 29216 consensus_queue.cc:260] T ca468a14f9ad47fc83c2fd8cca868e02 P ade6fdeec548419dafe0d8c727ea9db7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.412010 29222 raft_consensus.cc:493] T ccbfc50ea0d341fd975dd116645a8437 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.412436 29222 raft_consensus.cc:515] T ccbfc50ea0d341fd975dd116645a8437 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.413584 29216 ts_tablet_manager.cc:1434] T ca468a14f9ad47fc83c2fd8cca868e02 P ade6fdeec548419dafe0d8c727ea9db7: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:21.418224 29222 leader_election.cc:290] T ccbfc50ea0d341fd975dd116645a8437 P b675cc11b2dc4c9580b7b61dee8e4333 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ade6fdeec548419dafe0d8c727ea9db7 (127.28.54.65:37211), 1b1cd51a6e4f49c88eb2d118d294d565 (127.28.54.66:34329)
I20260709 13:09:21.422935 29216 tablet_bootstrap.cc:492] T 8ef2753d7f6f46e68a0ec3be338f525b P ade6fdeec548419dafe0d8c727ea9db7: Bootstrap starting.
I20260709 13:09:21.424678 29217 ts_tablet_manager.cc:1434] T ccbfc50ea0d341fd975dd116645a8437 P b675cc11b2dc4c9580b7b61dee8e4333: Time spent starting tablet: real 0.025s	user 0.000s	sys 0.005s
I20260709 13:09:21.425575 29217 tablet_bootstrap.cc:492] T 22db5056ecf74660ba332b5eef197747 P b675cc11b2dc4c9580b7b61dee8e4333: Bootstrap starting.
I20260709 13:09:21.430764 29218 tablet_bootstrap.cc:492] T eadbdd1c8352482bbaeb320f048b6a27 P 1b1cd51a6e4f49c88eb2d118d294d565: No bootstrap required, opened a new log
I20260709 13:09:21.432466 29218 ts_tablet_manager.cc:1403] T eadbdd1c8352482bbaeb320f048b6a27 P 1b1cd51a6e4f49c88eb2d118d294d565: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.007s
I20260709 13:09:21.436570 29217 tablet_bootstrap.cc:654] T 22db5056ecf74660ba332b5eef197747 P b675cc11b2dc4c9580b7b61dee8e4333: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:21.441491 28921 catalog_manager.cc:5697] T ca468a14f9ad47fc83c2fd8cca868e02 P 1b1cd51a6e4f49c88eb2d118d294d565 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1b1cd51a6e4f49c88eb2d118d294d565 (127.28.54.66). New cstate: current_term: 1 leader_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:21.436400 29218 raft_consensus.cc:359] T eadbdd1c8352482bbaeb320f048b6a27 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.443068 29218 raft_consensus.cc:385] T eadbdd1c8352482bbaeb320f048b6a27 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:21.443428 29218 raft_consensus.cc:740] T eadbdd1c8352482bbaeb320f048b6a27 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b1cd51a6e4f49c88eb2d118d294d565, State: Initialized, Role: FOLLOWER
I20260709 13:09:21.447538 29218 consensus_queue.cc:260] T eadbdd1c8352482bbaeb320f048b6a27 P 1b1cd51a6e4f49c88eb2d118d294d565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.448412 29217 tablet_bootstrap.cc:492] T 22db5056ecf74660ba332b5eef197747 P b675cc11b2dc4c9580b7b61dee8e4333: No bootstrap required, opened a new log
I20260709 13:09:21.448875 29217 ts_tablet_manager.cc:1403] T 22db5056ecf74660ba332b5eef197747 P b675cc11b2dc4c9580b7b61dee8e4333: Time spent bootstrapping tablet: real 0.023s	user 0.006s	sys 0.011s
I20260709 13:09:21.450816 29218 ts_tablet_manager.cc:1434] T eadbdd1c8352482bbaeb320f048b6a27 P 1b1cd51a6e4f49c88eb2d118d294d565: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:09:21.455309 29099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbfc50ea0d341fd975dd116645a8437" candidate_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" is_pre_election: true
I20260709 13:09:21.451790 29217 raft_consensus.cc:359] T 22db5056ecf74660ba332b5eef197747 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } }
I20260709 13:09:21.456032 29217 raft_consensus.cc:385] T 22db5056ecf74660ba332b5eef197747 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:21.456388 29217 raft_consensus.cc:740] T 22db5056ecf74660ba332b5eef197747 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b675cc11b2dc4c9580b7b61dee8e4333, State: Initialized, Role: FOLLOWER
W20260709 13:09:21.456990 29139 leader_election.cc:343] T ccbfc50ea0d341fd975dd116645a8437 P b675cc11b2dc4c9580b7b61dee8e4333 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b1cd51a6e4f49c88eb2d118d294d565 (127.28.54.66:34329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:21.429255 29216 tablet_bootstrap.cc:654] T 8ef2753d7f6f46e68a0ec3be338f525b P ade6fdeec548419dafe0d8c727ea9db7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:21.457185 29217 consensus_queue.cc:260] T 22db5056ecf74660ba332b5eef197747 P b675cc11b2dc4c9580b7b61dee8e4333 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } }
I20260709 13:09:21.455644 29218 tablet_bootstrap.cc:492] T 64cf35d356a841d6875cbb4106b48f49 P 1b1cd51a6e4f49c88eb2d118d294d565: Bootstrap starting.
I20260709 13:09:21.459758 29217 ts_tablet_manager.cc:1434] T 22db5056ecf74660ba332b5eef197747 P b675cc11b2dc4c9580b7b61dee8e4333: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:09:21.460719 29217 tablet_bootstrap.cc:492] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333: Bootstrap starting.
I20260709 13:09:21.461897 29024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbfc50ea0d341fd975dd116645a8437" candidate_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade6fdeec548419dafe0d8c727ea9db7" is_pre_election: true
I20260709 13:09:21.462513 29024 raft_consensus.cc:2468] T ccbfc50ea0d341fd975dd116645a8437 P ade6fdeec548419dafe0d8c727ea9db7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b675cc11b2dc4c9580b7b61dee8e4333 in term 0.
I20260709 13:09:21.463882 29137 leader_election.cc:304] T ccbfc50ea0d341fd975dd116645a8437 P b675cc11b2dc4c9580b7b61dee8e4333 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ade6fdeec548419dafe0d8c727ea9db7, b675cc11b2dc4c9580b7b61dee8e4333; no voters: 1b1cd51a6e4f49c88eb2d118d294d565
I20260709 13:09:21.464605 29222 raft_consensus.cc:2804] T ccbfc50ea0d341fd975dd116645a8437 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:21.464936 29222 raft_consensus.cc:493] T ccbfc50ea0d341fd975dd116645a8437 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.465269 29222 raft_consensus.cc:3060] T ccbfc50ea0d341fd975dd116645a8437 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:21.467808 29217 tablet_bootstrap.cc:654] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:21.471205 29218 tablet_bootstrap.cc:654] T 64cf35d356a841d6875cbb4106b48f49 P 1b1cd51a6e4f49c88eb2d118d294d565: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:21.472352 29222 raft_consensus.cc:515] T ccbfc50ea0d341fd975dd116645a8437 P b675cc11b2dc4c9580b7b61dee8e4333 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.474326 29222 leader_election.cc:290] T ccbfc50ea0d341fd975dd116645a8437 P b675cc11b2dc4c9580b7b61dee8e4333 [CANDIDATE]: Term 1 election: Requested vote from peers ade6fdeec548419dafe0d8c727ea9db7 (127.28.54.65:37211), 1b1cd51a6e4f49c88eb2d118d294d565 (127.28.54.66:34329)
I20260709 13:09:21.475829 29099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbfc50ea0d341fd975dd116645a8437" candidate_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b1cd51a6e4f49c88eb2d118d294d565"
I20260709 13:09:21.476758 29024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbfc50ea0d341fd975dd116645a8437" candidate_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade6fdeec548419dafe0d8c727ea9db7"
W20260709 13:09:21.476914 29139 leader_election.cc:343] T ccbfc50ea0d341fd975dd116645a8437 P b675cc11b2dc4c9580b7b61dee8e4333 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1b1cd51a6e4f49c88eb2d118d294d565 (127.28.54.66:34329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:21.477285 29024 raft_consensus.cc:3060] T ccbfc50ea0d341fd975dd116645a8437 P ade6fdeec548419dafe0d8c727ea9db7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:21.482534 29024 raft_consensus.cc:2468] T ccbfc50ea0d341fd975dd116645a8437 P ade6fdeec548419dafe0d8c727ea9db7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b675cc11b2dc4c9580b7b61dee8e4333 in term 1.
I20260709 13:09:21.483645 29137 leader_election.cc:304] T ccbfc50ea0d341fd975dd116645a8437 P b675cc11b2dc4c9580b7b61dee8e4333 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ade6fdeec548419dafe0d8c727ea9db7, b675cc11b2dc4c9580b7b61dee8e4333; no voters: 1b1cd51a6e4f49c88eb2d118d294d565
I20260709 13:09:21.484385 29222 raft_consensus.cc:2804] T ccbfc50ea0d341fd975dd116645a8437 P b675cc11b2dc4c9580b7b61dee8e4333 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:21.486553 29217 tablet_bootstrap.cc:492] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333: No bootstrap required, opened a new log
I20260709 13:09:21.487013 29217 ts_tablet_manager.cc:1403] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.000s
I20260709 13:09:21.489738 29217 raft_consensus.cc:359] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.490159 29216 tablet_bootstrap.cc:492] T 8ef2753d7f6f46e68a0ec3be338f525b P ade6fdeec548419dafe0d8c727ea9db7: No bootstrap required, opened a new log
I20260709 13:09:21.490661 29216 ts_tablet_manager.cc:1403] T 8ef2753d7f6f46e68a0ec3be338f525b P ade6fdeec548419dafe0d8c727ea9db7: Time spent bootstrapping tablet: real 0.068s	user 0.010s	sys 0.004s
I20260709 13:09:21.493265 29216 raft_consensus.cc:359] T 8ef2753d7f6f46e68a0ec3be338f525b P ade6fdeec548419dafe0d8c727ea9db7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.493978 29216 raft_consensus.cc:385] T 8ef2753d7f6f46e68a0ec3be338f525b P ade6fdeec548419dafe0d8c727ea9db7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:21.494261 29216 raft_consensus.cc:740] T 8ef2753d7f6f46e68a0ec3be338f525b P ade6fdeec548419dafe0d8c727ea9db7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade6fdeec548419dafe0d8c727ea9db7, State: Initialized, Role: FOLLOWER
I20260709 13:09:21.495045 29216 consensus_queue.cc:260] T 8ef2753d7f6f46e68a0ec3be338f525b P ade6fdeec548419dafe0d8c727ea9db7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.495514 29222 raft_consensus.cc:697] T ccbfc50ea0d341fd975dd116645a8437 P b675cc11b2dc4c9580b7b61dee8e4333 [term 1 LEADER]: Becoming Leader. State: Replica: b675cc11b2dc4c9580b7b61dee8e4333, State: Running, Role: LEADER
I20260709 13:09:21.496250 29222 consensus_queue.cc:237] T ccbfc50ea0d341fd975dd116645a8437 P b675cc11b2dc4c9580b7b61dee8e4333 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.496935 29216 ts_tablet_manager.cc:1434] T 8ef2753d7f6f46e68a0ec3be338f525b P ade6fdeec548419dafe0d8c727ea9db7: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:09:21.499831 29218 tablet_bootstrap.cc:492] T 64cf35d356a841d6875cbb4106b48f49 P 1b1cd51a6e4f49c88eb2d118d294d565: No bootstrap required, opened a new log
I20260709 13:09:21.499925 29217 raft_consensus.cc:385] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:21.500336 29217 raft_consensus.cc:740] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b675cc11b2dc4c9580b7b61dee8e4333, State: Initialized, Role: FOLLOWER
I20260709 13:09:21.500458 29218 ts_tablet_manager.cc:1403] T 64cf35d356a841d6875cbb4106b48f49 P 1b1cd51a6e4f49c88eb2d118d294d565: Time spent bootstrapping tablet: real 0.045s	user 0.009s	sys 0.006s
I20260709 13:09:21.501549 29217 consensus_queue.cc:260] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.503686 29217 ts_tablet_manager.cc:1434] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:09:21.504549 29217 tablet_bootstrap.cc:492] T 51c6d4bc6ab749eebcd70e632a6c8c08 P b675cc11b2dc4c9580b7b61dee8e4333: Bootstrap starting.
I20260709 13:09:21.506904 29218 raft_consensus.cc:359] T 64cf35d356a841d6875cbb4106b48f49 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.507607 29218 raft_consensus.cc:385] T 64cf35d356a841d6875cbb4106b48f49 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:21.507899 29218 raft_consensus.cc:740] T 64cf35d356a841d6875cbb4106b48f49 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b1cd51a6e4f49c88eb2d118d294d565, State: Initialized, Role: FOLLOWER
I20260709 13:09:21.499842 29216 tablet_bootstrap.cc:492] T f593a7e12d394520ac84b9cb01f8a445 P ade6fdeec548419dafe0d8c727ea9db7: Bootstrap starting.
I20260709 13:09:21.516022 29216 tablet_bootstrap.cc:654] T f593a7e12d394520ac84b9cb01f8a445 P ade6fdeec548419dafe0d8c727ea9db7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:21.508577 29218 consensus_queue.cc:260] T 64cf35d356a841d6875cbb4106b48f49 P 1b1cd51a6e4f49c88eb2d118d294d565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.520133 29218 ts_tablet_manager.cc:1434] T 64cf35d356a841d6875cbb4106b48f49 P 1b1cd51a6e4f49c88eb2d118d294d565: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.007s
I20260709 13:09:21.520388 29217 tablet_bootstrap.cc:654] T 51c6d4bc6ab749eebcd70e632a6c8c08 P b675cc11b2dc4c9580b7b61dee8e4333: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:21.521276 29218 tablet_bootstrap.cc:492] T f593a7e12d394520ac84b9cb01f8a445 P 1b1cd51a6e4f49c88eb2d118d294d565: Bootstrap starting.
I20260709 13:09:21.528916 29217 tablet_bootstrap.cc:492] T 51c6d4bc6ab749eebcd70e632a6c8c08 P b675cc11b2dc4c9580b7b61dee8e4333: No bootstrap required, opened a new log
I20260709 13:09:21.529385 29217 ts_tablet_manager.cc:1403] T 51c6d4bc6ab749eebcd70e632a6c8c08 P b675cc11b2dc4c9580b7b61dee8e4333: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.000s
I20260709 13:09:21.532569 29217 raft_consensus.cc:359] T 51c6d4bc6ab749eebcd70e632a6c8c08 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.533263 29217 raft_consensus.cc:385] T 51c6d4bc6ab749eebcd70e632a6c8c08 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:21.534724 29218 tablet_bootstrap.cc:654] T f593a7e12d394520ac84b9cb01f8a445 P 1b1cd51a6e4f49c88eb2d118d294d565: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:21.538393 29216 tablet_bootstrap.cc:492] T f593a7e12d394520ac84b9cb01f8a445 P ade6fdeec548419dafe0d8c727ea9db7: No bootstrap required, opened a new log
I20260709 13:09:21.538820 29216 ts_tablet_manager.cc:1403] T f593a7e12d394520ac84b9cb01f8a445 P ade6fdeec548419dafe0d8c727ea9db7: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.002s
I20260709 13:09:21.538683 28920 catalog_manager.cc:5697] T ccbfc50ea0d341fd975dd116645a8437 P b675cc11b2dc4c9580b7b61dee8e4333 reported cstate change: term changed from 0 to 1, leader changed from <none> to b675cc11b2dc4c9580b7b61dee8e4333 (127.28.54.67). New cstate: current_term: 1 leader_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:21.541603 29216 raft_consensus.cc:359] T f593a7e12d394520ac84b9cb01f8a445 P ade6fdeec548419dafe0d8c727ea9db7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.542342 29216 raft_consensus.cc:385] T f593a7e12d394520ac84b9cb01f8a445 P ade6fdeec548419dafe0d8c727ea9db7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:21.542621 29216 raft_consensus.cc:740] T f593a7e12d394520ac84b9cb01f8a445 P ade6fdeec548419dafe0d8c727ea9db7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade6fdeec548419dafe0d8c727ea9db7, State: Initialized, Role: FOLLOWER
I20260709 13:09:21.543270 29216 consensus_queue.cc:260] T f593a7e12d394520ac84b9cb01f8a445 P ade6fdeec548419dafe0d8c727ea9db7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.545315 29216 ts_tablet_manager.cc:1434] T f593a7e12d394520ac84b9cb01f8a445 P ade6fdeec548419dafe0d8c727ea9db7: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:21.546221 29216 tablet_bootstrap.cc:492] T eadbdd1c8352482bbaeb320f048b6a27 P ade6fdeec548419dafe0d8c727ea9db7: Bootstrap starting.
I20260709 13:09:21.533540 29217 raft_consensus.cc:740] T 51c6d4bc6ab749eebcd70e632a6c8c08 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b675cc11b2dc4c9580b7b61dee8e4333, State: Initialized, Role: FOLLOWER
I20260709 13:09:21.548024 29217 consensus_queue.cc:260] T 51c6d4bc6ab749eebcd70e632a6c8c08 P b675cc11b2dc4c9580b7b61dee8e4333 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.550169 29217 ts_tablet_manager.cc:1434] T 51c6d4bc6ab749eebcd70e632a6c8c08 P b675cc11b2dc4c9580b7b61dee8e4333: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 13:09:21.550989 29217 tablet_bootstrap.cc:492] T 64cf35d356a841d6875cbb4106b48f49 P b675cc11b2dc4c9580b7b61dee8e4333: Bootstrap starting.
I20260709 13:09:21.553079 29218 tablet_bootstrap.cc:492] T f593a7e12d394520ac84b9cb01f8a445 P 1b1cd51a6e4f49c88eb2d118d294d565: No bootstrap required, opened a new log
I20260709 13:09:21.553510 29218 ts_tablet_manager.cc:1403] T f593a7e12d394520ac84b9cb01f8a445 P 1b1cd51a6e4f49c88eb2d118d294d565: Time spent bootstrapping tablet: real 0.032s	user 0.009s	sys 0.001s
I20260709 13:09:21.556205 29218 raft_consensus.cc:359] T f593a7e12d394520ac84b9cb01f8a445 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.556939 29217 tablet_bootstrap.cc:654] T 64cf35d356a841d6875cbb4106b48f49 P b675cc11b2dc4c9580b7b61dee8e4333: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:21.556859 29218 raft_consensus.cc:385] T f593a7e12d394520ac84b9cb01f8a445 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:21.557247 29218 raft_consensus.cc:740] T f593a7e12d394520ac84b9cb01f8a445 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b1cd51a6e4f49c88eb2d118d294d565, State: Initialized, Role: FOLLOWER
I20260709 13:09:21.560348 29218 consensus_queue.cc:260] T f593a7e12d394520ac84b9cb01f8a445 P 1b1cd51a6e4f49c88eb2d118d294d565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.562577 29216 tablet_bootstrap.cc:654] T eadbdd1c8352482bbaeb320f048b6a27 P ade6fdeec548419dafe0d8c727ea9db7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:21.562665 29218 ts_tablet_manager.cc:1434] T f593a7e12d394520ac84b9cb01f8a445 P 1b1cd51a6e4f49c88eb2d118d294d565: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 13:09:21.563622 29218 tablet_bootstrap.cc:492] T ccbfc50ea0d341fd975dd116645a8437 P 1b1cd51a6e4f49c88eb2d118d294d565: Bootstrap starting.
I20260709 13:09:21.569880 29218 tablet_bootstrap.cc:654] T ccbfc50ea0d341fd975dd116645a8437 P 1b1cd51a6e4f49c88eb2d118d294d565: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:21.573275 29222 raft_consensus.cc:493] T 51c6d4bc6ab749eebcd70e632a6c8c08 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.573698 29222 raft_consensus.cc:515] T 51c6d4bc6ab749eebcd70e632a6c8c08 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.575766 29222 leader_election.cc:290] T 51c6d4bc6ab749eebcd70e632a6c8c08 P b675cc11b2dc4c9580b7b61dee8e4333 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ade6fdeec548419dafe0d8c727ea9db7 (127.28.54.65:37211), 1b1cd51a6e4f49c88eb2d118d294d565 (127.28.54.66:34329)
I20260709 13:09:21.576363 29216 tablet_bootstrap.cc:492] T eadbdd1c8352482bbaeb320f048b6a27 P ade6fdeec548419dafe0d8c727ea9db7: No bootstrap required, opened a new log
I20260709 13:09:21.576471 29024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c6d4bc6ab749eebcd70e632a6c8c08" candidate_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade6fdeec548419dafe0d8c727ea9db7" is_pre_election: true
I20260709 13:09:21.576891 29216 ts_tablet_manager.cc:1403] T eadbdd1c8352482bbaeb320f048b6a27 P ade6fdeec548419dafe0d8c727ea9db7: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.004s
I20260709 13:09:21.577181 29099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c6d4bc6ab749eebcd70e632a6c8c08" candidate_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" is_pre_election: true
W20260709 13:09:21.577950 29137 leader_election.cc:343] T 51c6d4bc6ab749eebcd70e632a6c8c08 P b675cc11b2dc4c9580b7b61dee8e4333 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ade6fdeec548419dafe0d8c727ea9db7 (127.28.54.65:37211): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:21.578415 29139 leader_election.cc:343] T 51c6d4bc6ab749eebcd70e632a6c8c08 P b675cc11b2dc4c9580b7b61dee8e4333 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1b1cd51a6e4f49c88eb2d118d294d565 (127.28.54.66:34329): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:21.578536 29218 tablet_bootstrap.cc:492] T ccbfc50ea0d341fd975dd116645a8437 P 1b1cd51a6e4f49c88eb2d118d294d565: No bootstrap required, opened a new log
I20260709 13:09:21.578841 29139 leader_election.cc:304] T 51c6d4bc6ab749eebcd70e632a6c8c08 P b675cc11b2dc4c9580b7b61dee8e4333 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b675cc11b2dc4c9580b7b61dee8e4333; no voters: 1b1cd51a6e4f49c88eb2d118d294d565, ade6fdeec548419dafe0d8c727ea9db7
I20260709 13:09:21.579087 29218 ts_tablet_manager.cc:1403] T ccbfc50ea0d341fd975dd116645a8437 P 1b1cd51a6e4f49c88eb2d118d294d565: Time spent bootstrapping tablet: real 0.016s	user 0.008s	sys 0.005s
I20260709 13:09:21.579845 29222 raft_consensus.cc:2749] T 51c6d4bc6ab749eebcd70e632a6c8c08 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:21.579684 29216 raft_consensus.cc:359] T eadbdd1c8352482bbaeb320f048b6a27 P ade6fdeec548419dafe0d8c727ea9db7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.580377 29216 raft_consensus.cc:385] T eadbdd1c8352482bbaeb320f048b6a27 P ade6fdeec548419dafe0d8c727ea9db7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:21.580685 29216 raft_consensus.cc:740] T eadbdd1c8352482bbaeb320f048b6a27 P ade6fdeec548419dafe0d8c727ea9db7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade6fdeec548419dafe0d8c727ea9db7, State: Initialized, Role: FOLLOWER
I20260709 13:09:21.581357 29216 consensus_queue.cc:260] T eadbdd1c8352482bbaeb320f048b6a27 P ade6fdeec548419dafe0d8c727ea9db7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.581864 29218 raft_consensus.cc:359] T ccbfc50ea0d341fd975dd116645a8437 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.582541 29218 raft_consensus.cc:385] T ccbfc50ea0d341fd975dd116645a8437 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:21.582799 29218 raft_consensus.cc:740] T ccbfc50ea0d341fd975dd116645a8437 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b1cd51a6e4f49c88eb2d118d294d565, State: Initialized, Role: FOLLOWER
I20260709 13:09:21.583858 29217 tablet_bootstrap.cc:492] T 64cf35d356a841d6875cbb4106b48f49 P b675cc11b2dc4c9580b7b61dee8e4333: No bootstrap required, opened a new log
I20260709 13:09:21.584378 29217 ts_tablet_manager.cc:1403] T 64cf35d356a841d6875cbb4106b48f49 P b675cc11b2dc4c9580b7b61dee8e4333: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.004s
I20260709 13:09:21.583873 29218 consensus_queue.cc:260] T ccbfc50ea0d341fd975dd116645a8437 P 1b1cd51a6e4f49c88eb2d118d294d565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.586421 29218 ts_tablet_manager.cc:1434] T ccbfc50ea0d341fd975dd116645a8437 P 1b1cd51a6e4f49c88eb2d118d294d565: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:21.586742 29217 raft_consensus.cc:359] T 64cf35d356a841d6875cbb4106b48f49 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.587307 29218 tablet_bootstrap.cc:492] T 53af9481634c45f5a2cf52f3b93047d1 P 1b1cd51a6e4f49c88eb2d118d294d565: Bootstrap starting.
I20260709 13:09:21.588649 29216 ts_tablet_manager.cc:1434] T eadbdd1c8352482bbaeb320f048b6a27 P ade6fdeec548419dafe0d8c727ea9db7: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:09:21.589593 29216 tablet_bootstrap.cc:492] T 64cf35d356a841d6875cbb4106b48f49 P ade6fdeec548419dafe0d8c727ea9db7: Bootstrap starting.
I20260709 13:09:21.590688 29225 raft_consensus.cc:493] T ca468a14f9ad47fc83c2fd8cca868e02 P ade6fdeec548419dafe0d8c727ea9db7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.591158 29225 raft_consensus.cc:515] T ca468a14f9ad47fc83c2fd8cca868e02 P ade6fdeec548419dafe0d8c727ea9db7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.593710 29218 tablet_bootstrap.cc:654] T 53af9481634c45f5a2cf52f3b93047d1 P 1b1cd51a6e4f49c88eb2d118d294d565: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:21.593634 29225 leader_election.cc:290] T ca468a14f9ad47fc83c2fd8cca868e02 P ade6fdeec548419dafe0d8c727ea9db7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b1cd51a6e4f49c88eb2d118d294d565 (127.28.54.66:34329), b675cc11b2dc4c9580b7b61dee8e4333 (127.28.54.67:41555)
I20260709 13:09:21.587327 29217 raft_consensus.cc:385] T 64cf35d356a841d6875cbb4106b48f49 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:21.598053 29217 raft_consensus.cc:740] T 64cf35d356a841d6875cbb4106b48f49 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b675cc11b2dc4c9580b7b61dee8e4333, State: Initialized, Role: FOLLOWER
I20260709 13:09:21.598745 29217 consensus_queue.cc:260] T 64cf35d356a841d6875cbb4106b48f49 P b675cc11b2dc4c9580b7b61dee8e4333 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.600979 29217 ts_tablet_manager.cc:1434] T 64cf35d356a841d6875cbb4106b48f49 P b675cc11b2dc4c9580b7b61dee8e4333: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:09:21.601830 29217 tablet_bootstrap.cc:492] T 53af9481634c45f5a2cf52f3b93047d1 P b675cc11b2dc4c9580b7b61dee8e4333: Bootstrap starting.
I20260709 13:09:21.607123 29217 tablet_bootstrap.cc:654] T 53af9481634c45f5a2cf52f3b93047d1 P b675cc11b2dc4c9580b7b61dee8e4333: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:21.611783 29099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca468a14f9ad47fc83c2fd8cca868e02" candidate_uuid: "ade6fdeec548419dafe0d8c727ea9db7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" is_pre_election: true
I20260709 13:09:21.612525 29222 raft_consensus.cc:493] T 64cf35d356a841d6875cbb4106b48f49 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.612977 29222 raft_consensus.cc:515] T 64cf35d356a841d6875cbb4106b48f49 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.615095 29222 leader_election.cc:290] T 64cf35d356a841d6875cbb4106b48f49 P b675cc11b2dc4c9580b7b61dee8e4333 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ade6fdeec548419dafe0d8c727ea9db7 (127.28.54.65:37211), 1b1cd51a6e4f49c88eb2d118d294d565 (127.28.54.66:34329)
I20260709 13:09:21.615676 29024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64cf35d356a841d6875cbb4106b48f49" candidate_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade6fdeec548419dafe0d8c727ea9db7" is_pre_election: true
I20260709 13:09:21.617238 29099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64cf35d356a841d6875cbb4106b48f49" candidate_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" is_pre_election: true
I20260709 13:09:21.617877 29099 raft_consensus.cc:2468] T 64cf35d356a841d6875cbb4106b48f49 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b675cc11b2dc4c9580b7b61dee8e4333 in term 0.
I20260709 13:09:21.618471 29216 tablet_bootstrap.cc:654] T 64cf35d356a841d6875cbb4106b48f49 P ade6fdeec548419dafe0d8c727ea9db7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:21.618932 29222 raft_consensus.cc:493] T 8ef2753d7f6f46e68a0ec3be338f525b P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.619145 29139 leader_election.cc:304] T 64cf35d356a841d6875cbb4106b48f49 P b675cc11b2dc4c9580b7b61dee8e4333 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b1cd51a6e4f49c88eb2d118d294d565, b675cc11b2dc4c9580b7b61dee8e4333; no voters: 
I20260709 13:09:21.619367 29222 raft_consensus.cc:515] T 8ef2753d7f6f46e68a0ec3be338f525b P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
W20260709 13:09:21.620643 29137 leader_election.cc:343] T 64cf35d356a841d6875cbb4106b48f49 P b675cc11b2dc4c9580b7b61dee8e4333 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ade6fdeec548419dafe0d8c727ea9db7 (127.28.54.65:37211): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:21.620765 29246 raft_consensus.cc:2804] T 64cf35d356a841d6875cbb4106b48f49 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:21.621225 29246 raft_consensus.cc:493] T 64cf35d356a841d6875cbb4106b48f49 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.621364 29222 leader_election.cc:290] T 8ef2753d7f6f46e68a0ec3be338f525b P b675cc11b2dc4c9580b7b61dee8e4333 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ade6fdeec548419dafe0d8c727ea9db7 (127.28.54.65:37211), 1b1cd51a6e4f49c88eb2d118d294d565 (127.28.54.66:34329)
I20260709 13:09:21.621562 29246 raft_consensus.cc:3060] T 64cf35d356a841d6875cbb4106b48f49 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:21.623296 29024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ef2753d7f6f46e68a0ec3be338f525b" candidate_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade6fdeec548419dafe0d8c727ea9db7" is_pre_election: true
I20260709 13:09:21.623917 29024 raft_consensus.cc:2468] T 8ef2753d7f6f46e68a0ec3be338f525b P ade6fdeec548419dafe0d8c727ea9db7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b675cc11b2dc4c9580b7b61dee8e4333 in term 0.
I20260709 13:09:21.625089 29137 leader_election.cc:304] T 8ef2753d7f6f46e68a0ec3be338f525b P b675cc11b2dc4c9580b7b61dee8e4333 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ade6fdeec548419dafe0d8c727ea9db7, b675cc11b2dc4c9580b7b61dee8e4333; no voters: 
I20260709 13:09:21.625828 29222 raft_consensus.cc:2804] T 8ef2753d7f6f46e68a0ec3be338f525b P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:21.626184 29222 raft_consensus.cc:493] T 8ef2753d7f6f46e68a0ec3be338f525b P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.626499 29222 raft_consensus.cc:3060] T 8ef2753d7f6f46e68a0ec3be338f525b P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:21.627198 29099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ef2753d7f6f46e68a0ec3be338f525b" candidate_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" is_pre_election: true
I20260709 13:09:21.627784 29099 raft_consensus.cc:2468] T 8ef2753d7f6f46e68a0ec3be338f525b P 1b1cd51a6e4f49c88eb2d118d294d565 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b675cc11b2dc4c9580b7b61dee8e4333 in term 0.
I20260709 13:09:21.628258 29246 raft_consensus.cc:515] T 64cf35d356a841d6875cbb4106b48f49 P b675cc11b2dc4c9580b7b61dee8e4333 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.630309 29246 leader_election.cc:290] T 64cf35d356a841d6875cbb4106b48f49 P b675cc11b2dc4c9580b7b61dee8e4333 [CANDIDATE]: Term 1 election: Requested vote from peers ade6fdeec548419dafe0d8c727ea9db7 (127.28.54.65:37211), 1b1cd51a6e4f49c88eb2d118d294d565 (127.28.54.66:34329)
I20260709 13:09:21.630751 29246 raft_consensus.cc:493] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.631156 29246 raft_consensus.cc:515] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.631407 29099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64cf35d356a841d6875cbb4106b48f49" candidate_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b1cd51a6e4f49c88eb2d118d294d565"
I20260709 13:09:21.632051 29099 raft_consensus.cc:3060] T 64cf35d356a841d6875cbb4106b48f49 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:21.632366 29222 raft_consensus.cc:515] T 8ef2753d7f6f46e68a0ec3be338f525b P b675cc11b2dc4c9580b7b61dee8e4333 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.633067 29246 leader_election.cc:290] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ade6fdeec548419dafe0d8c727ea9db7 (127.28.54.65:37211), 1b1cd51a6e4f49c88eb2d118d294d565 (127.28.54.66:34329)
I20260709 13:09:21.634723 29098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f593a7e12d394520ac84b9cb01f8a445" candidate_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" is_pre_election: true
I20260709 13:09:21.634904 29222 leader_election.cc:290] T 8ef2753d7f6f46e68a0ec3be338f525b P b675cc11b2dc4c9580b7b61dee8e4333 [CANDIDATE]: Term 1 election: Requested vote from peers ade6fdeec548419dafe0d8c727ea9db7 (127.28.54.65:37211), 1b1cd51a6e4f49c88eb2d118d294d565 (127.28.54.66:34329)
I20260709 13:09:21.635412 29098 raft_consensus.cc:2468] T f593a7e12d394520ac84b9cb01f8a445 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b675cc11b2dc4c9580b7b61dee8e4333 in term 0.
I20260709 13:09:21.636211 29218 tablet_bootstrap.cc:492] T 53af9481634c45f5a2cf52f3b93047d1 P 1b1cd51a6e4f49c88eb2d118d294d565: No bootstrap required, opened a new log
I20260709 13:09:21.636644 29218 ts_tablet_manager.cc:1403] T 53af9481634c45f5a2cf52f3b93047d1 P 1b1cd51a6e4f49c88eb2d118d294d565: Time spent bootstrapping tablet: real 0.050s	user 0.014s	sys 0.002s
I20260709 13:09:21.636868 29139 leader_election.cc:304] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b1cd51a6e4f49c88eb2d118d294d565, b675cc11b2dc4c9580b7b61dee8e4333; no voters: 
I20260709 13:09:21.637281 29098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ef2753d7f6f46e68a0ec3be338f525b" candidate_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b1cd51a6e4f49c88eb2d118d294d565"
I20260709 13:09:21.637836 29098 raft_consensus.cc:3060] T 8ef2753d7f6f46e68a0ec3be338f525b P 1b1cd51a6e4f49c88eb2d118d294d565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:21.639202 29218 raft_consensus.cc:359] T 53af9481634c45f5a2cf52f3b93047d1 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.639879 29218 raft_consensus.cc:385] T 53af9481634c45f5a2cf52f3b93047d1 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:21.640158 29218 raft_consensus.cc:740] T 53af9481634c45f5a2cf52f3b93047d1 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b1cd51a6e4f49c88eb2d118d294d565, State: Initialized, Role: FOLLOWER
I20260709 13:09:21.640818 29218 consensus_queue.cc:260] T 53af9481634c45f5a2cf52f3b93047d1 P 1b1cd51a6e4f49c88eb2d118d294d565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.644068 29217 tablet_bootstrap.cc:492] T 53af9481634c45f5a2cf52f3b93047d1 P b675cc11b2dc4c9580b7b61dee8e4333: No bootstrap required, opened a new log
I20260709 13:09:21.644500 29217 ts_tablet_manager.cc:1403] T 53af9481634c45f5a2cf52f3b93047d1 P b675cc11b2dc4c9580b7b61dee8e4333: Time spent bootstrapping tablet: real 0.043s	user 0.010s	sys 0.000s
I20260709 13:09:21.644595 29098 raft_consensus.cc:2468] T 8ef2753d7f6f46e68a0ec3be338f525b P 1b1cd51a6e4f49c88eb2d118d294d565 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b675cc11b2dc4c9580b7b61dee8e4333 in term 1.
I20260709 13:09:21.645620 29139 leader_election.cc:304] T 8ef2753d7f6f46e68a0ec3be338f525b P b675cc11b2dc4c9580b7b61dee8e4333 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b1cd51a6e4f49c88eb2d118d294d565, b675cc11b2dc4c9580b7b61dee8e4333; no voters: 
I20260709 13:09:21.645618 29222 raft_consensus.cc:2804] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:21.646302 29222 raft_consensus.cc:493] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.646996 29246 raft_consensus.cc:2804] T 8ef2753d7f6f46e68a0ec3be338f525b P b675cc11b2dc4c9580b7b61dee8e4333 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:21.647429 29246 raft_consensus.cc:697] T 8ef2753d7f6f46e68a0ec3be338f525b P b675cc11b2dc4c9580b7b61dee8e4333 [term 1 LEADER]: Becoming Leader. State: Replica: b675cc11b2dc4c9580b7b61dee8e4333, State: Running, Role: LEADER
I20260709 13:09:21.647941 29218 ts_tablet_manager.cc:1434] T 53af9481634c45f5a2cf52f3b93047d1 P 1b1cd51a6e4f49c88eb2d118d294d565: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:09:21.648290 29246 consensus_queue.cc:237] T 8ef2753d7f6f46e68a0ec3be338f525b P b675cc11b2dc4c9580b7b61dee8e4333 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.649267 29099 raft_consensus.cc:2468] T 64cf35d356a841d6875cbb4106b48f49 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b675cc11b2dc4c9580b7b61dee8e4333 in term 1.
I20260709 13:09:21.646644 29222 raft_consensus.cc:3060] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:21.649605 29217 raft_consensus.cc:359] T 53af9481634c45f5a2cf52f3b93047d1 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.653322 29217 raft_consensus.cc:385] T 53af9481634c45f5a2cf52f3b93047d1 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:21.653023 29139 leader_election.cc:304] T 64cf35d356a841d6875cbb4106b48f49 P b675cc11b2dc4c9580b7b61dee8e4333 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b1cd51a6e4f49c88eb2d118d294d565, b675cc11b2dc4c9580b7b61dee8e4333; no voters: 
I20260709 13:09:21.653628 29217 raft_consensus.cc:740] T 53af9481634c45f5a2cf52f3b93047d1 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b675cc11b2dc4c9580b7b61dee8e4333, State: Initialized, Role: FOLLOWER
I20260709 13:09:21.654289 29217 consensus_queue.cc:260] T 53af9481634c45f5a2cf52f3b93047d1 P b675cc11b2dc4c9580b7b61dee8e4333 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.653087 29216 tablet_bootstrap.cc:492] T 64cf35d356a841d6875cbb4106b48f49 P ade6fdeec548419dafe0d8c727ea9db7: No bootstrap required, opened a new log
I20260709 13:09:21.655905 29216 ts_tablet_manager.cc:1403] T 64cf35d356a841d6875cbb4106b48f49 P ade6fdeec548419dafe0d8c727ea9db7: Time spent bootstrapping tablet: real 0.067s	user 0.012s	sys 0.000s
I20260709 13:09:21.657925 29222 raft_consensus.cc:515] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.658628 29216 raft_consensus.cc:359] T 64cf35d356a841d6875cbb4106b48f49 P ade6fdeec548419dafe0d8c727ea9db7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.659272 29216 raft_consensus.cc:385] T 64cf35d356a841d6875cbb4106b48f49 P ade6fdeec548419dafe0d8c727ea9db7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:21.659557 29216 raft_consensus.cc:740] T 64cf35d356a841d6875cbb4106b48f49 P ade6fdeec548419dafe0d8c727ea9db7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade6fdeec548419dafe0d8c727ea9db7, State: Initialized, Role: FOLLOWER
I20260709 13:09:21.659849 29222 leader_election.cc:290] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 [CANDIDATE]: Term 1 election: Requested vote from peers ade6fdeec548419dafe0d8c727ea9db7 (127.28.54.65:37211), 1b1cd51a6e4f49c88eb2d118d294d565 (127.28.54.66:34329)
I20260709 13:09:21.660459 29222 raft_consensus.cc:2804] T 64cf35d356a841d6875cbb4106b48f49 P b675cc11b2dc4c9580b7b61dee8e4333 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:21.660192 29216 consensus_queue.cc:260] T 64cf35d356a841d6875cbb4106b48f49 P ade6fdeec548419dafe0d8c727ea9db7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.660872 29222 raft_consensus.cc:697] T 64cf35d356a841d6875cbb4106b48f49 P b675cc11b2dc4c9580b7b61dee8e4333 [term 1 LEADER]: Becoming Leader. State: Replica: b675cc11b2dc4c9580b7b61dee8e4333, State: Running, Role: LEADER
I20260709 13:09:21.648785 29218 tablet_bootstrap.cc:492] T 51c6d4bc6ab749eebcd70e632a6c8c08 P 1b1cd51a6e4f49c88eb2d118d294d565: Bootstrap starting.
I20260709 13:09:21.662580 29216 ts_tablet_manager.cc:1434] T 64cf35d356a841d6875cbb4106b48f49 P ade6fdeec548419dafe0d8c727ea9db7: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:09:21.663699 29216 tablet_bootstrap.cc:492] T 51c6d4bc6ab749eebcd70e632a6c8c08 P ade6fdeec548419dafe0d8c727ea9db7: Bootstrap starting.
I20260709 13:09:21.668467 29218 tablet_bootstrap.cc:654] T 51c6d4bc6ab749eebcd70e632a6c8c08 P 1b1cd51a6e4f49c88eb2d118d294d565: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:21.672606 29216 tablet_bootstrap.cc:654] T 51c6d4bc6ab749eebcd70e632a6c8c08 P ade6fdeec548419dafe0d8c727ea9db7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:21.661643 29222 consensus_queue.cc:237] T 64cf35d356a841d6875cbb4106b48f49 P b675cc11b2dc4c9580b7b61dee8e4333 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.674734 29173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca468a14f9ad47fc83c2fd8cca868e02" candidate_uuid: "ade6fdeec548419dafe0d8c727ea9db7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" is_pre_election: true
I20260709 13:09:21.675534 29173 raft_consensus.cc:2393] T ca468a14f9ad47fc83c2fd8cca868e02 P b675cc11b2dc4c9580b7b61dee8e4333 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ade6fdeec548419dafe0d8c727ea9db7 in current term 1: Already voted for candidate 1b1cd51a6e4f49c88eb2d118d294d565 in this term.
I20260709 13:09:21.676906 28989 leader_election.cc:304] T ca468a14f9ad47fc83c2fd8cca868e02 P ade6fdeec548419dafe0d8c727ea9db7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ade6fdeec548419dafe0d8c727ea9db7; no voters: 1b1cd51a6e4f49c88eb2d118d294d565, b675cc11b2dc4c9580b7b61dee8e4333
I20260709 13:09:21.677700 29225 raft_consensus.cc:3060] T ca468a14f9ad47fc83c2fd8cca868e02 P ade6fdeec548419dafe0d8c727ea9db7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:21.678669 29099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f593a7e12d394520ac84b9cb01f8a445" candidate_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b1cd51a6e4f49c88eb2d118d294d565"
I20260709 13:09:21.679271 29099 raft_consensus.cc:3060] T f593a7e12d394520ac84b9cb01f8a445 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:21.684374 29225 raft_consensus.cc:2749] T ca468a14f9ad47fc83c2fd8cca868e02 P ade6fdeec548419dafe0d8c727ea9db7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:21.685024 29225 raft_consensus.cc:493] T 22db5056ecf74660ba332b5eef197747 P ade6fdeec548419dafe0d8c727ea9db7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.685452 29225 raft_consensus.cc:515] T 22db5056ecf74660ba332b5eef197747 P ade6fdeec548419dafe0d8c727ea9db7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } }
I20260709 13:09:21.686625 29024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64cf35d356a841d6875cbb4106b48f49" candidate_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade6fdeec548419dafe0d8c727ea9db7"
I20260709 13:09:21.687150 29024 raft_consensus.cc:3060] T 64cf35d356a841d6875cbb4106b48f49 P ade6fdeec548419dafe0d8c727ea9db7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:21.687381 29225 leader_election.cc:290] T 22db5056ecf74660ba332b5eef197747 P ade6fdeec548419dafe0d8c727ea9db7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b675cc11b2dc4c9580b7b61dee8e4333 (127.28.54.67:41555), 1b1cd51a6e4f49c88eb2d118d294d565 (127.28.54.66:34329)
I20260709 13:09:21.688468 29098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22db5056ecf74660ba332b5eef197747" candidate_uuid: "ade6fdeec548419dafe0d8c727ea9db7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" is_pre_election: true
I20260709 13:09:21.689082 29098 raft_consensus.cc:2468] T 22db5056ecf74660ba332b5eef197747 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ade6fdeec548419dafe0d8c727ea9db7 in term 0.
I20260709 13:09:21.690483 28990 leader_election.cc:304] T 22db5056ecf74660ba332b5eef197747 P ade6fdeec548419dafe0d8c727ea9db7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b1cd51a6e4f49c88eb2d118d294d565, ade6fdeec548419dafe0d8c727ea9db7; no voters: 
I20260709 13:09:21.691877 29225 raft_consensus.cc:2804] T 22db5056ecf74660ba332b5eef197747 P ade6fdeec548419dafe0d8c727ea9db7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:21.692235 29225 raft_consensus.cc:493] T 22db5056ecf74660ba332b5eef197747 P ade6fdeec548419dafe0d8c727ea9db7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.692559 29225 raft_consensus.cc:3060] T 22db5056ecf74660ba332b5eef197747 P ade6fdeec548419dafe0d8c727ea9db7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:21.694427 29173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22db5056ecf74660ba332b5eef197747" candidate_uuid: "ade6fdeec548419dafe0d8c727ea9db7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" is_pre_election: true
I20260709 13:09:21.695010 29173 raft_consensus.cc:2468] T 22db5056ecf74660ba332b5eef197747 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ade6fdeec548419dafe0d8c727ea9db7 in term 0.
I20260709 13:09:21.697553 29024 raft_consensus.cc:2468] T 64cf35d356a841d6875cbb4106b48f49 P ade6fdeec548419dafe0d8c727ea9db7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b675cc11b2dc4c9580b7b61dee8e4333 in term 1.
I20260709 13:09:21.700066 29023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f593a7e12d394520ac84b9cb01f8a445" candidate_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade6fdeec548419dafe0d8c727ea9db7" is_pre_election: true
I20260709 13:09:21.701978 29023 raft_consensus.cc:2468] T f593a7e12d394520ac84b9cb01f8a445 P ade6fdeec548419dafe0d8c727ea9db7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b675cc11b2dc4c9580b7b61dee8e4333 in term 0.
I20260709 13:09:21.702296 29225 raft_consensus.cc:515] T 22db5056ecf74660ba332b5eef197747 P ade6fdeec548419dafe0d8c727ea9db7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } }
I20260709 13:09:21.703926 29023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ef2753d7f6f46e68a0ec3be338f525b" candidate_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade6fdeec548419dafe0d8c727ea9db7"
I20260709 13:09:21.704245 29225 leader_election.cc:290] T 22db5056ecf74660ba332b5eef197747 P ade6fdeec548419dafe0d8c727ea9db7 [CANDIDATE]: Term 1 election: Requested vote from peers b675cc11b2dc4c9580b7b61dee8e4333 (127.28.54.67:41555), 1b1cd51a6e4f49c88eb2d118d294d565 (127.28.54.66:34329)
I20260709 13:09:21.704486 29023 raft_consensus.cc:3060] T 8ef2753d7f6f46e68a0ec3be338f525b P ade6fdeec548419dafe0d8c727ea9db7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:21.705291 29098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22db5056ecf74660ba332b5eef197747" candidate_uuid: "ade6fdeec548419dafe0d8c727ea9db7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b1cd51a6e4f49c88eb2d118d294d565"
I20260709 13:09:21.705842 29098 raft_consensus.cc:3060] T 22db5056ecf74660ba332b5eef197747 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:21.708194 29173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22db5056ecf74660ba332b5eef197747" candidate_uuid: "ade6fdeec548419dafe0d8c727ea9db7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b675cc11b2dc4c9580b7b61dee8e4333"
I20260709 13:09:21.708696 29173 raft_consensus.cc:3060] T 22db5056ecf74660ba332b5eef197747 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:21.712052 29098 raft_consensus.cc:2468] T 22db5056ecf74660ba332b5eef197747 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade6fdeec548419dafe0d8c727ea9db7 in term 1.
I20260709 13:09:21.713238 28990 leader_election.cc:304] T 22db5056ecf74660ba332b5eef197747 P ade6fdeec548419dafe0d8c727ea9db7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b1cd51a6e4f49c88eb2d118d294d565, ade6fdeec548419dafe0d8c727ea9db7; no voters: 
I20260709 13:09:21.714010 29225 raft_consensus.cc:2804] T 22db5056ecf74660ba332b5eef197747 P ade6fdeec548419dafe0d8c727ea9db7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:21.714455 29225 raft_consensus.cc:697] T 22db5056ecf74660ba332b5eef197747 P ade6fdeec548419dafe0d8c727ea9db7 [term 1 LEADER]: Becoming Leader. State: Replica: ade6fdeec548419dafe0d8c727ea9db7, State: Running, Role: LEADER
I20260709 13:09:21.715281 29225 consensus_queue.cc:237] T 22db5056ecf74660ba332b5eef197747 P ade6fdeec548419dafe0d8c727ea9db7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } }
I20260709 13:09:21.720165 29023 raft_consensus.cc:2468] T 8ef2753d7f6f46e68a0ec3be338f525b P ade6fdeec548419dafe0d8c727ea9db7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b675cc11b2dc4c9580b7b61dee8e4333 in term 1.
I20260709 13:09:21.722177 29173 raft_consensus.cc:2468] T 22db5056ecf74660ba332b5eef197747 P b675cc11b2dc4c9580b7b61dee8e4333 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade6fdeec548419dafe0d8c727ea9db7 in term 1.
I20260709 13:09:21.725793 29218 tablet_bootstrap.cc:492] T 51c6d4bc6ab749eebcd70e632a6c8c08 P 1b1cd51a6e4f49c88eb2d118d294d565: No bootstrap required, opened a new log
I20260709 13:09:21.726230 29218 ts_tablet_manager.cc:1403] T 51c6d4bc6ab749eebcd70e632a6c8c08 P 1b1cd51a6e4f49c88eb2d118d294d565: Time spent bootstrapping tablet: real 0.078s	user 0.010s	sys 0.003s
I20260709 13:09:21.723433 29259 raft_consensus.cc:493] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.730077 29023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f593a7e12d394520ac84b9cb01f8a445" candidate_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade6fdeec548419dafe0d8c727ea9db7"
I20260709 13:09:21.730926 29023 raft_consensus.cc:3060] T f593a7e12d394520ac84b9cb01f8a445 P ade6fdeec548419dafe0d8c727ea9db7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:21.729493 29099 raft_consensus.cc:2468] T f593a7e12d394520ac84b9cb01f8a445 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b675cc11b2dc4c9580b7b61dee8e4333 in term 1.
I20260709 13:09:21.731115 29217 ts_tablet_manager.cc:1434] T 53af9481634c45f5a2cf52f3b93047d1 P b675cc11b2dc4c9580b7b61dee8e4333: Time spent starting tablet: real 0.086s	user 0.011s	sys 0.014s
I20260709 13:09:21.726760 29259 raft_consensus.cc:515] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.731417 29218 raft_consensus.cc:359] T 51c6d4bc6ab749eebcd70e632a6c8c08 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.732280 29218 raft_consensus.cc:385] T 51c6d4bc6ab749eebcd70e632a6c8c08 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:21.732522 29218 raft_consensus.cc:740] T 51c6d4bc6ab749eebcd70e632a6c8c08 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1b1cd51a6e4f49c88eb2d118d294d565, State: Initialized, Role: FOLLOWER
I20260709 13:09:21.733184 29218 consensus_queue.cc:260] T 51c6d4bc6ab749eebcd70e632a6c8c08 P 1b1cd51a6e4f49c88eb2d118d294d565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.735280 29216 tablet_bootstrap.cc:492] T 51c6d4bc6ab749eebcd70e632a6c8c08 P ade6fdeec548419dafe0d8c727ea9db7: No bootstrap required, opened a new log
I20260709 13:09:21.735610 29216 ts_tablet_manager.cc:1403] T 51c6d4bc6ab749eebcd70e632a6c8c08 P ade6fdeec548419dafe0d8c727ea9db7: Time spent bootstrapping tablet: real 0.072s	user 0.011s	sys 0.008s
I20260709 13:09:21.734414 29139 leader_election.cc:304] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b1cd51a6e4f49c88eb2d118d294d565, b675cc11b2dc4c9580b7b61dee8e4333; no voters: 
I20260709 13:09:21.745985 29218 ts_tablet_manager.cc:1434] T 51c6d4bc6ab749eebcd70e632a6c8c08 P 1b1cd51a6e4f49c88eb2d118d294d565: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.003s
I20260709 13:09:21.747948 28921 catalog_manager.cc:5697] T 8ef2753d7f6f46e68a0ec3be338f525b P b675cc11b2dc4c9580b7b61dee8e4333 reported cstate change: term changed from 0 to 1, leader changed from <none> to b675cc11b2dc4c9580b7b61dee8e4333 (127.28.54.67). New cstate: current_term: 1 leader_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:21.753335 29024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadbdd1c8352482bbaeb320f048b6a27" candidate_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade6fdeec548419dafe0d8c727ea9db7" is_pre_election: true
I20260709 13:09:21.747730 29246 raft_consensus.cc:2804] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:21.753990 29024 raft_consensus.cc:2468] T eadbdd1c8352482bbaeb320f048b6a27 P ade6fdeec548419dafe0d8c727ea9db7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b675cc11b2dc4c9580b7b61dee8e4333 in term 0.
I20260709 13:09:21.754400 29246 raft_consensus.cc:697] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 [term 1 LEADER]: Becoming Leader. State: Replica: b675cc11b2dc4c9580b7b61dee8e4333, State: Running, Role: LEADER
I20260709 13:09:21.755208 29246 consensus_queue.cc:237] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.758760 29137 leader_election.cc:304] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ade6fdeec548419dafe0d8c727ea9db7, b675cc11b2dc4c9580b7b61dee8e4333; no voters: 
I20260709 13:09:21.760053 29023 raft_consensus.cc:2468] T f593a7e12d394520ac84b9cb01f8a445 P ade6fdeec548419dafe0d8c727ea9db7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b675cc11b2dc4c9580b7b61dee8e4333 in term 1.
I20260709 13:09:21.760609 29222 raft_consensus.cc:2804] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:21.761234 29222 raft_consensus.cc:493] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.761335 29259 leader_election.cc:290] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ade6fdeec548419dafe0d8c727ea9db7 (127.28.54.65:37211), 1b1cd51a6e4f49c88eb2d118d294d565 (127.28.54.66:34329)
I20260709 13:09:21.761649 29222 raft_consensus.cc:3060] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:21.764963 29099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadbdd1c8352482bbaeb320f048b6a27" candidate_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" is_pre_election: true
I20260709 13:09:21.765836 29099 raft_consensus.cc:2468] T eadbdd1c8352482bbaeb320f048b6a27 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b675cc11b2dc4c9580b7b61dee8e4333 in term 0.
I20260709 13:09:21.768000 29216 raft_consensus.cc:359] T 51c6d4bc6ab749eebcd70e632a6c8c08 P ade6fdeec548419dafe0d8c727ea9db7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.768615 29216 raft_consensus.cc:385] T 51c6d4bc6ab749eebcd70e632a6c8c08 P ade6fdeec548419dafe0d8c727ea9db7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:21.768821 29216 raft_consensus.cc:740] T 51c6d4bc6ab749eebcd70e632a6c8c08 P ade6fdeec548419dafe0d8c727ea9db7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade6fdeec548419dafe0d8c727ea9db7, State: Initialized, Role: FOLLOWER
I20260709 13:09:21.770872 29222 raft_consensus.cc:515] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.772437 29222 leader_election.cc:290] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333 [CANDIDATE]: Term 1 election: Requested vote from peers ade6fdeec548419dafe0d8c727ea9db7 (127.28.54.65:37211), 1b1cd51a6e4f49c88eb2d118d294d565 (127.28.54.66:34329)
I20260709 13:09:21.771963 28920 catalog_manager.cc:5697] T 22db5056ecf74660ba332b5eef197747 P ade6fdeec548419dafe0d8c727ea9db7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ade6fdeec548419dafe0d8c727ea9db7 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "ade6fdeec548419dafe0d8c727ea9db7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:21.772998 29216 consensus_queue.cc:260] T 51c6d4bc6ab749eebcd70e632a6c8c08 P ade6fdeec548419dafe0d8c727ea9db7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.773272 29023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadbdd1c8352482bbaeb320f048b6a27" candidate_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade6fdeec548419dafe0d8c727ea9db7"
I20260709 13:09:21.773898 29023 raft_consensus.cc:3060] T eadbdd1c8352482bbaeb320f048b6a27 P ade6fdeec548419dafe0d8c727ea9db7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:21.775905 29099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadbdd1c8352482bbaeb320f048b6a27" candidate_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b1cd51a6e4f49c88eb2d118d294d565"
I20260709 13:09:21.776439 29216 ts_tablet_manager.cc:1434] T 51c6d4bc6ab749eebcd70e632a6c8c08 P ade6fdeec548419dafe0d8c727ea9db7: Time spent starting tablet: real 0.041s	user 0.001s	sys 0.005s
I20260709 13:09:21.777304 29216 tablet_bootstrap.cc:492] T 53af9481634c45f5a2cf52f3b93047d1 P ade6fdeec548419dafe0d8c727ea9db7: Bootstrap starting.
I20260709 13:09:21.780838 29023 raft_consensus.cc:2468] T eadbdd1c8352482bbaeb320f048b6a27 P ade6fdeec548419dafe0d8c727ea9db7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b675cc11b2dc4c9580b7b61dee8e4333 in term 1.
I20260709 13:09:21.776444 29099 raft_consensus.cc:3060] T eadbdd1c8352482bbaeb320f048b6a27 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:21.783776 29216 tablet_bootstrap.cc:654] T 53af9481634c45f5a2cf52f3b93047d1 P ade6fdeec548419dafe0d8c727ea9db7: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:21.789064 28921 catalog_manager.cc:5697] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 reported cstate change: term changed from 0 to 1, leader changed from <none> to b675cc11b2dc4c9580b7b61dee8e4333 (127.28.54.67). New cstate: current_term: 1 leader_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:21.781980 29137 leader_election.cc:304] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ade6fdeec548419dafe0d8c727ea9db7, b675cc11b2dc4c9580b7b61dee8e4333; no voters: 
I20260709 13:09:21.790880 29246 raft_consensus.cc:2804] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:21.791320 29246 raft_consensus.cc:697] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333 [term 1 LEADER]: Becoming Leader. State: Replica: b675cc11b2dc4c9580b7b61dee8e4333, State: Running, Role: LEADER
I20260709 13:09:21.791527 28921 catalog_manager.cc:5697] T 64cf35d356a841d6875cbb4106b48f49 P b675cc11b2dc4c9580b7b61dee8e4333 reported cstate change: term changed from 0 to 1, leader changed from <none> to b675cc11b2dc4c9580b7b61dee8e4333 (127.28.54.67). New cstate: current_term: 1 leader_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:21.792269 29246 consensus_queue.cc:237] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.796937 29099 raft_consensus.cc:2468] T eadbdd1c8352482bbaeb320f048b6a27 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b675cc11b2dc4c9580b7b61dee8e4333 in term 1.
I20260709 13:09:21.799935 29216 tablet_bootstrap.cc:492] T 53af9481634c45f5a2cf52f3b93047d1 P ade6fdeec548419dafe0d8c727ea9db7: No bootstrap required, opened a new log
I20260709 13:09:21.800359 29216 ts_tablet_manager.cc:1403] T 53af9481634c45f5a2cf52f3b93047d1 P ade6fdeec548419dafe0d8c727ea9db7: Time spent bootstrapping tablet: real 0.023s	user 0.006s	sys 0.007s
I20260709 13:09:21.802532 29216 raft_consensus.cc:359] T 53af9481634c45f5a2cf52f3b93047d1 P ade6fdeec548419dafe0d8c727ea9db7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.803082 29216 raft_consensus.cc:385] T 53af9481634c45f5a2cf52f3b93047d1 P ade6fdeec548419dafe0d8c727ea9db7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:21.803340 29216 raft_consensus.cc:740] T 53af9481634c45f5a2cf52f3b93047d1 P ade6fdeec548419dafe0d8c727ea9db7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ade6fdeec548419dafe0d8c727ea9db7, State: Initialized, Role: FOLLOWER
I20260709 13:09:21.803901 29216 consensus_queue.cc:260] T 53af9481634c45f5a2cf52f3b93047d1 P ade6fdeec548419dafe0d8c727ea9db7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.805253 29216 ts_tablet_manager.cc:1434] T 53af9481634c45f5a2cf52f3b93047d1 P ade6fdeec548419dafe0d8c727ea9db7: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:09:21.807479 28921 catalog_manager.cc:5697] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333 reported cstate change: term changed from 0 to 1, leader changed from <none> to b675cc11b2dc4c9580b7b61dee8e4333 (127.28.54.67). New cstate: current_term: 1 leader_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:21.823885 29225 raft_consensus.cc:493] T 51c6d4bc6ab749eebcd70e632a6c8c08 P ade6fdeec548419dafe0d8c727ea9db7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.824316 29225 raft_consensus.cc:515] T 51c6d4bc6ab749eebcd70e632a6c8c08 P ade6fdeec548419dafe0d8c727ea9db7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.826009 29225 leader_election.cc:290] T 51c6d4bc6ab749eebcd70e632a6c8c08 P ade6fdeec548419dafe0d8c727ea9db7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1b1cd51a6e4f49c88eb2d118d294d565 (127.28.54.66:34329), b675cc11b2dc4c9580b7b61dee8e4333 (127.28.54.67:41555)
I20260709 13:09:21.826717 29099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c6d4bc6ab749eebcd70e632a6c8c08" candidate_uuid: "ade6fdeec548419dafe0d8c727ea9db7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" is_pre_election: true
I20260709 13:09:21.826967 29173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c6d4bc6ab749eebcd70e632a6c8c08" candidate_uuid: "ade6fdeec548419dafe0d8c727ea9db7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" is_pre_election: true
I20260709 13:09:21.827301 29099 raft_consensus.cc:2468] T 51c6d4bc6ab749eebcd70e632a6c8c08 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ade6fdeec548419dafe0d8c727ea9db7 in term 0.
I20260709 13:09:21.827476 29173 raft_consensus.cc:2468] T 51c6d4bc6ab749eebcd70e632a6c8c08 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ade6fdeec548419dafe0d8c727ea9db7 in term 0.
I20260709 13:09:21.828260 28990 leader_election.cc:304] T 51c6d4bc6ab749eebcd70e632a6c8c08 P ade6fdeec548419dafe0d8c727ea9db7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b1cd51a6e4f49c88eb2d118d294d565, ade6fdeec548419dafe0d8c727ea9db7; no voters: 
I20260709 13:09:21.828969 29225 raft_consensus.cc:2804] T 51c6d4bc6ab749eebcd70e632a6c8c08 P ade6fdeec548419dafe0d8c727ea9db7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:21.829267 29225 raft_consensus.cc:493] T 51c6d4bc6ab749eebcd70e632a6c8c08 P ade6fdeec548419dafe0d8c727ea9db7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.829504 29225 raft_consensus.cc:3060] T 51c6d4bc6ab749eebcd70e632a6c8c08 P ade6fdeec548419dafe0d8c727ea9db7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:21.831573 29246 raft_consensus.cc:493] T 53af9481634c45f5a2cf52f3b93047d1 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.832015 29246 raft_consensus.cc:515] T 53af9481634c45f5a2cf52f3b93047d1 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.833932 29246 leader_election.cc:290] T 53af9481634c45f5a2cf52f3b93047d1 P b675cc11b2dc4c9580b7b61dee8e4333 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ade6fdeec548419dafe0d8c727ea9db7 (127.28.54.65:37211), 1b1cd51a6e4f49c88eb2d118d294d565 (127.28.54.66:34329)
I20260709 13:09:21.834672 29023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53af9481634c45f5a2cf52f3b93047d1" candidate_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade6fdeec548419dafe0d8c727ea9db7" is_pre_election: true
I20260709 13:09:21.835086 29099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53af9481634c45f5a2cf52f3b93047d1" candidate_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" is_pre_election: true
I20260709 13:09:21.835242 29023 raft_consensus.cc:2468] T 53af9481634c45f5a2cf52f3b93047d1 P ade6fdeec548419dafe0d8c727ea9db7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b675cc11b2dc4c9580b7b61dee8e4333 in term 0.
I20260709 13:09:21.835203 29225 raft_consensus.cc:515] T 51c6d4bc6ab749eebcd70e632a6c8c08 P ade6fdeec548419dafe0d8c727ea9db7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.835772 29099 raft_consensus.cc:2468] T 53af9481634c45f5a2cf52f3b93047d1 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b675cc11b2dc4c9580b7b61dee8e4333 in term 0.
I20260709 13:09:21.836500 29137 leader_election.cc:304] T 53af9481634c45f5a2cf52f3b93047d1 P b675cc11b2dc4c9580b7b61dee8e4333 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ade6fdeec548419dafe0d8c727ea9db7, b675cc11b2dc4c9580b7b61dee8e4333; no voters: 
I20260709 13:09:21.837283 29246 raft_consensus.cc:2804] T 53af9481634c45f5a2cf52f3b93047d1 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:21.837527 29225 leader_election.cc:290] T 51c6d4bc6ab749eebcd70e632a6c8c08 P ade6fdeec548419dafe0d8c727ea9db7 [CANDIDATE]: Term 1 election: Requested vote from peers 1b1cd51a6e4f49c88eb2d118d294d565 (127.28.54.66:34329), b675cc11b2dc4c9580b7b61dee8e4333 (127.28.54.67:41555)
I20260709 13:09:21.837622 29246 raft_consensus.cc:493] T 53af9481634c45f5a2cf52f3b93047d1 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:21.838001 29098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c6d4bc6ab749eebcd70e632a6c8c08" candidate_uuid: "ade6fdeec548419dafe0d8c727ea9db7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b1cd51a6e4f49c88eb2d118d294d565"
I20260709 13:09:21.838580 29098 raft_consensus.cc:3060] T 51c6d4bc6ab749eebcd70e632a6c8c08 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:21.838019 29246 raft_consensus.cc:3060] T 53af9481634c45f5a2cf52f3b93047d1 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:21.840334 29173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c6d4bc6ab749eebcd70e632a6c8c08" candidate_uuid: "ade6fdeec548419dafe0d8c727ea9db7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b675cc11b2dc4c9580b7b61dee8e4333"
I20260709 13:09:21.840843 29173 raft_consensus.cc:3060] T 51c6d4bc6ab749eebcd70e632a6c8c08 P b675cc11b2dc4c9580b7b61dee8e4333 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:21.844671 29098 raft_consensus.cc:2468] T 51c6d4bc6ab749eebcd70e632a6c8c08 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade6fdeec548419dafe0d8c727ea9db7 in term 1.
I20260709 13:09:21.845713 28990 leader_election.cc:304] T 51c6d4bc6ab749eebcd70e632a6c8c08 P ade6fdeec548419dafe0d8c727ea9db7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b1cd51a6e4f49c88eb2d118d294d565, ade6fdeec548419dafe0d8c727ea9db7; no voters: 
I20260709 13:09:21.846064 29246 raft_consensus.cc:515] T 53af9481634c45f5a2cf52f3b93047d1 P b675cc11b2dc4c9580b7b61dee8e4333 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.846822 29225 raft_consensus.cc:2804] T 51c6d4bc6ab749eebcd70e632a6c8c08 P ade6fdeec548419dafe0d8c727ea9db7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:21.846776 29173 raft_consensus.cc:2468] T 51c6d4bc6ab749eebcd70e632a6c8c08 P b675cc11b2dc4c9580b7b61dee8e4333 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade6fdeec548419dafe0d8c727ea9db7 in term 1.
I20260709 13:09:21.848050 29225 raft_consensus.cc:697] T 51c6d4bc6ab749eebcd70e632a6c8c08 P ade6fdeec548419dafe0d8c727ea9db7 [term 1 LEADER]: Becoming Leader. State: Replica: ade6fdeec548419dafe0d8c727ea9db7, State: Running, Role: LEADER
I20260709 13:09:21.848852 29023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53af9481634c45f5a2cf52f3b93047d1" candidate_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade6fdeec548419dafe0d8c727ea9db7"
I20260709 13:09:21.849412 29246 leader_election.cc:290] T 53af9481634c45f5a2cf52f3b93047d1 P b675cc11b2dc4c9580b7b61dee8e4333 [CANDIDATE]: Term 1 election: Requested vote from peers ade6fdeec548419dafe0d8c727ea9db7 (127.28.54.65:37211), 1b1cd51a6e4f49c88eb2d118d294d565 (127.28.54.66:34329)
I20260709 13:09:21.849478 29023 raft_consensus.cc:3060] T 53af9481634c45f5a2cf52f3b93047d1 P ade6fdeec548419dafe0d8c727ea9db7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:21.849660 29098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "53af9481634c45f5a2cf52f3b93047d1" candidate_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1b1cd51a6e4f49c88eb2d118d294d565"
I20260709 13:09:21.848845 29225 consensus_queue.cc:237] T 51c6d4bc6ab749eebcd70e632a6c8c08 P ade6fdeec548419dafe0d8c727ea9db7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.850273 29098 raft_consensus.cc:3060] T 53af9481634c45f5a2cf52f3b93047d1 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:21.855909 29098 raft_consensus.cc:2468] T 53af9481634c45f5a2cf52f3b93047d1 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b675cc11b2dc4c9580b7b61dee8e4333 in term 1.
I20260709 13:09:21.856007 29023 raft_consensus.cc:2468] T 53af9481634c45f5a2cf52f3b93047d1 P ade6fdeec548419dafe0d8c727ea9db7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b675cc11b2dc4c9580b7b61dee8e4333 in term 1.
I20260709 13:09:21.856956 29139 leader_election.cc:304] T 53af9481634c45f5a2cf52f3b93047d1 P b675cc11b2dc4c9580b7b61dee8e4333 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b1cd51a6e4f49c88eb2d118d294d565, b675cc11b2dc4c9580b7b61dee8e4333; no voters: 
I20260709 13:09:21.857733 29246 raft_consensus.cc:2804] T 53af9481634c45f5a2cf52f3b93047d1 P b675cc11b2dc4c9580b7b61dee8e4333 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:21.858234 29246 raft_consensus.cc:697] T 53af9481634c45f5a2cf52f3b93047d1 P b675cc11b2dc4c9580b7b61dee8e4333 [term 1 LEADER]: Becoming Leader. State: Replica: b675cc11b2dc4c9580b7b61dee8e4333, State: Running, Role: LEADER
I20260709 13:09:21.859000 29246 consensus_queue.cc:237] T 53af9481634c45f5a2cf52f3b93047d1 P b675cc11b2dc4c9580b7b61dee8e4333 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.864004 28921 catalog_manager.cc:5697] T 51c6d4bc6ab749eebcd70e632a6c8c08 P ade6fdeec548419dafe0d8c727ea9db7 reported cstate change: term changed from 0 to 1, leader changed from <none> to ade6fdeec548419dafe0d8c727ea9db7 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "ade6fdeec548419dafe0d8c727ea9db7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:21.867249 28920 catalog_manager.cc:5697] T 53af9481634c45f5a2cf52f3b93047d1 P b675cc11b2dc4c9580b7b61dee8e4333 reported cstate change: term changed from 0 to 1, leader changed from <none> to b675cc11b2dc4c9580b7b61dee8e4333 (127.28.54.67). New cstate: current_term: 1 leader_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:21.913340 29223 consensus_queue.cc:1048] T ca468a14f9ad47fc83c2fd8cca868e02 P 1b1cd51a6e4f49c88eb2d118d294d565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:21.927609 29274 consensus_queue.cc:1048] T ca468a14f9ad47fc83c2fd8cca868e02 P 1b1cd51a6e4f49c88eb2d118d294d565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:21.948563 29277 raft_consensus.cc:493] T ccbfc50ea0d341fd975dd116645a8437 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:21.948935 29277 raft_consensus.cc:515] T ccbfc50ea0d341fd975dd116645a8437 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:21.950593 29277 leader_election.cc:290] T ccbfc50ea0d341fd975dd116645a8437 P 1b1cd51a6e4f49c88eb2d118d294d565 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ade6fdeec548419dafe0d8c727ea9db7 (127.28.54.65:37211), b675cc11b2dc4c9580b7b61dee8e4333 (127.28.54.67:41555)
I20260709 13:09:21.951380 29023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbfc50ea0d341fd975dd116645a8437" candidate_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ade6fdeec548419dafe0d8c727ea9db7" is_pre_election: true
I20260709 13:09:21.951602 29173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbfc50ea0d341fd975dd116645a8437" candidate_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" is_pre_election: true
I20260709 13:09:21.951963 29023 raft_consensus.cc:2393] T ccbfc50ea0d341fd975dd116645a8437 P ade6fdeec548419dafe0d8c727ea9db7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1b1cd51a6e4f49c88eb2d118d294d565 in current term 1: Already voted for candidate b675cc11b2dc4c9580b7b61dee8e4333 in this term.
I20260709 13:09:21.952960 29063 leader_election.cc:304] T ccbfc50ea0d341fd975dd116645a8437 P 1b1cd51a6e4f49c88eb2d118d294d565 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1b1cd51a6e4f49c88eb2d118d294d565; no voters: ade6fdeec548419dafe0d8c727ea9db7, b675cc11b2dc4c9580b7b61dee8e4333
I20260709 13:09:21.953528 29277 raft_consensus.cc:3060] T ccbfc50ea0d341fd975dd116645a8437 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:21.957798 29277 raft_consensus.cc:2749] T ccbfc50ea0d341fd975dd116645a8437 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:21.972173 29246 consensus_queue.cc:1048] T ccbfc50ea0d341fd975dd116645a8437 P b675cc11b2dc4c9580b7b61dee8e4333 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:21.982657 29262 consensus_queue.cc:1048] T ccbfc50ea0d341fd975dd116645a8437 P b675cc11b2dc4c9580b7b61dee8e4333 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:22.097821 29173 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ccbfc50ea0d341fd975dd116645a8437"
dest_uuid: "b675cc11b2dc4c9580b7b61dee8e4333"
mode: GRACEFUL
new_leader_uuid: "ade6fdeec548419dafe0d8c727ea9db7"
 from {username='slave'} at 127.0.0.1:36878
I20260709 13:09:22.098500 29173 raft_consensus.cc:606] T ccbfc50ea0d341fd975dd116645a8437 P b675cc11b2dc4c9580b7b61dee8e4333 [term 1 LEADER]: Received request to transfer leadership to TS ade6fdeec548419dafe0d8c727ea9db7
I20260709 13:09:22.107085 29225 consensus_queue.cc:1048] T 22db5056ecf74660ba332b5eef197747 P ade6fdeec548419dafe0d8c727ea9db7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:22.110896 29098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca468a14f9ad47fc83c2fd8cca868e02"
dest_uuid: "1b1cd51a6e4f49c88eb2d118d294d565"
mode: GRACEFUL
new_leader_uuid: "ade6fdeec548419dafe0d8c727ea9db7"
 from {username='slave'} at 127.0.0.1:53904
I20260709 13:09:22.111364 29098 raft_consensus.cc:606] T ca468a14f9ad47fc83c2fd8cca868e02 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 1 LEADER]: Received request to transfer leadership to TS ade6fdeec548419dafe0d8c727ea9db7
I20260709 13:09:22.121848 29172 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f593a7e12d394520ac84b9cb01f8a445"
dest_uuid: "b675cc11b2dc4c9580b7b61dee8e4333"
mode: GRACEFUL
new_leader_uuid: "ade6fdeec548419dafe0d8c727ea9db7"
 from {username='slave'} at 127.0.0.1:36878
I20260709 13:09:22.122463 29172 raft_consensus.cc:606] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 [term 1 LEADER]: Received request to transfer leadership to TS ade6fdeec548419dafe0d8c727ea9db7
I20260709 13:09:22.122272 29225 consensus_queue.cc:1048] T 22db5056ecf74660ba332b5eef197747 P ade6fdeec548419dafe0d8c727ea9db7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:22.128580 29172 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ef2753d7f6f46e68a0ec3be338f525b"
dest_uuid: "b675cc11b2dc4c9580b7b61dee8e4333"
mode: GRACEFUL
new_leader_uuid: "1b1cd51a6e4f49c88eb2d118d294d565"
 from {username='slave'} at 127.0.0.1:36878
I20260709 13:09:22.129032 29172 raft_consensus.cc:606] T 8ef2753d7f6f46e68a0ec3be338f525b P b675cc11b2dc4c9580b7b61dee8e4333 [term 1 LEADER]: Received request to transfer leadership to TS 1b1cd51a6e4f49c88eb2d118d294d565
I20260709 13:09:22.134636 29262 consensus_queue.cc:1048] T 8ef2753d7f6f46e68a0ec3be338f525b P b675cc11b2dc4c9580b7b61dee8e4333 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:22.134846 29172 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eadbdd1c8352482bbaeb320f048b6a27"
dest_uuid: "b675cc11b2dc4c9580b7b61dee8e4333"
mode: GRACEFUL
new_leader_uuid: "1b1cd51a6e4f49c88eb2d118d294d565"
 from {username='slave'} at 127.0.0.1:36878
I20260709 13:09:22.135399 29172 raft_consensus.cc:606] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333 [term 1 LEADER]: Received request to transfer leadership to TS 1b1cd51a6e4f49c88eb2d118d294d565
I20260709 13:09:22.144145 29259 raft_consensus.cc:993] T 8ef2753d7f6f46e68a0ec3be338f525b P b675cc11b2dc4c9580b7b61dee8e4333: : Instructing follower 1b1cd51a6e4f49c88eb2d118d294d565 to start an election
I20260709 13:09:22.144577 29259 raft_consensus.cc:1081] T 8ef2753d7f6f46e68a0ec3be338f525b P b675cc11b2dc4c9580b7b61dee8e4333 [term 1 LEADER]: Signalling peer 1b1cd51a6e4f49c88eb2d118d294d565 to start an election
I20260709 13:09:22.146528 29099 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ef2753d7f6f46e68a0ec3be338f525b"
dest_uuid: "1b1cd51a6e4f49c88eb2d118d294d565"
 from {username='slave'} at 127.0.0.1:53888
I20260709 13:09:22.147082 29099 raft_consensus.cc:493] T 8ef2753d7f6f46e68a0ec3be338f525b P 1b1cd51a6e4f49c88eb2d118d294d565 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:22.147460 29099 raft_consensus.cc:3060] T 8ef2753d7f6f46e68a0ec3be338f525b P 1b1cd51a6e4f49c88eb2d118d294d565 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:22.147977 29172 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64cf35d356a841d6875cbb4106b48f49"
dest_uuid: "b675cc11b2dc4c9580b7b61dee8e4333"
mode: GRACEFUL
new_leader_uuid: "1b1cd51a6e4f49c88eb2d118d294d565"
 from {username='slave'} at 127.0.0.1:36878
I20260709 13:09:22.148509 29172 raft_consensus.cc:606] T 64cf35d356a841d6875cbb4106b48f49 P b675cc11b2dc4c9580b7b61dee8e4333 [term 1 LEADER]: Received request to transfer leadership to TS 1b1cd51a6e4f49c88eb2d118d294d565
I20260709 13:09:22.153548 29099 raft_consensus.cc:515] T 8ef2753d7f6f46e68a0ec3be338f525b P 1b1cd51a6e4f49c88eb2d118d294d565 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:22.156450 29024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ef2753d7f6f46e68a0ec3be338f525b" candidate_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ade6fdeec548419dafe0d8c727ea9db7"
I20260709 13:09:22.157007 29024 raft_consensus.cc:3060] T 8ef2753d7f6f46e68a0ec3be338f525b P ade6fdeec548419dafe0d8c727ea9db7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:22.157320 29099 leader_election.cc:290] T 8ef2753d7f6f46e68a0ec3be338f525b P 1b1cd51a6e4f49c88eb2d118d294d565 [CANDIDATE]: Term 2 election: Requested vote from peers ade6fdeec548419dafe0d8c727ea9db7 (127.28.54.65:37211), b675cc11b2dc4c9580b7b61dee8e4333 (127.28.54.67:41555)
I20260709 13:09:22.157454 29172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ef2753d7f6f46e68a0ec3be338f525b" candidate_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b675cc11b2dc4c9580b7b61dee8e4333"
I20260709 13:09:22.158010 29172 raft_consensus.cc:3055] T 8ef2753d7f6f46e68a0ec3be338f525b P b675cc11b2dc4c9580b7b61dee8e4333 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:22.158319 29172 raft_consensus.cc:740] T 8ef2753d7f6f46e68a0ec3be338f525b P b675cc11b2dc4c9580b7b61dee8e4333 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b675cc11b2dc4c9580b7b61dee8e4333, State: Running, Role: LEADER
I20260709 13:09:22.159091 29172 consensus_queue.cc:260] T 8ef2753d7f6f46e68a0ec3be338f525b P b675cc11b2dc4c9580b7b61dee8e4333 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:22.160343 29172 raft_consensus.cc:3060] T 8ef2753d7f6f46e68a0ec3be338f525b P b675cc11b2dc4c9580b7b61dee8e4333 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:22.163226 29024 raft_consensus.cc:2468] T 8ef2753d7f6f46e68a0ec3be338f525b P ade6fdeec548419dafe0d8c727ea9db7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b1cd51a6e4f49c88eb2d118d294d565 in term 2.
I20260709 13:09:22.164300 29063 leader_election.cc:304] T 8ef2753d7f6f46e68a0ec3be338f525b P 1b1cd51a6e4f49c88eb2d118d294d565 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b1cd51a6e4f49c88eb2d118d294d565, ade6fdeec548419dafe0d8c727ea9db7; no voters: 
I20260709 13:09:22.165050 29277 raft_consensus.cc:2804] T 8ef2753d7f6f46e68a0ec3be338f525b P 1b1cd51a6e4f49c88eb2d118d294d565 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:22.165510 29277 raft_consensus.cc:697] T 8ef2753d7f6f46e68a0ec3be338f525b P 1b1cd51a6e4f49c88eb2d118d294d565 [term 2 LEADER]: Becoming Leader. State: Replica: 1b1cd51a6e4f49c88eb2d118d294d565, State: Running, Role: LEADER
I20260709 13:09:22.166288 29277 consensus_queue.cc:237] T 8ef2753d7f6f46e68a0ec3be338f525b P 1b1cd51a6e4f49c88eb2d118d294d565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:22.172273 29172 raft_consensus.cc:2468] T 8ef2753d7f6f46e68a0ec3be338f525b P b675cc11b2dc4c9580b7b61dee8e4333 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b1cd51a6e4f49c88eb2d118d294d565 in term 2.
I20260709 13:09:22.179358 28920 catalog_manager.cc:5697] T 8ef2753d7f6f46e68a0ec3be338f525b P 1b1cd51a6e4f49c88eb2d118d294d565 reported cstate change: term changed from 1 to 2, leader changed from b675cc11b2dc4c9580b7b61dee8e4333 (127.28.54.67) to 1b1cd51a6e4f49c88eb2d118d294d565 (127.28.54.66). New cstate: current_term: 2 leader_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:22.191766 29024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51c6d4bc6ab749eebcd70e632a6c8c08"
dest_uuid: "ade6fdeec548419dafe0d8c727ea9db7"
mode: GRACEFUL
new_leader_uuid: "1b1cd51a6e4f49c88eb2d118d294d565"
 from {username='slave'} at 127.0.0.1:42460
I20260709 13:09:22.192373 29024 raft_consensus.cc:606] T 51c6d4bc6ab749eebcd70e632a6c8c08 P ade6fdeec548419dafe0d8c727ea9db7 [term 1 LEADER]: Received request to transfer leadership to TS 1b1cd51a6e4f49c88eb2d118d294d565
I20260709 13:09:22.215348 29261 consensus_queue.cc:1048] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:22.222602 29222 raft_consensus.cc:993] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333: : Instructing follower ade6fdeec548419dafe0d8c727ea9db7 to start an election
I20260709 13:09:22.222467 29262 consensus_queue.cc:1048] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:22.223065 29222 raft_consensus.cc:1081] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 [term 1 LEADER]: Signalling peer ade6fdeec548419dafe0d8c727ea9db7 to start an election
I20260709 13:09:22.224802 29024 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f593a7e12d394520ac84b9cb01f8a445"
dest_uuid: "ade6fdeec548419dafe0d8c727ea9db7"
 from {username='slave'} at 127.0.0.1:42450
I20260709 13:09:22.225337 29024 raft_consensus.cc:493] T f593a7e12d394520ac84b9cb01f8a445 P ade6fdeec548419dafe0d8c727ea9db7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:22.225682 29024 raft_consensus.cc:3060] T f593a7e12d394520ac84b9cb01f8a445 P ade6fdeec548419dafe0d8c727ea9db7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:22.233089 29261 consensus_queue.cc:1048] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:22.235143 29024 raft_consensus.cc:515] T f593a7e12d394520ac84b9cb01f8a445 P ade6fdeec548419dafe0d8c727ea9db7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:22.237222 29023 raft_consensus.cc:1240] T f593a7e12d394520ac84b9cb01f8a445 P ade6fdeec548419dafe0d8c727ea9db7 [term 2 FOLLOWER]: Rejecting Update request from peer b675cc11b2dc4c9580b7b61dee8e4333 for earlier term 1. Current term is 2. Ops: []
I20260709 13:09:22.242790 29099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f593a7e12d394520ac84b9cb01f8a445" candidate_uuid: "ade6fdeec548419dafe0d8c727ea9db7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1b1cd51a6e4f49c88eb2d118d294d565"
I20260709 13:09:22.245009 29261 consensus_queue.cc:1059] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:09:22.246462 29246 raft_consensus.cc:993] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333: : Instructing follower 1b1cd51a6e4f49c88eb2d118d294d565 to start an election
I20260709 13:09:22.250183 29222 raft_consensus.cc:3055] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:22.250447 29246 raft_consensus.cc:1081] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333 [term 1 LEADER]: Signalling peer 1b1cd51a6e4f49c88eb2d118d294d565 to start an election
I20260709 13:09:22.250533 29222 raft_consensus.cc:740] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b675cc11b2dc4c9580b7b61dee8e4333, State: Running, Role: LEADER
I20260709 13:09:22.251516 29222 consensus_queue.cc:260] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:22.252365 29222 raft_consensus.cc:3060] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:22.245174 29024 leader_election.cc:290] T f593a7e12d394520ac84b9cb01f8a445 P ade6fdeec548419dafe0d8c727ea9db7 [CANDIDATE]: Term 2 election: Requested vote from peers 1b1cd51a6e4f49c88eb2d118d294d565 (127.28.54.66:34329), b675cc11b2dc4c9580b7b61dee8e4333 (127.28.54.67:41555)
I20260709 13:09:22.256071 29259 consensus_queue.cc:1048] T 64cf35d356a841d6875cbb4106b48f49 P b675cc11b2dc4c9580b7b61dee8e4333 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:22.247524 29172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f593a7e12d394520ac84b9cb01f8a445" candidate_uuid: "ade6fdeec548419dafe0d8c727ea9db7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b675cc11b2dc4c9580b7b61dee8e4333"
I20260709 13:09:22.260674 29284 consensus_queue.cc:1048] T 51c6d4bc6ab749eebcd70e632a6c8c08 P ade6fdeec548419dafe0d8c727ea9db7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:22.267594 29099 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eadbdd1c8352482bbaeb320f048b6a27"
dest_uuid: "1b1cd51a6e4f49c88eb2d118d294d565"
 from {username='slave'} at 127.0.0.1:53888
I20260709 13:09:22.268111 29099 raft_consensus.cc:493] T eadbdd1c8352482bbaeb320f048b6a27 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:22.268464 29099 raft_consensus.cc:3060] T eadbdd1c8352482bbaeb320f048b6a27 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:22.273633 29225 raft_consensus.cc:993] T 51c6d4bc6ab749eebcd70e632a6c8c08 P ade6fdeec548419dafe0d8c727ea9db7: : Instructing follower 1b1cd51a6e4f49c88eb2d118d294d565 to start an election
I20260709 13:09:22.274093 29225 raft_consensus.cc:1081] T 51c6d4bc6ab749eebcd70e632a6c8c08 P ade6fdeec548419dafe0d8c727ea9db7 [term 1 LEADER]: Signalling peer 1b1cd51a6e4f49c88eb2d118d294d565 to start an election
I20260709 13:09:22.275940 29095 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "51c6d4bc6ab749eebcd70e632a6c8c08"
dest_uuid: "1b1cd51a6e4f49c88eb2d118d294d565"
 from {username='slave'} at 127.0.0.1:53894
I20260709 13:09:22.276784 29095 raft_consensus.cc:493] T 51c6d4bc6ab749eebcd70e632a6c8c08 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:22.277125 29095 raft_consensus.cc:3060] T 51c6d4bc6ab749eebcd70e632a6c8c08 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:22.284330 29095 raft_consensus.cc:515] T 51c6d4bc6ab749eebcd70e632a6c8c08 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:22.284868 29246 consensus_queue.cc:1048] T 64cf35d356a841d6875cbb4106b48f49 P b675cc11b2dc4c9580b7b61dee8e4333 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:22.285004 29284 consensus_queue.cc:1048] T 51c6d4bc6ab749eebcd70e632a6c8c08 P ade6fdeec548419dafe0d8c727ea9db7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:22.287122 29095 leader_election.cc:290] T 51c6d4bc6ab749eebcd70e632a6c8c08 P 1b1cd51a6e4f49c88eb2d118d294d565 [CANDIDATE]: Term 2 election: Requested vote from peers ade6fdeec548419dafe0d8c727ea9db7 (127.28.54.65:37211), b675cc11b2dc4c9580b7b61dee8e4333 (127.28.54.67:41555)
I20260709 13:09:22.287535 29023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c6d4bc6ab749eebcd70e632a6c8c08" candidate_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ade6fdeec548419dafe0d8c727ea9db7"
I20260709 13:09:22.288414 29023 raft_consensus.cc:3055] T 51c6d4bc6ab749eebcd70e632a6c8c08 P ade6fdeec548419dafe0d8c727ea9db7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:22.288808 29172 raft_consensus.cc:2468] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade6fdeec548419dafe0d8c727ea9db7 in term 2.
I20260709 13:09:22.290930 29099 raft_consensus.cc:515] T eadbdd1c8352482bbaeb320f048b6a27 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:22.302341 29099 leader_election.cc:290] T eadbdd1c8352482bbaeb320f048b6a27 P 1b1cd51a6e4f49c88eb2d118d294d565 [CANDIDATE]: Term 2 election: Requested vote from peers ade6fdeec548419dafe0d8c727ea9db7 (127.28.54.65:37211), b675cc11b2dc4c9580b7b61dee8e4333 (127.28.54.67:41555)
I20260709 13:09:22.302640 29024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadbdd1c8352482bbaeb320f048b6a27" candidate_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ade6fdeec548419dafe0d8c727ea9db7"
I20260709 13:09:22.303218 29024 raft_consensus.cc:3060] T eadbdd1c8352482bbaeb320f048b6a27 P ade6fdeec548419dafe0d8c727ea9db7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:22.303329 28989 leader_election.cc:304] T f593a7e12d394520ac84b9cb01f8a445 P ade6fdeec548419dafe0d8c727ea9db7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ade6fdeec548419dafe0d8c727ea9db7, b675cc11b2dc4c9580b7b61dee8e4333; no voters: 1b1cd51a6e4f49c88eb2d118d294d565
I20260709 13:09:22.303134 29170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadbdd1c8352482bbaeb320f048b6a27" candidate_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b675cc11b2dc4c9580b7b61dee8e4333"
I20260709 13:09:22.292447 29246 consensus_queue.cc:1048] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 13:09:22.289218 29173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c6d4bc6ab749eebcd70e632a6c8c08" candidate_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b675cc11b2dc4c9580b7b61dee8e4333"
I20260709 13:09:22.304946 29170 raft_consensus.cc:3055] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:22.305264 29170 raft_consensus.cc:740] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b675cc11b2dc4c9580b7b61dee8e4333, State: Running, Role: LEADER
I20260709 13:09:22.306550 29284 raft_consensus.cc:2804] T f593a7e12d394520ac84b9cb01f8a445 P ade6fdeec548419dafe0d8c727ea9db7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:22.306459 29170 consensus_queue.cc:260] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:22.307085 29284 raft_consensus.cc:697] T f593a7e12d394520ac84b9cb01f8a445 P ade6fdeec548419dafe0d8c727ea9db7 [term 2 LEADER]: Becoming Leader. State: Replica: ade6fdeec548419dafe0d8c727ea9db7, State: Running, Role: LEADER
I20260709 13:09:22.307952 29284 consensus_queue.cc:237] T f593a7e12d394520ac84b9cb01f8a445 P ade6fdeec548419dafe0d8c727ea9db7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:22.288728 29023 raft_consensus.cc:740] T 51c6d4bc6ab749eebcd70e632a6c8c08 P ade6fdeec548419dafe0d8c727ea9db7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ade6fdeec548419dafe0d8c727ea9db7, State: Running, Role: LEADER
I20260709 13:09:22.309648 29024 raft_consensus.cc:2468] T eadbdd1c8352482bbaeb320f048b6a27 P ade6fdeec548419dafe0d8c727ea9db7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b1cd51a6e4f49c88eb2d118d294d565 in term 2.
I20260709 13:09:22.310806 29063 leader_election.cc:304] T eadbdd1c8352482bbaeb320f048b6a27 P 1b1cd51a6e4f49c88eb2d118d294d565 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b1cd51a6e4f49c88eb2d118d294d565, ade6fdeec548419dafe0d8c727ea9db7; no voters: 
I20260709 13:09:22.311573 29277 raft_consensus.cc:2804] T eadbdd1c8352482bbaeb320f048b6a27 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:22.309943 29023 consensus_queue.cc:260] T 51c6d4bc6ab749eebcd70e632a6c8c08 P ade6fdeec548419dafe0d8c727ea9db7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:22.312620 29277 raft_consensus.cc:697] T eadbdd1c8352482bbaeb320f048b6a27 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 2 LEADER]: Becoming Leader. State: Replica: 1b1cd51a6e4f49c88eb2d118d294d565, State: Running, Role: LEADER
I20260709 13:09:22.316274 29277 consensus_queue.cc:237] T eadbdd1c8352482bbaeb320f048b6a27 P 1b1cd51a6e4f49c88eb2d118d294d565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:22.317121 29170 raft_consensus.cc:3060] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:22.325246 29024 raft_consensus.cc:1240] T eadbdd1c8352482bbaeb320f048b6a27 P ade6fdeec548419dafe0d8c727ea9db7 [term 2 FOLLOWER]: Rejecting Update request from peer b675cc11b2dc4c9580b7b61dee8e4333 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:09:22.331342 29170 raft_consensus.cc:2468] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b1cd51a6e4f49c88eb2d118d294d565 in term 2.
I20260709 13:09:22.341637 29223 raft_consensus.cc:993] T ca468a14f9ad47fc83c2fd8cca868e02 P 1b1cd51a6e4f49c88eb2d118d294d565: : Instructing follower ade6fdeec548419dafe0d8c727ea9db7 to start an election
I20260709 13:09:22.342128 29223 raft_consensus.cc:1081] T ca468a14f9ad47fc83c2fd8cca868e02 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 1 LEADER]: Signalling peer ade6fdeec548419dafe0d8c727ea9db7 to start an election
I20260709 13:09:22.318651 29023 raft_consensus.cc:3060] T 51c6d4bc6ab749eebcd70e632a6c8c08 P ade6fdeec548419dafe0d8c727ea9db7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:22.344214 29024 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca468a14f9ad47fc83c2fd8cca868e02"
dest_uuid: "ade6fdeec548419dafe0d8c727ea9db7"
 from {username='slave'} at 127.0.0.1:42444
I20260709 13:09:22.344803 29024 raft_consensus.cc:493] T ca468a14f9ad47fc83c2fd8cca868e02 P ade6fdeec548419dafe0d8c727ea9db7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:22.345176 29024 raft_consensus.cc:3060] T ca468a14f9ad47fc83c2fd8cca868e02 P ade6fdeec548419dafe0d8c727ea9db7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:22.351315 29024 raft_consensus.cc:515] T ca468a14f9ad47fc83c2fd8cca868e02 P ade6fdeec548419dafe0d8c727ea9db7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:22.350627 29023 raft_consensus.cc:2468] T 51c6d4bc6ab749eebcd70e632a6c8c08 P ade6fdeec548419dafe0d8c727ea9db7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b1cd51a6e4f49c88eb2d118d294d565 in term 2.
I20260709 13:09:22.354080 29095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca468a14f9ad47fc83c2fd8cca868e02" candidate_uuid: "ade6fdeec548419dafe0d8c727ea9db7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1b1cd51a6e4f49c88eb2d118d294d565"
I20260709 13:09:22.352591 28920 catalog_manager.cc:5697] T f593a7e12d394520ac84b9cb01f8a445 P ade6fdeec548419dafe0d8c727ea9db7 reported cstate change: term changed from 1 to 2, leader changed from b675cc11b2dc4c9580b7b61dee8e4333 (127.28.54.67) to ade6fdeec548419dafe0d8c727ea9db7 (127.28.54.65). New cstate: current_term: 2 leader_uuid: "ade6fdeec548419dafe0d8c727ea9db7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:22.354624 29095 raft_consensus.cc:3055] T ca468a14f9ad47fc83c2fd8cca868e02 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:22.355019 29095 raft_consensus.cc:740] T ca468a14f9ad47fc83c2fd8cca868e02 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1b1cd51a6e4f49c88eb2d118d294d565, State: Running, Role: LEADER
I20260709 13:09:22.355744 29095 consensus_queue.cc:260] T ca468a14f9ad47fc83c2fd8cca868e02 P 1b1cd51a6e4f49c88eb2d118d294d565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:22.356686 29095 raft_consensus.cc:3060] T ca468a14f9ad47fc83c2fd8cca868e02 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:22.354518 29063 leader_election.cc:304] T 51c6d4bc6ab749eebcd70e632a6c8c08 P 1b1cd51a6e4f49c88eb2d118d294d565 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1b1cd51a6e4f49c88eb2d118d294d565, ade6fdeec548419dafe0d8c727ea9db7; no voters: b675cc11b2dc4c9580b7b61dee8e4333
I20260709 13:09:22.358122 29223 raft_consensus.cc:2804] T 51c6d4bc6ab749eebcd70e632a6c8c08 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:22.358559 29223 raft_consensus.cc:697] T 51c6d4bc6ab749eebcd70e632a6c8c08 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 2 LEADER]: Becoming Leader. State: Replica: 1b1cd51a6e4f49c88eb2d118d294d565, State: Running, Role: LEADER
I20260709 13:09:22.359277 29223 consensus_queue.cc:237] T 51c6d4bc6ab749eebcd70e632a6c8c08 P 1b1cd51a6e4f49c88eb2d118d294d565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:22.362149 29261 raft_consensus.cc:993] T 64cf35d356a841d6875cbb4106b48f49 P b675cc11b2dc4c9580b7b61dee8e4333: : Instructing follower 1b1cd51a6e4f49c88eb2d118d294d565 to start an election
I20260709 13:09:22.362558 29222 raft_consensus.cc:1081] T 64cf35d356a841d6875cbb4106b48f49 P b675cc11b2dc4c9580b7b61dee8e4333 [term 1 LEADER]: Signalling peer 1b1cd51a6e4f49c88eb2d118d294d565 to start an election
I20260709 13:09:22.365844 29024 leader_election.cc:290] T ca468a14f9ad47fc83c2fd8cca868e02 P ade6fdeec548419dafe0d8c727ea9db7 [CANDIDATE]: Term 2 election: Requested vote from peers 1b1cd51a6e4f49c88eb2d118d294d565 (127.28.54.66:34329), b675cc11b2dc4c9580b7b61dee8e4333 (127.28.54.67:41555)
I20260709 13:09:22.364203 29099 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "64cf35d356a841d6875cbb4106b48f49"
dest_uuid: "1b1cd51a6e4f49c88eb2d118d294d565"
 from {username='slave'} at 127.0.0.1:53888
I20260709 13:09:22.367743 29099 raft_consensus.cc:493] T 64cf35d356a841d6875cbb4106b48f49 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:22.368099 29099 raft_consensus.cc:3060] T 64cf35d356a841d6875cbb4106b48f49 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:22.364181 29095 raft_consensus.cc:2468] T ca468a14f9ad47fc83c2fd8cca868e02 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade6fdeec548419dafe0d8c727ea9db7 in term 2.
I20260709 13:09:22.369498 28990 leader_election.cc:304] T ca468a14f9ad47fc83c2fd8cca868e02 P ade6fdeec548419dafe0d8c727ea9db7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b1cd51a6e4f49c88eb2d118d294d565, ade6fdeec548419dafe0d8c727ea9db7; no voters: 
I20260709 13:09:22.370288 29284 raft_consensus.cc:2804] T ca468a14f9ad47fc83c2fd8cca868e02 P ade6fdeec548419dafe0d8c727ea9db7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:22.370718 29284 raft_consensus.cc:697] T ca468a14f9ad47fc83c2fd8cca868e02 P ade6fdeec548419dafe0d8c727ea9db7 [term 2 LEADER]: Becoming Leader. State: Replica: ade6fdeec548419dafe0d8c727ea9db7, State: Running, Role: LEADER
I20260709 13:09:22.370847 29171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca468a14f9ad47fc83c2fd8cca868e02" candidate_uuid: "ade6fdeec548419dafe0d8c727ea9db7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b675cc11b2dc4c9580b7b61dee8e4333"
I20260709 13:09:22.371531 29171 raft_consensus.cc:3060] T ca468a14f9ad47fc83c2fd8cca868e02 P b675cc11b2dc4c9580b7b61dee8e4333 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:22.371486 29284 consensus_queue.cc:237] T ca468a14f9ad47fc83c2fd8cca868e02 P ade6fdeec548419dafe0d8c727ea9db7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:22.375173 29099 raft_consensus.cc:515] T 64cf35d356a841d6875cbb4106b48f49 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:22.377970 29099 leader_election.cc:290] T 64cf35d356a841d6875cbb4106b48f49 P 1b1cd51a6e4f49c88eb2d118d294d565 [CANDIDATE]: Term 2 election: Requested vote from peers ade6fdeec548419dafe0d8c727ea9db7 (127.28.54.65:37211), b675cc11b2dc4c9580b7b61dee8e4333 (127.28.54.67:41555)
I20260709 13:09:22.378575 29024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64cf35d356a841d6875cbb4106b48f49" candidate_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ade6fdeec548419dafe0d8c727ea9db7"
I20260709 13:09:22.379101 29024 raft_consensus.cc:3060] T 64cf35d356a841d6875cbb4106b48f49 P ade6fdeec548419dafe0d8c727ea9db7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:22.379154 29170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64cf35d356a841d6875cbb4106b48f49" candidate_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b675cc11b2dc4c9580b7b61dee8e4333"
I20260709 13:09:22.379721 29170 raft_consensus.cc:3055] T 64cf35d356a841d6875cbb4106b48f49 P b675cc11b2dc4c9580b7b61dee8e4333 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:22.380015 29170 raft_consensus.cc:740] T 64cf35d356a841d6875cbb4106b48f49 P b675cc11b2dc4c9580b7b61dee8e4333 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b675cc11b2dc4c9580b7b61dee8e4333, State: Running, Role: LEADER
I20260709 13:09:22.380750 29170 consensus_queue.cc:260] T 64cf35d356a841d6875cbb4106b48f49 P b675cc11b2dc4c9580b7b61dee8e4333 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:22.381882 29170 raft_consensus.cc:3060] T 64cf35d356a841d6875cbb4106b48f49 P b675cc11b2dc4c9580b7b61dee8e4333 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:22.383097 28919 catalog_manager.cc:5697] T eadbdd1c8352482bbaeb320f048b6a27 P 1b1cd51a6e4f49c88eb2d118d294d565 reported cstate change: term changed from 1 to 2, leader changed from b675cc11b2dc4c9580b7b61dee8e4333 (127.28.54.67) to 1b1cd51a6e4f49c88eb2d118d294d565 (127.28.54.66). New cstate: current_term: 2 leader_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:22.385195 29024 raft_consensus.cc:2468] T 64cf35d356a841d6875cbb4106b48f49 P ade6fdeec548419dafe0d8c727ea9db7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b1cd51a6e4f49c88eb2d118d294d565 in term 2.
I20260709 13:09:22.384866 28919 catalog_manager.cc:5697] T 51c6d4bc6ab749eebcd70e632a6c8c08 P 1b1cd51a6e4f49c88eb2d118d294d565 reported cstate change: term changed from 1 to 2, leader changed from ade6fdeec548419dafe0d8c727ea9db7 (127.28.54.65) to 1b1cd51a6e4f49c88eb2d118d294d565 (127.28.54.66). New cstate: current_term: 2 leader_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:22.386358 29063 leader_election.cc:304] T 64cf35d356a841d6875cbb4106b48f49 P 1b1cd51a6e4f49c88eb2d118d294d565 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b1cd51a6e4f49c88eb2d118d294d565, ade6fdeec548419dafe0d8c727ea9db7; no voters: 
I20260709 13:09:22.387131 29277 raft_consensus.cc:2804] T 64cf35d356a841d6875cbb4106b48f49 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:22.387574 29277 raft_consensus.cc:697] T 64cf35d356a841d6875cbb4106b48f49 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 2 LEADER]: Becoming Leader. State: Replica: 1b1cd51a6e4f49c88eb2d118d294d565, State: Running, Role: LEADER
I20260709 13:09:22.388207 28920 catalog_manager.cc:5697] T ca468a14f9ad47fc83c2fd8cca868e02 P ade6fdeec548419dafe0d8c727ea9db7 reported cstate change: term changed from 1 to 2, leader changed from 1b1cd51a6e4f49c88eb2d118d294d565 (127.28.54.66) to ade6fdeec548419dafe0d8c727ea9db7 (127.28.54.65). New cstate: current_term: 2 leader_uuid: "ade6fdeec548419dafe0d8c727ea9db7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:22.388311 29277 consensus_queue.cc:237] T 64cf35d356a841d6875cbb4106b48f49 P 1b1cd51a6e4f49c88eb2d118d294d565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:22.391091 29170 raft_consensus.cc:2468] T 64cf35d356a841d6875cbb4106b48f49 P b675cc11b2dc4c9580b7b61dee8e4333 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b1cd51a6e4f49c88eb2d118d294d565 in term 2.
I20260709 13:09:22.394672 29171 raft_consensus.cc:2468] T ca468a14f9ad47fc83c2fd8cca868e02 P b675cc11b2dc4c9580b7b61dee8e4333 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade6fdeec548419dafe0d8c727ea9db7 in term 2.
I20260709 13:09:22.400736 28919 catalog_manager.cc:5697] T 64cf35d356a841d6875cbb4106b48f49 P 1b1cd51a6e4f49c88eb2d118d294d565 reported cstate change: term changed from 1 to 2, leader changed from b675cc11b2dc4c9580b7b61dee8e4333 (127.28.54.67) to 1b1cd51a6e4f49c88eb2d118d294d565 (127.28.54.66). New cstate: current_term: 2 leader_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:22.462879 29246 raft_consensus.cc:993] T ccbfc50ea0d341fd975dd116645a8437 P b675cc11b2dc4c9580b7b61dee8e4333: : Instructing follower ade6fdeec548419dafe0d8c727ea9db7 to start an election
I20260709 13:09:22.463335 29222 raft_consensus.cc:1081] T ccbfc50ea0d341fd975dd116645a8437 P b675cc11b2dc4c9580b7b61dee8e4333 [term 1 LEADER]: Signalling peer ade6fdeec548419dafe0d8c727ea9db7 to start an election
I20260709 13:09:22.464780 29024 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ccbfc50ea0d341fd975dd116645a8437"
dest_uuid: "ade6fdeec548419dafe0d8c727ea9db7"
 from {username='slave'} at 127.0.0.1:42450
I20260709 13:09:22.465247 29024 raft_consensus.cc:493] T ccbfc50ea0d341fd975dd116645a8437 P ade6fdeec548419dafe0d8c727ea9db7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:22.465520 29024 raft_consensus.cc:3060] T ccbfc50ea0d341fd975dd116645a8437 P ade6fdeec548419dafe0d8c727ea9db7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:22.470227 29024 raft_consensus.cc:515] T ccbfc50ea0d341fd975dd116645a8437 P ade6fdeec548419dafe0d8c727ea9db7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:22.471204 29246 consensus_queue.cc:1048] T 53af9481634c45f5a2cf52f3b93047d1 P b675cc11b2dc4c9580b7b61dee8e4333 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:22.472888 29024 leader_election.cc:290] T ccbfc50ea0d341fd975dd116645a8437 P ade6fdeec548419dafe0d8c727ea9db7 [CANDIDATE]: Term 2 election: Requested vote from peers 1b1cd51a6e4f49c88eb2d118d294d565 (127.28.54.66:34329), b675cc11b2dc4c9580b7b61dee8e4333 (127.28.54.67:41555)
I20260709 13:09:22.474331 29099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbfc50ea0d341fd975dd116645a8437" candidate_uuid: "ade6fdeec548419dafe0d8c727ea9db7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1b1cd51a6e4f49c88eb2d118d294d565"
I20260709 13:09:22.480357 29170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbfc50ea0d341fd975dd116645a8437" candidate_uuid: "ade6fdeec548419dafe0d8c727ea9db7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b675cc11b2dc4c9580b7b61dee8e4333"
I20260709 13:09:22.480912 29170 raft_consensus.cc:3055] T ccbfc50ea0d341fd975dd116645a8437 P b675cc11b2dc4c9580b7b61dee8e4333 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:22.481220 29170 raft_consensus.cc:740] T ccbfc50ea0d341fd975dd116645a8437 P b675cc11b2dc4c9580b7b61dee8e4333 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b675cc11b2dc4c9580b7b61dee8e4333, State: Running, Role: LEADER
I20260709 13:09:22.482504 29261 consensus_queue.cc:1048] T 53af9481634c45f5a2cf52f3b93047d1 P b675cc11b2dc4c9580b7b61dee8e4333 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:22.481990 29170 consensus_queue.cc:260] T ccbfc50ea0d341fd975dd116645a8437 P b675cc11b2dc4c9580b7b61dee8e4333 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:22.487800 29170 raft_consensus.cc:3060] T ccbfc50ea0d341fd975dd116645a8437 P b675cc11b2dc4c9580b7b61dee8e4333 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:22.494736 29170 raft_consensus.cc:2468] T ccbfc50ea0d341fd975dd116645a8437 P b675cc11b2dc4c9580b7b61dee8e4333 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade6fdeec548419dafe0d8c727ea9db7 in term 2.
I20260709 13:09:22.495815 28989 leader_election.cc:304] T ccbfc50ea0d341fd975dd116645a8437 P ade6fdeec548419dafe0d8c727ea9db7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: ade6fdeec548419dafe0d8c727ea9db7, b675cc11b2dc4c9580b7b61dee8e4333; no voters: 1b1cd51a6e4f49c88eb2d118d294d565
I20260709 13:09:22.496807 29284 raft_consensus.cc:2804] T ccbfc50ea0d341fd975dd116645a8437 P ade6fdeec548419dafe0d8c727ea9db7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:22.497236 29284 raft_consensus.cc:697] T ccbfc50ea0d341fd975dd116645a8437 P ade6fdeec548419dafe0d8c727ea9db7 [term 2 LEADER]: Becoming Leader. State: Replica: ade6fdeec548419dafe0d8c727ea9db7, State: Running, Role: LEADER
I20260709 13:09:22.497999 29284 consensus_queue.cc:237] T ccbfc50ea0d341fd975dd116645a8437 P ade6fdeec548419dafe0d8c727ea9db7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:22.507647 28918 catalog_manager.cc:5697] T ccbfc50ea0d341fd975dd116645a8437 P ade6fdeec548419dafe0d8c727ea9db7 reported cstate change: term changed from 1 to 2, leader changed from b675cc11b2dc4c9580b7b61dee8e4333 (127.28.54.67) to ade6fdeec548419dafe0d8c727ea9db7 (127.28.54.65). New cstate: current_term: 2 leader_uuid: "ade6fdeec548419dafe0d8c727ea9db7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:22.602142 29024 raft_consensus.cc:1275] T 8ef2753d7f6f46e68a0ec3be338f525b P ade6fdeec548419dafe0d8c727ea9db7 [term 2 FOLLOWER]: Refusing update from remote peer 1b1cd51a6e4f49c88eb2d118d294d565: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:22.603513 29277 consensus_queue.cc:1048] T 8ef2753d7f6f46e68a0ec3be338f525b P 1b1cd51a6e4f49c88eb2d118d294d565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:22.612322 29170 raft_consensus.cc:1275] T 8ef2753d7f6f46e68a0ec3be338f525b P b675cc11b2dc4c9580b7b61dee8e4333 [term 2 FOLLOWER]: Refusing update from remote peer 1b1cd51a6e4f49c88eb2d118d294d565: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:22.613879 29274 consensus_queue.cc:1048] T 8ef2753d7f6f46e68a0ec3be338f525b P 1b1cd51a6e4f49c88eb2d118d294d565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:22.788829 29171 raft_consensus.cc:1275] T 64cf35d356a841d6875cbb4106b48f49 P b675cc11b2dc4c9580b7b61dee8e4333 [term 2 FOLLOWER]: Refusing update from remote peer 1b1cd51a6e4f49c88eb2d118d294d565: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:22.789970 29274 consensus_queue.cc:1048] T 64cf35d356a841d6875cbb4106b48f49 P 1b1cd51a6e4f49c88eb2d118d294d565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:22.791457 29098 raft_consensus.cc:3060] T f593a7e12d394520ac84b9cb01f8a445 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:22.800961 29098 raft_consensus.cc:1275] T f593a7e12d394520ac84b9cb01f8a445 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 2 FOLLOWER]: Refusing update from remote peer ade6fdeec548419dafe0d8c727ea9db7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:22.802286 29284 consensus_queue.cc:1048] T f593a7e12d394520ac84b9cb01f8a445 P ade6fdeec548419dafe0d8c727ea9db7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:22.802608 29024 raft_consensus.cc:1275] T 64cf35d356a841d6875cbb4106b48f49 P ade6fdeec548419dafe0d8c727ea9db7 [term 2 FOLLOWER]: Refusing update from remote peer 1b1cd51a6e4f49c88eb2d118d294d565: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:22.804342 29277 consensus_queue.cc:1048] T 64cf35d356a841d6875cbb4106b48f49 P 1b1cd51a6e4f49c88eb2d118d294d565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:22.810072 29171 raft_consensus.cc:1275] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 [term 2 FOLLOWER]: Refusing update from remote peer ade6fdeec548419dafe0d8c727ea9db7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:22.811757 29225 consensus_queue.cc:1048] T f593a7e12d394520ac84b9cb01f8a445 P ade6fdeec548419dafe0d8c727ea9db7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:22.816495 29170 raft_consensus.cc:1275] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333 [term 2 FOLLOWER]: Refusing update from remote peer 1b1cd51a6e4f49c88eb2d118d294d565: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:22.817996 29223 consensus_queue.cc:1048] T eadbdd1c8352482bbaeb320f048b6a27 P 1b1cd51a6e4f49c88eb2d118d294d565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:22.826889 29023 raft_consensus.cc:1275] T eadbdd1c8352482bbaeb320f048b6a27 P ade6fdeec548419dafe0d8c727ea9db7 [term 2 FOLLOWER]: Refusing update from remote peer 1b1cd51a6e4f49c88eb2d118d294d565: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:22.828333 29274 consensus_queue.cc:1048] T eadbdd1c8352482bbaeb320f048b6a27 P 1b1cd51a6e4f49c88eb2d118d294d565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:22.881675 29170 raft_consensus.cc:1275] T ccbfc50ea0d341fd975dd116645a8437 P b675cc11b2dc4c9580b7b61dee8e4333 [term 2 FOLLOWER]: Refusing update from remote peer ade6fdeec548419dafe0d8c727ea9db7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:22.883661 29265 consensus_queue.cc:1048] T ccbfc50ea0d341fd975dd116645a8437 P ade6fdeec548419dafe0d8c727ea9db7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:22.892318 29098 raft_consensus.cc:3060] T ccbfc50ea0d341fd975dd116645a8437 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:22.900642 29098 raft_consensus.cc:1275] T ccbfc50ea0d341fd975dd116645a8437 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 2 FOLLOWER]: Refusing update from remote peer ade6fdeec548419dafe0d8c727ea9db7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:22.901783 29284 consensus_queue.cc:1048] T ccbfc50ea0d341fd975dd116645a8437 P ade6fdeec548419dafe0d8c727ea9db7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:22.903860 29098 raft_consensus.cc:1275] T ca468a14f9ad47fc83c2fd8cca868e02 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 2 FOLLOWER]: Refusing update from remote peer ade6fdeec548419dafe0d8c727ea9db7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:22.905184 29284 consensus_queue.cc:1048] T ca468a14f9ad47fc83c2fd8cca868e02 P ade6fdeec548419dafe0d8c727ea9db7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:22.913827 29170 raft_consensus.cc:1275] T ca468a14f9ad47fc83c2fd8cca868e02 P b675cc11b2dc4c9580b7b61dee8e4333 [term 2 FOLLOWER]: Refusing update from remote peer ade6fdeec548419dafe0d8c727ea9db7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:22.916625 29225 consensus_queue.cc:1048] T ca468a14f9ad47fc83c2fd8cca868e02 P ade6fdeec548419dafe0d8c727ea9db7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:22.919268 29171 raft_consensus.cc:3060] T 51c6d4bc6ab749eebcd70e632a6c8c08 P b675cc11b2dc4c9580b7b61dee8e4333 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:22.924279 29024 raft_consensus.cc:1275] T 51c6d4bc6ab749eebcd70e632a6c8c08 P ade6fdeec548419dafe0d8c727ea9db7 [term 2 FOLLOWER]: Refusing update from remote peer 1b1cd51a6e4f49c88eb2d118d294d565: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:22.925899 29298 consensus_queue.cc:1048] T 51c6d4bc6ab749eebcd70e632a6c8c08 P 1b1cd51a6e4f49c88eb2d118d294d565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:22.930539 29171 raft_consensus.cc:1275] T 51c6d4bc6ab749eebcd70e632a6c8c08 P b675cc11b2dc4c9580b7b61dee8e4333 [term 2 FOLLOWER]: Refusing update from remote peer 1b1cd51a6e4f49c88eb2d118d294d565: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:22.932379 29274 consensus_queue.cc:1048] T 51c6d4bc6ab749eebcd70e632a6c8c08 P 1b1cd51a6e4f49c88eb2d118d294d565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:25.220743 28889 auto_leader_rebalancer-test.cc:316] The leader distribution is 
I20260709 13:09:25.221592 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:25.235635 29099 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eadbdd1c8352482bbaeb320f048b6a27"
dest_uuid: "1b1cd51a6e4f49c88eb2d118d294d565"
mode: GRACEFUL
new_leader_uuid: "b675cc11b2dc4c9580b7b61dee8e4333"
 from {username='slave'} at 127.0.0.1:53918
I20260709 13:09:25.236119 29099 raft_consensus.cc:606] T eadbdd1c8352482bbaeb320f048b6a27 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 2 LEADER]: Received request to transfer leadership to TS b675cc11b2dc4c9580b7b61dee8e4333
I20260709 13:09:25.245925 29024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f593a7e12d394520ac84b9cb01f8a445"
dest_uuid: "ade6fdeec548419dafe0d8c727ea9db7"
mode: GRACEFUL
new_leader_uuid: "b675cc11b2dc4c9580b7b61dee8e4333"
 from {username='slave'} at 127.0.0.1:42476
I20260709 13:09:25.246397 29024 raft_consensus.cc:606] T f593a7e12d394520ac84b9cb01f8a445 P ade6fdeec548419dafe0d8c727ea9db7 [term 2 LEADER]: Received request to transfer leadership to TS b675cc11b2dc4c9580b7b61dee8e4333
I20260709 13:09:25.247419 28889 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:09:25.247838 28889 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:25.261116 29303 raft_consensus.cc:993] T eadbdd1c8352482bbaeb320f048b6a27 P 1b1cd51a6e4f49c88eb2d118d294d565: : Instructing follower b675cc11b2dc4c9580b7b61dee8e4333 to start an election
I20260709 13:09:25.261483 29307 raft_consensus.cc:1081] T eadbdd1c8352482bbaeb320f048b6a27 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 2 LEADER]: Signalling peer b675cc11b2dc4c9580b7b61dee8e4333 to start an election
I20260709 13:09:25.262817 29171 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eadbdd1c8352482bbaeb320f048b6a27"
dest_uuid: "b675cc11b2dc4c9580b7b61dee8e4333"
 from {username='slave'} at 127.0.0.1:36870
I20260709 13:09:25.263228 29171 raft_consensus.cc:493] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:25.263476 29171 raft_consensus.cc:3060] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:25.267621 29171 raft_consensus.cc:515] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:25.269132 29171 leader_election.cc:290] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333 [CANDIDATE]: Term 3 election: Requested vote from peers ade6fdeec548419dafe0d8c727ea9db7 (127.28.54.65:37211), 1b1cd51a6e4f49c88eb2d118d294d565 (127.28.54.66:34329)
I20260709 13:09:25.269800 29024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadbdd1c8352482bbaeb320f048b6a27" candidate_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ade6fdeec548419dafe0d8c727ea9db7"
I20260709 13:09:25.270066 29099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadbdd1c8352482bbaeb320f048b6a27" candidate_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1b1cd51a6e4f49c88eb2d118d294d565"
I20260709 13:09:25.270351 29024 raft_consensus.cc:3060] T eadbdd1c8352482bbaeb320f048b6a27 P ade6fdeec548419dafe0d8c727ea9db7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:25.270529 29099 raft_consensus.cc:3055] T eadbdd1c8352482bbaeb320f048b6a27 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:25.270831 29099 raft_consensus.cc:740] T eadbdd1c8352482bbaeb320f048b6a27 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1b1cd51a6e4f49c88eb2d118d294d565, State: Running, Role: LEADER
I20260709 13:09:25.271443 29099 consensus_queue.cc:260] T eadbdd1c8352482bbaeb320f048b6a27 P 1b1cd51a6e4f49c88eb2d118d294d565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:25.272269 29099 raft_consensus.cc:3060] T eadbdd1c8352482bbaeb320f048b6a27 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:25.274592 29024 raft_consensus.cc:2468] T eadbdd1c8352482bbaeb320f048b6a27 P ade6fdeec548419dafe0d8c727ea9db7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b675cc11b2dc4c9580b7b61dee8e4333 in term 3.
I20260709 13:09:25.275548 29137 leader_election.cc:304] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ade6fdeec548419dafe0d8c727ea9db7, b675cc11b2dc4c9580b7b61dee8e4333; no voters: 
I20260709 13:09:25.276182 29301 raft_consensus.cc:2804] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:25.276695 29099 raft_consensus.cc:2468] T eadbdd1c8352482bbaeb320f048b6a27 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b675cc11b2dc4c9580b7b61dee8e4333 in term 3.
I20260709 13:09:25.277315 29301 raft_consensus.cc:697] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333 [term 3 LEADER]: Becoming Leader. State: Replica: b675cc11b2dc4c9580b7b61dee8e4333, State: Running, Role: LEADER
I20260709 13:09:25.278081 29301 consensus_queue.cc:237] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:25.284485 28921 catalog_manager.cc:5697] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333 reported cstate change: term changed from 2 to 3, leader changed from 1b1cd51a6e4f49c88eb2d118d294d565 (127.28.54.66) to b675cc11b2dc4c9580b7b61dee8e4333 (127.28.54.67). New cstate: current_term: 3 leader_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:25.432116 29225 raft_consensus.cc:993] T f593a7e12d394520ac84b9cb01f8a445 P ade6fdeec548419dafe0d8c727ea9db7: : Instructing follower b675cc11b2dc4c9580b7b61dee8e4333 to start an election
I20260709 13:09:25.432505 29225 raft_consensus.cc:1081] T f593a7e12d394520ac84b9cb01f8a445 P ade6fdeec548419dafe0d8c727ea9db7 [term 2 LEADER]: Signalling peer b675cc11b2dc4c9580b7b61dee8e4333 to start an election
I20260709 13:09:25.433826 29171 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f593a7e12d394520ac84b9cb01f8a445"
dest_uuid: "b675cc11b2dc4c9580b7b61dee8e4333"
 from {username='slave'} at 127.0.0.1:36872
I20260709 13:09:25.434279 29171 raft_consensus.cc:493] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:25.434572 29171 raft_consensus.cc:3060] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:25.438750 29171 raft_consensus.cc:515] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:25.440315 29171 leader_election.cc:290] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 [CANDIDATE]: Term 3 election: Requested vote from peers ade6fdeec548419dafe0d8c727ea9db7 (127.28.54.65:37211), 1b1cd51a6e4f49c88eb2d118d294d565 (127.28.54.66:34329)
I20260709 13:09:25.441074 29024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f593a7e12d394520ac84b9cb01f8a445" candidate_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ade6fdeec548419dafe0d8c727ea9db7"
I20260709 13:09:25.441320 29099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f593a7e12d394520ac84b9cb01f8a445" candidate_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1b1cd51a6e4f49c88eb2d118d294d565"
I20260709 13:09:25.441586 29024 raft_consensus.cc:3055] T f593a7e12d394520ac84b9cb01f8a445 P ade6fdeec548419dafe0d8c727ea9db7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:25.441808 29099 raft_consensus.cc:3060] T f593a7e12d394520ac84b9cb01f8a445 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:25.441936 29024 raft_consensus.cc:740] T f593a7e12d394520ac84b9cb01f8a445 P ade6fdeec548419dafe0d8c727ea9db7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ade6fdeec548419dafe0d8c727ea9db7, State: Running, Role: LEADER
I20260709 13:09:25.442646 29024 consensus_queue.cc:260] T f593a7e12d394520ac84b9cb01f8a445 P ade6fdeec548419dafe0d8c727ea9db7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:25.443502 29024 raft_consensus.cc:3060] T f593a7e12d394520ac84b9cb01f8a445 P ade6fdeec548419dafe0d8c727ea9db7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:25.446281 29099 raft_consensus.cc:2468] T f593a7e12d394520ac84b9cb01f8a445 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b675cc11b2dc4c9580b7b61dee8e4333 in term 3.
I20260709 13:09:25.447266 29139 leader_election.cc:304] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b1cd51a6e4f49c88eb2d118d294d565, b675cc11b2dc4c9580b7b61dee8e4333; no voters: 
I20260709 13:09:25.448005 29301 raft_consensus.cc:2804] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:25.448120 29024 raft_consensus.cc:2468] T f593a7e12d394520ac84b9cb01f8a445 P ade6fdeec548419dafe0d8c727ea9db7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b675cc11b2dc4c9580b7b61dee8e4333 in term 3.
I20260709 13:09:25.448378 29301 raft_consensus.cc:697] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 [term 3 LEADER]: Becoming Leader. State: Replica: b675cc11b2dc4c9580b7b61dee8e4333, State: Running, Role: LEADER
I20260709 13:09:25.449146 29301 consensus_queue.cc:237] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:25.455667 28921 catalog_manager.cc:5697] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 reported cstate change: term changed from 2 to 3, leader changed from ade6fdeec548419dafe0d8c727ea9db7 (127.28.54.65) to b675cc11b2dc4c9580b7b61dee8e4333 (127.28.54.67). New cstate: current_term: 3 leader_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:25.856899 29099 raft_consensus.cc:1275] T f593a7e12d394520ac84b9cb01f8a445 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 3 FOLLOWER]: Refusing update from remote peer b675cc11b2dc4c9580b7b61dee8e4333: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:25.858047 29301 consensus_queue.cc:1048] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:25.866120 29024 raft_consensus.cc:1275] T f593a7e12d394520ac84b9cb01f8a445 P ade6fdeec548419dafe0d8c727ea9db7 [term 3 FOLLOWER]: Refusing update from remote peer b675cc11b2dc4c9580b7b61dee8e4333: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:25.867384 29301 consensus_queue.cc:1048] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:25.867911 29024 raft_consensus.cc:1275] T eadbdd1c8352482bbaeb320f048b6a27 P ade6fdeec548419dafe0d8c727ea9db7 [term 3 FOLLOWER]: Refusing update from remote peer b675cc11b2dc4c9580b7b61dee8e4333: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:25.869311 29301 consensus_queue.cc:1048] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:25.887132 29099 raft_consensus.cc:1275] T eadbdd1c8352482bbaeb320f048b6a27 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 3 FOLLOWER]: Refusing update from remote peer b675cc11b2dc4c9580b7b61dee8e4333: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:25.888568 29308 consensus_queue.cc:1048] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:26.248582 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:26.257896 29023 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22db5056ecf74660ba332b5eef197747"
dest_uuid: "ade6fdeec548419dafe0d8c727ea9db7"
mode: GRACEFUL
new_leader_uuid: "1b1cd51a6e4f49c88eb2d118d294d565"
 from {username='slave'} at 127.0.0.1:42460
I20260709 13:09:26.258390 29023 raft_consensus.cc:606] T 22db5056ecf74660ba332b5eef197747 P ade6fdeec548419dafe0d8c727ea9db7 [term 1 LEADER]: Received request to transfer leadership to TS 1b1cd51a6e4f49c88eb2d118d294d565
I20260709 13:09:26.262460 29023 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ccbfc50ea0d341fd975dd116645a8437"
dest_uuid: "ade6fdeec548419dafe0d8c727ea9db7"
mode: GRACEFUL
new_leader_uuid: "1b1cd51a6e4f49c88eb2d118d294d565"
 from {username='slave'} at 127.0.0.1:42460
I20260709 13:09:26.262887 29023 raft_consensus.cc:606] T ccbfc50ea0d341fd975dd116645a8437 P ade6fdeec548419dafe0d8c727ea9db7 [term 2 LEADER]: Received request to transfer leadership to TS 1b1cd51a6e4f49c88eb2d118d294d565
I20260709 13:09:26.266880 29023 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ca468a14f9ad47fc83c2fd8cca868e02"
dest_uuid: "ade6fdeec548419dafe0d8c727ea9db7"
mode: GRACEFUL
new_leader_uuid: "1b1cd51a6e4f49c88eb2d118d294d565"
 from {username='slave'} at 127.0.0.1:42460
I20260709 13:09:26.267302 29023 raft_consensus.cc:606] T ca468a14f9ad47fc83c2fd8cca868e02 P ade6fdeec548419dafe0d8c727ea9db7 [term 2 LEADER]: Received request to transfer leadership to TS 1b1cd51a6e4f49c88eb2d118d294d565
I20260709 13:09:26.271319 29170 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f593a7e12d394520ac84b9cb01f8a445"
dest_uuid: "b675cc11b2dc4c9580b7b61dee8e4333"
mode: GRACEFUL
new_leader_uuid: "1b1cd51a6e4f49c88eb2d118d294d565"
 from {username='slave'} at 127.0.0.1:36878
I20260709 13:09:26.271729 29170 raft_consensus.cc:606] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 [term 3 LEADER]: Received request to transfer leadership to TS 1b1cd51a6e4f49c88eb2d118d294d565
I20260709 13:09:26.278085 29170 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "eadbdd1c8352482bbaeb320f048b6a27"
dest_uuid: "b675cc11b2dc4c9580b7b61dee8e4333"
mode: GRACEFUL
new_leader_uuid: "1b1cd51a6e4f49c88eb2d118d294d565"
 from {username='slave'} at 127.0.0.1:36878
I20260709 13:09:26.278491 29170 raft_consensus.cc:606] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333 [term 3 LEADER]: Received request to transfer leadership to TS 1b1cd51a6e4f49c88eb2d118d294d565
I20260709 13:09:26.346540 29225 raft_consensus.cc:993] T 22db5056ecf74660ba332b5eef197747 P ade6fdeec548419dafe0d8c727ea9db7: : Instructing follower 1b1cd51a6e4f49c88eb2d118d294d565 to start an election
I20260709 13:09:26.346971 29314 raft_consensus.cc:1081] T 22db5056ecf74660ba332b5eef197747 P ade6fdeec548419dafe0d8c727ea9db7 [term 1 LEADER]: Signalling peer 1b1cd51a6e4f49c88eb2d118d294d565 to start an election
I20260709 13:09:26.348402 29098 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22db5056ecf74660ba332b5eef197747"
dest_uuid: "1b1cd51a6e4f49c88eb2d118d294d565"
 from {username='slave'} at 127.0.0.1:53894
I20260709 13:09:26.348847 29098 raft_consensus.cc:493] T 22db5056ecf74660ba332b5eef197747 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:26.349117 29098 raft_consensus.cc:3060] T 22db5056ecf74660ba332b5eef197747 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:26.354206 29098 raft_consensus.cc:515] T 22db5056ecf74660ba332b5eef197747 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } }
I20260709 13:09:26.355834 29098 leader_election.cc:290] T 22db5056ecf74660ba332b5eef197747 P 1b1cd51a6e4f49c88eb2d118d294d565 [CANDIDATE]: Term 2 election: Requested vote from peers ade6fdeec548419dafe0d8c727ea9db7 (127.28.54.65:37211), b675cc11b2dc4c9580b7b61dee8e4333 (127.28.54.67:41555)
I20260709 13:09:26.356616 29023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22db5056ecf74660ba332b5eef197747" candidate_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ade6fdeec548419dafe0d8c727ea9db7"
I20260709 13:09:26.356814 29170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22db5056ecf74660ba332b5eef197747" candidate_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b675cc11b2dc4c9580b7b61dee8e4333"
I20260709 13:09:26.357088 29023 raft_consensus.cc:3055] T 22db5056ecf74660ba332b5eef197747 P ade6fdeec548419dafe0d8c727ea9db7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:26.357312 29170 raft_consensus.cc:3060] T 22db5056ecf74660ba332b5eef197747 P b675cc11b2dc4c9580b7b61dee8e4333 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:26.357393 29023 raft_consensus.cc:740] T 22db5056ecf74660ba332b5eef197747 P ade6fdeec548419dafe0d8c727ea9db7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ade6fdeec548419dafe0d8c727ea9db7, State: Running, Role: LEADER
I20260709 13:09:26.358114 29023 consensus_queue.cc:260] T 22db5056ecf74660ba332b5eef197747 P ade6fdeec548419dafe0d8c727ea9db7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } }
I20260709 13:09:26.358945 29023 raft_consensus.cc:3060] T 22db5056ecf74660ba332b5eef197747 P ade6fdeec548419dafe0d8c727ea9db7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:26.361735 29170 raft_consensus.cc:2468] T 22db5056ecf74660ba332b5eef197747 P b675cc11b2dc4c9580b7b61dee8e4333 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b1cd51a6e4f49c88eb2d118d294d565 in term 2.
I20260709 13:09:26.362756 29064 leader_election.cc:304] T 22db5056ecf74660ba332b5eef197747 P 1b1cd51a6e4f49c88eb2d118d294d565 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b1cd51a6e4f49c88eb2d118d294d565, b675cc11b2dc4c9580b7b61dee8e4333; no voters: 
I20260709 13:09:26.363116 29023 raft_consensus.cc:2468] T 22db5056ecf74660ba332b5eef197747 P ade6fdeec548419dafe0d8c727ea9db7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b1cd51a6e4f49c88eb2d118d294d565 in term 2.
I20260709 13:09:26.363351 29307 raft_consensus.cc:2804] T 22db5056ecf74660ba332b5eef197747 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:26.364370 29307 raft_consensus.cc:697] T 22db5056ecf74660ba332b5eef197747 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 2 LEADER]: Becoming Leader. State: Replica: 1b1cd51a6e4f49c88eb2d118d294d565, State: Running, Role: LEADER
I20260709 13:09:26.365145 29307 consensus_queue.cc:237] T 22db5056ecf74660ba332b5eef197747 P 1b1cd51a6e4f49c88eb2d118d294d565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } }
I20260709 13:09:26.371093 28921 catalog_manager.cc:5697] T 22db5056ecf74660ba332b5eef197747 P 1b1cd51a6e4f49c88eb2d118d294d565 reported cstate change: term changed from 1 to 2, leader changed from ade6fdeec548419dafe0d8c727ea9db7 (127.28.54.65) to 1b1cd51a6e4f49c88eb2d118d294d565 (127.28.54.66). New cstate: current_term: 2 leader_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:26.422874 29329 raft_consensus.cc:993] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333: : Instructing follower 1b1cd51a6e4f49c88eb2d118d294d565 to start an election
I20260709 13:09:26.423344 29330 raft_consensus.cc:1081] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333 [term 3 LEADER]: Signalling peer 1b1cd51a6e4f49c88eb2d118d294d565 to start an election
I20260709 13:09:26.424687 29098 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "eadbdd1c8352482bbaeb320f048b6a27"
dest_uuid: "1b1cd51a6e4f49c88eb2d118d294d565"
 from {username='slave'} at 127.0.0.1:53888
I20260709 13:09:26.425120 29098 raft_consensus.cc:493] T eadbdd1c8352482bbaeb320f048b6a27 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:26.425509 29098 raft_consensus.cc:3060] T eadbdd1c8352482bbaeb320f048b6a27 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:26.429644 29098 raft_consensus.cc:515] T eadbdd1c8352482bbaeb320f048b6a27 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:26.431102 29098 leader_election.cc:290] T eadbdd1c8352482bbaeb320f048b6a27 P 1b1cd51a6e4f49c88eb2d118d294d565 [CANDIDATE]: Term 4 election: Requested vote from peers ade6fdeec548419dafe0d8c727ea9db7 (127.28.54.65:37211), b675cc11b2dc4c9580b7b61dee8e4333 (127.28.54.67:41555)
I20260709 13:09:26.431862 29023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadbdd1c8352482bbaeb320f048b6a27" candidate_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ade6fdeec548419dafe0d8c727ea9db7"
I20260709 13:09:26.432046 29170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "eadbdd1c8352482bbaeb320f048b6a27" candidate_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b675cc11b2dc4c9580b7b61dee8e4333"
I20260709 13:09:26.432372 29023 raft_consensus.cc:3060] T eadbdd1c8352482bbaeb320f048b6a27 P ade6fdeec548419dafe0d8c727ea9db7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:26.432507 29170 raft_consensus.cc:3055] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:26.432821 29170 raft_consensus.cc:740] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b675cc11b2dc4c9580b7b61dee8e4333, State: Running, Role: LEADER
I20260709 13:09:26.433386 29170 consensus_queue.cc:260] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:26.434258 29170 raft_consensus.cc:3060] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:26.436697 29023 raft_consensus.cc:2468] T eadbdd1c8352482bbaeb320f048b6a27 P ade6fdeec548419dafe0d8c727ea9db7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b1cd51a6e4f49c88eb2d118d294d565 in term 4.
I20260709 13:09:26.437548 29063 leader_election.cc:304] T eadbdd1c8352482bbaeb320f048b6a27 P 1b1cd51a6e4f49c88eb2d118d294d565 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b1cd51a6e4f49c88eb2d118d294d565, ade6fdeec548419dafe0d8c727ea9db7; no voters: 
I20260709 13:09:26.438203 29307 raft_consensus.cc:2804] T eadbdd1c8352482bbaeb320f048b6a27 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:26.438483 29170 raft_consensus.cc:2468] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b1cd51a6e4f49c88eb2d118d294d565 in term 4.
I20260709 13:09:26.438555 29307 raft_consensus.cc:697] T eadbdd1c8352482bbaeb320f048b6a27 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 4 LEADER]: Becoming Leader. State: Replica: 1b1cd51a6e4f49c88eb2d118d294d565, State: Running, Role: LEADER
I20260709 13:09:26.439429 29307 consensus_queue.cc:237] T eadbdd1c8352482bbaeb320f048b6a27 P 1b1cd51a6e4f49c88eb2d118d294d565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:26.443332 29329 raft_consensus.cc:993] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333: : Instructing follower 1b1cd51a6e4f49c88eb2d118d294d565 to start an election
I20260709 13:09:26.443732 29330 raft_consensus.cc:1081] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 [term 3 LEADER]: Signalling peer 1b1cd51a6e4f49c88eb2d118d294d565 to start an election
I20260709 13:09:26.445019 29098 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f593a7e12d394520ac84b9cb01f8a445"
dest_uuid: "1b1cd51a6e4f49c88eb2d118d294d565"
 from {username='slave'} at 127.0.0.1:53888
I20260709 13:09:26.445469 29098 raft_consensus.cc:493] T f593a7e12d394520ac84b9cb01f8a445 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:26.445067 28921 catalog_manager.cc:5697] T eadbdd1c8352482bbaeb320f048b6a27 P 1b1cd51a6e4f49c88eb2d118d294d565 reported cstate change: term changed from 3 to 4, leader changed from b675cc11b2dc4c9580b7b61dee8e4333 (127.28.54.67) to 1b1cd51a6e4f49c88eb2d118d294d565 (127.28.54.66). New cstate: current_term: 4 leader_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:26.445742 29098 raft_consensus.cc:3060] T f593a7e12d394520ac84b9cb01f8a445 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:26.451176 29098 raft_consensus.cc:515] T f593a7e12d394520ac84b9cb01f8a445 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:26.453007 29098 leader_election.cc:290] T f593a7e12d394520ac84b9cb01f8a445 P 1b1cd51a6e4f49c88eb2d118d294d565 [CANDIDATE]: Term 4 election: Requested vote from peers ade6fdeec548419dafe0d8c727ea9db7 (127.28.54.65:37211), b675cc11b2dc4c9580b7b61dee8e4333 (127.28.54.67:41555)
I20260709 13:09:26.454061 29023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f593a7e12d394520ac84b9cb01f8a445" candidate_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "ade6fdeec548419dafe0d8c727ea9db7"
I20260709 13:09:26.454658 29023 raft_consensus.cc:3060] T f593a7e12d394520ac84b9cb01f8a445 P ade6fdeec548419dafe0d8c727ea9db7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:26.454795 29170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f593a7e12d394520ac84b9cb01f8a445" candidate_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b675cc11b2dc4c9580b7b61dee8e4333"
I20260709 13:09:26.455330 29170 raft_consensus.cc:3055] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:26.455619 29170 raft_consensus.cc:740] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b675cc11b2dc4c9580b7b61dee8e4333, State: Running, Role: LEADER
I20260709 13:09:26.456358 29170 consensus_queue.cc:260] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:26.457211 29170 raft_consensus.cc:3060] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:26.460915 29023 raft_consensus.cc:2468] T f593a7e12d394520ac84b9cb01f8a445 P ade6fdeec548419dafe0d8c727ea9db7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b1cd51a6e4f49c88eb2d118d294d565 in term 4.
I20260709 13:09:26.461597 29024 raft_consensus.cc:1240] T f593a7e12d394520ac84b9cb01f8a445 P ade6fdeec548419dafe0d8c727ea9db7 [term 4 FOLLOWER]: Rejecting Update request from peer b675cc11b2dc4c9580b7b61dee8e4333 for earlier term 3. Current term is 4. Ops: []
I20260709 13:09:26.462080 29063 leader_election.cc:304] T f593a7e12d394520ac84b9cb01f8a445 P 1b1cd51a6e4f49c88eb2d118d294d565 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b1cd51a6e4f49c88eb2d118d294d565, ade6fdeec548419dafe0d8c727ea9db7; no voters: 
I20260709 13:09:26.462867 29307 raft_consensus.cc:2804] T f593a7e12d394520ac84b9cb01f8a445 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:26.463316 29307 raft_consensus.cc:697] T f593a7e12d394520ac84b9cb01f8a445 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 4 LEADER]: Becoming Leader. State: Replica: 1b1cd51a6e4f49c88eb2d118d294d565, State: Running, Role: LEADER
I20260709 13:09:26.464062 29170 raft_consensus.cc:2468] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b1cd51a6e4f49c88eb2d118d294d565 in term 4.
I20260709 13:09:26.463949 29307 consensus_queue.cc:237] T f593a7e12d394520ac84b9cb01f8a445 P 1b1cd51a6e4f49c88eb2d118d294d565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:26.469123 28921 catalog_manager.cc:5697] T f593a7e12d394520ac84b9cb01f8a445 P 1b1cd51a6e4f49c88eb2d118d294d565 reported cstate change: term changed from 3 to 4, leader changed from b675cc11b2dc4c9580b7b61dee8e4333 (127.28.54.67) to 1b1cd51a6e4f49c88eb2d118d294d565 (127.28.54.66). New cstate: current_term: 4 leader_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:26.482456 29225 raft_consensus.cc:993] T ccbfc50ea0d341fd975dd116645a8437 P ade6fdeec548419dafe0d8c727ea9db7: : Instructing follower 1b1cd51a6e4f49c88eb2d118d294d565 to start an election
I20260709 13:09:26.482839 29314 raft_consensus.cc:1081] T ccbfc50ea0d341fd975dd116645a8437 P ade6fdeec548419dafe0d8c727ea9db7 [term 2 LEADER]: Signalling peer 1b1cd51a6e4f49c88eb2d118d294d565 to start an election
I20260709 13:09:26.484108 29098 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ccbfc50ea0d341fd975dd116645a8437"
dest_uuid: "1b1cd51a6e4f49c88eb2d118d294d565"
 from {username='slave'} at 127.0.0.1:53894
I20260709 13:09:26.484552 29098 raft_consensus.cc:493] T ccbfc50ea0d341fd975dd116645a8437 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:26.484820 29098 raft_consensus.cc:3060] T ccbfc50ea0d341fd975dd116645a8437 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:26.488972 29098 raft_consensus.cc:515] T ccbfc50ea0d341fd975dd116645a8437 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:26.490530 29098 leader_election.cc:290] T ccbfc50ea0d341fd975dd116645a8437 P 1b1cd51a6e4f49c88eb2d118d294d565 [CANDIDATE]: Term 3 election: Requested vote from peers ade6fdeec548419dafe0d8c727ea9db7 (127.28.54.65:37211), b675cc11b2dc4c9580b7b61dee8e4333 (127.28.54.67:41555)
I20260709 13:09:26.491274 29024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbfc50ea0d341fd975dd116645a8437" candidate_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ade6fdeec548419dafe0d8c727ea9db7"
I20260709 13:09:26.491506 29170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ccbfc50ea0d341fd975dd116645a8437" candidate_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b675cc11b2dc4c9580b7b61dee8e4333"
I20260709 13:09:26.491807 29024 raft_consensus.cc:3055] T ccbfc50ea0d341fd975dd116645a8437 P ade6fdeec548419dafe0d8c727ea9db7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:26.492031 29170 raft_consensus.cc:3060] T ccbfc50ea0d341fd975dd116645a8437 P b675cc11b2dc4c9580b7b61dee8e4333 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:26.492126 29024 raft_consensus.cc:740] T ccbfc50ea0d341fd975dd116645a8437 P ade6fdeec548419dafe0d8c727ea9db7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ade6fdeec548419dafe0d8c727ea9db7, State: Running, Role: LEADER
I20260709 13:09:26.492848 29024 consensus_queue.cc:260] T ccbfc50ea0d341fd975dd116645a8437 P ade6fdeec548419dafe0d8c727ea9db7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:26.493934 29024 raft_consensus.cc:3060] T ccbfc50ea0d341fd975dd116645a8437 P ade6fdeec548419dafe0d8c727ea9db7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:26.498237 29170 raft_consensus.cc:2468] T ccbfc50ea0d341fd975dd116645a8437 P b675cc11b2dc4c9580b7b61dee8e4333 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b1cd51a6e4f49c88eb2d118d294d565 in term 3.
I20260709 13:09:26.499341 29024 raft_consensus.cc:2468] T ccbfc50ea0d341fd975dd116645a8437 P ade6fdeec548419dafe0d8c727ea9db7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b1cd51a6e4f49c88eb2d118d294d565 in term 3.
I20260709 13:09:26.499270 29064 leader_election.cc:304] T ccbfc50ea0d341fd975dd116645a8437 P 1b1cd51a6e4f49c88eb2d118d294d565 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b1cd51a6e4f49c88eb2d118d294d565, b675cc11b2dc4c9580b7b61dee8e4333; no voters: 
I20260709 13:09:26.500015 29307 raft_consensus.cc:2804] T ccbfc50ea0d341fd975dd116645a8437 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:26.500480 29307 raft_consensus.cc:697] T ccbfc50ea0d341fd975dd116645a8437 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 3 LEADER]: Becoming Leader. State: Replica: 1b1cd51a6e4f49c88eb2d118d294d565, State: Running, Role: LEADER
I20260709 13:09:26.501170 29307 consensus_queue.cc:237] T ccbfc50ea0d341fd975dd116645a8437 P 1b1cd51a6e4f49c88eb2d118d294d565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:26.506618 28921 catalog_manager.cc:5697] T ccbfc50ea0d341fd975dd116645a8437 P 1b1cd51a6e4f49c88eb2d118d294d565 reported cstate change: term changed from 2 to 3, leader changed from ade6fdeec548419dafe0d8c727ea9db7 (127.28.54.65) to 1b1cd51a6e4f49c88eb2d118d294d565 (127.28.54.66). New cstate: current_term: 3 leader_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:26.644661 29225 raft_consensus.cc:993] T ca468a14f9ad47fc83c2fd8cca868e02 P ade6fdeec548419dafe0d8c727ea9db7: : Instructing follower 1b1cd51a6e4f49c88eb2d118d294d565 to start an election
I20260709 13:09:26.645043 29225 raft_consensus.cc:1081] T ca468a14f9ad47fc83c2fd8cca868e02 P ade6fdeec548419dafe0d8c727ea9db7 [term 2 LEADER]: Signalling peer 1b1cd51a6e4f49c88eb2d118d294d565 to start an election
I20260709 13:09:26.646382 29098 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ca468a14f9ad47fc83c2fd8cca868e02"
dest_uuid: "1b1cd51a6e4f49c88eb2d118d294d565"
 from {username='slave'} at 127.0.0.1:53894
I20260709 13:09:26.646909 29098 raft_consensus.cc:493] T ca468a14f9ad47fc83c2fd8cca868e02 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:26.647217 29098 raft_consensus.cc:3060] T ca468a14f9ad47fc83c2fd8cca868e02 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:26.651502 29098 raft_consensus.cc:515] T ca468a14f9ad47fc83c2fd8cca868e02 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:26.653077 29098 leader_election.cc:290] T ca468a14f9ad47fc83c2fd8cca868e02 P 1b1cd51a6e4f49c88eb2d118d294d565 [CANDIDATE]: Term 3 election: Requested vote from peers ade6fdeec548419dafe0d8c727ea9db7 (127.28.54.65:37211), b675cc11b2dc4c9580b7b61dee8e4333 (127.28.54.67:41555)
I20260709 13:09:26.653990 29023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca468a14f9ad47fc83c2fd8cca868e02" candidate_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ade6fdeec548419dafe0d8c727ea9db7"
I20260709 13:09:26.654069 29170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ca468a14f9ad47fc83c2fd8cca868e02" candidate_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b675cc11b2dc4c9580b7b61dee8e4333"
I20260709 13:09:26.654625 29023 raft_consensus.cc:3055] T ca468a14f9ad47fc83c2fd8cca868e02 P ade6fdeec548419dafe0d8c727ea9db7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:26.654729 29170 raft_consensus.cc:3060] T ca468a14f9ad47fc83c2fd8cca868e02 P b675cc11b2dc4c9580b7b61dee8e4333 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:26.655018 29023 raft_consensus.cc:740] T ca468a14f9ad47fc83c2fd8cca868e02 P ade6fdeec548419dafe0d8c727ea9db7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ade6fdeec548419dafe0d8c727ea9db7, State: Running, Role: LEADER
I20260709 13:09:26.655779 29023 consensus_queue.cc:260] T ca468a14f9ad47fc83c2fd8cca868e02 P ade6fdeec548419dafe0d8c727ea9db7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:26.656904 29023 raft_consensus.cc:3060] T ca468a14f9ad47fc83c2fd8cca868e02 P ade6fdeec548419dafe0d8c727ea9db7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:26.661085 29170 raft_consensus.cc:2468] T ca468a14f9ad47fc83c2fd8cca868e02 P b675cc11b2dc4c9580b7b61dee8e4333 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b1cd51a6e4f49c88eb2d118d294d565 in term 3.
I20260709 13:09:26.662178 29064 leader_election.cc:304] T ca468a14f9ad47fc83c2fd8cca868e02 P 1b1cd51a6e4f49c88eb2d118d294d565 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1b1cd51a6e4f49c88eb2d118d294d565, b675cc11b2dc4c9580b7b61dee8e4333; no voters: 
I20260709 13:09:26.662890 29307 raft_consensus.cc:2804] T ca468a14f9ad47fc83c2fd8cca868e02 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:26.662949 29023 raft_consensus.cc:2468] T ca468a14f9ad47fc83c2fd8cca868e02 P ade6fdeec548419dafe0d8c727ea9db7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1b1cd51a6e4f49c88eb2d118d294d565 in term 3.
I20260709 13:09:26.663281 29307 raft_consensus.cc:697] T ca468a14f9ad47fc83c2fd8cca868e02 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 3 LEADER]: Becoming Leader. State: Replica: 1b1cd51a6e4f49c88eb2d118d294d565, State: Running, Role: LEADER
I20260709 13:09:26.664088 29307 consensus_queue.cc:237] T ca468a14f9ad47fc83c2fd8cca868e02 P 1b1cd51a6e4f49c88eb2d118d294d565 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:26.670315 28921 catalog_manager.cc:5697] T ca468a14f9ad47fc83c2fd8cca868e02 P 1b1cd51a6e4f49c88eb2d118d294d565 reported cstate change: term changed from 2 to 3, leader changed from ade6fdeec548419dafe0d8c727ea9db7 (127.28.54.65) to 1b1cd51a6e4f49c88eb2d118d294d565 (127.28.54.66). New cstate: current_term: 3 leader_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:26.744174 29170 raft_consensus.cc:1275] T 22db5056ecf74660ba332b5eef197747 P b675cc11b2dc4c9580b7b61dee8e4333 [term 2 FOLLOWER]: Refusing update from remote peer 1b1cd51a6e4f49c88eb2d118d294d565: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:26.745270 29307 consensus_queue.cc:1048] T 22db5056ecf74660ba332b5eef197747 P 1b1cd51a6e4f49c88eb2d118d294d565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:26.754050 29023 raft_consensus.cc:1275] T 22db5056ecf74660ba332b5eef197747 P ade6fdeec548419dafe0d8c727ea9db7 [term 2 FOLLOWER]: Refusing update from remote peer 1b1cd51a6e4f49c88eb2d118d294d565: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:26.755580 29324 consensus_queue.cc:1048] T 22db5056ecf74660ba332b5eef197747 P 1b1cd51a6e4f49c88eb2d118d294d565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:26.936866 29170 raft_consensus.cc:1275] T ccbfc50ea0d341fd975dd116645a8437 P b675cc11b2dc4c9580b7b61dee8e4333 [term 3 FOLLOWER]: Refusing update from remote peer 1b1cd51a6e4f49c88eb2d118d294d565: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:26.937979 29324 consensus_queue.cc:1048] T ccbfc50ea0d341fd975dd116645a8437 P 1b1cd51a6e4f49c88eb2d118d294d565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:26.945964 29023 raft_consensus.cc:1275] T ccbfc50ea0d341fd975dd116645a8437 P ade6fdeec548419dafe0d8c727ea9db7 [term 3 FOLLOWER]: Refusing update from remote peer 1b1cd51a6e4f49c88eb2d118d294d565: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:26.947495 29307 consensus_queue.cc:1048] T ccbfc50ea0d341fd975dd116645a8437 P 1b1cd51a6e4f49c88eb2d118d294d565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:26.959795 29170 raft_consensus.cc:1275] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333 [term 4 FOLLOWER]: Refusing update from remote peer 1b1cd51a6e4f49c88eb2d118d294d565: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:26.960887 29307 consensus_queue.cc:1048] T eadbdd1c8352482bbaeb320f048b6a27 P 1b1cd51a6e4f49c88eb2d118d294d565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:26.970083 29023 raft_consensus.cc:1275] T eadbdd1c8352482bbaeb320f048b6a27 P ade6fdeec548419dafe0d8c727ea9db7 [term 4 FOLLOWER]: Refusing update from remote peer 1b1cd51a6e4f49c88eb2d118d294d565: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:26.971364 29307 consensus_queue.cc:1048] T eadbdd1c8352482bbaeb320f048b6a27 P 1b1cd51a6e4f49c88eb2d118d294d565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:27.019083 29023 raft_consensus.cc:1275] T f593a7e12d394520ac84b9cb01f8a445 P ade6fdeec548419dafe0d8c727ea9db7 [term 4 FOLLOWER]: Refusing update from remote peer 1b1cd51a6e4f49c88eb2d118d294d565: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:27.020207 29307 consensus_queue.cc:1048] T f593a7e12d394520ac84b9cb01f8a445 P 1b1cd51a6e4f49c88eb2d118d294d565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:27.027801 29170 raft_consensus.cc:1275] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 [term 4 FOLLOWER]: Refusing update from remote peer 1b1cd51a6e4f49c88eb2d118d294d565: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:27.030172 29324 consensus_queue.cc:1048] T f593a7e12d394520ac84b9cb01f8a445 P 1b1cd51a6e4f49c88eb2d118d294d565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:27.066203 29023 raft_consensus.cc:1275] T ca468a14f9ad47fc83c2fd8cca868e02 P ade6fdeec548419dafe0d8c727ea9db7 [term 3 FOLLOWER]: Refusing update from remote peer 1b1cd51a6e4f49c88eb2d118d294d565: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:27.067458 29307 consensus_queue.cc:1048] T ca468a14f9ad47fc83c2fd8cca868e02 P 1b1cd51a6e4f49c88eb2d118d294d565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:27.075248 29170 raft_consensus.cc:1275] T ca468a14f9ad47fc83c2fd8cca868e02 P b675cc11b2dc4c9580b7b61dee8e4333 [term 3 FOLLOWER]: Refusing update from remote peer 1b1cd51a6e4f49c88eb2d118d294d565: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:27.076728 29307 consensus_queue.cc:1048] T ca468a14f9ad47fc83c2fd8cca868e02 P 1b1cd51a6e4f49c88eb2d118d294d565 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:29.286998 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:29.294494 29098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "22db5056ecf74660ba332b5eef197747"
dest_uuid: "1b1cd51a6e4f49c88eb2d118d294d565"
mode: GRACEFUL
new_leader_uuid: "b675cc11b2dc4c9580b7b61dee8e4333"
 from {username='slave'} at 127.0.0.1:53918
I20260709 13:09:29.295153 29098 raft_consensus.cc:606] T 22db5056ecf74660ba332b5eef197747 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 2 LEADER]: Received request to transfer leadership to TS b675cc11b2dc4c9580b7b61dee8e4333
I20260709 13:09:29.297438 29098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "51c6d4bc6ab749eebcd70e632a6c8c08"
dest_uuid: "1b1cd51a6e4f49c88eb2d118d294d565"
mode: GRACEFUL
new_leader_uuid: "ade6fdeec548419dafe0d8c727ea9db7"
 from {username='slave'} at 127.0.0.1:53918
I20260709 13:09:29.297855 29098 raft_consensus.cc:606] T 51c6d4bc6ab749eebcd70e632a6c8c08 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 2 LEADER]: Received request to transfer leadership to TS ade6fdeec548419dafe0d8c727ea9db7
I20260709 13:09:29.299845 29098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64cf35d356a841d6875cbb4106b48f49"
dest_uuid: "1b1cd51a6e4f49c88eb2d118d294d565"
mode: GRACEFUL
new_leader_uuid: "ade6fdeec548419dafe0d8c727ea9db7"
 from {username='slave'} at 127.0.0.1:53918
I20260709 13:09:29.300223 29098 raft_consensus.cc:606] T 64cf35d356a841d6875cbb4106b48f49 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 2 LEADER]: Received request to transfer leadership to TS ade6fdeec548419dafe0d8c727ea9db7
I20260709 13:09:29.302188 29098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ef2753d7f6f46e68a0ec3be338f525b"
dest_uuid: "1b1cd51a6e4f49c88eb2d118d294d565"
mode: GRACEFUL
new_leader_uuid: "b675cc11b2dc4c9580b7b61dee8e4333"
 from {username='slave'} at 127.0.0.1:53918
I20260709 13:09:29.302587 29098 raft_consensus.cc:606] T 8ef2753d7f6f46e68a0ec3be338f525b P 1b1cd51a6e4f49c88eb2d118d294d565 [term 2 LEADER]: Received request to transfer leadership to TS b675cc11b2dc4c9580b7b61dee8e4333
I20260709 13:09:29.304515 29098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f593a7e12d394520ac84b9cb01f8a445"
dest_uuid: "1b1cd51a6e4f49c88eb2d118d294d565"
mode: GRACEFUL
new_leader_uuid: "ade6fdeec548419dafe0d8c727ea9db7"
 from {username='slave'} at 127.0.0.1:53918
I20260709 13:09:29.304978 29098 raft_consensus.cc:606] T f593a7e12d394520ac84b9cb01f8a445 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 4 LEADER]: Received request to transfer leadership to TS ade6fdeec548419dafe0d8c727ea9db7
I20260709 13:09:29.305806 28889 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:09:29.306219 28889 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:29.449102 29348 raft_consensus.cc:993] T 8ef2753d7f6f46e68a0ec3be338f525b P 1b1cd51a6e4f49c88eb2d118d294d565: : Instructing follower b675cc11b2dc4c9580b7b61dee8e4333 to start an election
I20260709 13:09:29.449726 29350 raft_consensus.cc:1081] T 8ef2753d7f6f46e68a0ec3be338f525b P 1b1cd51a6e4f49c88eb2d118d294d565 [term 2 LEADER]: Signalling peer b675cc11b2dc4c9580b7b61dee8e4333 to start an election
I20260709 13:09:29.451292 29171 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ef2753d7f6f46e68a0ec3be338f525b"
dest_uuid: "b675cc11b2dc4c9580b7b61dee8e4333"
 from {username='slave'} at 127.0.0.1:36870
I20260709 13:09:29.451731 29171 raft_consensus.cc:493] T 8ef2753d7f6f46e68a0ec3be338f525b P b675cc11b2dc4c9580b7b61dee8e4333 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:29.452010 29171 raft_consensus.cc:3060] T 8ef2753d7f6f46e68a0ec3be338f525b P b675cc11b2dc4c9580b7b61dee8e4333 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:29.457290 29171 raft_consensus.cc:515] T 8ef2753d7f6f46e68a0ec3be338f525b P b675cc11b2dc4c9580b7b61dee8e4333 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:29.458967 29171 leader_election.cc:290] T 8ef2753d7f6f46e68a0ec3be338f525b P b675cc11b2dc4c9580b7b61dee8e4333 [CANDIDATE]: Term 3 election: Requested vote from peers ade6fdeec548419dafe0d8c727ea9db7 (127.28.54.65:37211), 1b1cd51a6e4f49c88eb2d118d294d565 (127.28.54.66:34329)
I20260709 13:09:29.459913 29023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ef2753d7f6f46e68a0ec3be338f525b" candidate_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ade6fdeec548419dafe0d8c727ea9db7"
I20260709 13:09:29.460007 29098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ef2753d7f6f46e68a0ec3be338f525b" candidate_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1b1cd51a6e4f49c88eb2d118d294d565"
I20260709 13:09:29.460636 29023 raft_consensus.cc:3060] T 8ef2753d7f6f46e68a0ec3be338f525b P ade6fdeec548419dafe0d8c727ea9db7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:29.460721 29098 raft_consensus.cc:3055] T 8ef2753d7f6f46e68a0ec3be338f525b P 1b1cd51a6e4f49c88eb2d118d294d565 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:29.461009 29098 raft_consensus.cc:740] T 8ef2753d7f6f46e68a0ec3be338f525b P 1b1cd51a6e4f49c88eb2d118d294d565 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1b1cd51a6e4f49c88eb2d118d294d565, State: Running, Role: LEADER
I20260709 13:09:29.461637 29098 consensus_queue.cc:260] T 8ef2753d7f6f46e68a0ec3be338f525b P 1b1cd51a6e4f49c88eb2d118d294d565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:29.462549 29098 raft_consensus.cc:3060] T 8ef2753d7f6f46e68a0ec3be338f525b P 1b1cd51a6e4f49c88eb2d118d294d565 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:29.465073 29023 raft_consensus.cc:2468] T 8ef2753d7f6f46e68a0ec3be338f525b P ade6fdeec548419dafe0d8c727ea9db7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b675cc11b2dc4c9580b7b61dee8e4333 in term 3.
I20260709 13:09:29.466205 29137 leader_election.cc:304] T 8ef2753d7f6f46e68a0ec3be338f525b P b675cc11b2dc4c9580b7b61dee8e4333 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ade6fdeec548419dafe0d8c727ea9db7, b675cc11b2dc4c9580b7b61dee8e4333; no voters: 
I20260709 13:09:29.467132 29330 raft_consensus.cc:2804] T 8ef2753d7f6f46e68a0ec3be338f525b P b675cc11b2dc4c9580b7b61dee8e4333 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:29.467176 29098 raft_consensus.cc:2468] T 8ef2753d7f6f46e68a0ec3be338f525b P 1b1cd51a6e4f49c88eb2d118d294d565 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b675cc11b2dc4c9580b7b61dee8e4333 in term 3.
I20260709 13:09:29.468254 29330 raft_consensus.cc:697] T 8ef2753d7f6f46e68a0ec3be338f525b P b675cc11b2dc4c9580b7b61dee8e4333 [term 3 LEADER]: Becoming Leader. State: Replica: b675cc11b2dc4c9580b7b61dee8e4333, State: Running, Role: LEADER
I20260709 13:09:29.469138 29330 consensus_queue.cc:237] T 8ef2753d7f6f46e68a0ec3be338f525b P b675cc11b2dc4c9580b7b61dee8e4333 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:29.475757 28921 catalog_manager.cc:5697] T 8ef2753d7f6f46e68a0ec3be338f525b P b675cc11b2dc4c9580b7b61dee8e4333 reported cstate change: term changed from 2 to 3, leader changed from 1b1cd51a6e4f49c88eb2d118d294d565 (127.28.54.66) to b675cc11b2dc4c9580b7b61dee8e4333 (127.28.54.67). New cstate: current_term: 3 leader_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:29.504688 29348 raft_consensus.cc:993] T 51c6d4bc6ab749eebcd70e632a6c8c08 P 1b1cd51a6e4f49c88eb2d118d294d565: : Instructing follower ade6fdeec548419dafe0d8c727ea9db7 to start an election
I20260709 13:09:29.505134 29350 raft_consensus.cc:1081] T 51c6d4bc6ab749eebcd70e632a6c8c08 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 2 LEADER]: Signalling peer ade6fdeec548419dafe0d8c727ea9db7 to start an election
I20260709 13:09:29.506485 29023 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "51c6d4bc6ab749eebcd70e632a6c8c08"
dest_uuid: "ade6fdeec548419dafe0d8c727ea9db7"
 from {username='slave'} at 127.0.0.1:42444
I20260709 13:09:29.506886 29023 raft_consensus.cc:493] T 51c6d4bc6ab749eebcd70e632a6c8c08 P ade6fdeec548419dafe0d8c727ea9db7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:29.507125 29023 raft_consensus.cc:3060] T 51c6d4bc6ab749eebcd70e632a6c8c08 P ade6fdeec548419dafe0d8c727ea9db7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:29.510946 29023 raft_consensus.cc:515] T 51c6d4bc6ab749eebcd70e632a6c8c08 P ade6fdeec548419dafe0d8c727ea9db7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:29.512358 29023 leader_election.cc:290] T 51c6d4bc6ab749eebcd70e632a6c8c08 P ade6fdeec548419dafe0d8c727ea9db7 [CANDIDATE]: Term 3 election: Requested vote from peers 1b1cd51a6e4f49c88eb2d118d294d565 (127.28.54.66:34329), b675cc11b2dc4c9580b7b61dee8e4333 (127.28.54.67:41555)
I20260709 13:09:29.513346 29098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c6d4bc6ab749eebcd70e632a6c8c08" candidate_uuid: "ade6fdeec548419dafe0d8c727ea9db7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1b1cd51a6e4f49c88eb2d118d294d565"
I20260709 13:09:29.513451 29171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "51c6d4bc6ab749eebcd70e632a6c8c08" candidate_uuid: "ade6fdeec548419dafe0d8c727ea9db7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b675cc11b2dc4c9580b7b61dee8e4333"
I20260709 13:09:29.513829 29098 raft_consensus.cc:3055] T 51c6d4bc6ab749eebcd70e632a6c8c08 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:29.514047 29171 raft_consensus.cc:3060] T 51c6d4bc6ab749eebcd70e632a6c8c08 P b675cc11b2dc4c9580b7b61dee8e4333 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:29.514119 29098 raft_consensus.cc:740] T 51c6d4bc6ab749eebcd70e632a6c8c08 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1b1cd51a6e4f49c88eb2d118d294d565, State: Running, Role: LEADER
I20260709 13:09:29.514808 29098 consensus_queue.cc:260] T 51c6d4bc6ab749eebcd70e632a6c8c08 P 1b1cd51a6e4f49c88eb2d118d294d565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:29.515578 29098 raft_consensus.cc:3060] T 51c6d4bc6ab749eebcd70e632a6c8c08 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:29.518657 29171 raft_consensus.cc:2468] T 51c6d4bc6ab749eebcd70e632a6c8c08 P b675cc11b2dc4c9580b7b61dee8e4333 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade6fdeec548419dafe0d8c727ea9db7 in term 3.
I20260709 13:09:29.519268 29098 raft_consensus.cc:2468] T 51c6d4bc6ab749eebcd70e632a6c8c08 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade6fdeec548419dafe0d8c727ea9db7 in term 3.
I20260709 13:09:29.519848 28989 leader_election.cc:304] T 51c6d4bc6ab749eebcd70e632a6c8c08 P ade6fdeec548419dafe0d8c727ea9db7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ade6fdeec548419dafe0d8c727ea9db7, b675cc11b2dc4c9580b7b61dee8e4333; no voters: 
I20260709 13:09:29.521565 29357 raft_consensus.cc:2804] T 51c6d4bc6ab749eebcd70e632a6c8c08 P ade6fdeec548419dafe0d8c727ea9db7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:29.522526 29357 raft_consensus.cc:697] T 51c6d4bc6ab749eebcd70e632a6c8c08 P ade6fdeec548419dafe0d8c727ea9db7 [term 3 LEADER]: Becoming Leader. State: Replica: ade6fdeec548419dafe0d8c727ea9db7, State: Running, Role: LEADER
I20260709 13:09:29.523176 29357 consensus_queue.cc:237] T 51c6d4bc6ab749eebcd70e632a6c8c08 P ade6fdeec548419dafe0d8c727ea9db7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:29.530032 28921 catalog_manager.cc:5697] T 51c6d4bc6ab749eebcd70e632a6c8c08 P ade6fdeec548419dafe0d8c727ea9db7 reported cstate change: term changed from 2 to 3, leader changed from 1b1cd51a6e4f49c88eb2d118d294d565 (127.28.54.66) to ade6fdeec548419dafe0d8c727ea9db7 (127.28.54.65). New cstate: current_term: 3 leader_uuid: "ade6fdeec548419dafe0d8c727ea9db7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:29.606137 29348 raft_consensus.cc:993] T 64cf35d356a841d6875cbb4106b48f49 P 1b1cd51a6e4f49c88eb2d118d294d565: : Instructing follower ade6fdeec548419dafe0d8c727ea9db7 to start an election
I20260709 13:09:29.606504 29350 raft_consensus.cc:1081] T 64cf35d356a841d6875cbb4106b48f49 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 2 LEADER]: Signalling peer ade6fdeec548419dafe0d8c727ea9db7 to start an election
I20260709 13:09:29.607764 29023 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "64cf35d356a841d6875cbb4106b48f49"
dest_uuid: "ade6fdeec548419dafe0d8c727ea9db7"
 from {username='slave'} at 127.0.0.1:42444
I20260709 13:09:29.608177 29023 raft_consensus.cc:493] T 64cf35d356a841d6875cbb4106b48f49 P ade6fdeec548419dafe0d8c727ea9db7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:29.608430 29023 raft_consensus.cc:3060] T 64cf35d356a841d6875cbb4106b48f49 P ade6fdeec548419dafe0d8c727ea9db7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:29.612195 29023 raft_consensus.cc:515] T 64cf35d356a841d6875cbb4106b48f49 P ade6fdeec548419dafe0d8c727ea9db7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:29.614053 29023 leader_election.cc:290] T 64cf35d356a841d6875cbb4106b48f49 P ade6fdeec548419dafe0d8c727ea9db7 [CANDIDATE]: Term 3 election: Requested vote from peers 1b1cd51a6e4f49c88eb2d118d294d565 (127.28.54.66:34329), b675cc11b2dc4c9580b7b61dee8e4333 (127.28.54.67:41555)
I20260709 13:09:29.614539 29098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64cf35d356a841d6875cbb4106b48f49" candidate_uuid: "ade6fdeec548419dafe0d8c727ea9db7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1b1cd51a6e4f49c88eb2d118d294d565"
I20260709 13:09:29.614869 29171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64cf35d356a841d6875cbb4106b48f49" candidate_uuid: "ade6fdeec548419dafe0d8c727ea9db7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b675cc11b2dc4c9580b7b61dee8e4333"
I20260709 13:09:29.615072 29098 raft_consensus.cc:3055] T 64cf35d356a841d6875cbb4106b48f49 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:29.615288 29098 raft_consensus.cc:740] T 64cf35d356a841d6875cbb4106b48f49 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1b1cd51a6e4f49c88eb2d118d294d565, State: Running, Role: LEADER
I20260709 13:09:29.615319 29171 raft_consensus.cc:3060] T 64cf35d356a841d6875cbb4106b48f49 P b675cc11b2dc4c9580b7b61dee8e4333 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:29.615897 29098 consensus_queue.cc:260] T 64cf35d356a841d6875cbb4106b48f49 P 1b1cd51a6e4f49c88eb2d118d294d565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:29.616639 29098 raft_consensus.cc:3060] T 64cf35d356a841d6875cbb4106b48f49 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:29.620253 29171 raft_consensus.cc:2468] T 64cf35d356a841d6875cbb4106b48f49 P b675cc11b2dc4c9580b7b61dee8e4333 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade6fdeec548419dafe0d8c727ea9db7 in term 3.
I20260709 13:09:29.621250 28989 leader_election.cc:304] T 64cf35d356a841d6875cbb4106b48f49 P ade6fdeec548419dafe0d8c727ea9db7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ade6fdeec548419dafe0d8c727ea9db7, b675cc11b2dc4c9580b7b61dee8e4333; no voters: 
I20260709 13:09:29.621354 29098 raft_consensus.cc:2468] T 64cf35d356a841d6875cbb4106b48f49 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade6fdeec548419dafe0d8c727ea9db7 in term 3.
I20260709 13:09:29.621882 29357 raft_consensus.cc:2804] T 64cf35d356a841d6875cbb4106b48f49 P ade6fdeec548419dafe0d8c727ea9db7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:29.622344 29357 raft_consensus.cc:697] T 64cf35d356a841d6875cbb4106b48f49 P ade6fdeec548419dafe0d8c727ea9db7 [term 3 LEADER]: Becoming Leader. State: Replica: ade6fdeec548419dafe0d8c727ea9db7, State: Running, Role: LEADER
I20260709 13:09:29.623008 29357 consensus_queue.cc:237] T 64cf35d356a841d6875cbb4106b48f49 P ade6fdeec548419dafe0d8c727ea9db7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:29.629172 28921 catalog_manager.cc:5697] T 64cf35d356a841d6875cbb4106b48f49 P ade6fdeec548419dafe0d8c727ea9db7 reported cstate change: term changed from 2 to 3, leader changed from 1b1cd51a6e4f49c88eb2d118d294d565 (127.28.54.66) to ade6fdeec548419dafe0d8c727ea9db7 (127.28.54.65). New cstate: current_term: 3 leader_uuid: "ade6fdeec548419dafe0d8c727ea9db7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:29.641512 29348 raft_consensus.cc:993] T f593a7e12d394520ac84b9cb01f8a445 P 1b1cd51a6e4f49c88eb2d118d294d565: : Instructing follower ade6fdeec548419dafe0d8c727ea9db7 to start an election
I20260709 13:09:29.641968 29350 raft_consensus.cc:1081] T f593a7e12d394520ac84b9cb01f8a445 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 4 LEADER]: Signalling peer ade6fdeec548419dafe0d8c727ea9db7 to start an election
I20260709 13:09:29.643266 29023 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f593a7e12d394520ac84b9cb01f8a445"
dest_uuid: "ade6fdeec548419dafe0d8c727ea9db7"
 from {username='slave'} at 127.0.0.1:42444
I20260709 13:09:29.643671 29023 raft_consensus.cc:493] T f593a7e12d394520ac84b9cb01f8a445 P ade6fdeec548419dafe0d8c727ea9db7 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:29.643914 29023 raft_consensus.cc:3060] T f593a7e12d394520ac84b9cb01f8a445 P ade6fdeec548419dafe0d8c727ea9db7 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:29.648224 29023 raft_consensus.cc:515] T f593a7e12d394520ac84b9cb01f8a445 P ade6fdeec548419dafe0d8c727ea9db7 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:29.649704 29023 leader_election.cc:290] T f593a7e12d394520ac84b9cb01f8a445 P ade6fdeec548419dafe0d8c727ea9db7 [CANDIDATE]: Term 5 election: Requested vote from peers 1b1cd51a6e4f49c88eb2d118d294d565 (127.28.54.66:34329), b675cc11b2dc4c9580b7b61dee8e4333 (127.28.54.67:41555)
I20260709 13:09:29.650468 29098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f593a7e12d394520ac84b9cb01f8a445" candidate_uuid: "ade6fdeec548419dafe0d8c727ea9db7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "1b1cd51a6e4f49c88eb2d118d294d565"
I20260709 13:09:29.650792 29171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f593a7e12d394520ac84b9cb01f8a445" candidate_uuid: "ade6fdeec548419dafe0d8c727ea9db7" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "b675cc11b2dc4c9580b7b61dee8e4333"
I20260709 13:09:29.651300 29098 raft_consensus.cc:3055] T f593a7e12d394520ac84b9cb01f8a445 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:29.651489 29171 raft_consensus.cc:3060] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:29.651705 29098 raft_consensus.cc:740] T f593a7e12d394520ac84b9cb01f8a445 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 1b1cd51a6e4f49c88eb2d118d294d565, State: Running, Role: LEADER
I20260709 13:09:29.652501 29098 consensus_queue.cc:260] T f593a7e12d394520ac84b9cb01f8a445 P 1b1cd51a6e4f49c88eb2d118d294d565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:29.653569 29098 raft_consensus.cc:3060] T f593a7e12d394520ac84b9cb01f8a445 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:29.656813 29171 raft_consensus.cc:2468] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade6fdeec548419dafe0d8c727ea9db7 in term 5.
I20260709 13:09:29.657648 29098 raft_consensus.cc:2468] T f593a7e12d394520ac84b9cb01f8a445 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ade6fdeec548419dafe0d8c727ea9db7 in term 5.
I20260709 13:09:29.657629 28989 leader_election.cc:304] T f593a7e12d394520ac84b9cb01f8a445 P ade6fdeec548419dafe0d8c727ea9db7 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ade6fdeec548419dafe0d8c727ea9db7, b675cc11b2dc4c9580b7b61dee8e4333; no voters: 
I20260709 13:09:29.658437 29357 raft_consensus.cc:2804] T f593a7e12d394520ac84b9cb01f8a445 P ade6fdeec548419dafe0d8c727ea9db7 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:29.658782 29357 raft_consensus.cc:697] T f593a7e12d394520ac84b9cb01f8a445 P ade6fdeec548419dafe0d8c727ea9db7 [term 5 LEADER]: Becoming Leader. State: Replica: ade6fdeec548419dafe0d8c727ea9db7, State: Running, Role: LEADER
I20260709 13:09:29.659392 29357 consensus_queue.cc:237] T f593a7e12d394520ac84b9cb01f8a445 P ade6fdeec548419dafe0d8c727ea9db7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } }
I20260709 13:09:29.665783 28921 catalog_manager.cc:5697] T f593a7e12d394520ac84b9cb01f8a445 P ade6fdeec548419dafe0d8c727ea9db7 reported cstate change: term changed from 4 to 5, leader changed from 1b1cd51a6e4f49c88eb2d118d294d565 (127.28.54.66) to ade6fdeec548419dafe0d8c727ea9db7 (127.28.54.65). New cstate: current_term: 5 leader_uuid: "ade6fdeec548419dafe0d8c727ea9db7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:29.668745 29348 raft_consensus.cc:993] T 22db5056ecf74660ba332b5eef197747 P 1b1cd51a6e4f49c88eb2d118d294d565: : Instructing follower b675cc11b2dc4c9580b7b61dee8e4333 to start an election
I20260709 13:09:29.669147 29350 raft_consensus.cc:1081] T 22db5056ecf74660ba332b5eef197747 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 2 LEADER]: Signalling peer b675cc11b2dc4c9580b7b61dee8e4333 to start an election
I20260709 13:09:29.670691 29171 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "22db5056ecf74660ba332b5eef197747"
dest_uuid: "b675cc11b2dc4c9580b7b61dee8e4333"
 from {username='slave'} at 127.0.0.1:36870
I20260709 13:09:29.671085 29171 raft_consensus.cc:493] T 22db5056ecf74660ba332b5eef197747 P b675cc11b2dc4c9580b7b61dee8e4333 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:29.671370 29171 raft_consensus.cc:3060] T 22db5056ecf74660ba332b5eef197747 P b675cc11b2dc4c9580b7b61dee8e4333 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:29.675832 29171 raft_consensus.cc:515] T 22db5056ecf74660ba332b5eef197747 P b675cc11b2dc4c9580b7b61dee8e4333 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } }
I20260709 13:09:29.677058 29171 leader_election.cc:290] T 22db5056ecf74660ba332b5eef197747 P b675cc11b2dc4c9580b7b61dee8e4333 [CANDIDATE]: Term 3 election: Requested vote from peers ade6fdeec548419dafe0d8c727ea9db7 (127.28.54.65:37211), 1b1cd51a6e4f49c88eb2d118d294d565 (127.28.54.66:34329)
I20260709 13:09:29.677908 29023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22db5056ecf74660ba332b5eef197747" candidate_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ade6fdeec548419dafe0d8c727ea9db7"
I20260709 13:09:29.678025 29098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22db5056ecf74660ba332b5eef197747" candidate_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1b1cd51a6e4f49c88eb2d118d294d565"
I20260709 13:09:29.678395 29023 raft_consensus.cc:3060] T 22db5056ecf74660ba332b5eef197747 P ade6fdeec548419dafe0d8c727ea9db7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:29.678450 29098 raft_consensus.cc:3055] T 22db5056ecf74660ba332b5eef197747 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:29.678745 29098 raft_consensus.cc:740] T 22db5056ecf74660ba332b5eef197747 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1b1cd51a6e4f49c88eb2d118d294d565, State: Running, Role: LEADER
I20260709 13:09:29.679255 29098 consensus_queue.cc:260] T 22db5056ecf74660ba332b5eef197747 P 1b1cd51a6e4f49c88eb2d118d294d565 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } }
I20260709 13:09:29.680017 29098 raft_consensus.cc:3060] T 22db5056ecf74660ba332b5eef197747 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:29.682230 29023 raft_consensus.cc:2468] T 22db5056ecf74660ba332b5eef197747 P ade6fdeec548419dafe0d8c727ea9db7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b675cc11b2dc4c9580b7b61dee8e4333 in term 3.
I20260709 13:09:29.683075 29137 leader_election.cc:304] T 22db5056ecf74660ba332b5eef197747 P b675cc11b2dc4c9580b7b61dee8e4333 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: ade6fdeec548419dafe0d8c727ea9db7, b675cc11b2dc4c9580b7b61dee8e4333; no voters: 
I20260709 13:09:29.683830 29330 raft_consensus.cc:2804] T 22db5056ecf74660ba332b5eef197747 P b675cc11b2dc4c9580b7b61dee8e4333 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:29.684072 29098 raft_consensus.cc:2468] T 22db5056ecf74660ba332b5eef197747 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b675cc11b2dc4c9580b7b61dee8e4333 in term 3.
I20260709 13:09:29.684172 29330 raft_consensus.cc:697] T 22db5056ecf74660ba332b5eef197747 P b675cc11b2dc4c9580b7b61dee8e4333 [term 3 LEADER]: Becoming Leader. State: Replica: b675cc11b2dc4c9580b7b61dee8e4333, State: Running, Role: LEADER
I20260709 13:09:29.684970 29330 consensus_queue.cc:237] T 22db5056ecf74660ba332b5eef197747 P b675cc11b2dc4c9580b7b61dee8e4333 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } }
I20260709 13:09:29.690969 28921 catalog_manager.cc:5697] T 22db5056ecf74660ba332b5eef197747 P b675cc11b2dc4c9580b7b61dee8e4333 reported cstate change: term changed from 2 to 3, leader changed from 1b1cd51a6e4f49c88eb2d118d294d565 (127.28.54.66) to b675cc11b2dc4c9580b7b61dee8e4333 (127.28.54.67). New cstate: current_term: 3 leader_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:29.951594 29098 raft_consensus.cc:1275] T 8ef2753d7f6f46e68a0ec3be338f525b P 1b1cd51a6e4f49c88eb2d118d294d565 [term 3 FOLLOWER]: Refusing update from remote peer b675cc11b2dc4c9580b7b61dee8e4333: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:29.952782 29351 consensus_queue.cc:1048] T 8ef2753d7f6f46e68a0ec3be338f525b P b675cc11b2dc4c9580b7b61dee8e4333 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:29.966822 29023 raft_consensus.cc:1275] T 8ef2753d7f6f46e68a0ec3be338f525b P ade6fdeec548419dafe0d8c727ea9db7 [term 3 FOLLOWER]: Refusing update from remote peer b675cc11b2dc4c9580b7b61dee8e4333: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:29.968428 29365 consensus_queue.cc:1048] T 8ef2753d7f6f46e68a0ec3be338f525b P b675cc11b2dc4c9580b7b61dee8e4333 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:30.012023 29099 raft_consensus.cc:1275] T 51c6d4bc6ab749eebcd70e632a6c8c08 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 3 FOLLOWER]: Refusing update from remote peer ade6fdeec548419dafe0d8c727ea9db7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:30.013227 29357 consensus_queue.cc:1048] T 51c6d4bc6ab749eebcd70e632a6c8c08 P ade6fdeec548419dafe0d8c727ea9db7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:30.022751 29171 raft_consensus.cc:1275] T 51c6d4bc6ab749eebcd70e632a6c8c08 P b675cc11b2dc4c9580b7b61dee8e4333 [term 3 FOLLOWER]: Refusing update from remote peer ade6fdeec548419dafe0d8c727ea9db7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:30.024741 29357 consensus_queue.cc:1048] T 51c6d4bc6ab749eebcd70e632a6c8c08 P ade6fdeec548419dafe0d8c727ea9db7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:30.056866 29171 raft_consensus.cc:1275] T 64cf35d356a841d6875cbb4106b48f49 P b675cc11b2dc4c9580b7b61dee8e4333 [term 3 FOLLOWER]: Refusing update from remote peer ade6fdeec548419dafe0d8c727ea9db7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:30.057945 29357 consensus_queue.cc:1048] T 64cf35d356a841d6875cbb4106b48f49 P ade6fdeec548419dafe0d8c727ea9db7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:30.066761 29099 raft_consensus.cc:1275] T 64cf35d356a841d6875cbb4106b48f49 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 3 FOLLOWER]: Refusing update from remote peer ade6fdeec548419dafe0d8c727ea9db7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:30.068922 29358 consensus_queue.cc:1048] T 64cf35d356a841d6875cbb4106b48f49 P ade6fdeec548419dafe0d8c727ea9db7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:30.119943 29024 raft_consensus.cc:1275] T 22db5056ecf74660ba332b5eef197747 P ade6fdeec548419dafe0d8c727ea9db7 [term 3 FOLLOWER]: Refusing update from remote peer b675cc11b2dc4c9580b7b61dee8e4333: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:30.121060 29365 consensus_queue.cc:1048] T 22db5056ecf74660ba332b5eef197747 P b675cc11b2dc4c9580b7b61dee8e4333 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ade6fdeec548419dafe0d8c727ea9db7" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 37211 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:30.129415 29099 raft_consensus.cc:1275] T 22db5056ecf74660ba332b5eef197747 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 3 FOLLOWER]: Refusing update from remote peer b675cc11b2dc4c9580b7b61dee8e4333: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:30.131490 29330 consensus_queue.cc:1048] T 22db5056ecf74660ba332b5eef197747 P b675cc11b2dc4c9580b7b61dee8e4333 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:30.209640 29099 raft_consensus.cc:1275] T f593a7e12d394520ac84b9cb01f8a445 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 5 FOLLOWER]: Refusing update from remote peer ade6fdeec548419dafe0d8c727ea9db7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:09:30.210809 29358 consensus_queue.cc:1048] T f593a7e12d394520ac84b9cb01f8a445 P ade6fdeec548419dafe0d8c727ea9db7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1b1cd51a6e4f49c88eb2d118d294d565" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 34329 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:30.218307 29171 raft_consensus.cc:1275] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 [term 5 FOLLOWER]: Refusing update from remote peer ade6fdeec548419dafe0d8c727ea9db7: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:09:30.219847 29357 consensus_queue.cc:1048] T f593a7e12d394520ac84b9cb01f8a445 P ade6fdeec548419dafe0d8c727ea9db7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b675cc11b2dc4c9580b7b61dee8e4333" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 41555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:30.307044 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:30.312391 28889 tablet_server.cc:179] TabletServer@127.28.54.65:0 shutting down...
I20260709 13:09:30.334789 28889 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:30.335506 28889 tablet_replica.cc:333] T 51c6d4bc6ab749eebcd70e632a6c8c08 P ade6fdeec548419dafe0d8c727ea9db7: stopping tablet replica
I20260709 13:09:30.336150 28889 raft_consensus.cc:2243] T 51c6d4bc6ab749eebcd70e632a6c8c08 P ade6fdeec548419dafe0d8c727ea9db7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:30.336891 28889 raft_consensus.cc:2272] T 51c6d4bc6ab749eebcd70e632a6c8c08 P ade6fdeec548419dafe0d8c727ea9db7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.339709 28889 tablet_replica.cc:333] T 64cf35d356a841d6875cbb4106b48f49 P ade6fdeec548419dafe0d8c727ea9db7: stopping tablet replica
I20260709 13:09:30.340197 28889 raft_consensus.cc:2243] T 64cf35d356a841d6875cbb4106b48f49 P ade6fdeec548419dafe0d8c727ea9db7 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:30.340878 28889 raft_consensus.cc:2272] T 64cf35d356a841d6875cbb4106b48f49 P ade6fdeec548419dafe0d8c727ea9db7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.342824 28889 tablet_replica.cc:333] T eadbdd1c8352482bbaeb320f048b6a27 P ade6fdeec548419dafe0d8c727ea9db7: stopping tablet replica
I20260709 13:09:30.343389 28889 raft_consensus.cc:2243] T eadbdd1c8352482bbaeb320f048b6a27 P ade6fdeec548419dafe0d8c727ea9db7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:30.343792 28889 raft_consensus.cc:2272] T eadbdd1c8352482bbaeb320f048b6a27 P ade6fdeec548419dafe0d8c727ea9db7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.345310 28889 tablet_replica.cc:333] T 53af9481634c45f5a2cf52f3b93047d1 P ade6fdeec548419dafe0d8c727ea9db7: stopping tablet replica
I20260709 13:09:30.345829 28889 raft_consensus.cc:2243] T 53af9481634c45f5a2cf52f3b93047d1 P ade6fdeec548419dafe0d8c727ea9db7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:30.346195 28889 raft_consensus.cc:2272] T 53af9481634c45f5a2cf52f3b93047d1 P ade6fdeec548419dafe0d8c727ea9db7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.347796 28889 tablet_replica.cc:333] T f593a7e12d394520ac84b9cb01f8a445 P ade6fdeec548419dafe0d8c727ea9db7: stopping tablet replica
I20260709 13:09:30.348225 28889 raft_consensus.cc:2243] T f593a7e12d394520ac84b9cb01f8a445 P ade6fdeec548419dafe0d8c727ea9db7 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:09:30.348873 28889 raft_consensus.cc:2272] T f593a7e12d394520ac84b9cb01f8a445 P ade6fdeec548419dafe0d8c727ea9db7 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.350716 28889 tablet_replica.cc:333] T 22db5056ecf74660ba332b5eef197747 P ade6fdeec548419dafe0d8c727ea9db7: stopping tablet replica
I20260709 13:09:30.351191 28889 raft_consensus.cc:2243] T 22db5056ecf74660ba332b5eef197747 P ade6fdeec548419dafe0d8c727ea9db7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:30.351549 28889 raft_consensus.cc:2272] T 22db5056ecf74660ba332b5eef197747 P ade6fdeec548419dafe0d8c727ea9db7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.353381 28889 tablet_replica.cc:333] T 8ef2753d7f6f46e68a0ec3be338f525b P ade6fdeec548419dafe0d8c727ea9db7: stopping tablet replica
I20260709 13:09:30.353857 28889 raft_consensus.cc:2243] T 8ef2753d7f6f46e68a0ec3be338f525b P ade6fdeec548419dafe0d8c727ea9db7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:30.354219 28889 raft_consensus.cc:2272] T 8ef2753d7f6f46e68a0ec3be338f525b P ade6fdeec548419dafe0d8c727ea9db7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.355912 28889 tablet_replica.cc:333] T ca468a14f9ad47fc83c2fd8cca868e02 P ade6fdeec548419dafe0d8c727ea9db7: stopping tablet replica
I20260709 13:09:30.356335 28889 raft_consensus.cc:2243] T ca468a14f9ad47fc83c2fd8cca868e02 P ade6fdeec548419dafe0d8c727ea9db7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:30.356698 28889 raft_consensus.cc:2272] T ca468a14f9ad47fc83c2fd8cca868e02 P ade6fdeec548419dafe0d8c727ea9db7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.358203 28889 tablet_replica.cc:333] T ccbfc50ea0d341fd975dd116645a8437 P ade6fdeec548419dafe0d8c727ea9db7: stopping tablet replica
I20260709 13:09:30.358589 28889 raft_consensus.cc:2243] T ccbfc50ea0d341fd975dd116645a8437 P ade6fdeec548419dafe0d8c727ea9db7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:30.358933 28889 raft_consensus.cc:2272] T ccbfc50ea0d341fd975dd116645a8437 P ade6fdeec548419dafe0d8c727ea9db7 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:30.470467 29137 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.54.65:37211: connect: Connection refused (error 111)
W20260709 13:09:30.481892 29137 consensus_peers.cc:597] T 8ef2753d7f6f46e68a0ec3be338f525b P b675cc11b2dc4c9580b7b61dee8e4333 -> Peer ade6fdeec548419dafe0d8c727ea9db7 (127.28.54.65:37211): Couldn't send request to peer ade6fdeec548419dafe0d8c727ea9db7. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:37211: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:30.482064 28889 tablet_server.cc:196] TabletServer@127.28.54.65:0 shutdown complete.
W20260709 13:09:30.482316 29137 consensus_peers.cc:597] T 53af9481634c45f5a2cf52f3b93047d1 P b675cc11b2dc4c9580b7b61dee8e4333 -> Peer ade6fdeec548419dafe0d8c727ea9db7 (127.28.54.65:37211): Couldn't send request to peer ade6fdeec548419dafe0d8c727ea9db7. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:37211: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:30.498934 28889 tablet_server.cc:179] TabletServer@127.28.54.66:0 shutting down...
W20260709 13:09:30.507880 29139 consensus_peers.cc:597] T 53af9481634c45f5a2cf52f3b93047d1 P b675cc11b2dc4c9580b7b61dee8e4333 -> Peer 1b1cd51a6e4f49c88eb2d118d294d565 (127.28.54.66:34329): Couldn't send request to peer 1b1cd51a6e4f49c88eb2d118d294d565. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:30.521464 28889 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:30.522181 28889 tablet_replica.cc:333] T ccbfc50ea0d341fd975dd116645a8437 P 1b1cd51a6e4f49c88eb2d118d294d565: stopping tablet replica
I20260709 13:09:30.522725 28889 raft_consensus.cc:2243] T ccbfc50ea0d341fd975dd116645a8437 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:30.523444 28889 raft_consensus.cc:2272] T ccbfc50ea0d341fd975dd116645a8437 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.525074 28889 tablet_replica.cc:333] T 53af9481634c45f5a2cf52f3b93047d1 P 1b1cd51a6e4f49c88eb2d118d294d565: stopping tablet replica
I20260709 13:09:30.525564 28889 raft_consensus.cc:2243] T 53af9481634c45f5a2cf52f3b93047d1 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:30.525995 28889 raft_consensus.cc:2272] T 53af9481634c45f5a2cf52f3b93047d1 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.527472 28889 tablet_replica.cc:333] T f593a7e12d394520ac84b9cb01f8a445 P 1b1cd51a6e4f49c88eb2d118d294d565: stopping tablet replica
I20260709 13:09:30.527905 28889 raft_consensus.cc:2243] T f593a7e12d394520ac84b9cb01f8a445 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:30.528251 28889 raft_consensus.cc:2272] T f593a7e12d394520ac84b9cb01f8a445 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.530032 28889 tablet_replica.cc:333] T 51c6d4bc6ab749eebcd70e632a6c8c08 P 1b1cd51a6e4f49c88eb2d118d294d565: stopping tablet replica
I20260709 13:09:30.530476 28889 raft_consensus.cc:2243] T 51c6d4bc6ab749eebcd70e632a6c8c08 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:30.530835 28889 raft_consensus.cc:2272] T 51c6d4bc6ab749eebcd70e632a6c8c08 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.532559 28889 tablet_replica.cc:333] T 64cf35d356a841d6875cbb4106b48f49 P 1b1cd51a6e4f49c88eb2d118d294d565: stopping tablet replica
I20260709 13:09:30.532991 28889 raft_consensus.cc:2243] T 64cf35d356a841d6875cbb4106b48f49 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:30.533336 28889 raft_consensus.cc:2272] T 64cf35d356a841d6875cbb4106b48f49 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.535079 28889 tablet_replica.cc:333] T eadbdd1c8352482bbaeb320f048b6a27 P 1b1cd51a6e4f49c88eb2d118d294d565: stopping tablet replica
I20260709 13:09:30.535509 28889 raft_consensus.cc:2243] T eadbdd1c8352482bbaeb320f048b6a27 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:09:30.536314 28889 raft_consensus.cc:2272] T eadbdd1c8352482bbaeb320f048b6a27 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.537942 28889 tablet_replica.cc:333] T 22db5056ecf74660ba332b5eef197747 P 1b1cd51a6e4f49c88eb2d118d294d565: stopping tablet replica
I20260709 13:09:30.538326 28889 raft_consensus.cc:2243] T 22db5056ecf74660ba332b5eef197747 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:30.538637 28889 raft_consensus.cc:2272] T 22db5056ecf74660ba332b5eef197747 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.540362 28889 tablet_replica.cc:333] T 8ef2753d7f6f46e68a0ec3be338f525b P 1b1cd51a6e4f49c88eb2d118d294d565: stopping tablet replica
I20260709 13:09:30.540746 28889 raft_consensus.cc:2243] T 8ef2753d7f6f46e68a0ec3be338f525b P 1b1cd51a6e4f49c88eb2d118d294d565 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:30.541052 28889 raft_consensus.cc:2272] T 8ef2753d7f6f46e68a0ec3be338f525b P 1b1cd51a6e4f49c88eb2d118d294d565 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.542722 28889 tablet_replica.cc:333] T ca468a14f9ad47fc83c2fd8cca868e02 P 1b1cd51a6e4f49c88eb2d118d294d565: stopping tablet replica
I20260709 13:09:30.543083 28889 raft_consensus.cc:2243] T ca468a14f9ad47fc83c2fd8cca868e02 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:30.543691 28889 raft_consensus.cc:2272] T ca468a14f9ad47fc83c2fd8cca868e02 P 1b1cd51a6e4f49c88eb2d118d294d565 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:30.564401 29139 consensus_peers.cc:597] T 22db5056ecf74660ba332b5eef197747 P b675cc11b2dc4c9580b7b61dee8e4333 -> Peer 1b1cd51a6e4f49c88eb2d118d294d565 (127.28.54.66:34329): Couldn't send request to peer 1b1cd51a6e4f49c88eb2d118d294d565. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.66:34329: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:30.566655 29139 consensus_peers.cc:597] T 8ef2753d7f6f46e68a0ec3be338f525b P b675cc11b2dc4c9580b7b61dee8e4333 -> Peer 1b1cd51a6e4f49c88eb2d118d294d565 (127.28.54.66:34329): Couldn't send request to peer 1b1cd51a6e4f49c88eb2d118d294d565. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.66:34329: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:30.568953 28889 tablet_server.cc:196] TabletServer@127.28.54.66:0 shutdown complete.
I20260709 13:09:30.583613 28889 tablet_server.cc:179] TabletServer@127.28.54.67:0 shutting down...
I20260709 13:09:30.603081 28889 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:30.603756 28889 tablet_replica.cc:333] T 64cf35d356a841d6875cbb4106b48f49 P b675cc11b2dc4c9580b7b61dee8e4333: stopping tablet replica
I20260709 13:09:30.604488 28889 raft_consensus.cc:2243] T 64cf35d356a841d6875cbb4106b48f49 P b675cc11b2dc4c9580b7b61dee8e4333 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:30.605034 28889 raft_consensus.cc:2272] T 64cf35d356a841d6875cbb4106b48f49 P b675cc11b2dc4c9580b7b61dee8e4333 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.607091 28889 tablet_replica.cc:333] T 51c6d4bc6ab749eebcd70e632a6c8c08 P b675cc11b2dc4c9580b7b61dee8e4333: stopping tablet replica
I20260709 13:09:30.607532 28889 raft_consensus.cc:2243] T 51c6d4bc6ab749eebcd70e632a6c8c08 P b675cc11b2dc4c9580b7b61dee8e4333 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:30.607873 28889 raft_consensus.cc:2272] T 51c6d4bc6ab749eebcd70e632a6c8c08 P b675cc11b2dc4c9580b7b61dee8e4333 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.609537 28889 tablet_replica.cc:333] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333: stopping tablet replica
I20260709 13:09:30.610042 28889 raft_consensus.cc:2243] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:30.610389 28889 raft_consensus.cc:2272] T eadbdd1c8352482bbaeb320f048b6a27 P b675cc11b2dc4c9580b7b61dee8e4333 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.611802 28889 tablet_replica.cc:333] T 8ef2753d7f6f46e68a0ec3be338f525b P b675cc11b2dc4c9580b7b61dee8e4333: stopping tablet replica
I20260709 13:09:30.612198 28889 raft_consensus.cc:2243] T 8ef2753d7f6f46e68a0ec3be338f525b P b675cc11b2dc4c9580b7b61dee8e4333 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:30.612813 28889 raft_consensus.cc:2272] T 8ef2753d7f6f46e68a0ec3be338f525b P b675cc11b2dc4c9580b7b61dee8e4333 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.614560 28889 tablet_replica.cc:333] T 22db5056ecf74660ba332b5eef197747 P b675cc11b2dc4c9580b7b61dee8e4333: stopping tablet replica
I20260709 13:09:30.614961 28889 raft_consensus.cc:2243] T 22db5056ecf74660ba332b5eef197747 P b675cc11b2dc4c9580b7b61dee8e4333 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:30.615549 28889 raft_consensus.cc:2272] T 22db5056ecf74660ba332b5eef197747 P b675cc11b2dc4c9580b7b61dee8e4333 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.617206 28889 tablet_replica.cc:333] T ccbfc50ea0d341fd975dd116645a8437 P b675cc11b2dc4c9580b7b61dee8e4333: stopping tablet replica
I20260709 13:09:30.617589 28889 raft_consensus.cc:2243] T ccbfc50ea0d341fd975dd116645a8437 P b675cc11b2dc4c9580b7b61dee8e4333 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:30.617969 28889 raft_consensus.cc:2272] T ccbfc50ea0d341fd975dd116645a8437 P b675cc11b2dc4c9580b7b61dee8e4333 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.619396 28889 tablet_replica.cc:333] T 53af9481634c45f5a2cf52f3b93047d1 P b675cc11b2dc4c9580b7b61dee8e4333: stopping tablet replica
I20260709 13:09:30.619772 28889 raft_consensus.cc:2243] T 53af9481634c45f5a2cf52f3b93047d1 P b675cc11b2dc4c9580b7b61dee8e4333 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:30.620402 28889 raft_consensus.cc:2272] T 53af9481634c45f5a2cf52f3b93047d1 P b675cc11b2dc4c9580b7b61dee8e4333 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.621905 28889 tablet_replica.cc:333] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333: stopping tablet replica
I20260709 13:09:30.622283 28889 raft_consensus.cc:2243] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:30.622634 28889 raft_consensus.cc:2272] T f593a7e12d394520ac84b9cb01f8a445 P b675cc11b2dc4c9580b7b61dee8e4333 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.624372 28889 tablet_replica.cc:333] T ca468a14f9ad47fc83c2fd8cca868e02 P b675cc11b2dc4c9580b7b61dee8e4333: stopping tablet replica
I20260709 13:09:30.624747 28889 raft_consensus.cc:2243] T ca468a14f9ad47fc83c2fd8cca868e02 P b675cc11b2dc4c9580b7b61dee8e4333 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:30.625070 28889 raft_consensus.cc:2272] T ca468a14f9ad47fc83c2fd8cca868e02 P b675cc11b2dc4c9580b7b61dee8e4333 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.649945 28889 tablet_server.cc:196] TabletServer@127.28.54.67:0 shutdown complete.
I20260709 13:09:30.665237 28889 master.cc:562] Master@127.28.54.126:37903 shutting down...
I20260709 13:09:30.825129 28889 raft_consensus.cc:2243] T 00000000000000000000000000000000 P a46242c1a0cd471a83e5a0a9c0c8e7d2 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:30.825611 28889 raft_consensus.cc:2272] T 00000000000000000000000000000000 P a46242c1a0cd471a83e5a0a9c0c8e7d2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:30.825946 28889 tablet_replica.cc:333] T 00000000000000000000000000000000 P a46242c1a0cd471a83e5a0a9c0c8e7d2: stopping tablet replica
I20260709 13:09:30.844849 28889 master.cc:584] Master@127.28.54.126:37903 shutdown complete.
1b1cd51a6e4f49c88eb2d118d294d565  4
ade6fdeec548419dafe0d8c727ea9db7  4
b675cc11b2dc4c9580b7b61dee8e4333  1
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (11970 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 13:09:30.882088 28889 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.28.54.126:42287
I20260709 13:09:30.883160 28889 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:30.888298 29381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:30.888274 29382 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:30.889654 29384 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:30.890491 28889 server_base.cc:1061] running on GCE node
I20260709 13:09:30.891414 28889 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:30.891697 28889 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:30.891878 28889 hybrid_clock.cc:648] HybridClock initialized: now 1783602570891861 us; error 0 us; skew 500 ppm
I20260709 13:09:30.892596 28889 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:30.898921 28889 webserver.cc:533] Webserver started at http://127.28.54.126:36055/ using document root <none> and password file <none>
I20260709 13:09:30.899395 28889 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:30.899564 28889 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:30.899807 28889 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:30.900838 28889 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602558744475-28889-0/minicluster-data/master-0-root/instance:
uuid: "f2acd763fac14fba951e6d3287c90875"
format_stamp: "Formatted at 2026-07-09 13:09:30 on dist-test-slave-vpdx"
I20260709 13:09:30.904896 28889 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:09:30.907982 29389 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:30.908602 28889 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 13:09:30.908859 28889 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602558744475-28889-0/minicluster-data/master-0-root
uuid: "f2acd763fac14fba951e6d3287c90875"
format_stamp: "Formatted at 2026-07-09 13:09:30 on dist-test-slave-vpdx"
I20260709 13:09:30.909108 28889 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602558744475-28889-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602558744475-28889-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602558744475-28889-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:30.920888 28889 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:30.922015 28889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:30.957376 28889 rpc_server.cc:307] RPC server started. Bound to: 127.28.54.126:42287
I20260709 13:09:30.957460 29440 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.54.126:42287 every 8 connection(s)
I20260709 13:09:30.960994 29441 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:30.969806 29441 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f2acd763fac14fba951e6d3287c90875: Bootstrap starting.
I20260709 13:09:30.974241 29441 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f2acd763fac14fba951e6d3287c90875: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:30.978134 29441 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f2acd763fac14fba951e6d3287c90875: No bootstrap required, opened a new log
I20260709 13:09:30.980139 29441 raft_consensus.cc:359] T 00000000000000000000000000000000 P f2acd763fac14fba951e6d3287c90875 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2acd763fac14fba951e6d3287c90875" member_type: VOTER }
I20260709 13:09:30.980491 29441 raft_consensus.cc:385] T 00000000000000000000000000000000 P f2acd763fac14fba951e6d3287c90875 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:30.980722 29441 raft_consensus.cc:740] T 00000000000000000000000000000000 P f2acd763fac14fba951e6d3287c90875 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f2acd763fac14fba951e6d3287c90875, State: Initialized, Role: FOLLOWER
I20260709 13:09:30.981274 29441 consensus_queue.cc:260] T 00000000000000000000000000000000 P f2acd763fac14fba951e6d3287c90875 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2acd763fac14fba951e6d3287c90875" member_type: VOTER }
I20260709 13:09:30.981704 29441 raft_consensus.cc:399] T 00000000000000000000000000000000 P f2acd763fac14fba951e6d3287c90875 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:09:30.981928 29441 raft_consensus.cc:493] T 00000000000000000000000000000000 P f2acd763fac14fba951e6d3287c90875 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:09:30.982167 29441 raft_consensus.cc:3060] T 00000000000000000000000000000000 P f2acd763fac14fba951e6d3287c90875 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:30.985924 29441 raft_consensus.cc:515] T 00000000000000000000000000000000 P f2acd763fac14fba951e6d3287c90875 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2acd763fac14fba951e6d3287c90875" member_type: VOTER }
I20260709 13:09:30.986405 29441 leader_election.cc:304] T 00000000000000000000000000000000 P f2acd763fac14fba951e6d3287c90875 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f2acd763fac14fba951e6d3287c90875; no voters: 
I20260709 13:09:30.987422 29441 leader_election.cc:290] T 00000000000000000000000000000000 P f2acd763fac14fba951e6d3287c90875 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:09:30.987785 29444 raft_consensus.cc:2804] T 00000000000000000000000000000000 P f2acd763fac14fba951e6d3287c90875 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:30.988974 29444 raft_consensus.cc:697] T 00000000000000000000000000000000 P f2acd763fac14fba951e6d3287c90875 [term 1 LEADER]: Becoming Leader. State: Replica: f2acd763fac14fba951e6d3287c90875, State: Running, Role: LEADER
I20260709 13:09:30.989599 29444 consensus_queue.cc:237] T 00000000000000000000000000000000 P f2acd763fac14fba951e6d3287c90875 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2acd763fac14fba951e6d3287c90875" member_type: VOTER }
I20260709 13:09:30.990140 29441 sys_catalog.cc:565] T 00000000000000000000000000000000 P f2acd763fac14fba951e6d3287c90875 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:09:30.993607 29445 sys_catalog.cc:455] T 00000000000000000000000000000000 P f2acd763fac14fba951e6d3287c90875 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f2acd763fac14fba951e6d3287c90875" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2acd763fac14fba951e6d3287c90875" member_type: VOTER } }
I20260709 13:09:30.994267 29445 sys_catalog.cc:458] T 00000000000000000000000000000000 P f2acd763fac14fba951e6d3287c90875 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:30.994261 29446 sys_catalog.cc:455] T 00000000000000000000000000000000 P f2acd763fac14fba951e6d3287c90875 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f2acd763fac14fba951e6d3287c90875. Latest consensus state: current_term: 1 leader_uuid: "f2acd763fac14fba951e6d3287c90875" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f2acd763fac14fba951e6d3287c90875" member_type: VOTER } }
I20260709 13:09:30.994906 29446 sys_catalog.cc:458] T 00000000000000000000000000000000 P f2acd763fac14fba951e6d3287c90875 [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:30.998387 29451 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:09:31.005600 29451 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:09:31.006544 28889 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:09:31.013525 29451 catalog_manager.cc:1383] Generated new cluster ID: 531d6521356144dfa447d14b80ea2b30
I20260709 13:09:31.013918 29451 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:09:31.032578 29451 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:09:31.034880 29451 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:09:31.052498 29451 catalog_manager.cc:6070] T 00000000000000000000000000000000 P f2acd763fac14fba951e6d3287c90875: Generated new TSK 0
I20260709 13:09:31.053126 29451 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:09:31.072866 28889 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:31.078321 29462 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:31.079355 29463 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:31.081120 29465 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:31.081466 28889 server_base.cc:1061] running on GCE node
I20260709 13:09:31.082281 28889 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:31.082470 28889 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:31.082618 28889 hybrid_clock.cc:648] HybridClock initialized: now 1783602571082601 us; error 0 us; skew 500 ppm
I20260709 13:09:31.083103 28889 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:31.085175 28889 webserver.cc:533] Webserver started at http://127.28.54.65:45215/ using document root <none> and password file <none>
I20260709 13:09:31.085623 28889 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:31.085829 28889 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:31.086068 28889 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:31.087060 28889 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602558744475-28889-0/minicluster-data/ts-0-root/instance:
uuid: "6d0b0542874c4b8798bf338303235c61"
format_stamp: "Formatted at 2026-07-09 13:09:31 on dist-test-slave-vpdx"
I20260709 13:09:31.091234 28889 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:09:31.094309 29470 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:31.094933 28889 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:09:31.095193 28889 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602558744475-28889-0/minicluster-data/ts-0-root
uuid: "6d0b0542874c4b8798bf338303235c61"
format_stamp: "Formatted at 2026-07-09 13:09:31 on dist-test-slave-vpdx"
I20260709 13:09:31.095446 28889 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602558744475-28889-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602558744475-28889-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602558744475-28889-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:31.127868 28889 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:31.129076 28889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:31.130541 28889 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:31.132768 28889 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:31.132956 28889 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:31.133186 28889 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:31.133347 28889 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:31.170351 28889 rpc_server.cc:307] RPC server started. Bound to: 127.28.54.65:33255
I20260709 13:09:31.170450 29532 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.54.65:33255 every 8 connection(s)
I20260709 13:09:31.174796 28889 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:31.181490 29537 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:31.182010 29538 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:31.184631 29541 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:31.185318 28889 server_base.cc:1061] running on GCE node
I20260709 13:09:31.186376 28889 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:31.186630 28889 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:31.186827 28889 hybrid_clock.cc:648] HybridClock initialized: now 1783602571186809 us; error 0 us; skew 500 ppm
I20260709 13:09:31.187469 28889 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:31.187606 29533 heartbeater.cc:344] Connected to a master server at 127.28.54.126:42287
I20260709 13:09:31.187960 29533 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:31.188649 29533 heartbeater.cc:507] Master 127.28.54.126:42287 requested a full tablet report, sending...
I20260709 13:09:31.189978 28889 webserver.cc:533] Webserver started at http://127.28.54.66:35871/ using document root <none> and password file <none>
I20260709 13:09:31.190529 28889 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:31.190732 28889 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:31.190616 29406 ts_manager.cc:194] Registered new tserver with Master: 6d0b0542874c4b8798bf338303235c61 (127.28.54.65:33255)
I20260709 13:09:31.191047 28889 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:31.192162 28889 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602558744475-28889-0/minicluster-data/ts-1-root/instance:
uuid: "09697c1884894b978e52204f376025c8"
format_stamp: "Formatted at 2026-07-09 13:09:31 on dist-test-slave-vpdx"
I20260709 13:09:31.192386 29406 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41660
I20260709 13:09:31.196336 28889 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:09:31.199359 29545 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:31.200044 28889 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:09:31.200307 28889 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602558744475-28889-0/minicluster-data/ts-1-root
uuid: "09697c1884894b978e52204f376025c8"
format_stamp: "Formatted at 2026-07-09 13:09:31 on dist-test-slave-vpdx"
I20260709 13:09:31.200589 28889 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602558744475-28889-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602558744475-28889-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602558744475-28889-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:31.229245 28889 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:31.230473 28889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:31.231892 28889 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:31.234135 28889 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:31.234328 28889 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:31.234545 28889 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:31.234700 28889 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:31.271132 28889 rpc_server.cc:307] RPC server started. Bound to: 127.28.54.66:35555
I20260709 13:09:31.271242 29607 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.54.66:35555 every 8 connection(s)
I20260709 13:09:31.275360 28889 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:31.282953 29611 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:31.283854 29612 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:31.286208 29608 heartbeater.cc:344] Connected to a master server at 127.28.54.126:42287
I20260709 13:09:31.286692 29608 heartbeater.cc:461] Registering TS with master...
W20260709 13:09:31.286972 29614 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:31.287175 28889 server_base.cc:1061] running on GCE node
I20260709 13:09:31.287707 29608 heartbeater.cc:507] Master 127.28.54.126:42287 requested a full tablet report, sending...
I20260709 13:09:31.288050 28889 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:31.288266 28889 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:31.288425 28889 hybrid_clock.cc:648] HybridClock initialized: now 1783602571288407 us; error 0 us; skew 500 ppm
I20260709 13:09:31.288951 28889 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:31.289542 29406 ts_manager.cc:194] Registered new tserver with Master: 09697c1884894b978e52204f376025c8 (127.28.54.66:35555)
I20260709 13:09:31.291288 29406 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41664
I20260709 13:09:31.291555 28889 webserver.cc:533] Webserver started at http://127.28.54.67:43761/ using document root <none> and password file <none>
I20260709 13:09:31.292243 28889 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:31.292522 28889 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:31.292881 28889 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:31.294028 28889 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602558744475-28889-0/minicluster-data/ts-2-root/instance:
uuid: "514542813d154b618edd53dfb5344a50"
format_stamp: "Formatted at 2026-07-09 13:09:31 on dist-test-slave-vpdx"
I20260709 13:09:31.298069 28889 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 13:09:31.300964 29619 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:31.301606 28889 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:09:31.301878 28889 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602558744475-28889-0/minicluster-data/ts-2-root
uuid: "514542813d154b618edd53dfb5344a50"
format_stamp: "Formatted at 2026-07-09 13:09:31 on dist-test-slave-vpdx"
I20260709 13:09:31.302174 28889 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602558744475-28889-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602558744475-28889-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783602558744475-28889-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:31.323973 28889 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:31.325127 28889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:31.326547 28889 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:31.328568 28889 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:31.328794 28889 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:31.329018 28889 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:31.329167 28889 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:31.366510 28889 rpc_server.cc:307] RPC server started. Bound to: 127.28.54.67:34839
I20260709 13:09:31.366616 29681 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.54.67:34839 every 8 connection(s)
I20260709 13:09:31.380630 29682 heartbeater.cc:344] Connected to a master server at 127.28.54.126:42287
I20260709 13:09:31.380955 29682 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:31.381640 29682 heartbeater.cc:507] Master 127.28.54.126:42287 requested a full tablet report, sending...
I20260709 13:09:31.383426 29406 ts_manager.cc:194] Registered new tserver with Master: 514542813d154b618edd53dfb5344a50 (127.28.54.67:34839)
I20260709 13:09:31.383805 28889 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014291991s
I20260709 13:09:31.385022 29406 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41670
I20260709 13:09:31.408077 29406 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41682:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:09:31.410862 29406 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:09:31.476188 29498 tablet_service.cc:1511] Processing CreateTablet for tablet 3800273f9bb44c2ca39bf63aa681fe6c (DEFAULT_TABLE table=test-workload [id=0d20901406f243d389cd1e7bced74a2d]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:09:31.477442 29498 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3800273f9bb44c2ca39bf63aa681fe6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:31.478929 29497 tablet_service.cc:1511] Processing CreateTablet for tablet 3e81245af96d4b4b810319574acf129c (DEFAULT_TABLE table=test-workload [id=0d20901406f243d389cd1e7bced74a2d]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:09:31.480304 29497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e81245af96d4b4b810319574acf129c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:31.482920 29494 tablet_service.cc:1511] Processing CreateTablet for tablet 6ed5e4177a61445f9768305d4c6867da (DEFAULT_TABLE table=test-workload [id=0d20901406f243d389cd1e7bced74a2d]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:09:31.484237 29494 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ed5e4177a61445f9768305d4c6867da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:31.478929 29495 tablet_service.cc:1511] Processing CreateTablet for tablet 5d7dcb82d7c94558a8dc7cebafb0d7f8 (DEFAULT_TABLE table=test-workload [id=0d20901406f243d389cd1e7bced74a2d]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:09:31.487208 29495 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d7dcb82d7c94558a8dc7cebafb0d7f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:31.489042 29493 tablet_service.cc:1511] Processing CreateTablet for tablet 823db933ae2c4c51a5321bbbd7b53f2c (DEFAULT_TABLE table=test-workload [id=0d20901406f243d389cd1e7bced74a2d]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:09:31.490339 29493 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 823db933ae2c4c51a5321bbbd7b53f2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:31.494369 29492 tablet_service.cc:1511] Processing CreateTablet for tablet 614a388092724f85b0d98362099dc41a (DEFAULT_TABLE table=test-workload [id=0d20901406f243d389cd1e7bced74a2d]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:09:31.495612 29492 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 614a388092724f85b0d98362099dc41a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:31.479934 29496 tablet_service.cc:1511] Processing CreateTablet for tablet e7fed5eeb6124b1794e0b6c304994049 (DEFAULT_TABLE table=test-workload [id=0d20901406f243d389cd1e7bced74a2d]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:09:31.498366 29496 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7fed5eeb6124b1794e0b6c304994049. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:31.508307 29491 tablet_service.cc:1511] Processing CreateTablet for tablet 9ff797420926444ab55e3a79c683f7dc (DEFAULT_TABLE table=test-workload [id=0d20901406f243d389cd1e7bced74a2d]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:09:31.509697 29491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ff797420926444ab55e3a79c683f7dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:31.526978 29573 tablet_service.cc:1511] Processing CreateTablet for tablet 3800273f9bb44c2ca39bf63aa681fe6c (DEFAULT_TABLE table=test-workload [id=0d20901406f243d389cd1e7bced74a2d]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:09:31.528334 29573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3800273f9bb44c2ca39bf63aa681fe6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:31.535779 29490 tablet_service.cc:1511] Processing CreateTablet for tablet e40d52b3e84c41148660cbdc2101d793 (DEFAULT_TABLE table=test-workload [id=0d20901406f243d389cd1e7bced74a2d]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:09:31.537052 29490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e40d52b3e84c41148660cbdc2101d793. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:31.538043 29497 tablet_service.cc:1511] Processing CreateTablet for tablet f5aee951cde24997a61edbc434b816bb (DEFAULT_TABLE table=test-workload [id=0d20901406f243d389cd1e7bced74a2d]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:09:31.543221 29572 tablet_service.cc:1511] Processing CreateTablet for tablet 3e81245af96d4b4b810319574acf129c (DEFAULT_TABLE table=test-workload [id=0d20901406f243d389cd1e7bced74a2d]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:09:31.544338 29497 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5aee951cde24997a61edbc434b816bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:31.544494 29572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e81245af96d4b4b810319574acf129c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:31.554674 29647 tablet_service.cc:1511] Processing CreateTablet for tablet 3800273f9bb44c2ca39bf63aa681fe6c (DEFAULT_TABLE table=test-workload [id=0d20901406f243d389cd1e7bced74a2d]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:09:31.555199 29646 tablet_service.cc:1511] Processing CreateTablet for tablet 3e81245af96d4b4b810319574acf129c (DEFAULT_TABLE table=test-workload [id=0d20901406f243d389cd1e7bced74a2d]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:09:31.556066 29647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3800273f9bb44c2ca39bf63aa681fe6c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:31.557314 29646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3e81245af96d4b4b810319574acf129c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:31.557984 29571 tablet_service.cc:1511] Processing CreateTablet for tablet e7fed5eeb6124b1794e0b6c304994049 (DEFAULT_TABLE table=test-workload [id=0d20901406f243d389cd1e7bced74a2d]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:09:31.559244 29571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7fed5eeb6124b1794e0b6c304994049. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:31.555199 29645 tablet_service.cc:1511] Processing CreateTablet for tablet e7fed5eeb6124b1794e0b6c304994049 (DEFAULT_TABLE table=test-workload [id=0d20901406f243d389cd1e7bced74a2d]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:09:31.564278 29645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7fed5eeb6124b1794e0b6c304994049. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:31.564396 29644 tablet_service.cc:1511] Processing CreateTablet for tablet 5d7dcb82d7c94558a8dc7cebafb0d7f8 (DEFAULT_TABLE table=test-workload [id=0d20901406f243d389cd1e7bced74a2d]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:09:31.565800 29570 tablet_service.cc:1511] Processing CreateTablet for tablet 5d7dcb82d7c94558a8dc7cebafb0d7f8 (DEFAULT_TABLE table=test-workload [id=0d20901406f243d389cd1e7bced74a2d]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:09:31.567327 29643 tablet_service.cc:1511] Processing CreateTablet for tablet 6ed5e4177a61445f9768305d4c6867da (DEFAULT_TABLE table=test-workload [id=0d20901406f243d389cd1e7bced74a2d]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:09:31.567795 29570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d7dcb82d7c94558a8dc7cebafb0d7f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:31.568514 29643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ed5e4177a61445f9768305d4c6867da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:31.574375 29639 tablet_service.cc:1511] Processing CreateTablet for tablet e40d52b3e84c41148660cbdc2101d793 (DEFAULT_TABLE table=test-workload [id=0d20901406f243d389cd1e7bced74a2d]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:09:31.575400 29566 tablet_service.cc:1511] Processing CreateTablet for tablet 9ff797420926444ab55e3a79c683f7dc (DEFAULT_TABLE table=test-workload [id=0d20901406f243d389cd1e7bced74a2d]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:09:31.575567 29641 tablet_service.cc:1511] Processing CreateTablet for tablet 614a388092724f85b0d98362099dc41a (DEFAULT_TABLE table=test-workload [id=0d20901406f243d389cd1e7bced74a2d]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:09:31.575911 29564 tablet_service.cc:1511] Processing CreateTablet for tablet f5aee951cde24997a61edbc434b816bb (DEFAULT_TABLE table=test-workload [id=0d20901406f243d389cd1e7bced74a2d]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:09:31.576640 29566 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ff797420926444ab55e3a79c683f7dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:31.578539 29640 tablet_service.cc:1511] Processing CreateTablet for tablet 9ff797420926444ab55e3a79c683f7dc (DEFAULT_TABLE table=test-workload [id=0d20901406f243d389cd1e7bced74a2d]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:09:31.583026 29569 tablet_service.cc:1511] Processing CreateTablet for tablet 6ed5e4177a61445f9768305d4c6867da (DEFAULT_TABLE table=test-workload [id=0d20901406f243d389cd1e7bced74a2d]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:09:31.585515 29568 tablet_service.cc:1511] Processing CreateTablet for tablet 823db933ae2c4c51a5321bbbd7b53f2c (DEFAULT_TABLE table=test-workload [id=0d20901406f243d389cd1e7bced74a2d]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:09:31.588927 29567 tablet_service.cc:1511] Processing CreateTablet for tablet 614a388092724f85b0d98362099dc41a (DEFAULT_TABLE table=test-workload [id=0d20901406f243d389cd1e7bced74a2d]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:09:31.590508 29565 tablet_service.cc:1511] Processing CreateTablet for tablet e40d52b3e84c41148660cbdc2101d793 (DEFAULT_TABLE table=test-workload [id=0d20901406f243d389cd1e7bced74a2d]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:09:31.591799 29638 tablet_service.cc:1511] Processing CreateTablet for tablet f5aee951cde24997a61edbc434b816bb (DEFAULT_TABLE table=test-workload [id=0d20901406f243d389cd1e7bced74a2d]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:09:31.593113 29642 tablet_service.cc:1511] Processing CreateTablet for tablet 823db933ae2c4c51a5321bbbd7b53f2c (DEFAULT_TABLE table=test-workload [id=0d20901406f243d389cd1e7bced74a2d]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:09:31.594909 29564 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5aee951cde24997a61edbc434b816bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:31.596578 29569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ed5e4177a61445f9768305d4c6867da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:31.597141 29567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 614a388092724f85b0d98362099dc41a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:31.598155 29565 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e40d52b3e84c41148660cbdc2101d793. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:31.602124 29568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 823db933ae2c4c51a5321bbbd7b53f2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:31.595108 29644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d7dcb82d7c94558a8dc7cebafb0d7f8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:31.607321 29642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 823db933ae2c4c51a5321bbbd7b53f2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:31.609028 29638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5aee951cde24997a61edbc434b816bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:31.611056 29639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e40d52b3e84c41148660cbdc2101d793. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:31.614105 29640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9ff797420926444ab55e3a79c683f7dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:31.618041 29641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 614a388092724f85b0d98362099dc41a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:31.606309 29697 tablet_bootstrap.cc:492] T 823db933ae2c4c51a5321bbbd7b53f2c P 6d0b0542874c4b8798bf338303235c61: Bootstrap starting.
I20260709 13:09:31.652098 29697 tablet_bootstrap.cc:654] T 823db933ae2c4c51a5321bbbd7b53f2c P 6d0b0542874c4b8798bf338303235c61: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.664750 29698 tablet_bootstrap.cc:492] T 3e81245af96d4b4b810319574acf129c P 514542813d154b618edd53dfb5344a50: Bootstrap starting.
I20260709 13:09:31.679749 29698 tablet_bootstrap.cc:654] T 3e81245af96d4b4b810319574acf129c P 514542813d154b618edd53dfb5344a50: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.692679 29699 tablet_bootstrap.cc:492] T 6ed5e4177a61445f9768305d4c6867da P 09697c1884894b978e52204f376025c8: Bootstrap starting.
I20260709 13:09:31.694139 29697 tablet_bootstrap.cc:492] T 823db933ae2c4c51a5321bbbd7b53f2c P 6d0b0542874c4b8798bf338303235c61: No bootstrap required, opened a new log
I20260709 13:09:31.694314 29698 tablet_bootstrap.cc:492] T 3e81245af96d4b4b810319574acf129c P 514542813d154b618edd53dfb5344a50: No bootstrap required, opened a new log
I20260709 13:09:31.694605 29697 ts_tablet_manager.cc:1403] T 823db933ae2c4c51a5321bbbd7b53f2c P 6d0b0542874c4b8798bf338303235c61: Time spent bootstrapping tablet: real 0.092s	user 0.014s	sys 0.005s
I20260709 13:09:31.694772 29698 ts_tablet_manager.cc:1403] T 3e81245af96d4b4b810319574acf129c P 514542813d154b618edd53dfb5344a50: Time spent bootstrapping tablet: real 0.030s	user 0.007s	sys 0.007s
I20260709 13:09:31.697348 29697 raft_consensus.cc:359] T 823db933ae2c4c51a5321bbbd7b53f2c P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:31.697502 29698 raft_consensus.cc:359] T 3e81245af96d4b4b810319574acf129c P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:31.698062 29697 raft_consensus.cc:385] T 823db933ae2c4c51a5321bbbd7b53f2c P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.698231 29698 raft_consensus.cc:385] T 3e81245af96d4b4b810319574acf129c P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.698386 29697 raft_consensus.cc:740] T 823db933ae2c4c51a5321bbbd7b53f2c P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d0b0542874c4b8798bf338303235c61, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.698796 29698 raft_consensus.cc:740] T 3e81245af96d4b4b810319574acf129c P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514542813d154b618edd53dfb5344a50, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.699651 29698 consensus_queue.cc:260] T 3e81245af96d4b4b810319574acf129c P 514542813d154b618edd53dfb5344a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:31.699613 29697 consensus_queue.cc:260] T 823db933ae2c4c51a5321bbbd7b53f2c P 6d0b0542874c4b8798bf338303235c61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:31.710256 29699 tablet_bootstrap.cc:654] T 6ed5e4177a61445f9768305d4c6867da P 09697c1884894b978e52204f376025c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.716341 29682 heartbeater.cc:499] Master 127.28.54.126:42287 was elected leader, sending a full tablet report...
I20260709 13:09:31.716715 29698 ts_tablet_manager.cc:1434] T 3e81245af96d4b4b810319574acf129c P 514542813d154b618edd53dfb5344a50: Time spent starting tablet: real 0.022s	user 0.017s	sys 0.004s
I20260709 13:09:31.717629 29698 tablet_bootstrap.cc:492] T 6ed5e4177a61445f9768305d4c6867da P 514542813d154b618edd53dfb5344a50: Bootstrap starting.
I20260709 13:09:31.717679 29699 tablet_bootstrap.cc:492] T 6ed5e4177a61445f9768305d4c6867da P 09697c1884894b978e52204f376025c8: No bootstrap required, opened a new log
I20260709 13:09:31.718220 29699 ts_tablet_manager.cc:1403] T 6ed5e4177a61445f9768305d4c6867da P 09697c1884894b978e52204f376025c8: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.000s
I20260709 13:09:31.719123 29702 raft_consensus.cc:493] T 3e81245af96d4b4b810319574acf129c P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.719671 29702 raft_consensus.cc:515] T 3e81245af96d4b4b810319574acf129c P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:31.722462 29702 leader_election.cc:290] T 3e81245af96d4b4b810319574acf129c P 514542813d154b618edd53dfb5344a50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d0b0542874c4b8798bf338303235c61 (127.28.54.65:33255), 09697c1884894b978e52204f376025c8 (127.28.54.66:35555)
I20260709 13:09:31.724057 29698 tablet_bootstrap.cc:654] T 6ed5e4177a61445f9768305d4c6867da P 514542813d154b618edd53dfb5344a50: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.729287 29697 ts_tablet_manager.cc:1434] T 823db933ae2c4c51a5321bbbd7b53f2c P 6d0b0542874c4b8798bf338303235c61: Time spent starting tablet: real 0.034s	user 0.015s	sys 0.011s
I20260709 13:09:31.730252 29697 tablet_bootstrap.cc:492] T 3e81245af96d4b4b810319574acf129c P 6d0b0542874c4b8798bf338303235c61: Bootstrap starting.
I20260709 13:09:31.733060 29533 heartbeater.cc:499] Master 127.28.54.126:42287 was elected leader, sending a full tablet report...
I20260709 13:09:31.736471 29697 tablet_bootstrap.cc:654] T 3e81245af96d4b4b810319574acf129c P 6d0b0542874c4b8798bf338303235c61: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.741189 29699 raft_consensus.cc:359] T 6ed5e4177a61445f9768305d4c6867da P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:31.741729 29699 raft_consensus.cc:385] T 6ed5e4177a61445f9768305d4c6867da P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.741997 29699 raft_consensus.cc:740] T 6ed5e4177a61445f9768305d4c6867da P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09697c1884894b978e52204f376025c8, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.742671 29699 consensus_queue.cc:260] T 6ed5e4177a61445f9768305d4c6867da P 09697c1884894b978e52204f376025c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:31.743538 29583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e81245af96d4b4b810319574acf129c" candidate_uuid: "514542813d154b618edd53dfb5344a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09697c1884894b978e52204f376025c8" is_pre_election: true
W20260709 13:09:31.745436 29620 leader_election.cc:343] T 3e81245af96d4b4b810319574acf129c P 514542813d154b618edd53dfb5344a50 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09697c1884894b978e52204f376025c8 (127.28.54.66:35555): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:31.751937 29608 heartbeater.cc:499] Master 127.28.54.126:42287 was elected leader, sending a full tablet report...
I20260709 13:09:31.752470 29699 ts_tablet_manager.cc:1434] T 6ed5e4177a61445f9768305d4c6867da P 09697c1884894b978e52204f376025c8: Time spent starting tablet: real 0.034s	user 0.002s	sys 0.004s
I20260709 13:09:31.753496 29699 tablet_bootstrap.cc:492] T 3e81245af96d4b4b810319574acf129c P 09697c1884894b978e52204f376025c8: Bootstrap starting.
I20260709 13:09:31.758869 29508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e81245af96d4b4b810319574acf129c" candidate_uuid: "514542813d154b618edd53dfb5344a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d0b0542874c4b8798bf338303235c61" is_pre_election: true
I20260709 13:09:31.759703 29699 tablet_bootstrap.cc:654] T 3e81245af96d4b4b810319574acf129c P 09697c1884894b978e52204f376025c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.759671 29698 tablet_bootstrap.cc:492] T 6ed5e4177a61445f9768305d4c6867da P 514542813d154b618edd53dfb5344a50: No bootstrap required, opened a new log
I20260709 13:09:31.760257 29697 tablet_bootstrap.cc:492] T 3e81245af96d4b4b810319574acf129c P 6d0b0542874c4b8798bf338303235c61: No bootstrap required, opened a new log
I20260709 13:09:31.760411 29698 ts_tablet_manager.cc:1403] T 6ed5e4177a61445f9768305d4c6867da P 514542813d154b618edd53dfb5344a50: Time spent bootstrapping tablet: real 0.043s	user 0.008s	sys 0.004s
I20260709 13:09:31.760775 29697 ts_tablet_manager.cc:1403] T 3e81245af96d4b4b810319574acf129c P 6d0b0542874c4b8798bf338303235c61: Time spent bootstrapping tablet: real 0.031s	user 0.007s	sys 0.004s
W20260709 13:09:31.760354 29622 leader_election.cc:343] T 3e81245af96d4b4b810319574acf129c P 514542813d154b618edd53dfb5344a50 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d0b0542874c4b8798bf338303235c61 (127.28.54.65:33255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:31.763043 29622 leader_election.cc:304] T 3e81245af96d4b4b810319574acf129c P 514542813d154b618edd53dfb5344a50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514542813d154b618edd53dfb5344a50; no voters: 09697c1884894b978e52204f376025c8, 6d0b0542874c4b8798bf338303235c61
I20260709 13:09:31.763365 29698 raft_consensus.cc:359] T 6ed5e4177a61445f9768305d4c6867da P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:31.764037 29698 raft_consensus.cc:385] T 6ed5e4177a61445f9768305d4c6867da P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.764168 29702 raft_consensus.cc:2749] T 3e81245af96d4b4b810319574acf129c P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:31.764343 29698 raft_consensus.cc:740] T 6ed5e4177a61445f9768305d4c6867da P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514542813d154b618edd53dfb5344a50, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.765995 29697 raft_consensus.cc:359] T 3e81245af96d4b4b810319574acf129c P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:31.766701 29697 raft_consensus.cc:385] T 3e81245af96d4b4b810319574acf129c P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.766973 29697 raft_consensus.cc:740] T 3e81245af96d4b4b810319574acf129c P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d0b0542874c4b8798bf338303235c61, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.767639 29697 consensus_queue.cc:260] T 3e81245af96d4b4b810319574acf129c P 6d0b0542874c4b8798bf338303235c61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:31.769618 29697 ts_tablet_manager.cc:1434] T 3e81245af96d4b4b810319574acf129c P 6d0b0542874c4b8798bf338303235c61: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.000s
I20260709 13:09:31.770074 29698 consensus_queue.cc:260] T 6ed5e4177a61445f9768305d4c6867da P 514542813d154b618edd53dfb5344a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:31.770567 29697 tablet_bootstrap.cc:492] T 9ff797420926444ab55e3a79c683f7dc P 6d0b0542874c4b8798bf338303235c61: Bootstrap starting.
I20260709 13:09:31.771852 29699 tablet_bootstrap.cc:492] T 3e81245af96d4b4b810319574acf129c P 09697c1884894b978e52204f376025c8: No bootstrap required, opened a new log
I20260709 13:09:31.772328 29699 ts_tablet_manager.cc:1403] T 3e81245af96d4b4b810319574acf129c P 09697c1884894b978e52204f376025c8: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.004s
I20260709 13:09:31.772343 29698 ts_tablet_manager.cc:1434] T 6ed5e4177a61445f9768305d4c6867da P 514542813d154b618edd53dfb5344a50: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:09:31.773367 29698 tablet_bootstrap.cc:492] T 614a388092724f85b0d98362099dc41a P 514542813d154b618edd53dfb5344a50: Bootstrap starting.
I20260709 13:09:31.775403 29699 raft_consensus.cc:359] T 3e81245af96d4b4b810319574acf129c P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:31.776108 29699 raft_consensus.cc:385] T 3e81245af96d4b4b810319574acf129c P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.776444 29699 raft_consensus.cc:740] T 3e81245af96d4b4b810319574acf129c P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09697c1884894b978e52204f376025c8, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.777479 29697 tablet_bootstrap.cc:654] T 9ff797420926444ab55e3a79c683f7dc P 6d0b0542874c4b8798bf338303235c61: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.777179 29699 consensus_queue.cc:260] T 3e81245af96d4b4b810319574acf129c P 09697c1884894b978e52204f376025c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:31.779475 29699 ts_tablet_manager.cc:1434] T 3e81245af96d4b4b810319574acf129c P 09697c1884894b978e52204f376025c8: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:31.780037 29698 tablet_bootstrap.cc:654] T 614a388092724f85b0d98362099dc41a P 514542813d154b618edd53dfb5344a50: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.780447 29699 tablet_bootstrap.cc:492] T e7fed5eeb6124b1794e0b6c304994049 P 09697c1884894b978e52204f376025c8: Bootstrap starting.
I20260709 13:09:31.787308 29699 tablet_bootstrap.cc:654] T e7fed5eeb6124b1794e0b6c304994049 P 09697c1884894b978e52204f376025c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.789289 29697 tablet_bootstrap.cc:492] T 9ff797420926444ab55e3a79c683f7dc P 6d0b0542874c4b8798bf338303235c61: No bootstrap required, opened a new log
I20260709 13:09:31.789603 29698 tablet_bootstrap.cc:492] T 614a388092724f85b0d98362099dc41a P 514542813d154b618edd53dfb5344a50: No bootstrap required, opened a new log
I20260709 13:09:31.789970 29697 ts_tablet_manager.cc:1403] T 9ff797420926444ab55e3a79c683f7dc P 6d0b0542874c4b8798bf338303235c61: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.003s
I20260709 13:09:31.790066 29698 ts_tablet_manager.cc:1403] T 614a388092724f85b0d98362099dc41a P 514542813d154b618edd53dfb5344a50: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.007s
I20260709 13:09:31.793057 29698 raft_consensus.cc:359] T 614a388092724f85b0d98362099dc41a P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:31.793787 29698 raft_consensus.cc:385] T 614a388092724f85b0d98362099dc41a P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.793394 29697 raft_consensus.cc:359] T 9ff797420926444ab55e3a79c683f7dc P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:31.794126 29698 raft_consensus.cc:740] T 614a388092724f85b0d98362099dc41a P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514542813d154b618edd53dfb5344a50, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.794389 29697 raft_consensus.cc:385] T 9ff797420926444ab55e3a79c683f7dc P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.794845 29697 raft_consensus.cc:740] T 9ff797420926444ab55e3a79c683f7dc P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d0b0542874c4b8798bf338303235c61, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.794973 29698 consensus_queue.cc:260] T 614a388092724f85b0d98362099dc41a P 514542813d154b618edd53dfb5344a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:31.795841 29697 consensus_queue.cc:260] T 9ff797420926444ab55e3a79c683f7dc P 6d0b0542874c4b8798bf338303235c61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:31.797399 29698 ts_tablet_manager.cc:1434] T 614a388092724f85b0d98362099dc41a P 514542813d154b618edd53dfb5344a50: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:31.798267 29697 ts_tablet_manager.cc:1434] T 9ff797420926444ab55e3a79c683f7dc P 6d0b0542874c4b8798bf338303235c61: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:31.799275 29697 tablet_bootstrap.cc:492] T 3800273f9bb44c2ca39bf63aa681fe6c P 6d0b0542874c4b8798bf338303235c61: Bootstrap starting.
I20260709 13:09:31.800249 29699 tablet_bootstrap.cc:492] T e7fed5eeb6124b1794e0b6c304994049 P 09697c1884894b978e52204f376025c8: No bootstrap required, opened a new log
I20260709 13:09:31.800696 29699 ts_tablet_manager.cc:1403] T e7fed5eeb6124b1794e0b6c304994049 P 09697c1884894b978e52204f376025c8: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.007s
I20260709 13:09:31.801945 29698 tablet_bootstrap.cc:492] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50: Bootstrap starting.
I20260709 13:09:31.808454 29698 tablet_bootstrap.cc:654] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.809746 29699 raft_consensus.cc:359] T e7fed5eeb6124b1794e0b6c304994049 P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:31.810483 29699 raft_consensus.cc:385] T e7fed5eeb6124b1794e0b6c304994049 P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.810842 29699 raft_consensus.cc:740] T e7fed5eeb6124b1794e0b6c304994049 P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09697c1884894b978e52204f376025c8, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.808084 29697 tablet_bootstrap.cc:654] T 3800273f9bb44c2ca39bf63aa681fe6c P 6d0b0542874c4b8798bf338303235c61: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.811550 29699 consensus_queue.cc:260] T e7fed5eeb6124b1794e0b6c304994049 P 09697c1884894b978e52204f376025c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:31.813833 29699 ts_tablet_manager.cc:1434] T e7fed5eeb6124b1794e0b6c304994049 P 09697c1884894b978e52204f376025c8: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.001s
I20260709 13:09:31.814741 29699 tablet_bootstrap.cc:492] T f5aee951cde24997a61edbc434b816bb P 09697c1884894b978e52204f376025c8: Bootstrap starting.
I20260709 13:09:31.820837 29699 tablet_bootstrap.cc:654] T f5aee951cde24997a61edbc434b816bb P 09697c1884894b978e52204f376025c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.826627 29698 tablet_bootstrap.cc:492] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50: No bootstrap required, opened a new log
I20260709 13:09:31.827104 29698 ts_tablet_manager.cc:1403] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.008s
I20260709 13:09:31.828814 29697 tablet_bootstrap.cc:492] T 3800273f9bb44c2ca39bf63aa681fe6c P 6d0b0542874c4b8798bf338303235c61: No bootstrap required, opened a new log
I20260709 13:09:31.829264 29697 ts_tablet_manager.cc:1403] T 3800273f9bb44c2ca39bf63aa681fe6c P 6d0b0542874c4b8798bf338303235c61: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.004s
I20260709 13:09:31.829818 29698 raft_consensus.cc:359] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:31.830541 29698 raft_consensus.cc:385] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.830835 29698 raft_consensus.cc:740] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514542813d154b618edd53dfb5344a50, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.831547 29698 consensus_queue.cc:260] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:31.831972 29699 tablet_bootstrap.cc:492] T f5aee951cde24997a61edbc434b816bb P 09697c1884894b978e52204f376025c8: No bootstrap required, opened a new log
I20260709 13:09:31.832453 29699 ts_tablet_manager.cc:1403] T f5aee951cde24997a61edbc434b816bb P 09697c1884894b978e52204f376025c8: Time spent bootstrapping tablet: real 0.018s	user 0.005s	sys 0.012s
I20260709 13:09:31.831984 29697 raft_consensus.cc:359] T 3800273f9bb44c2ca39bf63aa681fe6c P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } }
I20260709 13:09:31.832830 29697 raft_consensus.cc:385] T 3800273f9bb44c2ca39bf63aa681fe6c P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.833128 29697 raft_consensus.cc:740] T 3800273f9bb44c2ca39bf63aa681fe6c P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d0b0542874c4b8798bf338303235c61, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.834137 29698 ts_tablet_manager.cc:1434] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 13:09:31.833827 29697 consensus_queue.cc:260] T 3800273f9bb44c2ca39bf63aa681fe6c P 6d0b0542874c4b8798bf338303235c61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } }
I20260709 13:09:31.835054 29698 tablet_bootstrap.cc:492] T 3800273f9bb44c2ca39bf63aa681fe6c P 514542813d154b618edd53dfb5344a50: Bootstrap starting.
I20260709 13:09:31.835961 29697 ts_tablet_manager.cc:1434] T 3800273f9bb44c2ca39bf63aa681fe6c P 6d0b0542874c4b8798bf338303235c61: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260709 13:09:31.836818 29697 tablet_bootstrap.cc:492] T 614a388092724f85b0d98362099dc41a P 6d0b0542874c4b8798bf338303235c61: Bootstrap starting.
I20260709 13:09:31.837281 29699 raft_consensus.cc:359] T f5aee951cde24997a61edbc434b816bb P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:31.837952 29699 raft_consensus.cc:385] T f5aee951cde24997a61edbc434b816bb P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.838236 29699 raft_consensus.cc:740] T f5aee951cde24997a61edbc434b816bb P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09697c1884894b978e52204f376025c8, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.838900 29699 consensus_queue.cc:260] T f5aee951cde24997a61edbc434b816bb P 09697c1884894b978e52204f376025c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:31.841207 29699 ts_tablet_manager.cc:1434] T f5aee951cde24997a61edbc434b816bb P 09697c1884894b978e52204f376025c8: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:09:31.841773 29698 tablet_bootstrap.cc:654] T 3800273f9bb44c2ca39bf63aa681fe6c P 514542813d154b618edd53dfb5344a50: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.842085 29699 tablet_bootstrap.cc:492] T 3800273f9bb44c2ca39bf63aa681fe6c P 09697c1884894b978e52204f376025c8: Bootstrap starting.
I20260709 13:09:31.843209 29697 tablet_bootstrap.cc:654] T 614a388092724f85b0d98362099dc41a P 6d0b0542874c4b8798bf338303235c61: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.848125 29699 tablet_bootstrap.cc:654] T 3800273f9bb44c2ca39bf63aa681fe6c P 09697c1884894b978e52204f376025c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.853171 29698 tablet_bootstrap.cc:492] T 3800273f9bb44c2ca39bf63aa681fe6c P 514542813d154b618edd53dfb5344a50: No bootstrap required, opened a new log
I20260709 13:09:31.853638 29698 ts_tablet_manager.cc:1403] T 3800273f9bb44c2ca39bf63aa681fe6c P 514542813d154b618edd53dfb5344a50: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.005s
I20260709 13:09:31.856521 29698 raft_consensus.cc:359] T 3800273f9bb44c2ca39bf63aa681fe6c P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } }
I20260709 13:09:31.857264 29698 raft_consensus.cc:385] T 3800273f9bb44c2ca39bf63aa681fe6c P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.858825 29698 raft_consensus.cc:740] T 3800273f9bb44c2ca39bf63aa681fe6c P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514542813d154b618edd53dfb5344a50, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.859396 29699 tablet_bootstrap.cc:492] T 3800273f9bb44c2ca39bf63aa681fe6c P 09697c1884894b978e52204f376025c8: No bootstrap required, opened a new log
I20260709 13:09:31.859819 29699 ts_tablet_manager.cc:1403] T 3800273f9bb44c2ca39bf63aa681fe6c P 09697c1884894b978e52204f376025c8: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 13:09:31.859877 29697 tablet_bootstrap.cc:492] T 614a388092724f85b0d98362099dc41a P 6d0b0542874c4b8798bf338303235c61: No bootstrap required, opened a new log
I20260709 13:09:31.859584 29698 consensus_queue.cc:260] T 3800273f9bb44c2ca39bf63aa681fe6c P 514542813d154b618edd53dfb5344a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } }
I20260709 13:09:31.860491 29697 ts_tablet_manager.cc:1403] T 614a388092724f85b0d98362099dc41a P 6d0b0542874c4b8798bf338303235c61: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.016s
I20260709 13:09:31.862653 29699 raft_consensus.cc:359] T 3800273f9bb44c2ca39bf63aa681fe6c P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } }
I20260709 13:09:31.863447 29699 raft_consensus.cc:385] T 3800273f9bb44c2ca39bf63aa681fe6c P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.863194 29697 raft_consensus.cc:359] T 614a388092724f85b0d98362099dc41a P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:31.863741 29699 raft_consensus.cc:740] T 3800273f9bb44c2ca39bf63aa681fe6c P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09697c1884894b978e52204f376025c8, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.863871 29697 raft_consensus.cc:385] T 614a388092724f85b0d98362099dc41a P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.864207 29697 raft_consensus.cc:740] T 614a388092724f85b0d98362099dc41a P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d0b0542874c4b8798bf338303235c61, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.864820 29698 ts_tablet_manager.cc:1434] T 3800273f9bb44c2ca39bf63aa681fe6c P 514542813d154b618edd53dfb5344a50: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:09:31.864542 29699 consensus_queue.cc:260] T 3800273f9bb44c2ca39bf63aa681fe6c P 09697c1884894b978e52204f376025c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } }
I20260709 13:09:31.864849 29697 consensus_queue.cc:260] T 614a388092724f85b0d98362099dc41a P 6d0b0542874c4b8798bf338303235c61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:31.865900 29698 tablet_bootstrap.cc:492] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50: Bootstrap starting.
I20260709 13:09:31.867138 29697 ts_tablet_manager.cc:1434] T 614a388092724f85b0d98362099dc41a P 6d0b0542874c4b8798bf338303235c61: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:31.868050 29697 tablet_bootstrap.cc:492] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61: Bootstrap starting.
I20260709 13:09:31.870692 29699 ts_tablet_manager.cc:1434] T 3800273f9bb44c2ca39bf63aa681fe6c P 09697c1884894b978e52204f376025c8: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:09:31.871646 29699 tablet_bootstrap.cc:492] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 09697c1884894b978e52204f376025c8: Bootstrap starting.
I20260709 13:09:31.874123 29697 tablet_bootstrap.cc:654] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.874222 29698 tablet_bootstrap.cc:654] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.875080 29703 raft_consensus.cc:493] T 614a388092724f85b0d98362099dc41a P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.875526 29703 raft_consensus.cc:515] T 614a388092724f85b0d98362099dc41a P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:31.877530 29702 raft_consensus.cc:493] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.877712 29699 tablet_bootstrap.cc:654] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 09697c1884894b978e52204f376025c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.878028 29702 raft_consensus.cc:515] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:31.879949 29702 leader_election.cc:290] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d0b0542874c4b8798bf338303235c61 (127.28.54.65:33255), 09697c1884894b978e52204f376025c8 (127.28.54.66:35555)
I20260709 13:09:31.881712 29703 leader_election.cc:290] T 614a388092724f85b0d98362099dc41a P 6d0b0542874c4b8798bf338303235c61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09697c1884894b978e52204f376025c8 (127.28.54.66:35555), 514542813d154b618edd53dfb5344a50 (127.28.54.67:34839)
I20260709 13:09:31.881636 29583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823db933ae2c4c51a5321bbbd7b53f2c" candidate_uuid: "514542813d154b618edd53dfb5344a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09697c1884894b978e52204f376025c8" is_pre_election: true
I20260709 13:09:31.892773 29697 tablet_bootstrap.cc:492] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61: No bootstrap required, opened a new log
I20260709 13:09:31.893267 29697 ts_tablet_manager.cc:1403] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61: Time spent bootstrapping tablet: real 0.025s	user 0.016s	sys 0.008s
I20260709 13:09:31.896169 29697 raft_consensus.cc:359] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:31.896840 29697 raft_consensus.cc:385] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.897125 29697 raft_consensus.cc:740] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d0b0542874c4b8798bf338303235c61, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.893219 29508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823db933ae2c4c51a5321bbbd7b53f2c" candidate_uuid: "514542813d154b618edd53dfb5344a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d0b0542874c4b8798bf338303235c61" is_pre_election: true
W20260709 13:09:31.912281 29620 leader_election.cc:343] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09697c1884894b978e52204f376025c8 (127.28.54.66:35555): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:31.914686 29508 raft_consensus.cc:2468] T 823db933ae2c4c51a5321bbbd7b53f2c P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514542813d154b618edd53dfb5344a50 in term 0.
I20260709 13:09:31.922093 29622 leader_election.cc:304] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514542813d154b618edd53dfb5344a50, 6d0b0542874c4b8798bf338303235c61; no voters: 09697c1884894b978e52204f376025c8
I20260709 13:09:31.923259 29702 raft_consensus.cc:2804] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:31.923632 29702 raft_consensus.cc:493] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.923955 29702 raft_consensus.cc:3060] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:31.932971 29702 raft_consensus.cc:515] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:31.936337 29699 tablet_bootstrap.cc:492] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 09697c1884894b978e52204f376025c8: No bootstrap required, opened a new log
I20260709 13:09:31.936740 29699 ts_tablet_manager.cc:1403] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 09697c1884894b978e52204f376025c8: Time spent bootstrapping tablet: real 0.065s	user 0.020s	sys 0.040s
I20260709 13:09:31.938473 29698 tablet_bootstrap.cc:492] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50: No bootstrap required, opened a new log
I20260709 13:09:31.938992 29698 ts_tablet_manager.cc:1403] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50: Time spent bootstrapping tablet: real 0.073s	user 0.020s	sys 0.030s
I20260709 13:09:31.939548 29699 raft_consensus.cc:359] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:31.940253 29699 raft_consensus.cc:385] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.940538 29699 raft_consensus.cc:740] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09697c1884894b978e52204f376025c8, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.941246 29699 consensus_queue.cc:260] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 09697c1884894b978e52204f376025c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:31.942086 29698 raft_consensus.cc:359] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:31.942829 29698 raft_consensus.cc:385] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:31.943151 29698 raft_consensus.cc:740] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514542813d154b618edd53dfb5344a50, State: Initialized, Role: FOLLOWER
I20260709 13:09:31.897810 29697 consensus_queue.cc:260] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:31.943960 29698 consensus_queue.cc:260] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:31.946156 29699 ts_tablet_manager.cc:1434] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 09697c1884894b978e52204f376025c8: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.001s
I20260709 13:09:31.947082 29699 tablet_bootstrap.cc:492] T 614a388092724f85b0d98362099dc41a P 09697c1884894b978e52204f376025c8: Bootstrap starting.
I20260709 13:09:31.947432 29697 ts_tablet_manager.cc:1434] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.000s
I20260709 13:09:31.948390 29697 tablet_bootstrap.cc:492] T 6ed5e4177a61445f9768305d4c6867da P 6d0b0542874c4b8798bf338303235c61: Bootstrap starting.
I20260709 13:09:31.951745 29508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823db933ae2c4c51a5321bbbd7b53f2c" candidate_uuid: "514542813d154b618edd53dfb5344a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d0b0542874c4b8798bf338303235c61"
I20260709 13:09:31.952316 29508 raft_consensus.cc:3060] T 823db933ae2c4c51a5321bbbd7b53f2c P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:31.957305 29583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "614a388092724f85b0d98362099dc41a" candidate_uuid: "6d0b0542874c4b8798bf338303235c61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09697c1884894b978e52204f376025c8" is_pre_election: true
I20260709 13:09:31.957960 29699 tablet_bootstrap.cc:654] T 614a388092724f85b0d98362099dc41a P 09697c1884894b978e52204f376025c8: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:31.958940 29471 leader_election.cc:343] T 614a388092724f85b0d98362099dc41a P 6d0b0542874c4b8798bf338303235c61 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09697c1884894b978e52204f376025c8 (127.28.54.66:35555): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:31.961407 29698 ts_tablet_manager.cc:1434] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:09:31.962370 29724 raft_consensus.cc:493] T 6ed5e4177a61445f9768305d4c6867da P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.962484 29698 tablet_bootstrap.cc:492] T f5aee951cde24997a61edbc434b816bb P 514542813d154b618edd53dfb5344a50: Bootstrap starting.
I20260709 13:09:31.962806 29724 raft_consensus.cc:515] T 6ed5e4177a61445f9768305d4c6867da P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:31.968291 29724 leader_election.cc:290] T 6ed5e4177a61445f9768305d4c6867da P 514542813d154b618edd53dfb5344a50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d0b0542874c4b8798bf338303235c61 (127.28.54.65:33255), 09697c1884894b978e52204f376025c8 (127.28.54.66:35555)
I20260709 13:09:31.965394 29508 raft_consensus.cc:2468] T 823db933ae2c4c51a5321bbbd7b53f2c P 6d0b0542874c4b8798bf338303235c61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514542813d154b618edd53dfb5344a50 in term 1.
I20260709 13:09:31.969992 29507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed5e4177a61445f9768305d4c6867da" candidate_uuid: "514542813d154b618edd53dfb5344a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d0b0542874c4b8798bf338303235c61" is_pre_election: true
I20260709 13:09:31.970965 29622 leader_election.cc:304] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514542813d154b618edd53dfb5344a50, 6d0b0542874c4b8798bf338303235c61; no voters: 
W20260709 13:09:31.971807 29622 leader_election.cc:343] T 6ed5e4177a61445f9768305d4c6867da P 514542813d154b618edd53dfb5344a50 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d0b0542874c4b8798bf338303235c61 (127.28.54.65:33255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:31.973042 29702 leader_election.cc:290] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50 [CANDIDATE]: Term 1 election: Requested vote from peers 6d0b0542874c4b8798bf338303235c61 (127.28.54.65:33255), 09697c1884894b978e52204f376025c8 (127.28.54.66:35555)
I20260709 13:09:31.973457 29702 raft_consensus.cc:2804] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:31.973804 29702 raft_consensus.cc:697] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50 [term 1 LEADER]: Becoming Leader. State: Replica: 514542813d154b618edd53dfb5344a50, State: Running, Role: LEADER
I20260709 13:09:31.974387 29702 consensus_queue.cc:237] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:31.974890 29698 tablet_bootstrap.cc:654] T f5aee951cde24997a61edbc434b816bb P 514542813d154b618edd53dfb5344a50: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:31.974975 29703 raft_consensus.cc:493] T 3e81245af96d4b4b810319574acf129c P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.975543 29703 raft_consensus.cc:515] T 3e81245af96d4b4b810319574acf129c P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:31.977384 29703 leader_election.cc:290] T 3e81245af96d4b4b810319574acf129c P 6d0b0542874c4b8798bf338303235c61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09697c1884894b978e52204f376025c8 (127.28.54.66:35555), 514542813d154b618edd53dfb5344a50 (127.28.54.67:34839)
I20260709 13:09:31.977514 29708 raft_consensus.cc:493] T 6ed5e4177a61445f9768305d4c6867da P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.977836 29703 raft_consensus.cc:493] T 3800273f9bb44c2ca39bf63aa681fe6c P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:31.977989 29708 raft_consensus.cc:515] T 6ed5e4177a61445f9768305d4c6867da P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:31.978256 29703 raft_consensus.cc:515] T 3800273f9bb44c2ca39bf63aa681fe6c P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } }
I20260709 13:09:31.979983 29703 leader_election.cc:290] T 3800273f9bb44c2ca39bf63aa681fe6c P 6d0b0542874c4b8798bf338303235c61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 514542813d154b618edd53dfb5344a50 (127.28.54.67:34839), 09697c1884894b978e52204f376025c8 (127.28.54.66:35555)
I20260709 13:09:31.980430 29708 leader_election.cc:290] T 6ed5e4177a61445f9768305d4c6867da P 09697c1884894b978e52204f376025c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d0b0542874c4b8798bf338303235c61 (127.28.54.65:33255), 514542813d154b618edd53dfb5344a50 (127.28.54.67:34839)
I20260709 13:09:31.982561 29583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e81245af96d4b4b810319574acf129c" candidate_uuid: "6d0b0542874c4b8798bf338303235c61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09697c1884894b978e52204f376025c8" is_pre_election: true
I20260709 13:09:31.983196 29583 raft_consensus.cc:2468] T 3e81245af96d4b4b810319574acf129c P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d0b0542874c4b8798bf338303235c61 in term 0.
I20260709 13:09:31.985163 29471 leader_election.cc:304] T 3e81245af96d4b4b810319574acf129c P 6d0b0542874c4b8798bf338303235c61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09697c1884894b978e52204f376025c8, 6d0b0542874c4b8798bf338303235c61; no voters: 
I20260709 13:09:31.986657 29583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3800273f9bb44c2ca39bf63aa681fe6c" candidate_uuid: "6d0b0542874c4b8798bf338303235c61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09697c1884894b978e52204f376025c8" is_pre_election: true
I20260709 13:09:31.987260 29583 raft_consensus.cc:2468] T 3800273f9bb44c2ca39bf63aa681fe6c P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d0b0542874c4b8798bf338303235c61 in term 0.
I20260709 13:09:31.988552 29471 leader_election.cc:304] T 3800273f9bb44c2ca39bf63aa681fe6c P 6d0b0542874c4b8798bf338303235c61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09697c1884894b978e52204f376025c8, 6d0b0542874c4b8798bf338303235c61; no voters: 
I20260709 13:09:31.989480 29703 raft_consensus.cc:2804] T 3e81245af96d4b4b810319574acf129c P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:31.989907 29703 raft_consensus.cc:493] T 3e81245af96d4b4b810319574acf129c P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:31.990306 29703 raft_consensus.cc:3060] T 3e81245af96d4b4b810319574acf129c P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:31.997830 29703 raft_consensus.cc:515] T 3e81245af96d4b4b810319574acf129c P 6d0b0542874c4b8798bf338303235c61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
W20260709 13:09:32.000020 29454 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:32.000555 29583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e81245af96d4b4b810319574acf129c" candidate_uuid: "6d0b0542874c4b8798bf338303235c61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09697c1884894b978e52204f376025c8"
I20260709 13:09:32.001080 29583 raft_consensus.cc:3060] T 3e81245af96d4b4b810319574acf129c P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.001358 29582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed5e4177a61445f9768305d4c6867da" candidate_uuid: "514542813d154b618edd53dfb5344a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09697c1884894b978e52204f376025c8" is_pre_election: true
I20260709 13:09:32.002135 29582 raft_consensus.cc:2468] T 6ed5e4177a61445f9768305d4c6867da P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514542813d154b618edd53dfb5344a50 in term 0.
I20260709 13:09:32.003501 29582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823db933ae2c4c51a5321bbbd7b53f2c" candidate_uuid: "514542813d154b618edd53dfb5344a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09697c1884894b978e52204f376025c8"
I20260709 13:09:32.005986 29657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "614a388092724f85b0d98362099dc41a" candidate_uuid: "6d0b0542874c4b8798bf338303235c61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514542813d154b618edd53dfb5344a50" is_pre_election: true
I20260709 13:09:32.006616 29657 raft_consensus.cc:2468] T 614a388092724f85b0d98362099dc41a P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d0b0542874c4b8798bf338303235c61 in term 0.
I20260709 13:09:32.007684 29656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e81245af96d4b4b810319574acf129c" candidate_uuid: "6d0b0542874c4b8798bf338303235c61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514542813d154b618edd53dfb5344a50" is_pre_election: true
I20260709 13:09:32.008081 29727 raft_consensus.cc:2804] T 3800273f9bb44c2ca39bf63aa681fe6c P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:32.008358 29656 raft_consensus.cc:2468] T 3e81245af96d4b4b810319574acf129c P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d0b0542874c4b8798bf338303235c61 in term 0.
I20260709 13:09:32.008343 29583 raft_consensus.cc:2468] T 3e81245af96d4b4b810319574acf129c P 09697c1884894b978e52204f376025c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d0b0542874c4b8798bf338303235c61 in term 1.
I20260709 13:09:32.010776 29471 leader_election.cc:304] T 3e81245af96d4b4b810319574acf129c P 6d0b0542874c4b8798bf338303235c61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09697c1884894b978e52204f376025c8, 6d0b0542874c4b8798bf338303235c61; no voters: 
I20260709 13:09:32.011507 29656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3800273f9bb44c2ca39bf63aa681fe6c" candidate_uuid: "6d0b0542874c4b8798bf338303235c61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514542813d154b618edd53dfb5344a50" is_pre_election: true
I20260709 13:09:32.012144 29656 raft_consensus.cc:2468] T 3800273f9bb44c2ca39bf63aa681fe6c P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d0b0542874c4b8798bf338303235c61 in term 0.
I20260709 13:09:32.013046 29620 leader_election.cc:304] T 6ed5e4177a61445f9768305d4c6867da P 514542813d154b618edd53dfb5344a50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09697c1884894b978e52204f376025c8, 514542813d154b618edd53dfb5344a50; no voters: 6d0b0542874c4b8798bf338303235c61
W20260709 13:09:32.014312 29620 leader_election.cc:343] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 09697c1884894b978e52204f376025c8 (127.28.54.66:35555): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:32.015522 29474 leader_election.cc:304] T 614a388092724f85b0d98362099dc41a P 6d0b0542874c4b8798bf338303235c61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 514542813d154b618edd53dfb5344a50, 6d0b0542874c4b8798bf338303235c61; no voters: 09697c1884894b978e52204f376025c8
I20260709 13:09:32.015849 29725 raft_consensus.cc:2804] T 6ed5e4177a61445f9768305d4c6867da P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:32.016206 29725 raft_consensus.cc:493] T 6ed5e4177a61445f9768305d4c6867da P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.016512 29725 raft_consensus.cc:3060] T 6ed5e4177a61445f9768305d4c6867da P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.008466 29727 raft_consensus.cc:493] T 3800273f9bb44c2ca39bf63aa681fe6c P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.018816 29727 raft_consensus.cc:3060] T 3800273f9bb44c2ca39bf63aa681fe6c P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.041309 29734 raft_consensus.cc:2804] T 3e81245af96d4b4b810319574acf129c P 6d0b0542874c4b8798bf338303235c61 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:32.044791 29725 raft_consensus.cc:515] T 6ed5e4177a61445f9768305d4c6867da P 514542813d154b618edd53dfb5344a50 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:32.047842 29697 tablet_bootstrap.cc:654] T 6ed5e4177a61445f9768305d4c6867da P 6d0b0542874c4b8798bf338303235c61: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:32.058969 29698 tablet_bootstrap.cc:492] T f5aee951cde24997a61edbc434b816bb P 514542813d154b618edd53dfb5344a50: No bootstrap required, opened a new log
I20260709 13:09:32.058792 29656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e81245af96d4b4b810319574acf129c" candidate_uuid: "6d0b0542874c4b8798bf338303235c61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514542813d154b618edd53dfb5344a50"
I20260709 13:09:32.055927 29703 leader_election.cc:290] T 3e81245af96d4b4b810319574acf129c P 6d0b0542874c4b8798bf338303235c61 [CANDIDATE]: Term 1 election: Requested vote from peers 09697c1884894b978e52204f376025c8 (127.28.54.66:35555), 514542813d154b618edd53dfb5344a50 (127.28.54.67:34839)
I20260709 13:09:32.059428 29698 ts_tablet_manager.cc:1403] T f5aee951cde24997a61edbc434b816bb P 514542813d154b618edd53dfb5344a50: Time spent bootstrapping tablet: real 0.097s	user 0.008s	sys 0.014s
I20260709 13:09:32.059384 29656 raft_consensus.cc:3060] T 3e81245af96d4b4b810319574acf129c P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.062510 29508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed5e4177a61445f9768305d4c6867da" candidate_uuid: "514542813d154b618edd53dfb5344a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d0b0542874c4b8798bf338303235c61"
W20260709 13:09:32.054593 29471 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:35555, user_credentials={real_user=slave}} blocked reactor thread for 43884.4us
I20260709 13:09:32.066766 29733 raft_consensus.cc:2804] T 614a388092724f85b0d98362099dc41a P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:32.067502 29733 raft_consensus.cc:493] T 614a388092724f85b0d98362099dc41a P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.062359 29725 leader_election.cc:290] T 6ed5e4177a61445f9768305d4c6867da P 514542813d154b618edd53dfb5344a50 [CANDIDATE]: Term 1 election: Requested vote from peers 6d0b0542874c4b8798bf338303235c61 (127.28.54.65:33255), 09697c1884894b978e52204f376025c8 (127.28.54.66:35555)
I20260709 13:09:32.068077 29583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed5e4177a61445f9768305d4c6867da" candidate_uuid: "514542813d154b618edd53dfb5344a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09697c1884894b978e52204f376025c8"
I20260709 13:09:32.068667 29583 raft_consensus.cc:3060] T 6ed5e4177a61445f9768305d4c6867da P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.068821 29657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed5e4177a61445f9768305d4c6867da" candidate_uuid: "09697c1884894b978e52204f376025c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514542813d154b618edd53dfb5344a50" is_pre_election: true
I20260709 13:09:32.069427 29699 tablet_bootstrap.cc:492] T 614a388092724f85b0d98362099dc41a P 09697c1884894b978e52204f376025c8: No bootstrap required, opened a new log
I20260709 13:09:32.069619 29657 raft_consensus.cc:2393] T 6ed5e4177a61445f9768305d4c6867da P 514542813d154b618edd53dfb5344a50 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09697c1884894b978e52204f376025c8 in current term 1: Already voted for candidate 514542813d154b618edd53dfb5344a50 in this term.
W20260709 13:09:32.068089 29622 leader_election.cc:343] T 6ed5e4177a61445f9768305d4c6867da P 514542813d154b618edd53dfb5344a50 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d0b0542874c4b8798bf338303235c61 (127.28.54.65:33255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:32.069934 29699 ts_tablet_manager.cc:1403] T 614a388092724f85b0d98362099dc41a P 09697c1884894b978e52204f376025c8: Time spent bootstrapping tablet: real 0.123s	user 0.046s	sys 0.054s
I20260709 13:09:32.072412 29703 raft_consensus.cc:493] T 9ff797420926444ab55e3a79c683f7dc P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.074546 29698 raft_consensus.cc:359] T f5aee951cde24997a61edbc434b816bb P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:32.073975 29656 raft_consensus.cc:2468] T 3e81245af96d4b4b810319574acf129c P 514542813d154b618edd53dfb5344a50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d0b0542874c4b8798bf338303235c61 in term 1.
I20260709 13:09:32.069167 29403 catalog_manager.cc:5697] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50 reported cstate change: term changed from 0 to 1, leader changed from <none> to 514542813d154b618edd53dfb5344a50 (127.28.54.67). New cstate: current_term: 1 leader_uuid: "514542813d154b618edd53dfb5344a50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:32.074640 29733 raft_consensus.cc:3060] T 614a388092724f85b0d98362099dc41a P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.076395 29698 raft_consensus.cc:385] T f5aee951cde24997a61edbc434b816bb P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.076874 29698 raft_consensus.cc:740] T f5aee951cde24997a61edbc434b816bb P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514542813d154b618edd53dfb5344a50, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.075112 29703 raft_consensus.cc:515] T 9ff797420926444ab55e3a79c683f7dc P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:32.083455 29727 raft_consensus.cc:515] T 3800273f9bb44c2ca39bf63aa681fe6c P 6d0b0542874c4b8798bf338303235c61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } }
I20260709 13:09:32.085777 29583 raft_consensus.cc:2468] T 6ed5e4177a61445f9768305d4c6867da P 09697c1884894b978e52204f376025c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514542813d154b618edd53dfb5344a50 in term 1.
I20260709 13:09:32.087175 29620 leader_election.cc:304] T 6ed5e4177a61445f9768305d4c6867da P 514542813d154b618edd53dfb5344a50 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09697c1884894b978e52204f376025c8, 514542813d154b618edd53dfb5344a50; no voters: 6d0b0542874c4b8798bf338303235c61
I20260709 13:09:32.088258 29703 leader_election.cc:290] T 9ff797420926444ab55e3a79c683f7dc P 6d0b0542874c4b8798bf338303235c61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09697c1884894b978e52204f376025c8 (127.28.54.66:35555), 514542813d154b618edd53dfb5344a50 (127.28.54.67:34839)
I20260709 13:09:32.088651 29725 raft_consensus.cc:2804] T 6ed5e4177a61445f9768305d4c6867da P 514542813d154b618edd53dfb5344a50 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:32.089196 29725 raft_consensus.cc:697] T 6ed5e4177a61445f9768305d4c6867da P 514542813d154b618edd53dfb5344a50 [term 1 LEADER]: Becoming Leader. State: Replica: 514542813d154b618edd53dfb5344a50, State: Running, Role: LEADER
I20260709 13:09:32.090014 29725 consensus_queue.cc:237] T 6ed5e4177a61445f9768305d4c6867da P 514542813d154b618edd53dfb5344a50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:32.091334 29699 raft_consensus.cc:359] T 614a388092724f85b0d98362099dc41a P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:32.092109 29699 raft_consensus.cc:385] T 614a388092724f85b0d98362099dc41a P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.092415 29699 raft_consensus.cc:740] T 614a388092724f85b0d98362099dc41a P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09697c1884894b978e52204f376025c8, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.093461 29657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff797420926444ab55e3a79c683f7dc" candidate_uuid: "6d0b0542874c4b8798bf338303235c61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514542813d154b618edd53dfb5344a50" is_pre_election: true
I20260709 13:09:32.087659 29698 consensus_queue.cc:260] T f5aee951cde24997a61edbc434b816bb P 514542813d154b618edd53dfb5344a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
W20260709 13:09:32.095105 29474 leader_election.cc:343] T 9ff797420926444ab55e3a79c683f7dc P 6d0b0542874c4b8798bf338303235c61 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 514542813d154b618edd53dfb5344a50 (127.28.54.67:34839): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:32.096024 29698 ts_tablet_manager.cc:1434] T f5aee951cde24997a61edbc434b816bb P 514542813d154b618edd53dfb5344a50: Time spent starting tablet: real 0.033s	user 0.003s	sys 0.002s
I20260709 13:09:32.097072 29698 tablet_bootstrap.cc:492] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 514542813d154b618edd53dfb5344a50: Bootstrap starting.
I20260709 13:09:32.099467 29583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff797420926444ab55e3a79c683f7dc" candidate_uuid: "6d0b0542874c4b8798bf338303235c61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09697c1884894b978e52204f376025c8" is_pre_election: true
I20260709 13:09:32.093303 29699 consensus_queue.cc:260] T 614a388092724f85b0d98362099dc41a P 09697c1884894b978e52204f376025c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:32.100566 29734 raft_consensus.cc:697] T 3e81245af96d4b4b810319574acf129c P 6d0b0542874c4b8798bf338303235c61 [term 1 LEADER]: Becoming Leader. State: Replica: 6d0b0542874c4b8798bf338303235c61, State: Running, Role: LEADER
I20260709 13:09:32.102757 29656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3800273f9bb44c2ca39bf63aa681fe6c" candidate_uuid: "6d0b0542874c4b8798bf338303235c61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514542813d154b618edd53dfb5344a50"
I20260709 13:09:32.108695 29582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3800273f9bb44c2ca39bf63aa681fe6c" candidate_uuid: "6d0b0542874c4b8798bf338303235c61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09697c1884894b978e52204f376025c8"
I20260709 13:09:32.108866 29508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed5e4177a61445f9768305d4c6867da" candidate_uuid: "09697c1884894b978e52204f376025c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d0b0542874c4b8798bf338303235c61" is_pre_election: true
I20260709 13:09:32.109238 29582 raft_consensus.cc:3060] T 3800273f9bb44c2ca39bf63aa681fe6c P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.110092 29727 leader_election.cc:290] T 3800273f9bb44c2ca39bf63aa681fe6c P 6d0b0542874c4b8798bf338303235c61 [CANDIDATE]: Term 1 election: Requested vote from peers 514542813d154b618edd53dfb5344a50 (127.28.54.67:34839), 09697c1884894b978e52204f376025c8 (127.28.54.66:35555)
W20260709 13:09:32.110481 29548 leader_election.cc:343] T 6ed5e4177a61445f9768305d4c6867da P 09697c1884894b978e52204f376025c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d0b0542874c4b8798bf338303235c61 (127.28.54.65:33255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:32.110909 29548 leader_election.cc:304] T 6ed5e4177a61445f9768305d4c6867da P 09697c1884894b978e52204f376025c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09697c1884894b978e52204f376025c8; no voters: 514542813d154b618edd53dfb5344a50, 6d0b0542874c4b8798bf338303235c61
I20260709 13:09:32.111704 29708 raft_consensus.cc:2749] T 6ed5e4177a61445f9768305d4c6867da P 09697c1884894b978e52204f376025c8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:32.112416 29471 leader_election.cc:343] T 9ff797420926444ab55e3a79c683f7dc P 6d0b0542874c4b8798bf338303235c61 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 09697c1884894b978e52204f376025c8 (127.28.54.66:35555): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:32.106653 29699 ts_tablet_manager.cc:1434] T 614a388092724f85b0d98362099dc41a P 09697c1884894b978e52204f376025c8: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.001s
I20260709 13:09:32.114279 29699 tablet_bootstrap.cc:492] T e40d52b3e84c41148660cbdc2101d793 P 09697c1884894b978e52204f376025c8: Bootstrap starting.
I20260709 13:09:32.113837 29471 leader_election.cc:304] T 9ff797420926444ab55e3a79c683f7dc P 6d0b0542874c4b8798bf338303235c61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d0b0542874c4b8798bf338303235c61; no voters: 09697c1884894b978e52204f376025c8, 514542813d154b618edd53dfb5344a50
I20260709 13:09:32.115290 29727 raft_consensus.cc:2749] T 9ff797420926444ab55e3a79c683f7dc P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:32.119966 29698 tablet_bootstrap.cc:654] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 514542813d154b618edd53dfb5344a50: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:32.120213 29582 raft_consensus.cc:2468] T 3800273f9bb44c2ca39bf63aa681fe6c P 09697c1884894b978e52204f376025c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d0b0542874c4b8798bf338303235c61 in term 1.
I20260709 13:09:32.121232 29471 leader_election.cc:304] T 3800273f9bb44c2ca39bf63aa681fe6c P 6d0b0542874c4b8798bf338303235c61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09697c1884894b978e52204f376025c8, 6d0b0542874c4b8798bf338303235c61; no voters: 
I20260709 13:09:32.122154 29727 raft_consensus.cc:2804] T 3800273f9bb44c2ca39bf63aa681fe6c P 6d0b0542874c4b8798bf338303235c61 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:32.106993 29656 raft_consensus.cc:3060] T 3800273f9bb44c2ca39bf63aa681fe6c P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.104260 29734 consensus_queue.cc:237] T 3e81245af96d4b4b810319574acf129c P 6d0b0542874c4b8798bf338303235c61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:32.125279 29702 raft_consensus.cc:493] T f5aee951cde24997a61edbc434b816bb P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.125799 29702 raft_consensus.cc:515] T f5aee951cde24997a61edbc434b816bb P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:32.127940 29702 leader_election.cc:290] T f5aee951cde24997a61edbc434b816bb P 514542813d154b618edd53dfb5344a50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d0b0542874c4b8798bf338303235c61 (127.28.54.65:33255), 09697c1884894b978e52204f376025c8 (127.28.54.66:35555)
I20260709 13:09:32.122583 29727 raft_consensus.cc:697] T 3800273f9bb44c2ca39bf63aa681fe6c P 6d0b0542874c4b8798bf338303235c61 [term 1 LEADER]: Becoming Leader. State: Replica: 6d0b0542874c4b8798bf338303235c61, State: Running, Role: LEADER
I20260709 13:09:32.129590 29508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aee951cde24997a61edbc434b816bb" candidate_uuid: "514542813d154b618edd53dfb5344a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d0b0542874c4b8798bf338303235c61" is_pre_election: true
I20260709 13:09:32.130597 29727 consensus_queue.cc:237] T 3800273f9bb44c2ca39bf63aa681fe6c P 6d0b0542874c4b8798bf338303235c61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } }
I20260709 13:09:32.132236 29697 tablet_bootstrap.cc:492] T 6ed5e4177a61445f9768305d4c6867da P 6d0b0542874c4b8798bf338303235c61: No bootstrap required, opened a new log
W20260709 13:09:32.132428 29622 leader_election.cc:343] T f5aee951cde24997a61edbc434b816bb P 514542813d154b618edd53dfb5344a50 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d0b0542874c4b8798bf338303235c61 (127.28.54.65:33255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:32.132763 29697 ts_tablet_manager.cc:1403] T 6ed5e4177a61445f9768305d4c6867da P 6d0b0542874c4b8798bf338303235c61: Time spent bootstrapping tablet: real 0.185s	user 0.020s	sys 0.025s
I20260709 13:09:32.136597 29733 raft_consensus.cc:515] T 614a388092724f85b0d98362099dc41a P 6d0b0542874c4b8798bf338303235c61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:32.134994 29582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aee951cde24997a61edbc434b816bb" candidate_uuid: "514542813d154b618edd53dfb5344a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09697c1884894b978e52204f376025c8" is_pre_election: true
I20260709 13:09:32.139928 29699 tablet_bootstrap.cc:654] T e40d52b3e84c41148660cbdc2101d793 P 09697c1884894b978e52204f376025c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:32.139228 29582 raft_consensus.cc:2468] T f5aee951cde24997a61edbc434b816bb P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514542813d154b618edd53dfb5344a50 in term 0.
I20260709 13:09:32.135337 29656 raft_consensus.cc:2468] T 3800273f9bb44c2ca39bf63aa681fe6c P 514542813d154b618edd53dfb5344a50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d0b0542874c4b8798bf338303235c61 in term 1.
I20260709 13:09:32.150768 29620 leader_election.cc:304] T f5aee951cde24997a61edbc434b816bb P 514542813d154b618edd53dfb5344a50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09697c1884894b978e52204f376025c8, 514542813d154b618edd53dfb5344a50; no voters: 6d0b0542874c4b8798bf338303235c61
I20260709 13:09:32.152740 29697 raft_consensus.cc:359] T 6ed5e4177a61445f9768305d4c6867da P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:32.153548 29697 raft_consensus.cc:385] T 6ed5e4177a61445f9768305d4c6867da P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.153899 29697 raft_consensus.cc:740] T 6ed5e4177a61445f9768305d4c6867da P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d0b0542874c4b8798bf338303235c61, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.154023 29698 tablet_bootstrap.cc:492] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 514542813d154b618edd53dfb5344a50: No bootstrap required, opened a new log
I20260709 13:09:32.154099 29582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "614a388092724f85b0d98362099dc41a" candidate_uuid: "6d0b0542874c4b8798bf338303235c61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09697c1884894b978e52204f376025c8"
I20260709 13:09:32.154500 29698 ts_tablet_manager.cc:1403] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 514542813d154b618edd53dfb5344a50: Time spent bootstrapping tablet: real 0.058s	user 0.011s	sys 0.012s
I20260709 13:09:32.154623 29733 leader_election.cc:290] T 614a388092724f85b0d98362099dc41a P 6d0b0542874c4b8798bf338303235c61 [CANDIDATE]: Term 1 election: Requested vote from peers 09697c1884894b978e52204f376025c8 (127.28.54.66:35555), 514542813d154b618edd53dfb5344a50 (127.28.54.67:34839)
I20260709 13:09:32.154696 29582 raft_consensus.cc:3060] T 614a388092724f85b0d98362099dc41a P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.154857 29656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "614a388092724f85b0d98362099dc41a" candidate_uuid: "6d0b0542874c4b8798bf338303235c61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514542813d154b618edd53dfb5344a50"
I20260709 13:09:32.152689 29725 raft_consensus.cc:2804] T f5aee951cde24997a61edbc434b816bb P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:32.155432 29656 raft_consensus.cc:3060] T 614a388092724f85b0d98362099dc41a P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.157045 29697 consensus_queue.cc:260] T 6ed5e4177a61445f9768305d4c6867da P 6d0b0542874c4b8798bf338303235c61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:32.157155 29698 raft_consensus.cc:359] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:32.155644 29725 raft_consensus.cc:493] T f5aee951cde24997a61edbc434b816bb P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.158008 29698 raft_consensus.cc:385] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.158215 29725 raft_consensus.cc:3060] T f5aee951cde24997a61edbc434b816bb P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.158416 29698 raft_consensus.cc:740] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514542813d154b618edd53dfb5344a50, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.159241 29698 consensus_queue.cc:260] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 514542813d154b618edd53dfb5344a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:32.159781 29699 tablet_bootstrap.cc:492] T e40d52b3e84c41148660cbdc2101d793 P 09697c1884894b978e52204f376025c8: No bootstrap required, opened a new log
I20260709 13:09:32.160245 29699 ts_tablet_manager.cc:1403] T e40d52b3e84c41148660cbdc2101d793 P 09697c1884894b978e52204f376025c8: Time spent bootstrapping tablet: real 0.047s	user 0.008s	sys 0.004s
I20260709 13:09:32.161478 29698 ts_tablet_manager.cc:1434] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 514542813d154b618edd53dfb5344a50: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:09:32.162415 29582 raft_consensus.cc:2468] T 614a388092724f85b0d98362099dc41a P 09697c1884894b978e52204f376025c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d0b0542874c4b8798bf338303235c61 in term 1.
I20260709 13:09:32.162689 29699 raft_consensus.cc:359] T e40d52b3e84c41148660cbdc2101d793 P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:32.162416 29698 tablet_bootstrap.cc:492] T e40d52b3e84c41148660cbdc2101d793 P 514542813d154b618edd53dfb5344a50: Bootstrap starting.
I20260709 13:09:32.163544 29699 raft_consensus.cc:385] T e40d52b3e84c41148660cbdc2101d793 P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.163576 29471 leader_election.cc:304] T 614a388092724f85b0d98362099dc41a P 6d0b0542874c4b8798bf338303235c61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09697c1884894b978e52204f376025c8, 6d0b0542874c4b8798bf338303235c61; no voters: 
I20260709 13:09:32.163930 29699 raft_consensus.cc:740] T e40d52b3e84c41148660cbdc2101d793 P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09697c1884894b978e52204f376025c8, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.164633 29727 raft_consensus.cc:2804] T 614a388092724f85b0d98362099dc41a P 6d0b0542874c4b8798bf338303235c61 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:32.164623 29699 consensus_queue.cc:260] T e40d52b3e84c41148660cbdc2101d793 P 09697c1884894b978e52204f376025c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:32.165211 29727 raft_consensus.cc:697] T 614a388092724f85b0d98362099dc41a P 6d0b0542874c4b8798bf338303235c61 [term 1 LEADER]: Becoming Leader. State: Replica: 6d0b0542874c4b8798bf338303235c61, State: Running, Role: LEADER
I20260709 13:09:32.166587 29697 ts_tablet_manager.cc:1434] T 6ed5e4177a61445f9768305d4c6867da P 6d0b0542874c4b8798bf338303235c61: Time spent starting tablet: real 0.033s	user 0.008s	sys 0.000s
I20260709 13:09:32.166242 29727 consensus_queue.cc:237] T 614a388092724f85b0d98362099dc41a P 6d0b0542874c4b8798bf338303235c61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:32.167161 29699 ts_tablet_manager.cc:1434] T e40d52b3e84c41148660cbdc2101d793 P 09697c1884894b978e52204f376025c8: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:09:32.168103 29699 tablet_bootstrap.cc:492] T 9ff797420926444ab55e3a79c683f7dc P 09697c1884894b978e52204f376025c8: Bootstrap starting.
I20260709 13:09:32.170287 29708 raft_consensus.cc:493] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.170728 29708 raft_consensus.cc:515] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:32.172735 29708 leader_election.cc:290] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 09697c1884894b978e52204f376025c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d0b0542874c4b8798bf338303235c61 (127.28.54.65:33255), 514542813d154b618edd53dfb5344a50 (127.28.54.67:34839)
I20260709 13:09:32.173318 29508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7dcb82d7c94558a8dc7cebafb0d7f8" candidate_uuid: "09697c1884894b978e52204f376025c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d0b0542874c4b8798bf338303235c61" is_pre_election: true
I20260709 13:09:32.173748 29657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7dcb82d7c94558a8dc7cebafb0d7f8" candidate_uuid: "09697c1884894b978e52204f376025c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514542813d154b618edd53dfb5344a50" is_pre_election: true
I20260709 13:09:32.173964 29508 raft_consensus.cc:2468] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09697c1884894b978e52204f376025c8 in term 0.
I20260709 13:09:32.174357 29657 raft_consensus.cc:2468] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09697c1884894b978e52204f376025c8 in term 0.
I20260709 13:09:32.175526 29548 leader_election.cc:304] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 09697c1884894b978e52204f376025c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09697c1884894b978e52204f376025c8, 6d0b0542874c4b8798bf338303235c61; no voters: 
I20260709 13:09:32.175904 29698 tablet_bootstrap.cc:654] T e40d52b3e84c41148660cbdc2101d793 P 514542813d154b618edd53dfb5344a50: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:32.167550 29697 tablet_bootstrap.cc:492] T f5aee951cde24997a61edbc434b816bb P 6d0b0542874c4b8798bf338303235c61: Bootstrap starting.
I20260709 13:09:32.177989 29708 raft_consensus.cc:2804] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:32.178335 29708 raft_consensus.cc:493] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.178668 29708 raft_consensus.cc:3060] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.179347 29734 raft_consensus.cc:493] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.183735 29404 catalog_manager.cc:5697] T 3e81245af96d4b4b810319574acf129c P 6d0b0542874c4b8798bf338303235c61 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d0b0542874c4b8798bf338303235c61 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "6d0b0542874c4b8798bf338303235c61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:32.184782 29734 raft_consensus.cc:515] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:32.189121 29697 tablet_bootstrap.cc:654] T f5aee951cde24997a61edbc434b816bb P 6d0b0542874c4b8798bf338303235c61: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:32.190775 29725 raft_consensus.cc:515] T f5aee951cde24997a61edbc434b816bb P 514542813d154b618edd53dfb5344a50 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:32.194924 29582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7dcb82d7c94558a8dc7cebafb0d7f8" candidate_uuid: "6d0b0542874c4b8798bf338303235c61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09697c1884894b978e52204f376025c8" is_pre_election: true
I20260709 13:09:32.196374 29657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7dcb82d7c94558a8dc7cebafb0d7f8" candidate_uuid: "6d0b0542874c4b8798bf338303235c61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514542813d154b618edd53dfb5344a50" is_pre_election: true
I20260709 13:09:32.196964 29657 raft_consensus.cc:2468] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d0b0542874c4b8798bf338303235c61 in term 0.
I20260709 13:09:32.198357 29474 leader_election.cc:304] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514542813d154b618edd53dfb5344a50, 6d0b0542874c4b8798bf338303235c61; no voters: 
I20260709 13:09:32.199311 29734 leader_election.cc:290] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09697c1884894b978e52204f376025c8 (127.28.54.66:35555), 514542813d154b618edd53dfb5344a50 (127.28.54.67:34839)
I20260709 13:09:32.200062 29708 raft_consensus.cc:515] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 09697c1884894b978e52204f376025c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:32.201345 29582 raft_consensus.cc:2393] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 09697c1884894b978e52204f376025c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d0b0542874c4b8798bf338303235c61 in current term 1: Already voted for candidate 09697c1884894b978e52204f376025c8 in this term.
I20260709 13:09:32.201953 29708 leader_election.cc:290] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 09697c1884894b978e52204f376025c8 [CANDIDATE]: Term 1 election: Requested vote from peers 6d0b0542874c4b8798bf338303235c61 (127.28.54.65:33255), 514542813d154b618edd53dfb5344a50 (127.28.54.67:34839)
I20260709 13:09:32.202929 29699 tablet_bootstrap.cc:654] T 9ff797420926444ab55e3a79c683f7dc P 09697c1884894b978e52204f376025c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:32.203902 29508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7dcb82d7c94558a8dc7cebafb0d7f8" candidate_uuid: "09697c1884894b978e52204f376025c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d0b0542874c4b8798bf338303235c61"
I20260709 13:09:32.206465 29657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7dcb82d7c94558a8dc7cebafb0d7f8" candidate_uuid: "09697c1884894b978e52204f376025c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514542813d154b618edd53dfb5344a50"
I20260709 13:09:32.206830 29727 raft_consensus.cc:2804] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:32.207753 29727 raft_consensus.cc:493] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.208079 29727 raft_consensus.cc:3060] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.206975 29657 raft_consensus.cc:3060] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.215149 29725 leader_election.cc:290] T f5aee951cde24997a61edbc434b816bb P 514542813d154b618edd53dfb5344a50 [CANDIDATE]: Term 1 election: Requested vote from peers 6d0b0542874c4b8798bf338303235c61 (127.28.54.65:33255), 09697c1884894b978e52204f376025c8 (127.28.54.66:35555)
I20260709 13:09:32.215939 29507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aee951cde24997a61edbc434b816bb" candidate_uuid: "514542813d154b618edd53dfb5344a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d0b0542874c4b8798bf338303235c61"
W20260709 13:09:32.220557 29622 leader_election.cc:343] T f5aee951cde24997a61edbc434b816bb P 514542813d154b618edd53dfb5344a50 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d0b0542874c4b8798bf338303235c61 (127.28.54.65:33255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:32.222470 29582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aee951cde24997a61edbc434b816bb" candidate_uuid: "514542813d154b618edd53dfb5344a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09697c1884894b978e52204f376025c8"
I20260709 13:09:32.223093 29582 raft_consensus.cc:3060] T f5aee951cde24997a61edbc434b816bb P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.243289 29656 raft_consensus.cc:2468] T 614a388092724f85b0d98362099dc41a P 514542813d154b618edd53dfb5344a50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d0b0542874c4b8798bf338303235c61 in term 1.
I20260709 13:09:32.245704 29582 raft_consensus.cc:2468] T f5aee951cde24997a61edbc434b816bb P 09697c1884894b978e52204f376025c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514542813d154b618edd53dfb5344a50 in term 1.
I20260709 13:09:32.248095 29620 leader_election.cc:304] T f5aee951cde24997a61edbc434b816bb P 514542813d154b618edd53dfb5344a50 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09697c1884894b978e52204f376025c8, 514542813d154b618edd53dfb5344a50; no voters: 6d0b0542874c4b8798bf338303235c61
I20260709 13:09:32.249270 29725 raft_consensus.cc:2804] T f5aee951cde24997a61edbc434b816bb P 514542813d154b618edd53dfb5344a50 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:32.251016 29725 raft_consensus.cc:697] T f5aee951cde24997a61edbc434b816bb P 514542813d154b618edd53dfb5344a50 [term 1 LEADER]: Becoming Leader. State: Replica: 514542813d154b618edd53dfb5344a50, State: Running, Role: LEADER
I20260709 13:09:32.258051 29727 raft_consensus.cc:515] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:32.262341 29508 raft_consensus.cc:2393] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 09697c1884894b978e52204f376025c8 in current term 1: Already voted for candidate 6d0b0542874c4b8798bf338303235c61 in this term.
I20260709 13:09:32.261896 29725 consensus_queue.cc:237] T f5aee951cde24997a61edbc434b816bb P 514542813d154b618edd53dfb5344a50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:32.263687 29699 tablet_bootstrap.cc:492] T 9ff797420926444ab55e3a79c683f7dc P 09697c1884894b978e52204f376025c8: No bootstrap required, opened a new log
I20260709 13:09:32.264145 29699 ts_tablet_manager.cc:1403] T 9ff797420926444ab55e3a79c683f7dc P 09697c1884894b978e52204f376025c8: Time spent bootstrapping tablet: real 0.096s	user 0.010s	sys 0.037s
I20260709 13:09:32.258556 29657 raft_consensus.cc:2468] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 514542813d154b618edd53dfb5344a50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09697c1884894b978e52204f376025c8 in term 1.
I20260709 13:09:32.264760 29656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7dcb82d7c94558a8dc7cebafb0d7f8" candidate_uuid: "6d0b0542874c4b8798bf338303235c61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514542813d154b618edd53dfb5344a50"
I20260709 13:09:32.265504 29656 raft_consensus.cc:2393] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 514542813d154b618edd53dfb5344a50 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 6d0b0542874c4b8798bf338303235c61 in current term 1: Already voted for candidate 09697c1884894b978e52204f376025c8 in this term.
I20260709 13:09:32.266279 29549 leader_election.cc:304] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 09697c1884894b978e52204f376025c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09697c1884894b978e52204f376025c8, 514542813d154b618edd53dfb5344a50; no voters: 
I20260709 13:09:32.267295 29708 raft_consensus.cc:2804] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 09697c1884894b978e52204f376025c8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:32.269160 29582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7dcb82d7c94558a8dc7cebafb0d7f8" candidate_uuid: "6d0b0542874c4b8798bf338303235c61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09697c1884894b978e52204f376025c8"
I20260709 13:09:32.269846 29727 leader_election.cc:290] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [CANDIDATE]: Term 1 election: Requested vote from peers 09697c1884894b978e52204f376025c8 (127.28.54.66:35555), 514542813d154b618edd53dfb5344a50 (127.28.54.67:34839)
I20260709 13:09:32.273306 29697 tablet_bootstrap.cc:492] T f5aee951cde24997a61edbc434b816bb P 6d0b0542874c4b8798bf338303235c61: No bootstrap required, opened a new log
I20260709 13:09:32.273712 29697 ts_tablet_manager.cc:1403] T f5aee951cde24997a61edbc434b816bb P 6d0b0542874c4b8798bf338303235c61: Time spent bootstrapping tablet: real 0.106s	user 0.014s	sys 0.008s
I20260709 13:09:32.273979 29698 tablet_bootstrap.cc:492] T e40d52b3e84c41148660cbdc2101d793 P 514542813d154b618edd53dfb5344a50: No bootstrap required, opened a new log
I20260709 13:09:32.274456 29698 ts_tablet_manager.cc:1403] T e40d52b3e84c41148660cbdc2101d793 P 514542813d154b618edd53dfb5344a50: Time spent bootstrapping tablet: real 0.112s	user 0.022s	sys 0.014s
I20260709 13:09:32.276114 29697 raft_consensus.cc:359] T f5aee951cde24997a61edbc434b816bb P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:32.276743 29697 raft_consensus.cc:385] T f5aee951cde24997a61edbc434b816bb P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.276932 29698 raft_consensus.cc:359] T e40d52b3e84c41148660cbdc2101d793 P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:32.277668 29698 raft_consensus.cc:385] T e40d52b3e84c41148660cbdc2101d793 P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.277948 29698 raft_consensus.cc:740] T e40d52b3e84c41148660cbdc2101d793 P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514542813d154b618edd53dfb5344a50, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.278585 29699 raft_consensus.cc:359] T 9ff797420926444ab55e3a79c683f7dc P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:32.278700 29698 consensus_queue.cc:260] T e40d52b3e84c41148660cbdc2101d793 P 514542813d154b618edd53dfb5344a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:32.279285 29699 raft_consensus.cc:385] T 9ff797420926444ab55e3a79c683f7dc P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.279560 29699 raft_consensus.cc:740] T 9ff797420926444ab55e3a79c683f7dc P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09697c1884894b978e52204f376025c8, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.280134 29699 consensus_queue.cc:260] T 9ff797420926444ab55e3a79c683f7dc P 09697c1884894b978e52204f376025c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:32.281040 29698 ts_tablet_manager.cc:1434] T e40d52b3e84c41148660cbdc2101d793 P 514542813d154b618edd53dfb5344a50: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:09:32.281992 29698 tablet_bootstrap.cc:492] T 9ff797420926444ab55e3a79c683f7dc P 514542813d154b618edd53dfb5344a50: Bootstrap starting.
I20260709 13:09:32.276922 29406 catalog_manager.cc:5697] T 614a388092724f85b0d98362099dc41a P 6d0b0542874c4b8798bf338303235c61 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d0b0542874c4b8798bf338303235c61 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "6d0b0542874c4b8798bf338303235c61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:32.283506 29406 catalog_manager.cc:5697] T 3800273f9bb44c2ca39bf63aa681fe6c P 6d0b0542874c4b8798bf338303235c61 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d0b0542874c4b8798bf338303235c61 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "6d0b0542874c4b8798bf338303235c61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:32.276983 29697 raft_consensus.cc:740] T f5aee951cde24997a61edbc434b816bb P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d0b0542874c4b8798bf338303235c61, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.288195 29698 tablet_bootstrap.cc:654] T 9ff797420926444ab55e3a79c683f7dc P 514542813d154b618edd53dfb5344a50: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:32.289541 29697 consensus_queue.cc:260] T f5aee951cde24997a61edbc434b816bb P 6d0b0542874c4b8798bf338303235c61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:32.296412 29697 ts_tablet_manager.cc:1434] T f5aee951cde24997a61edbc434b816bb P 6d0b0542874c4b8798bf338303235c61: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 13:09:32.297510 29697 tablet_bootstrap.cc:492] T e40d52b3e84c41148660cbdc2101d793 P 6d0b0542874c4b8798bf338303235c61: Bootstrap starting.
I20260709 13:09:32.299203 29698 tablet_bootstrap.cc:492] T 9ff797420926444ab55e3a79c683f7dc P 514542813d154b618edd53dfb5344a50: No bootstrap required, opened a new log
I20260709 13:09:32.299645 29698 ts_tablet_manager.cc:1403] T 9ff797420926444ab55e3a79c683f7dc P 514542813d154b618edd53dfb5344a50: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 13:09:32.302472 29698 raft_consensus.cc:359] T 9ff797420926444ab55e3a79c683f7dc P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:32.303118 29698 raft_consensus.cc:385] T 9ff797420926444ab55e3a79c683f7dc P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.303386 29698 raft_consensus.cc:740] T 9ff797420926444ab55e3a79c683f7dc P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 514542813d154b618edd53dfb5344a50, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.304293 29698 consensus_queue.cc:260] T 9ff797420926444ab55e3a79c683f7dc P 514542813d154b618edd53dfb5344a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:32.306555 29698 ts_tablet_manager.cc:1434] T 9ff797420926444ab55e3a79c683f7dc P 514542813d154b618edd53dfb5344a50: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 13:09:32.305897 29404 catalog_manager.cc:5697] T 6ed5e4177a61445f9768305d4c6867da P 514542813d154b618edd53dfb5344a50 reported cstate change: term changed from 0 to 1, leader changed from <none> to 514542813d154b618edd53dfb5344a50 (127.28.54.67). New cstate: current_term: 1 leader_uuid: "514542813d154b618edd53dfb5344a50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:32.313270 29751 raft_consensus.cc:493] T e7fed5eeb6124b1794e0b6c304994049 P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.313441 29725 raft_consensus.cc:493] T 9ff797420926444ab55e3a79c683f7dc P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.313745 29751 raft_consensus.cc:515] T e7fed5eeb6124b1794e0b6c304994049 P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:32.313987 29725 raft_consensus.cc:515] T 9ff797420926444ab55e3a79c683f7dc P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:32.316601 29508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fed5eeb6124b1794e0b6c304994049" candidate_uuid: "09697c1884894b978e52204f376025c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d0b0542874c4b8798bf338303235c61" is_pre_election: true
I20260709 13:09:32.317116 29507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff797420926444ab55e3a79c683f7dc" candidate_uuid: "514542813d154b618edd53dfb5344a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d0b0542874c4b8798bf338303235c61" is_pre_election: true
I20260709 13:09:32.317826 29507 raft_consensus.cc:2468] T 9ff797420926444ab55e3a79c683f7dc P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514542813d154b618edd53dfb5344a50 in term 0.
W20260709 13:09:32.318049 29548 leader_election.cc:343] T e7fed5eeb6124b1794e0b6c304994049 P 09697c1884894b978e52204f376025c8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d0b0542874c4b8798bf338303235c61 (127.28.54.65:33255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:32.317303 29702 raft_consensus.cc:493] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.319396 29708 raft_consensus.cc:697] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 09697c1884894b978e52204f376025c8 [term 1 LEADER]: Becoming Leader. State: Replica: 09697c1884894b978e52204f376025c8, State: Running, Role: LEADER
I20260709 13:09:32.319653 29583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff797420926444ab55e3a79c683f7dc" candidate_uuid: "514542813d154b618edd53dfb5344a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09697c1884894b978e52204f376025c8" is_pre_election: true
I20260709 13:09:32.319505 29702 raft_consensus.cc:515] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:32.319051 29725 leader_election.cc:290] T 9ff797420926444ab55e3a79c683f7dc P 514542813d154b618edd53dfb5344a50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d0b0542874c4b8798bf338303235c61 (127.28.54.65:33255), 09697c1884894b978e52204f376025c8 (127.28.54.66:35555)
I20260709 13:09:32.318933 29622 leader_election.cc:304] T 9ff797420926444ab55e3a79c683f7dc P 514542813d154b618edd53dfb5344a50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514542813d154b618edd53dfb5344a50, 6d0b0542874c4b8798bf338303235c61; no voters: 
I20260709 13:09:32.320245 29583 raft_consensus.cc:2468] T 9ff797420926444ab55e3a79c683f7dc P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514542813d154b618edd53dfb5344a50 in term 0.
I20260709 13:09:32.320746 29724 raft_consensus.cc:2804] T 9ff797420926444ab55e3a79c683f7dc P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:32.321066 29724 raft_consensus.cc:493] T 9ff797420926444ab55e3a79c683f7dc P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.321376 29724 raft_consensus.cc:3060] T 9ff797420926444ab55e3a79c683f7dc P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.321501 29702 leader_election.cc:290] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d0b0542874c4b8798bf338303235c61 (127.28.54.65:33255), 09697c1884894b978e52204f376025c8 (127.28.54.66:35555)
I20260709 13:09:32.322324 29751 leader_election.cc:290] T e7fed5eeb6124b1794e0b6c304994049 P 09697c1884894b978e52204f376025c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d0b0542874c4b8798bf338303235c61 (127.28.54.65:33255), 514542813d154b618edd53dfb5344a50 (127.28.54.67:34839)
I20260709 13:09:32.322654 29583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fed5eeb6124b1794e0b6c304994049" candidate_uuid: "514542813d154b618edd53dfb5344a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09697c1884894b978e52204f376025c8" is_pre_election: true
I20260709 13:09:32.323246 29583 raft_consensus.cc:2468] T e7fed5eeb6124b1794e0b6c304994049 P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514542813d154b618edd53dfb5344a50 in term 0.
I20260709 13:09:32.324045 29697 tablet_bootstrap.cc:654] T e40d52b3e84c41148660cbdc2101d793 P 6d0b0542874c4b8798bf338303235c61: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:32.324818 29620 leader_election.cc:304] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09697c1884894b978e52204f376025c8, 514542813d154b618edd53dfb5344a50; no voters: 
I20260709 13:09:32.325855 29507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fed5eeb6124b1794e0b6c304994049" candidate_uuid: "514542813d154b618edd53dfb5344a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d0b0542874c4b8798bf338303235c61" is_pre_election: true
I20260709 13:09:32.325976 29657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fed5eeb6124b1794e0b6c304994049" candidate_uuid: "09697c1884894b978e52204f376025c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514542813d154b618edd53dfb5344a50" is_pre_election: true
I20260709 13:09:32.326493 29657 raft_consensus.cc:2468] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09697c1884894b978e52204f376025c8 in term 0.
W20260709 13:09:32.327152 29622 leader_election.cc:343] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6d0b0542874c4b8798bf338303235c61 (127.28.54.65:33255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:32.327651 29549 leader_election.cc:304] T e7fed5eeb6124b1794e0b6c304994049 P 09697c1884894b978e52204f376025c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 09697c1884894b978e52204f376025c8, 514542813d154b618edd53dfb5344a50; no voters: 6d0b0542874c4b8798bf338303235c61
I20260709 13:09:32.327981 29702 raft_consensus.cc:2804] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:32.328330 29702 raft_consensus.cc:493] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.328447 29751 raft_consensus.cc:2804] T e7fed5eeb6124b1794e0b6c304994049 P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:32.328678 29702 raft_consensus.cc:3060] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.328843 29751 raft_consensus.cc:493] T e7fed5eeb6124b1794e0b6c304994049 P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.329365 29751 raft_consensus.cc:3060] T e7fed5eeb6124b1794e0b6c304994049 P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.331259 29699 ts_tablet_manager.cc:1434] T 9ff797420926444ab55e3a79c683f7dc P 09697c1884894b978e52204f376025c8: Time spent starting tablet: real 0.067s	user 0.006s	sys 0.016s
I20260709 13:09:32.331804 29724 raft_consensus.cc:515] T 9ff797420926444ab55e3a79c683f7dc P 514542813d154b618edd53dfb5344a50 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:32.332180 29699 tablet_bootstrap.cc:492] T 823db933ae2c4c51a5321bbbd7b53f2c P 09697c1884894b978e52204f376025c8: Bootstrap starting.
I20260709 13:09:32.335302 29702 raft_consensus.cc:515] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:32.336472 29751 raft_consensus.cc:515] T e7fed5eeb6124b1794e0b6c304994049 P 09697c1884894b978e52204f376025c8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:32.337182 29724 leader_election.cc:290] T 9ff797420926444ab55e3a79c683f7dc P 514542813d154b618edd53dfb5344a50 [CANDIDATE]: Term 1 election: Requested vote from peers 6d0b0542874c4b8798bf338303235c61 (127.28.54.65:33255), 09697c1884894b978e52204f376025c8 (127.28.54.66:35555)
I20260709 13:09:32.320245 29708 consensus_queue.cc:237] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 09697c1884894b978e52204f376025c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:32.338835 29507 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fed5eeb6124b1794e0b6c304994049" candidate_uuid: "514542813d154b618edd53dfb5344a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d0b0542874c4b8798bf338303235c61"
I20260709 13:09:32.339354 29506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fed5eeb6124b1794e0b6c304994049" candidate_uuid: "09697c1884894b978e52204f376025c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d0b0542874c4b8798bf338303235c61"
I20260709 13:09:32.339936 29508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff797420926444ab55e3a79c683f7dc" candidate_uuid: "514542813d154b618edd53dfb5344a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d0b0542874c4b8798bf338303235c61"
I20260709 13:09:32.339447 29404 catalog_manager.cc:5697] T f5aee951cde24997a61edbc434b816bb P 514542813d154b618edd53dfb5344a50 reported cstate change: term changed from 0 to 1, leader changed from <none> to 514542813d154b618edd53dfb5344a50 (127.28.54.67). New cstate: current_term: 1 leader_uuid: "514542813d154b618edd53dfb5344a50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:32.340461 29508 raft_consensus.cc:3060] T 9ff797420926444ab55e3a79c683f7dc P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:32.340863 29548 leader_election.cc:343] T e7fed5eeb6124b1794e0b6c304994049 P 09697c1884894b978e52204f376025c8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d0b0542874c4b8798bf338303235c61 (127.28.54.65:33255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:32.342686 29583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff797420926444ab55e3a79c683f7dc" candidate_uuid: "514542813d154b618edd53dfb5344a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09697c1884894b978e52204f376025c8"
I20260709 13:09:32.342988 29657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fed5eeb6124b1794e0b6c304994049" candidate_uuid: "09697c1884894b978e52204f376025c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514542813d154b618edd53dfb5344a50"
I20260709 13:09:32.343290 29583 raft_consensus.cc:3060] T 9ff797420926444ab55e3a79c683f7dc P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.343816 29657 raft_consensus.cc:2393] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 09697c1884894b978e52204f376025c8 in current term 1: Already voted for candidate 514542813d154b618edd53dfb5344a50 in this term.
I20260709 13:09:32.344908 29549 leader_election.cc:304] T e7fed5eeb6124b1794e0b6c304994049 P 09697c1884894b978e52204f376025c8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09697c1884894b978e52204f376025c8; no voters: 514542813d154b618edd53dfb5344a50, 6d0b0542874c4b8798bf338303235c61
I20260709 13:09:32.345794 29753 raft_consensus.cc:2749] T e7fed5eeb6124b1794e0b6c304994049 P 09697c1884894b978e52204f376025c8 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:32.346858 29751 leader_election.cc:290] T e7fed5eeb6124b1794e0b6c304994049 P 09697c1884894b978e52204f376025c8 [CANDIDATE]: Term 1 election: Requested vote from peers 6d0b0542874c4b8798bf338303235c61 (127.28.54.65:33255), 514542813d154b618edd53dfb5344a50 (127.28.54.67:34839)
W20260709 13:09:32.350441 29622 leader_election.cc:343] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6d0b0542874c4b8798bf338303235c61 (127.28.54.65:33255): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:32.353163 29697 tablet_bootstrap.cc:492] T e40d52b3e84c41148660cbdc2101d793 P 6d0b0542874c4b8798bf338303235c61: No bootstrap required, opened a new log
I20260709 13:09:32.353576 29697 ts_tablet_manager.cc:1403] T e40d52b3e84c41148660cbdc2101d793 P 6d0b0542874c4b8798bf338303235c61: Time spent bootstrapping tablet: real 0.056s	user 0.014s	sys 0.001s
I20260709 13:09:32.353850 29699 tablet_bootstrap.cc:654] T 823db933ae2c4c51a5321bbbd7b53f2c P 09697c1884894b978e52204f376025c8: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:32.356200 29697 raft_consensus.cc:359] T e40d52b3e84c41148660cbdc2101d793 P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:32.356531 29508 raft_consensus.cc:2468] T 9ff797420926444ab55e3a79c683f7dc P 6d0b0542874c4b8798bf338303235c61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514542813d154b618edd53dfb5344a50 in term 1.
I20260709 13:09:32.356896 29697 raft_consensus.cc:385] T e40d52b3e84c41148660cbdc2101d793 P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.357213 29697 raft_consensus.cc:740] T e40d52b3e84c41148660cbdc2101d793 P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d0b0542874c4b8798bf338303235c61, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.358096 29697 consensus_queue.cc:260] T e40d52b3e84c41148660cbdc2101d793 P 6d0b0542874c4b8798bf338303235c61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:32.357863 29622 leader_election.cc:304] T 9ff797420926444ab55e3a79c683f7dc P 514542813d154b618edd53dfb5344a50 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514542813d154b618edd53dfb5344a50, 6d0b0542874c4b8798bf338303235c61; no voters: 
I20260709 13:09:32.359781 29725 raft_consensus.cc:2804] T 9ff797420926444ab55e3a79c683f7dc P 514542813d154b618edd53dfb5344a50 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:32.360252 29725 raft_consensus.cc:697] T 9ff797420926444ab55e3a79c683f7dc P 514542813d154b618edd53dfb5344a50 [term 1 LEADER]: Becoming Leader. State: Replica: 514542813d154b618edd53dfb5344a50, State: Running, Role: LEADER
I20260709 13:09:32.360410 29697 ts_tablet_manager.cc:1434] T e40d52b3e84c41148660cbdc2101d793 P 6d0b0542874c4b8798bf338303235c61: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.001s
I20260709 13:09:32.361274 29697 tablet_bootstrap.cc:492] T e7fed5eeb6124b1794e0b6c304994049 P 6d0b0542874c4b8798bf338303235c61: Bootstrap starting.
I20260709 13:09:32.361073 29725 consensus_queue.cc:237] T 9ff797420926444ab55e3a79c683f7dc P 514542813d154b618edd53dfb5344a50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:32.366359 29583 raft_consensus.cc:2468] T 9ff797420926444ab55e3a79c683f7dc P 09697c1884894b978e52204f376025c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514542813d154b618edd53dfb5344a50 in term 1.
I20260709 13:09:32.367575 29697 tablet_bootstrap.cc:654] T e7fed5eeb6124b1794e0b6c304994049 P 6d0b0542874c4b8798bf338303235c61: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:32.370720 29581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fed5eeb6124b1794e0b6c304994049" candidate_uuid: "514542813d154b618edd53dfb5344a50" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09697c1884894b978e52204f376025c8"
I20260709 13:09:32.371342 29702 leader_election.cc:290] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50 [CANDIDATE]: Term 1 election: Requested vote from peers 6d0b0542874c4b8798bf338303235c61 (127.28.54.65:33255), 09697c1884894b978e52204f376025c8 (127.28.54.66:35555)
I20260709 13:09:32.371628 29581 raft_consensus.cc:2393] T e7fed5eeb6124b1794e0b6c304994049 P 09697c1884894b978e52204f376025c8 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 514542813d154b618edd53dfb5344a50 in current term 1: Already voted for candidate 09697c1884894b978e52204f376025c8 in this term.
I20260709 13:09:32.373278 29620 leader_election.cc:304] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 514542813d154b618edd53dfb5344a50; no voters: 09697c1884894b978e52204f376025c8, 6d0b0542874c4b8798bf338303235c61
I20260709 13:09:32.374837 29702 raft_consensus.cc:2749] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:32.378772 29404 catalog_manager.cc:5697] T 9ff797420926444ab55e3a79c683f7dc P 514542813d154b618edd53dfb5344a50 reported cstate change: term changed from 0 to 1, leader changed from <none> to 514542813d154b618edd53dfb5344a50 (127.28.54.67). New cstate: current_term: 1 leader_uuid: "514542813d154b618edd53dfb5344a50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:32.382030 29699 tablet_bootstrap.cc:492] T 823db933ae2c4c51a5321bbbd7b53f2c P 09697c1884894b978e52204f376025c8: No bootstrap required, opened a new log
I20260709 13:09:32.382212 29471 leader_election.cc:304] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d0b0542874c4b8798bf338303235c61; no voters: 09697c1884894b978e52204f376025c8, 514542813d154b618edd53dfb5344a50
I20260709 13:09:32.383291 29727 raft_consensus.cc:2749] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:32.382566 29699 ts_tablet_manager.cc:1403] T 823db933ae2c4c51a5321bbbd7b53f2c P 09697c1884894b978e52204f376025c8: Time spent bootstrapping tablet: real 0.051s	user 0.009s	sys 0.004s
I20260709 13:09:32.387645 29699 raft_consensus.cc:359] T 823db933ae2c4c51a5321bbbd7b53f2c P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:32.388420 29699 raft_consensus.cc:385] T 823db933ae2c4c51a5321bbbd7b53f2c P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.388671 29699 raft_consensus.cc:740] T 823db933ae2c4c51a5321bbbd7b53f2c P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09697c1884894b978e52204f376025c8, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.389310 29403 catalog_manager.cc:5697] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 09697c1884894b978e52204f376025c8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 09697c1884894b978e52204f376025c8 (127.28.54.66). New cstate: current_term: 1 leader_uuid: "09697c1884894b978e52204f376025c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:32.389345 29699 consensus_queue.cc:260] T 823db933ae2c4c51a5321bbbd7b53f2c P 09697c1884894b978e52204f376025c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:32.391523 29697 tablet_bootstrap.cc:492] T e7fed5eeb6124b1794e0b6c304994049 P 6d0b0542874c4b8798bf338303235c61: No bootstrap required, opened a new log
I20260709 13:09:32.392042 29697 ts_tablet_manager.cc:1403] T e7fed5eeb6124b1794e0b6c304994049 P 6d0b0542874c4b8798bf338303235c61: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.009s
I20260709 13:09:32.392558 29699 ts_tablet_manager.cc:1434] T 823db933ae2c4c51a5321bbbd7b53f2c P 09697c1884894b978e52204f376025c8: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:32.394313 29697 raft_consensus.cc:359] T e7fed5eeb6124b1794e0b6c304994049 P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:32.394949 29697 raft_consensus.cc:385] T e7fed5eeb6124b1794e0b6c304994049 P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:32.395200 29697 raft_consensus.cc:740] T e7fed5eeb6124b1794e0b6c304994049 P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d0b0542874c4b8798bf338303235c61, State: Initialized, Role: FOLLOWER
I20260709 13:09:32.395779 29697 consensus_queue.cc:260] T e7fed5eeb6124b1794e0b6c304994049 P 6d0b0542874c4b8798bf338303235c61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:32.397341 29697 ts_tablet_manager.cc:1434] T e7fed5eeb6124b1794e0b6c304994049 P 6d0b0542874c4b8798bf338303235c61: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:09:32.415529 29708 raft_consensus.cc:493] T 823db933ae2c4c51a5321bbbd7b53f2c P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.415901 29708 raft_consensus.cc:515] T 823db933ae2c4c51a5321bbbd7b53f2c P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:32.417377 29708 leader_election.cc:290] T 823db933ae2c4c51a5321bbbd7b53f2c P 09697c1884894b978e52204f376025c8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6d0b0542874c4b8798bf338303235c61 (127.28.54.65:33255), 514542813d154b618edd53dfb5344a50 (127.28.54.67:34839)
I20260709 13:09:32.417992 29508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823db933ae2c4c51a5321bbbd7b53f2c" candidate_uuid: "09697c1884894b978e52204f376025c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d0b0542874c4b8798bf338303235c61" is_pre_election: true
I20260709 13:09:32.418330 29657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823db933ae2c4c51a5321bbbd7b53f2c" candidate_uuid: "09697c1884894b978e52204f376025c8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514542813d154b618edd53dfb5344a50" is_pre_election: true
I20260709 13:09:32.418563 29508 raft_consensus.cc:2393] T 823db933ae2c4c51a5321bbbd7b53f2c P 6d0b0542874c4b8798bf338303235c61 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 09697c1884894b978e52204f376025c8 in current term 1: Already voted for candidate 514542813d154b618edd53dfb5344a50 in this term.
I20260709 13:09:32.419617 29548 leader_election.cc:304] T 823db933ae2c4c51a5321bbbd7b53f2c P 09697c1884894b978e52204f376025c8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 09697c1884894b978e52204f376025c8; no voters: 514542813d154b618edd53dfb5344a50, 6d0b0542874c4b8798bf338303235c61
I20260709 13:09:32.420238 29708 raft_consensus.cc:3060] T 823db933ae2c4c51a5321bbbd7b53f2c P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.424543 29708 raft_consensus.cc:2749] T 823db933ae2c4c51a5321bbbd7b53f2c P 09697c1884894b978e52204f376025c8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:32.453231 29702 consensus_queue.cc:1048] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:32.458185 29727 raft_consensus.cc:493] T e40d52b3e84c41148660cbdc2101d793 P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.458668 29727 raft_consensus.cc:515] T e40d52b3e84c41148660cbdc2101d793 P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:32.460640 29727 leader_election.cc:290] T e40d52b3e84c41148660cbdc2101d793 P 6d0b0542874c4b8798bf338303235c61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09697c1884894b978e52204f376025c8 (127.28.54.66:35555), 514542813d154b618edd53dfb5344a50 (127.28.54.67:34839)
I20260709 13:09:32.462260 29582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40d52b3e84c41148660cbdc2101d793" candidate_uuid: "6d0b0542874c4b8798bf338303235c61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09697c1884894b978e52204f376025c8" is_pre_election: true
I20260709 13:09:32.462877 29582 raft_consensus.cc:2468] T e40d52b3e84c41148660cbdc2101d793 P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d0b0542874c4b8798bf338303235c61 in term 0.
I20260709 13:09:32.463544 29657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40d52b3e84c41148660cbdc2101d793" candidate_uuid: "6d0b0542874c4b8798bf338303235c61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514542813d154b618edd53dfb5344a50" is_pre_election: true
I20260709 13:09:32.464040 29471 leader_election.cc:304] T e40d52b3e84c41148660cbdc2101d793 P 6d0b0542874c4b8798bf338303235c61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09697c1884894b978e52204f376025c8, 6d0b0542874c4b8798bf338303235c61; no voters: 
I20260709 13:09:32.464133 29657 raft_consensus.cc:2468] T e40d52b3e84c41148660cbdc2101d793 P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6d0b0542874c4b8798bf338303235c61 in term 0.
I20260709 13:09:32.466361 29727 raft_consensus.cc:2804] T e40d52b3e84c41148660cbdc2101d793 P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:32.467447 29702 consensus_queue.cc:1048] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:32.466723 29727 raft_consensus.cc:493] T e40d52b3e84c41148660cbdc2101d793 P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:32.468153 29727 raft_consensus.cc:3060] T e40d52b3e84c41148660cbdc2101d793 P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.475174 29727 raft_consensus.cc:515] T e40d52b3e84c41148660cbdc2101d793 P 6d0b0542874c4b8798bf338303235c61 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:32.477365 29727 leader_election.cc:290] T e40d52b3e84c41148660cbdc2101d793 P 6d0b0542874c4b8798bf338303235c61 [CANDIDATE]: Term 1 election: Requested vote from peers 09697c1884894b978e52204f376025c8 (127.28.54.66:35555), 514542813d154b618edd53dfb5344a50 (127.28.54.67:34839)
I20260709 13:09:32.477859 29657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40d52b3e84c41148660cbdc2101d793" candidate_uuid: "6d0b0542874c4b8798bf338303235c61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514542813d154b618edd53dfb5344a50"
I20260709 13:09:32.478302 29657 raft_consensus.cc:3060] T e40d52b3e84c41148660cbdc2101d793 P 514542813d154b618edd53dfb5344a50 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.478307 29582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40d52b3e84c41148660cbdc2101d793" candidate_uuid: "6d0b0542874c4b8798bf338303235c61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09697c1884894b978e52204f376025c8"
I20260709 13:09:32.478915 29582 raft_consensus.cc:3060] T e40d52b3e84c41148660cbdc2101d793 P 09697c1884894b978e52204f376025c8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.484874 29582 raft_consensus.cc:2468] T e40d52b3e84c41148660cbdc2101d793 P 09697c1884894b978e52204f376025c8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d0b0542874c4b8798bf338303235c61 in term 1.
I20260709 13:09:32.484838 29657 raft_consensus.cc:2468] T e40d52b3e84c41148660cbdc2101d793 P 514542813d154b618edd53dfb5344a50 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d0b0542874c4b8798bf338303235c61 in term 1.
I20260709 13:09:32.486001 29471 leader_election.cc:304] T e40d52b3e84c41148660cbdc2101d793 P 6d0b0542874c4b8798bf338303235c61 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09697c1884894b978e52204f376025c8, 6d0b0542874c4b8798bf338303235c61; no voters: 
I20260709 13:09:32.486707 29727 raft_consensus.cc:2804] T e40d52b3e84c41148660cbdc2101d793 P 6d0b0542874c4b8798bf338303235c61 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:32.487085 29727 raft_consensus.cc:697] T e40d52b3e84c41148660cbdc2101d793 P 6d0b0542874c4b8798bf338303235c61 [term 1 LEADER]: Becoming Leader. State: Replica: 6d0b0542874c4b8798bf338303235c61, State: Running, Role: LEADER
I20260709 13:09:32.487780 29727 consensus_queue.cc:237] T e40d52b3e84c41148660cbdc2101d793 P 6d0b0542874c4b8798bf338303235c61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:32.494015 29404 catalog_manager.cc:5697] T e40d52b3e84c41148660cbdc2101d793 P 6d0b0542874c4b8798bf338303235c61 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6d0b0542874c4b8798bf338303235c61 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "6d0b0542874c4b8798bf338303235c61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:32.539919 29702 consensus_queue.cc:1048] T 6ed5e4177a61445f9768305d4c6867da P 514542813d154b618edd53dfb5344a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:32.547925 29508 raft_consensus.cc:3060] T 6ed5e4177a61445f9768305d4c6867da P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.553408 29727 consensus_queue.cc:1048] T 3e81245af96d4b4b810319574acf129c P 6d0b0542874c4b8798bf338303235c61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:32.553831 29725 consensus_queue.cc:1048] T 6ed5e4177a61445f9768305d4c6867da P 514542813d154b618edd53dfb5344a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:32.567934 29727 consensus_queue.cc:1048] T 3e81245af96d4b4b810319574acf129c P 6d0b0542874c4b8798bf338303235c61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:32.591150 29727 consensus_queue.cc:1048] T 3800273f9bb44c2ca39bf63aa681fe6c P 6d0b0542874c4b8798bf338303235c61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:32.600749 29727 consensus_queue.cc:1048] T 3800273f9bb44c2ca39bf63aa681fe6c P 6d0b0542874c4b8798bf338303235c61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:32.614811 29727 raft_consensus.cc:493] T f5aee951cde24997a61edbc434b816bb P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.615305 29727 raft_consensus.cc:515] T f5aee951cde24997a61edbc434b816bb P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:32.616866 29727 leader_election.cc:290] T f5aee951cde24997a61edbc434b816bb P 6d0b0542874c4b8798bf338303235c61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09697c1884894b978e52204f376025c8 (127.28.54.66:35555), 514542813d154b618edd53dfb5344a50 (127.28.54.67:34839)
I20260709 13:09:32.617462 29582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aee951cde24997a61edbc434b816bb" candidate_uuid: "6d0b0542874c4b8798bf338303235c61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09697c1884894b978e52204f376025c8" is_pre_election: true
I20260709 13:09:32.617806 29657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5aee951cde24997a61edbc434b816bb" candidate_uuid: "6d0b0542874c4b8798bf338303235c61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514542813d154b618edd53dfb5344a50" is_pre_election: true
I20260709 13:09:32.618247 29582 raft_consensus.cc:2393] T f5aee951cde24997a61edbc434b816bb P 09697c1884894b978e52204f376025c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d0b0542874c4b8798bf338303235c61 in current term 1: Already voted for candidate 514542813d154b618edd53dfb5344a50 in this term.
I20260709 13:09:32.619076 29471 leader_election.cc:304] T f5aee951cde24997a61edbc434b816bb P 6d0b0542874c4b8798bf338303235c61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d0b0542874c4b8798bf338303235c61; no voters: 09697c1884894b978e52204f376025c8, 514542813d154b618edd53dfb5344a50
I20260709 13:09:32.619634 29727 raft_consensus.cc:3060] T f5aee951cde24997a61edbc434b816bb P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.623903 29727 raft_consensus.cc:2749] T f5aee951cde24997a61edbc434b816bb P 6d0b0542874c4b8798bf338303235c61 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:32.675072 29725 consensus_queue.cc:1048] T f5aee951cde24997a61edbc434b816bb P 514542813d154b618edd53dfb5344a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:32.686213 29773 consensus_queue.cc:1048] T f5aee951cde24997a61edbc434b816bb P 514542813d154b618edd53dfb5344a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:32.710315 29727 raft_consensus.cc:493] T e7fed5eeb6124b1794e0b6c304994049 P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:32.710810 29727 raft_consensus.cc:515] T e7fed5eeb6124b1794e0b6c304994049 P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:32.712340 29727 leader_election.cc:290] T e7fed5eeb6124b1794e0b6c304994049 P 6d0b0542874c4b8798bf338303235c61 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 09697c1884894b978e52204f376025c8 (127.28.54.66:35555), 514542813d154b618edd53dfb5344a50 (127.28.54.67:34839)
I20260709 13:09:32.712976 29582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fed5eeb6124b1794e0b6c304994049" candidate_uuid: "6d0b0542874c4b8798bf338303235c61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09697c1884894b978e52204f376025c8" is_pre_election: true
I20260709 13:09:32.713368 29657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fed5eeb6124b1794e0b6c304994049" candidate_uuid: "6d0b0542874c4b8798bf338303235c61" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "514542813d154b618edd53dfb5344a50" is_pre_election: true
I20260709 13:09:32.713856 29582 raft_consensus.cc:2393] T e7fed5eeb6124b1794e0b6c304994049 P 09697c1884894b978e52204f376025c8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d0b0542874c4b8798bf338303235c61 in current term 1: Already voted for candidate 09697c1884894b978e52204f376025c8 in this term.
I20260709 13:09:32.714218 29657 raft_consensus.cc:2393] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6d0b0542874c4b8798bf338303235c61 in current term 1: Already voted for candidate 514542813d154b618edd53dfb5344a50 in this term.
I20260709 13:09:32.715097 29474 leader_election.cc:304] T e7fed5eeb6124b1794e0b6c304994049 P 6d0b0542874c4b8798bf338303235c61 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6d0b0542874c4b8798bf338303235c61; no voters: 09697c1884894b978e52204f376025c8, 514542813d154b618edd53dfb5344a50
I20260709 13:09:32.715656 29727 raft_consensus.cc:3060] T e7fed5eeb6124b1794e0b6c304994049 P 6d0b0542874c4b8798bf338303235c61 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:32.719791 29727 raft_consensus.cc:2749] T e7fed5eeb6124b1794e0b6c304994049 P 6d0b0542874c4b8798bf338303235c61 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:32.752038 29727 consensus_queue.cc:1048] T 614a388092724f85b0d98362099dc41a P 6d0b0542874c4b8798bf338303235c61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:32.760277 29773 consensus_queue.cc:1048] T 9ff797420926444ab55e3a79c683f7dc P 514542813d154b618edd53dfb5344a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:32.760704 29734 consensus_queue.cc:1048] T 614a388092724f85b0d98362099dc41a P 6d0b0542874c4b8798bf338303235c61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:32.774075 29725 consensus_queue.cc:1048] T 9ff797420926444ab55e3a79c683f7dc P 514542813d154b618edd53dfb5344a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:32.784621 29708 consensus_queue.cc:1048] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 09697c1884894b978e52204f376025c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:32.795145 29753 consensus_queue.cc:1048] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 09697c1884894b978e52204f376025c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:32.895089 29727 consensus_queue.cc:1048] T e40d52b3e84c41148660cbdc2101d793 P 6d0b0542874c4b8798bf338303235c61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:32.906188 29733 consensus_queue.cc:1048] T e40d52b3e84c41148660cbdc2101d793 P 6d0b0542874c4b8798bf338303235c61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:33.002832 29454 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:09:34.005525 29454 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:34.417250 29702 raft_consensus.cc:493] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:34.417683 29702 raft_consensus.cc:515] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:34.419373 29702 leader_election.cc:290] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 6d0b0542874c4b8798bf338303235c61 (127.28.54.65:33255), 09697c1884894b978e52204f376025c8 (127.28.54.66:35555)
I20260709 13:09:34.420105 29508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fed5eeb6124b1794e0b6c304994049" candidate_uuid: "514542813d154b618edd53dfb5344a50" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d0b0542874c4b8798bf338303235c61" is_pre_election: true
I20260709 13:09:34.420235 29582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fed5eeb6124b1794e0b6c304994049" candidate_uuid: "514542813d154b618edd53dfb5344a50" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09697c1884894b978e52204f376025c8" is_pre_election: true
I20260709 13:09:34.420601 29508 raft_consensus.cc:2468] T e7fed5eeb6124b1794e0b6c304994049 P 6d0b0542874c4b8798bf338303235c61 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514542813d154b618edd53dfb5344a50 in term 1.
I20260709 13:09:34.420747 29582 raft_consensus.cc:2468] T e7fed5eeb6124b1794e0b6c304994049 P 09697c1884894b978e52204f376025c8 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 514542813d154b618edd53dfb5344a50 in term 1.
I20260709 13:09:34.421564 29622 leader_election.cc:304] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514542813d154b618edd53dfb5344a50, 6d0b0542874c4b8798bf338303235c61; no voters: 
I20260709 13:09:34.422233 29702 raft_consensus.cc:2804] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:34.422498 29702 raft_consensus.cc:493] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:34.422739 29702 raft_consensus.cc:3060] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:34.426832 29702 raft_consensus.cc:515] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:34.428179 29702 leader_election.cc:290] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50 [CANDIDATE]: Term 2 election: Requested vote from peers 6d0b0542874c4b8798bf338303235c61 (127.28.54.65:33255), 09697c1884894b978e52204f376025c8 (127.28.54.66:35555)
I20260709 13:09:34.428874 29508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fed5eeb6124b1794e0b6c304994049" candidate_uuid: "514542813d154b618edd53dfb5344a50" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6d0b0542874c4b8798bf338303235c61"
I20260709 13:09:34.428983 29582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fed5eeb6124b1794e0b6c304994049" candidate_uuid: "514542813d154b618edd53dfb5344a50" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09697c1884894b978e52204f376025c8"
I20260709 13:09:34.429306 29508 raft_consensus.cc:3060] T e7fed5eeb6124b1794e0b6c304994049 P 6d0b0542874c4b8798bf338303235c61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:34.429425 29582 raft_consensus.cc:3060] T e7fed5eeb6124b1794e0b6c304994049 P 09697c1884894b978e52204f376025c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:34.433388 29508 raft_consensus.cc:2468] T e7fed5eeb6124b1794e0b6c304994049 P 6d0b0542874c4b8798bf338303235c61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514542813d154b618edd53dfb5344a50 in term 2.
I20260709 13:09:34.433406 29582 raft_consensus.cc:2468] T e7fed5eeb6124b1794e0b6c304994049 P 09697c1884894b978e52204f376025c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514542813d154b618edd53dfb5344a50 in term 2.
I20260709 13:09:34.434356 29622 leader_election.cc:304] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514542813d154b618edd53dfb5344a50, 6d0b0542874c4b8798bf338303235c61; no voters: 
I20260709 13:09:34.434928 29702 raft_consensus.cc:2804] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:34.435729 29702 raft_consensus.cc:697] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50 [term 2 LEADER]: Becoming Leader. State: Replica: 514542813d154b618edd53dfb5344a50, State: Running, Role: LEADER
I20260709 13:09:34.436415 29702 consensus_queue.cc:237] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:34.442363 29406 catalog_manager.cc:5697] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50 reported cstate change: term changed from 0 to 2, leader changed from <none> to 514542813d154b618edd53dfb5344a50 (127.28.54.67). New cstate: current_term: 2 leader_uuid: "514542813d154b618edd53dfb5344a50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:34.816655 29508 raft_consensus.cc:1275] T e7fed5eeb6124b1794e0b6c304994049 P 6d0b0542874c4b8798bf338303235c61 [term 2 FOLLOWER]: Refusing update from remote peer 514542813d154b618edd53dfb5344a50: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:09:34.817795 29702 consensus_queue.cc:1048] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:34.828864 29582 raft_consensus.cc:1275] T e7fed5eeb6124b1794e0b6c304994049 P 09697c1884894b978e52204f376025c8 [term 2 FOLLOWER]: Refusing update from remote peer 514542813d154b618edd53dfb5344a50: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:09:34.830796 29793 consensus_queue.cc:1048] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:34.851846 29657 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e7fed5eeb6124b1794e0b6c304994049"
dest_uuid: "514542813d154b618edd53dfb5344a50"
mode: GRACEFUL
new_leader_uuid: "6d0b0542874c4b8798bf338303235c61"
 from {username='slave'} at 127.0.0.1:56242
I20260709 13:09:34.852389 29657 raft_consensus.cc:606] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50 [term 2 LEADER]: Received request to transfer leadership to TS 6d0b0542874c4b8798bf338303235c61
I20260709 13:09:34.864037 29582 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d7dcb82d7c94558a8dc7cebafb0d7f8"
dest_uuid: "09697c1884894b978e52204f376025c8"
mode: GRACEFUL
new_leader_uuid: "6d0b0542874c4b8798bf338303235c61"
 from {username='slave'} at 127.0.0.1:48306
I20260709 13:09:34.864475 29582 raft_consensus.cc:606] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 09697c1884894b978e52204f376025c8 [term 1 LEADER]: Received request to transfer leadership to TS 6d0b0542874c4b8798bf338303235c61
I20260709 13:09:34.868673 29657 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ed5e4177a61445f9768305d4c6867da"
dest_uuid: "514542813d154b618edd53dfb5344a50"
mode: GRACEFUL
new_leader_uuid: "6d0b0542874c4b8798bf338303235c61"
 from {username='slave'} at 127.0.0.1:56242
I20260709 13:09:34.869135 29657 raft_consensus.cc:606] T 6ed5e4177a61445f9768305d4c6867da P 514542813d154b618edd53dfb5344a50 [term 1 LEADER]: Received request to transfer leadership to TS 6d0b0542874c4b8798bf338303235c61
I20260709 13:09:34.873250 29657 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "823db933ae2c4c51a5321bbbd7b53f2c"
dest_uuid: "514542813d154b618edd53dfb5344a50"
mode: GRACEFUL
new_leader_uuid: "09697c1884894b978e52204f376025c8"
 from {username='slave'} at 127.0.0.1:56242
I20260709 13:09:34.873693 29657 raft_consensus.cc:606] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50 [term 1 LEADER]: Received request to transfer leadership to TS 09697c1884894b978e52204f376025c8
I20260709 13:09:34.884764 29508 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "614a388092724f85b0d98362099dc41a"
dest_uuid: "6d0b0542874c4b8798bf338303235c61"
mode: GRACEFUL
new_leader_uuid: "09697c1884894b978e52204f376025c8"
 from {username='slave'} at 127.0.0.1:45034
I20260709 13:09:34.885212 29508 raft_consensus.cc:606] T 614a388092724f85b0d98362099dc41a P 6d0b0542874c4b8798bf338303235c61 [term 1 LEADER]: Received request to transfer leadership to TS 09697c1884894b978e52204f376025c8
I20260709 13:09:34.889664 29657 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ff797420926444ab55e3a79c683f7dc"
dest_uuid: "514542813d154b618edd53dfb5344a50"
mode: GRACEFUL
new_leader_uuid: "09697c1884894b978e52204f376025c8"
 from {username='slave'} at 127.0.0.1:56242
I20260709 13:09:34.890136 29657 raft_consensus.cc:606] T 9ff797420926444ab55e3a79c683f7dc P 514542813d154b618edd53dfb5344a50 [term 1 LEADER]: Received request to transfer leadership to TS 09697c1884894b978e52204f376025c8
I20260709 13:09:34.894191 29508 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e40d52b3e84c41148660cbdc2101d793"
dest_uuid: "6d0b0542874c4b8798bf338303235c61"
mode: GRACEFUL
new_leader_uuid: "09697c1884894b978e52204f376025c8"
 from {username='slave'} at 127.0.0.1:45034
I20260709 13:09:34.894603 29508 raft_consensus.cc:606] T e40d52b3e84c41148660cbdc2101d793 P 6d0b0542874c4b8798bf338303235c61 [term 1 LEADER]: Received request to transfer leadership to TS 09697c1884894b978e52204f376025c8
I20260709 13:09:35.132834 29727 raft_consensus.cc:993] T e40d52b3e84c41148660cbdc2101d793 P 6d0b0542874c4b8798bf338303235c61: : Instructing follower 09697c1884894b978e52204f376025c8 to start an election
I20260709 13:09:35.133255 29727 raft_consensus.cc:1081] T e40d52b3e84c41148660cbdc2101d793 P 6d0b0542874c4b8798bf338303235c61 [term 1 LEADER]: Signalling peer 09697c1884894b978e52204f376025c8 to start an election
I20260709 13:09:35.134526 29582 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e40d52b3e84c41148660cbdc2101d793"
dest_uuid: "09697c1884894b978e52204f376025c8"
 from {username='slave'} at 127.0.0.1:48300
I20260709 13:09:35.134946 29582 raft_consensus.cc:493] T e40d52b3e84c41148660cbdc2101d793 P 09697c1884894b978e52204f376025c8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:35.135226 29582 raft_consensus.cc:3060] T e40d52b3e84c41148660cbdc2101d793 P 09697c1884894b978e52204f376025c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:35.139394 29582 raft_consensus.cc:515] T e40d52b3e84c41148660cbdc2101d793 P 09697c1884894b978e52204f376025c8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:35.140785 29582 leader_election.cc:290] T e40d52b3e84c41148660cbdc2101d793 P 09697c1884894b978e52204f376025c8 [CANDIDATE]: Term 2 election: Requested vote from peers 6d0b0542874c4b8798bf338303235c61 (127.28.54.65:33255), 514542813d154b618edd53dfb5344a50 (127.28.54.67:34839)
I20260709 13:09:35.141649 29508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40d52b3e84c41148660cbdc2101d793" candidate_uuid: "09697c1884894b978e52204f376025c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6d0b0542874c4b8798bf338303235c61"
I20260709 13:09:35.141860 29657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e40d52b3e84c41148660cbdc2101d793" candidate_uuid: "09697c1884894b978e52204f376025c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "514542813d154b618edd53dfb5344a50"
I20260709 13:09:35.142254 29508 raft_consensus.cc:3055] T e40d52b3e84c41148660cbdc2101d793 P 6d0b0542874c4b8798bf338303235c61 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:35.142328 29657 raft_consensus.cc:3060] T e40d52b3e84c41148660cbdc2101d793 P 514542813d154b618edd53dfb5344a50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:35.142630 29508 raft_consensus.cc:740] T e40d52b3e84c41148660cbdc2101d793 P 6d0b0542874c4b8798bf338303235c61 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d0b0542874c4b8798bf338303235c61, State: Running, Role: LEADER
I20260709 13:09:35.143399 29508 consensus_queue.cc:260] T e40d52b3e84c41148660cbdc2101d793 P 6d0b0542874c4b8798bf338303235c61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:35.144564 29508 raft_consensus.cc:3060] T e40d52b3e84c41148660cbdc2101d793 P 6d0b0542874c4b8798bf338303235c61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:35.148411 29657 raft_consensus.cc:2468] T e40d52b3e84c41148660cbdc2101d793 P 514542813d154b618edd53dfb5344a50 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09697c1884894b978e52204f376025c8 in term 2.
I20260709 13:09:35.149541 29549 leader_election.cc:304] T e40d52b3e84c41148660cbdc2101d793 P 09697c1884894b978e52204f376025c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09697c1884894b978e52204f376025c8, 514542813d154b618edd53dfb5344a50; no voters: 
I20260709 13:09:35.150182 29784 raft_consensus.cc:2804] T e40d52b3e84c41148660cbdc2101d793 P 09697c1884894b978e52204f376025c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:35.150399 29508 raft_consensus.cc:2468] T e40d52b3e84c41148660cbdc2101d793 P 6d0b0542874c4b8798bf338303235c61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09697c1884894b978e52204f376025c8 in term 2.
I20260709 13:09:35.151165 29784 raft_consensus.cc:697] T e40d52b3e84c41148660cbdc2101d793 P 09697c1884894b978e52204f376025c8 [term 2 LEADER]: Becoming Leader. State: Replica: 09697c1884894b978e52204f376025c8, State: Running, Role: LEADER
I20260709 13:09:35.151902 29784 consensus_queue.cc:237] T e40d52b3e84c41148660cbdc2101d793 P 09697c1884894b978e52204f376025c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:35.156759 29785 raft_consensus.cc:993] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50: : Instructing follower 09697c1884894b978e52204f376025c8 to start an election
I20260709 13:09:35.157128 29793 raft_consensus.cc:1081] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50 [term 1 LEADER]: Signalling peer 09697c1884894b978e52204f376025c8 to start an election
I20260709 13:09:35.158473 29582 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "823db933ae2c4c51a5321bbbd7b53f2c"
dest_uuid: "09697c1884894b978e52204f376025c8"
 from {username='slave'} at 127.0.0.1:48298
I20260709 13:09:35.158866 29582 raft_consensus.cc:493] T 823db933ae2c4c51a5321bbbd7b53f2c P 09697c1884894b978e52204f376025c8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:35.159118 29582 raft_consensus.cc:3060] T 823db933ae2c4c51a5321bbbd7b53f2c P 09697c1884894b978e52204f376025c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:35.159173 29406 catalog_manager.cc:5697] T e40d52b3e84c41148660cbdc2101d793 P 09697c1884894b978e52204f376025c8 reported cstate change: term changed from 1 to 2, leader changed from 6d0b0542874c4b8798bf338303235c61 (127.28.54.65) to 09697c1884894b978e52204f376025c8 (127.28.54.66). New cstate: current_term: 2 leader_uuid: "09697c1884894b978e52204f376025c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:35.163163 29582 raft_consensus.cc:515] T 823db933ae2c4c51a5321bbbd7b53f2c P 09697c1884894b978e52204f376025c8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:35.164716 29582 leader_election.cc:290] T 823db933ae2c4c51a5321bbbd7b53f2c P 09697c1884894b978e52204f376025c8 [CANDIDATE]: Term 2 election: Requested vote from peers 6d0b0542874c4b8798bf338303235c61 (127.28.54.65:33255), 514542813d154b618edd53dfb5344a50 (127.28.54.67:34839)
I20260709 13:09:35.165432 29508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823db933ae2c4c51a5321bbbd7b53f2c" candidate_uuid: "09697c1884894b978e52204f376025c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6d0b0542874c4b8798bf338303235c61"
I20260709 13:09:35.165994 29508 raft_consensus.cc:3060] T 823db933ae2c4c51a5321bbbd7b53f2c P 6d0b0542874c4b8798bf338303235c61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:35.165925 29657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823db933ae2c4c51a5321bbbd7b53f2c" candidate_uuid: "09697c1884894b978e52204f376025c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "514542813d154b618edd53dfb5344a50"
I20260709 13:09:35.166599 29657 raft_consensus.cc:3055] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:35.166810 29657 raft_consensus.cc:740] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 514542813d154b618edd53dfb5344a50, State: Running, Role: LEADER
I20260709 13:09:35.167378 29657 consensus_queue.cc:260] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:35.168373 29657 raft_consensus.cc:3060] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:35.171604 29508 raft_consensus.cc:2468] T 823db933ae2c4c51a5321bbbd7b53f2c P 6d0b0542874c4b8798bf338303235c61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09697c1884894b978e52204f376025c8 in term 2.
I20260709 13:09:35.172503 29548 leader_election.cc:304] T 823db933ae2c4c51a5321bbbd7b53f2c P 09697c1884894b978e52204f376025c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09697c1884894b978e52204f376025c8, 6d0b0542874c4b8798bf338303235c61; no voters: 
I20260709 13:09:35.172894 29657 raft_consensus.cc:2468] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09697c1884894b978e52204f376025c8 in term 2.
I20260709 13:09:35.173241 29784 raft_consensus.cc:2804] T 823db933ae2c4c51a5321bbbd7b53f2c P 09697c1884894b978e52204f376025c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:35.173643 29784 raft_consensus.cc:697] T 823db933ae2c4c51a5321bbbd7b53f2c P 09697c1884894b978e52204f376025c8 [term 2 LEADER]: Becoming Leader. State: Replica: 09697c1884894b978e52204f376025c8, State: Running, Role: LEADER
I20260709 13:09:35.174387 29784 consensus_queue.cc:237] T 823db933ae2c4c51a5321bbbd7b53f2c P 09697c1884894b978e52204f376025c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:35.180588 29406 catalog_manager.cc:5697] T 823db933ae2c4c51a5321bbbd7b53f2c P 09697c1884894b978e52204f376025c8 reported cstate change: term changed from 1 to 2, leader changed from 514542813d154b618edd53dfb5344a50 (127.28.54.67) to 09697c1884894b978e52204f376025c8 (127.28.54.66). New cstate: current_term: 2 leader_uuid: "09697c1884894b978e52204f376025c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:35.196072 29802 raft_consensus.cc:993] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 09697c1884894b978e52204f376025c8: : Instructing follower 6d0b0542874c4b8798bf338303235c61 to start an election
I20260709 13:09:35.196434 29784 raft_consensus.cc:1081] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 09697c1884894b978e52204f376025c8 [term 1 LEADER]: Signalling peer 6d0b0542874c4b8798bf338303235c61 to start an election
I20260709 13:09:35.197700 29508 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5d7dcb82d7c94558a8dc7cebafb0d7f8"
dest_uuid: "6d0b0542874c4b8798bf338303235c61"
 from {username='slave'} at 127.0.0.1:45030
I20260709 13:09:35.198115 29508 raft_consensus.cc:493] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:35.198356 29508 raft_consensus.cc:3060] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:35.202608 29508 raft_consensus.cc:515] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:35.204017 29508 leader_election.cc:290] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [CANDIDATE]: Term 2 election: Requested vote from peers 09697c1884894b978e52204f376025c8 (127.28.54.66:35555), 514542813d154b618edd53dfb5344a50 (127.28.54.67:34839)
I20260709 13:09:35.204645 29582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7dcb82d7c94558a8dc7cebafb0d7f8" candidate_uuid: "6d0b0542874c4b8798bf338303235c61" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "09697c1884894b978e52204f376025c8"
I20260709 13:09:35.204912 29657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7dcb82d7c94558a8dc7cebafb0d7f8" candidate_uuid: "6d0b0542874c4b8798bf338303235c61" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "514542813d154b618edd53dfb5344a50"
I20260709 13:09:35.205149 29582 raft_consensus.cc:3055] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 09697c1884894b978e52204f376025c8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:35.205359 29657 raft_consensus.cc:3060] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 514542813d154b618edd53dfb5344a50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:35.205443 29582 raft_consensus.cc:740] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 09697c1884894b978e52204f376025c8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 09697c1884894b978e52204f376025c8, State: Running, Role: LEADER
I20260709 13:09:35.206132 29582 consensus_queue.cc:260] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 09697c1884894b978e52204f376025c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:35.206907 29582 raft_consensus.cc:3060] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 09697c1884894b978e52204f376025c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:35.209470 29657 raft_consensus.cc:2468] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 514542813d154b618edd53dfb5344a50 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d0b0542874c4b8798bf338303235c61 in term 2.
I20260709 13:09:35.210537 29582 raft_consensus.cc:2468] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 09697c1884894b978e52204f376025c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d0b0542874c4b8798bf338303235c61 in term 2.
I20260709 13:09:35.210381 29474 leader_election.cc:304] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514542813d154b618edd53dfb5344a50, 6d0b0542874c4b8798bf338303235c61; no voters: 
I20260709 13:09:35.211310 29727 raft_consensus.cc:2804] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:35.211751 29727 raft_consensus.cc:697] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [term 2 LEADER]: Becoming Leader. State: Replica: 6d0b0542874c4b8798bf338303235c61, State: Running, Role: LEADER
I20260709 13:09:35.212491 29727 consensus_queue.cc:237] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:35.218566 29406 catalog_manager.cc:5697] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 reported cstate change: term changed from 1 to 2, leader changed from 09697c1884894b978e52204f376025c8 (127.28.54.66) to 6d0b0542874c4b8798bf338303235c61 (127.28.54.65). New cstate: current_term: 2 leader_uuid: "6d0b0542874c4b8798bf338303235c61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:35.251823 29785 raft_consensus.cc:993] T 6ed5e4177a61445f9768305d4c6867da P 514542813d154b618edd53dfb5344a50: : Instructing follower 6d0b0542874c4b8798bf338303235c61 to start an election
I20260709 13:09:35.252199 29793 raft_consensus.cc:1081] T 6ed5e4177a61445f9768305d4c6867da P 514542813d154b618edd53dfb5344a50 [term 1 LEADER]: Signalling peer 6d0b0542874c4b8798bf338303235c61 to start an election
I20260709 13:09:35.253409 29508 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ed5e4177a61445f9768305d4c6867da"
dest_uuid: "6d0b0542874c4b8798bf338303235c61"
 from {username='slave'} at 127.0.0.1:45026
I20260709 13:09:35.253854 29508 raft_consensus.cc:493] T 6ed5e4177a61445f9768305d4c6867da P 6d0b0542874c4b8798bf338303235c61 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:35.254125 29508 raft_consensus.cc:3060] T 6ed5e4177a61445f9768305d4c6867da P 6d0b0542874c4b8798bf338303235c61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:35.258791 29508 raft_consensus.cc:515] T 6ed5e4177a61445f9768305d4c6867da P 6d0b0542874c4b8798bf338303235c61 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:35.259111 29785 raft_consensus.cc:993] T 9ff797420926444ab55e3a79c683f7dc P 514542813d154b618edd53dfb5344a50: : Instructing follower 09697c1884894b978e52204f376025c8 to start an election
I20260709 13:09:35.259523 29793 raft_consensus.cc:1081] T 9ff797420926444ab55e3a79c683f7dc P 514542813d154b618edd53dfb5344a50 [term 1 LEADER]: Signalling peer 09697c1884894b978e52204f376025c8 to start an election
I20260709 13:09:35.260949 29581 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ff797420926444ab55e3a79c683f7dc"
dest_uuid: "09697c1884894b978e52204f376025c8"
 from {username='slave'} at 127.0.0.1:48298
I20260709 13:09:35.261057 29582 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed5e4177a61445f9768305d4c6867da" candidate_uuid: "6d0b0542874c4b8798bf338303235c61" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "09697c1884894b978e52204f376025c8"
I20260709 13:09:35.261420 29508 leader_election.cc:290] T 6ed5e4177a61445f9768305d4c6867da P 6d0b0542874c4b8798bf338303235c61 [CANDIDATE]: Term 2 election: Requested vote from peers 09697c1884894b978e52204f376025c8 (127.28.54.66:35555), 514542813d154b618edd53dfb5344a50 (127.28.54.67:34839)
I20260709 13:09:35.261554 29582 raft_consensus.cc:3060] T 6ed5e4177a61445f9768305d4c6867da P 09697c1884894b978e52204f376025c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:35.261456 29581 raft_consensus.cc:493] T 9ff797420926444ab55e3a79c683f7dc P 09697c1884894b978e52204f376025c8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:35.262145 29581 raft_consensus.cc:3060] T 9ff797420926444ab55e3a79c683f7dc P 09697c1884894b978e52204f376025c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:35.263147 29657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed5e4177a61445f9768305d4c6867da" candidate_uuid: "6d0b0542874c4b8798bf338303235c61" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "514542813d154b618edd53dfb5344a50"
I20260709 13:09:35.263720 29657 raft_consensus.cc:3055] T 6ed5e4177a61445f9768305d4c6867da P 514542813d154b618edd53dfb5344a50 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:35.264047 29657 raft_consensus.cc:740] T 6ed5e4177a61445f9768305d4c6867da P 514542813d154b618edd53dfb5344a50 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 514542813d154b618edd53dfb5344a50, State: Running, Role: LEADER
I20260709 13:09:35.264154 29801 raft_consensus.cc:993] T 614a388092724f85b0d98362099dc41a P 6d0b0542874c4b8798bf338303235c61: : Instructing follower 09697c1884894b978e52204f376025c8 to start an election
I20260709 13:09:35.264724 29801 raft_consensus.cc:1081] T 614a388092724f85b0d98362099dc41a P 6d0b0542874c4b8798bf338303235c61 [term 1 LEADER]: Signalling peer 09697c1884894b978e52204f376025c8 to start an election
I20260709 13:09:35.264954 29657 consensus_queue.cc:260] T 6ed5e4177a61445f9768305d4c6867da P 514542813d154b618edd53dfb5344a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:35.266188 29657 raft_consensus.cc:3060] T 6ed5e4177a61445f9768305d4c6867da P 514542813d154b618edd53dfb5344a50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:35.266479 29583 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "614a388092724f85b0d98362099dc41a"
dest_uuid: "09697c1884894b978e52204f376025c8"
 from {username='slave'} at 127.0.0.1:48300
I20260709 13:09:35.267000 29583 raft_consensus.cc:493] T 614a388092724f85b0d98362099dc41a P 09697c1884894b978e52204f376025c8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:35.267335 29583 raft_consensus.cc:3060] T 614a388092724f85b0d98362099dc41a P 09697c1884894b978e52204f376025c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:35.267573 29582 raft_consensus.cc:2468] T 6ed5e4177a61445f9768305d4c6867da P 09697c1884894b978e52204f376025c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d0b0542874c4b8798bf338303235c61 in term 2.
I20260709 13:09:35.268512 29581 raft_consensus.cc:515] T 9ff797420926444ab55e3a79c683f7dc P 09697c1884894b978e52204f376025c8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:35.268837 29471 leader_election.cc:304] T 6ed5e4177a61445f9768305d4c6867da P 6d0b0542874c4b8798bf338303235c61 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09697c1884894b978e52204f376025c8, 6d0b0542874c4b8798bf338303235c61; no voters: 
I20260709 13:09:35.269687 29727 raft_consensus.cc:2804] T 6ed5e4177a61445f9768305d4c6867da P 6d0b0542874c4b8798bf338303235c61 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:35.270190 29727 raft_consensus.cc:697] T 6ed5e4177a61445f9768305d4c6867da P 6d0b0542874c4b8798bf338303235c61 [term 2 LEADER]: Becoming Leader. State: Replica: 6d0b0542874c4b8798bf338303235c61, State: Running, Role: LEADER
I20260709 13:09:35.270998 29727 consensus_queue.cc:237] T 6ed5e4177a61445f9768305d4c6867da P 6d0b0542874c4b8798bf338303235c61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:35.271313 29508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff797420926444ab55e3a79c683f7dc" candidate_uuid: "09697c1884894b978e52204f376025c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6d0b0542874c4b8798bf338303235c61"
I20260709 13:09:35.272267 29657 raft_consensus.cc:2468] T 6ed5e4177a61445f9768305d4c6867da P 514542813d154b618edd53dfb5344a50 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d0b0542874c4b8798bf338303235c61 in term 2.
I20260709 13:09:35.272760 29508 raft_consensus.cc:3060] T 9ff797420926444ab55e3a79c683f7dc P 6d0b0542874c4b8798bf338303235c61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:35.272891 29581 leader_election.cc:290] T 9ff797420926444ab55e3a79c683f7dc P 09697c1884894b978e52204f376025c8 [CANDIDATE]: Term 2 election: Requested vote from peers 6d0b0542874c4b8798bf338303235c61 (127.28.54.65:33255), 514542813d154b618edd53dfb5344a50 (127.28.54.67:34839)
I20260709 13:09:35.273101 29656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff797420926444ab55e3a79c683f7dc" candidate_uuid: "09697c1884894b978e52204f376025c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "514542813d154b618edd53dfb5344a50"
I20260709 13:09:35.273597 29656 raft_consensus.cc:3055] T 9ff797420926444ab55e3a79c683f7dc P 514542813d154b618edd53dfb5344a50 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:35.273908 29656 raft_consensus.cc:740] T 9ff797420926444ab55e3a79c683f7dc P 514542813d154b618edd53dfb5344a50 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 514542813d154b618edd53dfb5344a50, State: Running, Role: LEADER
I20260709 13:09:35.274562 29656 consensus_queue.cc:260] T 9ff797420926444ab55e3a79c683f7dc P 514542813d154b618edd53dfb5344a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:35.275738 29656 raft_consensus.cc:3060] T 9ff797420926444ab55e3a79c683f7dc P 514542813d154b618edd53dfb5344a50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:35.278582 29583 raft_consensus.cc:515] T 614a388092724f85b0d98362099dc41a P 09697c1884894b978e52204f376025c8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:35.280000 29508 raft_consensus.cc:2468] T 9ff797420926444ab55e3a79c683f7dc P 6d0b0542874c4b8798bf338303235c61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09697c1884894b978e52204f376025c8 in term 2.
I20260709 13:09:35.279822 29406 catalog_manager.cc:5697] T 6ed5e4177a61445f9768305d4c6867da P 6d0b0542874c4b8798bf338303235c61 reported cstate change: term changed from 1 to 2, leader changed from 514542813d154b618edd53dfb5344a50 (127.28.54.67) to 6d0b0542874c4b8798bf338303235c61 (127.28.54.65). New cstate: current_term: 2 leader_uuid: "6d0b0542874c4b8798bf338303235c61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:35.281144 29583 leader_election.cc:290] T 614a388092724f85b0d98362099dc41a P 09697c1884894b978e52204f376025c8 [CANDIDATE]: Term 2 election: Requested vote from peers 6d0b0542874c4b8798bf338303235c61 (127.28.54.65:33255), 514542813d154b618edd53dfb5344a50 (127.28.54.67:34839)
I20260709 13:09:35.281370 29548 leader_election.cc:304] T 9ff797420926444ab55e3a79c683f7dc P 09697c1884894b978e52204f376025c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09697c1884894b978e52204f376025c8, 6d0b0542874c4b8798bf338303235c61; no voters: 
I20260709 13:09:35.282152 29784 raft_consensus.cc:2804] T 9ff797420926444ab55e3a79c683f7dc P 09697c1884894b978e52204f376025c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:35.282312 29508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "614a388092724f85b0d98362099dc41a" candidate_uuid: "09697c1884894b978e52204f376025c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6d0b0542874c4b8798bf338303235c61"
I20260709 13:09:35.282615 29784 raft_consensus.cc:697] T 9ff797420926444ab55e3a79c683f7dc P 09697c1884894b978e52204f376025c8 [term 2 LEADER]: Becoming Leader. State: Replica: 09697c1884894b978e52204f376025c8, State: Running, Role: LEADER
I20260709 13:09:35.282883 29508 raft_consensus.cc:3055] T 614a388092724f85b0d98362099dc41a P 6d0b0542874c4b8798bf338303235c61 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:35.283191 29508 raft_consensus.cc:740] T 614a388092724f85b0d98362099dc41a P 6d0b0542874c4b8798bf338303235c61 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d0b0542874c4b8798bf338303235c61, State: Running, Role: LEADER
I20260709 13:09:35.282310 29657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "614a388092724f85b0d98362099dc41a" candidate_uuid: "09697c1884894b978e52204f376025c8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "514542813d154b618edd53dfb5344a50"
I20260709 13:09:35.283413 29784 consensus_queue.cc:237] T 9ff797420926444ab55e3a79c683f7dc P 09697c1884894b978e52204f376025c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:35.283941 29657 raft_consensus.cc:3060] T 614a388092724f85b0d98362099dc41a P 514542813d154b618edd53dfb5344a50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:35.284001 29508 consensus_queue.cc:260] T 614a388092724f85b0d98362099dc41a P 6d0b0542874c4b8798bf338303235c61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:35.285097 29508 raft_consensus.cc:3060] T 614a388092724f85b0d98362099dc41a P 6d0b0542874c4b8798bf338303235c61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:35.281155 29656 raft_consensus.cc:2468] T 9ff797420926444ab55e3a79c683f7dc P 514542813d154b618edd53dfb5344a50 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09697c1884894b978e52204f376025c8 in term 2.
I20260709 13:09:35.290639 29508 raft_consensus.cc:2468] T 614a388092724f85b0d98362099dc41a P 6d0b0542874c4b8798bf338303235c61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09697c1884894b978e52204f376025c8 in term 2.
I20260709 13:09:35.291249 29657 raft_consensus.cc:2468] T 614a388092724f85b0d98362099dc41a P 514542813d154b618edd53dfb5344a50 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09697c1884894b978e52204f376025c8 in term 2.
I20260709 13:09:35.291646 29548 leader_election.cc:304] T 614a388092724f85b0d98362099dc41a P 09697c1884894b978e52204f376025c8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09697c1884894b978e52204f376025c8, 6d0b0542874c4b8798bf338303235c61; no voters: 
I20260709 13:09:35.292492 29802 raft_consensus.cc:2804] T 614a388092724f85b0d98362099dc41a P 09697c1884894b978e52204f376025c8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:35.293691 29802 raft_consensus.cc:697] T 614a388092724f85b0d98362099dc41a P 09697c1884894b978e52204f376025c8 [term 2 LEADER]: Becoming Leader. State: Replica: 09697c1884894b978e52204f376025c8, State: Running, Role: LEADER
I20260709 13:09:35.294528 29802 consensus_queue.cc:237] T 614a388092724f85b0d98362099dc41a P 09697c1884894b978e52204f376025c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:35.296260 29406 catalog_manager.cc:5697] T 9ff797420926444ab55e3a79c683f7dc P 09697c1884894b978e52204f376025c8 reported cstate change: term changed from 1 to 2, leader changed from 514542813d154b618edd53dfb5344a50 (127.28.54.67) to 09697c1884894b978e52204f376025c8 (127.28.54.66). New cstate: current_term: 2 leader_uuid: "09697c1884894b978e52204f376025c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:35.306408 29406 catalog_manager.cc:5697] T 614a388092724f85b0d98362099dc41a P 09697c1884894b978e52204f376025c8 reported cstate change: term changed from 1 to 2, leader changed from 6d0b0542874c4b8798bf338303235c61 (127.28.54.65) to 09697c1884894b978e52204f376025c8 (127.28.54.66). New cstate: current_term: 2 leader_uuid: "09697c1884894b978e52204f376025c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:35.355247 29785 raft_consensus.cc:993] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50: : Instructing follower 6d0b0542874c4b8798bf338303235c61 to start an election
I20260709 13:09:35.355597 29793 raft_consensus.cc:1081] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50 [term 2 LEADER]: Signalling peer 6d0b0542874c4b8798bf338303235c61 to start an election
I20260709 13:09:35.356879 29508 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e7fed5eeb6124b1794e0b6c304994049"
dest_uuid: "6d0b0542874c4b8798bf338303235c61"
 from {username='slave'} at 127.0.0.1:45026
I20260709 13:09:35.357270 29508 raft_consensus.cc:493] T e7fed5eeb6124b1794e0b6c304994049 P 6d0b0542874c4b8798bf338303235c61 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:35.357497 29508 raft_consensus.cc:3060] T e7fed5eeb6124b1794e0b6c304994049 P 6d0b0542874c4b8798bf338303235c61 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:35.361181 29508 raft_consensus.cc:515] T e7fed5eeb6124b1794e0b6c304994049 P 6d0b0542874c4b8798bf338303235c61 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:35.362557 29508 leader_election.cc:290] T e7fed5eeb6124b1794e0b6c304994049 P 6d0b0542874c4b8798bf338303235c61 [CANDIDATE]: Term 3 election: Requested vote from peers 09697c1884894b978e52204f376025c8 (127.28.54.66:35555), 514542813d154b618edd53dfb5344a50 (127.28.54.67:34839)
I20260709 13:09:35.363210 29583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fed5eeb6124b1794e0b6c304994049" candidate_uuid: "6d0b0542874c4b8798bf338303235c61" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "09697c1884894b978e52204f376025c8"
I20260709 13:09:35.363659 29583 raft_consensus.cc:3060] T e7fed5eeb6124b1794e0b6c304994049 P 09697c1884894b978e52204f376025c8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:35.363500 29657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e7fed5eeb6124b1794e0b6c304994049" candidate_uuid: "6d0b0542874c4b8798bf338303235c61" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "514542813d154b618edd53dfb5344a50"
I20260709 13:09:35.364137 29657 raft_consensus.cc:3055] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:35.364452 29657 raft_consensus.cc:740] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 514542813d154b618edd53dfb5344a50, State: Running, Role: LEADER
I20260709 13:09:35.365193 29657 consensus_queue.cc:260] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:35.366384 29657 raft_consensus.cc:3060] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:35.369746 29583 raft_consensus.cc:2468] T e7fed5eeb6124b1794e0b6c304994049 P 09697c1884894b978e52204f376025c8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d0b0542874c4b8798bf338303235c61 in term 3.
I20260709 13:09:35.370760 29471 leader_election.cc:304] T e7fed5eeb6124b1794e0b6c304994049 P 6d0b0542874c4b8798bf338303235c61 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09697c1884894b978e52204f376025c8, 6d0b0542874c4b8798bf338303235c61; no voters: 
I20260709 13:09:35.371349 29727 raft_consensus.cc:2804] T e7fed5eeb6124b1794e0b6c304994049 P 6d0b0542874c4b8798bf338303235c61 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:35.371757 29727 raft_consensus.cc:697] T e7fed5eeb6124b1794e0b6c304994049 P 6d0b0542874c4b8798bf338303235c61 [term 3 LEADER]: Becoming Leader. State: Replica: 6d0b0542874c4b8798bf338303235c61, State: Running, Role: LEADER
I20260709 13:09:35.372090 29657 raft_consensus.cc:2468] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d0b0542874c4b8798bf338303235c61 in term 3.
I20260709 13:09:35.372433 29727 consensus_queue.cc:237] T e7fed5eeb6124b1794e0b6c304994049 P 6d0b0542874c4b8798bf338303235c61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:35.377660 29406 catalog_manager.cc:5697] T e7fed5eeb6124b1794e0b6c304994049 P 6d0b0542874c4b8798bf338303235c61 reported cstate change: term changed from 2 to 3, leader changed from 514542813d154b618edd53dfb5344a50 (127.28.54.67) to 6d0b0542874c4b8798bf338303235c61 (127.28.54.65). New cstate: current_term: 3 leader_uuid: "6d0b0542874c4b8798bf338303235c61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:35.583601 29657 raft_consensus.cc:1275] T e40d52b3e84c41148660cbdc2101d793 P 514542813d154b618edd53dfb5344a50 [term 2 FOLLOWER]: Refusing update from remote peer 09697c1884894b978e52204f376025c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:35.584736 29802 consensus_queue.cc:1048] T e40d52b3e84c41148660cbdc2101d793 P 09697c1884894b978e52204f376025c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:35.595254 29508 raft_consensus.cc:1275] T e40d52b3e84c41148660cbdc2101d793 P 6d0b0542874c4b8798bf338303235c61 [term 2 FOLLOWER]: Refusing update from remote peer 09697c1884894b978e52204f376025c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:35.596717 29784 consensus_queue.cc:1048] T e40d52b3e84c41148660cbdc2101d793 P 09697c1884894b978e52204f376025c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:35.723006 29583 raft_consensus.cc:1275] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 09697c1884894b978e52204f376025c8 [term 2 FOLLOWER]: Refusing update from remote peer 6d0b0542874c4b8798bf338303235c61: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:35.724120 29801 consensus_queue.cc:1048] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:35.731730 29656 raft_consensus.cc:1275] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 514542813d154b618edd53dfb5344a50 [term 2 FOLLOWER]: Refusing update from remote peer 6d0b0542874c4b8798bf338303235c61: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:35.733203 29801 consensus_queue.cc:1048] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:35.749778 29656 raft_consensus.cc:1275] T 6ed5e4177a61445f9768305d4c6867da P 514542813d154b618edd53dfb5344a50 [term 2 FOLLOWER]: Refusing update from remote peer 6d0b0542874c4b8798bf338303235c61: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:35.750754 29801 consensus_queue.cc:1048] T 6ed5e4177a61445f9768305d4c6867da P 6d0b0542874c4b8798bf338303235c61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:35.758832 29583 raft_consensus.cc:1275] T 6ed5e4177a61445f9768305d4c6867da P 09697c1884894b978e52204f376025c8 [term 2 FOLLOWER]: Refusing update from remote peer 6d0b0542874c4b8798bf338303235c61: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:35.758883 29657 raft_consensus.cc:1275] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50 [term 2 FOLLOWER]: Refusing update from remote peer 09697c1884894b978e52204f376025c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:35.760192 29819 consensus_queue.cc:1048] T 6ed5e4177a61445f9768305d4c6867da P 6d0b0542874c4b8798bf338303235c61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:35.760957 29784 consensus_queue.cc:1048] T 823db933ae2c4c51a5321bbbd7b53f2c P 09697c1884894b978e52204f376025c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:35.769999 29508 raft_consensus.cc:1275] T 823db933ae2c4c51a5321bbbd7b53f2c P 6d0b0542874c4b8798bf338303235c61 [term 2 FOLLOWER]: Refusing update from remote peer 09697c1884894b978e52204f376025c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:35.771397 29802 consensus_queue.cc:1048] T 823db933ae2c4c51a5321bbbd7b53f2c P 09697c1884894b978e52204f376025c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:35.812932 29583 raft_consensus.cc:1275] T e7fed5eeb6124b1794e0b6c304994049 P 09697c1884894b978e52204f376025c8 [term 3 FOLLOWER]: Refusing update from remote peer 6d0b0542874c4b8798bf338303235c61: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:35.814100 29819 consensus_queue.cc:1048] T e7fed5eeb6124b1794e0b6c304994049 P 6d0b0542874c4b8798bf338303235c61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:35.820616 29656 raft_consensus.cc:1275] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50 [term 3 FOLLOWER]: Refusing update from remote peer 6d0b0542874c4b8798bf338303235c61: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:09:35.823004 29801 consensus_queue.cc:1048] T e7fed5eeb6124b1794e0b6c304994049 P 6d0b0542874c4b8798bf338303235c61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:35.824268 29656 raft_consensus.cc:1275] T 614a388092724f85b0d98362099dc41a P 514542813d154b618edd53dfb5344a50 [term 2 FOLLOWER]: Refusing update from remote peer 09697c1884894b978e52204f376025c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:35.825515 29802 consensus_queue.cc:1048] T 614a388092724f85b0d98362099dc41a P 09697c1884894b978e52204f376025c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:35.829630 29508 raft_consensus.cc:1275] T 9ff797420926444ab55e3a79c683f7dc P 6d0b0542874c4b8798bf338303235c61 [term 2 FOLLOWER]: Refusing update from remote peer 09697c1884894b978e52204f376025c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:35.831152 29802 consensus_queue.cc:1048] T 9ff797420926444ab55e3a79c683f7dc P 09697c1884894b978e52204f376025c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:35.836126 29506 raft_consensus.cc:1275] T 614a388092724f85b0d98362099dc41a P 6d0b0542874c4b8798bf338303235c61 [term 2 FOLLOWER]: Refusing update from remote peer 09697c1884894b978e52204f376025c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:35.837622 29784 consensus_queue.cc:1048] T 614a388092724f85b0d98362099dc41a P 09697c1884894b978e52204f376025c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:35.843088 29657 raft_consensus.cc:1275] T 9ff797420926444ab55e3a79c683f7dc P 514542813d154b618edd53dfb5344a50 [term 2 FOLLOWER]: Refusing update from remote peer 09697c1884894b978e52204f376025c8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:35.845132 29784 consensus_queue.cc:1048] T 9ff797420926444ab55e3a79c683f7dc P 09697c1884894b978e52204f376025c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:37.925926 28889 auto_leader_rebalancer-test.cc:348] The leader distribution is 
I20260709 13:09:37.926550 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:37.947692 29508 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e81245af96d4b4b810319574acf129c"
dest_uuid: "6d0b0542874c4b8798bf338303235c61"
mode: GRACEFUL
new_leader_uuid: "514542813d154b618edd53dfb5344a50"
 from {username='slave'} at 127.0.0.1:58810
I20260709 13:09:37.948143 29508 raft_consensus.cc:606] T 3e81245af96d4b4b810319574acf129c P 6d0b0542874c4b8798bf338303235c61 [term 1 LEADER]: Received request to transfer leadership to TS 514542813d154b618edd53dfb5344a50
I20260709 13:09:37.950129 29508 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d7dcb82d7c94558a8dc7cebafb0d7f8"
dest_uuid: "6d0b0542874c4b8798bf338303235c61"
mode: GRACEFUL
new_leader_uuid: "514542813d154b618edd53dfb5344a50"
 from {username='slave'} at 127.0.0.1:58810
I20260709 13:09:37.950505 29508 raft_consensus.cc:606] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [term 2 LEADER]: Received request to transfer leadership to TS 514542813d154b618edd53dfb5344a50
I20260709 13:09:37.951311 28889 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:09:37.951705 28889 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:38.141108 29727 raft_consensus.cc:993] T 3e81245af96d4b4b810319574acf129c P 6d0b0542874c4b8798bf338303235c61: : Instructing follower 514542813d154b618edd53dfb5344a50 to start an election
I20260709 13:09:38.141490 29832 raft_consensus.cc:1081] T 3e81245af96d4b4b810319574acf129c P 6d0b0542874c4b8798bf338303235c61 [term 1 LEADER]: Signalling peer 514542813d154b618edd53dfb5344a50 to start an election
I20260709 13:09:38.142849 29656 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e81245af96d4b4b810319574acf129c"
dest_uuid: "514542813d154b618edd53dfb5344a50"
 from {username='slave'} at 127.0.0.1:56222
I20260709 13:09:38.143255 29656 raft_consensus.cc:493] T 3e81245af96d4b4b810319574acf129c P 514542813d154b618edd53dfb5344a50 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:38.143496 29656 raft_consensus.cc:3060] T 3e81245af96d4b4b810319574acf129c P 514542813d154b618edd53dfb5344a50 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.147812 29656 raft_consensus.cc:515] T 3e81245af96d4b4b810319574acf129c P 514542813d154b618edd53dfb5344a50 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:38.149322 29656 leader_election.cc:290] T 3e81245af96d4b4b810319574acf129c P 514542813d154b618edd53dfb5344a50 [CANDIDATE]: Term 2 election: Requested vote from peers 6d0b0542874c4b8798bf338303235c61 (127.28.54.65:33255), 09697c1884894b978e52204f376025c8 (127.28.54.66:35555)
I20260709 13:09:38.150013 29508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e81245af96d4b4b810319574acf129c" candidate_uuid: "514542813d154b618edd53dfb5344a50" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6d0b0542874c4b8798bf338303235c61"
I20260709 13:09:38.150477 29508 raft_consensus.cc:3055] T 3e81245af96d4b4b810319574acf129c P 6d0b0542874c4b8798bf338303235c61 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:38.150554 29583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e81245af96d4b4b810319574acf129c" candidate_uuid: "514542813d154b618edd53dfb5344a50" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "09697c1884894b978e52204f376025c8"
I20260709 13:09:38.150794 29508 raft_consensus.cc:740] T 3e81245af96d4b4b810319574acf129c P 6d0b0542874c4b8798bf338303235c61 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6d0b0542874c4b8798bf338303235c61, State: Running, Role: LEADER
I20260709 13:09:38.151127 29583 raft_consensus.cc:3060] T 3e81245af96d4b4b810319574acf129c P 09697c1884894b978e52204f376025c8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.151448 29508 consensus_queue.cc:260] T 3e81245af96d4b4b810319574acf129c P 6d0b0542874c4b8798bf338303235c61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:38.152449 29508 raft_consensus.cc:3060] T 3e81245af96d4b4b810319574acf129c P 6d0b0542874c4b8798bf338303235c61 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:38.155870 29583 raft_consensus.cc:2468] T 3e81245af96d4b4b810319574acf129c P 09697c1884894b978e52204f376025c8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514542813d154b618edd53dfb5344a50 in term 2.
I20260709 13:09:38.156306 29508 raft_consensus.cc:2468] T 3e81245af96d4b4b810319574acf129c P 6d0b0542874c4b8798bf338303235c61 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514542813d154b618edd53dfb5344a50 in term 2.
I20260709 13:09:38.156790 29620 leader_election.cc:304] T 3e81245af96d4b4b810319574acf129c P 514542813d154b618edd53dfb5344a50 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09697c1884894b978e52204f376025c8, 514542813d154b618edd53dfb5344a50; no voters: 
I20260709 13:09:38.157462 29793 raft_consensus.cc:2804] T 3e81245af96d4b4b810319574acf129c P 514542813d154b618edd53dfb5344a50 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:38.158241 29793 raft_consensus.cc:697] T 3e81245af96d4b4b810319574acf129c P 514542813d154b618edd53dfb5344a50 [term 2 LEADER]: Becoming Leader. State: Replica: 514542813d154b618edd53dfb5344a50, State: Running, Role: LEADER
I20260709 13:09:38.158851 29793 consensus_queue.cc:237] T 3e81245af96d4b4b810319574acf129c P 514542813d154b618edd53dfb5344a50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:38.164701 29406 catalog_manager.cc:5697] T 3e81245af96d4b4b810319574acf129c P 514542813d154b618edd53dfb5344a50 reported cstate change: term changed from 1 to 2, leader changed from 6d0b0542874c4b8798bf338303235c61 (127.28.54.65) to 514542813d154b618edd53dfb5344a50 (127.28.54.67). New cstate: current_term: 2 leader_uuid: "514542813d154b618edd53dfb5344a50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:38.353960 29727 raft_consensus.cc:993] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61: : Instructing follower 514542813d154b618edd53dfb5344a50 to start an election
I20260709 13:09:38.354352 29727 raft_consensus.cc:1081] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [term 2 LEADER]: Signalling peer 514542813d154b618edd53dfb5344a50 to start an election
I20260709 13:09:38.355681 29656 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5d7dcb82d7c94558a8dc7cebafb0d7f8"
dest_uuid: "514542813d154b618edd53dfb5344a50"
 from {username='slave'} at 127.0.0.1:56222
I20260709 13:09:38.356098 29656 raft_consensus.cc:493] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 514542813d154b618edd53dfb5344a50 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:38.356339 29656 raft_consensus.cc:3060] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 514542813d154b618edd53dfb5344a50 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:38.360865 29656 raft_consensus.cc:515] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 514542813d154b618edd53dfb5344a50 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:38.362637 29656 leader_election.cc:290] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 514542813d154b618edd53dfb5344a50 [CANDIDATE]: Term 3 election: Requested vote from peers 6d0b0542874c4b8798bf338303235c61 (127.28.54.65:33255), 09697c1884894b978e52204f376025c8 (127.28.54.66:35555)
I20260709 13:09:38.363317 29508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7dcb82d7c94558a8dc7cebafb0d7f8" candidate_uuid: "514542813d154b618edd53dfb5344a50" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6d0b0542874c4b8798bf338303235c61"
I20260709 13:09:38.363684 29583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7dcb82d7c94558a8dc7cebafb0d7f8" candidate_uuid: "514542813d154b618edd53dfb5344a50" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "09697c1884894b978e52204f376025c8"
I20260709 13:09:38.363888 29508 raft_consensus.cc:3055] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:38.364180 29508 raft_consensus.cc:740] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6d0b0542874c4b8798bf338303235c61, State: Running, Role: LEADER
I20260709 13:09:38.364221 29583 raft_consensus.cc:3060] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 09697c1884894b978e52204f376025c8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:38.365022 29508 consensus_queue.cc:260] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:38.366120 29508 raft_consensus.cc:3060] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:38.370862 29583 raft_consensus.cc:2468] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 09697c1884894b978e52204f376025c8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514542813d154b618edd53dfb5344a50 in term 3.
I20260709 13:09:38.371989 29508 raft_consensus.cc:2468] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514542813d154b618edd53dfb5344a50 in term 3.
I20260709 13:09:38.371966 29620 leader_election.cc:304] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 514542813d154b618edd53dfb5344a50 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09697c1884894b978e52204f376025c8, 514542813d154b618edd53dfb5344a50; no voters: 
I20260709 13:09:38.372857 29793 raft_consensus.cc:2804] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 514542813d154b618edd53dfb5344a50 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:38.373274 29793 raft_consensus.cc:697] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 514542813d154b618edd53dfb5344a50 [term 3 LEADER]: Becoming Leader. State: Replica: 514542813d154b618edd53dfb5344a50, State: Running, Role: LEADER
I20260709 13:09:38.373978 29793 consensus_queue.cc:237] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 514542813d154b618edd53dfb5344a50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:38.379601 29406 catalog_manager.cc:5697] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 514542813d154b618edd53dfb5344a50 reported cstate change: term changed from 2 to 3, leader changed from 6d0b0542874c4b8798bf338303235c61 (127.28.54.65) to 514542813d154b618edd53dfb5344a50 (127.28.54.67). New cstate: current_term: 3 leader_uuid: "514542813d154b618edd53dfb5344a50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:38.563649 29508 raft_consensus.cc:1275] T 3e81245af96d4b4b810319574acf129c P 6d0b0542874c4b8798bf338303235c61 [term 2 FOLLOWER]: Refusing update from remote peer 514542813d154b618edd53dfb5344a50: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:38.564698 29793 consensus_queue.cc:1048] T 3e81245af96d4b4b810319574acf129c P 514542813d154b618edd53dfb5344a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:38.573251 29583 raft_consensus.cc:1275] T 3e81245af96d4b4b810319574acf129c P 09697c1884894b978e52204f376025c8 [term 2 FOLLOWER]: Refusing update from remote peer 514542813d154b618edd53dfb5344a50: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:09:38.574880 29833 consensus_queue.cc:1048] T 3e81245af96d4b4b810319574acf129c P 514542813d154b618edd53dfb5344a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:38.855983 29583 raft_consensus.cc:1275] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 09697c1884894b978e52204f376025c8 [term 3 FOLLOWER]: Refusing update from remote peer 514542813d154b618edd53dfb5344a50: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:38.857183 29844 consensus_queue.cc:1048] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 514542813d154b618edd53dfb5344a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:38.864596 29508 raft_consensus.cc:1275] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [term 3 FOLLOWER]: Refusing update from remote peer 514542813d154b618edd53dfb5344a50: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:38.866017 29793 consensus_queue.cc:1048] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 514542813d154b618edd53dfb5344a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:38.952399 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:38.993965 29656 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3e81245af96d4b4b810319574acf129c"
dest_uuid: "514542813d154b618edd53dfb5344a50"
mode: GRACEFUL
new_leader_uuid: "6d0b0542874c4b8798bf338303235c61"
 from {username='slave'} at 127.0.0.1:56242
I20260709 13:09:38.994973 29656 raft_consensus.cc:606] T 3e81245af96d4b4b810319574acf129c P 514542813d154b618edd53dfb5344a50 [term 2 LEADER]: Received request to transfer leadership to TS 6d0b0542874c4b8798bf338303235c61
I20260709 13:09:39.003861 29656 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d7dcb82d7c94558a8dc7cebafb0d7f8"
dest_uuid: "514542813d154b618edd53dfb5344a50"
mode: GRACEFUL
new_leader_uuid: "6d0b0542874c4b8798bf338303235c61"
 from {username='slave'} at 127.0.0.1:56242
I20260709 13:09:39.004386 29656 raft_consensus.cc:606] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 514542813d154b618edd53dfb5344a50 [term 3 LEADER]: Received request to transfer leadership to TS 6d0b0542874c4b8798bf338303235c61
I20260709 13:09:39.011584 29583 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "823db933ae2c4c51a5321bbbd7b53f2c"
dest_uuid: "09697c1884894b978e52204f376025c8"
mode: GRACEFUL
new_leader_uuid: "6d0b0542874c4b8798bf338303235c61"
 from {username='slave'} at 127.0.0.1:48306
I20260709 13:09:39.012079 29583 raft_consensus.cc:606] T 823db933ae2c4c51a5321bbbd7b53f2c P 09697c1884894b978e52204f376025c8 [term 2 LEADER]: Received request to transfer leadership to TS 6d0b0542874c4b8798bf338303235c61
I20260709 13:09:39.016587 29583 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "614a388092724f85b0d98362099dc41a"
dest_uuid: "09697c1884894b978e52204f376025c8"
mode: GRACEFUL
new_leader_uuid: "6d0b0542874c4b8798bf338303235c61"
 from {username='slave'} at 127.0.0.1:48306
I20260709 13:09:39.017225 29583 raft_consensus.cc:606] T 614a388092724f85b0d98362099dc41a P 09697c1884894b978e52204f376025c8 [term 2 LEADER]: Received request to transfer leadership to TS 6d0b0542874c4b8798bf338303235c61
I20260709 13:09:39.022817 29581 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ff797420926444ab55e3a79c683f7dc"
dest_uuid: "09697c1884894b978e52204f376025c8"
mode: GRACEFUL
new_leader_uuid: "6d0b0542874c4b8798bf338303235c61"
 from {username='slave'} at 127.0.0.1:48306
I20260709 13:09:39.023476 29581 raft_consensus.cc:606] T 9ff797420926444ab55e3a79c683f7dc P 09697c1884894b978e52204f376025c8 [term 2 LEADER]: Received request to transfer leadership to TS 6d0b0542874c4b8798bf338303235c61
I20260709 13:09:39.034513 29851 raft_consensus.cc:993] T 9ff797420926444ab55e3a79c683f7dc P 09697c1884894b978e52204f376025c8: : Instructing follower 6d0b0542874c4b8798bf338303235c61 to start an election
I20260709 13:09:39.034950 29811 raft_consensus.cc:1081] T 9ff797420926444ab55e3a79c683f7dc P 09697c1884894b978e52204f376025c8 [term 2 LEADER]: Signalling peer 6d0b0542874c4b8798bf338303235c61 to start an election
I20260709 13:09:39.036327 29508 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ff797420926444ab55e3a79c683f7dc"
dest_uuid: "6d0b0542874c4b8798bf338303235c61"
 from {username='slave'} at 127.0.0.1:45030
I20260709 13:09:39.036720 29508 raft_consensus.cc:493] T 9ff797420926444ab55e3a79c683f7dc P 6d0b0542874c4b8798bf338303235c61 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:39.037001 29508 raft_consensus.cc:3060] T 9ff797420926444ab55e3a79c683f7dc P 6d0b0542874c4b8798bf338303235c61 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:39.042651 29508 raft_consensus.cc:515] T 9ff797420926444ab55e3a79c683f7dc P 6d0b0542874c4b8798bf338303235c61 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:39.044128 29508 leader_election.cc:290] T 9ff797420926444ab55e3a79c683f7dc P 6d0b0542874c4b8798bf338303235c61 [CANDIDATE]: Term 3 election: Requested vote from peers 09697c1884894b978e52204f376025c8 (127.28.54.66:35555), 514542813d154b618edd53dfb5344a50 (127.28.54.67:34839)
I20260709 13:09:39.045135 29581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff797420926444ab55e3a79c683f7dc" candidate_uuid: "6d0b0542874c4b8798bf338303235c61" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "09697c1884894b978e52204f376025c8"
I20260709 13:09:39.045349 29656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff797420926444ab55e3a79c683f7dc" candidate_uuid: "6d0b0542874c4b8798bf338303235c61" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "514542813d154b618edd53dfb5344a50"
I20260709 13:09:39.045907 29581 raft_consensus.cc:3055] T 9ff797420926444ab55e3a79c683f7dc P 09697c1884894b978e52204f376025c8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:39.046010 29656 raft_consensus.cc:3060] T 9ff797420926444ab55e3a79c683f7dc P 514542813d154b618edd53dfb5344a50 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:39.046298 29581 raft_consensus.cc:740] T 9ff797420926444ab55e3a79c683f7dc P 09697c1884894b978e52204f376025c8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 09697c1884894b978e52204f376025c8, State: Running, Role: LEADER
I20260709 13:09:39.047187 29581 consensus_queue.cc:260] T 9ff797420926444ab55e3a79c683f7dc P 09697c1884894b978e52204f376025c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:39.048622 29581 raft_consensus.cc:3060] T 9ff797420926444ab55e3a79c683f7dc P 09697c1884894b978e52204f376025c8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:39.053731 29656 raft_consensus.cc:2468] T 9ff797420926444ab55e3a79c683f7dc P 514542813d154b618edd53dfb5344a50 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d0b0542874c4b8798bf338303235c61 in term 3.
I20260709 13:09:39.055321 29474 leader_election.cc:304] T 9ff797420926444ab55e3a79c683f7dc P 6d0b0542874c4b8798bf338303235c61 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514542813d154b618edd53dfb5344a50, 6d0b0542874c4b8798bf338303235c61; no voters: 
I20260709 13:09:39.055624 29581 raft_consensus.cc:2468] T 9ff797420926444ab55e3a79c683f7dc P 09697c1884894b978e52204f376025c8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d0b0542874c4b8798bf338303235c61 in term 3.
I20260709 13:09:39.056348 29848 raft_consensus.cc:2804] T 9ff797420926444ab55e3a79c683f7dc P 6d0b0542874c4b8798bf338303235c61 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:39.056869 29848 raft_consensus.cc:697] T 9ff797420926444ab55e3a79c683f7dc P 6d0b0542874c4b8798bf338303235c61 [term 3 LEADER]: Becoming Leader. State: Replica: 6d0b0542874c4b8798bf338303235c61, State: Running, Role: LEADER
I20260709 13:09:39.057920 29848 consensus_queue.cc:237] T 9ff797420926444ab55e3a79c683f7dc P 6d0b0542874c4b8798bf338303235c61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:39.066560 29404 catalog_manager.cc:5697] T 9ff797420926444ab55e3a79c683f7dc P 6d0b0542874c4b8798bf338303235c61 reported cstate change: term changed from 2 to 3, leader changed from 09697c1884894b978e52204f376025c8 (127.28.54.66) to 6d0b0542874c4b8798bf338303235c61 (127.28.54.65). New cstate: current_term: 3 leader_uuid: "6d0b0542874c4b8798bf338303235c61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.240929 29851 raft_consensus.cc:993] T 823db933ae2c4c51a5321bbbd7b53f2c P 09697c1884894b978e52204f376025c8: : Instructing follower 6d0b0542874c4b8798bf338303235c61 to start an election
I20260709 13:09:39.241333 29811 raft_consensus.cc:1081] T 823db933ae2c4c51a5321bbbd7b53f2c P 09697c1884894b978e52204f376025c8 [term 2 LEADER]: Signalling peer 6d0b0542874c4b8798bf338303235c61 to start an election
I20260709 13:09:39.242779 29508 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "823db933ae2c4c51a5321bbbd7b53f2c"
dest_uuid: "6d0b0542874c4b8798bf338303235c61"
 from {username='slave'} at 127.0.0.1:45030
I20260709 13:09:39.243301 29508 raft_consensus.cc:493] T 823db933ae2c4c51a5321bbbd7b53f2c P 6d0b0542874c4b8798bf338303235c61 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:39.243614 29508 raft_consensus.cc:3060] T 823db933ae2c4c51a5321bbbd7b53f2c P 6d0b0542874c4b8798bf338303235c61 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:39.248282 29508 raft_consensus.cc:515] T 823db933ae2c4c51a5321bbbd7b53f2c P 6d0b0542874c4b8798bf338303235c61 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:39.249625 29508 leader_election.cc:290] T 823db933ae2c4c51a5321bbbd7b53f2c P 6d0b0542874c4b8798bf338303235c61 [CANDIDATE]: Term 3 election: Requested vote from peers 09697c1884894b978e52204f376025c8 (127.28.54.66:35555), 514542813d154b618edd53dfb5344a50 (127.28.54.67:34839)
I20260709 13:09:39.250451 29581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823db933ae2c4c51a5321bbbd7b53f2c" candidate_uuid: "6d0b0542874c4b8798bf338303235c61" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "09697c1884894b978e52204f376025c8"
I20260709 13:09:39.250633 29656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823db933ae2c4c51a5321bbbd7b53f2c" candidate_uuid: "6d0b0542874c4b8798bf338303235c61" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "514542813d154b618edd53dfb5344a50"
I20260709 13:09:39.251000 29581 raft_consensus.cc:3055] T 823db933ae2c4c51a5321bbbd7b53f2c P 09697c1884894b978e52204f376025c8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:39.251121 29656 raft_consensus.cc:3060] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:39.251327 29581 raft_consensus.cc:740] T 823db933ae2c4c51a5321bbbd7b53f2c P 09697c1884894b978e52204f376025c8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 09697c1884894b978e52204f376025c8, State: Running, Role: LEADER
I20260709 13:09:39.252055 29581 consensus_queue.cc:260] T 823db933ae2c4c51a5321bbbd7b53f2c P 09697c1884894b978e52204f376025c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:39.253067 29581 raft_consensus.cc:3060] T 823db933ae2c4c51a5321bbbd7b53f2c P 09697c1884894b978e52204f376025c8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:39.255321 29656 raft_consensus.cc:2468] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d0b0542874c4b8798bf338303235c61 in term 3.
I20260709 13:09:39.256234 29474 leader_election.cc:304] T 823db933ae2c4c51a5321bbbd7b53f2c P 6d0b0542874c4b8798bf338303235c61 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514542813d154b618edd53dfb5344a50, 6d0b0542874c4b8798bf338303235c61; no voters: 
I20260709 13:09:39.256963 29848 raft_consensus.cc:2804] T 823db933ae2c4c51a5321bbbd7b53f2c P 6d0b0542874c4b8798bf338303235c61 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:39.257302 29848 raft_consensus.cc:697] T 823db933ae2c4c51a5321bbbd7b53f2c P 6d0b0542874c4b8798bf338303235c61 [term 3 LEADER]: Becoming Leader. State: Replica: 6d0b0542874c4b8798bf338303235c61, State: Running, Role: LEADER
I20260709 13:09:39.258076 29848 consensus_queue.cc:237] T 823db933ae2c4c51a5321bbbd7b53f2c P 6d0b0542874c4b8798bf338303235c61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:39.258774 29581 raft_consensus.cc:2468] T 823db933ae2c4c51a5321bbbd7b53f2c P 09697c1884894b978e52204f376025c8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d0b0542874c4b8798bf338303235c61 in term 3.
I20260709 13:09:39.264962 29404 catalog_manager.cc:5697] T 823db933ae2c4c51a5321bbbd7b53f2c P 6d0b0542874c4b8798bf338303235c61 reported cstate change: term changed from 2 to 3, leader changed from 09697c1884894b978e52204f376025c8 (127.28.54.66) to 6d0b0542874c4b8798bf338303235c61 (127.28.54.65). New cstate: current_term: 3 leader_uuid: "6d0b0542874c4b8798bf338303235c61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.313398 29793 raft_consensus.cc:993] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 514542813d154b618edd53dfb5344a50: : Instructing follower 6d0b0542874c4b8798bf338303235c61 to start an election
I20260709 13:09:39.313900 29844 raft_consensus.cc:1081] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 514542813d154b618edd53dfb5344a50 [term 3 LEADER]: Signalling peer 6d0b0542874c4b8798bf338303235c61 to start an election
I20260709 13:09:39.315373 29508 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5d7dcb82d7c94558a8dc7cebafb0d7f8"
dest_uuid: "6d0b0542874c4b8798bf338303235c61"
 from {username='slave'} at 127.0.0.1:45026
I20260709 13:09:39.315807 29508 raft_consensus.cc:493] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:39.316121 29508 raft_consensus.cc:3060] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:39.322104 29508 raft_consensus.cc:515] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:39.323861 29508 leader_election.cc:290] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [CANDIDATE]: Term 4 election: Requested vote from peers 09697c1884894b978e52204f376025c8 (127.28.54.66:35555), 514542813d154b618edd53dfb5344a50 (127.28.54.67:34839)
I20260709 13:09:39.324524 29581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7dcb82d7c94558a8dc7cebafb0d7f8" candidate_uuid: "6d0b0542874c4b8798bf338303235c61" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "09697c1884894b978e52204f376025c8"
I20260709 13:09:39.324735 29656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7dcb82d7c94558a8dc7cebafb0d7f8" candidate_uuid: "6d0b0542874c4b8798bf338303235c61" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "514542813d154b618edd53dfb5344a50"
I20260709 13:09:39.325079 29581 raft_consensus.cc:3060] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 09697c1884894b978e52204f376025c8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:39.325173 29656 raft_consensus.cc:3055] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 514542813d154b618edd53dfb5344a50 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:39.325505 29656 raft_consensus.cc:740] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 514542813d154b618edd53dfb5344a50 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 514542813d154b618edd53dfb5344a50, State: Running, Role: LEADER
I20260709 13:09:39.326231 29656 consensus_queue.cc:260] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 514542813d154b618edd53dfb5344a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:39.327334 29656 raft_consensus.cc:3060] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 514542813d154b618edd53dfb5344a50 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:39.331305 29581 raft_consensus.cc:2468] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 09697c1884894b978e52204f376025c8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d0b0542874c4b8798bf338303235c61 in term 4.
I20260709 13:09:39.332392 29471 leader_election.cc:304] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09697c1884894b978e52204f376025c8, 6d0b0542874c4b8798bf338303235c61; no voters: 
I20260709 13:09:39.332885 29656 raft_consensus.cc:2468] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 514542813d154b618edd53dfb5344a50 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d0b0542874c4b8798bf338303235c61 in term 4.
I20260709 13:09:39.332990 29848 raft_consensus.cc:2804] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:39.333406 29848 raft_consensus.cc:697] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [term 4 LEADER]: Becoming Leader. State: Replica: 6d0b0542874c4b8798bf338303235c61, State: Running, Role: LEADER
I20260709 13:09:39.334137 29848 consensus_queue.cc:237] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:39.339609 29404 catalog_manager.cc:5697] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 reported cstate change: term changed from 3 to 4, leader changed from 514542813d154b618edd53dfb5344a50 (127.28.54.67) to 6d0b0542874c4b8798bf338303235c61 (127.28.54.65). New cstate: current_term: 4 leader_uuid: "6d0b0542874c4b8798bf338303235c61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.353119 29851 raft_consensus.cc:993] T 614a388092724f85b0d98362099dc41a P 09697c1884894b978e52204f376025c8: : Instructing follower 6d0b0542874c4b8798bf338303235c61 to start an election
I20260709 13:09:39.354224 29811 raft_consensus.cc:1081] T 614a388092724f85b0d98362099dc41a P 09697c1884894b978e52204f376025c8 [term 2 LEADER]: Signalling peer 6d0b0542874c4b8798bf338303235c61 to start an election
I20260709 13:09:39.355816 29508 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "614a388092724f85b0d98362099dc41a"
dest_uuid: "6d0b0542874c4b8798bf338303235c61"
 from {username='slave'} at 127.0.0.1:45030
I20260709 13:09:39.356328 29508 raft_consensus.cc:493] T 614a388092724f85b0d98362099dc41a P 6d0b0542874c4b8798bf338303235c61 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:39.356681 29508 raft_consensus.cc:3060] T 614a388092724f85b0d98362099dc41a P 6d0b0542874c4b8798bf338303235c61 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:39.360728 29508 raft_consensus.cc:515] T 614a388092724f85b0d98362099dc41a P 6d0b0542874c4b8798bf338303235c61 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:39.362183 29508 leader_election.cc:290] T 614a388092724f85b0d98362099dc41a P 6d0b0542874c4b8798bf338303235c61 [CANDIDATE]: Term 3 election: Requested vote from peers 09697c1884894b978e52204f376025c8 (127.28.54.66:35555), 514542813d154b618edd53dfb5344a50 (127.28.54.67:34839)
I20260709 13:09:39.362905 29581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "614a388092724f85b0d98362099dc41a" candidate_uuid: "6d0b0542874c4b8798bf338303235c61" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "09697c1884894b978e52204f376025c8"
I20260709 13:09:39.363129 29656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "614a388092724f85b0d98362099dc41a" candidate_uuid: "6d0b0542874c4b8798bf338303235c61" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "514542813d154b618edd53dfb5344a50"
I20260709 13:09:39.363487 29581 raft_consensus.cc:3055] T 614a388092724f85b0d98362099dc41a P 09697c1884894b978e52204f376025c8 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:39.363636 29656 raft_consensus.cc:3060] T 614a388092724f85b0d98362099dc41a P 514542813d154b618edd53dfb5344a50 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:39.363897 29581 raft_consensus.cc:740] T 614a388092724f85b0d98362099dc41a P 09697c1884894b978e52204f376025c8 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 09697c1884894b978e52204f376025c8, State: Running, Role: LEADER
I20260709 13:09:39.364778 29581 consensus_queue.cc:260] T 614a388092724f85b0d98362099dc41a P 09697c1884894b978e52204f376025c8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:39.366076 29581 raft_consensus.cc:3060] T 614a388092724f85b0d98362099dc41a P 09697c1884894b978e52204f376025c8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:39.368251 29656 raft_consensus.cc:2468] T 614a388092724f85b0d98362099dc41a P 514542813d154b618edd53dfb5344a50 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d0b0542874c4b8798bf338303235c61 in term 3.
I20260709 13:09:39.369323 29474 leader_election.cc:304] T 614a388092724f85b0d98362099dc41a P 6d0b0542874c4b8798bf338303235c61 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 514542813d154b618edd53dfb5344a50, 6d0b0542874c4b8798bf338303235c61; no voters: 
I20260709 13:09:39.369963 29848 raft_consensus.cc:2804] T 614a388092724f85b0d98362099dc41a P 6d0b0542874c4b8798bf338303235c61 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:39.370321 29848 raft_consensus.cc:697] T 614a388092724f85b0d98362099dc41a P 6d0b0542874c4b8798bf338303235c61 [term 3 LEADER]: Becoming Leader. State: Replica: 6d0b0542874c4b8798bf338303235c61, State: Running, Role: LEADER
I20260709 13:09:39.371107 29848 consensus_queue.cc:237] T 614a388092724f85b0d98362099dc41a P 6d0b0542874c4b8798bf338303235c61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:39.372591 29581 raft_consensus.cc:2468] T 614a388092724f85b0d98362099dc41a P 09697c1884894b978e52204f376025c8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d0b0542874c4b8798bf338303235c61 in term 3.
I20260709 13:09:39.377334 29404 catalog_manager.cc:5697] T 614a388092724f85b0d98362099dc41a P 6d0b0542874c4b8798bf338303235c61 reported cstate change: term changed from 2 to 3, leader changed from 09697c1884894b978e52204f376025c8 (127.28.54.66) to 6d0b0542874c4b8798bf338303235c61 (127.28.54.65). New cstate: current_term: 3 leader_uuid: "6d0b0542874c4b8798bf338303235c61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.462491 29793 raft_consensus.cc:993] T 3e81245af96d4b4b810319574acf129c P 514542813d154b618edd53dfb5344a50: : Instructing follower 6d0b0542874c4b8798bf338303235c61 to start an election
I20260709 13:09:39.462864 29844 raft_consensus.cc:1081] T 3e81245af96d4b4b810319574acf129c P 514542813d154b618edd53dfb5344a50 [term 2 LEADER]: Signalling peer 6d0b0542874c4b8798bf338303235c61 to start an election
I20260709 13:09:39.464190 29508 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3e81245af96d4b4b810319574acf129c"
dest_uuid: "6d0b0542874c4b8798bf338303235c61"
 from {username='slave'} at 127.0.0.1:45026
I20260709 13:09:39.464591 29508 raft_consensus.cc:493] T 3e81245af96d4b4b810319574acf129c P 6d0b0542874c4b8798bf338303235c61 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:39.464804 29508 raft_consensus.cc:3060] T 3e81245af96d4b4b810319574acf129c P 6d0b0542874c4b8798bf338303235c61 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:39.468998 29508 raft_consensus.cc:515] T 3e81245af96d4b4b810319574acf129c P 6d0b0542874c4b8798bf338303235c61 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:39.470323 29508 leader_election.cc:290] T 3e81245af96d4b4b810319574acf129c P 6d0b0542874c4b8798bf338303235c61 [CANDIDATE]: Term 3 election: Requested vote from peers 09697c1884894b978e52204f376025c8 (127.28.54.66:35555), 514542813d154b618edd53dfb5344a50 (127.28.54.67:34839)
I20260709 13:09:39.471038 29581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e81245af96d4b4b810319574acf129c" candidate_uuid: "6d0b0542874c4b8798bf338303235c61" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "09697c1884894b978e52204f376025c8"
I20260709 13:09:39.471305 29656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3e81245af96d4b4b810319574acf129c" candidate_uuid: "6d0b0542874c4b8798bf338303235c61" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "514542813d154b618edd53dfb5344a50"
I20260709 13:09:39.471540 29581 raft_consensus.cc:3060] T 3e81245af96d4b4b810319574acf129c P 09697c1884894b978e52204f376025c8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:39.471752 29656 raft_consensus.cc:3055] T 3e81245af96d4b4b810319574acf129c P 514542813d154b618edd53dfb5344a50 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:39.472014 29656 raft_consensus.cc:740] T 3e81245af96d4b4b810319574acf129c P 514542813d154b618edd53dfb5344a50 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 514542813d154b618edd53dfb5344a50, State: Running, Role: LEADER
I20260709 13:09:39.472595 29656 consensus_queue.cc:260] T 3e81245af96d4b4b810319574acf129c P 514542813d154b618edd53dfb5344a50 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:39.473493 29656 raft_consensus.cc:3060] T 3e81245af96d4b4b810319574acf129c P 514542813d154b618edd53dfb5344a50 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:39.475993 29581 raft_consensus.cc:2468] T 3e81245af96d4b4b810319574acf129c P 09697c1884894b978e52204f376025c8 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d0b0542874c4b8798bf338303235c61 in term 3.
I20260709 13:09:39.476895 29471 leader_election.cc:304] T 3e81245af96d4b4b810319574acf129c P 6d0b0542874c4b8798bf338303235c61 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09697c1884894b978e52204f376025c8, 6d0b0542874c4b8798bf338303235c61; no voters: 
I20260709 13:09:39.477205 29656 raft_consensus.cc:2468] T 3e81245af96d4b4b810319574acf129c P 514542813d154b618edd53dfb5344a50 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6d0b0542874c4b8798bf338303235c61 in term 3.
I20260709 13:09:39.477506 29848 raft_consensus.cc:2804] T 3e81245af96d4b4b810319574acf129c P 6d0b0542874c4b8798bf338303235c61 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:39.477949 29848 raft_consensus.cc:697] T 3e81245af96d4b4b810319574acf129c P 6d0b0542874c4b8798bf338303235c61 [term 3 LEADER]: Becoming Leader. State: Replica: 6d0b0542874c4b8798bf338303235c61, State: Running, Role: LEADER
I20260709 13:09:39.478689 29848 consensus_queue.cc:237] T 3e81245af96d4b4b810319574acf129c P 6d0b0542874c4b8798bf338303235c61 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:39.484563 29404 catalog_manager.cc:5697] T 3e81245af96d4b4b810319574acf129c P 6d0b0542874c4b8798bf338303235c61 reported cstate change: term changed from 2 to 3, leader changed from 514542813d154b618edd53dfb5344a50 (127.28.54.67) to 6d0b0542874c4b8798bf338303235c61 (127.28.54.65). New cstate: current_term: 3 leader_uuid: "6d0b0542874c4b8798bf338303235c61" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:39.523823 29581 raft_consensus.cc:1275] T 9ff797420926444ab55e3a79c683f7dc P 09697c1884894b978e52204f376025c8 [term 3 FOLLOWER]: Refusing update from remote peer 6d0b0542874c4b8798bf338303235c61: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:39.525018 29848 consensus_queue.cc:1048] T 9ff797420926444ab55e3a79c683f7dc P 6d0b0542874c4b8798bf338303235c61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:39.532624 29656 raft_consensus.cc:1275] T 9ff797420926444ab55e3a79c683f7dc P 514542813d154b618edd53dfb5344a50 [term 3 FOLLOWER]: Refusing update from remote peer 6d0b0542874c4b8798bf338303235c61: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:39.534047 29860 consensus_queue.cc:1048] T 9ff797420926444ab55e3a79c683f7dc P 6d0b0542874c4b8798bf338303235c61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:39.761636 29581 raft_consensus.cc:1275] T 823db933ae2c4c51a5321bbbd7b53f2c P 09697c1884894b978e52204f376025c8 [term 3 FOLLOWER]: Refusing update from remote peer 6d0b0542874c4b8798bf338303235c61: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:39.762368 29583 raft_consensus.cc:1275] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 09697c1884894b978e52204f376025c8 [term 4 FOLLOWER]: Refusing update from remote peer 6d0b0542874c4b8798bf338303235c61: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:39.762861 29860 consensus_queue.cc:1048] T 823db933ae2c4c51a5321bbbd7b53f2c P 6d0b0542874c4b8798bf338303235c61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:39.763516 29848 consensus_queue.cc:1048] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:39.778028 29656 raft_consensus.cc:1275] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50 [term 3 FOLLOWER]: Refusing update from remote peer 6d0b0542874c4b8798bf338303235c61: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:39.778867 29657 raft_consensus.cc:1275] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 514542813d154b618edd53dfb5344a50 [term 4 FOLLOWER]: Refusing update from remote peer 6d0b0542874c4b8798bf338303235c61: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:39.783430 29727 consensus_queue.cc:1048] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:39.782775 29848 consensus_queue.cc:1048] T 823db933ae2c4c51a5321bbbd7b53f2c P 6d0b0542874c4b8798bf338303235c61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:39.816784 29581 raft_consensus.cc:1275] T 614a388092724f85b0d98362099dc41a P 09697c1884894b978e52204f376025c8 [term 3 FOLLOWER]: Refusing update from remote peer 6d0b0542874c4b8798bf338303235c61: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:39.817983 29867 consensus_queue.cc:1048] T 614a388092724f85b0d98362099dc41a P 6d0b0542874c4b8798bf338303235c61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:39.825901 29656 raft_consensus.cc:1275] T 614a388092724f85b0d98362099dc41a P 514542813d154b618edd53dfb5344a50 [term 3 FOLLOWER]: Refusing update from remote peer 6d0b0542874c4b8798bf338303235c61: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:39.827514 29727 consensus_queue.cc:1048] T 614a388092724f85b0d98362099dc41a P 6d0b0542874c4b8798bf338303235c61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:40.016486 29581 raft_consensus.cc:1275] T 3e81245af96d4b4b810319574acf129c P 09697c1884894b978e52204f376025c8 [term 3 FOLLOWER]: Refusing update from remote peer 6d0b0542874c4b8798bf338303235c61: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:40.017608 29727 consensus_queue.cc:1048] T 3e81245af96d4b4b810319574acf129c P 6d0b0542874c4b8798bf338303235c61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:40.026620 29656 raft_consensus.cc:1275] T 3e81245af96d4b4b810319574acf129c P 514542813d154b618edd53dfb5344a50 [term 3 FOLLOWER]: Refusing update from remote peer 6d0b0542874c4b8798bf338303235c61: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:40.027730 29727 consensus_queue.cc:1048] T 3e81245af96d4b4b810319574acf129c P 6d0b0542874c4b8798bf338303235c61 [LEADER]: Connected to new peer: Peer: permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:42.031361 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:42.040158 29508 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5d7dcb82d7c94558a8dc7cebafb0d7f8"
dest_uuid: "6d0b0542874c4b8798bf338303235c61"
mode: GRACEFUL
new_leader_uuid: "514542813d154b618edd53dfb5344a50"
 from {username='slave'} at 127.0.0.1:58810
I20260709 13:09:42.040593 29508 raft_consensus.cc:606] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [term 4 LEADER]: Received request to transfer leadership to TS 514542813d154b618edd53dfb5344a50
I20260709 13:09:42.042593 29508 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ed5e4177a61445f9768305d4c6867da"
dest_uuid: "6d0b0542874c4b8798bf338303235c61"
mode: GRACEFUL
new_leader_uuid: "09697c1884894b978e52204f376025c8"
 from {username='slave'} at 127.0.0.1:58810
I20260709 13:09:42.042972 29508 raft_consensus.cc:606] T 6ed5e4177a61445f9768305d4c6867da P 6d0b0542874c4b8798bf338303235c61 [term 2 LEADER]: Received request to transfer leadership to TS 09697c1884894b978e52204f376025c8
I20260709 13:09:42.045004 29508 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "823db933ae2c4c51a5321bbbd7b53f2c"
dest_uuid: "6d0b0542874c4b8798bf338303235c61"
mode: GRACEFUL
new_leader_uuid: "514542813d154b618edd53dfb5344a50"
 from {username='slave'} at 127.0.0.1:58810
I20260709 13:09:42.045400 29508 raft_consensus.cc:606] T 823db933ae2c4c51a5321bbbd7b53f2c P 6d0b0542874c4b8798bf338303235c61 [term 3 LEADER]: Received request to transfer leadership to TS 514542813d154b618edd53dfb5344a50
I20260709 13:09:42.047376 29508 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9ff797420926444ab55e3a79c683f7dc"
dest_uuid: "6d0b0542874c4b8798bf338303235c61"
mode: GRACEFUL
new_leader_uuid: "09697c1884894b978e52204f376025c8"
 from {username='slave'} at 127.0.0.1:58810
I20260709 13:09:42.047809 29508 raft_consensus.cc:606] T 9ff797420926444ab55e3a79c683f7dc P 6d0b0542874c4b8798bf338303235c61 [term 3 LEADER]: Received request to transfer leadership to TS 09697c1884894b978e52204f376025c8
I20260709 13:09:42.048617 28889 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:09:42.049063 28889 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:09:42.221253 29875 raft_consensus.cc:993] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61: : Instructing follower 514542813d154b618edd53dfb5344a50 to start an election
I20260709 13:09:42.221859 29874 raft_consensus.cc:1081] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [term 4 LEADER]: Signalling peer 514542813d154b618edd53dfb5344a50 to start an election
I20260709 13:09:42.223446 29656 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5d7dcb82d7c94558a8dc7cebafb0d7f8"
dest_uuid: "514542813d154b618edd53dfb5344a50"
 from {username='slave'} at 127.0.0.1:56222
I20260709 13:09:42.223958 29656 raft_consensus.cc:493] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 514542813d154b618edd53dfb5344a50 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:42.224299 29656 raft_consensus.cc:3060] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 514542813d154b618edd53dfb5344a50 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:42.228294 29656 raft_consensus.cc:515] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 514542813d154b618edd53dfb5344a50 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:42.229598 29656 leader_election.cc:290] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 514542813d154b618edd53dfb5344a50 [CANDIDATE]: Term 5 election: Requested vote from peers 6d0b0542874c4b8798bf338303235c61 (127.28.54.65:33255), 09697c1884894b978e52204f376025c8 (127.28.54.66:35555)
I20260709 13:09:42.230350 29508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7dcb82d7c94558a8dc7cebafb0d7f8" candidate_uuid: "514542813d154b618edd53dfb5344a50" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "6d0b0542874c4b8798bf338303235c61"
I20260709 13:09:42.230753 29508 raft_consensus.cc:3055] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:09:42.230737 29581 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7dcb82d7c94558a8dc7cebafb0d7f8" candidate_uuid: "514542813d154b618edd53dfb5344a50" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "09697c1884894b978e52204f376025c8"
I20260709 13:09:42.231127 29508 raft_consensus.cc:740] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6d0b0542874c4b8798bf338303235c61, State: Running, Role: LEADER
I20260709 13:09:42.231318 29581 raft_consensus.cc:3060] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 09697c1884894b978e52204f376025c8 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:42.231726 29508 consensus_queue.cc:260] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:42.232486 29508 raft_consensus.cc:3060] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:09:42.235728 29581 raft_consensus.cc:2468] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 09697c1884894b978e52204f376025c8 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514542813d154b618edd53dfb5344a50 in term 5.
I20260709 13:09:42.236313 29508 raft_consensus.cc:2468] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514542813d154b618edd53dfb5344a50 in term 5.
I20260709 13:09:42.236747 29620 leader_election.cc:304] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 514542813d154b618edd53dfb5344a50 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09697c1884894b978e52204f376025c8, 514542813d154b618edd53dfb5344a50; no voters: 
I20260709 13:09:42.237340 29844 raft_consensus.cc:2804] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 514542813d154b618edd53dfb5344a50 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:09:42.238126 29844 raft_consensus.cc:697] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 514542813d154b618edd53dfb5344a50 [term 5 LEADER]: Becoming Leader. State: Replica: 514542813d154b618edd53dfb5344a50, State: Running, Role: LEADER
I20260709 13:09:42.238794 29844 consensus_queue.cc:237] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 514542813d154b618edd53dfb5344a50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:42.244489 29403 catalog_manager.cc:5697] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 514542813d154b618edd53dfb5344a50 reported cstate change: term changed from 4 to 5, leader changed from 6d0b0542874c4b8798bf338303235c61 (127.28.54.65) to 514542813d154b618edd53dfb5344a50 (127.28.54.67). New cstate: current_term: 5 leader_uuid: "514542813d154b618edd53dfb5344a50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:42.412139 29874 raft_consensus.cc:993] T 9ff797420926444ab55e3a79c683f7dc P 6d0b0542874c4b8798bf338303235c61: : Instructing follower 09697c1884894b978e52204f376025c8 to start an election
I20260709 13:09:42.412523 29875 raft_consensus.cc:1081] T 9ff797420926444ab55e3a79c683f7dc P 6d0b0542874c4b8798bf338303235c61 [term 3 LEADER]: Signalling peer 09697c1884894b978e52204f376025c8 to start an election
I20260709 13:09:42.413461 29875 raft_consensus.cc:993] T 6ed5e4177a61445f9768305d4c6867da P 6d0b0542874c4b8798bf338303235c61: : Instructing follower 09697c1884894b978e52204f376025c8 to start an election
I20260709 13:09:42.413887 29875 raft_consensus.cc:1081] T 6ed5e4177a61445f9768305d4c6867da P 6d0b0542874c4b8798bf338303235c61 [term 2 LEADER]: Signalling peer 09697c1884894b978e52204f376025c8 to start an election
I20260709 13:09:42.413975 29581 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9ff797420926444ab55e3a79c683f7dc"
dest_uuid: "09697c1884894b978e52204f376025c8"
 from {username='slave'} at 127.0.0.1:48300
I20260709 13:09:42.414531 29581 raft_consensus.cc:493] T 9ff797420926444ab55e3a79c683f7dc P 09697c1884894b978e52204f376025c8 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:42.414880 29581 raft_consensus.cc:3060] T 9ff797420926444ab55e3a79c683f7dc P 09697c1884894b978e52204f376025c8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:42.415447 29583 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ed5e4177a61445f9768305d4c6867da"
dest_uuid: "09697c1884894b978e52204f376025c8"
 from {username='slave'} at 127.0.0.1:48300
I20260709 13:09:42.415894 29583 raft_consensus.cc:493] T 6ed5e4177a61445f9768305d4c6867da P 09697c1884894b978e52204f376025c8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:42.416174 29583 raft_consensus.cc:3060] T 6ed5e4177a61445f9768305d4c6867da P 09697c1884894b978e52204f376025c8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:42.420890 29583 raft_consensus.cc:515] T 6ed5e4177a61445f9768305d4c6867da P 09697c1884894b978e52204f376025c8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:42.420964 29581 raft_consensus.cc:515] T 9ff797420926444ab55e3a79c683f7dc P 09697c1884894b978e52204f376025c8 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:42.422418 29581 leader_election.cc:290] T 9ff797420926444ab55e3a79c683f7dc P 09697c1884894b978e52204f376025c8 [CANDIDATE]: Term 4 election: Requested vote from peers 6d0b0542874c4b8798bf338303235c61 (127.28.54.65:33255), 514542813d154b618edd53dfb5344a50 (127.28.54.67:34839)
I20260709 13:09:42.422675 29583 leader_election.cc:290] T 6ed5e4177a61445f9768305d4c6867da P 09697c1884894b978e52204f376025c8 [CANDIDATE]: Term 3 election: Requested vote from peers 6d0b0542874c4b8798bf338303235c61 (127.28.54.65:33255), 514542813d154b618edd53dfb5344a50 (127.28.54.67:34839)
I20260709 13:09:42.423520 29508 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff797420926444ab55e3a79c683f7dc" candidate_uuid: "09697c1884894b978e52204f376025c8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6d0b0542874c4b8798bf338303235c61"
I20260709 13:09:42.423741 29656 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9ff797420926444ab55e3a79c683f7dc" candidate_uuid: "09697c1884894b978e52204f376025c8" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "514542813d154b618edd53dfb5344a50"
I20260709 13:09:42.424053 29508 raft_consensus.cc:3055] T 9ff797420926444ab55e3a79c683f7dc P 6d0b0542874c4b8798bf338303235c61 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:42.424194 29656 raft_consensus.cc:3060] T 9ff797420926444ab55e3a79c683f7dc P 514542813d154b618edd53dfb5344a50 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:42.424398 29508 raft_consensus.cc:740] T 9ff797420926444ab55e3a79c683f7dc P 6d0b0542874c4b8798bf338303235c61 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d0b0542874c4b8798bf338303235c61, State: Running, Role: LEADER
I20260709 13:09:42.425094 29508 consensus_queue.cc:260] T 9ff797420926444ab55e3a79c683f7dc P 6d0b0542874c4b8798bf338303235c61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:42.424127 29657 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed5e4177a61445f9768305d4c6867da" candidate_uuid: "09697c1884894b978e52204f376025c8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "514542813d154b618edd53dfb5344a50"
I20260709 13:09:42.425983 29657 raft_consensus.cc:3060] T 6ed5e4177a61445f9768305d4c6867da P 514542813d154b618edd53dfb5344a50 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:42.426039 29508 raft_consensus.cc:3060] T 9ff797420926444ab55e3a79c683f7dc P 6d0b0542874c4b8798bf338303235c61 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:42.427086 29506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed5e4177a61445f9768305d4c6867da" candidate_uuid: "09697c1884894b978e52204f376025c8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6d0b0542874c4b8798bf338303235c61"
I20260709 13:09:42.427670 29506 raft_consensus.cc:3055] T 6ed5e4177a61445f9768305d4c6867da P 6d0b0542874c4b8798bf338303235c61 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:09:42.427970 29506 raft_consensus.cc:740] T 6ed5e4177a61445f9768305d4c6867da P 6d0b0542874c4b8798bf338303235c61 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6d0b0542874c4b8798bf338303235c61, State: Running, Role: LEADER
I20260709 13:09:42.428714 29506 consensus_queue.cc:260] T 6ed5e4177a61445f9768305d4c6867da P 6d0b0542874c4b8798bf338303235c61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:42.429942 29506 raft_consensus.cc:3060] T 6ed5e4177a61445f9768305d4c6867da P 6d0b0542874c4b8798bf338303235c61 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:09:42.430454 29656 raft_consensus.cc:2468] T 9ff797420926444ab55e3a79c683f7dc P 514542813d154b618edd53dfb5344a50 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09697c1884894b978e52204f376025c8 in term 4.
I20260709 13:09:42.432250 29657 raft_consensus.cc:2468] T 6ed5e4177a61445f9768305d4c6867da P 514542813d154b618edd53dfb5344a50 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09697c1884894b978e52204f376025c8 in term 3.
I20260709 13:09:42.431968 29549 leader_election.cc:304] T 9ff797420926444ab55e3a79c683f7dc P 09697c1884894b978e52204f376025c8 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09697c1884894b978e52204f376025c8, 514542813d154b618edd53dfb5344a50; no voters: 
I20260709 13:09:42.433063 29508 raft_consensus.cc:2468] T 9ff797420926444ab55e3a79c683f7dc P 6d0b0542874c4b8798bf338303235c61 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09697c1884894b978e52204f376025c8 in term 4.
I20260709 13:09:42.433230 29811 raft_consensus.cc:2804] T 9ff797420926444ab55e3a79c683f7dc P 09697c1884894b978e52204f376025c8 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:42.434273 29549 leader_election.cc:304] T 6ed5e4177a61445f9768305d4c6867da P 09697c1884894b978e52204f376025c8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09697c1884894b978e52204f376025c8, 514542813d154b618edd53dfb5344a50; no voters: 
I20260709 13:09:42.434674 29811 raft_consensus.cc:697] T 9ff797420926444ab55e3a79c683f7dc P 09697c1884894b978e52204f376025c8 [term 4 LEADER]: Becoming Leader. State: Replica: 09697c1884894b978e52204f376025c8, State: Running, Role: LEADER
I20260709 13:09:42.435187 29882 raft_consensus.cc:2804] T 6ed5e4177a61445f9768305d4c6867da P 09697c1884894b978e52204f376025c8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:09:42.435709 29882 raft_consensus.cc:697] T 6ed5e4177a61445f9768305d4c6867da P 09697c1884894b978e52204f376025c8 [term 3 LEADER]: Becoming Leader. State: Replica: 09697c1884894b978e52204f376025c8, State: Running, Role: LEADER
I20260709 13:09:42.435530 29811 consensus_queue.cc:237] T 9ff797420926444ab55e3a79c683f7dc P 09697c1884894b978e52204f376025c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:42.436625 29882 consensus_queue.cc:237] T 6ed5e4177a61445f9768305d4c6867da P 09697c1884894b978e52204f376025c8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:42.437848 29506 raft_consensus.cc:2468] T 6ed5e4177a61445f9768305d4c6867da P 6d0b0542874c4b8798bf338303235c61 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09697c1884894b978e52204f376025c8 in term 3.
I20260709 13:09:42.442978 29403 catalog_manager.cc:5697] T 9ff797420926444ab55e3a79c683f7dc P 09697c1884894b978e52204f376025c8 reported cstate change: term changed from 3 to 4, leader changed from 6d0b0542874c4b8798bf338303235c61 (127.28.54.65) to 09697c1884894b978e52204f376025c8 (127.28.54.66). New cstate: current_term: 4 leader_uuid: "09697c1884894b978e52204f376025c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:42.453032 29403 catalog_manager.cc:5697] T 6ed5e4177a61445f9768305d4c6867da P 09697c1884894b978e52204f376025c8 reported cstate change: term changed from 2 to 3, leader changed from 6d0b0542874c4b8798bf338303235c61 (127.28.54.65) to 09697c1884894b978e52204f376025c8 (127.28.54.66). New cstate: current_term: 3 leader_uuid: "09697c1884894b978e52204f376025c8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:42.557452 29874 raft_consensus.cc:993] T 823db933ae2c4c51a5321bbbd7b53f2c P 6d0b0542874c4b8798bf338303235c61: : Instructing follower 514542813d154b618edd53dfb5344a50 to start an election
I20260709 13:09:42.557890 29875 raft_consensus.cc:1081] T 823db933ae2c4c51a5321bbbd7b53f2c P 6d0b0542874c4b8798bf338303235c61 [term 3 LEADER]: Signalling peer 514542813d154b618edd53dfb5344a50 to start an election
I20260709 13:09:42.559162 29656 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "823db933ae2c4c51a5321bbbd7b53f2c"
dest_uuid: "514542813d154b618edd53dfb5344a50"
 from {username='slave'} at 127.0.0.1:56222
I20260709 13:09:42.559574 29656 raft_consensus.cc:493] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:09:42.559818 29656 raft_consensus.cc:3060] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:42.563633 29656 raft_consensus.cc:515] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:42.564985 29656 leader_election.cc:290] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50 [CANDIDATE]: Term 4 election: Requested vote from peers 6d0b0542874c4b8798bf338303235c61 (127.28.54.65:33255), 09697c1884894b978e52204f376025c8 (127.28.54.66:35555)
I20260709 13:09:42.565701 29506 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823db933ae2c4c51a5321bbbd7b53f2c" candidate_uuid: "514542813d154b618edd53dfb5344a50" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6d0b0542874c4b8798bf338303235c61"
I20260709 13:09:42.565888 29583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "823db933ae2c4c51a5321bbbd7b53f2c" candidate_uuid: "514542813d154b618edd53dfb5344a50" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "09697c1884894b978e52204f376025c8"
I20260709 13:09:42.566309 29506 raft_consensus.cc:3055] T 823db933ae2c4c51a5321bbbd7b53f2c P 6d0b0542874c4b8798bf338303235c61 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:09:42.566407 29583 raft_consensus.cc:3060] T 823db933ae2c4c51a5321bbbd7b53f2c P 09697c1884894b978e52204f376025c8 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:42.566596 29506 raft_consensus.cc:740] T 823db933ae2c4c51a5321bbbd7b53f2c P 6d0b0542874c4b8798bf338303235c61 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6d0b0542874c4b8798bf338303235c61, State: Running, Role: LEADER
I20260709 13:09:42.567298 29506 consensus_queue.cc:260] T 823db933ae2c4c51a5321bbbd7b53f2c P 6d0b0542874c4b8798bf338303235c61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:42.568164 29506 raft_consensus.cc:3060] T 823db933ae2c4c51a5321bbbd7b53f2c P 6d0b0542874c4b8798bf338303235c61 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:09:42.570945 29583 raft_consensus.cc:2468] T 823db933ae2c4c51a5321bbbd7b53f2c P 09697c1884894b978e52204f376025c8 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514542813d154b618edd53dfb5344a50 in term 4.
I20260709 13:09:42.571725 29620 leader_election.cc:304] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09697c1884894b978e52204f376025c8, 514542813d154b618edd53dfb5344a50; no voters: 
I20260709 13:09:42.572288 29844 raft_consensus.cc:2804] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:09:42.572630 29844 raft_consensus.cc:697] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50 [term 4 LEADER]: Becoming Leader. State: Replica: 514542813d154b618edd53dfb5344a50, State: Running, Role: LEADER
I20260709 13:09:42.573002 29506 raft_consensus.cc:2468] T 823db933ae2c4c51a5321bbbd7b53f2c P 6d0b0542874c4b8798bf338303235c61 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 514542813d154b618edd53dfb5344a50 in term 4.
I20260709 13:09:42.573381 29844 consensus_queue.cc:237] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } }
I20260709 13:09:42.579532 29403 catalog_manager.cc:5697] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50 reported cstate change: term changed from 3 to 4, leader changed from 6d0b0542874c4b8798bf338303235c61 (127.28.54.65) to 514542813d154b618edd53dfb5344a50 (127.28.54.67). New cstate: current_term: 4 leader_uuid: "514542813d154b618edd53dfb5344a50" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:42.667330 29506 raft_consensus.cc:1275] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [term 5 FOLLOWER]: Refusing update from remote peer 514542813d154b618edd53dfb5344a50: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:09:42.668346 29844 consensus_queue.cc:1048] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 514542813d154b618edd53dfb5344a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:42.679003 29583 raft_consensus.cc:1275] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 09697c1884894b978e52204f376025c8 [term 5 FOLLOWER]: Refusing update from remote peer 514542813d154b618edd53dfb5344a50: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:09:42.680087 29844 consensus_queue.cc:1048] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 514542813d154b618edd53dfb5344a50 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09697c1884894b978e52204f376025c8" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35555 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:09:42.900574 29506 raft_consensus.cc:1275] T 9ff797420926444ab55e3a79c683f7dc P 6d0b0542874c4b8798bf338303235c61 [term 4 FOLLOWER]: Refusing update from remote peer 09697c1884894b978e52204f376025c8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:42.901597 29882 consensus_queue.cc:1048] T 9ff797420926444ab55e3a79c683f7dc P 09697c1884894b978e52204f376025c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:42.909855 29656 raft_consensus.cc:1275] T 9ff797420926444ab55e3a79c683f7dc P 514542813d154b618edd53dfb5344a50 [term 4 FOLLOWER]: Refusing update from remote peer 09697c1884894b978e52204f376025c8: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:09:42.911348 29883 consensus_queue.cc:1048] T 9ff797420926444ab55e3a79c683f7dc P 09697c1884894b978e52204f376025c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:42.931869 29506 raft_consensus.cc:1275] T 6ed5e4177a61445f9768305d4c6867da P 6d0b0542874c4b8798bf338303235c61 [term 3 FOLLOWER]: Refusing update from remote peer 09697c1884894b978e52204f376025c8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:42.933045 29883 consensus_queue.cc:1048] T 6ed5e4177a61445f9768305d4c6867da P 09697c1884894b978e52204f376025c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6d0b0542874c4b8798bf338303235c61" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 33255 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:42.940996 29656 raft_consensus.cc:1275] T 6ed5e4177a61445f9768305d4c6867da P 514542813d154b618edd53dfb5344a50 [term 3 FOLLOWER]: Refusing update from remote peer 09697c1884894b978e52204f376025c8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:09:42.942490 29811 consensus_queue.cc:1048] T 6ed5e4177a61445f9768305d4c6867da P 09697c1884894b978e52204f376025c8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "514542813d154b618edd53dfb5344a50" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34839 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:43.049796 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:09:43.055353 28889 tablet_server.cc:179] TabletServer@127.28.54.65:0 shutting down...
I20260709 13:09:43.076030 28889 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:43.076679 28889 tablet_replica.cc:333] T e40d52b3e84c41148660cbdc2101d793 P 6d0b0542874c4b8798bf338303235c61: stopping tablet replica
I20260709 13:09:43.077265 28889 raft_consensus.cc:2243] T e40d52b3e84c41148660cbdc2101d793 P 6d0b0542874c4b8798bf338303235c61 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.077682 28889 raft_consensus.cc:2272] T e40d52b3e84c41148660cbdc2101d793 P 6d0b0542874c4b8798bf338303235c61 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.079407 28889 tablet_replica.cc:333] T e7fed5eeb6124b1794e0b6c304994049 P 6d0b0542874c4b8798bf338303235c61: stopping tablet replica
I20260709 13:09:43.079952 28889 raft_consensus.cc:2243] T e7fed5eeb6124b1794e0b6c304994049 P 6d0b0542874c4b8798bf338303235c61 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:43.080650 28889 raft_consensus.cc:2272] T e7fed5eeb6124b1794e0b6c304994049 P 6d0b0542874c4b8798bf338303235c61 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.082226 28889 tablet_replica.cc:333] T 6ed5e4177a61445f9768305d4c6867da P 6d0b0542874c4b8798bf338303235c61: stopping tablet replica
I20260709 13:09:43.082711 28889 raft_consensus.cc:2243] T 6ed5e4177a61445f9768305d4c6867da P 6d0b0542874c4b8798bf338303235c61 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.083086 28889 raft_consensus.cc:2272] T 6ed5e4177a61445f9768305d4c6867da P 6d0b0542874c4b8798bf338303235c61 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.085577 28889 tablet_replica.cc:333] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61: stopping tablet replica
I20260709 13:09:43.086097 28889 raft_consensus.cc:2243] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.086443 28889 raft_consensus.cc:2272] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 6d0b0542874c4b8798bf338303235c61 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.088529 28889 tablet_replica.cc:333] T 3800273f9bb44c2ca39bf63aa681fe6c P 6d0b0542874c4b8798bf338303235c61: stopping tablet replica
I20260709 13:09:43.088979 28889 raft_consensus.cc:2243] T 3800273f9bb44c2ca39bf63aa681fe6c P 6d0b0542874c4b8798bf338303235c61 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:43.089682 28889 raft_consensus.cc:2272] T 3800273f9bb44c2ca39bf63aa681fe6c P 6d0b0542874c4b8798bf338303235c61 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:43.089716 29622 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 4 similar messages]
I20260709 13:09:43.091537 28889 tablet_replica.cc:333] T 9ff797420926444ab55e3a79c683f7dc P 6d0b0542874c4b8798bf338303235c61: stopping tablet replica
I20260709 13:09:43.092063 28889 raft_consensus.cc:2243] T 9ff797420926444ab55e3a79c683f7dc P 6d0b0542874c4b8798bf338303235c61 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.092484 28889 raft_consensus.cc:2272] T 9ff797420926444ab55e3a79c683f7dc P 6d0b0542874c4b8798bf338303235c61 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:43.092615 29622 consensus_peers.cc:597] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50 -> Peer 6d0b0542874c4b8798bf338303235c61 (127.28.54.65:33255): Couldn't send request to peer 6d0b0542874c4b8798bf338303235c61. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:43.094564 28889 tablet_replica.cc:333] T 614a388092724f85b0d98362099dc41a P 6d0b0542874c4b8798bf338303235c61: stopping tablet replica
I20260709 13:09:43.095002 28889 raft_consensus.cc:2243] T 614a388092724f85b0d98362099dc41a P 6d0b0542874c4b8798bf338303235c61 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:43.095587 28889 raft_consensus.cc:2272] T 614a388092724f85b0d98362099dc41a P 6d0b0542874c4b8798bf338303235c61 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.097043 28889 tablet_replica.cc:333] T f5aee951cde24997a61edbc434b816bb P 6d0b0542874c4b8798bf338303235c61: stopping tablet replica
I20260709 13:09:43.097481 28889 raft_consensus.cc:2243] T f5aee951cde24997a61edbc434b816bb P 6d0b0542874c4b8798bf338303235c61 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.097883 28889 raft_consensus.cc:2272] T f5aee951cde24997a61edbc434b816bb P 6d0b0542874c4b8798bf338303235c61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.099612 28889 tablet_replica.cc:333] T 3e81245af96d4b4b810319574acf129c P 6d0b0542874c4b8798bf338303235c61: stopping tablet replica
I20260709 13:09:43.100016 28889 raft_consensus.cc:2243] T 3e81245af96d4b4b810319574acf129c P 6d0b0542874c4b8798bf338303235c61 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:43.100610 28889 raft_consensus.cc:2272] T 3e81245af96d4b4b810319574acf129c P 6d0b0542874c4b8798bf338303235c61 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.102152 28889 tablet_replica.cc:333] T 823db933ae2c4c51a5321bbbd7b53f2c P 6d0b0542874c4b8798bf338303235c61: stopping tablet replica
I20260709 13:09:43.102658 28889 raft_consensus.cc:2243] T 823db933ae2c4c51a5321bbbd7b53f2c P 6d0b0542874c4b8798bf338303235c61 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.102968 28889 raft_consensus.cc:2272] T 823db933ae2c4c51a5321bbbd7b53f2c P 6d0b0542874c4b8798bf338303235c61 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.130303 28889 tablet_server.cc:196] TabletServer@127.28.54.65:0 shutdown complete.
I20260709 13:09:43.148244 28889 tablet_server.cc:179] TabletServer@127.28.54.66:0 shutting down...
I20260709 13:09:43.167572 28889 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:43.168151 28889 tablet_replica.cc:333] T 823db933ae2c4c51a5321bbbd7b53f2c P 09697c1884894b978e52204f376025c8: stopping tablet replica
I20260709 13:09:43.168707 28889 raft_consensus.cc:2243] T 823db933ae2c4c51a5321bbbd7b53f2c P 09697c1884894b978e52204f376025c8 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.169103 28889 raft_consensus.cc:2272] T 823db933ae2c4c51a5321bbbd7b53f2c P 09697c1884894b978e52204f376025c8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.170769 28889 tablet_replica.cc:333] T 9ff797420926444ab55e3a79c683f7dc P 09697c1884894b978e52204f376025c8: stopping tablet replica
I20260709 13:09:43.171250 28889 raft_consensus.cc:2243] T 9ff797420926444ab55e3a79c683f7dc P 09697c1884894b978e52204f376025c8 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:09:43.171903 28889 raft_consensus.cc:2272] T 9ff797420926444ab55e3a79c683f7dc P 09697c1884894b978e52204f376025c8 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.173779 28889 tablet_replica.cc:333] T e40d52b3e84c41148660cbdc2101d793 P 09697c1884894b978e52204f376025c8: stopping tablet replica
I20260709 13:09:43.174258 28889 raft_consensus.cc:2243] T e40d52b3e84c41148660cbdc2101d793 P 09697c1884894b978e52204f376025c8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:09:43.174902 28889 raft_consensus.cc:2272] T e40d52b3e84c41148660cbdc2101d793 P 09697c1884894b978e52204f376025c8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.176469 28889 tablet_replica.cc:333] T 614a388092724f85b0d98362099dc41a P 09697c1884894b978e52204f376025c8: stopping tablet replica
I20260709 13:09:43.176964 28889 raft_consensus.cc:2243] T 614a388092724f85b0d98362099dc41a P 09697c1884894b978e52204f376025c8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.177327 28889 raft_consensus.cc:2272] T 614a388092724f85b0d98362099dc41a P 09697c1884894b978e52204f376025c8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.178963 28889 tablet_replica.cc:333] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 09697c1884894b978e52204f376025c8: stopping tablet replica
I20260709 13:09:43.179414 28889 raft_consensus.cc:2243] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 09697c1884894b978e52204f376025c8 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.179761 28889 raft_consensus.cc:2272] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 09697c1884894b978e52204f376025c8 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.181572 28889 tablet_replica.cc:333] T 3e81245af96d4b4b810319574acf129c P 09697c1884894b978e52204f376025c8: stopping tablet replica
I20260709 13:09:43.182078 28889 raft_consensus.cc:2243] T 3e81245af96d4b4b810319574acf129c P 09697c1884894b978e52204f376025c8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.182423 28889 raft_consensus.cc:2272] T 3e81245af96d4b4b810319574acf129c P 09697c1884894b978e52204f376025c8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.183823 28889 tablet_replica.cc:333] T f5aee951cde24997a61edbc434b816bb P 09697c1884894b978e52204f376025c8: stopping tablet replica
I20260709 13:09:43.184267 28889 raft_consensus.cc:2243] T f5aee951cde24997a61edbc434b816bb P 09697c1884894b978e52204f376025c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.184602 28889 raft_consensus.cc:2272] T f5aee951cde24997a61edbc434b816bb P 09697c1884894b978e52204f376025c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.186563 28889 tablet_replica.cc:333] T 6ed5e4177a61445f9768305d4c6867da P 09697c1884894b978e52204f376025c8: stopping tablet replica
I20260709 13:09:43.188290 28889 raft_consensus.cc:2243] T 6ed5e4177a61445f9768305d4c6867da P 09697c1884894b978e52204f376025c8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:09:43.189108 28889 raft_consensus.cc:2272] T 6ed5e4177a61445f9768305d4c6867da P 09697c1884894b978e52204f376025c8 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:43.189491 29620 consensus_peers.cc:597] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 514542813d154b618edd53dfb5344a50 -> Peer 09697c1884894b978e52204f376025c8 (127.28.54.66:35555): Couldn't send request to peer 09697c1884894b978e52204f376025c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:43.191656 28889 tablet_replica.cc:333] T e7fed5eeb6124b1794e0b6c304994049 P 09697c1884894b978e52204f376025c8: stopping tablet replica
I20260709 13:09:43.192327 28889 raft_consensus.cc:2243] T e7fed5eeb6124b1794e0b6c304994049 P 09697c1884894b978e52204f376025c8 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.192873 28889 raft_consensus.cc:2272] T e7fed5eeb6124b1794e0b6c304994049 P 09697c1884894b978e52204f376025c8 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:09:43.193260 29620 consensus_peers.cc:597] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50 -> Peer 09697c1884894b978e52204f376025c8 (127.28.54.66:35555): Couldn't send request to peer 09697c1884894b978e52204f376025c8. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:43.194510 28889 tablet_replica.cc:333] T 3800273f9bb44c2ca39bf63aa681fe6c P 09697c1884894b978e52204f376025c8: stopping tablet replica
I20260709 13:09:43.194952 28889 raft_consensus.cc:2243] T 3800273f9bb44c2ca39bf63aa681fe6c P 09697c1884894b978e52204f376025c8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.195287 28889 raft_consensus.cc:2272] T 3800273f9bb44c2ca39bf63aa681fe6c P 09697c1884894b978e52204f376025c8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.220424 28889 tablet_server.cc:196] TabletServer@127.28.54.66:0 shutdown complete.
I20260709 13:09:43.237869 28889 tablet_server.cc:179] TabletServer@127.28.54.67:0 shutting down...
I20260709 13:09:43.255911 28889 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:09:43.256583 28889 tablet_replica.cc:333] T 9ff797420926444ab55e3a79c683f7dc P 514542813d154b618edd53dfb5344a50: stopping tablet replica
I20260709 13:09:43.257143 28889 raft_consensus.cc:2243] T 9ff797420926444ab55e3a79c683f7dc P 514542813d154b618edd53dfb5344a50 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.257577 28889 raft_consensus.cc:2272] T 9ff797420926444ab55e3a79c683f7dc P 514542813d154b618edd53dfb5344a50 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.259975 28889 tablet_replica.cc:333] T e40d52b3e84c41148660cbdc2101d793 P 514542813d154b618edd53dfb5344a50: stopping tablet replica
I20260709 13:09:43.260465 28889 raft_consensus.cc:2243] T e40d52b3e84c41148660cbdc2101d793 P 514542813d154b618edd53dfb5344a50 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.260876 28889 raft_consensus.cc:2272] T e40d52b3e84c41148660cbdc2101d793 P 514542813d154b618edd53dfb5344a50 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.262566 28889 tablet_replica.cc:333] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 514542813d154b618edd53dfb5344a50: stopping tablet replica
I20260709 13:09:43.263064 28889 raft_consensus.cc:2243] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 514542813d154b618edd53dfb5344a50 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:09:43.263628 28889 raft_consensus.cc:2272] T 5d7dcb82d7c94558a8dc7cebafb0d7f8 P 514542813d154b618edd53dfb5344a50 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.265282 28889 tablet_replica.cc:333] T 3800273f9bb44c2ca39bf63aa681fe6c P 514542813d154b618edd53dfb5344a50: stopping tablet replica
I20260709 13:09:43.265736 28889 raft_consensus.cc:2243] T 3800273f9bb44c2ca39bf63aa681fe6c P 514542813d154b618edd53dfb5344a50 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.266129 28889 raft_consensus.cc:2272] T 3800273f9bb44c2ca39bf63aa681fe6c P 514542813d154b618edd53dfb5344a50 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.267539 28889 tablet_replica.cc:333] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50: stopping tablet replica
I20260709 13:09:43.267975 28889 raft_consensus.cc:2243] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.268347 28889 raft_consensus.cc:2272] T e7fed5eeb6124b1794e0b6c304994049 P 514542813d154b618edd53dfb5344a50 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.269791 28889 tablet_replica.cc:333] T 6ed5e4177a61445f9768305d4c6867da P 514542813d154b618edd53dfb5344a50: stopping tablet replica
I20260709 13:09:43.270224 28889 raft_consensus.cc:2243] T 6ed5e4177a61445f9768305d4c6867da P 514542813d154b618edd53dfb5344a50 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.270578 28889 raft_consensus.cc:2272] T 6ed5e4177a61445f9768305d4c6867da P 514542813d154b618edd53dfb5344a50 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.272308 28889 tablet_replica.cc:333] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50: stopping tablet replica
I20260709 13:09:43.272739 28889 raft_consensus.cc:2243] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:09:43.273351 28889 pending_rounds.cc:70] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50: Trying to abort 1 pending ops.
I20260709 13:09:43.273562 28889 pending_rounds.cc:77] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50: Aborting op as it isn't in flight: id { term: 4 index: 4 } timestamp: 7305636178227986432 op_type: NO_OP noop_request { }
I20260709 13:09:43.273880 28889 raft_consensus.cc:2889] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50 [term 4 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:09:43.274140 28889 raft_consensus.cc:2272] T 823db933ae2c4c51a5321bbbd7b53f2c P 514542813d154b618edd53dfb5344a50 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.275713 28889 tablet_replica.cc:333] T 614a388092724f85b0d98362099dc41a P 514542813d154b618edd53dfb5344a50: stopping tablet replica
I20260709 13:09:43.276134 28889 raft_consensus.cc:2243] T 614a388092724f85b0d98362099dc41a P 514542813d154b618edd53dfb5344a50 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.276497 28889 raft_consensus.cc:2272] T 614a388092724f85b0d98362099dc41a P 514542813d154b618edd53dfb5344a50 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.277884 28889 tablet_replica.cc:333] T f5aee951cde24997a61edbc434b816bb P 514542813d154b618edd53dfb5344a50: stopping tablet replica
I20260709 13:09:43.278275 28889 raft_consensus.cc:2243] T f5aee951cde24997a61edbc434b816bb P 514542813d154b618edd53dfb5344a50 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:43.278877 28889 raft_consensus.cc:2272] T f5aee951cde24997a61edbc434b816bb P 514542813d154b618edd53dfb5344a50 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.280306 28889 tablet_replica.cc:333] T 3e81245af96d4b4b810319574acf129c P 514542813d154b618edd53dfb5344a50: stopping tablet replica
I20260709 13:09:43.280670 28889 raft_consensus.cc:2243] T 3e81245af96d4b4b810319574acf129c P 514542813d154b618edd53dfb5344a50 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:43.281023 28889 raft_consensus.cc:2272] T 3e81245af96d4b4b810319574acf129c P 514542813d154b618edd53dfb5344a50 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.306277 28889 tablet_server.cc:196] TabletServer@127.28.54.67:0 shutdown complete.
I20260709 13:09:43.323237 28889 master.cc:562] Master@127.28.54.126:42287 shutting down...
I20260709 13:09:43.340312 28889 raft_consensus.cc:2243] T 00000000000000000000000000000000 P f2acd763fac14fba951e6d3287c90875 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:09:43.340786 28889 raft_consensus.cc:2272] T 00000000000000000000000000000000 P f2acd763fac14fba951e6d3287c90875 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:43.341086 28889 tablet_replica.cc:333] T 00000000000000000000000000000000 P f2acd763fac14fba951e6d3287c90875: stopping tablet replica
I20260709 13:09:43.359266 28889 master.cc:584] Master@127.28.54.126:42287 shutdown complete.
09697c1884894b978e52204f376025c8  4
514542813d154b618edd53dfb5344a50  1
6d0b0542874c4b8798bf338303235c61  5
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (12513 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 13:09:43.394381 28889 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.28.54.126:45283
I20260709 13:09:43.395385 28889 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:43.400106 29901 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:43.400380 29902 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:43.401408 29904 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:43.402308 28889 server_base.cc:1061] running on GCE node
I20260709 13:09:43.403092 28889 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:43.403271 28889 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:43.403414 28889 hybrid_clock.cc:648] HybridClock initialized: now 1783602583403397 us; error 0 us; skew 500 ppm
I20260709 13:09:43.403895 28889 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:43.406124 28889 webserver.cc:533] Webserver started at http://127.28.54.126:37179/ using document root <none> and password file <none>
I20260709 13:09:43.406543 28889 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:43.406694 28889 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:43.406946 28889 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:43.407970 28889 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/master-0-root/instance:
uuid: "1c91346f9a2a480e908d4e0323634aeb"
format_stamp: "Formatted at 2026-07-09 13:09:43 on dist-test-slave-vpdx"
I20260709 13:09:43.411913 28889 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260709 13:09:43.414987 29909 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:43.415628 28889 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:09:43.415879 28889 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/master-0-root
uuid: "1c91346f9a2a480e908d4e0323634aeb"
format_stamp: "Formatted at 2026-07-09 13:09:43 on dist-test-slave-vpdx"
I20260709 13:09:43.416112 28889 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:43.426050 28889 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:43.427294 28889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:43.462447 28889 rpc_server.cc:307] RPC server started. Bound to: 127.28.54.126:45283
I20260709 13:09:43.462536 29960 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.54.126:45283 every 8 connection(s)
I20260709 13:09:43.465987 29961 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:43.474979 29961 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c91346f9a2a480e908d4e0323634aeb: Bootstrap starting.
I20260709 13:09:43.479496 29961 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1c91346f9a2a480e908d4e0323634aeb: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:43.483198 29961 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1c91346f9a2a480e908d4e0323634aeb: No bootstrap required, opened a new log
I20260709 13:09:43.485111 29961 raft_consensus.cc:359] T 00000000000000000000000000000000 P 1c91346f9a2a480e908d4e0323634aeb [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c91346f9a2a480e908d4e0323634aeb" member_type: VOTER }
I20260709 13:09:43.485464 29961 raft_consensus.cc:385] T 00000000000000000000000000000000 P 1c91346f9a2a480e908d4e0323634aeb [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:43.485635 29961 raft_consensus.cc:740] T 00000000000000000000000000000000 P 1c91346f9a2a480e908d4e0323634aeb [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1c91346f9a2a480e908d4e0323634aeb, State: Initialized, Role: FOLLOWER
I20260709 13:09:43.486212 29961 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1c91346f9a2a480e908d4e0323634aeb [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c91346f9a2a480e908d4e0323634aeb" member_type: VOTER }
I20260709 13:09:43.486617 29961 raft_consensus.cc:399] T 00000000000000000000000000000000 P 1c91346f9a2a480e908d4e0323634aeb [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:09:43.486797 29961 raft_consensus.cc:493] T 00000000000000000000000000000000 P 1c91346f9a2a480e908d4e0323634aeb [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:09:43.487002 29961 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 1c91346f9a2a480e908d4e0323634aeb [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:43.490804 29961 raft_consensus.cc:515] T 00000000000000000000000000000000 P 1c91346f9a2a480e908d4e0323634aeb [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c91346f9a2a480e908d4e0323634aeb" member_type: VOTER }
I20260709 13:09:43.491243 29961 leader_election.cc:304] T 00000000000000000000000000000000 P 1c91346f9a2a480e908d4e0323634aeb [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1c91346f9a2a480e908d4e0323634aeb; no voters: 
I20260709 13:09:43.492208 29961 leader_election.cc:290] T 00000000000000000000000000000000 P 1c91346f9a2a480e908d4e0323634aeb [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:09:43.492542 29964 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 1c91346f9a2a480e908d4e0323634aeb [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:43.493733 29964 raft_consensus.cc:697] T 00000000000000000000000000000000 P 1c91346f9a2a480e908d4e0323634aeb [term 1 LEADER]: Becoming Leader. State: Replica: 1c91346f9a2a480e908d4e0323634aeb, State: Running, Role: LEADER
I20260709 13:09:43.494302 29964 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1c91346f9a2a480e908d4e0323634aeb [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c91346f9a2a480e908d4e0323634aeb" member_type: VOTER }
I20260709 13:09:43.494870 29961 sys_catalog.cc:565] T 00000000000000000000000000000000 P 1c91346f9a2a480e908d4e0323634aeb [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:09:43.496942 29965 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c91346f9a2a480e908d4e0323634aeb [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1c91346f9a2a480e908d4e0323634aeb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c91346f9a2a480e908d4e0323634aeb" member_type: VOTER } }
I20260709 13:09:43.497011 29966 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1c91346f9a2a480e908d4e0323634aeb [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1c91346f9a2a480e908d4e0323634aeb. Latest consensus state: current_term: 1 leader_uuid: "1c91346f9a2a480e908d4e0323634aeb" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1c91346f9a2a480e908d4e0323634aeb" member_type: VOTER } }
I20260709 13:09:43.497634 29965 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c91346f9a2a480e908d4e0323634aeb [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:43.497699 29966 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1c91346f9a2a480e908d4e0323634aeb [sys.catalog]: This master's current role is: LEADER
I20260709 13:09:43.500272 29971 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:09:43.504783 29971 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:09:43.508877 28889 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:09:43.512475 29971 catalog_manager.cc:1383] Generated new cluster ID: a8ff98aeabd644a1b78160999af53cf0
I20260709 13:09:43.512701 29971 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:09:43.529158 29971 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:09:43.530380 29971 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:09:43.545255 29971 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 1c91346f9a2a480e908d4e0323634aeb: Generated new TSK 0
I20260709 13:09:43.545786 29971 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:09:43.575614 28889 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:43.581018 29982 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:43.582105 29983 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:43.583341 29985 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:43.584069 28889 server_base.cc:1061] running on GCE node
I20260709 13:09:43.584822 28889 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:43.584997 28889 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:43.585144 28889 hybrid_clock.cc:648] HybridClock initialized: now 1783602583585130 us; error 0 us; skew 500 ppm
I20260709 13:09:43.585629 28889 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:43.587698 28889 webserver.cc:533] Webserver started at http://127.28.54.65:41149/ using document root <none> and password file <none>
I20260709 13:09:43.588122 28889 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:43.588287 28889 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:43.588526 28889 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:43.589483 28889 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-0-root/instance:
uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
format_stamp: "Formatted at 2026-07-09 13:09:43 on dist-test-slave-vpdx"
I20260709 13:09:43.593465 28889 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:09:43.596465 29990 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:43.597157 28889 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:09:43.597411 28889 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-0-root
uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
format_stamp: "Formatted at 2026-07-09 13:09:43 on dist-test-slave-vpdx"
I20260709 13:09:43.597656 28889 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:43.608047 28889 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:43.609127 28889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:43.610524 28889 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:43.612627 28889 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:43.612814 28889 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:43.613040 28889 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:43.613196 28889 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:43.650279 28889 rpc_server.cc:307] RPC server started. Bound to: 127.28.54.65:34451
I20260709 13:09:43.650377 30052 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.54.65:34451 every 8 connection(s)
I20260709 13:09:43.654918 28889 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:43.661371 30057 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:43.662672 30058 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:43.665380 30060 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:43.665987 28889 server_base.cc:1061] running on GCE node
I20260709 13:09:43.666981 28889 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:43.667177 28889 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:43.667335 28889 hybrid_clock.cc:648] HybridClock initialized: now 1783602583667316 us; error 0 us; skew 500 ppm
I20260709 13:09:43.667861 28889 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:43.670624 28889 webserver.cc:533] Webserver started at http://127.28.54.66:42395/ using document root <none> and password file <none>
I20260709 13:09:43.671005 30053 heartbeater.cc:344] Connected to a master server at 127.28.54.126:45283
I20260709 13:09:43.671201 28889 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:43.671398 30053 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:43.671453 28889 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:43.671836 28889 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:43.672284 30053 heartbeater.cc:507] Master 127.28.54.126:45283 requested a full tablet report, sending...
I20260709 13:09:43.673270 28889 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-1-root/instance:
uuid: "5ec73dc157ed476ca903a7d596271719"
format_stamp: "Formatted at 2026-07-09 13:09:43 on dist-test-slave-vpdx"
I20260709 13:09:43.674450 29926 ts_manager.cc:194] Registered new tserver with Master: b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451)
I20260709 13:09:43.676087 29926 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51818
I20260709 13:09:43.677829 28889 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 13:09:43.681324 30065 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:43.682054 28889 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:09:43.682309 28889 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-1-root
uuid: "5ec73dc157ed476ca903a7d596271719"
format_stamp: "Formatted at 2026-07-09 13:09:43 on dist-test-slave-vpdx"
I20260709 13:09:43.682538 28889 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:43.701964 28889 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:43.703025 28889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:43.704478 28889 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:43.706543 28889 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:43.706741 28889 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:43.706970 28889 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:43.707116 28889 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:43.743093 28889 rpc_server.cc:307] RPC server started. Bound to: 127.28.54.66:43821
I20260709 13:09:43.743175 30127 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.54.66:43821 every 8 connection(s)
I20260709 13:09:43.747315 28889 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:43.753645 30131 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:43.755256 30132 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:43.756484 30134 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:43.757491 28889 server_base.cc:1061] running on GCE node
I20260709 13:09:43.758540 28889 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:43.758802 28889 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:43.758776 30128 heartbeater.cc:344] Connected to a master server at 127.28.54.126:45283
I20260709 13:09:43.759119 28889 hybrid_clock.cc:648] HybridClock initialized: now 1783602583759097 us; error 0 us; skew 500 ppm
I20260709 13:09:43.759258 30128 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:43.759662 28889 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:43.759943 30128 heartbeater.cc:507] Master 127.28.54.126:45283 requested a full tablet report, sending...
I20260709 13:09:43.761965 29926 ts_manager.cc:194] Registered new tserver with Master: 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:43.762125 28889 webserver.cc:533] Webserver started at http://127.28.54.67:39303/ using document root <none> and password file <none>
I20260709 13:09:43.762607 28889 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:43.762779 28889 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:43.763005 28889 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:43.763334 29926 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51828
I20260709 13:09:43.764030 28889 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-2-root/instance:
uuid: "c99569d27a6f4c648eae7119fe3db124"
format_stamp: "Formatted at 2026-07-09 13:09:43 on dist-test-slave-vpdx"
I20260709 13:09:43.768070 28889 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:09:43.771019 30139 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:43.771764 28889 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:09:43.772033 28889 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-2-root
uuid: "c99569d27a6f4c648eae7119fe3db124"
format_stamp: "Formatted at 2026-07-09 13:09:43 on dist-test-slave-vpdx"
I20260709 13:09:43.772312 28889 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:43.790076 28889 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:43.791174 28889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:43.792532 28889 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:43.794672 28889 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:43.794862 28889 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:43.795075 28889 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:43.795225 28889 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:43.832378 28889 rpc_server.cc:307] RPC server started. Bound to: 127.28.54.67:45001
I20260709 13:09:43.832466 30201 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.54.67:45001 every 8 connection(s)
I20260709 13:09:43.844751 30202 heartbeater.cc:344] Connected to a master server at 127.28.54.126:45283
I20260709 13:09:43.845090 30202 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:43.845741 30202 heartbeater.cc:507] Master 127.28.54.126:45283 requested a full tablet report, sending...
I20260709 13:09:43.847498 29926 ts_manager.cc:194] Registered new tserver with Master: c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:43.848505 28889 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013135244s
I20260709 13:09:43.848683 29926 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51840
I20260709 13:09:43.871061 29926 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51854:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:09:43.876976 29926 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:09:44.058892 30092 tablet_service.cc:1511] Processing CreateTablet for tablet e218d3c3e368401a8eff81a5699074b8 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:09:44.060276 30092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e218d3c3e368401a8eff81a5699074b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.062841 30091 tablet_service.cc:1511] Processing CreateTablet for tablet 1cd924402bd0402aa7ad47fac1308ac9 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:09:44.064096 30091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cd924402bd0402aa7ad47fac1308ac9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.066794 30090 tablet_service.cc:1511] Processing CreateTablet for tablet 18a72905c2e24e33af2e64672417cfcf (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:09:44.068100 30090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18a72905c2e24e33af2e64672417cfcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.072261 30089 tablet_service.cc:1511] Processing CreateTablet for tablet 98e11967c3504e11865ed831f2584aea (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:09:44.072971 30167 tablet_service.cc:1511] Processing CreateTablet for tablet c56071aeace442bebfbcd88e12fe4376 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:09:44.073508 30089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98e11967c3504e11865ed831f2584aea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.074240 30167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c56071aeace442bebfbcd88e12fe4376. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.074848 30088 tablet_service.cc:1511] Processing CreateTablet for tablet 63253e2671134725b8fe85f63070e4c8 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:09:44.076915 30087 tablet_service.cc:1511] Processing CreateTablet for tablet 88d3759f7fe14a4d8e7ba8670ce5cfeb (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:09:44.057119 30093 tablet_service.cc:1511] Processing CreateTablet for tablet c56071aeace442bebfbcd88e12fe4376 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:09:44.078531 30093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c56071aeace442bebfbcd88e12fe4376. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.078858 30166 tablet_service.cc:1511] Processing CreateTablet for tablet e218d3c3e368401a8eff81a5699074b8 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:09:44.080076 30166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e218d3c3e368401a8eff81a5699074b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.082050 30088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63253e2671134725b8fe85f63070e4c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.083469 30087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88d3759f7fe14a4d8e7ba8670ce5cfeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.083310 30165 tablet_service.cc:1511] Processing CreateTablet for tablet 1cd924402bd0402aa7ad47fac1308ac9 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:09:44.084534 30165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cd924402bd0402aa7ad47fac1308ac9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.086501 30164 tablet_service.cc:1511] Processing CreateTablet for tablet 18a72905c2e24e33af2e64672417cfcf (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:09:44.088853 30164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18a72905c2e24e33af2e64672417cfcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.087054 30159 tablet_service.cc:1511] Processing CreateTablet for tablet 817d4a23671d4a1d9c3b9db3b4e77b0f (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:09:44.091846 30163 tablet_service.cc:1511] Processing CreateTablet for tablet 98e11967c3504e11865ed831f2584aea (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:09:44.093111 30163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98e11967c3504e11865ed831f2584aea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.094728 30160 tablet_service.cc:1511] Processing CreateTablet for tablet ff758e6a87fa49b99c35558fafe39f11 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:09:44.098512 30086 tablet_service.cc:1511] Processing CreateTablet for tablet ff758e6a87fa49b99c35558fafe39f11 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:09:44.099802 30086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff758e6a87fa49b99c35558fafe39f11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.100246 30161 tablet_service.cc:1511] Processing CreateTablet for tablet 88d3759f7fe14a4d8e7ba8670ce5cfeb (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:09:44.102553 30085 tablet_service.cc:1511] Processing CreateTablet for tablet 817d4a23671d4a1d9c3b9db3b4e77b0f (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:09:44.102805 30162 tablet_service.cc:1511] Processing CreateTablet for tablet 63253e2671134725b8fe85f63070e4c8 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:09:44.103767 30085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 817d4a23671d4a1d9c3b9db3b4e77b0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.104377 30158 tablet_service.cc:1511] Processing CreateTablet for tablet 38e941311158407e8c0e2f4ca4b31d32 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:09:44.106791 30084 tablet_service.cc:1511] Processing CreateTablet for tablet 38e941311158407e8c0e2f4ca4b31d32 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:09:44.108210 30084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38e941311158407e8c0e2f4ca4b31d32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.110842 30160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff758e6a87fa49b99c35558fafe39f11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.117590 30159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 817d4a23671d4a1d9c3b9db3b4e77b0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.119376 30162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63253e2671134725b8fe85f63070e4c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.122812 30158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38e941311158407e8c0e2f4ca4b31d32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.124907 30161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88d3759f7fe14a4d8e7ba8670ce5cfeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.182672 30090 tablet_service.cc:1511] Processing CreateTablet for tablet c6d87bb3ff11400cbdaf30e614c4b3da (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:09:44.184058 30090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6d87bb3ff11400cbdaf30e614c4b3da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.190692 30218 tablet_bootstrap.cc:492] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:44.194885 30018 tablet_service.cc:1511] Processing CreateTablet for tablet c56071aeace442bebfbcd88e12fe4376 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:09:44.196097 30018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c56071aeace442bebfbcd88e12fe4376. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.198858 30017 tablet_service.cc:1511] Processing CreateTablet for tablet e218d3c3e368401a8eff81a5699074b8 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:09:44.200088 30017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e218d3c3e368401a8eff81a5699074b8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.202852 30016 tablet_service.cc:1511] Processing CreateTablet for tablet 1cd924402bd0402aa7ad47fac1308ac9 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:09:44.204066 30090 tablet_service.cc:1511] Processing CreateTablet for tablet 978900c67750481aba3e58987ac43180 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:09:44.205294 30090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 978900c67750481aba3e58987ac43180. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.205159 30015 tablet_service.cc:1511] Processing CreateTablet for tablet 18a72905c2e24e33af2e64672417cfcf (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:09:44.207283 30014 tablet_service.cc:1511] Processing CreateTablet for tablet 98e11967c3504e11865ed831f2584aea (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:09:44.209393 30013 tablet_service.cc:1511] Processing CreateTablet for tablet 63253e2671134725b8fe85f63070e4c8 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:09:44.211553 30012 tablet_service.cc:1511] Processing CreateTablet for tablet 88d3759f7fe14a4d8e7ba8670ce5cfeb (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:09:44.204075 30016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cd924402bd0402aa7ad47fac1308ac9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.218158 30012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88d3759f7fe14a4d8e7ba8670ce5cfeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.221206 30090 tablet_service.cc:1511] Processing CreateTablet for tablet 21562b36aa874c9cba1acd5dc79cf517 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:09:44.222162 30014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98e11967c3504e11865ed831f2584aea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.222381 30090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21562b36aa874c9cba1acd5dc79cf517. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.225057 30013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63253e2671134725b8fe85f63070e4c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.230144 30015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18a72905c2e24e33af2e64672417cfcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.235832 30010 tablet_service.cc:1511] Processing CreateTablet for tablet 817d4a23671d4a1d9c3b9db3b4e77b0f (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:09:44.237159 30010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 817d4a23671d4a1d9c3b9db3b4e77b0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.237599 30011 tablet_service.cc:1511] Processing CreateTablet for tablet ff758e6a87fa49b99c35558fafe39f11 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:09:44.238940 30011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff758e6a87fa49b99c35558fafe39f11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.242873 30009 tablet_service.cc:1511] Processing CreateTablet for tablet 38e941311158407e8c0e2f4ca4b31d32 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:09:44.244920 30009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38e941311158407e8c0e2f4ca4b31d32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.249001 30093 tablet_service.cc:1511] Processing CreateTablet for tablet 777fb4e4b87a4d549e79b74a36a2ac08 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:09:44.250312 30093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 777fb4e4b87a4d549e79b74a36a2ac08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.256577 30085 tablet_service.cc:1511] Processing CreateTablet for tablet b58427f5fe51486b983433e11caa8a3f (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:09:44.251849 30164 tablet_service.cc:1511] Processing CreateTablet for tablet 143490b42f5d4687a680435e8cd86d1f (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:09:44.260635 30164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 143490b42f5d4687a680435e8cd86d1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.213523 30088 tablet_service.cc:1511] Processing CreateTablet for tablet f5616428acc64e24945a779e1aee597f (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:09:44.273517 30167 tablet_service.cc:1511] Processing CreateTablet for tablet 978900c67750481aba3e58987ac43180 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:09:44.274793 30167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 978900c67750481aba3e58987ac43180. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.276955 30164 tablet_service.cc:1511] Processing CreateTablet for tablet c6d87bb3ff11400cbdaf30e614c4b3da (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:09:44.278160 30164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6d87bb3ff11400cbdaf30e614c4b3da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.290325 30167 tablet_service.cc:1511] Processing CreateTablet for tablet 21562b36aa874c9cba1acd5dc79cf517 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:09:44.290382 30091 tablet_service.cc:1511] Processing CreateTablet for tablet 143490b42f5d4687a680435e8cd86d1f (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:09:44.294430 30167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21562b36aa874c9cba1acd5dc79cf517. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.300691 30218 tablet_bootstrap.cc:654] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.300426 30158 tablet_service.cc:1511] Processing CreateTablet for tablet 777fb4e4b87a4d549e79b74a36a2ac08 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:09:44.301725 30158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 777fb4e4b87a4d549e79b74a36a2ac08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.302748 30165 tablet_service.cc:1511] Processing CreateTablet for tablet f68c2b86f7fc4ef48b6dc19371d4560b (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:09:44.303959 30165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f68c2b86f7fc4ef48b6dc19371d4560b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.308790 30162 tablet_service.cc:1511] Processing CreateTablet for tablet b38ec265ce704d799b58d99914a46422 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:09:44.292066 30160 tablet_service.cc:1511] Processing CreateTablet for tablet b58427f5fe51486b983433e11caa8a3f (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:09:44.309891 30167 tablet_service.cc:1511] Processing CreateTablet for tablet 80006b8186d74baba29992ade1966048 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:09:44.311584 30084 tablet_service.cc:1511] Processing CreateTablet for tablet f68c2b86f7fc4ef48b6dc19371d4560b (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:09:44.315899 30162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b38ec265ce704d799b58d99914a46422. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.319254 30092 tablet_service.cc:1511] Processing CreateTablet for tablet b38ec265ce704d799b58d99914a46422 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:09:44.317572 30166 tablet_service.cc:1511] Processing CreateTablet for tablet f5616428acc64e24945a779e1aee597f (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:09:44.320996 30089 tablet_service.cc:1511] Processing CreateTablet for tablet 80006b8186d74baba29992ade1966048 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:09:44.323727 30085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b58427f5fe51486b983433e11caa8a3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.327255 30166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5616428acc64e24945a779e1aee597f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.331765 30088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5616428acc64e24945a779e1aee597f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.333295 30091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 143490b42f5d4687a680435e8cd86d1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.334244 30217 tablet_bootstrap.cc:492] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:44.336720 30015 tablet_service.cc:1511] Processing CreateTablet for tablet 978900c67750481aba3e58987ac43180 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:09:44.333264 30160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b58427f5fe51486b983433e11caa8a3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.337903 30015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 978900c67750481aba3e58987ac43180. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.338598 30092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b38ec265ce704d799b58d99914a46422. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.339707 30167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80006b8186d74baba29992ade1966048. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.346422 30084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f68c2b86f7fc4ef48b6dc19371d4560b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.355049 30219 tablet_bootstrap.cc:492] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:44.374706 30087 tablet_service.cc:1511] Processing CreateTablet for tablet 2ef07e332d8e432eaf9fc64b07cd74f0 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:09:44.363700 30012 tablet_service.cc:1511] Processing CreateTablet for tablet 143490b42f5d4687a680435e8cd86d1f (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:09:44.376529 30012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 143490b42f5d4687a680435e8cd86d1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.367077 30089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80006b8186d74baba29992ade1966048. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.378191 30087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ef07e332d8e432eaf9fc64b07cd74f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.381443 30010 tablet_service.cc:1511] Processing CreateTablet for tablet 21562b36aa874c9cba1acd5dc79cf517 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:09:44.382632 30010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21562b36aa874c9cba1acd5dc79cf517. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.363580 30090 tablet_service.cc:1511] Processing CreateTablet for tablet 3068102662114944a63195a8d764e93d (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:09:44.386560 30090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3068102662114944a63195a8d764e93d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.393880 30087 tablet_service.cc:1511] Processing CreateTablet for tablet d7be23af8c824b3bb048a59d6bdf884c (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:09:44.395196 30087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7be23af8c824b3bb048a59d6bdf884c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.396274 30014 tablet_service.cc:1511] Processing CreateTablet for tablet c6d87bb3ff11400cbdaf30e614c4b3da (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:09:44.397441 30014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6d87bb3ff11400cbdaf30e614c4b3da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.398274 30010 tablet_service.cc:1511] Processing CreateTablet for tablet b58427f5fe51486b983433e11caa8a3f (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:09:44.399565 30010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b58427f5fe51486b983433e11caa8a3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.406522 30016 tablet_service.cc:1511] Processing CreateTablet for tablet 777fb4e4b87a4d549e79b74a36a2ac08 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:09:44.407719 30016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 777fb4e4b87a4d549e79b74a36a2ac08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.408150 30009 tablet_service.cc:1511] Processing CreateTablet for tablet f68c2b86f7fc4ef48b6dc19371d4560b (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:09:44.409282 30009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f68c2b86f7fc4ef48b6dc19371d4560b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.411010 30087 tablet_service.cc:1511] Processing CreateTablet for tablet 64e2b2bd54d3454a9f64030c149e2e25 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:09:44.412290 30087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64e2b2bd54d3454a9f64030c149e2e25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.418359 30010 tablet_service.cc:1511] Processing CreateTablet for tablet b38ec265ce704d799b58d99914a46422 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:09:44.419370 30011 tablet_service.cc:1511] Processing CreateTablet for tablet 80006b8186d74baba29992ade1966048 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:09:44.420256 30010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b38ec265ce704d799b58d99914a46422. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.422119 30159 tablet_service.cc:1511] Processing CreateTablet for tablet 3068102662114944a63195a8d764e93d (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:09:44.422847 30218 tablet_bootstrap.cc:492] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:44.423270 30218 ts_tablet_manager.cc:1403] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.233s	user 0.010s	sys 0.007s
I20260709 13:09:44.426249 30218 raft_consensus.cc:359] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:44.426967 30218 raft_consensus.cc:385] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.427299 30218 raft_consensus.cc:740] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.428170 30218 consensus_queue.cc:260] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:44.419948 30086 tablet_service.cc:1511] Processing CreateTablet for tablet c41a6d79ca9c459eb4b0b41302fb76a9 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:09:44.430452 30086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c41a6d79ca9c459eb4b0b41302fb76a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.439014 30011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80006b8186d74baba29992ade1966048. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.440383 30087 tablet_service.cc:1511] Processing CreateTablet for tablet 48d3196b43924d35bf72234ad500783e (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:09:44.443087 30087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48d3196b43924d35bf72234ad500783e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.423256 30159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3068102662114944a63195a8d764e93d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.443825 30219 tablet_bootstrap.cc:654] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.455719 30088 tablet_service.cc:1511] Processing CreateTablet for tablet fe9a5ae7a3c04826a4bdde9445be46bb (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:09:44.457005 30088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe9a5ae7a3c04826a4bdde9445be46bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.458618 30158 tablet_service.cc:1511] Processing CreateTablet for tablet 2ef07e332d8e432eaf9fc64b07cd74f0 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:09:44.459918 30158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ef07e332d8e432eaf9fc64b07cd74f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.465883 30013 tablet_service.cc:1511] Processing CreateTablet for tablet f5616428acc64e24945a779e1aee597f (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:09:44.467172 30013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5616428acc64e24945a779e1aee597f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.467741 30164 tablet_service.cc:1511] Processing CreateTablet for tablet 64e2b2bd54d3454a9f64030c149e2e25 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:09:44.468896 30164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64e2b2bd54d3454a9f64030c149e2e25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.464286 30092 tablet_service.cc:1511] Processing CreateTablet for tablet 9cd772608bf64bf9b1c1aec00dc57eee (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:09:44.471545 30092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cd772608bf64bf9b1c1aec00dc57eee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.473121 30163 tablet_service.cc:1511] Processing CreateTablet for tablet c41a6d79ca9c459eb4b0b41302fb76a9 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:09:44.474321 30163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c41a6d79ca9c459eb4b0b41302fb76a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.475210 30161 tablet_service.cc:1511] Processing CreateTablet for tablet d7be23af8c824b3bb048a59d6bdf884c (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:09:44.476415 30161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7be23af8c824b3bb048a59d6bdf884c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.482533 30084 tablet_service.cc:1511] Processing CreateTablet for tablet d968b6d22e3243bfb840139be8b6dddd (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:09:44.483726 30084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d968b6d22e3243bfb840139be8b6dddd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.484634 30160 tablet_service.cc:1511] Processing CreateTablet for tablet 48d3196b43924d35bf72234ad500783e (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:09:44.485745 30160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48d3196b43924d35bf72234ad500783e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:44.504907 29974 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:44.493671 30091 tablet_service.cc:1511] Processing CreateTablet for tablet 1136db29fbad4093bcad74bb6274f752 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:09:44.486944 30017 tablet_service.cc:1511] Processing CreateTablet for tablet 3068102662114944a63195a8d764e93d (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:09:44.495014 30217 tablet_bootstrap.cc:654] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.512272 30091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1136db29fbad4093bcad74bb6274f752. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.498003 30010 tablet_service.cc:1511] Processing CreateTablet for tablet 2ef07e332d8e432eaf9fc64b07cd74f0 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:09:44.507144 30166 tablet_service.cc:1511] Processing CreateTablet for tablet fe9a5ae7a3c04826a4bdde9445be46bb (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:09:44.514973 30010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ef07e332d8e432eaf9fc64b07cd74f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.516191 30218 ts_tablet_manager.cc:1434] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.093s	user 0.013s	sys 0.022s
I20260709 13:09:44.516958 30166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe9a5ae7a3c04826a4bdde9445be46bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.504205 30086 tablet_service.cc:1511] Processing CreateTablet for tablet de39104c229542e3a29860956492edea (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:09:44.519032 30086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de39104c229542e3a29860956492edea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.519767 30128 heartbeater.cc:499] Master 127.28.54.126:45283 was elected leader, sending a full tablet report...
I20260709 13:09:44.502398 30167 tablet_service.cc:1511] Processing CreateTablet for tablet 9cd772608bf64bf9b1c1aec00dc57eee (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:09:44.522439 30167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cd772608bf64bf9b1c1aec00dc57eee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.490725 30085 tablet_service.cc:1511] Processing CreateTablet for tablet 64effd13e9a741368e16bc2f52fb573c (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:09:44.525079 30165 tablet_service.cc:1511] Processing CreateTablet for tablet d968b6d22e3243bfb840139be8b6dddd (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:09:44.529142 30165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d968b6d22e3243bfb840139be8b6dddd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.525079 30162 tablet_service.cc:1511] Processing CreateTablet for tablet de39104c229542e3a29860956492edea (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:09:44.534467 30218 tablet_bootstrap.cc:492] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:44.534622 30017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3068102662114944a63195a8d764e93d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.534905 30162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de39104c229542e3a29860956492edea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.529094 30085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64effd13e9a741368e16bc2f52fb573c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.541811 30093 tablet_service.cc:1511] Processing CreateTablet for tablet 24644eca754d40189c8264977160368a (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:09:44.543035 30093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24644eca754d40189c8264977160368a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.546226 30018 tablet_service.cc:1511] Processing CreateTablet for tablet c41a6d79ca9c459eb4b0b41302fb76a9 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:09:44.547441 30018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c41a6d79ca9c459eb4b0b41302fb76a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.557539 30158 tablet_service.cc:1511] Processing CreateTablet for tablet 64effd13e9a741368e16bc2f52fb573c (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:09:44.573263 30015 tablet_service.cc:1511] Processing CreateTablet for tablet d7be23af8c824b3bb048a59d6bdf884c (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:09:44.574496 30219 tablet_bootstrap.cc:492] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:44.582314 30219 ts_tablet_manager.cc:1403] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.227s	user 0.014s	sys 0.021s
I20260709 13:09:44.584998 30219 raft_consensus.cc:359] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:44.585661 30219 raft_consensus.cc:385] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.585964 30219 raft_consensus.cc:740] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.586790 30219 consensus_queue.cc:260] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:44.569952 30158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64effd13e9a741368e16bc2f52fb573c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.581920 30218 tablet_bootstrap.cc:654] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.579656 30016 tablet_service.cc:1511] Processing CreateTablet for tablet 9cd772608bf64bf9b1c1aec00dc57eee (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:09:44.595148 30090 tablet_service.cc:1511] Processing CreateTablet for tablet b66f98d7fcfe4102a01ace9ed64355ed (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:09:44.596285 30090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b66f98d7fcfe4102a01ace9ed64355ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.574649 30015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7be23af8c824b3bb048a59d6bdf884c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.605682 30016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cd772608bf64bf9b1c1aec00dc57eee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.609174 30089 tablet_service.cc:1511] Processing CreateTablet for tablet d3f3f9c9793f4390874e250718c41697 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:09:44.609903 30087 tablet_service.cc:1511] Processing CreateTablet for tablet 407fb380b889498d94c7525edbc34b23 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:09:44.610564 30089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3f3f9c9793f4390874e250718c41697. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.615773 30012 tablet_service.cc:1511] Processing CreateTablet for tablet 48d3196b43924d35bf72234ad500783e (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:09:44.617048 30012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48d3196b43924d35bf72234ad500783e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.624833 30217 tablet_bootstrap.cc:492] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:44.625308 30217 ts_tablet_manager.cc:1403] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.291s	user 0.024s	sys 0.009s
I20260709 13:09:44.628275 30217 raft_consensus.cc:359] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:44.628991 30217 raft_consensus.cc:385] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.629326 30217 raft_consensus.cc:740] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.630087 30217 consensus_queue.cc:260] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:44.633623 30087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 407fb380b889498d94c7525edbc34b23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.573876 30011 tablet_service.cc:1511] Processing CreateTablet for tablet 64e2b2bd54d3454a9f64030c149e2e25 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:09:44.638664 30011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64e2b2bd54d3454a9f64030c149e2e25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.644901 30014 tablet_service.cc:1511] Processing CreateTablet for tablet fe9a5ae7a3c04826a4bdde9445be46bb (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:09:44.663918 30166 tablet_service.cc:1511] Processing CreateTablet for tablet 24644eca754d40189c8264977160368a (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:09:44.665293 30166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24644eca754d40189c8264977160368a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.667999 30160 tablet_service.cc:1511] Processing CreateTablet for tablet b66f98d7fcfe4102a01ace9ed64355ed (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:09:44.669267 30160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b66f98d7fcfe4102a01ace9ed64355ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.669679 30088 tablet_service.cc:1511] Processing CreateTablet for tablet 802499fd316b44c9b21bede0e714fcfb (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:09:44.673807 30088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 802499fd316b44c9b21bede0e714fcfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.678748 30053 heartbeater.cc:499] Master 127.28.54.126:45283 was elected leader, sending a full tablet report...
I20260709 13:09:44.671693 30165 tablet_service.cc:1511] Processing CreateTablet for tablet d3f3f9c9793f4390874e250718c41697 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:09:44.679884 30165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3f3f9c9793f4390874e250718c41697. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.681036 30167 tablet_service.cc:1511] Processing CreateTablet for tablet 407fb380b889498d94c7525edbc34b23 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:09:44.671339 30092 tablet_service.cc:1511] Processing CreateTablet for tablet 2964592ff08b4434889d830c05501d8e (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:09:44.684252 30159 tablet_service.cc:1511] Processing CreateTablet for tablet 1136db29fbad4093bcad74bb6274f752 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:09:44.684706 30092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2964592ff08b4434889d830c05501d8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.672793 30091 tablet_service.cc:1511] Processing CreateTablet for tablet ea42d6bd0dbb4438a96c31b335069e3c (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:09:44.699452 30086 tablet_service.cc:1511] Processing CreateTablet for tablet 651beb51dcbf4055b1178a304fe23043 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:09:44.700683 30091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea42d6bd0dbb4438a96c31b335069e3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.700340 30013 tablet_service.cc:1511] Processing CreateTablet for tablet de39104c229542e3a29860956492edea (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:09:44.706473 30224 raft_consensus.cc:493] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.707181 30167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 407fb380b889498d94c7525edbc34b23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.706987 30224 raft_consensus.cc:515] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:44.708185 30159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1136db29fbad4093bcad74bb6274f752. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.714692 30218 tablet_bootstrap.cc:492] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:44.715198 30218 ts_tablet_manager.cc:1403] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.181s	user 0.010s	sys 0.006s
I20260709 13:09:44.716797 30086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 651beb51dcbf4055b1178a304fe23043. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.720770 30163 tablet_service.cc:1511] Processing CreateTablet for tablet 802499fd316b44c9b21bede0e714fcfb (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:09:44.696925 30014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe9a5ae7a3c04826a4bdde9445be46bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.729444 30221 raft_consensus.cc:493] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.738459 30219 ts_tablet_manager.cc:1434] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.156s	user 0.009s	sys 0.014s
I20260709 13:09:44.738184 30221 raft_consensus.cc:515] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:44.727283 30224 leader_election.cc:290] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:44.718894 30009 tablet_service.cc:1511] Processing CreateTablet for tablet d968b6d22e3243bfb840139be8b6dddd (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:09:44.740763 30221 leader_election.cc:290] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:44.729820 30218 raft_consensus.cc:359] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:44.762730 30163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 802499fd316b44c9b21bede0e714fcfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.739929 30090 tablet_service.cc:1511] Processing CreateTablet for tablet 56168b79f56f4dee859bee3ef7df4712 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:09:44.770533 30202 heartbeater.cc:499] Master 127.28.54.126:45283 was elected leader, sending a full tablet report...
I20260709 13:09:44.771235 30016 tablet_service.cc:1511] Processing CreateTablet for tablet b66f98d7fcfe4102a01ace9ed64355ed (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:09:44.764277 30013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet de39104c229542e3a29860956492edea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.776716 30217 ts_tablet_manager.cc:1434] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.151s	user 0.005s	sys 0.008s
I20260709 13:09:44.777771 30217 tablet_bootstrap.cc:492] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:44.763165 30218 raft_consensus.cc:385] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:44.744186 30164 tablet_service.cc:1511] Processing CreateTablet for tablet 2964592ff08b4434889d830c05501d8e (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:09:44.785888 30018 tablet_service.cc:1511] Processing CreateTablet for tablet 64effd13e9a741368e16bc2f52fb573c (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:09:44.787118 30010 tablet_service.cc:1511] Processing CreateTablet for tablet 1136db29fbad4093bcad74bb6274f752 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:09:44.768793 30017 tablet_service.cc:1511] Processing CreateTablet for tablet 24644eca754d40189c8264977160368a (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:09:44.788064 30084 tablet_service.cc:1511] Processing CreateTablet for tablet b52e70a06b534fbf90cbcb6a010e9d43 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:09:44.792897 30218 raft_consensus.cc:740] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:44.798851 30218 consensus_queue.cc:260] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:44.800056 30093 tablet_service.cc:1511] Processing CreateTablet for tablet f5c869d5410b4a83adc1ca35397defb6 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:09:44.800895 30218 ts_tablet_manager.cc:1434] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.085s	user 0.007s	sys 0.000s
I20260709 13:09:44.809346 30011 tablet_service.cc:1511] Processing CreateTablet for tablet d3f3f9c9793f4390874e250718c41697 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:09:44.812548 30012 tablet_service.cc:1511] Processing CreateTablet for tablet 407fb380b889498d94c7525edbc34b23 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:09:44.818189 30164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2964592ff08b4434889d830c05501d8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.822011 30087 tablet_service.cc:1511] Processing CreateTablet for tablet 3a0f0dc1823e4c99aa3cc53ce8a58efa (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:09:44.824189 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:44.824404 30015 tablet_service.cc:1511] Processing CreateTablet for tablet 802499fd316b44c9b21bede0e714fcfb (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:09:44.825456 30218 tablet_bootstrap.cc:492] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
W20260709 13:09:44.825784 29993 leader_election.cc:343] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:44.826236 30161 tablet_service.cc:1511] Processing CreateTablet for tablet 651beb51dcbf4055b1178a304fe23043 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:09:44.826597 30091 tablet_service.cc:1511] Processing CreateTablet for tablet 8495d060d6b042a3b7bd9dba1055dbbf (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:09:44.827451 30161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 651beb51dcbf4055b1178a304fe23043. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.796711 30219 tablet_bootstrap.cc:492] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:44.829833 30090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56168b79f56f4dee859bee3ef7df4712. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.833827 30012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 407fb380b889498d94c7525edbc34b23. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.838400 30084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b52e70a06b534fbf90cbcb6a010e9d43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.840664 30165 tablet_service.cc:1511] Processing CreateTablet for tablet 56168b79f56f4dee859bee3ef7df4712 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:09:44.847227 30217 tablet_bootstrap.cc:654] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.857690 30162 tablet_service.cc:1511] Processing CreateTablet for tablet f5c869d5410b4a83adc1ca35397defb6 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:09:44.858566 30158 tablet_service.cc:1511] Processing CreateTablet for tablet ea42d6bd0dbb4438a96c31b335069e3c (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:09:44.858994 30162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5c869d5410b4a83adc1ca35397defb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.859709 30158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea42d6bd0dbb4438a96c31b335069e3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.870987 30009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d968b6d22e3243bfb840139be8b6dddd. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:44.871353 29913 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 50299.4us
I20260709 13:09:44.871734 30010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1136db29fbad4093bcad74bb6274f752. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.870934 30093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5c869d5410b4a83adc1ca35397defb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.873303 30016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b66f98d7fcfe4102a01ace9ed64355ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.876200 30091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8495d060d6b042a3b7bd9dba1055dbbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.882009 30018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64effd13e9a741368e16bc2f52fb573c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:44.870913 29912 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 74327.1us
I20260709 13:09:44.899657 30011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3f3f9c9793f4390874e250718c41697. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.899463 30088 tablet_service.cc:1511] Processing CreateTablet for tablet 8a3e809a994e4cbf98d7ea56807b8dad (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:09:44.900930 30017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24644eca754d40189c8264977160368a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.905196 30092 tablet_service.cc:1511] Processing CreateTablet for tablet f8fcd3026125450694af59415c94e029 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:09:44.906222 30015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 802499fd316b44c9b21bede0e714fcfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.913378 30165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56168b79f56f4dee859bee3ef7df4712. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.909684 30161 tablet_service.cc:1511] Processing CreateTablet for tablet 8495d060d6b042a3b7bd9dba1055dbbf (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:09:44.916627 30161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8495d060d6b042a3b7bd9dba1055dbbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.927039 30085 tablet_service.cc:1511] Processing CreateTablet for tablet 7d7c81315a41495eafb4a8020a99cb7c (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:09:44.932929 30012 tablet_service.cc:1511] Processing CreateTablet for tablet 2964592ff08b4434889d830c05501d8e (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:09:44.938627 30012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2964592ff08b4434889d830c05501d8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.937361 30164 tablet_service.cc:1511] Processing CreateTablet for tablet 8a3e809a994e4cbf98d7ea56807b8dad (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:09:44.945330 30164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a3e809a994e4cbf98d7ea56807b8dad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.946777 30167 tablet_service.cc:1511] Processing CreateTablet for tablet b52e70a06b534fbf90cbcb6a010e9d43 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:09:44.948017 30167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b52e70a06b534fbf90cbcb6a010e9d43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.956481 30009 tablet_service.cc:1511] Processing CreateTablet for tablet 651beb51dcbf4055b1178a304fe23043 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:09:44.958742 30091 tablet_service.cc:1511] Processing CreateTablet for tablet f7c9e9bbe0c44a8d803c3d45799906f2 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:09:44.962364 30218 tablet_bootstrap.cc:654] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.967834 30221 raft_consensus.cc:493] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:44.968298 30221 raft_consensus.cc:515] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:44.963258 30087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a0f0dc1823e4c99aa3cc53ce8a58efa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.970758 30009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 651beb51dcbf4055b1178a304fe23043. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.971272 30221 leader_election.cc:290] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:44.982357 30163 tablet_service.cc:1511] Processing CreateTablet for tablet f8fcd3026125450694af59415c94e029 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:09:44.983636 30163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8fcd3026125450694af59415c94e029. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.987321 30219 tablet_bootstrap.cc:654] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:44.988018 30092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8fcd3026125450694af59415c94e029. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.989212 30085 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d7c81315a41495eafb4a8020a99cb7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.990680 30091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7c9e9bbe0c44a8d803c3d45799906f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.993304 30165 tablet_service.cc:1511] Processing CreateTablet for tablet 7d7c81315a41495eafb4a8020a99cb7c (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:09:44.994107 30088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a3e809a994e4cbf98d7ea56807b8dad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:44.996093 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:44.997423 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:09:44.999069 30068 leader_election.cc:343] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:44.999732 30068 leader_election.cc:343] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:44.989769 30011 tablet_service.cc:1511] Processing CreateTablet for tablet ea42d6bd0dbb4438a96c31b335069e3c (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:09:45.001282 30011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea42d6bd0dbb4438a96c31b335069e3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:45.011454 30165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d7c81315a41495eafb4a8020a99cb7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:45.013165 30016 tablet_service.cc:1511] Processing CreateTablet for tablet 56168b79f56f4dee859bee3ef7df4712 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:09:45.014647 30093 tablet_service.cc:1511] Processing CreateTablet for tablet 0be979412dd54241bd212ddbb7611046 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:09:45.021108 30086 tablet_service.cc:1511] Processing CreateTablet for tablet 632c5405056e40be8152973f0c966318 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:09:45.021600 30226 raft_consensus.cc:493] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.022428 30086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 632c5405056e40be8152973f0c966318. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:45.022050 30226 raft_consensus.cc:515] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.025951 30226 leader_election.cc:290] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:45.039862 30160 tablet_service.cc:1511] Processing CreateTablet for tablet f7c9e9bbe0c44a8d803c3d45799906f2 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:09:45.041941 30016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56168b79f56f4dee859bee3ef7df4712. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:45.046999 30093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0be979412dd54241bd212ddbb7611046. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:45.024930 30159 tablet_service.cc:1511] Processing CreateTablet for tablet 3a0f0dc1823e4c99aa3cc53ce8a58efa (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:09:45.055889 30160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7c9e9bbe0c44a8d803c3d45799906f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:45.058187 30088 tablet_service.cc:1511] Processing CreateTablet for tablet 30a540a1b03746b785f2fc4692e05833 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:09:45.060144 30090 tablet_service.cc:1511] Processing CreateTablet for tablet 5c8539fb97344b07aed5af91eaf0806f (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:09:45.066355 30219 tablet_bootstrap.cc:492] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:45.071831 30219 ts_tablet_manager.cc:1403] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.303s	user 0.022s	sys 0.009s
I20260709 13:09:45.079265 30088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30a540a1b03746b785f2fc4692e05833. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:45.079946 30090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c8539fb97344b07aed5af91eaf0806f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:45.083089 30166 tablet_service.cc:1511] Processing CreateTablet for tablet 0be979412dd54241bd212ddbb7611046 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:09:45.096256 30217 tablet_bootstrap.cc:492] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:45.096799 30217 ts_tablet_manager.cc:1403] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.319s	user 0.018s	sys 0.009s
I20260709 13:09:45.096917 30017 tablet_service.cc:1511] Processing CreateTablet for tablet 8a3e809a994e4cbf98d7ea56807b8dad (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:09:45.098642 30015 tablet_service.cc:1511] Processing CreateTablet for tablet 0be979412dd54241bd212ddbb7611046 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:09:45.099885 30217 raft_consensus.cc:359] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.107249 30159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a0f0dc1823e4c99aa3cc53ce8a58efa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:45.108249 30018 tablet_service.cc:1511] Processing CreateTablet for tablet f5c869d5410b4a83adc1ca35397defb6 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:09:45.112807 30219 raft_consensus.cc:359] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.115087 30014 tablet_service.cc:1511] Processing CreateTablet for tablet b52e70a06b534fbf90cbcb6a010e9d43 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:09:45.149921 30219 raft_consensus.cc:385] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.150293 30219 raft_consensus.cc:740] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.150987 30219 consensus_queue.cc:260] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.151938 30092 tablet_service.cc:1511] Processing CreateTablet for tablet 31b19922895c4885a5a8bc5030afcba3 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:09:45.153087 30092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31b19922895c4885a5a8bc5030afcba3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:45.153517 30219 ts_tablet_manager.cc:1434] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.078s	user 0.006s	sys 0.000s
I20260709 13:09:45.154557 30219 tablet_bootstrap.cc:492] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:45.156287 30167 tablet_service.cc:1511] Processing CreateTablet for tablet 31b19922895c4885a5a8bc5030afcba3 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:09:45.157516 30167 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31b19922895c4885a5a8bc5030afcba3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:45.119002 30012 tablet_service.cc:1511] Processing CreateTablet for tablet 3a0f0dc1823e4c99aa3cc53ce8a58efa (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:09:45.120095 30013 tablet_service.cc:1511] Processing CreateTablet for tablet 8495d060d6b042a3b7bd9dba1055dbbf (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:09:45.125356 30010 tablet_service.cc:1511] Processing CreateTablet for tablet f8fcd3026125450694af59415c94e029 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:09:45.162019 30084 tablet_service.cc:1511] Processing CreateTablet for tablet 57ce415a86d343cb8bdff28acc41c6a6 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:09:45.137322 30217 raft_consensus.cc:385] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.163053 30217 raft_consensus.cc:740] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.143149 30090 tablet_service.cc:1511] Processing CreateTablet for tablet 0a722bee3f14472ebed5b798e61c64b3 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:09:45.146493 30017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a3e809a994e4cbf98d7ea56807b8dad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:45.146750 30162 tablet_service.cc:1511] Processing CreateTablet for tablet 0a722bee3f14472ebed5b798e61c64b3 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:09:45.163865 30217 consensus_queue.cc:260] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.164531 30162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a722bee3f14472ebed5b798e61c64b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:45.166778 30217 ts_tablet_manager.cc:1434] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.070s	user 0.007s	sys 0.001s
I20260709 13:09:45.167680 30217 tablet_bootstrap.cc:492] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:45.168218 30089 tablet_service.cc:1511] Processing CreateTablet for tablet f71bd695ecc748db8c77f136fb53616b (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:09:45.140162 30165 tablet_service.cc:1511] Processing CreateTablet for tablet 5c8539fb97344b07aed5af91eaf0806f (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:09:45.170559 30165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c8539fb97344b07aed5af91eaf0806f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:45.163211 30084 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57ce415a86d343cb8bdff28acc41c6a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:45.133699 30161 tablet_service.cc:1511] Processing CreateTablet for tablet 632c5405056e40be8152973f0c966318 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:09:45.175719 30161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 632c5405056e40be8152973f0c966318. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:45.177964 30217 tablet_bootstrap.cc:654] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.181159 30087 tablet_service.cc:1511] Processing CreateTablet for tablet 5a14bd61c7a94d1ca54063afae0c68e8 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:09:45.182924 30158 tablet_service.cc:1511] Processing CreateTablet for tablet 57ce415a86d343cb8bdff28acc41c6a6 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:09:45.147707 30009 tablet_service.cc:1511] Processing CreateTablet for tablet 7d7c81315a41495eafb4a8020a99cb7c (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:09:45.183825 30011 tablet_service.cc:1511] Processing CreateTablet for tablet f7c9e9bbe0c44a8d803c3d45799906f2 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:09:45.199775 30090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a722bee3f14472ebed5b798e61c64b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:45.206243 30010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8fcd3026125450694af59415c94e029. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:45.206859 30089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f71bd695ecc748db8c77f136fb53616b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:45.193699 30160 tablet_service.cc:1511] Processing CreateTablet for tablet f71bd695ecc748db8c77f136fb53616b (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:09:45.207710 30011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7c9e9bbe0c44a8d803c3d45799906f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:45.208309 30015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0be979412dd54241bd212ddbb7611046. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:45.203099 30166 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0be979412dd54241bd212ddbb7611046. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:45.220050 30218 tablet_bootstrap.cc:492] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:45.220551 30218 ts_tablet_manager.cc:1403] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.419s	user 0.017s	sys 0.002s
I20260709 13:09:45.222623 30091 tablet_service.cc:1511] Processing CreateTablet for tablet 935127b9887c4175b5b65fd739c5cffe (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:09:45.223423 30218 raft_consensus.cc:359] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.224143 30218 raft_consensus.cc:385] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.224674 30218 raft_consensus.cc:740] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.225526 30218 consensus_queue.cc:260] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.196970 30164 tablet_service.cc:1511] Processing CreateTablet for tablet 30a540a1b03746b785f2fc4692e05833 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:09:45.223920 30158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57ce415a86d343cb8bdff28acc41c6a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:45.230757 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:45.232208 30163 tablet_service.cc:1511] Processing CreateTablet for tablet 5a14bd61c7a94d1ca54063afae0c68e8 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:09:45.235131 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
W20260709 13:09:45.236600 30143 leader_election.cc:343] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:45.237324 30218 ts_tablet_manager.cc:1434] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.001s
I20260709 13:09:45.237923 30013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8495d060d6b042a3b7bd9dba1055dbbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:45.238507 30014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b52e70a06b534fbf90cbcb6a010e9d43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:45.239279 30087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a14bd61c7a94d1ca54063afae0c68e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:45.242029 30018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5c869d5410b4a83adc1ca35397defb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:45.242722 30012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a0f0dc1823e4c99aa3cc53ce8a58efa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:45.247519 30009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d7c81315a41495eafb4a8020a99cb7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:45.253197 30164 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30a540a1b03746b785f2fc4692e05833. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:45.260576 30218 tablet_bootstrap.cc:492] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:45.266353 30091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 935127b9887c4175b5b65fd739c5cffe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:45.267685 30163 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a14bd61c7a94d1ca54063afae0c68e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:45.268689 30160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f71bd695ecc748db8c77f136fb53616b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:45.270789 30016 tablet_service.cc:1511] Processing CreateTablet for tablet 0a722bee3f14472ebed5b798e61c64b3 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:09:45.272086 30016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a722bee3f14472ebed5b798e61c64b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:45.278187 30165 tablet_service.cc:1511] Processing CreateTablet for tablet 935127b9887c4175b5b65fd739c5cffe (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:09:45.279542 30165 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 935127b9887c4175b5b65fd739c5cffe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:45.320822 30012 tablet_service.cc:1511] Processing CreateTablet for tablet 632c5405056e40be8152973f0c966318 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:09:45.327459 30012 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 632c5405056e40be8152973f0c966318. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:45.330614 30015 tablet_service.cc:1511] Processing CreateTablet for tablet 5c8539fb97344b07aed5af91eaf0806f (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:09:45.331883 30015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c8539fb97344b07aed5af91eaf0806f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:45.335486 30218 tablet_bootstrap.cc:654] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:45.337334 29994 leader_election.cc:343] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:45.352138 29994 leader_election.cc:304] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:09:45.352677 30010 tablet_service.cc:1511] Processing CreateTablet for tablet 30a540a1b03746b785f2fc4692e05833 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:09:45.353163 30227 raft_consensus.cc:2749] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:45.341383 29913 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 56907.9us
I20260709 13:09:45.356516 30018 tablet_service.cc:1511] Processing CreateTablet for tablet f71bd695ecc748db8c77f136fb53616b (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:09:45.358232 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:45.359480 30217 tablet_bootstrap.cc:492] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:45.359941 30217 ts_tablet_manager.cc:1403] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.192s	user 0.009s	sys 0.003s
I20260709 13:09:45.360846 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:45.362067 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:45.362699 30027 raft_consensus.cc:2468] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 0.
I20260709 13:09:45.363615 30219 tablet_bootstrap.cc:654] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.374080 30018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f71bd695ecc748db8c77f136fb53616b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:45.375265 30066 leader_election.cc:343] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:45.375759 30066 leader_election.cc:304] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:09:45.376885 30221 raft_consensus.cc:2749] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:45.377414 30010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30a540a1b03746b785f2fc4692e05833. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:09:45.376955 30140 leader_election.cc:343] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:45.377978 30140 leader_election.cc:304] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:09:45.379047 30226 raft_consensus.cc:2749] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:45.382298 30017 tablet_service.cc:1511] Processing CreateTablet for tablet 31b19922895c4885a5a8bc5030afcba3 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:09:45.383612 30017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31b19922895c4885a5a8bc5030afcba3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:45.386251 30066 leader_election.cc:304] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:09:45.387336 30221 raft_consensus.cc:2804] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:45.387765 30221 raft_consensus.cc:493] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.387516 30217 raft_consensus.cc:359] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.387655 30015 tablet_service.cc:1511] Processing CreateTablet for tablet 57ce415a86d343cb8bdff28acc41c6a6 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:09:45.388192 30221 raft_consensus.cc:3060] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.392623 30015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57ce415a86d343cb8bdff28acc41c6a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:45.388265 30217 raft_consensus.cc:385] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.401604 30217 raft_consensus.cc:740] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.402401 30217 consensus_queue.cc:260] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.413293 30221 raft_consensus.cc:515] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.415731 30009 tablet_service.cc:1511] Processing CreateTablet for tablet 5a14bd61c7a94d1ca54063afae0c68e8 (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:09:45.416472 30010 tablet_service.cc:1511] Processing CreateTablet for tablet 935127b9887c4175b5b65fd739c5cffe (DEFAULT_TABLE table=test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:09:45.416991 30009 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a14bd61c7a94d1ca54063afae0c68e8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:45.416838 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:09:45.419273 30219 tablet_bootstrap.cc:492] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:45.419713 30219 ts_tablet_manager.cc:1403] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.265s	user 0.015s	sys 0.008s
I20260709 13:09:45.419042 30176 raft_consensus.cc:3060] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.417408 30221 leader_election.cc:290] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:45.418257 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:09:45.420895 30010 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 935127b9887c4175b5b65fd739c5cffe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:45.426759 30027 raft_consensus.cc:3060] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.426888 30176 raft_consensus.cc:2468] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 1.
I20260709 13:09:45.428036 30068 leader_election.cc:304] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:45.422973 30219 raft_consensus.cc:359] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.426304 30217 ts_tablet_manager.cc:1434] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.066s	user 0.007s	sys 0.002s
I20260709 13:09:45.442140 30217 tablet_bootstrap.cc:492] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:45.435117 30218 tablet_bootstrap.cc:492] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:45.442808 30218 ts_tablet_manager.cc:1403] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.182s	user 0.016s	sys 0.005s
I20260709 13:09:45.445043 30219 raft_consensus.cc:385] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.445690 30218 raft_consensus.cc:359] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.438472 30027 raft_consensus.cc:2468] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 1.
I20260709 13:09:45.429535 30221 raft_consensus.cc:2804] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:45.445987 30219 raft_consensus.cc:740] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.447007 30218 raft_consensus.cc:385] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.447576 30221 raft_consensus.cc:697] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:09:45.448722 30218 raft_consensus.cc:740] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.449347 30221 consensus_queue.cc:237] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.449563 30218 consensus_queue.cc:260] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.450165 30217 tablet_bootstrap.cc:654] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.448501 30219 consensus_queue.cc:260] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.458356 30218 ts_tablet_manager.cc:1434] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.009s
I20260709 13:09:45.459326 30218 tablet_bootstrap.cc:492] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:45.459662 30219 ts_tablet_manager.cc:1434] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.003s
I20260709 13:09:45.460783 30219 tablet_bootstrap.cc:492] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:45.469652 29925 catalog_manager.cc:5697] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:45.464525 30218 tablet_bootstrap.cc:654] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.475215 30219 tablet_bootstrap.cc:654] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.476364 30217 tablet_bootstrap.cc:492] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:45.476871 30217 ts_tablet_manager.cc:1403] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.035s	user 0.027s	sys 0.004s
I20260709 13:09:45.479802 30217 raft_consensus.cc:359] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.480523 30217 raft_consensus.cc:385] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.480810 30217 raft_consensus.cc:740] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.481658 30217 consensus_queue.cc:260] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.485620 30217 ts_tablet_manager.cc:1434] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 13:09:45.486955 30217 tablet_bootstrap.cc:492] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:45.489005 30219 tablet_bootstrap.cc:492] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:45.489568 30219 ts_tablet_manager.cc:1403] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.008s
I20260709 13:09:45.492117 30218 tablet_bootstrap.cc:492] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:45.494136 30218 ts_tablet_manager.cc:1403] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.035s	user 0.013s	sys 0.008s
I20260709 13:09:45.494379 30219 raft_consensus.cc:359] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.495092 30219 raft_consensus.cc:385] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.495371 30219 raft_consensus.cc:740] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.496425 30219 consensus_queue.cc:260] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.492573 30217 tablet_bootstrap.cc:654] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.497350 30218 raft_consensus.cc:359] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.498046 30218 raft_consensus.cc:385] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.498332 30218 raft_consensus.cc:740] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.498430 30219 ts_tablet_manager.cc:1434] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 13:09:45.499013 30218 consensus_queue.cc:260] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.499818 30219 tablet_bootstrap.cc:492] T 1cd924402bd0402aa7ad47fac1308ac9 P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:45.501094 30218 ts_tablet_manager.cc:1434] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:09:45.502063 30218 tablet_bootstrap.cc:492] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:45.505693 30219 tablet_bootstrap.cc:654] T 1cd924402bd0402aa7ad47fac1308ac9 P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.508282 30218 tablet_bootstrap.cc:654] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:45.513373 29974 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:45.514102 30217 tablet_bootstrap.cc:492] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:45.514599 30217 ts_tablet_manager.cc:1403] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.028s	user 0.001s	sys 0.015s
I20260709 13:09:45.517779 30217 raft_consensus.cc:359] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.518551 30217 raft_consensus.cc:385] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.518847 30217 raft_consensus.cc:740] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.519498 30217 consensus_queue.cc:260] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.521597 30217 ts_tablet_manager.cc:1434] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:09:45.523291 30218 tablet_bootstrap.cc:492] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:45.523732 30218 ts_tablet_manager.cc:1403] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.005s
I20260709 13:09:45.524343 30219 tablet_bootstrap.cc:492] T 1cd924402bd0402aa7ad47fac1308ac9 P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:45.524842 30219 ts_tablet_manager.cc:1403] T 1cd924402bd0402aa7ad47fac1308ac9 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.001s
I20260709 13:09:45.526458 30218 raft_consensus.cc:359] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.527153 30218 raft_consensus.cc:385] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.527432 30218 raft_consensus.cc:740] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.527474 30219 raft_consensus.cc:359] T 1cd924402bd0402aa7ad47fac1308ac9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.528241 30219 raft_consensus.cc:385] T 1cd924402bd0402aa7ad47fac1308ac9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.528174 30218 consensus_queue.cc:260] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.528610 30219 raft_consensus.cc:740] T 1cd924402bd0402aa7ad47fac1308ac9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.529315 30219 consensus_queue.cc:260] T 1cd924402bd0402aa7ad47fac1308ac9 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.530277 30218 ts_tablet_manager.cc:1434] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:09:45.531510 30218 tablet_bootstrap.cc:492] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:45.531589 30219 ts_tablet_manager.cc:1434] T 1cd924402bd0402aa7ad47fac1308ac9 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 13:09:45.532636 30219 tablet_bootstrap.cc:492] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:45.533267 30217 tablet_bootstrap.cc:492] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:45.537580 30218 tablet_bootstrap.cc:654] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.538668 30219 tablet_bootstrap.cc:654] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.540123 30217 tablet_bootstrap.cc:654] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.565289 30218 tablet_bootstrap.cc:492] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:45.565725 30218 ts_tablet_manager.cc:1403] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.034s	user 0.016s	sys 0.016s
I20260709 13:09:45.565930 30219 tablet_bootstrap.cc:492] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:45.566341 30219 ts_tablet_manager.cc:1403] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.034s	user 0.017s	sys 0.016s
I20260709 13:09:45.566944 30217 tablet_bootstrap.cc:492] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:45.567380 30217 ts_tablet_manager.cc:1403] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.016s
I20260709 13:09:45.568523 30219 raft_consensus.cc:359] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.568533 30218 raft_consensus.cc:359] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.569119 30219 raft_consensus.cc:385] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.569397 30219 raft_consensus.cc:740] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.569360 30218 raft_consensus.cc:385] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.569924 30218 raft_consensus.cc:740] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.570230 30219 consensus_queue.cc:260] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.570712 30227 raft_consensus.cc:493] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.570317 30217 raft_consensus.cc:359] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.570606 30218 consensus_queue.cc:260] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.571300 30217 raft_consensus.cc:385] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.571306 30227 raft_consensus.cc:515] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.573877 30217 raft_consensus.cc:740] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.574622 30217 consensus_queue.cc:260] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.575379 30227 leader_election.cc:290] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:45.576643 30217 ts_tablet_manager.cc:1434] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 13:09:45.576869 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:45.577555 30217 tablet_bootstrap.cc:492] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
W20260709 13:09:45.578270 29994 leader_election.cc:343] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:45.573055 30218 ts_tablet_manager.cc:1434] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:09:45.573529 30219 ts_tablet_manager.cc:1434] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:09:45.579456 30219 tablet_bootstrap.cc:492] T 38e941311158407e8c0e2f4ca4b31d32 P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:45.580574 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:09:45.581908 29993 leader_election.cc:343] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:45.582307 29993 leader_election.cc:304] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:09:45.583709 30217 tablet_bootstrap.cc:654] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.584944 30227 raft_consensus.cc:2749] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:45.585651 30219 tablet_bootstrap.cc:654] T 38e941311158407e8c0e2f4ca4b31d32 P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.589221 30217 tablet_bootstrap.cc:492] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:45.589277 30218 tablet_bootstrap.cc:492] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:45.590833 30217 ts_tablet_manager.cc:1403] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.013s	user 0.013s	sys 0.000s
I20260709 13:09:45.594548 30217 raft_consensus.cc:359] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.595285 30217 raft_consensus.cc:385] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.595614 30217 raft_consensus.cc:740] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.596508 30217 consensus_queue.cc:260] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.597110 30218 tablet_bootstrap.cc:654] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.598951 30217 ts_tablet_manager.cc:1434] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:09:45.599917 30217 tablet_bootstrap.cc:492] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:45.601240 30219 tablet_bootstrap.cc:492] T 38e941311158407e8c0e2f4ca4b31d32 P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:45.601783 30219 ts_tablet_manager.cc:1403] T 38e941311158407e8c0e2f4ca4b31d32 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.022s	user 0.010s	sys 0.001s
I20260709 13:09:45.604494 30219 raft_consensus.cc:359] T 38e941311158407e8c0e2f4ca4b31d32 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.605216 30219 raft_consensus.cc:385] T 38e941311158407e8c0e2f4ca4b31d32 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.606205 30217 tablet_bootstrap.cc:654] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.606570 30219 raft_consensus.cc:740] T 38e941311158407e8c0e2f4ca4b31d32 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.607651 30218 tablet_bootstrap.cc:492] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:45.607440 30219 consensus_queue.cc:260] T 38e941311158407e8c0e2f4ca4b31d32 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.608091 30218 ts_tablet_manager.cc:1403] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 13:09:45.609810 30219 ts_tablet_manager.cc:1434] T 38e941311158407e8c0e2f4ca4b31d32 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:09:45.610721 30219 tablet_bootstrap.cc:492] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:45.610720 30218 raft_consensus.cc:359] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.611585 30218 raft_consensus.cc:385] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.611845 30218 raft_consensus.cc:740] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.612598 30218 consensus_queue.cc:260] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.616976 30217 tablet_bootstrap.cc:492] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:45.617141 30219 tablet_bootstrap.cc:654] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.617394 30217 ts_tablet_manager.cc:1403] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.002s
I20260709 13:09:45.619982 30217 raft_consensus.cc:359] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.620566 30217 raft_consensus.cc:385] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.620827 30217 raft_consensus.cc:740] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.621592 30218 ts_tablet_manager.cc:1434] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:09:45.621409 30217 consensus_queue.cc:260] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.626020 30217 ts_tablet_manager.cc:1434] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:09:45.626827 30217 tablet_bootstrap.cc:492] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:45.627000 30218 tablet_bootstrap.cc:492] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:45.628473 30261 raft_consensus.cc:493] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.628943 30261 raft_consensus.cc:515] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.631906 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:45.632531 30218 tablet_bootstrap.cc:654] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.632553 30103 raft_consensus.cc:2468] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 0.
I20260709 13:09:45.633999 29994 leader_election.cc:304] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:09:45.634912 30227 raft_consensus.cc:2804] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:45.635278 30227 raft_consensus.cc:493] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.635623 30227 raft_consensus.cc:3060] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.639292 30217 tablet_bootstrap.cc:654] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.642915 30227 raft_consensus.cc:515] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.645771 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:09:45.646334 30103 raft_consensus.cc:3060] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.648523 30217 tablet_bootstrap.cc:492] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:45.648859 30217 ts_tablet_manager.cc:1403] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.007s
I20260709 13:09:45.650947 30217 raft_consensus.cc:359] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.651592 30217 raft_consensus.cc:385] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.651856 30217 raft_consensus.cc:740] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.646412 30218 tablet_bootstrap.cc:492] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:45.652729 30218 ts_tablet_manager.cc:1403] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.004s
I20260709 13:09:45.652523 30217 consensus_queue.cc:260] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.653501 30261 leader_election.cc:290] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:45.654661 30227 leader_election.cc:290] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:45.654551 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:45.656096 30176 raft_consensus.cc:2468] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 0.
I20260709 13:09:45.656144 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:09:45.656700 30177 raft_consensus.cc:3060] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.657397 30217 ts_tablet_manager.cc:1434] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:09:45.658289 30217 tablet_bootstrap.cc:492] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:45.659442 30218 raft_consensus.cc:359] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.660043 30218 raft_consensus.cc:385] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.660298 30218 raft_consensus.cc:740] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.661989 30103 raft_consensus.cc:2468] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 1.
I20260709 13:09:45.663077 29994 leader_election.cc:304] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:09:45.663375 30177 raft_consensus.cc:2468] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 1.
I20260709 13:09:45.663777 30217 tablet_bootstrap.cc:654] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.663887 30227 raft_consensus.cc:2804] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:45.664355 30227 raft_consensus.cc:697] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:09:45.665112 30227 consensus_queue.cc:237] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.666414 30219 tablet_bootstrap.cc:492] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:45.666880 30219 ts_tablet_manager.cc:1403] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.056s	user 0.017s	sys 0.028s
I20260709 13:09:45.669452 30219 raft_consensus.cc:359] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.670202 30219 raft_consensus.cc:385] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.670511 30219 raft_consensus.cc:740] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.671154 30218 consensus_queue.cc:260] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.671250 30219 consensus_queue.cc:260] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.675697 30218 ts_tablet_manager.cc:1434] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:09:45.676579 30218 tablet_bootstrap.cc:492] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:45.675673 30219 ts_tablet_manager.cc:1434] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:09:45.677533 30219 tablet_bootstrap.cc:492] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:45.678153 30217 tablet_bootstrap.cc:492] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:45.678608 30217 ts_tablet_manager.cc:1403] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.004s
I20260709 13:09:45.680097 29925 catalog_manager.cc:5697] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:45.681067 30217 raft_consensus.cc:359] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.681648 30218 tablet_bootstrap.cc:654] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.681906 30217 raft_consensus.cc:385] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.682241 30217 raft_consensus.cc:740] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.682574 30219 tablet_bootstrap.cc:654] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.683060 30217 consensus_queue.cc:260] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.688314 30217 ts_tablet_manager.cc:1434] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:09:45.689209 30217 tablet_bootstrap.cc:492] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:45.694659 30217 tablet_bootstrap.cc:654] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.695741 30219 tablet_bootstrap.cc:492] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:45.696152 30219 ts_tablet_manager.cc:1403] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.002s
I20260709 13:09:45.698681 30219 raft_consensus.cc:359] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.699466 30219 raft_consensus.cc:385] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.699797 30219 raft_consensus.cc:740] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.700421 30219 consensus_queue.cc:260] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.702417 30217 tablet_bootstrap.cc:492] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:45.702627 30219 ts_tablet_manager.cc:1434] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:09:45.702831 30217 ts_tablet_manager.cc:1403] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.001s
I20260709 13:09:45.703492 30219 tablet_bootstrap.cc:492] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:45.705801 30217 raft_consensus.cc:359] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.706394 30217 raft_consensus.cc:385] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.706873 30218 tablet_bootstrap.cc:492] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:45.707326 30218 ts_tablet_manager.cc:1403] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.000s
I20260709 13:09:45.706634 30217 raft_consensus.cc:740] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.708046 30217 consensus_queue.cc:260] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.709030 30219 tablet_bootstrap.cc:654] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.710224 30217 ts_tablet_manager.cc:1434] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:45.712107 30218 raft_consensus.cc:359] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.712726 30218 raft_consensus.cc:385] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.713001 30218 raft_consensus.cc:740] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.713622 30218 consensus_queue.cc:260] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.715435 30219 tablet_bootstrap.cc:492] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:45.715474 30218 ts_tablet_manager.cc:1434] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:45.715941 30219 ts_tablet_manager.cc:1403] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.001s
I20260709 13:09:45.716481 30218 tablet_bootstrap.cc:492] T 21562b36aa874c9cba1acd5dc79cf517 P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:45.717976 30219 raft_consensus.cc:359] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.718297 30221 raft_consensus.cc:493] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.718590 30219 raft_consensus.cc:385] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.718927 30219 raft_consensus.cc:740] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.718778 30221 raft_consensus.cc:515] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.719684 30219 consensus_queue.cc:260] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.720801 30221 leader_election.cc:290] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:45.721531 30218 tablet_bootstrap.cc:654] T 21562b36aa874c9cba1acd5dc79cf517 P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.721776 30219 ts_tablet_manager.cc:1434] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:09:45.722401 30217 tablet_bootstrap.cc:492] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:45.722577 30219 tablet_bootstrap.cc:492] T 978900c67750481aba3e58987ac43180 P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:45.725373 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:45.725977 30027 raft_consensus.cc:2468] T 1cd924402bd0402aa7ad47fac1308ac9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 0.
I20260709 13:09:45.727809 30217 tablet_bootstrap.cc:654] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.727802 30219 tablet_bootstrap.cc:654] T 978900c67750481aba3e58987ac43180 P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.731719 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:45.732404 30177 raft_consensus.cc:2468] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 0.
I20260709 13:09:45.733834 30066 leader_election.cc:304] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:09:45.738052 30246 raft_consensus.cc:2804] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:45.738464 30246 raft_consensus.cc:493] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.738821 30246 raft_consensus.cc:3060] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.738915 30219 tablet_bootstrap.cc:492] T 978900c67750481aba3e58987ac43180 P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:45.740134 30219 ts_tablet_manager.cc:1403] T 978900c67750481aba3e58987ac43180 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 13:09:45.740477 30221 raft_consensus.cc:493] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.740991 30221 raft_consensus.cc:515] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.742576 30219 raft_consensus.cc:359] T 978900c67750481aba3e58987ac43180 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.743075 30221 leader_election.cc:290] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:45.743199 30219 raft_consensus.cc:385] T 978900c67750481aba3e58987ac43180 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.743580 30245 raft_consensus.cc:493] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.746477 30219 raft_consensus.cc:740] T 978900c67750481aba3e58987ac43180 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.747035 30245 raft_consensus.cc:515] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.747481 30219 consensus_queue.cc:260] T 978900c67750481aba3e58987ac43180 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.749239 30245 leader_election.cc:290] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:45.749620 30219 ts_tablet_manager.cc:1434] T 978900c67750481aba3e58987ac43180 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:09:45.749989 30226 raft_consensus.cc:493] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.750504 30219 tablet_bootstrap.cc:492] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:45.750453 30226 raft_consensus.cc:515] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.752223 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:45.752588 30226 leader_election.cc:290] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451)
I20260709 13:09:45.753896 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:45.754405 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:45.746003 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:45.755542 30027 raft_consensus.cc:2468] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 0.
I20260709 13:09:45.756985 30219 tablet_bootstrap.cc:654] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.757300 30066 leader_election.cc:304] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
W20260709 13:09:45.756898 30140 leader_election.cc:343] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:45.758231 30068 leader_election.cc:343] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:45.759157 30221 raft_consensus.cc:493] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:09:45.759769 30068 leader_election.cc:343] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:45.759629 30221 raft_consensus.cc:515] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.761103 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:45.761656 30103 raft_consensus.cc:2468] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 0.
I20260709 13:09:45.756858 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:45.745076 30218 tablet_bootstrap.cc:492] T 21562b36aa874c9cba1acd5dc79cf517 P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:45.761511 30221 leader_election.cc:290] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:45.762673 30218 ts_tablet_manager.cc:1403] T 21562b36aa874c9cba1acd5dc79cf517 P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.046s	user 0.012s	sys 0.005s
I20260709 13:09:45.759159 30227 raft_consensus.cc:493] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.763041 30245 raft_consensus.cc:2804] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:45.763264 30227 raft_consensus.cc:515] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:09:45.766337 30066 leader_election.cc:343] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:45.766491 30227 leader_election.cc:290] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:45.766811 30066 leader_election.cc:304] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:09:45.770342 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:45.770977 30103 raft_consensus.cc:2468] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 0.
I20260709 13:09:45.763397 30245 raft_consensus.cc:493] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.773165 30245 raft_consensus.cc:3060] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.764132 30221 raft_consensus.cc:493] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.775820 29994 leader_election.cc:304] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:09:45.777257 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:45.777611 30227 raft_consensus.cc:2804] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:45.776295 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:45.778218 30227 raft_consensus.cc:493] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.776400 30221 raft_consensus.cc:515] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.778400 30177 raft_consensus.cc:2468] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 0.
I20260709 13:09:45.778679 30227 raft_consensus.cc:3060] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.776284 30143 leader_election.cc:304] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:09:45.779868 30261 raft_consensus.cc:493] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.775975 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:45.780280 30261 raft_consensus.cc:515] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.780306 30221 leader_election.cc:290] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:45.782212 30261 leader_election.cc:290] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:45.784116 30226 raft_consensus.cc:2804] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:45.784471 30226 raft_consensus.cc:493] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.784778 30226 raft_consensus.cc:3060] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.786068 30176 raft_consensus.cc:2468] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 0.
W20260709 13:09:45.786494 30066 leader_election.cc:343] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:45.787230 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:45.787415 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:45.787496 30218 raft_consensus.cc:359] T 21562b36aa874c9cba1acd5dc79cf517 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:09:45.788455 30066 leader_election.cc:343] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:45.788578 29994 leader_election.cc:343] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:45.788194 30218 raft_consensus.cc:385] T 21562b36aa874c9cba1acd5dc79cf517 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.789304 30218 raft_consensus.cc:740] T 21562b36aa874c9cba1acd5dc79cf517 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.790009 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:45.789956 30218 consensus_queue.cc:260] T 21562b36aa874c9cba1acd5dc79cf517 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:09:45.791061 29993 leader_election.cc:343] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:45.791461 29993 leader_election.cc:304] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:09:45.792174 30261 raft_consensus.cc:2749] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:45.795188 30278 raft_consensus.cc:2749] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:45.794642 30221 raft_consensus.cc:493] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.796119 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:45.785408 30245 raft_consensus.cc:515] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.797386 30217 tablet_bootstrap.cc:492] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:45.796875 30221 raft_consensus.cc:515] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.797402 30068 leader_election.cc:304] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:09:45.793936 30227 raft_consensus.cc:515] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.799108 30221 leader_election.cc:290] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:45.799564 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:09:45.799607 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:09:45.800203 30028 raft_consensus.cc:3060] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.800534 30227 leader_election.cc:290] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:45.799623 30221 raft_consensus.cc:2804] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:45.801450 30218 ts_tablet_manager.cc:1434] T 21562b36aa874c9cba1acd5dc79cf517 P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.001s
I20260709 13:09:45.801883 30217 ts_tablet_manager.cc:1403] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.080s	user 0.022s	sys 0.030s
I20260709 13:09:45.802464 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:45.803256 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:09:45.798509 30245 leader_election.cc:290] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:45.794556 30246 raft_consensus.cc:515] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.803442 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:09:45.804600 30218 tablet_bootstrap.cc:492] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:45.804841 30103 raft_consensus.cc:3060] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.804484 30176 raft_consensus.cc:2468] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 0.
I20260709 13:09:45.804479 30175 raft_consensus.cc:3060] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:45.803100 30068 leader_election.cc:343] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:45.807040 30068 leader_election.cc:304] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:45.807816 30245 raft_consensus.cc:2804] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:45.808144 30245 raft_consensus.cc:493] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.808463 30245 raft_consensus.cc:3060] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.805423 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:45.809366 30027 raft_consensus.cc:2468] T 978900c67750481aba3e58987ac43180 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 0.
I20260709 13:09:45.814651 30175 raft_consensus.cc:2468] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 1.
I20260709 13:09:45.815555 30103 raft_consensus.cc:2468] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 1.
I20260709 13:09:45.815485 30245 raft_consensus.cc:515] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.815800 29993 leader_election.cc:304] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:45.816715 30227 raft_consensus.cc:2804] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:45.817595 30227 raft_consensus.cc:697] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:09:45.817646 30245 leader_election.cc:290] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:45.818223 30217 raft_consensus.cc:359] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.818986 30217 raft_consensus.cc:385] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.818953 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:09:45.819244 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:09:45.819410 30217 raft_consensus.cc:740] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.819618 30176 raft_consensus.cc:3060] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.819748 30027 raft_consensus.cc:3060] T 978900c67750481aba3e58987ac43180 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.820204 30217 consensus_queue.cc:260] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.822419 30227 consensus_queue.cc:237] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.803697 30221 raft_consensus.cc:493] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.823073 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:09:45.824254 30026 raft_consensus.cc:3060] T 1cd924402bd0402aa7ad47fac1308ac9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.825441 30226 raft_consensus.cc:515] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.825042 30221 raft_consensus.cc:3060] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.828431 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:09:45.828979 30175 raft_consensus.cc:3060] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.832180 30026 raft_consensus.cc:2468] T 1cd924402bd0402aa7ad47fac1308ac9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 1.
I20260709 13:09:45.819993 30246 leader_election.cc:290] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:45.834425 30177 raft_consensus.cc:2393] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 1: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:09:45.841312 30226 leader_election.cc:290] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451)
I20260709 13:09:45.842046 30226 raft_consensus.cc:493] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.842525 30226 raft_consensus.cc:515] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.844323 30226 leader_election.cc:290] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:45.845227 30066 leader_election.cc:304] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:09:45.842111 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:09:45.850090 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:45.850473 30103 raft_consensus.cc:3060] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.851457 30102 raft_consensus.cc:2468] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 0.
I20260709 13:09:45.850044 30246 raft_consensus.cc:2804] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:45.853490 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:09:45.852885 30246 raft_consensus.cc:697] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
W20260709 13:09:45.854837 30140 leader_election.cc:343] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:45.854627 30246 consensus_queue.cc:237] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.838328 30221 raft_consensus.cc:515] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.858824 30143 leader_election.cc:304] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:45.853581 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:45.859908 30068 leader_election.cc:304] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:09:45.866568 30025 raft_consensus.cc:2468] T 38e941311158407e8c0e2f4ca4b31d32 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 0.
I20260709 13:09:45.867158 30226 raft_consensus.cc:2804] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:45.865717 30027 raft_consensus.cc:2468] T 978900c67750481aba3e58987ac43180 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 1.
I20260709 13:09:45.868592 30226 raft_consensus.cc:493] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.871390 30226 raft_consensus.cc:3060] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.871920 30221 leader_election.cc:290] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:45.868445 30176 raft_consensus.cc:2468] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 1.
I20260709 13:09:45.874158 30028 raft_consensus.cc:2468] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 1.
I20260709 13:09:45.879500 30217 ts_tablet_manager.cc:1434] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.075s	user 0.025s	sys 0.027s
I20260709 13:09:45.880486 30217 tablet_bootstrap.cc:492] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:45.882674 30218 tablet_bootstrap.cc:654] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.883718 30219 tablet_bootstrap.cc:492] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:45.884133 30219 ts_tablet_manager.cc:1403] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.134s	user 0.009s	sys 0.006s
I20260709 13:09:45.884812 30068 leader_election.cc:304] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:45.886652 30066 leader_election.cc:304] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:09:45.887377 30245 raft_consensus.cc:2804] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:45.887816 30245 raft_consensus.cc:697] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:09:45.888693 30103 raft_consensus.cc:2468] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 1.
I20260709 13:09:45.877887 30175 raft_consensus.cc:2468] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 1.
I20260709 13:09:45.889055 30219 raft_consensus.cc:359] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.890689 30219 raft_consensus.cc:385] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.890900 30219 raft_consensus.cc:740] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.889746 30280 raft_consensus.cc:2749] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:45.888656 30245 consensus_queue.cc:237] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.887732 30221 raft_consensus.cc:2804] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:45.892937 30227 raft_consensus.cc:493] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.894688 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:09:45.899318 30176 raft_consensus.cc:3060] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.902272 30226 raft_consensus.cc:515] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.902956 30280 consensus_queue.cc:1048] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:45.898607 30221 raft_consensus.cc:697] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:09:45.893368 30219 consensus_queue.cc:260] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.907649 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:09:45.908299 30028 raft_consensus.cc:3060] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.907979 30221 consensus_queue.cc:237] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.911216 30227 raft_consensus.cc:515] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.911716 29924 catalog_manager.cc:5697] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:45.914746 30226 leader_election.cc:290] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:45.917321 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:09:45.918004 30027 raft_consensus.cc:3060] T 38e941311158407e8c0e2f4ca4b31d32 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.922892 30219 ts_tablet_manager.cc:1434] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.039s	user 0.004s	sys 0.002s
I20260709 13:09:45.924034 30219 tablet_bootstrap.cc:492] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:45.922797 30143 leader_election.cc:304] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:09:45.925930 30226 raft_consensus.cc:2804] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:45.927085 30226 raft_consensus.cc:697] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:09:45.927961 30027 raft_consensus.cc:2468] T 38e941311158407e8c0e2f4ca4b31d32 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 1.
I20260709 13:09:45.929111 30140 leader_election.cc:304] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:45.930652 30281 raft_consensus.cc:2804] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:45.931149 30281 raft_consensus.cc:697] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:09:45.928172 30226 consensus_queue.cc:237] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.933835 30227 leader_election.cc:290] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:45.935190 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:09:45.935745 30103 raft_consensus.cc:3060] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.935859 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:45.936530 30177 raft_consensus.cc:2468] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 0.
I20260709 13:09:45.932792 29924 catalog_manager.cc:5697] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:45.939141 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:45.940871 30281 consensus_queue.cc:237] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.934132 30028 raft_consensus.cc:2468] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 1.
I20260709 13:09:45.945381 30219 tablet_bootstrap.cc:654] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.946436 29993 leader_election.cc:304] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:45.947234 30227 raft_consensus.cc:2804] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:45.947566 30227 raft_consensus.cc:493] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:45.947892 30227 raft_consensus.cc:3060] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.950074 30102 raft_consensus.cc:2468] T 21562b36aa874c9cba1acd5dc79cf517 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 0.
I20260709 13:09:45.938123 30176 raft_consensus.cc:2468] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 1.
I20260709 13:09:45.963635 30066 leader_election.cc:304] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:09:45.964715 30221 raft_consensus.cc:2804] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:45.965405 30221 raft_consensus.cc:697] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:09:45.966779 30221 consensus_queue.cc:237] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.973073 30103 raft_consensus.cc:2468] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 1.
I20260709 13:09:45.974404 30217 tablet_bootstrap.cc:654] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:45.976465 30227 raft_consensus.cc:515] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.978447 30227 leader_election.cc:290] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:45.979970 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:09:45.980648 30176 raft_consensus.cc:3060] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.986370 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:09:45.989048 30103 raft_consensus.cc:3060] T 21562b36aa874c9cba1acd5dc79cf517 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:45.990962 30281 raft_consensus.cc:493] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:45.991420 30281 raft_consensus.cc:515] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:45.991950 30218 tablet_bootstrap.cc:492] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:45.993189 29924 catalog_manager.cc:5697] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 0 to 1, leader changed from <none> to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 1 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:45.994478 30281 leader_election.cc:290] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:45.995014 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:45.995711 30176 raft_consensus.cc:2468] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 1.
W20260709 13:09:45.996430 30143 leader_election.cc:343] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:46.002269 29993 leader_election.cc:304] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:46.003080 30227 raft_consensus.cc:2804] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:46.003538 30227 raft_consensus.cc:697] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:09:46.004333 30219 tablet_bootstrap.cc:492] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:46.004293 30227 consensus_queue.cc:237] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.004863 30219 ts_tablet_manager.cc:1403] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.081s	user 0.009s	sys 0.004s
I20260709 13:09:46.006438 29926 catalog_manager.cc:5697] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:46.007551 30219 raft_consensus.cc:359] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.008389 30219 raft_consensus.cc:385] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:46.008005 29926 catalog_manager.cc:5697] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:46.008709 30219 raft_consensus.cc:740] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.009838 30281 raft_consensus.cc:493] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.010325 30281 raft_consensus.cc:515] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.009565 29926 catalog_manager.cc:5697] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:46.012179 29925 catalog_manager.cc:5697] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 0 to 1, leader changed from <none> to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 1 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:46.013197 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:45.994418 30218 ts_tablet_manager.cc:1403] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.190s	user 0.011s	sys 0.030s
W20260709 13:09:46.014654 30140 leader_election.cc:343] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:46.009543 30219 consensus_queue.cc:260] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.017201 30281 leader_election.cc:290] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:46.018828 30219 ts_tablet_manager.cc:1434] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:09:46.019743 30219 tablet_bootstrap.cc:492] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:46.022071 30218 raft_consensus.cc:359] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.023046 30218 raft_consensus.cc:385] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:45.993947 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:46.023316 30218 raft_consensus.cc:740] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.023929 30218 consensus_queue.cc:260] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:09:46.024434 30140 leader_election.cc:343] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:46.024873 30140 leader_election.cc:304] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:09:46.025929 30281 raft_consensus.cc:2749] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:46.000960 30103 raft_consensus.cc:2468] T 21562b36aa874c9cba1acd5dc79cf517 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 1.
I20260709 13:09:46.029620 30219 tablet_bootstrap.cc:654] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:46.016736 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
W20260709 13:09:46.032519 30143 leader_election.cc:343] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:46.032940 30143 leader_election.cc:304] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:09:46.033948 30281 raft_consensus.cc:2749] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:46.036830 30219 tablet_bootstrap.cc:492] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:46.037273 30219 ts_tablet_manager.cc:1403] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.003s
I20260709 13:09:46.037273 29924 catalog_manager.cc:5697] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:46.040091 30219 raft_consensus.cc:359] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.040709 30219 raft_consensus.cc:385] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:46.040962 30219 raft_consensus.cc:740] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:45.998301 30217 tablet_bootstrap.cc:492] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:46.025872 30218 ts_tablet_manager.cc:1434] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.002s
I20260709 13:09:46.042178 30217 ts_tablet_manager.cc:1403] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.162s	user 0.010s	sys 0.001s
I20260709 13:09:46.042629 30218 tablet_bootstrap.cc:492] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:46.043402 30280 consensus_queue.cc:1048] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:46.045202 30217 raft_consensus.cc:359] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.045893 30217 raft_consensus.cc:385] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:46.046191 30217 raft_consensus.cc:740] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.046958 30217 consensus_queue.cc:260] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.048249 30218 tablet_bootstrap.cc:654] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:46.048998 30217 ts_tablet_manager.cc:1434] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.001s
I20260709 13:09:46.050367 30217 tablet_bootstrap.cc:492] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:46.041550 30219 consensus_queue.cc:260] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.052448 30219 ts_tablet_manager.cc:1434] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:09:46.053193 30227 raft_consensus.cc:493] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.053653 30227 raft_consensus.cc:515] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.055871 30227 leader_election.cc:290] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:46.056100 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:46.056450 30219 tablet_bootstrap.cc:492] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
W20260709 13:09:46.057367 29994 leader_election.cc:343] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:46.057642 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:46.058323 30176 raft_consensus.cc:2468] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 0.
I20260709 13:09:46.059762 29993 leader_election.cc:304] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:09:46.060705 30219 tablet_bootstrap.cc:654] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:46.070802 30261 raft_consensus.cc:2804] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:46.071214 30261 raft_consensus.cc:493] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.071555 30261 raft_consensus.cc:3060] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:46.074441 30217 tablet_bootstrap.cc:654] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:46.080363 30261 raft_consensus.cc:515] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.085214 30227 consensus_queue.cc:1048] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:46.088737 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:09:46.090070 30218 tablet_bootstrap.cc:492] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
W20260709 13:09:46.090225 29994 leader_election.cc:343] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:46.091243 30261 leader_election.cc:290] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:46.094380 30218 ts_tablet_manager.cc:1403] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.052s	user 0.009s	sys 0.017s
I20260709 13:09:46.095216 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:09:46.095721 30217 tablet_bootstrap.cc:492] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:46.095758 30176 raft_consensus.cc:3060] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:46.096310 30217 ts_tablet_manager.cc:1403] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.046s	user 0.014s	sys 0.011s
I20260709 13:09:46.096985 30218 raft_consensus.cc:359] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.097615 30218 raft_consensus.cc:385] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:46.097906 30218 raft_consensus.cc:740] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.098590 30218 consensus_queue.cc:260] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.098798 30217 raft_consensus.cc:359] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.099511 30217 raft_consensus.cc:385] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:46.099761 30217 raft_consensus.cc:740] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.100482 30217 consensus_queue.cc:260] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.102308 30217 ts_tablet_manager.cc:1434] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:46.102800 30176 raft_consensus.cc:2468] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 1.
I20260709 13:09:46.103155 30217 tablet_bootstrap.cc:492] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:46.104198 30218 ts_tablet_manager.cc:1434] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:09:46.104771 29993 leader_election.cc:304] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:09:46.105067 30218 tablet_bootstrap.cc:492] T d7be23af8c824b3bb048a59d6bdf884c P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:46.105962 30303 raft_consensus.cc:2804] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:46.106427 30303 raft_consensus.cc:697] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:09:46.107208 30303 consensus_queue.cc:237] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.108551 30217 tablet_bootstrap.cc:654] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:46.111173 30218 tablet_bootstrap.cc:654] T d7be23af8c824b3bb048a59d6bdf884c P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:46.135680 30219 tablet_bootstrap.cc:492] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:46.136298 30219 ts_tablet_manager.cc:1403] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.083s	user 0.019s	sys 0.011s
I20260709 13:09:46.139127 30219 raft_consensus.cc:359] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.139979 30219 raft_consensus.cc:385] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:46.140305 30219 raft_consensus.cc:740] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.141033 30219 consensus_queue.cc:260] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.149729 30227 consensus_queue.cc:1048] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:46.162475 30217 tablet_bootstrap.cc:492] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:46.162926 30217 ts_tablet_manager.cc:1403] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.060s	user 0.022s	sys 0.036s
I20260709 13:09:46.162788 29923 catalog_manager.cc:5697] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:46.163707 30218 tablet_bootstrap.cc:492] T d7be23af8c824b3bb048a59d6bdf884c P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:46.164193 30218 ts_tablet_manager.cc:1403] T d7be23af8c824b3bb048a59d6bdf884c P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.059s	user 0.006s	sys 0.032s
I20260709 13:09:46.165329 30217 raft_consensus.cc:359] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.165985 30217 raft_consensus.cc:385] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:46.166255 30217 raft_consensus.cc:740] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.166785 30218 raft_consensus.cc:359] T d7be23af8c824b3bb048a59d6bdf884c P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.166966 30217 consensus_queue.cc:260] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.167466 30218 raft_consensus.cc:385] T d7be23af8c824b3bb048a59d6bdf884c P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:46.173776 30218 raft_consensus.cc:740] T d7be23af8c824b3bb048a59d6bdf884c P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.174502 30218 consensus_queue.cc:260] T d7be23af8c824b3bb048a59d6bdf884c P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.176280 30218 ts_tablet_manager.cc:1434] T d7be23af8c824b3bb048a59d6bdf884c P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:09:46.177110 30218 tablet_bootstrap.cc:492] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:46.170672 30219 ts_tablet_manager.cc:1434] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.034s	user 0.010s	sys 0.011s
I20260709 13:09:46.180606 30219 tablet_bootstrap.cc:492] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:46.182663 30218 tablet_bootstrap.cc:654] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:46.185055 30217 ts_tablet_manager.cc:1434] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:09:46.185848 30310 raft_consensus.cc:493] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.186714 30310 raft_consensus.cc:515] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.188913 30310 leader_election.cc:290] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:46.193709 30280 raft_consensus.cc:493] T d7be23af8c824b3bb048a59d6bdf884c P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.194265 30280 raft_consensus.cc:515] T d7be23af8c824b3bb048a59d6bdf884c P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.196568 30280 leader_election.cc:290] T d7be23af8c824b3bb048a59d6bdf884c P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:46.190819 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:46.197196 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:09:46.198173 29993 leader_election.cc:343] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:46.199287 30066 leader_election.cc:343] T d7be23af8c824b3bb048a59d6bdf884c P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:46.200032 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:46.200809 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
W20260709 13:09:46.201298 30068 leader_election.cc:343] T d7be23af8c824b3bb048a59d6bdf884c P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:46.192912 30217 tablet_bootstrap.cc:492] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:46.201743 30068 leader_election.cc:304] T d7be23af8c824b3bb048a59d6bdf884c P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
W20260709 13:09:46.203065 29994 leader_election.cc:343] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:46.203490 29994 leader_election.cc:304] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:09:46.204317 30310 raft_consensus.cc:2749] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:46.205176 30280 raft_consensus.cc:2749] T d7be23af8c824b3bb048a59d6bdf884c P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:46.207381 30219 tablet_bootstrap.cc:654] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:46.209359 30217 tablet_bootstrap.cc:654] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:46.211978 30218 tablet_bootstrap.cc:492] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:46.212401 30219 tablet_bootstrap.cc:492] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:46.212401 30218 ts_tablet_manager.cc:1403] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.019s
I20260709 13:09:46.212980 30219 ts_tablet_manager.cc:1403] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.033s	user 0.007s	sys 0.003s
I20260709 13:09:46.213598 30217 tablet_bootstrap.cc:492] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:46.213953 30217 ts_tablet_manager.cc:1403] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.001s
I20260709 13:09:46.215170 30218 raft_consensus.cc:359] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.215412 30219 raft_consensus.cc:359] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.215844 30218 raft_consensus.cc:385] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:46.215993 30219 raft_consensus.cc:385] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:46.216132 30218 raft_consensus.cc:740] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.216354 30219 raft_consensus.cc:740] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.216055 30217 raft_consensus.cc:359] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.216773 30217 raft_consensus.cc:385] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:46.217036 30217 raft_consensus.cc:740] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.216995 30219 consensus_queue.cc:260] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.216995 30218 consensus_queue.cc:260] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.218036 30217 consensus_queue.cc:260] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.219156 30219 ts_tablet_manager.cc:1434] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:46.222126 30219 tablet_bootstrap.cc:492] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:46.222280 30217 ts_tablet_manager.cc:1434] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:09:46.222471 30218 ts_tablet_manager.cc:1434] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:09:46.223127 30217 tablet_bootstrap.cc:492] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:46.223289 30218 tablet_bootstrap.cc:492] T 64e2b2bd54d3454a9f64030c149e2e25 P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:46.228289 30219 tablet_bootstrap.cc:654] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:46.228893 30217 tablet_bootstrap.cc:654] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:46.229272 30218 tablet_bootstrap.cc:654] T 64e2b2bd54d3454a9f64030c149e2e25 P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:46.239594 30217 tablet_bootstrap.cc:492] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:46.240067 30217 ts_tablet_manager.cc:1403] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.004s
I20260709 13:09:46.240429 30218 tablet_bootstrap.cc:492] T 64e2b2bd54d3454a9f64030c149e2e25 P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:46.240849 30218 ts_tablet_manager.cc:1403] T 64e2b2bd54d3454a9f64030c149e2e25 P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.006s
I20260709 13:09:46.240986 30219 tablet_bootstrap.cc:492] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:46.241398 30219 ts_tablet_manager.cc:1403] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.003s
I20260709 13:09:46.243649 30218 raft_consensus.cc:359] T 64e2b2bd54d3454a9f64030c149e2e25 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.244390 30218 raft_consensus.cc:385] T 64e2b2bd54d3454a9f64030c149e2e25 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:46.244644 30218 raft_consensus.cc:740] T 64e2b2bd54d3454a9f64030c149e2e25 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.244704 30219 raft_consensus.cc:359] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.245368 30219 raft_consensus.cc:385] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:46.245631 30219 raft_consensus.cc:740] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.245456 30218 consensus_queue.cc:260] T 64e2b2bd54d3454a9f64030c149e2e25 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.248271 30280 consensus_queue.cc:1048] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:09:46.246358 30219 consensus_queue.cc:260] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.252488 30219 ts_tablet_manager.cc:1434] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:09:46.250113 30217 raft_consensus.cc:359] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.254272 30217 raft_consensus.cc:385] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:46.254531 30217 raft_consensus.cc:740] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.253376 30219 tablet_bootstrap.cc:492] T c6d87bb3ff11400cbdaf30e614c4b3da P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:46.255172 30217 consensus_queue.cc:260] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.256568 30280 raft_consensus.cc:493] T 64e2b2bd54d3454a9f64030c149e2e25 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.257006 30280 raft_consensus.cc:515] T 64e2b2bd54d3454a9f64030c149e2e25 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.258993 30217 ts_tablet_manager.cc:1434] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 13:09:46.259698 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:46.259919 30217 tablet_bootstrap.cc:492] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
W20260709 13:09:46.261004 30066 leader_election.cc:343] T 64e2b2bd54d3454a9f64030c149e2e25 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:46.260988 30219 tablet_bootstrap.cc:654] T c6d87bb3ff11400cbdaf30e614c4b3da P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:46.263006 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:09:46.264277 30068 leader_election.cc:343] T 64e2b2bd54d3454a9f64030c149e2e25 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:46.264711 30068 leader_election.cc:304] T 64e2b2bd54d3454a9f64030c149e2e25 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:09:46.265461 30221 raft_consensus.cc:2749] T 64e2b2bd54d3454a9f64030c149e2e25 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:46.266158 30280 leader_election.cc:290] T 64e2b2bd54d3454a9f64030c149e2e25 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:46.266631 30217 tablet_bootstrap.cc:654] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:46.272358 30221 consensus_queue.cc:1048] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:46.284440 30280 raft_consensus.cc:493] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.285044 30280 raft_consensus.cc:515] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.250178 30218 ts_tablet_manager.cc:1434] T 64e2b2bd54d3454a9f64030c149e2e25 P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:09:46.287308 30218 tablet_bootstrap.cc:492] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:46.288003 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:46.288586 30028 raft_consensus.cc:2468] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 0.
I20260709 13:09:46.289614 30066 leader_election.cc:304] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:09:46.290457 30221 raft_consensus.cc:2804] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:46.290831 30221 raft_consensus.cc:493] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.291133 30221 raft_consensus.cc:3060] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:46.294435 30218 tablet_bootstrap.cc:654] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:46.296420 30219 tablet_bootstrap.cc:492] T c6d87bb3ff11400cbdaf30e614c4b3da P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:46.296958 30219 ts_tablet_manager.cc:1403] T c6d87bb3ff11400cbdaf30e614c4b3da P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.044s	user 0.010s	sys 0.001s
I20260709 13:09:46.297519 30217 tablet_bootstrap.cc:492] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:46.298014 30217 ts_tablet_manager.cc:1403] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.038s	user 0.015s	sys 0.009s
I20260709 13:09:46.297607 30221 raft_consensus.cc:515] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.299752 30219 raft_consensus.cc:359] T c6d87bb3ff11400cbdaf30e614c4b3da P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.300412 30219 raft_consensus.cc:385] T c6d87bb3ff11400cbdaf30e614c4b3da P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:46.300357 30217 raft_consensus.cc:359] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.300678 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:09:46.300822 30219 raft_consensus.cc:740] T c6d87bb3ff11400cbdaf30e614c4b3da P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.301163 30217 raft_consensus.cc:385] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:46.301360 30027 raft_consensus.cc:3060] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:46.301858 30219 consensus_queue.cc:260] T c6d87bb3ff11400cbdaf30e614c4b3da P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.304088 30219 ts_tablet_manager.cc:1434] T c6d87bb3ff11400cbdaf30e614c4b3da P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 13:09:46.305085 30219 tablet_bootstrap.cc:492] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:46.308331 30027 raft_consensus.cc:2468] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 1.
I20260709 13:09:46.309581 30066 leader_election.cc:304] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:09:46.310393 30246 raft_consensus.cc:2804] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:46.310868 30246 raft_consensus.cc:697] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:09:46.311022 30219 tablet_bootstrap.cc:654] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:46.311734 30246 consensus_queue.cc:237] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.320815 30025 raft_consensus.cc:3060] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:46.301466 30217 raft_consensus.cc:740] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.325805 30217 consensus_queue.cc:260] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.326256 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:46.326673 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:09:46.326874 30176 raft_consensus.cc:2468] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 0.
I20260709 13:09:46.327999 30217 ts_tablet_manager.cc:1434] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.000s
I20260709 13:09:46.328222 30219 tablet_bootstrap.cc:492] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:46.328759 30219 ts_tablet_manager.cc:1403] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.003s
I20260709 13:09:46.328996 30217 tablet_bootstrap.cc:492] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:46.330120 30221 leader_election.cc:290] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:46.331001 30280 leader_election.cc:290] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:46.331544 30219 raft_consensus.cc:359] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.332243 30219 raft_consensus.cc:385] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:46.332543 30219 raft_consensus.cc:740] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.333200 30219 consensus_queue.cc:260] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.335525 30219 ts_tablet_manager.cc:1434] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:46.335692 30280 consensus_queue.cc:1048] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:46.336480 30219 tablet_bootstrap.cc:492] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:46.338744 30217 tablet_bootstrap.cc:654] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:46.342397 30219 tablet_bootstrap.cc:654] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:46.343007 30281 consensus_queue.cc:1048] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:46.346812 30310 consensus_queue.cc:1048] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:46.350627 30218 tablet_bootstrap.cc:492] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:46.351111 30218 ts_tablet_manager.cc:1403] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.064s	user 0.018s	sys 0.031s
I20260709 13:09:46.355397 30217 tablet_bootstrap.cc:492] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:46.355842 30217 ts_tablet_manager.cc:1403] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.002s
I20260709 13:09:46.356283 30218 raft_consensus.cc:359] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.356938 30218 raft_consensus.cc:385] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:46.357205 30218 raft_consensus.cc:740] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.343488 29924 catalog_manager.cc:5697] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:46.360595 30218 consensus_queue.cc:260] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.362358 30217 raft_consensus.cc:359] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.363013 30217 raft_consensus.cc:385] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:46.363286 30217 raft_consensus.cc:740] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.363914 30217 consensus_queue.cc:260] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.365742 30218 ts_tablet_manager.cc:1434] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 13:09:46.367980 30218 tablet_bootstrap.cc:492] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:46.370455 30280 consensus_queue.cc:1048] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:46.372630 30217 ts_tablet_manager.cc:1434] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:09:46.373487 30217 tablet_bootstrap.cc:492] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:46.374593 30303 consensus_queue.cc:1048] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:46.379606 30217 tablet_bootstrap.cc:654] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:46.381287 30221 raft_consensus.cc:493] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.381817 30221 raft_consensus.cc:515] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.383932 30221 leader_election.cc:290] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:46.385471 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:09:46.388336 30066 leader_election.cc:343] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:46.393225 30218 tablet_bootstrap.cc:654] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:46.395798 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:09:46.397881 30068 leader_election.cc:343] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:46.398303 30068 leader_election.cc:304] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:09:46.399995 30280 raft_consensus.cc:2749] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:46.408738 30217 tablet_bootstrap.cc:492] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:46.409235 30217 ts_tablet_manager.cc:1403] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.005s
I20260709 13:09:46.409940 30281 raft_consensus.cc:493] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.412868 30281 raft_consensus.cc:515] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.415869 30281 leader_election.cc:290] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:46.419221 30226 raft_consensus.cc:493] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.419737 30226 raft_consensus.cc:515] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.422482 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:46.423666 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
W20260709 13:09:46.426388 30143 leader_election.cc:343] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:46.426476 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:46.426949 30219 tablet_bootstrap.cc:492] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:46.427062 30026 raft_consensus.cc:2468] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 0.
I20260709 13:09:46.427446 30219 ts_tablet_manager.cc:1403] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.091s	user 0.042s	sys 0.020s
W20260709 13:09:46.427758 30143 leader_election.cc:343] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:46.429505 30140 leader_election.cc:304] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:09:46.430018 30310 raft_consensus.cc:493] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.430362 30281 raft_consensus.cc:2804] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:46.430737 30281 raft_consensus.cc:493] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.430510 30310 raft_consensus.cc:515] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.431071 30281 raft_consensus.cc:3060] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:46.431236 30219 raft_consensus.cc:359] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.431941 30219 raft_consensus.cc:385] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:46.432185 30219 raft_consensus.cc:740] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.432731 30219 consensus_queue.cc:260] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.432561 30310 leader_election.cc:290] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:46.434656 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:46.428690 30217 raft_consensus.cc:359] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.435655 30282 raft_consensus.cc:493] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.437492 30027 raft_consensus.cc:2468] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 0.
I20260709 13:09:46.436162 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:46.438760 30177 raft_consensus.cc:2468] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 0.
I20260709 13:09:46.436162 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:46.424363 30226 leader_election.cc:290] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:46.437578 30282 raft_consensus.cc:515] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.440253 30217 raft_consensus.cc:385] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:46.442170 30217 raft_consensus.cc:740] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.443307 30219 ts_tablet_manager.cc:1434] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:09:46.444314 30219 tablet_bootstrap.cc:492] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:46.445884 30217 consensus_queue.cc:260] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.447957 30217 ts_tablet_manager.cc:1434] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.038s	user 0.004s	sys 0.004s
I20260709 13:09:46.448397 30282 leader_election.cc:290] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:46.448812 30217 tablet_bootstrap.cc:492] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:46.445045 30226 consensus_queue.cc:1048] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:09:46.445248 29993 leader_election.cc:304] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:46.452543 30303 raft_consensus.cc:2804] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:46.452924 30303 raft_consensus.cc:493] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.453243 30303 raft_consensus.cc:3060] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:46.459408 29994 leader_election.cc:343] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:46.462750 30310 consensus_queue.cc:1048] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:46.465378 30221 consensus_queue.cc:1048] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:46.467133 30140 leader_election.cc:304] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:09:46.468024 30282 raft_consensus.cc:2804] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:46.468387 30282 raft_consensus.cc:493] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.468701 30282 raft_consensus.cc:3060] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:46.502408 30311 raft_consensus.cc:493] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.502949 30311 raft_consensus.cc:515] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.488303 30227 consensus_queue.cc:1048] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 13:09:46.489087 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:46.520118 30027 raft_consensus.cc:2468] T c6d87bb3ff11400cbdaf30e614c4b3da P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 0.
I20260709 13:09:46.573809 30227 raft_consensus.cc:493] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.574410 30227 raft_consensus.cc:515] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:09:46.615360 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 148096us
I20260709 13:09:46.621150 30278 consensus_queue.cc:1048] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:09:46.638298 30227 leader_election.cc:290] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:46.645870 30311 leader_election.cc:290] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:46.650640 30338 raft_consensus.cc:493] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.651072 30338 raft_consensus.cc:515] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.652604 30338 leader_election.cc:290] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:46.655234 30219 tablet_bootstrap.cc:654] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:46.656569 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:46.659468 30217 tablet_bootstrap.cc:654] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:46.647315 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 207573us
I20260709 13:09:46.660338 30337 raft_consensus.cc:493] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.660688 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:46.669260 30218 tablet_bootstrap.cc:492] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:46.661532 30311 raft_consensus.cc:493] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.658387 30176 raft_consensus.cc:2468] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 0.
I20260709 13:09:46.669698 30218 ts_tablet_manager.cc:1403] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.302s	user 0.064s	sys 0.039s
I20260709 13:09:46.660281 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:46.659365 30303 raft_consensus.cc:515] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.667986 30227 consensus_queue.cc:1048] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:09:46.670709 30311 raft_consensus.cc:515] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.690600 29993 leader_election.cc:304] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:46.691501 30308 raft_consensus.cc:2804] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:46.691874 30308 raft_consensus.cc:493] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.692245 30308 raft_consensus.cc:3060] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:46.692713 30221 raft_consensus.cc:493] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.693176 30221 raft_consensus.cc:515] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.673610 30281 raft_consensus.cc:515] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.670747 30337 raft_consensus.cc:515] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.701930 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:46.702762 30100 raft_consensus.cc:2468] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 0.
I20260709 13:09:46.704821 30278 raft_consensus.cc:493] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.705404 30278 raft_consensus.cc:515] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.679064 30174 raft_consensus.cc:2468] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 0.
W20260709 13:09:46.709137 29974 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:46.681239 30140 leader_election.cc:304] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:46.719024 30175 raft_consensus.cc:3060] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:46.736613 30311 leader_election.cc:290] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:46.742401 30226 raft_consensus.cc:2804] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:46.750756 30226 raft_consensus.cc:493] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.751104 30226 raft_consensus.cc:3060] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:46.707608 29994 leader_election.cc:343] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:46.784855 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 78250.6us
I20260709 13:09:46.789121 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:46.789749 30026 raft_consensus.cc:2468] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 0.
W20260709 13:09:46.769717 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 92018.6us
I20260709 13:09:46.790517 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:46.791113 30174 raft_consensus.cc:2468] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 0.
I20260709 13:09:46.794049 30066 leader_election.cc:304] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:09:46.794988 30281 leader_election.cc:290] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:46.795145 30246 raft_consensus.cc:2804] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:46.794878 29993 leader_election.cc:304] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:46.802796 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:46.803375 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:46.751772 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:46.795586 30218 raft_consensus.cc:359] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.785492 30221 leader_election.cc:290] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:46.809741 30218 raft_consensus.cc:385] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:46.812755 30218 raft_consensus.cc:740] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.795560 30246 raft_consensus.cc:493] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.784950 30337 leader_election.cc:290] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:46.813464 30218 consensus_queue.cc:260] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.814783 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:46.762301 30226 raft_consensus.cc:515] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.808802 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:46.812958 30227 raft_consensus.cc:2804] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:46.828743 30339 consensus_queue.cc:1048] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:46.828677 30278 leader_election.cc:290] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:46.832793 30218 ts_tablet_manager.cc:1434] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.163s	user 0.017s	sys 0.003s
I20260709 13:09:46.816744 30246 raft_consensus.cc:3060] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:46.815163 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:46.836025 30218 tablet_bootstrap.cc:492] T f5616428acc64e24945a779e1aee597f P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:46.833645 30303 leader_election.cc:290] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:46.836612 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:09:46.838315 30282 raft_consensus.cc:515] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.843528 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:46.829952 30227 raft_consensus.cc:493] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.835817 30337 raft_consensus.cc:493] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:46.844853 30026 raft_consensus.cc:2468] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 0.
I20260709 13:09:46.846493 30027 raft_consensus.cc:3060] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:46.840412 30226 leader_election.cc:290] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:46.848990 30227 raft_consensus.cc:3060] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:46.846779 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:09:46.850916 30337 raft_consensus.cc:515] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:09:46.855962 30143 leader_election.cc:343] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:46.858103 30337 leader_election.cc:290] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:46.859043 30282 leader_election.cc:290] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:46.860350 30217 tablet_bootstrap.cc:492] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:46.853093 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:46.860739 30217 ts_tablet_manager.cc:1403] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.412s	user 0.021s	sys 0.025s
I20260709 13:09:46.861102 30174 raft_consensus.cc:2468] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 0.
I20260709 13:09:46.861877 30099 raft_consensus.cc:3060] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:46.842790 29993 leader_election.cc:304] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:46.865188 30217 raft_consensus.cc:359] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.866813 30217 raft_consensus.cc:385] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:46.867098 30217 raft_consensus.cc:740] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.867687 30217 consensus_queue.cc:260] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.869024 30311 raft_consensus.cc:2804] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:46.869366 30311 raft_consensus.cc:493] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:46.869668 30311 raft_consensus.cc:3060] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:46.865651 29994 leader_election.cc:343] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:46.836076 30308 raft_consensus.cc:515] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.873010 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:09:46.876878 30217 ts_tablet_manager.cc:1434] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 13:09:46.875463 30227 raft_consensus.cc:515] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.879002 30227 leader_election.cc:290] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:46.880018 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:09:46.880487 30174 raft_consensus.cc:3060] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:46.880679 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:09:46.886039 30176 raft_consensus.cc:3060] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:46.902637 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:46.886439 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:09:46.903666 30346 consensus_queue.cc:1048] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.038s
W20260709 13:09:46.904816 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 61198.5us
I20260709 13:09:46.907307 30217 tablet_bootstrap.cc:492] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:46.908974 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:09:46.909588 30098 raft_consensus.cc:3060] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:46.882102 30143 leader_election.cc:304] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:09:46.918467 30339 raft_consensus.cc:2749] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:46.895964 30246 raft_consensus.cc:515] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.911415 30103 raft_consensus.cc:3060] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:46.954675 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:09:46.955319 30028 raft_consensus.cc:3060] T c6d87bb3ff11400cbdaf30e614c4b3da P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:46.974092 30102 raft_consensus.cc:2393] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 1: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:09:46.976554 30028 raft_consensus.cc:2468] T c6d87bb3ff11400cbdaf30e614c4b3da P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 1.
I20260709 13:09:46.981470 30308 leader_election.cc:290] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:09:46.982630 30143 leader_election.cc:343] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:46.989167 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 123250us
I20260709 13:09:46.989733 30219 tablet_bootstrap.cc:492] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:46.990217 30219 ts_tablet_manager.cc:1403] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.546s	user 0.008s	sys 0.053s
I20260709 13:09:46.929107 30027 raft_consensus.cc:2468] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 1.
I20260709 13:09:46.953737 30098 raft_consensus.cc:2468] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 1.
I20260709 13:09:46.994516 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:09:46.995095 30177 raft_consensus.cc:3060] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:46.996749 30219 raft_consensus.cc:359] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.997366 30219 raft_consensus.cc:385] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:46.997604 30219 raft_consensus.cc:740] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:46.998243 30219 consensus_queue.cc:260] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:46.999506 30176 raft_consensus.cc:2468] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 1.
I20260709 13:09:47.000137 30219 ts_tablet_manager.cc:1434] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:09:47.000890 30219 tablet_bootstrap.cc:492] T 2ef07e332d8e432eaf9fc64b07cd74f0 P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:47.012892 29993 leader_election.cc:304] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:47.013201 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:09:47.013419 30246 leader_election.cc:290] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:47.012208 30311 raft_consensus.cc:515] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.015381 30311 leader_election.cc:290] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:47.016781 30308 raft_consensus.cc:2804] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:47.017649 30308 raft_consensus.cc:697] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:09:47.017961 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:09:47.018507 30175 raft_consensus.cc:3060] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.018471 30308 consensus_queue.cc:237] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.020020 30103 raft_consensus.cc:2468] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 1.
I20260709 13:09:47.024178 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:47.028453 30174 raft_consensus.cc:2468] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 1.
I20260709 13:09:47.029542 30218 tablet_bootstrap.cc:654] T f5616428acc64e24945a779e1aee597f P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.029702 29993 leader_election.cc:304] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:47.030925 30311 raft_consensus.cc:2804] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:47.031352 30311 raft_consensus.cc:697] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:09:47.032306 30140 leader_election.cc:304] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:09:47.032105 30311 consensus_queue.cc:237] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.034561 30337 consensus_queue.cc:1048] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:47.032102 30176 raft_consensus.cc:3060] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.048653 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:09:47.049278 30028 raft_consensus.cc:3060] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.036478 30177 raft_consensus.cc:2468] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 1.
I20260709 13:09:47.051935 29993 leader_election.cc:304] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:47.052878 30227 raft_consensus.cc:2804] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:47.053342 30227 raft_consensus.cc:697] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:09:47.054322 30227 consensus_queue.cc:237] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.056907 30028 raft_consensus.cc:2468] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 1.
I20260709 13:09:47.057929 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:09:47.069275 30217 tablet_bootstrap.cc:654] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:47.063470 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 46425.6us
I20260709 13:09:47.078601 30143 leader_election.cc:304] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:47.079582 30337 raft_consensus.cc:2804] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:47.077718 29925 catalog_manager.cc:5697] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:47.080091 30337 raft_consensus.cc:697] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:09:47.081807 29925 catalog_manager.cc:5697] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:47.082351 30337 consensus_queue.cc:237] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.084882 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:09:47.065449 30175 raft_consensus.cc:2468] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 1.
I20260709 13:09:47.085418 30177 raft_consensus.cc:3060] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.086050 30339 raft_consensus.cc:2764] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:09:47.091542 30143 leader_election.cc:304] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:47.092295 30226 raft_consensus.cc:2804] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:47.092732 30226 raft_consensus.cc:697] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
W20260709 13:09:47.080616 29994 leader_election.cc:343] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:47.095345 30227 raft_consensus.cc:493] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.095793 30227 raft_consensus.cc:515] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.095719 29993 leader_election.cc:304] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:47.098446 30311 raft_consensus.cc:2804] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:47.098640 30227 leader_election.cc:290] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:47.098922 30311 raft_consensus.cc:697] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:09:47.099704 30311 consensus_queue.cc:237] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.100581 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:09:47.101846 29993 leader_election.cc:343] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:47.095669 29994 leader_election.cc:343] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:47.102279 30226 consensus_queue.cc:237] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.118280 30217 tablet_bootstrap.cc:492] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:47.118785 30217 ts_tablet_manager.cc:1403] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.212s	user 0.026s	sys 0.027s
I20260709 13:09:47.126860 30218 tablet_bootstrap.cc:492] T f5616428acc64e24945a779e1aee597f P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:47.127231 30218 ts_tablet_manager.cc:1403] T f5616428acc64e24945a779e1aee597f P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.291s	user 0.009s	sys 0.026s
I20260709 13:09:47.128074 30177 raft_consensus.cc:2468] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 1.
I20260709 13:09:47.120841 30346 consensus_queue.cc:1048] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:09:47.135964 30217 raft_consensus.cc:359] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.136590 30217 raft_consensus.cc:385] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.136843 30217 raft_consensus.cc:740] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.138181 30303 consensus_queue.cc:1048] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:47.138577 30217 consensus_queue.cc:260] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.140564 30217 ts_tablet_manager.cc:1434] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:09:47.141458 30217 tablet_bootstrap.cc:492] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:47.140831 29923 catalog_manager.cc:5697] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 0 to 1, leader changed from <none> to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 1 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:47.141875 30218 raft_consensus.cc:359] T f5616428acc64e24945a779e1aee597f P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.142504 30218 raft_consensus.cc:385] T f5616428acc64e24945a779e1aee597f P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.142756 30218 raft_consensus.cc:740] T f5616428acc64e24945a779e1aee597f P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.146082 30218 consensus_queue.cc:260] T f5616428acc64e24945a779e1aee597f P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.125964 30068 leader_election.cc:304] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:09:47.147709 30219 tablet_bootstrap.cc:654] T 2ef07e332d8e432eaf9fc64b07cd74f0 P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.147663 30346 raft_consensus.cc:2749] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:47.148797 30246 consensus_queue.cc:1048] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:47.148952 30068 leader_election.cc:304] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:47.149540 30218 ts_tablet_manager.cc:1434] T f5616428acc64e24945a779e1aee597f P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:09:47.149838 30346 raft_consensus.cc:2804] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:47.150779 30346 raft_consensus.cc:697] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:09:47.151214 30218 tablet_bootstrap.cc:492] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:47.151543 30346 consensus_queue.cc:237] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:09:47.155316 29994 leader_election.cc:343] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:47.159561 30337 raft_consensus.cc:493] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.166298 30337 raft_consensus.cc:515] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:09:47.170595 29994 leader_election.cc:343] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:47.172207 30337 leader_election.cc:290] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:47.173457 30217 tablet_bootstrap.cc:654] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.174821 30140 leader_election.cc:304] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:09:47.175530 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:47.175946 30337 raft_consensus.cc:2804] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:47.176565 30337 raft_consensus.cc:697] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
W20260709 13:09:47.176709 30143 leader_election.cc:343] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:47.177577 30337 consensus_queue.cc:237] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.186918 30346 consensus_queue.cc:1048] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:47.187569 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:47.189322 30218 tablet_bootstrap.cc:654] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.186086 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:09:47.193902 30103 raft_consensus.cc:3060] T f5616428acc64e24945a779e1aee597f P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.197434 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:09:47.197724 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:47.197899 30027 raft_consensus.cc:3060] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.198485 30028 raft_consensus.cc:2393] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 1: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:09:47.204396 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:47.219843 30103 raft_consensus.cc:2468] T f5616428acc64e24945a779e1aee597f P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 1.
I20260709 13:09:47.224123 30140 leader_election.cc:304] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:09:47.224720 30337 raft_consensus.cc:2749] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:47.228849 29994 leader_election.cc:343] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:47.230265 29994 leader_election.cc:304] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
W20260709 13:09:47.230365 30140 leader_election.cc:343] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:47.230808 30140 leader_election.cc:304] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:09:47.231920 30337 raft_consensus.cc:2749] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:47.233208 30303 raft_consensus.cc:2749] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:47.239383 30219 tablet_bootstrap.cc:492] T 2ef07e332d8e432eaf9fc64b07cd74f0 P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:47.239763 30219 ts_tablet_manager.cc:1403] T 2ef07e332d8e432eaf9fc64b07cd74f0 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.239s	user 0.011s	sys 0.008s
I20260709 13:09:47.244414 30219 raft_consensus.cc:359] T 2ef07e332d8e432eaf9fc64b07cd74f0 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.245029 30219 raft_consensus.cc:385] T 2ef07e332d8e432eaf9fc64b07cd74f0 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.245210 30027 raft_consensus.cc:2468] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 1.
I20260709 13:09:47.245316 30219 raft_consensus.cc:740] T 2ef07e332d8e432eaf9fc64b07cd74f0 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.246484 30219 consensus_queue.cc:260] T 2ef07e332d8e432eaf9fc64b07cd74f0 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.248365 30219 ts_tablet_manager.cc:1434] T 2ef07e332d8e432eaf9fc64b07cd74f0 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:09:47.249174 30219 tablet_bootstrap.cc:492] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:47.255374 29925 catalog_manager.cc:5697] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:47.257656 29925 catalog_manager.cc:5697] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:47.262943 30219 tablet_bootstrap.cc:654] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.263250 30218 tablet_bootstrap.cc:492] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:47.263679 30218 ts_tablet_manager.cc:1403] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.113s	user 0.013s	sys 0.007s
I20260709 13:09:47.265267 30217 tablet_bootstrap.cc:492] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:47.265602 30217 ts_tablet_manager.cc:1403] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.124s	user 0.008s	sys 0.011s
I20260709 13:09:47.268181 30217 raft_consensus.cc:359] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.268766 30217 raft_consensus.cc:385] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.268694 30218 raft_consensus.cc:359] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.269107 30217 raft_consensus.cc:740] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.269447 30218 raft_consensus.cc:385] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.269727 30218 raft_consensus.cc:740] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.270099 30217 consensus_queue.cc:260] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.271302 30218 consensus_queue.cc:260] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.272948 30218 ts_tablet_manager.cc:1434] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:09:47.273103 30217 ts_tablet_manager.cc:1434] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:47.273986 30217 tablet_bootstrap.cc:492] T 48d3196b43924d35bf72234ad500783e P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:47.274101 30218 tablet_bootstrap.cc:492] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:47.274322 29923 catalog_manager.cc:5697] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 0 to 1, leader changed from <none> to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 1 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:47.276363 30219 tablet_bootstrap.cc:492] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:47.276859 30219 ts_tablet_manager.cc:1403] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.001s
I20260709 13:09:47.276821 29923 catalog_manager.cc:5697] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 0 to 1, leader changed from <none> to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 1 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:47.279716 30219 raft_consensus.cc:359] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.280337 30218 tablet_bootstrap.cc:654] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.280484 30219 raft_consensus.cc:385] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.280843 30219 raft_consensus.cc:740] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.281559 30219 consensus_queue.cc:260] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.283607 30219 ts_tablet_manager.cc:1434] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 13:09:47.287971 30217 tablet_bootstrap.cc:654] T 48d3196b43924d35bf72234ad500783e P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.292841 30218 tablet_bootstrap.cc:492] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:47.293375 30218 ts_tablet_manager.cc:1403] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
I20260709 13:09:47.293062 30219 tablet_bootstrap.cc:492] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:47.292199 29926 catalog_manager.cc:5697] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:47.296146 30218 raft_consensus.cc:359] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.296761 30218 raft_consensus.cc:385] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.297005 30218 raft_consensus.cc:740] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.297719 30218 consensus_queue.cc:260] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.299880 30218 ts_tablet_manager.cc:1434] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:47.300503 30219 tablet_bootstrap.cc:654] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.302011 30218 tablet_bootstrap.cc:492] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:47.305275 30219 tablet_bootstrap.cc:492] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:47.305717 30219 ts_tablet_manager.cc:1403] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.001s
I20260709 13:09:47.307262 30218 tablet_bootstrap.cc:654] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.308725 30219 raft_consensus.cc:359] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.309386 30219 raft_consensus.cc:385] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.309623 30219 raft_consensus.cc:740] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.311137 30217 tablet_bootstrap.cc:492] T 48d3196b43924d35bf72234ad500783e P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:47.311550 30217 ts_tablet_manager.cc:1403] T 48d3196b43924d35bf72234ad500783e P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.038s	user 0.007s	sys 0.001s
I20260709 13:09:47.313989 30217 raft_consensus.cc:359] T 48d3196b43924d35bf72234ad500783e P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.314608 30217 raft_consensus.cc:385] T 48d3196b43924d35bf72234ad500783e P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.314864 30218 tablet_bootstrap.cc:492] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:47.314851 30217 raft_consensus.cc:740] T 48d3196b43924d35bf72234ad500783e P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.315387 30218 ts_tablet_manager.cc:1403] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 13:09:47.315677 30217 consensus_queue.cc:260] T 48d3196b43924d35bf72234ad500783e P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.317871 30218 raft_consensus.cc:359] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.318475 30218 raft_consensus.cc:385] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.318727 30218 raft_consensus.cc:740] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.319413 30218 consensus_queue.cc:260] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.321308 30218 ts_tablet_manager.cc:1434] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.002s
I20260709 13:09:47.322384 30218 tablet_bootstrap.cc:492] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:47.322885 30219 consensus_queue.cc:260] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.324752 30219 ts_tablet_manager.cc:1434] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.000s
I20260709 13:09:47.325532 30219 tablet_bootstrap.cc:492] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:47.328011 30218 tablet_bootstrap.cc:654] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.322415 30217 ts_tablet_manager.cc:1434] T 48d3196b43924d35bf72234ad500783e P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:09:47.330651 30219 tablet_bootstrap.cc:654] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.330704 30217 tablet_bootstrap.cc:492] T d968b6d22e3243bfb840139be8b6dddd P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:47.337162 30217 tablet_bootstrap.cc:654] T d968b6d22e3243bfb840139be8b6dddd P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.338960 30218 tablet_bootstrap.cc:492] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:47.339464 30218 ts_tablet_manager.cc:1403] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.017s	user 0.006s	sys 0.009s
I20260709 13:09:47.341878 30218 raft_consensus.cc:359] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.342516 30218 raft_consensus.cc:385] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.342763 30218 raft_consensus.cc:740] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.343557 30218 consensus_queue.cc:260] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.346493 30218 ts_tablet_manager.cc:1434] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:09:47.347314 30218 tablet_bootstrap.cc:492] T 80006b8186d74baba29992ade1966048 P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:47.352703 30218 tablet_bootstrap.cc:654] T 80006b8186d74baba29992ade1966048 P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.356089 30219 tablet_bootstrap.cc:492] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:47.356515 30219 ts_tablet_manager.cc:1403] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.004s
I20260709 13:09:47.358376 30246 raft_consensus.cc:493] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.358856 30246 raft_consensus.cc:515] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.359262 30218 tablet_bootstrap.cc:492] T 80006b8186d74baba29992ade1966048 P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:47.359710 30218 ts_tablet_manager.cc:1403] T 80006b8186d74baba29992ade1966048 P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.013s	user 0.007s	sys 0.004s
I20260709 13:09:47.359488 30219 raft_consensus.cc:359] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.360211 30219 raft_consensus.cc:385] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.360491 30219 raft_consensus.cc:740] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.360852 30246 leader_election.cc:290] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:47.361280 30219 consensus_queue.cc:260] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.362361 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:47.362275 30218 raft_consensus.cc:359] T 80006b8186d74baba29992ade1966048 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.362939 30218 raft_consensus.cc:385] T 80006b8186d74baba29992ade1966048 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.363198 30218 raft_consensus.cc:740] T 80006b8186d74baba29992ade1966048 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.364058 30218 consensus_queue.cc:260] T 80006b8186d74baba29992ade1966048 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.364846 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:47.365542 30176 raft_consensus.cc:2393] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 1: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:09:47.366214 30218 ts_tablet_manager.cc:1434] T 80006b8186d74baba29992ade1966048 P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:47.366879 30303 raft_consensus.cc:493] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.367617 30218 tablet_bootstrap.cc:492] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:47.367987 30219 ts_tablet_manager.cc:1434] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:09:47.368829 30219 tablet_bootstrap.cc:492] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:47.368721 30068 leader_election.cc:304] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:09:47.367307 30303 raft_consensus.cc:515] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.373736 30218 tablet_bootstrap.cc:654] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.374358 30219 tablet_bootstrap.cc:654] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.375391 30303 leader_election.cc:290] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:47.376618 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:47.377277 30098 raft_consensus.cc:2468] T 64e2b2bd54d3454a9f64030c149e2e25 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 0.
I20260709 13:09:47.380167 30246 raft_consensus.cc:3060] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.380519 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:47.381980 30219 tablet_bootstrap.cc:492] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:47.382426 30219 ts_tablet_manager.cc:1403] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.014s	user 0.012s	sys 0.000s
W20260709 13:09:47.381925 29993 leader_election.cc:343] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:47.386792 29994 leader_election.cc:304] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:09:47.389200 30278 raft_consensus.cc:493] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.389691 30303 raft_consensus.cc:2804] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:47.389637 30278 raft_consensus.cc:515] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.389935 30219 raft_consensus.cc:359] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.390203 30303 raft_consensus.cc:493] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.390599 30219 raft_consensus.cc:385] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.390887 30219 raft_consensus.cc:740] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.390726 30303 raft_consensus.cc:3060] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.393121 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:47.391669 30278 leader_election.cc:290] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:47.393720 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:47.394490 30176 raft_consensus.cc:2393] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 1: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:09:47.395740 30068 leader_election.cc:304] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:09:47.396430 30346 raft_consensus.cc:3060] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.391628 30246 raft_consensus.cc:2749] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:47.391506 30219 consensus_queue.cc:260] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.400404 30219 ts_tablet_manager.cc:1434] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:09:47.401057 30303 raft_consensus.cc:515] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.402482 30217 tablet_bootstrap.cc:492] T d968b6d22e3243bfb840139be8b6dddd P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:47.402669 30346 raft_consensus.cc:2749] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:47.403007 30217 ts_tablet_manager.cc:1403] T d968b6d22e3243bfb840139be8b6dddd P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.072s	user 0.014s	sys 0.004s
I20260709 13:09:47.403340 30346 raft_consensus.cc:493] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.403761 30346 raft_consensus.cc:515] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.405676 30217 raft_consensus.cc:359] T d968b6d22e3243bfb840139be8b6dddd P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.406337 30218 tablet_bootstrap.cc:492] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:47.406375 30217 raft_consensus.cc:385] T d968b6d22e3243bfb840139be8b6dddd P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.406299 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:47.406951 30218 ts_tablet_manager.cc:1403] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.039s	user 0.015s	sys 0.007s
I20260709 13:09:47.406975 30217 raft_consensus.cc:740] T d968b6d22e3243bfb840139be8b6dddd P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.407935 30217 consensus_queue.cc:260] T d968b6d22e3243bfb840139be8b6dddd P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.409421 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:47.410163 30176 raft_consensus.cc:2393] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 1: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:09:47.411239 30068 leader_election.cc:304] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:09:47.411805 30217 ts_tablet_manager.cc:1434] T d968b6d22e3243bfb840139be8b6dddd P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:09:47.412703 30217 tablet_bootstrap.cc:492] T 9cd772608bf64bf9b1c1aec00dc57eee P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:47.413293 30218 raft_consensus.cc:359] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.413925 30218 raft_consensus.cc:385] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.414208 30218 raft_consensus.cc:740] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.414829 30218 consensus_queue.cc:260] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.415292 30246 raft_consensus.cc:3060] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.416759 30218 ts_tablet_manager.cc:1434] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.000s
I20260709 13:09:47.417649 30218 tablet_bootstrap.cc:492] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:47.421062 30311 consensus_queue.cc:1048] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:47.409626 30219 tablet_bootstrap.cc:492] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:47.422389 30217 tablet_bootstrap.cc:654] T 9cd772608bf64bf9b1c1aec00dc57eee P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.422879 30218 tablet_bootstrap.cc:654] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.427886 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:09:47.428483 30098 raft_consensus.cc:3060] T 64e2b2bd54d3454a9f64030c149e2e25 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.434451 30346 leader_election.cc:290] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:47.435051 30098 raft_consensus.cc:2468] T 64e2b2bd54d3454a9f64030c149e2e25 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 1.
I20260709 13:09:47.436240 29994 leader_election.cc:304] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:09:47.437057 30308 raft_consensus.cc:2804] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:47.437477 30308 raft_consensus.cc:697] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:09:47.439456 30310 consensus_queue.cc:1048] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:09:47.442314 30308 consensus_queue.cc:237] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.439272 30337 raft_consensus.cc:493] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.445264 30337 raft_consensus.cc:515] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.445853 30217 tablet_bootstrap.cc:492] T 9cd772608bf64bf9b1c1aec00dc57eee P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:47.446895 30217 ts_tablet_manager.cc:1403] T 9cd772608bf64bf9b1c1aec00dc57eee P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.034s	user 0.012s	sys 0.001s
I20260709 13:09:47.448683 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:47.449278 30100 raft_consensus.cc:2468] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 0.
I20260709 13:09:47.450153 30217 raft_consensus.cc:359] T 9cd772608bf64bf9b1c1aec00dc57eee P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.450438 30143 leader_election.cc:304] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:47.450903 30337 leader_election.cc:290] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:47.452090 30217 raft_consensus.cc:385] T 9cd772608bf64bf9b1c1aec00dc57eee P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.451974 30337 raft_consensus.cc:2804] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:47.452807 30337 raft_consensus.cc:493] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.453270 30337 raft_consensus.cc:3060] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.452829 30217 raft_consensus.cc:740] T 9cd772608bf64bf9b1c1aec00dc57eee P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.454157 30217 consensus_queue.cc:260] T 9cd772608bf64bf9b1c1aec00dc57eee P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.456161 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:47.452414 30246 raft_consensus.cc:2749] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:47.456745 30028 raft_consensus.cc:2468] T 2ef07e332d8e432eaf9fc64b07cd74f0 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 0.
I20260709 13:09:47.462237 30217 ts_tablet_manager.cc:1434] T 9cd772608bf64bf9b1c1aec00dc57eee P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 13:09:47.463675 30217 tablet_bootstrap.cc:492] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:47.468598 30337 raft_consensus.cc:515] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.469530 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:09:47.469937 30303 leader_election.cc:290] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:47.470582 30337 leader_election.cc:290] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:47.471645 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:09:47.471906 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:09:47.472313 30098 raft_consensus.cc:3060] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.472422 30028 raft_consensus.cc:3060] T 2ef07e332d8e432eaf9fc64b07cd74f0 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.474411 29925 catalog_manager.cc:5697] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:47.478121 29993 leader_election.cc:343] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:47.478937 30308 raft_consensus.cc:493] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.479362 30308 raft_consensus.cc:515] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.481178 30308 leader_election.cc:290] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:47.481352 30098 raft_consensus.cc:2468] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 1.
I20260709 13:09:47.482609 30143 leader_election.cc:304] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:47.484243 30219 tablet_bootstrap.cc:654] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.485203 30217 tablet_bootstrap.cc:654] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.488801 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:47.489477 30176 raft_consensus.cc:2468] T 9cd772608bf64bf9b1c1aec00dc57eee P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 0.
I20260709 13:09:47.491029 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:47.495975 30310 raft_consensus.cc:493] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.496479 30310 raft_consensus.cc:515] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.496899 30028 raft_consensus.cc:2468] T 2ef07e332d8e432eaf9fc64b07cd74f0 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 1.
I20260709 13:09:47.498443 30310 leader_election.cc:290] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:47.502286 29993 leader_election.cc:304] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:47.502686 30308 consensus_queue.cc:1048] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:47.504004 30311 raft_consensus.cc:2804] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:47.504390 30311 raft_consensus.cc:493] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:09:47.504312 29994 leader_election.cc:343] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:47.504818 30311 raft_consensus.cc:3060] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.505116 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:47.505687 30102 raft_consensus.cc:2468] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 0.
I20260709 13:09:47.506726 29994 leader_election.cc:304] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:09:47.507496 30303 raft_consensus.cc:2804] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:47.507849 30303 raft_consensus.cc:493] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.508172 30303 raft_consensus.cc:3060] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.509531 30218 tablet_bootstrap.cc:492] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:47.510028 30218 ts_tablet_manager.cc:1403] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.093s	user 0.028s	sys 0.049s
I20260709 13:09:47.510166 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:47.510778 30176 raft_consensus.cc:2468] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 0.
I20260709 13:09:47.512207 30217 tablet_bootstrap.cc:492] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:47.512631 30217 ts_tablet_manager.cc:1403] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.049s	user 0.009s	sys 0.003s
I20260709 13:09:47.512876 30218 raft_consensus.cc:359] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.513525 30218 raft_consensus.cc:385] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.513841 30218 raft_consensus.cc:740] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.511831 30311 raft_consensus.cc:515] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.514603 30218 consensus_queue.cc:260] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.515381 30310 consensus_queue.cc:1048] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:47.516884 30218 ts_tablet_manager.cc:1434] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:09:47.517133 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:09:47.517660 30176 raft_consensus.cc:3060] T 9cd772608bf64bf9b1c1aec00dc57eee P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.517853 30218 tablet_bootstrap.cc:492] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:47.518217 30303 raft_consensus.cc:515] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.518527 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:09:47.521113 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:09:47.521653 30177 raft_consensus.cc:3060] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:47.522830 29994 leader_election.cc:343] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:47.523924 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:09:47.526340 30100 raft_consensus.cc:3060] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.526396 30217 raft_consensus.cc:359] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.527140 30217 raft_consensus.cc:385] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.527422 30217 raft_consensus.cc:740] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.500187 30219 tablet_bootstrap.cc:492] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:47.525357 30176 raft_consensus.cc:2468] T 9cd772608bf64bf9b1c1aec00dc57eee P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 1.
I20260709 13:09:47.525377 30303 leader_election.cc:290] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:47.530169 30219 ts_tablet_manager.cc:1403] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.121s	user 0.009s	sys 0.003s
I20260709 13:09:47.531947 30177 raft_consensus.cc:2468] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 1.
I20260709 13:09:47.525734 30311 leader_election.cc:290] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:47.528347 30217 consensus_queue.cc:260] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.534396 29993 leader_election.cc:304] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:47.534941 30337 raft_consensus.cc:2804] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:47.535964 30303 raft_consensus.cc:2804] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:47.536118 29993 leader_election.cc:304] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:09:47.536422 30303 raft_consensus.cc:697] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:09:47.536688 30218 tablet_bootstrap.cc:654] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.537441 30308 raft_consensus.cc:2804] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:47.537928 30308 raft_consensus.cc:697] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:09:47.538682 30308 consensus_queue.cc:237] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.539129 30337 raft_consensus.cc:697] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:09:47.537217 30303 consensus_queue.cc:237] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.539966 30337 consensus_queue.cc:237] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.544727 30282 consensus_queue.cc:1048] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.033s
I20260709 13:09:47.556320 30217 ts_tablet_manager.cc:1434] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.043s	user 0.004s	sys 0.002s
I20260709 13:09:47.578701 30217 tablet_bootstrap.cc:492] T c41a6d79ca9c459eb4b0b41302fb76a9 P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:47.545356 30100 raft_consensus.cc:2468] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 1.
I20260709 13:09:47.555029 30246 raft_consensus.cc:493] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.581789 30246 raft_consensus.cc:515] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.583904 30246 leader_election.cc:290] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:47.584985 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:09:47.586433 30068 leader_election.cc:343] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:47.574700 30219 raft_consensus.cc:359] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.587208 30219 raft_consensus.cc:385] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.587312 30217 tablet_bootstrap.cc:654] T c41a6d79ca9c459eb4b0b41302fb76a9 P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.587607 30219 raft_consensus.cc:740] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.587826 30218 tablet_bootstrap.cc:492] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:47.588284 30218 ts_tablet_manager.cc:1403] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.071s	user 0.002s	sys 0.015s
I20260709 13:09:47.588477 30219 consensus_queue.cc:260] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.590862 30219 ts_tablet_manager.cc:1434] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.059s	user 0.004s	sys 0.001s
I20260709 13:09:47.591192 30218 raft_consensus.cc:359] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.591837 30218 raft_consensus.cc:385] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.592017 30219 tablet_bootstrap.cc:492] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:47.592090 30218 raft_consensus.cc:740] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.595010 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:47.595602 30027 raft_consensus.cc:2468] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 0.
I20260709 13:09:47.593024 30218 consensus_queue.cc:260] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.600871 30309 consensus_queue.cc:1048] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:47.605034 30309 consensus_queue.cc:1048] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:47.609237 29926 catalog_manager.cc:5697] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 0 to 1, leader changed from <none> to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 1 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:47.625595 29926 catalog_manager.cc:5697] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:47.629356 30218 ts_tablet_manager.cc:1434] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.041s	user 0.004s	sys 0.002s
I20260709 13:09:47.630322 30218 tablet_bootstrap.cc:492] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:47.647439 30303 raft_consensus.cc:493] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.647928 30303 raft_consensus.cc:515] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.645236 30221 raft_consensus.cc:493] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.650648 30221 raft_consensus.cc:515] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.652136 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:47.652717 30221 leader_election.cc:290] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:47.652735 30176 raft_consensus.cc:2468] T 48d3196b43924d35bf72234ad500783e P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 0.
I20260709 13:09:47.654032 29993 leader_election.cc:304] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:47.654814 30309 raft_consensus.cc:2804] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:47.655138 30066 leader_election.cc:304] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:09:47.655812 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:47.655149 30309 raft_consensus.cc:493] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.656720 30309 raft_consensus.cc:3060] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.656881 30346 consensus_queue.cc:1048] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:47.658353 30346 raft_consensus.cc:2804] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:47.658692 30346 raft_consensus.cc:493] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.658830 30246 raft_consensus.cc:493] T 80006b8186d74baba29992ade1966048 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.659324 30246 raft_consensus.cc:515] T 80006b8186d74baba29992ade1966048 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.645128 30337 raft_consensus.cc:493] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.660360 30337 raft_consensus.cc:515] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.662323 30337 leader_election.cc:290] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:47.662890 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:47.644536 30308 raft_consensus.cc:493] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.663746 30308 raft_consensus.cc:515] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.664179 30176 raft_consensus.cc:2468] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 0.
I20260709 13:09:47.665546 30337 consensus_queue.cc:1048] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:47.665869 30246 leader_election.cc:290] T 80006b8186d74baba29992ade1966048 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:47.666630 30068 leader_election.cc:304] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:47.663359 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:47.667243 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:47.667321 30102 raft_consensus.cc:2468] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 0.
I20260709 13:09:47.669050 30143 leader_election.cc:304] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:47.669878 30337 raft_consensus.cc:2804] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:47.670260 30337 raft_consensus.cc:493] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.670804 30337 raft_consensus.cc:3060] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.672123 30309 raft_consensus.cc:515] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.673782 30346 raft_consensus.cc:3060] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.678771 30337 raft_consensus.cc:515] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.676451 30303 leader_election.cc:290] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:47.676518 30308 leader_election.cc:290] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:47.679704 30246 raft_consensus.cc:2804] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:47.687786 30246 raft_consensus.cc:493] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:47.688206 30246 raft_consensus.cc:3060] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.689546 30218 tablet_bootstrap.cc:654] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:47.690217 30219 tablet_bootstrap.cc:654] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:47.692798 29993 leader_election.cc:343] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:47.705402 30309 leader_election.cc:290] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:47.704113 30303 consensus_queue.cc:1048] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:09:47.700124 30346 raft_consensus.cc:515] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.707897 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:09:47.708526 30176 raft_consensus.cc:3060] T 48d3196b43924d35bf72234ad500783e P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.709069 30346 leader_election.cc:290] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:47.713881 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
W20260709 13:09:47.724941 30068 leader_election.cc:343] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:47.732568 30278 consensus_queue.cc:1048] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:47.734390 30226 consensus_queue.cc:1048] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:47.716645 29926 catalog_manager.cc:5697] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:47.757122 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:09:47.757462 30337 leader_election.cc:290] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:47.783763 30217 tablet_bootstrap.cc:492] T c41a6d79ca9c459eb4b0b41302fb76a9 P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:47.785633 30217 ts_tablet_manager.cc:1403] T c41a6d79ca9c459eb4b0b41302fb76a9 P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.207s	user 0.091s	sys 0.074s
I20260709 13:09:47.807291 30282 raft_consensus.cc:493] T d968b6d22e3243bfb840139be8b6dddd P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.818868 30282 raft_consensus.cc:515] T d968b6d22e3243bfb840139be8b6dddd P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.821070 30282 leader_election.cc:290] T d968b6d22e3243bfb840139be8b6dddd P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:47.830844 30219 tablet_bootstrap.cc:492] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:47.831751 30219 ts_tablet_manager.cc:1403] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.240s	user 0.013s	sys 0.000s
I20260709 13:09:47.829440 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
W20260709 13:09:47.835070 30143 leader_election.cc:343] T d968b6d22e3243bfb840139be8b6dddd P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:47.836056 30103 raft_consensus.cc:3060] T 80006b8186d74baba29992ade1966048 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.836653 30176 raft_consensus.cc:2468] T 48d3196b43924d35bf72234ad500783e P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 1.
I20260709 13:09:47.837800 29993 leader_election.cc:304] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:47.841352 30310 raft_consensus.cc:2804] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:47.841953 30310 raft_consensus.cc:697] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:09:47.842814 30310 consensus_queue.cc:237] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:09:47.844611 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 166702us
I20260709 13:09:47.853287 30218 tablet_bootstrap.cc:492] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:47.853796 30218 ts_tablet_manager.cc:1403] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.224s	user 0.013s	sys 0.012s
I20260709 13:09:47.860518 30218 raft_consensus.cc:359] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.860978 30218 raft_consensus.cc:385] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.861186 30218 raft_consensus.cc:740] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.861619 30218 consensus_queue.cc:260] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.863013 30405 consensus_queue.cc:1048] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:47.864152 29974 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:47.866001 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:47.866430 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:47.866617 30100 raft_consensus.cc:2468] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 0.
I20260709 13:09:47.867036 30101 raft_consensus.cc:2468] T d7be23af8c824b3bb048a59d6bdf884c P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 0.
I20260709 13:09:47.868803 30218 ts_tablet_manager.cc:1434] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.000s
I20260709 13:09:47.869102 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:09:47.869236 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:47.869647 30101 raft_consensus.cc:3060] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:47.870039 30218 tablet_bootstrap.cc:492] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:47.865998 30226 consensus_queue.cc:1048] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:09:47.876566 30246 raft_consensus.cc:515] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.876868 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:47.878228 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:09:47.879612 30219 raft_consensus.cc:359] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.884629 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:47.884327 30219 raft_consensus.cc:385] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.886039 30098 raft_consensus.cc:2393] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 1: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:09:47.888447 30026 raft_consensus.cc:3060] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:47.892027 30406 log.cc:927] Time spent T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.082s	user 0.001s	sys 0.001s
I20260709 13:09:47.885613 30219 raft_consensus.cc:740] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.891949 30217 raft_consensus.cc:359] T c41a6d79ca9c459eb4b0b41302fb76a9 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.893100 30217 raft_consensus.cc:385] T c41a6d79ca9c459eb4b0b41302fb76a9 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:47.893375 30217 raft_consensus.cc:740] T c41a6d79ca9c459eb4b0b41302fb76a9 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:47.901980 30219 consensus_queue.cc:260] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.963990 30217 consensus_queue.cc:260] T c41a6d79ca9c459eb4b0b41302fb76a9 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.974838 30219 ts_tablet_manager.cc:1434] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.143s	user 0.016s	sys 0.009s
I20260709 13:09:47.976447 30219 tablet_bootstrap.cc:492] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:47.888554 30101 raft_consensus.cc:2468] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 1.
I20260709 13:09:47.968107 30303 raft_consensus.cc:493] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.909152 30027 raft_consensus.cc:2393] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 1: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:09:47.908826 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:09:47.908921 30026 raft_consensus.cc:2468] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 1.
I20260709 13:09:47.986487 30217 ts_tablet_manager.cc:1434] T c41a6d79ca9c459eb4b0b41302fb76a9 P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.201s	user 0.010s	sys 0.025s
I20260709 13:09:47.987151 30217 tablet_bootstrap.cc:492] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:47.977547 30337 raft_consensus.cc:493] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:47.985630 30246 leader_election.cc:290] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:47.995622 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:47.985893 30303 raft_consensus.cc:515] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:47.989641 30337 raft_consensus.cc:515] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:09:48.005277 30066 leader_election.cc:343] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.007223 30066 leader_election.cc:304] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
W20260709 13:09:48.007484 30140 leader_election.cc:343] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.008144 30218 tablet_bootstrap.cc:654] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:48.009532 30140 leader_election.cc:343] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.009928 30278 raft_consensus.cc:2804] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:48.009970 30140 leader_election.cc:304] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:09:48.010517 30278 raft_consensus.cc:697] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
W20260709 13:09:48.011162 30140 leader_election.cc:343] T d968b6d22e3243bfb840139be8b6dddd P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.011327 30278 consensus_queue.cc:237] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.011623 30140 leader_election.cc:304] T d968b6d22e3243bfb840139be8b6dddd P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:09:48.012619 30281 raft_consensus.cc:2749] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:48.015439 29994 leader_election.cc:304] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:09:48.016680 30404 raft_consensus.cc:2804] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:48.024616 30226 raft_consensus.cc:2749] T d968b6d22e3243bfb840139be8b6dddd P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:48.024783 30411 consensus_queue.cc:1048] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:09:48.025223 30337 leader_election.cc:290] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:48.022653 30404 raft_consensus.cc:493] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.025920 30404 raft_consensus.cc:3060] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.012770 30066 leader_election.cc:304] T 80006b8186d74baba29992ade1966048 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:09:48.034448 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:48.036686 30103 raft_consensus.cc:2393] T 64e2b2bd54d3454a9f64030c149e2e25 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 1: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:09:48.032974 30246 raft_consensus.cc:2749] T 80006b8186d74baba29992ade1966048 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:48.041723 30337 consensus_queue.cc:1048] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:48.041803 30309 consensus_queue.cc:1048] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:48.044430 30219 tablet_bootstrap.cc:654] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:48.049256 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:09:48.050081 30174 raft_consensus.cc:2393] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 1: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:09:48.058797 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:48.044909 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:09:48.048115 30404 raft_consensus.cc:515] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.064052 30219 tablet_bootstrap.cc:492] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:48.064508 30219 ts_tablet_manager.cc:1403] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.088s	user 0.006s	sys 0.013s
I20260709 13:09:48.059473 30303 leader_election.cc:290] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:48.065001 30337 consensus_queue.cc:1048] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:09:48.066983 29926 catalog_manager.cc:5697] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:48.075327 30411 raft_consensus.cc:493] T c41a6d79ca9c459eb4b0b41302fb76a9 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.085089 30311 consensus_queue.cc:1048] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:48.086542 30140 leader_election.cc:304] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:09:48.087661 30337 consensus_queue.cc:1048] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:48.087954 30226 raft_consensus.cc:3060] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.089318 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:48.093060 30217 tablet_bootstrap.cc:654] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:48.095227 29925 catalog_manager.cc:5697] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:48.112028 30219 raft_consensus.cc:359] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.113505 30219 raft_consensus.cc:385] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:48.113726 30219 raft_consensus.cc:740] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
W20260709 13:09:48.106853 30066 leader_election.cc:343] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.114428 30219 consensus_queue.cc:260] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.094023 30411 raft_consensus.cc:515] T c41a6d79ca9c459eb4b0b41302fb76a9 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.116784 30219 ts_tablet_manager.cc:1434] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.000s
I20260709 13:09:48.117647 30219 tablet_bootstrap.cc:492] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:48.118242 30404 leader_election.cc:290] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:48.119105 30411 leader_election.cc:290] T c41a6d79ca9c459eb4b0b41302fb76a9 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:48.119403 30066 leader_election.cc:304] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:09:48.120196 30278 raft_consensus.cc:2749] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:48.121999 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:48.122790 30025 raft_consensus.cc:2393] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 1: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:09:48.125391 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:09:48.126001 30096 raft_consensus.cc:3060] T d7be23af8c824b3bb048a59d6bdf884c P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.129132 30218 tablet_bootstrap.cc:492] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:48.129483 30218 ts_tablet_manager.cc:1403] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.260s	user 0.022s	sys 0.043s
W20260709 13:09:48.114892 29993 leader_election.cc:343] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.133776 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:48.146905 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:48.148404 30218 raft_consensus.cc:359] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.155747 30218 raft_consensus.cc:385] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:48.156038 30218 raft_consensus.cc:740] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.156679 30218 consensus_queue.cc:260] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:09:48.158174 29994 leader_election.cc:343] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.158614 29994 leader_election.cc:304] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:09:48.159894 30309 raft_consensus.cc:2749] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:48.161187 30096 raft_consensus.cc:2468] T d7be23af8c824b3bb048a59d6bdf884c P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 1.
I20260709 13:09:48.143054 30404 consensus_queue.cc:1048] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260709 13:09:48.170626 30219 tablet_bootstrap.cc:654] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:48.172228 30218 ts_tablet_manager.cc:1434] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.001s
I20260709 13:09:48.173283 30226 raft_consensus.cc:2749] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:48.173310 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:09:48.177045 30143 leader_election.cc:304] T c41a6d79ca9c459eb4b0b41302fb76a9 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:09:48.178870 30226 raft_consensus.cc:3060] T c41a6d79ca9c459eb4b0b41302fb76a9 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.179056 30308 consensus_queue.cc:1048] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:48.187227 30218 tablet_bootstrap.cc:492] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
W20260709 13:09:48.192955 29993 leader_election.cc:343] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.199312 29994 leader_election.cc:304] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:09:48.200155 30309 raft_consensus.cc:2804] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:48.200605 30309 raft_consensus.cc:697] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:09:48.201398 30309 consensus_queue.cc:237] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.218909 30404 consensus_queue.cc:1048] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:48.216154 30226 raft_consensus.cc:2749] T c41a6d79ca9c459eb4b0b41302fb76a9 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:48.228348 30101 raft_consensus.cc:3060] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.235481 30219 tablet_bootstrap.cc:492] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:48.235915 30219 ts_tablet_manager.cc:1403] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.118s	user 0.011s	sys 0.007s
W20260709 13:09:48.255030 30420 log.cc:927] Time spent T 9cd772608bf64bf9b1c1aec00dc57eee P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:09:48.263604 30218 tablet_bootstrap.cc:654] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:48.264254 30219 raft_consensus.cc:359] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.271757 30219 raft_consensus.cc:385] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:48.272115 30219 raft_consensus.cc:740] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.273053 30219 consensus_queue.cc:260] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.277025 30219 ts_tablet_manager.cc:1434] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.041s	user 0.008s	sys 0.000s
I20260709 13:09:48.277922 30219 tablet_bootstrap.cc:492] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:48.274811 29925 catalog_manager.cc:5697] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:48.277266 30405 consensus_queue.cc:1048] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:48.337918 30217 tablet_bootstrap.cc:492] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:48.338323 30217 ts_tablet_manager.cc:1403] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.351s	user 0.018s	sys 0.027s
I20260709 13:09:48.340567 30405 consensus_queue.cc:1048] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:48.346760 30217 raft_consensus.cc:359] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.347556 30217 raft_consensus.cc:385] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:48.347828 30217 raft_consensus.cc:740] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.348474 30217 consensus_queue.cc:260] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.350582 30217 ts_tablet_manager.cc:1434] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:09:48.352116 30217 tablet_bootstrap.cc:492] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:48.358994 30217 tablet_bootstrap.cc:654] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:48.362772 30218 tablet_bootstrap.cc:492] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:48.368261 30218 ts_tablet_manager.cc:1403] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.181s	user 0.014s	sys 0.000s
I20260709 13:09:48.358994 30219 tablet_bootstrap.cc:654] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:48.375494 30218 raft_consensus.cc:359] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.376396 30218 raft_consensus.cc:385] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:48.376718 30218 raft_consensus.cc:740] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.377771 30218 consensus_queue.cc:260] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.379917 30221 raft_consensus.cc:493] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:09:48.384603 30221 raft_consensus.cc:515] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.387434 30218 ts_tablet_manager.cc:1434] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:09:48.390509 30218 tablet_bootstrap.cc:492] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:48.393147 30405 consensus_queue.cc:1048] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:48.395920 30221 leader_election.cc:290] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:48.397226 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:48.397226 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:48.401186 30068 leader_election.cc:304] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:09:48.402961 30278 raft_consensus.cc:2749] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:48.429610 30217 tablet_bootstrap.cc:492] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:48.430641 30217 ts_tablet_manager.cc:1403] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.079s	user 0.029s	sys 0.030s
I20260709 13:09:48.433048 30217 raft_consensus.cc:359] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.433662 30217 raft_consensus.cc:385] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:48.433940 30217 raft_consensus.cc:740] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.434599 30217 consensus_queue.cc:260] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.436600 30217 ts_tablet_manager.cc:1434] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:09:48.437148 30308 raft_consensus.cc:493] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.437448 30217 tablet_bootstrap.cc:492] T d3f3f9c9793f4390874e250718c41697 P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:48.437609 30308 raft_consensus.cc:515] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.439998 30308 leader_election.cc:290] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:48.440837 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:48.441565 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:48.442385 30176 raft_consensus.cc:2468] T d968b6d22e3243bfb840139be8b6dddd P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 0.
W20260709 13:09:48.442900 29994 leader_election.cc:343] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.446074 29993 leader_election.cc:304] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:09:48.448664 30308 raft_consensus.cc:2804] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:48.449872 30308 raft_consensus.cc:493] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.450201 30308 raft_consensus.cc:3060] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.451308 30218 tablet_bootstrap.cc:654] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:48.454698 30221 raft_consensus.cc:493] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.455138 30221 raft_consensus.cc:515] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.455811 30219 tablet_bootstrap.cc:492] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:48.456255 30219 ts_tablet_manager.cc:1403] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.179s	user 0.019s	sys 0.003s
I20260709 13:09:48.458483 30221 leader_election.cc:290] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:48.460009 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:09:48.461385 30068 leader_election.cc:343] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.464264 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:09:48.465503 30066 leader_election.cc:343] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.465490 30308 raft_consensus.cc:515] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.466128 30066 leader_election.cc:304] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:09:48.467135 30221 raft_consensus.cc:2749] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:48.468330 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
W20260709 13:09:48.469362 29994 leader_election.cc:343] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.470427 30219 raft_consensus.cc:359] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.471065 30219 raft_consensus.cc:385] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:48.471336 30219 raft_consensus.cc:740] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.471917 30219 consensus_queue.cc:260] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.473901 30219 ts_tablet_manager.cc:1434] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.003s
I20260709 13:09:48.478322 30278 raft_consensus.cc:493] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.478746 30278 raft_consensus.cc:515] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.480713 30278 leader_election.cc:290] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:48.481212 30308 leader_election.cc:290] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:48.481915 30217 tablet_bootstrap.cc:654] T d3f3f9c9793f4390874e250718c41697 P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:48.481740 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:48.482458 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:09:48.483001 30175 raft_consensus.cc:3060] T d968b6d22e3243bfb840139be8b6dddd P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:48.483201 30068 leader_election.cc:343] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.484278 30219 tablet_bootstrap.cc:492] T b66f98d7fcfe4102a01ace9ed64355ed P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:48.485841 30218 tablet_bootstrap.cc:492] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:48.485996 30217 tablet_bootstrap.cc:492] T d3f3f9c9793f4390874e250718c41697 P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:48.486275 30218 ts_tablet_manager.cc:1403] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.096s	user 0.010s	sys 0.003s
I20260709 13:09:48.486392 30217 ts_tablet_manager.cc:1403] T d3f3f9c9793f4390874e250718c41697 P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.049s	user 0.006s	sys 0.005s
I20260709 13:09:48.488406 30217 raft_consensus.cc:359] T d3f3f9c9793f4390874e250718c41697 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.488956 30217 raft_consensus.cc:385] T d3f3f9c9793f4390874e250718c41697 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:48.489158 30217 raft_consensus.cc:740] T d3f3f9c9793f4390874e250718c41697 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.489678 30217 consensus_queue.cc:260] T d3f3f9c9793f4390874e250718c41697 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.489915 30218 raft_consensus.cc:359] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.490646 30218 raft_consensus.cc:385] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:48.490952 30218 raft_consensus.cc:740] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.491918 30217 ts_tablet_manager.cc:1434] T d3f3f9c9793f4390874e250718c41697 P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:09:48.491807 30218 consensus_queue.cc:260] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.492794 30217 tablet_bootstrap.cc:492] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:48.494341 30218 ts_tablet_manager.cc:1434] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.001s
I20260709 13:09:48.497833 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:48.498561 30308 raft_consensus.cc:493] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.498771 30218 tablet_bootstrap.cc:492] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:48.499044 30308 raft_consensus.cc:515] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.501312 30308 leader_election.cc:290] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:48.502327 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:48.502921 30176 raft_consensus.cc:2468] T d3f3f9c9793f4390874e250718c41697 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 0.
I20260709 13:09:48.504106 30217 tablet_bootstrap.cc:654] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:48.506248 30066 leader_election.cc:343] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.506690 30066 leader_election.cc:304] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:09:48.508015 30278 raft_consensus.cc:2749] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:48.506916 30219 tablet_bootstrap.cc:654] T b66f98d7fcfe4102a01ace9ed64355ed P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:48.511322 30218 tablet_bootstrap.cc:654] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:48.512558 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:48.515092 30217 tablet_bootstrap.cc:492] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:48.515543 30217 ts_tablet_manager.cc:1403] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.007s
I20260709 13:09:48.511267 29993 leader_election.cc:304] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:48.516455 30308 raft_consensus.cc:2804] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:48.516814 30308 raft_consensus.cc:493] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.517124 30308 raft_consensus.cc:3060] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.514566 30175 raft_consensus.cc:2468] T d968b6d22e3243bfb840139be8b6dddd P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 1.
I20260709 13:09:48.518178 30217 raft_consensus.cc:359] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:09:48.517812 29994 leader_election.cc:343] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.518869 30217 raft_consensus.cc:385] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:48.519166 30217 raft_consensus.cc:740] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.519611 30221 consensus_queue.cc:1048] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:48.519774 30217 consensus_queue.cc:260] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.524081 30308 raft_consensus.cc:515] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.526144 30308 leader_election.cc:290] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:48.527204 30217 ts_tablet_manager.cc:1434] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:09:48.527395 29993 leader_election.cc:304] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:09:48.528079 30217 tablet_bootstrap.cc:492] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:48.528369 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:09:48.528565 30303 raft_consensus.cc:2804] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:48.529057 30221 raft_consensus.cc:493] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.529018 30303 raft_consensus.cc:697] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:09:48.529506 30221 raft_consensus.cc:515] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.530202 30303 consensus_queue.cc:237] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:09:48.530654 29994 leader_election.cc:343] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.532898 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:48.527980 30219 tablet_bootstrap.cc:492] T b66f98d7fcfe4102a01ace9ed64355ed P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:48.533524 30176 raft_consensus.cc:2468] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 0.
I20260709 13:09:48.534438 30217 tablet_bootstrap.cc:654] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:48.533766 30219 ts_tablet_manager.cc:1403] T b66f98d7fcfe4102a01ace9ed64355ed P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.050s	user 0.004s	sys 0.010s
I20260709 13:09:48.534660 30068 leader_election.cc:304] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:48.535755 30278 raft_consensus.cc:2804] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:48.535923 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:09:48.536132 30278 raft_consensus.cc:493] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.536504 30278 raft_consensus.cc:3060] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.541145 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:09:48.542364 30066 leader_election.cc:343] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.542990 30278 raft_consensus.cc:515] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.543953 30219 raft_consensus.cc:359] T b66f98d7fcfe4102a01ace9ed64355ed P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.545354 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:09:48.544691 30218 tablet_bootstrap.cc:492] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:48.546173 30218 ts_tablet_manager.cc:1403] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.048s	user 0.012s	sys 0.004s
W20260709 13:09:48.548027 30066 leader_election.cc:343] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.548853 30218 raft_consensus.cc:359] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.549539 30218 raft_consensus.cc:385] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:48.545641 30219 raft_consensus.cc:385] T b66f98d7fcfe4102a01ace9ed64355ed P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:48.556587 30219 raft_consensus.cc:740] T b66f98d7fcfe4102a01ace9ed64355ed P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.556491 30218 raft_consensus.cc:740] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.557300 30219 consensus_queue.cc:260] T b66f98d7fcfe4102a01ace9ed64355ed P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.557632 30218 consensus_queue.cc:260] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.553368 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:09:48.559319 30176 raft_consensus.cc:3060] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.559746 30218 ts_tablet_manager.cc:1434] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:09:48.560568 30218 tablet_bootstrap.cc:492] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:48.536489 30175 raft_consensus.cc:3060] T d3f3f9c9793f4390874e250718c41697 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.554067 30278 leader_election.cc:290] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:48.554406 30221 leader_election.cc:290] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:48.569090 30221 consensus_queue.cc:1048] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:48.570529 30176 raft_consensus.cc:2468] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 1.
I20260709 13:09:48.573048 30219 ts_tablet_manager.cc:1434] T b66f98d7fcfe4102a01ace9ed64355ed P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 13:09:48.574286 30219 tablet_bootstrap.cc:492] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:48.573956 30068 leader_election.cc:304] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:09:48.576143 30278 raft_consensus.cc:2804] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:48.576596 30278 raft_consensus.cc:697] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:09:48.576647 30175 raft_consensus.cc:2468] T d3f3f9c9793f4390874e250718c41697 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 1.
I20260709 13:09:48.577415 30278 consensus_queue.cc:237] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.578315 30218 tablet_bootstrap.cc:654] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:48.580936 30282 raft_consensus.cc:493] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.581432 30282 raft_consensus.cc:515] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.583582 30282 leader_election.cc:290] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:48.585543 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:48.617154 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:48.618619 30405 raft_consensus.cc:493] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.605497 29923 catalog_manager.cc:5697] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:48.629319 30143 leader_election.cc:343] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.621428 29993 leader_election.cc:304] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:09:48.640646 30303 raft_consensus.cc:2804] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:48.641098 30303 raft_consensus.cc:697] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:09:48.641512 30217 tablet_bootstrap.cc:492] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:48.641958 30217 ts_tablet_manager.cc:1403] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.114s	user 0.027s	sys 0.047s
I20260709 13:09:48.642196 30303 consensus_queue.cc:237] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.644896 30217 raft_consensus.cc:359] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.645629 30217 raft_consensus.cc:385] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:48.628587 30405 raft_consensus.cc:515] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.645978 30217 raft_consensus.cc:740] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.649619 30219 tablet_bootstrap.cc:654] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:48.652693 30028 raft_consensus.cc:2468] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 0.
I20260709 13:09:48.656004 30217 consensus_queue.cc:260] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.661286 30217 ts_tablet_manager.cc:1434] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260709 13:09:48.661615 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:48.662212 30217 tablet_bootstrap.cc:492] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:48.660391 30405 leader_election.cc:290] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:09:48.662876 29994 leader_election.cc:343] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.664562 30140 leader_election.cc:304] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:09:48.665593 30226 raft_consensus.cc:2804] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:48.665951 30226 raft_consensus.cc:493] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.672262 30226 raft_consensus.cc:3060] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.675206 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:48.677986 30218 tablet_bootstrap.cc:492] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:48.681529 30217 tablet_bootstrap.cc:654] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:48.685272 30405 raft_consensus.cc:493] T b66f98d7fcfe4102a01ace9ed64355ed P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.687404 30405 raft_consensus.cc:515] T b66f98d7fcfe4102a01ace9ed64355ed P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.688197 30218 ts_tablet_manager.cc:1403] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.128s	user 0.024s	sys 0.019s
I20260709 13:09:48.692625 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:48.693051 30405 leader_election.cc:290] T b66f98d7fcfe4102a01ace9ed64355ed P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:48.693311 30102 raft_consensus.cc:2468] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 0.
I20260709 13:09:48.693795 30219 tablet_bootstrap.cc:492] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:48.694283 30219 ts_tablet_manager.cc:1403] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.120s	user 0.012s	sys 0.000s
I20260709 13:09:48.695894 29994 leader_election.cc:304] T b66f98d7fcfe4102a01ace9ed64355ed P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:09:48.696661 30227 raft_consensus.cc:2804] T b66f98d7fcfe4102a01ace9ed64355ed P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:48.697057 30227 raft_consensus.cc:493] T b66f98d7fcfe4102a01ace9ed64355ed P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.697376 30227 raft_consensus.cc:3060] T b66f98d7fcfe4102a01ace9ed64355ed P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.700695 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:48.681592 29924 catalog_manager.cc:5697] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:48.702205 29993 leader_election.cc:343] T b66f98d7fcfe4102a01ace9ed64355ed P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.703922 30227 raft_consensus.cc:515] T b66f98d7fcfe4102a01ace9ed64355ed P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.705925 30227 leader_election.cc:290] T b66f98d7fcfe4102a01ace9ed64355ed P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:48.706835 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:09:48.707882 30103 raft_consensus.cc:3060] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.707798 30226 raft_consensus.cc:515] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.710906 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:09:48.711474 30028 raft_consensus.cc:3060] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.714118 30103 raft_consensus.cc:2468] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 1.
I20260709 13:09:48.714598 30175 raft_consensus.cc:2393] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 1: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:09:48.707108 30218 raft_consensus.cc:359] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.715327 30218 raft_consensus.cc:385] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:48.715801 30218 raft_consensus.cc:740] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.716567 30218 consensus_queue.cc:260] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.718823 30218 ts_tablet_manager.cc:1434] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.000s
I20260709 13:09:48.720184 30218 tablet_bootstrap.cc:492] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:48.706806 30219 raft_consensus.cc:359] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.720556 30219 raft_consensus.cc:385] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:48.720863 30219 raft_consensus.cc:740] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.721063 30217 tablet_bootstrap.cc:492] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:48.721558 30217 ts_tablet_manager.cc:1403] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.060s	user 0.034s	sys 0.010s
I20260709 13:09:48.721617 30219 consensus_queue.cc:260] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.724283 30219 ts_tablet_manager.cc:1434] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 13:09:48.724016 30217 raft_consensus.cc:359] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.724709 30217 raft_consensus.cc:385] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:48.724987 30217 raft_consensus.cc:740] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.725574 30217 consensus_queue.cc:260] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.726446 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:09:48.726857 30219 tablet_bootstrap.cc:492] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:48.728535 29993 leader_election.cc:304] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:09:48.731616 30217 ts_tablet_manager.cc:1434] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.002s
I20260709 13:09:48.732474 30217 tablet_bootstrap.cc:492] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:48.726315 29994 leader_election.cc:304] T b66f98d7fcfe4102a01ace9ed64355ed P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:09:48.735954 30308 raft_consensus.cc:2804] T b66f98d7fcfe4102a01ace9ed64355ed P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:48.736279 30218 tablet_bootstrap.cc:654] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:48.736407 30308 raft_consensus.cc:697] T b66f98d7fcfe4102a01ace9ed64355ed P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:09:48.736786 30219 tablet_bootstrap.cc:654] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:48.737645 30217 tablet_bootstrap.cc:654] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:48.737228 30308 consensus_queue.cc:237] T b66f98d7fcfe4102a01ace9ed64355ed P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.747563 30028 raft_consensus.cc:2468] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 1.
I20260709 13:09:48.748062 30227 raft_consensus.cc:2749] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:48.748354 30217 tablet_bootstrap.cc:492] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:48.748764 30217 ts_tablet_manager.cc:1403] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.007s
I20260709 13:09:48.749673 30219 tablet_bootstrap.cc:492] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:48.750121 30219 ts_tablet_manager.cc:1403] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.023s	user 0.007s	sys 0.006s
I20260709 13:09:48.751156 30217 raft_consensus.cc:359] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.751785 30217 raft_consensus.cc:385] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:48.752033 30217 raft_consensus.cc:740] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.752435 30219 raft_consensus.cc:359] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.752959 30217 consensus_queue.cc:260] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:09:48.753365 29993 leader_election.cc:343] T b66f98d7fcfe4102a01ace9ed64355ed P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.753821 30140 leader_election.cc:304] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:48.754727 30282 raft_consensus.cc:2804] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:48.755165 30282 raft_consensus.cc:697] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:09:48.755491 30218 tablet_bootstrap.cc:492] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:48.755892 30218 ts_tablet_manager.cc:1403] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.036s	user 0.004s	sys 0.007s
I20260709 13:09:48.755918 30282 consensus_queue.cc:237] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.758464 30217 ts_tablet_manager.cc:1434] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 13:09:48.758849 30218 raft_consensus.cc:359] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.759342 30217 tablet_bootstrap.cc:492] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:48.753019 30219 raft_consensus.cc:385] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:48.759785 30219 raft_consensus.cc:740] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.760466 30219 consensus_queue.cc:260] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.761024 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:09:48.765651 30217 tablet_bootstrap.cc:654] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:48.766083 30218 raft_consensus.cc:385] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:09:48.762281 30143 leader_election.cc:343] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.766618 30218 raft_consensus.cc:740] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.767267 30226 leader_election.cc:290] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:48.767453 30218 consensus_queue.cc:260] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.769409 30175 raft_consensus.cc:3060] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.777748 30337 raft_consensus.cc:493] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.778316 30337 raft_consensus.cc:515] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.779479 30219 ts_tablet_manager.cc:1434] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:09:48.780344 30337 leader_election.cc:290] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:48.780459 30219 tablet_bootstrap.cc:492] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:48.782640 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:48.782693 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:48.783538 30103 raft_consensus.cc:2468] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 0.
I20260709 13:09:48.778733 30218 ts_tablet_manager.cc:1434] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.003s
I20260709 13:09:48.784035 30446 raft_consensus.cc:493] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.784866 30218 tablet_bootstrap.cc:492] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:48.784612 30446 raft_consensus.cc:515] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:09:48.784035 30140 leader_election.cc:343] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.786804 30337 raft_consensus.cc:493] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.787272 30337 raft_consensus.cc:515] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.787719 30143 leader_election.cc:304] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:09:48.789721 30281 raft_consensus.cc:2804] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:48.790066 30281 raft_consensus.cc:493] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.790375 30281 raft_consensus.cc:3060] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.791451 30337 leader_election.cc:290] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:48.795174 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:48.798672 30218 tablet_bootstrap.cc:654] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:48.800170 30281 raft_consensus.cc:515] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.804358 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:48.803215 30446 leader_election.cc:290] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:48.804373 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:48.806110 30281 leader_election.cc:290] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:48.806437 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
W20260709 13:09:48.806937 30066 leader_election.cc:343] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.809228 30219 tablet_bootstrap.cc:654] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:48.812623 30140 leader_election.cc:343] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:48.812615 30068 leader_election.cc:343] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.814043 30068 leader_election.cc:304] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:09:48.816232 30446 raft_consensus.cc:2749] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:48.816481 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:09:48.817163 30102 raft_consensus.cc:3060] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.823091 29925 catalog_manager.cc:5697] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 0 to 1, leader changed from <none> to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 1 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:48.821570 29923 catalog_manager.cc:5697] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:48.851095 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:48.851856 30103 raft_consensus.cc:2468] T d7be23af8c824b3bb048a59d6bdf884c P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 1.
I20260709 13:09:48.853178 30143 leader_election.cc:304] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:09:48.854382 30281 raft_consensus.cc:2804] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:48.854730 30281 raft_consensus.cc:493] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.855029 30281 raft_consensus.cc:3060] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.858163 30102 raft_consensus.cc:2468] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 1.
I20260709 13:09:48.859241 30143 leader_election.cc:304] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:09:48.861034 30282 raft_consensus.cc:2804] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:48.861570 30282 raft_consensus.cc:697] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:09:48.862502 30282 consensus_queue.cc:237] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.865727 30281 raft_consensus.cc:515] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.881534 30308 consensus_queue.cc:1048] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:48.888406 30303 consensus_queue.cc:1048] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:48.892596 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:09:48.895254 30281 leader_election.cc:290] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 2 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:48.896235 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:09:48.896950 30102 raft_consensus.cc:3060] T d7be23af8c824b3bb048a59d6bdf884c P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.903548 30175 raft_consensus.cc:1240] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:09:48.908066 30278 raft_consensus.cc:493] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.908226 30102 raft_consensus.cc:2468] T d7be23af8c824b3bb048a59d6bdf884c P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 2.
I20260709 13:09:48.908669 30278 raft_consensus.cc:515] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.909415 30143 leader_election.cc:304] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:09:48.910681 30278 leader_election.cc:290] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:48.910821 30103 raft_consensus.cc:1240] T d7be23af8c824b3bb048a59d6bdf884c P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 13:09:48.912179 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:48.912609 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:48.913501 30175 raft_consensus.cc:2393] T d968b6d22e3243bfb840139be8b6dddd P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 1: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:09:48.914932 30068 leader_election.cc:304] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:09:48.916253 30278 raft_consensus.cc:3060] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:48.922737 29974 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:48.923166 30278 raft_consensus.cc:2749] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:48.925158 30281 raft_consensus.cc:2804] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:48.925596 30303 consensus_queue.cc:1059] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:48.935411 30281 raft_consensus.cc:697] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 2 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:09:48.920799 29924 catalog_manager.cc:5697] T b66f98d7fcfe4102a01ace9ed64355ed P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:48.934504 30218 tablet_bootstrap.cc:492] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:48.935614 30227 consensus_queue.cc:1059] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:48.937669 30218 ts_tablet_manager.cc:1403] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.153s	user 0.013s	sys 0.042s
I20260709 13:09:48.937801 30281 consensus_queue.cc:237] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.939702 30309 raft_consensus.cc:3055] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:09:48.940099 30309 raft_consensus.cc:740] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:09:48.940824 30309 consensus_queue.cc:260] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.941952 30218 raft_consensus.cc:359] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.942571 30218 raft_consensus.cc:385] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:48.942830 30218 raft_consensus.cc:740] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.943427 30218 consensus_queue.cc:260] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.945374 30218 ts_tablet_manager.cc:1434] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.000s
I20260709 13:09:48.945803 30446 raft_consensus.cc:493] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:48.947789 30309 raft_consensus.cc:3060] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:48.946352 29923 catalog_manager.cc:5697] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 0 to 1, leader changed from <none> to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 1 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:48.946224 30446 raft_consensus.cc:515] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.953895 30446 leader_election.cc:290] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:48.955180 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:48.957053 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:09:48.957207 30068 leader_election.cc:343] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:48.957677 30025 raft_consensus.cc:2468] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 0.
I20260709 13:09:48.928769 30219 tablet_bootstrap.cc:492] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:48.937029 30217 tablet_bootstrap.cc:492] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:48.962419 30217 ts_tablet_manager.cc:1403] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.203s	user 0.062s	sys 0.059s
I20260709 13:09:48.964670 30066 leader_election.cc:304] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:09:48.965305 30219 ts_tablet_manager.cc:1403] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.185s	user 0.024s	sys 0.044s
I20260709 13:09:48.965339 30217 raft_consensus.cc:359] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.966089 30217 raft_consensus.cc:385] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:48.966351 30217 raft_consensus.cc:740] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.966624 30446 raft_consensus.cc:2804] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:48.967012 30446 raft_consensus.cc:493] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:48.966949 30217 consensus_queue.cc:260] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.967443 30446 raft_consensus.cc:3060] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.967913 30219 raft_consensus.cc:359] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.968525 30219 raft_consensus.cc:385] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:48.968786 30219 raft_consensus.cc:740] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:48.969173 30217 ts_tablet_manager.cc:1434] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:09:48.970790 30218 tablet_bootstrap.cc:492] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:48.971903 30217 tablet_bootstrap.cc:492] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:48.974934 30219 consensus_queue.cc:260] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.977181 30219 ts_tablet_manager.cc:1434] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:09:48.978044 30219 tablet_bootstrap.cc:492] T fe9a5ae7a3c04826a4bdde9445be46bb P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:48.982662 30218 tablet_bootstrap.cc:654] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:48.988567 30217 tablet_bootstrap.cc:654] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:48.987957 29926 catalog_manager.cc:5697] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 1 to 2, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 2 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:48.988623 30446 raft_consensus.cc:515] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:48.991314 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:09:48.991845 30025 raft_consensus.cc:3060] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:48.993683 30219 tablet_bootstrap.cc:654] T fe9a5ae7a3c04826a4bdde9445be46bb P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:49.000360 30218 tablet_bootstrap.cc:492] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:49.002652 30218 ts_tablet_manager.cc:1403] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.030s	user 0.006s	sys 0.004s
I20260709 13:09:49.003798 30281 raft_consensus.cc:493] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.003700 30308 consensus_queue.cc:1048] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:49.004281 30281 raft_consensus.cc:515] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:49.006799 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:49.007400 30028 raft_consensus.cc:2468] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 0.
I20260709 13:09:49.008665 30140 leader_election.cc:304] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:49.009451 30282 raft_consensus.cc:2804] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:49.009819 30282 raft_consensus.cc:493] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:49.009888 30281 leader_election.cc:290] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:49.010206 30282 raft_consensus.cc:3060] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:49.011745 30025 raft_consensus.cc:2468] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 1.
I20260709 13:09:49.014446 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:09:49.013460 30446 leader_election.cc:290] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:49.012719 30219 tablet_bootstrap.cc:492] T fe9a5ae7a3c04826a4bdde9445be46bb P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:49.015127 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:49.015376 30219 ts_tablet_manager.cc:1403] T fe9a5ae7a3c04826a4bdde9445be46bb P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.038s	user 0.008s	sys 0.013s
I20260709 13:09:49.015694 30102 raft_consensus.cc:2468] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 0.
I20260709 13:09:49.015781 30066 leader_election.cc:304] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:09:49.016811 30446 raft_consensus.cc:2804] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:09:49.023178 30068 leader_election.cc:343] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:49.023393 30446 raft_consensus.cc:697] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:09:49.024422 30446 consensus_queue.cc:237] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:49.024603 30219 raft_consensus.cc:359] T fe9a5ae7a3c04826a4bdde9445be46bb P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:49.026760 30219 raft_consensus.cc:385] T fe9a5ae7a3c04826a4bdde9445be46bb P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:49.027040 30219 raft_consensus.cc:740] T fe9a5ae7a3c04826a4bdde9445be46bb P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.027652 30219 consensus_queue.cc:260] T fe9a5ae7a3c04826a4bdde9445be46bb P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:49.029816 30219 ts_tablet_manager.cc:1434] T fe9a5ae7a3c04826a4bdde9445be46bb P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 13:09:49.030107 30282 raft_consensus.cc:515] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:49.031204 30219 tablet_bootstrap.cc:492] T 2964592ff08b4434889d830c05501d8e P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:49.035041 30278 consensus_queue.cc:1048] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:49.037103 30219 tablet_bootstrap.cc:654] T 2964592ff08b4434889d830c05501d8e P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:49.044643 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:09:49.045321 30025 raft_consensus.cc:3060] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:49.047820 30281 raft_consensus.cc:493] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.048272 30281 raft_consensus.cc:515] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:49.050693 30281 leader_election.cc:290] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:49.053917 30025 raft_consensus.cc:2468] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 1.
I20260709 13:09:49.055382 30219 tablet_bootstrap.cc:492] T 2964592ff08b4434889d830c05501d8e P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:49.055819 30219 ts_tablet_manager.cc:1403] T 2964592ff08b4434889d830c05501d8e P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.025s	user 0.006s	sys 0.014s
I20260709 13:09:49.058259 30219 raft_consensus.cc:359] T 2964592ff08b4434889d830c05501d8e P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:49.058894 30219 raft_consensus.cc:385] T 2964592ff08b4434889d830c05501d8e P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:49.059141 30219 raft_consensus.cc:740] T 2964592ff08b4434889d830c05501d8e P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.059731 30219 consensus_queue.cc:260] T 2964592ff08b4434889d830c05501d8e P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:49.063372 30219 ts_tablet_manager.cc:1434] T 2964592ff08b4434889d830c05501d8e P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:09:49.064004 30217 tablet_bootstrap.cc:492] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:49.064343 30217 ts_tablet_manager.cc:1403] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.093s	user 0.010s	sys 0.000s
I20260709 13:09:49.067734 30282 leader_election.cc:290] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:49.069113 30217 raft_consensus.cc:359] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:49.069597 30217 raft_consensus.cc:385] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:49.069245 30218 raft_consensus.cc:359] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:49.069886 30217 raft_consensus.cc:740] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.070077 30218 raft_consensus.cc:385] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:49.070462 30217 consensus_queue.cc:260] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:49.072252 30217 ts_tablet_manager.cc:1434] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 13:09:49.072916 30217 tablet_bootstrap.cc:492] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:49.070492 30218 raft_consensus.cc:740] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.112586 30282 raft_consensus.cc:493] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.112697 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
W20260709 13:09:49.115980 30143 leader_election.cc:343] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:49.117481 30218 consensus_queue.cc:260] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:49.114249 30282 raft_consensus.cc:515] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:49.124799 30226 raft_consensus.cc:493] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.135474 30226 raft_consensus.cc:515] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:49.135936 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:09:49.136848 30103 raft_consensus.cc:3060] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:49.137979 30309 raft_consensus.cc:493] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.139048 30219 tablet_bootstrap.cc:492] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:49.138749 30309 raft_consensus.cc:515] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:49.145716 30028 raft_consensus.cc:3060] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:49.149266 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
W20260709 13:09:49.152150 30143 leader_election.cc:343] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:49.152594 30282 leader_election.cc:290] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:49.109807 30140 leader_election.cc:304] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
W20260709 13:09:49.153563 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 44294.9us
I20260709 13:09:49.154464 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:49.155663 30308 consensus_queue.cc:1048] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:49.156876 30309 leader_election.cc:290] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:49.155983 30102 raft_consensus.cc:3060] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:49.158313 30143 leader_election.cc:343] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:49.161819 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:49.164274 30226 leader_election.cc:290] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:49.172273 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:49.173044 30024 raft_consensus.cc:2468] T 2964592ff08b4434889d830c05501d8e P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 0.
I20260709 13:09:49.173439 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:49.174352 30027 raft_consensus.cc:2468] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 0.
I20260709 13:09:49.172250 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:49.142586 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:49.185269 30103 raft_consensus.cc:2468] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 1.
I20260709 13:09:49.190362 30218 ts_tablet_manager.cc:1434] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.187s	user 0.003s	sys 0.007s
I20260709 13:09:49.200441 29993 leader_election.cc:304] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:09:49.197386 30140 leader_election.cc:304] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:09:49.202446 30140 leader_election.cc:304] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:09:49.203455 30337 raft_consensus.cc:2804] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:49.203476 30281 raft_consensus.cc:2804] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:49.204169 30281 raft_consensus.cc:493] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:49.204492 30281 raft_consensus.cc:3060] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:49.191278 30282 raft_consensus.cc:2804] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:49.203828 30337 raft_consensus.cc:493] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:49.214385 30309 raft_consensus.cc:2749] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:49.215423 30337 raft_consensus.cc:3060] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:49.225961 29993 consensus_peers.cc:597] T b66f98d7fcfe4102a01ace9ed64355ed P b2cea0098c1040f69755ea4d3dab7fc4 -> Peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Couldn't send request to peer c99569d27a6f4c648eae7119fe3db124. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:09:49.283406 30140 leader_election.cc:343] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:49.283942 30140 leader_election.cc:304] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:09:49.286187 30219 tablet_bootstrap.cc:654] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:49.285549 30218 tablet_bootstrap.cc:492] T 64effd13e9a741368e16bc2f52fb573c P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:49.272642 30282 raft_consensus.cc:697] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:09:49.295691 30478 raft_consensus.cc:2749] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:49.298306 30282 consensus_queue.cc:237] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:49.299659 30346 consensus_queue.cc:1048] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:09:49.310794 30221 raft_consensus.cc:493] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.312005 30221 raft_consensus.cc:515] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:49.315084 30221 leader_election.cc:290] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:49.316256 30308 consensus_queue.cc:1048] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:49.315037 30143 consensus_peers.cc:597] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:49.333154 30309 consensus_queue.cc:1048] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:49.336685 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:49.337224 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:49.342651 30066 leader_election.cc:304] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:09:49.453218 30281 raft_consensus.cc:515] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:49.494108 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:09:49.503544 30281 leader_election.cc:290] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:49.504988 30221 raft_consensus.cc:2749] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:09:49.499385 30337 raft_consensus.cc:515] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:49.516517 30337 leader_election.cc:290] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:49.519778 29926 catalog_manager.cc:5697] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:49.513649 30308 consensus_queue.cc:1048] T b66f98d7fcfe4102a01ace9ed64355ed P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260709 13:09:49.529420 30217 tablet_bootstrap.cc:654] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:49.532924 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 166677us
I20260709 13:09:49.533411 30219 tablet_bootstrap.cc:492] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:49.533905 30219 ts_tablet_manager.cc:1403] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.395s	user 0.013s	sys 0.035s
I20260709 13:09:49.537014 30219 raft_consensus.cc:359] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:49.537600 30227 raft_consensus.cc:493] T fe9a5ae7a3c04826a4bdde9445be46bb P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.538156 30227 raft_consensus.cc:515] T fe9a5ae7a3c04826a4bdde9445be46bb P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:49.540154 30227 leader_election.cc:290] T fe9a5ae7a3c04826a4bdde9445be46bb P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:49.541702 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:09:49.542281 30025 raft_consensus.cc:3060] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:49.542441 30028 raft_consensus.cc:1275] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 13:09:49.542827 30028 pending_rounds.cc:85] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4: Aborting all ops after (but not including) 0
I20260709 13:09:49.543370 30028 pending_rounds.cc:107] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:09:49.543681 30028 raft_consensus.cc:2889] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:09:49.544327 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:09:49.544898 30027 raft_consensus.cc:3060] T 2964592ff08b4434889d830c05501d8e P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:49.537701 30219 raft_consensus.cc:385] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:49.551960 30219 raft_consensus.cc:740] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
W20260709 13:09:49.554955 30143 leader_election.cc:343] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:49.558897 30219 consensus_queue.cc:260] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:49.564251 30217 tablet_bootstrap.cc:492] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:49.566205 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:09:49.566517 30217 ts_tablet_manager.cc:1403] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.494s	user 0.010s	sys 0.006s
I20260709 13:09:49.570837 30027 raft_consensus.cc:2468] T 2964592ff08b4434889d830c05501d8e P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 1.
W20260709 13:09:49.571671 30068 consensus_peers.cc:597] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 -> Peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Couldn't send request to peer c99569d27a6f4c648eae7119fe3db124. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:49.573432 30025 raft_consensus.cc:2468] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 1.
W20260709 13:09:49.575042 30143 leader_election.cc:343] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:49.576189 30478 consensus_queue.cc:1048] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:49.576565 30103 raft_consensus.cc:1275] T d7be23af8c824b3bb048a59d6bdf884c P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:09:49.576983 30219 ts_tablet_manager.cc:1434] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.001s
I20260709 13:09:49.578517 30219 tablet_bootstrap.cc:492] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:49.578246 30478 consensus_queue.cc:1048] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:49.579298 30217 raft_consensus.cc:359] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:49.579936 30217 raft_consensus.cc:385] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:49.580197 30217 raft_consensus.cc:740] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.580813 30217 consensus_queue.cc:260] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:49.582940 30218 tablet_bootstrap.cc:654] T 64effd13e9a741368e16bc2f52fb573c P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:49.588662 30217 ts_tablet_manager.cc:1434] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.001s
I20260709 13:09:49.591533 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:49.592010 30217 tablet_bootstrap.cc:492] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:49.592360 30102 raft_consensus.cc:2393] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 1: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:09:49.597008 30479 consensus_queue.cc:1048] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:49.597083 30480 consensus_queue.cc:1048] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:49.606154 30278 consensus_queue.cc:1048] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:49.597059 30140 leader_election.cc:304] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:09:49.609838 30478 raft_consensus.cc:2804] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:49.610169 30140 leader_election.cc:304] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:09:49.610970 30480 raft_consensus.cc:2804] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:49.611395 30480 raft_consensus.cc:697] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:09:49.611608 30219 tablet_bootstrap.cc:654] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:49.610288 30478 raft_consensus.cc:697] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:09:49.621220 30478 consensus_queue.cc:237] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:49.612172 30480 consensus_queue.cc:237] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:49.636932 30025 raft_consensus.cc:3060] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:49.672802 30217 tablet_bootstrap.cc:654] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:49.675588 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:49.676484 30174 raft_consensus.cc:2393] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 1: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:09:49.678236 30218 tablet_bootstrap.cc:492] T 64effd13e9a741368e16bc2f52fb573c P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:49.678752 30218 ts_tablet_manager.cc:1403] T 64effd13e9a741368e16bc2f52fb573c P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.395s	user 0.011s	sys 0.011s
I20260709 13:09:49.683687 30218 raft_consensus.cc:359] T 64effd13e9a741368e16bc2f52fb573c P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:49.688212 30218 raft_consensus.cc:385] T 64effd13e9a741368e16bc2f52fb573c P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:49.688397 30218 raft_consensus.cc:740] T 64effd13e9a741368e16bc2f52fb573c P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.694345 30219 tablet_bootstrap.cc:492] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:49.694816 30219 ts_tablet_manager.cc:1403] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.117s	user 0.020s	sys 0.014s
I20260709 13:09:49.706475 30219 raft_consensus.cc:359] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:49.707125 30219 raft_consensus.cc:385] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:49.707399 30219 raft_consensus.cc:740] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.708101 30219 consensus_queue.cc:260] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:49.713037 30226 consensus_queue.cc:1048] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:49.714710 30218 consensus_queue.cc:260] T 64effd13e9a741368e16bc2f52fb573c P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:49.716544 30218 ts_tablet_manager.cc:1434] T 64effd13e9a741368e16bc2f52fb573c P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.000s
I20260709 13:09:49.717403 30218 tablet_bootstrap.cc:492] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:49.719069 29993 leader_election.cc:304] T fe9a5ae7a3c04826a4bdde9445be46bb P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:09:49.720726 30404 raft_consensus.cc:3060] T fe9a5ae7a3c04826a4bdde9445be46bb P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:49.723380 30219 ts_tablet_manager.cc:1434] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.001s
I20260709 13:09:49.725927 30346 raft_consensus.cc:493] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:49.728091 30346 raft_consensus.cc:515] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:49.739696 30346 leader_election.cc:290] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:49.740382 30219 tablet_bootstrap.cc:492] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:49.742332 29925 catalog_manager.cc:5697] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 0 to 1, leader changed from <none> to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 1 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:49.747016 30404 raft_consensus.cc:2749] T fe9a5ae7a3c04826a4bdde9445be46bb P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:49.750594 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:49.750871 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:49.751221 30025 raft_consensus.cc:2468] T fe9a5ae7a3c04826a4bdde9445be46bb P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 1.
I20260709 13:09:49.751508 30175 raft_consensus.cc:2468] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 1.
I20260709 13:09:49.753173 30068 leader_election.cc:304] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:49.755084 30221 raft_consensus.cc:2804] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:09:49.755829 30221 raft_consensus.cc:493] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:49.756141 30221 raft_consensus.cc:3060] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.761346 30218 tablet_bootstrap.cc:654] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:49.769003 30217 tablet_bootstrap.cc:492] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:49.769470 30217 ts_tablet_manager.cc:1403] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.178s	user 0.013s	sys 0.015s
I20260709 13:09:49.774833 30217 raft_consensus.cc:359] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:49.775478 30217 raft_consensus.cc:385] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:49.775738 30217 raft_consensus.cc:740] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.812037 30221 raft_consensus.cc:515] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:49.823390 30219 tablet_bootstrap.cc:654] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:49.825799 30478 consensus_queue.cc:1048] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:49.826546 30217 consensus_queue.cc:260] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:49.829952 30217 ts_tablet_manager.cc:1434] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.060s	user 0.021s	sys 0.016s
I20260709 13:09:49.831288 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:09:49.831847 30023 raft_consensus.cc:3060] T fe9a5ae7a3c04826a4bdde9445be46bb P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.842540 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:09:49.843154 30175 raft_consensus.cc:3060] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:09:49.851866 30217 tablet_bootstrap.cc:492] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:49.854655 30175 raft_consensus.cc:2468] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
I20260709 13:09:49.855994 30068 leader_election.cc:304] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:49.856722 30346 raft_consensus.cc:2804] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:09:49.857177 30346 raft_consensus.cc:697] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 2 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:09:49.857990 30346 consensus_queue.cc:237] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:49.864614 30217 tablet_bootstrap.cc:654] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:49.866766 29925 catalog_manager.cc:5697] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 0 to 1, leader changed from <none> to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 1 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:49.868271 30487 consensus_queue.cc:1048] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:49.868997 29925 catalog_manager.cc:5697] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 0 to 1, leader changed from <none> to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 1 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:49.879832 30217 tablet_bootstrap.cc:492] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:49.880348 30217 ts_tablet_manager.cc:1403] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.050s	user 0.012s	sys 0.000s
I20260709 13:09:49.882537 30023 raft_consensus.cc:2468] T fe9a5ae7a3c04826a4bdde9445be46bb P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
I20260709 13:09:49.884071 30221 leader_election.cc:290] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:49.883096 30217 raft_consensus.cc:359] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:49.888437 30217 raft_consensus.cc:385] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:49.889725 30217 raft_consensus.cc:740] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.891247 30217 consensus_queue.cc:260] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:49.894219 30217 ts_tablet_manager.cc:1434] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.002s
I20260709 13:09:49.895402 30217 tablet_bootstrap.cc:492] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:49.903198 29925 catalog_manager.cc:5697] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 0 to 2, leader changed from <none> to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 2 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:49.910312 30218 tablet_bootstrap.cc:492] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:49.910740 30218 ts_tablet_manager.cc:1403] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.194s	user 0.021s	sys 0.014s
I20260709 13:09:49.911854 30217 tablet_bootstrap.cc:654] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:49.915221 30219 tablet_bootstrap.cc:492] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:49.915612 30219 ts_tablet_manager.cc:1403] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.179s	user 0.032s	sys 0.048s
I20260709 13:09:49.918540 30218 raft_consensus.cc:359] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:49.919221 30218 raft_consensus.cc:385] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:49.919472 30218 raft_consensus.cc:740] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.920100 30218 consensus_queue.cc:260] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:49.921023 30219 raft_consensus.cc:359] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:49.921672 30219 raft_consensus.cc:385] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:49.921954 30219 raft_consensus.cc:740] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.922116 30218 ts_tablet_manager.cc:1434] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 13:09:49.922668 30219 consensus_queue.cc:260] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:49.923061 30218 tablet_bootstrap.cc:492] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:49.925745 30219 ts_tablet_manager.cc:1434] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:09:49.927352 30219 tablet_bootstrap.cc:492] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:49.929391 30218 tablet_bootstrap.cc:654] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:49.931280 30217 tablet_bootstrap.cc:492] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:49.931702 30217 ts_tablet_manager.cc:1403] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.037s	user 0.005s	sys 0.007s
I20260709 13:09:49.932799 30219 tablet_bootstrap.cc:654] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:49.934263 30217 raft_consensus.cc:359] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:49.934890 30217 raft_consensus.cc:385] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:49.935149 30217 raft_consensus.cc:740] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.935803 30217 consensus_queue.cc:260] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:49.941571 30217 ts_tablet_manager.cc:1434] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.002s
I20260709 13:09:49.942569 30217 tablet_bootstrap.cc:492] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:49.949780 30219 tablet_bootstrap.cc:492] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:49.950215 30219 ts_tablet_manager.cc:1403] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.008s
I20260709 13:09:49.952836 30219 raft_consensus.cc:359] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:49.953461 30219 raft_consensus.cc:385] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:49.953737 30219 raft_consensus.cc:740] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.954445 30219 consensus_queue.cc:260] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:49.955883 30217 tablet_bootstrap.cc:654] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:49.960368 30219 ts_tablet_manager.cc:1434] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.004s
I20260709 13:09:49.961508 30219 tablet_bootstrap.cc:492] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:49.965059 30217 tablet_bootstrap.cc:492] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:49.965538 30217 ts_tablet_manager.cc:1403] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.023s	user 0.006s	sys 0.006s
I20260709 13:09:49.967159 30219 tablet_bootstrap.cc:654] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:49.976408 30217 raft_consensus.cc:359] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:49.978863 30217 raft_consensus.cc:385] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:49.979209 30217 raft_consensus.cc:740] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.978559 30218 tablet_bootstrap.cc:492] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:49.980758 30218 ts_tablet_manager.cc:1403] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.058s	user 0.010s	sys 0.012s
I20260709 13:09:49.979904 30217 consensus_queue.cc:260] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:49.985117 30217 ts_tablet_manager.cc:1434] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:09:49.985677 30218 raft_consensus.cc:359] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:49.986472 30218 raft_consensus.cc:385] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:09:49.986785 29974 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:49.987639 30218 raft_consensus.cc:740] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:49.988294 30218 consensus_queue.cc:260] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:49.990273 30218 ts_tablet_manager.cc:1434] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:09:49.987381 30217 tablet_bootstrap.cc:492] T ea42d6bd0dbb4438a96c31b335069e3c P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:49.994601 30218 tablet_bootstrap.cc:492] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:49.996362 30217 tablet_bootstrap.cc:654] T ea42d6bd0dbb4438a96c31b335069e3c P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:50.004894 30219 tablet_bootstrap.cc:492] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:50.005357 30219 ts_tablet_manager.cc:1403] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.044s	user 0.027s	sys 0.015s
I20260709 13:09:50.007872 30219 raft_consensus.cc:359] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.008394 30218 tablet_bootstrap.cc:654] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:50.008490 30219 raft_consensus.cc:385] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:50.008816 30219 raft_consensus.cc:740] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.009565 30219 consensus_queue.cc:260] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.013201 30478 raft_consensus.cc:493] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.013649 30478 raft_consensus.cc:515] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.013574 30487 raft_consensus.cc:493] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.015662 30478 leader_election.cc:290] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:50.015483 30487 raft_consensus.cc:515] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.017479 30487 leader_election.cc:290] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:50.018182 30219 ts_tablet_manager.cc:1434] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.003s
I20260709 13:09:50.019230 30219 tablet_bootstrap.cc:492] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:50.024940 30219 tablet_bootstrap.cc:654] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:50.025547 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:50.026242 30027 raft_consensus.cc:2468] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 0.
I20260709 13:09:50.026907 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:50.027480 30140 leader_election.cc:304] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:50.028386 30217 tablet_bootstrap.cc:492] T ea42d6bd0dbb4438a96c31b335069e3c P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:50.028543 30487 raft_consensus.cc:2804] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:50.028805 30217 ts_tablet_manager.cc:1403] T ea42d6bd0dbb4438a96c31b335069e3c P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.015s
I20260709 13:09:50.028923 30487 raft_consensus.cc:493] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.029044 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:50.028980 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:50.029397 30487 raft_consensus.cc:3060] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.030931 30143 leader_election.cc:304] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:09:50.031680 30478 raft_consensus.cc:2749] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:50.033003 30143 leader_election.cc:343] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:50.036007 30217 raft_consensus.cc:359] T ea42d6bd0dbb4438a96c31b335069e3c P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.036185 30487 raft_consensus.cc:515] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.036672 30217 raft_consensus.cc:385] T ea42d6bd0dbb4438a96c31b335069e3c P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:50.036970 30217 raft_consensus.cc:740] T ea42d6bd0dbb4438a96c31b335069e3c P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.037884 30217 consensus_queue.cc:260] T ea42d6bd0dbb4438a96c31b335069e3c P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.038980 30218 tablet_bootstrap.cc:492] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:50.039948 30217 ts_tablet_manager.cc:1434] T ea42d6bd0dbb4438a96c31b335069e3c P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:09:50.040550 30218 ts_tablet_manager.cc:1403] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.046s	user 0.012s	sys 0.000s
I20260709 13:09:50.041098 30217 tablet_bootstrap.cc:492] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:50.043772 30218 raft_consensus.cc:359] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.044615 30218 raft_consensus.cc:385] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:50.044900 30218 raft_consensus.cc:740] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.045616 30218 consensus_queue.cc:260] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.046890 30217 tablet_bootstrap.cc:654] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:50.048002 30218 ts_tablet_manager.cc:1434] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:09:50.050839 30175 raft_consensus.cc:3060] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.050809 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:09:50.051491 30023 raft_consensus.cc:3060] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.059223 30217 tablet_bootstrap.cc:492] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:50.059666 30217 ts_tablet_manager.cc:1403] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.003s
I20260709 13:09:50.062336 30217 raft_consensus.cc:359] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.062947 30217 raft_consensus.cc:385] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:50.063205 30217 raft_consensus.cc:740] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.063967 30217 consensus_queue.cc:260] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.064790 30023 raft_consensus.cc:2468] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 1.
I20260709 13:09:50.066015 30140 leader_election.cc:304] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:50.067344 30309 raft_consensus.cc:493] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.066061 30217 ts_tablet_manager.cc:1434] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:09:50.067348 30478 raft_consensus.cc:2804] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:50.069212 30478 raft_consensus.cc:697] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:09:50.069561 30217 tablet_bootstrap.cc:492] T f5c869d5410b4a83adc1ca35397defb6 P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:50.070029 30478 consensus_queue.cc:237] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.072451 30487 leader_election.cc:290] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:50.073314 30098 raft_consensus.cc:3060] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.073714 30218 tablet_bootstrap.cc:492] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:50.073668 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:09:50.074456 30101 raft_consensus.cc:3060] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.068234 30309 raft_consensus.cc:515] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.082484 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:50.083099 30176 raft_consensus.cc:2468] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 0.
I20260709 13:09:50.084295 29993 leader_election.cc:304] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:50.085011 30404 raft_consensus.cc:2804] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:50.085347 30404 raft_consensus.cc:493] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.085659 30404 raft_consensus.cc:3060] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.086338 30101 raft_consensus.cc:2468] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 1.
I20260709 13:09:50.088804 30487 raft_consensus.cc:493] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.091180 30487 raft_consensus.cc:515] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.093586 30487 leader_election.cc:290] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:50.094558 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:50.089061 30103 raft_consensus.cc:3060] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:50.101276 30143 leader_election.cc:343] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:50.103056 30101 raft_consensus.cc:3060] T 64effd13e9a741368e16bc2f52fb573c P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.086791 30309 leader_election.cc:290] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:50.088928 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:50.094997 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:09:50.105088 29994 leader_election.cc:343] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:50.106344 30140 leader_election.cc:343] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:50.106806 30140 leader_election.cc:304] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:09:50.107815 30337 raft_consensus.cc:2749] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:50.107717 30481 consensus_queue.cc:1048] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:50.108273 30404 raft_consensus.cc:515] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.112883 30217 tablet_bootstrap.cc:654] T f5c869d5410b4a83adc1ca35397defb6 P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:50.105129 30487 consensus_queue.cc:1048] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:09:50.120939 30218 tablet_bootstrap.cc:654] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:50.122856 30404 leader_election.cc:290] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:50.123536 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:09:50.123937 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
W20260709 13:09:50.124819 29994 leader_election.cc:343] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:50.125404 30176 raft_consensus.cc:3060] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.142004 30487 consensus_queue.cc:1048] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:50.162753 30219 tablet_bootstrap.cc:492] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:50.162858 30478 raft_consensus.cc:493] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.163642 30219 ts_tablet_manager.cc:1403] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.145s	user 0.019s	sys 0.008s
I20260709 13:09:50.163379 30478 raft_consensus.cc:515] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.162352 30176 raft_consensus.cc:2468] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 1.
I20260709 13:09:50.165398 30478 leader_election.cc:290] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:50.166390 30219 raft_consensus.cc:359] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.166296 30404 raft_consensus.cc:493] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.167097 30219 raft_consensus.cc:385] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:50.167425 30176 raft_consensus.cc:3060] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.167248 30404 raft_consensus.cc:515] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.167460 30219 raft_consensus.cc:740] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.169462 30481 consensus_queue.cc:1048] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:50.168265 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:50.169739 30219 consensus_queue.cc:260] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.171221 30404 leader_election.cc:290] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:50.168286 29993 leader_election.cc:304] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:09:50.171785 30219 ts_tablet_manager.cc:1434] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:09:50.172138 30404 raft_consensus.cc:2804] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:50.172647 30404 raft_consensus.cc:697] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:09:50.173588 30219 tablet_bootstrap.cc:492] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:50.176447 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:09:50.176900 30140 leader_election.cc:343] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:50.178562 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
W20260709 13:09:50.179651 29994 leader_election.cc:343] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:50.167171 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:50.173461 30404 consensus_queue.cc:237] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:09:50.181074 30143 leader_election.cc:343] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:50.181535 30143 leader_election.cc:304] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:09:50.183243 30337 raft_consensus.cc:2749] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:50.186337 30219 tablet_bootstrap.cc:654] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:50.188288 30217 tablet_bootstrap.cc:492] T f5c869d5410b4a83adc1ca35397defb6 P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:50.188678 30217 ts_tablet_manager.cc:1403] T f5c869d5410b4a83adc1ca35397defb6 P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.119s	user 0.025s	sys 0.020s
W20260709 13:09:50.190356 29993 leader_election.cc:343] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:50.190805 29993 leader_election.cc:304] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:09:50.191242 30217 raft_consensus.cc:359] T f5c869d5410b4a83adc1ca35397defb6 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.191490 30309 raft_consensus.cc:2749] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:50.191890 30217 raft_consensus.cc:385] T f5c869d5410b4a83adc1ca35397defb6 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:50.192190 30217 raft_consensus.cc:740] T f5c869d5410b4a83adc1ca35397defb6 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.192966 30217 consensus_queue.cc:260] T f5c869d5410b4a83adc1ca35397defb6 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.197701 30217 ts_tablet_manager.cc:1434] T f5c869d5410b4a83adc1ca35397defb6 P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 13:09:50.198706 30217 tablet_bootstrap.cc:492] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:50.201391 30219 tablet_bootstrap.cc:492] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:50.201833 30219 ts_tablet_manager.cc:1403] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.028s	user 0.006s	sys 0.007s
I20260709 13:09:50.206867 30217 tablet_bootstrap.cc:654] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:50.207383 30219 raft_consensus.cc:359] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.207996 30219 raft_consensus.cc:385] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:50.208242 30219 raft_consensus.cc:740] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.210958 30219 consensus_queue.cc:260] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.214254 30219 ts_tablet_manager.cc:1434] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:09:50.216003 30219 tablet_bootstrap.cc:492] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:50.226922 29924 catalog_manager.cc:5697] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 0 to 1, leader changed from <none> to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 1 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:50.231053 30218 tablet_bootstrap.cc:492] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:50.231572 30218 ts_tablet_manager.cc:1403] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.158s	user 0.025s	sys 0.040s
I20260709 13:09:50.235488 29925 catalog_manager.cc:5697] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:50.236961 30218 raft_consensus.cc:359] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.237594 30218 raft_consensus.cc:385] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:50.237879 30218 raft_consensus.cc:740] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.238845 30219 tablet_bootstrap.cc:654] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:50.238523 30218 consensus_queue.cc:260] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.243777 30218 ts_tablet_manager.cc:1434] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:09:50.244740 30218 tablet_bootstrap.cc:492] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:50.245428 30219 tablet_bootstrap.cc:492] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:50.245872 30219 ts_tablet_manager.cc:1403] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.000s
I20260709 13:09:50.250444 30218 tablet_bootstrap.cc:654] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:50.250976 30219 raft_consensus.cc:359] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.251617 30219 raft_consensus.cc:385] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:50.251875 30219 raft_consensus.cc:740] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.255369 30219 consensus_queue.cc:260] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.257448 30219 ts_tablet_manager.cc:1434] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.000s
I20260709 13:09:50.263223 30219 tablet_bootstrap.cc:492] T 8a3e809a994e4cbf98d7ea56807b8dad P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:50.264462 30218 tablet_bootstrap.cc:492] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:50.267953 30217 tablet_bootstrap.cc:492] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:50.268384 30217 ts_tablet_manager.cc:1403] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.070s	user 0.011s	sys 0.010s
I20260709 13:09:50.268735 30219 tablet_bootstrap.cc:654] T 8a3e809a994e4cbf98d7ea56807b8dad P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:50.270812 30217 raft_consensus.cc:359] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.271442 30217 raft_consensus.cc:385] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:50.271683 30217 raft_consensus.cc:740] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.264883 30218 ts_tablet_manager.cc:1403] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.007s
I20260709 13:09:50.272678 30217 consensus_queue.cc:260] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.274736 30217 ts_tablet_manager.cc:1434] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:09:50.275650 30217 tablet_bootstrap.cc:492] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:50.276111 30218 raft_consensus.cc:359] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.276824 30218 raft_consensus.cc:385] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:50.277508 30218 raft_consensus.cc:740] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.279263 30218 consensus_queue.cc:260] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.281172 30218 ts_tablet_manager.cc:1434] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:09:50.281719 30217 tablet_bootstrap.cc:654] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:50.282145 30218 tablet_bootstrap.cc:492] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:50.286497 30219 tablet_bootstrap.cc:492] T 8a3e809a994e4cbf98d7ea56807b8dad P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:50.286950 30219 ts_tablet_manager.cc:1403] T 8a3e809a994e4cbf98d7ea56807b8dad P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.003s
I20260709 13:09:50.288302 30218 tablet_bootstrap.cc:654] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:50.288915 30027 raft_consensus.cc:1275] T fe9a5ae7a3c04826a4bdde9445be46bb P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:09:50.289441 30219 raft_consensus.cc:359] T 8a3e809a994e4cbf98d7ea56807b8dad P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.290124 30219 raft_consensus.cc:385] T 8a3e809a994e4cbf98d7ea56807b8dad P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:50.290413 30219 raft_consensus.cc:740] T 8a3e809a994e4cbf98d7ea56807b8dad P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.290231 30221 consensus_queue.cc:1048] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:50.291142 30219 consensus_queue.cc:260] T 8a3e809a994e4cbf98d7ea56807b8dad P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.293457 30219 ts_tablet_manager.cc:1434] T 8a3e809a994e4cbf98d7ea56807b8dad P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:09:50.294486 30219 tablet_bootstrap.cc:492] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:50.299314 30218 tablet_bootstrap.cc:492] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:50.299731 30218 ts_tablet_manager.cc:1403] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.018s	user 0.010s	sys 0.005s
I20260709 13:09:50.300197 30219 tablet_bootstrap.cc:654] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:50.302223 30218 raft_consensus.cc:359] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.302863 30218 raft_consensus.cc:385] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:50.303128 30218 raft_consensus.cc:740] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.303822 30218 consensus_queue.cc:260] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.306033 30218 ts_tablet_manager.cc:1434] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:09:50.306942 30218 tablet_bootstrap.cc:492] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:50.307540 30219 tablet_bootstrap.cc:492] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:50.307950 30219 ts_tablet_manager.cc:1403] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 13:09:50.310509 30219 raft_consensus.cc:359] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.311120 30219 raft_consensus.cc:385] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:50.311375 30219 raft_consensus.cc:740] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.312306 30218 tablet_bootstrap.cc:654] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:50.312106 30219 consensus_queue.cc:260] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.314112 30219 ts_tablet_manager.cc:1434] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:09:50.315056 30219 tablet_bootstrap.cc:492] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:50.321242 30219 tablet_bootstrap.cc:654] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:50.327030 30218 tablet_bootstrap.cc:492] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:50.327461 30218 ts_tablet_manager.cc:1403] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.008s
I20260709 13:09:50.329347 30218 raft_consensus.cc:359] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.329979 30218 raft_consensus.cc:385] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:50.330192 30218 raft_consensus.cc:740] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.330772 30218 consensus_queue.cc:260] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.333225 30218 ts_tablet_manager.cc:1434] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:09:50.335474 30219 tablet_bootstrap.cc:492] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:50.335902 30219 ts_tablet_manager.cc:1403] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.002s
I20260709 13:09:50.337917 30303 raft_consensus.cc:493] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.338366 30219 raft_consensus.cc:359] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.338318 30303 raft_consensus.cc:515] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.339032 30219 raft_consensus.cc:385] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:50.339311 30219 raft_consensus.cc:740] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.340346 30219 consensus_queue.cc:260] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.342000 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:50.342259 30219 ts_tablet_manager.cc:1434] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:09:50.342555 30176 raft_consensus.cc:2468] T ea42d6bd0dbb4438a96c31b335069e3c P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 0.
I20260709 13:09:50.343194 30219 tablet_bootstrap.cc:492] T 30a540a1b03746b785f2fc4692e05833 P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:50.343647 29993 leader_election.cc:304] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:50.344293 30303 leader_election.cc:290] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:50.344769 30303 raft_consensus.cc:2804] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:50.344908 30346 raft_consensus.cc:493] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.345103 30303 raft_consensus.cc:493] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.345520 30303 raft_consensus.cc:3060] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.346324 30176 raft_consensus.cc:1275] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:09:50.346455 30218 tablet_bootstrap.cc:492] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:50.345350 30346 raft_consensus.cc:515] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.347604 30278 consensus_queue.cc:1048] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:50.349234 30346 leader_election.cc:290] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:50.352188 30218 tablet_bootstrap.cc:654] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:50.352250 30303 raft_consensus.cc:515] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.353639 30278 raft_consensus.cc:493] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.354108 30278 raft_consensus.cc:515] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.355294 30404 raft_consensus.cc:493] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.355926 30278 leader_election.cc:290] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:50.355774 30404 raft_consensus.cc:515] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.356060 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:09:50.356560 30175 raft_consensus.cc:3060] T ea42d6bd0dbb4438a96c31b335069e3c P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.357633 30404 leader_election.cc:290] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:50.358292 30219 tablet_bootstrap.cc:654] T 30a540a1b03746b785f2fc4692e05833 P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:50.359225 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:09:50.360623 29993 leader_election.cc:343] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:50.362623 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:50.363185 30173 raft_consensus.cc:2468] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 0.
I20260709 13:09:50.363065 30303 leader_election.cc:290] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:50.365095 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:50.365835 30173 raft_consensus.cc:2468] T f5c869d5410b4a83adc1ca35397defb6 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 0.
I20260709 13:09:50.366931 30068 leader_election.cc:304] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:50.367699 30068 leader_election.cc:304] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:50.368975 30221 raft_consensus.cc:2804] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:50.369279 30221 raft_consensus.cc:493] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.369552 30221 raft_consensus.cc:3060] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.369935 30346 raft_consensus.cc:2804] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:50.370280 30346 raft_consensus.cc:493] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.370579 30346 raft_consensus.cc:3060] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.377897 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:50.378043 30175 raft_consensus.cc:2468] T ea42d6bd0dbb4438a96c31b335069e3c P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 1.
I20260709 13:09:50.378470 30096 raft_consensus.cc:2468] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 0.
I20260709 13:09:50.379258 29993 leader_election.cc:304] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:50.379987 30303 raft_consensus.cc:2804] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:50.380409 30303 raft_consensus.cc:697] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:09:50.381173 30303 consensus_queue.cc:237] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.387248 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:50.388710 30404 raft_consensus.cc:493] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.383810 30346 raft_consensus.cc:515] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.389183 30404 raft_consensus.cc:515] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:09:50.390360 29994 leader_election.cc:343] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:50.390760 29994 leader_election.cc:304] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:09:50.391234 30404 leader_election.cc:290] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:50.391371 30309 raft_consensus.cc:2749] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:50.392453 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:09:50.393656 29993 leader_election.cc:343] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:50.394335 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:09:50.394904 30096 raft_consensus.cc:3060] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.396551 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:09:50.397149 30175 raft_consensus.cc:3060] T f5c869d5410b4a83adc1ca35397defb6 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.402168 30346 leader_election.cc:290] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:50.377254 30221 raft_consensus.cc:515] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.411535 30175 raft_consensus.cc:2468] T f5c869d5410b4a83adc1ca35397defb6 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 1.
I20260709 13:09:50.413432 30068 leader_election.cc:304] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:50.414418 30221 leader_election.cc:290] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:50.414937 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:09:50.415504 30176 raft_consensus.cc:3060] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.414223 30346 raft_consensus.cc:2804] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:50.418089 30346 raft_consensus.cc:697] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:09:50.419127 30346 consensus_queue.cc:237] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.420429 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:50.421021 30027 raft_consensus.cc:2468] T 8a3e809a994e4cbf98d7ea56807b8dad P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 0.
I20260709 13:09:50.423903 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:50.424505 30023 raft_consensus.cc:2468] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 0.
I20260709 13:09:50.425715 30176 raft_consensus.cc:2468] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 1.
I20260709 13:09:50.426769 30068 leader_election.cc:304] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:50.427639 30278 raft_consensus.cc:2804] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:50.428068 30278 raft_consensus.cc:697] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:09:50.428864 30278 consensus_queue.cc:237] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.449095 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:09:50.449726 30023 raft_consensus.cc:3060] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.455421 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:09:50.456054 30027 raft_consensus.cc:3060] T 8a3e809a994e4cbf98d7ea56807b8dad P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.472657 30218 tablet_bootstrap.cc:492] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:50.473137 30218 ts_tablet_manager.cc:1403] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.127s	user 0.026s	sys 0.034s
I20260709 13:09:50.475867 30218 raft_consensus.cc:359] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.476573 30218 raft_consensus.cc:385] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:50.476836 30218 raft_consensus.cc:740] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.477476 30218 consensus_queue.cc:260] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.479387 30218 ts_tablet_manager.cc:1434] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260709 13:09:50.480217 30218 tablet_bootstrap.cc:492] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:50.428140 30096 raft_consensus.cc:2468] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 1.
I20260709 13:09:50.482862 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:50.501263 29926 catalog_manager.cc:5697] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:50.511742 30219 tablet_bootstrap.cc:492] T 30a540a1b03746b785f2fc4692e05833 P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:50.511794 30217 tablet_bootstrap.cc:492] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:50.512312 30217 ts_tablet_manager.cc:1403] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.237s	user 0.026s	sys 0.084s
I20260709 13:09:50.512814 30218 tablet_bootstrap.cc:654] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:50.512192 29926 catalog_manager.cc:5697] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
W20260709 13:09:50.505709 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 47477us
I20260709 13:09:50.515471 30217 raft_consensus.cc:359] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.516186 30217 raft_consensus.cc:385] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:50.516439 30217 raft_consensus.cc:740] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.517210 30217 consensus_queue.cc:260] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.503086 29922 catalog_manager.cc:5697] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:50.512312 30219 ts_tablet_manager.cc:1403] T 30a540a1b03746b785f2fc4692e05833 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.169s	user 0.034s	sys 0.035s
I20260709 13:09:50.489197 30023 raft_consensus.cc:2468] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 1.
I20260709 13:09:50.509642 30027 raft_consensus.cc:2468] T 8a3e809a994e4cbf98d7ea56807b8dad P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 1.
I20260709 13:09:50.526863 30217 ts_tablet_manager.cc:1434] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:09:50.526662 30219 raft_consensus.cc:359] T 30a540a1b03746b785f2fc4692e05833 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.527282 30219 raft_consensus.cc:385] T 30a540a1b03746b785f2fc4692e05833 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:50.527554 30219 raft_consensus.cc:740] T 30a540a1b03746b785f2fc4692e05833 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.528118 30218 tablet_bootstrap.cc:492] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:50.528460 30218 ts_tablet_manager.cc:1403] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.048s	user 0.007s	sys 0.016s
W20260709 13:09:50.507658 29994 leader_election.cc:343] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:50.529057 29994 leader_election.cc:304] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:09:50.530233 30219 consensus_queue.cc:260] T 30a540a1b03746b785f2fc4692e05833 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.532356 30219 ts_tablet_manager.cc:1434] T 30a540a1b03746b785f2fc4692e05833 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:09:50.534870 30219 tablet_bootstrap.cc:492] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:50.530135 30303 raft_consensus.cc:2749] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:50.533114 30218 raft_consensus.cc:359] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.538439 30218 raft_consensus.cc:385] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:50.538719 30218 raft_consensus.cc:740] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.539436 30218 consensus_queue.cc:260] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.540002 30282 consensus_queue.cc:1048] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:50.542524 30217 tablet_bootstrap.cc:492] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:50.547809 30219 tablet_bootstrap.cc:654] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:50.549029 30218 ts_tablet_manager.cc:1434] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.020s	user 0.003s	sys 0.002s
I20260709 13:09:50.550038 30218 tablet_bootstrap.cc:492] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:50.549681 30282 raft_consensus.cc:493] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.550751 30303 raft_consensus.cc:493] T 30a540a1b03746b785f2fc4692e05833 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.550705 30282 raft_consensus.cc:515] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.551290 30303 raft_consensus.cc:515] T 30a540a1b03746b785f2fc4692e05833 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.553200 30303 leader_election.cc:290] T 30a540a1b03746b785f2fc4692e05833 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:50.553377 30478 raft_consensus.cc:493] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.553719 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:50.553886 30478 raft_consensus.cc:515] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.554471 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:09:50.555158 29994 leader_election.cc:343] T 30a540a1b03746b785f2fc4692e05833 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:50.555708 29993 leader_election.cc:343] T 30a540a1b03746b785f2fc4692e05833 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:50.555975 30478 leader_election.cc:290] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:50.556069 29993 leader_election.cc:304] T 30a540a1b03746b785f2fc4692e05833 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:09:50.557390 30303 raft_consensus.cc:2749] T 30a540a1b03746b785f2fc4692e05833 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:50.558454 30282 leader_election.cc:290] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:50.559216 30218 tablet_bootstrap.cc:654] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:50.560364 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:50.560729 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:50.560932 30098 raft_consensus.cc:2468] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 0.
W20260709 13:09:50.562047 30143 leader_election.cc:343] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:50.563088 30143 leader_election.cc:304] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:50.564073 30346 raft_consensus.cc:493] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.564502 30346 raft_consensus.cc:515] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.565531 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:50.567273 30217 tablet_bootstrap.cc:654] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:50.569440 30140 leader_election.cc:343] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:50.574542 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:50.575444 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:09:50.575742 30066 leader_election.cc:343] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:50.580322 30176 raft_consensus.cc:2468] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 0.
I20260709 13:09:50.581434 30068 leader_election.cc:304] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:09:50.582278 30552 raft_consensus.cc:2804] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:50.582648 30552 raft_consensus.cc:493] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.582907 30217 tablet_bootstrap.cc:492] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:50.582973 30552 raft_consensus.cc:3060] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.583436 30217 ts_tablet_manager.cc:1403] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.041s	user 0.009s	sys 0.005s
I20260709 13:09:50.569741 30282 raft_consensus.cc:2804] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:50.569260 30346 leader_election.cc:290] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:50.572854 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:50.584734 30024 raft_consensus.cc:2468] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 0.
I20260709 13:09:50.585911 30346 raft_consensus.cc:493] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.586421 30346 raft_consensus.cc:515] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.588423 30346 leader_election.cc:290] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:50.586067 30217 raft_consensus.cc:359] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.591300 30217 raft_consensus.cc:385] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:50.591576 30217 raft_consensus.cc:740] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.594684 30217 consensus_queue.cc:260] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.602907 30217 ts_tablet_manager.cc:1434] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.019s	user 0.004s	sys 0.002s
I20260709 13:09:50.603868 30217 tablet_bootstrap.cc:492] T 5c8539fb97344b07aed5af91eaf0806f P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:50.603775 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:50.604529 30175 raft_consensus.cc:2393] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 1: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:09:50.606437 30309 consensus_queue.cc:1048] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:50.609041 30337 raft_consensus.cc:493] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.609490 30337 raft_consensus.cc:515] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.612439 30337 leader_election.cc:290] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:50.585629 30282 raft_consensus.cc:493] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.613519 30282 raft_consensus.cc:3060] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.614619 30217 tablet_bootstrap.cc:654] T 5c8539fb97344b07aed5af91eaf0806f P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:50.621738 30552 raft_consensus.cc:515] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.629410 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:50.625613 30098 raft_consensus.cc:3060] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.630100 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:50.630071 30027 raft_consensus.cc:2468] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 0.
I20260709 13:09:50.631513 30505 raft_consensus.cc:493] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.628468 30282 raft_consensus.cc:515] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.631960 30505 raft_consensus.cc:515] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.633692 30282 leader_election.cc:290] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:50.636382 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:09:50.636909 30103 raft_consensus.cc:3060] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.638638 30217 tablet_bootstrap.cc:492] T 5c8539fb97344b07aed5af91eaf0806f P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:50.639276 30217 ts_tablet_manager.cc:1403] T 5c8539fb97344b07aed5af91eaf0806f P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.036s	user 0.006s	sys 0.004s
I20260709 13:09:50.641009 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:50.630029 30219 tablet_bootstrap.cc:492] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:50.641775 30219 ts_tablet_manager.cc:1403] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.107s	user 0.021s	sys 0.037s
I20260709 13:09:50.642659 30103 raft_consensus.cc:2468] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 1.
I20260709 13:09:50.643687 30143 leader_election.cc:304] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:50.644497 30282 raft_consensus.cc:2804] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:50.645134 30282 raft_consensus.cc:697] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:09:50.646202 30219 raft_consensus.cc:359] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.648545 30219 raft_consensus.cc:385] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:50.624325 30140 leader_election.cc:304] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:09:50.649323 30219 raft_consensus.cc:740] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.646528 30282 consensus_queue.cc:237] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.649520 30337 raft_consensus.cc:2804] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:50.650133 30337 raft_consensus.cc:493] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.650445 30337 raft_consensus.cc:3060] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.651358 30478 consensus_queue.cc:1048] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:50.654199 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
W20260709 13:09:50.653475 29993 leader_election.cc:343] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:50.654728 30177 raft_consensus.cc:3060] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.657276 30505 leader_election.cc:290] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:50.648940 30552 leader_election.cc:290] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:50.647326 30217 raft_consensus.cc:359] T 5c8539fb97344b07aed5af91eaf0806f P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.660961 30217 raft_consensus.cc:385] T 5c8539fb97344b07aed5af91eaf0806f P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:50.661242 30217 raft_consensus.cc:740] T 5c8539fb97344b07aed5af91eaf0806f P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.661933 30217 consensus_queue.cc:260] T 5c8539fb97344b07aed5af91eaf0806f P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.663646 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:50.664403 30337 raft_consensus.cc:515] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:09:50.664927 30143 leader_election.cc:343] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:50.664206 30217 ts_tablet_manager.cc:1434] T 5c8539fb97344b07aed5af91eaf0806f P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 13:09:50.666158 30217 tablet_bootstrap.cc:492] T 0be979412dd54241bd212ddbb7611046 P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:50.663851 30177 raft_consensus.cc:2468] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 1.
I20260709 13:09:50.667151 30068 leader_election.cc:304] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:50.668030 30337 leader_election.cc:290] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:50.673529 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:09:50.674666 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:09:50.675209 30023 raft_consensus.cc:3060] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.676479 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:09:50.678557 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:50.679728 30066 leader_election.cc:304] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
W20260709 13:09:50.680912 30066 leader_election.cc:343] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:50.681887 30221 raft_consensus.cc:493] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.682340 30221 raft_consensus.cc:515] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.684046 30023 raft_consensus.cc:2468] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 1.
I20260709 13:09:50.684295 30221 leader_election.cc:290] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:50.670089 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:09:50.676376 30505 consensus_queue.cc:1048] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:50.684834 30221 raft_consensus.cc:2749] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:50.685833 30143 leader_election.cc:343] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:50.686614 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:50.687212 30175 raft_consensus.cc:2468] T 5c8539fb97344b07aed5af91eaf0806f P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 0.
W20260709 13:09:50.690339 29994 leader_election.cc:343] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:50.690708 29994 leader_election.cc:304] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:09:50.691318 30505 raft_consensus.cc:2749] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:50.691491 30218 tablet_bootstrap.cc:492] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:50.691902 30218 ts_tablet_manager.cc:1403] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.142s	user 0.022s	sys 0.031s
I20260709 13:09:50.686518 30140 leader_election.cc:304] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
W20260709 13:09:50.694651 30140 leader_election.cc:343] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:50.695556 30140 leader_election.cc:304] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:09:50.696276 30478 raft_consensus.cc:2804] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:50.697086 30226 raft_consensus.cc:2804] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:50.697599 30226 raft_consensus.cc:697] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:09:50.698433 30226 consensus_queue.cc:237] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.696622 30478 raft_consensus.cc:493] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.702364 30478 raft_consensus.cc:3060] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.703447 30218 raft_consensus.cc:359] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.704061 30218 raft_consensus.cc:385] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:50.704305 30218 raft_consensus.cc:740] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.704989 30218 consensus_queue.cc:260] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.708392 30218 ts_tablet_manager.cc:1434] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:09:50.711313 30218 tablet_bootstrap.cc:492] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:50.668834 30552 raft_consensus.cc:2804] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:50.714687 30552 raft_consensus.cc:697] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:09:50.715026 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:50.715602 30027 raft_consensus.cc:2468] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 0.
I20260709 13:09:50.715462 30552 consensus_queue.cc:237] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.716939 30218 tablet_bootstrap.cc:654] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:50.716928 30066 leader_election.cc:304] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:09:50.718456 30278 raft_consensus.cc:2804] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:50.718811 30278 raft_consensus.cc:493] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.719110 30278 raft_consensus.cc:3060] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.723338 30218 tablet_bootstrap.cc:492] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:50.723757 30218 ts_tablet_manager.cc:1403] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.013s	user 0.007s	sys 0.002s
I20260709 13:09:50.726059 30218 raft_consensus.cc:359] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.726641 30218 raft_consensus.cc:385] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:50.726876 30218 raft_consensus.cc:740] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.727424 30218 consensus_queue.cc:260] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.729321 30218 ts_tablet_manager.cc:1434] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:09:50.730271 30218 tablet_bootstrap.cc:492] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:50.674890 30219 consensus_queue.cc:260] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.730096 30478 raft_consensus.cc:515] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.743008 30478 leader_election.cc:290] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:50.743885 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:09:50.744451 30102 raft_consensus.cc:3060] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.732002 30278 raft_consensus.cc:515] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.749693 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:09:50.750269 30027 raft_consensus.cc:3060] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.750766 30278 leader_election.cc:290] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:50.752677 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:09:50.753204 30176 raft_consensus.cc:3060] T 5c8539fb97344b07aed5af91eaf0806f P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.755789 30219 ts_tablet_manager.cc:1434] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.114s	user 0.006s	sys 0.000s
I20260709 13:09:50.762462 30346 raft_consensus.cc:493] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.762913 30346 raft_consensus.cc:515] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.764788 30346 leader_election.cc:290] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:50.764878 30027 raft_consensus.cc:2468] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 1.
I20260709 13:09:50.765791 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:09:50.766335 30028 raft_consensus.cc:3060] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.766795 30102 raft_consensus.cc:2468] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 1.
I20260709 13:09:50.768944 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:50.769483 30175 raft_consensus.cc:2468] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 0.
I20260709 13:09:50.770803 30143 leader_election.cc:304] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:50.771557 30337 raft_consensus.cc:2804] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:50.772069 30337 raft_consensus.cc:697] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:09:50.773064 30337 consensus_queue.cc:237] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.774163 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:50.774195 30561 consensus_queue.cc:1048] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:50.777590 30219 tablet_bootstrap.cc:492] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:50.771957 30068 leader_election.cc:304] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:50.780063 30176 raft_consensus.cc:2468] T 5c8539fb97344b07aed5af91eaf0806f P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 1.
I20260709 13:09:50.781867 30278 raft_consensus.cc:2804] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:50.801924 30278 raft_consensus.cc:493] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:50.802266 30278 raft_consensus.cc:3060] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:50.802352 30028 raft_consensus.cc:2468] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 1.
I20260709 13:09:50.777159 30561 consensus_queue.cc:1048] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
W20260709 13:09:50.789909 30066 leader_election.cc:343] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:50.827176 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 44970.9us
I20260709 13:09:50.828552 30066 leader_election.cc:304] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:09:50.832376 30552 raft_consensus.cc:2804] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:50.838655 30552 raft_consensus.cc:697] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:09:50.840873 30505 raft_consensus.cc:493] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:50.848635 30552 consensus_queue.cc:237] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.841326 30505 raft_consensus.cc:515] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.857596 30505 leader_election.cc:290] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:50.858683 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:09:50.860417 29993 leader_election.cc:343] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:50.864928 30278 raft_consensus.cc:515] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.878813 30218 tablet_bootstrap.cc:654] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:50.864564 29922 catalog_manager.cc:5697] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 0 to 1, leader changed from <none> to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 1 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:50.884064 30346 consensus_queue.cc:1048] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:50.886699 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:50.889065 30278 leader_election.cc:290] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:50.894599 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:09:50.895210 30175 raft_consensus.cc:3060] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:50.901335 29994 leader_election.cc:343] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:50.902043 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:09:50.901590 30175 raft_consensus.cc:2468] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 1.
I20260709 13:09:50.904507 30068 leader_election.cc:304] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:50.905745 29994 leader_election.cc:304] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:09:50.905296 30346 raft_consensus.cc:2804] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:50.906594 30346 raft_consensus.cc:697] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:09:50.908634 30562 raft_consensus.cc:2749] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:09:50.913197 30066 leader_election.cc:343] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:50.907716 30346 consensus_queue.cc:237] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.927033 30217 tablet_bootstrap.cc:654] T 0be979412dd54241bd212ddbb7611046 P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:50.936751 30218 tablet_bootstrap.cc:492] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:50.937407 30218 ts_tablet_manager.cc:1403] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.207s	user 0.019s	sys 0.010s
I20260709 13:09:50.940709 29926 catalog_manager.cc:5697] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:50.941896 30219 tablet_bootstrap.cc:654] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:50.945935 30218 raft_consensus.cc:359] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.946894 30218 raft_consensus.cc:385] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:50.947201 30218 raft_consensus.cc:740] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.947957 30218 consensus_queue.cc:260] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.948123 30552 consensus_queue.cc:1048] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:50.950083 30218 ts_tablet_manager.cc:1434] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:09:50.951084 30218 tablet_bootstrap.cc:492] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:50.957262 30218 tablet_bootstrap.cc:654] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:50.958509 30549 consensus_queue.cc:1048] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:50.975996 30218 tablet_bootstrap.cc:492] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:50.976497 30218 ts_tablet_manager.cc:1403] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.026s	user 0.006s	sys 0.010s
I20260709 13:09:50.978947 30218 raft_consensus.cc:359] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.979698 30218 raft_consensus.cc:385] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:50.980041 30218 raft_consensus.cc:740] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:50.980695 30218 consensus_queue.cc:260] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:50.982723 30218 ts_tablet_manager.cc:1434] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:50.983634 30218 tablet_bootstrap.cc:492] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:50.984258 30278 consensus_queue.cc:1048] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:50.985389 29925 catalog_manager.cc:5697] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 0 to 1, leader changed from <none> to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 1 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:50.987217 29925 catalog_manager.cc:5697] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 0 to 1, leader changed from <none> to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 1 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:50.989106 30218 tablet_bootstrap.cc:654] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:50.996752 30219 tablet_bootstrap.cc:492] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:50.997229 30219 ts_tablet_manager.cc:1403] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.238s	user 0.031s	sys 0.028s
I20260709 13:09:50.999747 30219 raft_consensus.cc:359] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.000408 30219 raft_consensus.cc:385] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.000730 30219 raft_consensus.cc:740] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.001487 30219 consensus_queue.cc:260] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.003686 30219 ts_tablet_manager.cc:1434] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:51.005249 30219 tablet_bootstrap.cc:492] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:51.007679 30303 raft_consensus.cc:493] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.008157 30303 raft_consensus.cc:515] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.010128 30303 leader_election.cc:290] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:51.010951 30219 tablet_bootstrap.cc:654] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.012560 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:09:51.014058 29993 leader_election.cc:343] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:51.019644 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:51.020327 30098 raft_consensus.cc:2468] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 0.
I20260709 13:09:51.022943 29926 catalog_manager.cc:5697] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:51.026968 30219 tablet_bootstrap.cc:492] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:51.027390 30219 ts_tablet_manager.cc:1403] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.022s	user 0.012s	sys 0.003s
I20260709 13:09:51.029917 30219 raft_consensus.cc:359] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.030495 30219 raft_consensus.cc:385] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.030761 30219 raft_consensus.cc:740] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.040340 30217 tablet_bootstrap.cc:492] T 0be979412dd54241bd212ddbb7611046 P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:51.040771 30217 ts_tablet_manager.cc:1403] T 0be979412dd54241bd212ddbb7611046 P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.375s	user 0.036s	sys 0.001s
I20260709 13:09:51.043083 30217 raft_consensus.cc:359] T 0be979412dd54241bd212ddbb7611046 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.043738 30217 raft_consensus.cc:385] T 0be979412dd54241bd212ddbb7611046 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.044804 29926 catalog_manager.cc:5697] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:51.047111 29994 leader_election.cc:304] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:09:51.031328 30219 consensus_queue.cc:260] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.043977 30217 raft_consensus.cc:740] T 0be979412dd54241bd212ddbb7611046 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.051944 30217 consensus_queue.cc:260] T 0be979412dd54241bd212ddbb7611046 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.054546 30562 raft_consensus.cc:2804] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:51.054951 30562 raft_consensus.cc:493] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.058085 30562 raft_consensus.cc:3060] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:51.058820 30219 ts_tablet_manager.cc:1434] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 13:09:51.059698 30219 tablet_bootstrap.cc:492] T 8495d060d6b042a3b7bd9dba1055dbbf P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:51.064999 30219 tablet_bootstrap.cc:654] T 8495d060d6b042a3b7bd9dba1055dbbf P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.068671 30562 raft_consensus.cc:515] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.075763 30219 tablet_bootstrap.cc:492] T 8495d060d6b042a3b7bd9dba1055dbbf P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:51.076179 30219 ts_tablet_manager.cc:1403] T 8495d060d6b042a3b7bd9dba1055dbbf P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.017s	user 0.006s	sys 0.007s
I20260709 13:09:51.078536 30219 raft_consensus.cc:359] T 8495d060d6b042a3b7bd9dba1055dbbf P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.079167 30219 raft_consensus.cc:385] T 8495d060d6b042a3b7bd9dba1055dbbf P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.079420 30219 raft_consensus.cc:740] T 8495d060d6b042a3b7bd9dba1055dbbf P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.080058 30219 consensus_queue.cc:260] T 8495d060d6b042a3b7bd9dba1055dbbf P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.082216 30219 ts_tablet_manager.cc:1434] T 8495d060d6b042a3b7bd9dba1055dbbf P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:09:51.082736 30562 leader_election.cc:290] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:51.083199 30219 tablet_bootstrap.cc:492] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:51.086594 30217 ts_tablet_manager.cc:1434] T 0be979412dd54241bd212ddbb7611046 P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.001s
I20260709 13:09:51.091214 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
W20260709 13:09:51.096292 29993 leader_election.cc:343] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:51.100013 30219 tablet_bootstrap.cc:654] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.101230 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:09:51.101789 30102 raft_consensus.cc:3060] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:51.111661 30282 consensus_queue.cc:1048] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:51.111927 30102 raft_consensus.cc:2468] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 1.
I20260709 13:09:51.117185 30218 tablet_bootstrap.cc:492] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:51.117636 30218 ts_tablet_manager.cc:1403] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.134s	user 0.043s	sys 0.054s
I20260709 13:09:51.119529 29994 leader_election.cc:304] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
W20260709 13:09:51.119715 30140 consensus_peers.cc:597] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:51.120538 30562 raft_consensus.cc:2804] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:51.122810 30562 raft_consensus.cc:697] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:09:51.121268 30218 raft_consensus.cc:359] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.123629 30562 consensus_queue.cc:237] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.124210 30218 raft_consensus.cc:385] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.125152 30218 raft_consensus.cc:740] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.125803 30218 consensus_queue.cc:260] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.129248 30219 tablet_bootstrap.cc:492] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:51.130221 30219 ts_tablet_manager.cc:1403] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.047s	user 0.008s	sys 0.013s
I20260709 13:09:51.132288 30218 ts_tablet_manager.cc:1434] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 13:09:51.135247 30218 tablet_bootstrap.cc:492] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:51.138693 30217 tablet_bootstrap.cc:492] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:51.143671 30552 raft_consensus.cc:493] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.145452 30549 consensus_queue.cc:1048] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 13:09:51.151615 30219 raft_consensus.cc:359] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.152700 30219 raft_consensus.cc:385] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.153357 30219 raft_consensus.cc:740] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.154670 30219 consensus_queue.cc:260] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:09:51.155118 29974 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:09:51.151355 30552 raft_consensus.cc:515] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.163295 30219 ts_tablet_manager.cc:1434] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.000s
I20260709 13:09:51.177018 30219 tablet_bootstrap.cc:492] T b52e70a06b534fbf90cbcb6a010e9d43 P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:51.178248 30552 leader_election.cc:290] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:51.179756 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:51.180359 30027 raft_consensus.cc:2468] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 0.
I20260709 13:09:51.182765 30066 leader_election.cc:304] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:09:51.183075 29923 catalog_manager.cc:5697] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:51.184448 30549 raft_consensus.cc:2804] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:51.184782 30549 raft_consensus.cc:493] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.186713 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:51.185321 30549 raft_consensus.cc:3060] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:51.192922 30552 raft_consensus.cc:493] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.193389 30552 raft_consensus.cc:515] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.196116 30552 leader_election.cc:290] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:51.200250 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:51.200862 30218 tablet_bootstrap.cc:654] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
W20260709 13:09:51.201165 30068 leader_election.cc:343] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:51.200824 30027 raft_consensus.cc:2468] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 0.
I20260709 13:09:51.205554 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:51.199991 30549 raft_consensus.cc:515] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.207262 30217 tablet_bootstrap.cc:654] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.206139 30177 raft_consensus.cc:2468] T 0be979412dd54241bd212ddbb7611046 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 0.
I20260709 13:09:51.208885 30066 leader_election.cc:304] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:09:51.220649 30549 leader_election.cc:290] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:51.221179 30549 raft_consensus.cc:2804] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:51.221487 30549 raft_consensus.cc:493] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.221812 30549 raft_consensus.cc:3060] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:51.222072 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:09:51.229830 30023 raft_consensus.cc:3060] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:51.230270 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:09:51.238178 30023 raft_consensus.cc:2468] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 1.
I20260709 13:09:51.239245 30066 leader_election.cc:304] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:09:51.239966 30278 raft_consensus.cc:2804] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:51.240397 30278 raft_consensus.cc:697] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:09:51.241154 30278 consensus_queue.cc:237] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.242733 30027 raft_consensus.cc:3060] T 8495d060d6b042a3b7bd9dba1055dbbf P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:51.243261 30068 leader_election.cc:343] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:09:51.250932 30143 consensus_peers.cc:597] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:51.251869 30218 tablet_bootstrap.cc:492] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:51.252385 30218 ts_tablet_manager.cc:1403] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.117s	user 0.008s	sys 0.004s
I20260709 13:09:51.252918 30346 consensus_queue.cc:1048] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:51.256621 30219 tablet_bootstrap.cc:654] T b52e70a06b534fbf90cbcb6a010e9d43 P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.256330 30218 raft_consensus.cc:359] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.256939 30218 raft_consensus.cc:385] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.245409 30549 raft_consensus.cc:515] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.257216 30218 raft_consensus.cc:740] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.259567 30218 consensus_queue.cc:260] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.261687 30218 ts_tablet_manager.cc:1434] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.002s
I20260709 13:09:51.262630 30218 tablet_bootstrap.cc:492] T 7d7c81315a41495eafb4a8020a99cb7c P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:51.263145 30217 tablet_bootstrap.cc:492] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:51.263546 30217 ts_tablet_manager.cc:1403] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.125s	user 0.004s	sys 0.008s
I20260709 13:09:51.264101 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:09:51.264591 30028 raft_consensus.cc:3060] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:51.267889 30218 tablet_bootstrap.cc:654] T 7d7c81315a41495eafb4a8020a99cb7c P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.271311 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:09:51.271826 30176 raft_consensus.cc:3060] T 0be979412dd54241bd212ddbb7611046 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:51.272300 30028 raft_consensus.cc:2468] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 1.
I20260709 13:09:51.275558 30066 leader_election.cc:304] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:09:51.277292 30176 raft_consensus.cc:2468] T 0be979412dd54241bd212ddbb7611046 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 1.
I20260709 13:09:51.278406 30549 leader_election.cc:290] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:51.280664 30219 tablet_bootstrap.cc:492] T b52e70a06b534fbf90cbcb6a010e9d43 P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:51.281361 30278 raft_consensus.cc:2804] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:51.284845 30549 consensus_queue.cc:1048] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:51.291157 30278 raft_consensus.cc:697] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:09:51.291947 30278 consensus_queue.cc:237] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.285396 30217 raft_consensus.cc:359] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.290261 30218 tablet_bootstrap.cc:492] T 7d7c81315a41495eafb4a8020a99cb7c P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:51.295351 30217 raft_consensus.cc:385] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.295578 30218 ts_tablet_manager.cc:1403] T 7d7c81315a41495eafb4a8020a99cb7c P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.005s
I20260709 13:09:51.295677 30217 raft_consensus.cc:740] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.296517 30217 consensus_queue.cc:260] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.298223 30218 raft_consensus.cc:359] T 7d7c81315a41495eafb4a8020a99cb7c P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.298926 30218 raft_consensus.cc:385] T 7d7c81315a41495eafb4a8020a99cb7c P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.299189 30218 raft_consensus.cc:740] T 7d7c81315a41495eafb4a8020a99cb7c P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.304270 30218 consensus_queue.cc:260] T 7d7c81315a41495eafb4a8020a99cb7c P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.305460 30217 ts_tablet_manager.cc:1434] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.001s
I20260709 13:09:51.305943 30552 consensus_queue.cc:1048] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:51.306931 30218 ts_tablet_manager.cc:1434] T 7d7c81315a41495eafb4a8020a99cb7c P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:09:51.307826 30218 tablet_bootstrap.cc:492] T 31b19922895c4885a5a8bc5030afcba3 P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:51.311031 30219 ts_tablet_manager.cc:1403] T b52e70a06b534fbf90cbcb6a010e9d43 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.134s	user 0.010s	sys 0.000s
I20260709 13:09:51.314464 30217 tablet_bootstrap.cc:492] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:51.286172 29922 catalog_manager.cc:5697] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:51.313473 30219 raft_consensus.cc:359] T b52e70a06b534fbf90cbcb6a010e9d43 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.319681 30219 raft_consensus.cc:385] T b52e70a06b534fbf90cbcb6a010e9d43 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.319739 30226 consensus_queue.cc:1048] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:51.322834 30218 tablet_bootstrap.cc:654] T 31b19922895c4885a5a8bc5030afcba3 P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.326359 30226 consensus_queue.cc:1048] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:51.319947 30219 raft_consensus.cc:740] T b52e70a06b534fbf90cbcb6a010e9d43 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.333128 30219 consensus_queue.cc:260] T b52e70a06b534fbf90cbcb6a010e9d43 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.336542 30217 tablet_bootstrap.cc:654] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.340049 30278 consensus_queue.cc:1048] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:51.346997 30218 tablet_bootstrap.cc:492] T 31b19922895c4885a5a8bc5030afcba3 P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:51.347446 30218 ts_tablet_manager.cc:1403] T 31b19922895c4885a5a8bc5030afcba3 P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.040s	user 0.009s	sys 0.001s
I20260709 13:09:51.349223 30219 ts_tablet_manager.cc:1434] T b52e70a06b534fbf90cbcb6a010e9d43 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.000s
I20260709 13:09:51.350260 30219 tablet_bootstrap.cc:492] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:51.350332 30218 raft_consensus.cc:359] T 31b19922895c4885a5a8bc5030afcba3 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.350963 30218 raft_consensus.cc:385] T 31b19922895c4885a5a8bc5030afcba3 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.351191 30218 raft_consensus.cc:740] T 31b19922895c4885a5a8bc5030afcba3 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.353694 29926 catalog_manager.cc:5697] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:51.351735 30218 consensus_queue.cc:260] T 31b19922895c4885a5a8bc5030afcba3 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.356724 30219 tablet_bootstrap.cc:654] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.360025 30218 ts_tablet_manager.cc:1434] T 31b19922895c4885a5a8bc5030afcba3 P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.002s
I20260709 13:09:51.361073 30218 tablet_bootstrap.cc:492] T 632c5405056e40be8152973f0c966318 P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:51.361709 30219 tablet_bootstrap.cc:492] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:51.362185 30219 ts_tablet_manager.cc:1403] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.012s	user 0.006s	sys 0.005s
I20260709 13:09:51.364552 30219 raft_consensus.cc:359] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.365407 30219 raft_consensus.cc:385] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.365702 30219 raft_consensus.cc:740] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.367921 30219 consensus_queue.cc:260] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.370045 30219 ts_tablet_manager.cc:1434] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:09:51.375635 30219 tablet_bootstrap.cc:492] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:51.378633 30028 raft_consensus.cc:3060] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:51.381059 30219 tablet_bootstrap.cc:654] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.382441 30218 tablet_bootstrap.cc:654] T 632c5405056e40be8152973f0c966318 P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.396010 30278 consensus_queue.cc:1048] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:09:51.406317 30203 tablet.cc:2406] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:09:51.408396 30226 consensus_queue.cc:1048] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:51.409766 30217 tablet_bootstrap.cc:492] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:51.413061 30218 tablet_bootstrap.cc:492] T 632c5405056e40be8152973f0c966318 P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:51.413549 30218 ts_tablet_manager.cc:1403] T 632c5405056e40be8152973f0c966318 P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.053s	user 0.010s	sys 0.006s
I20260709 13:09:51.410193 30217 ts_tablet_manager.cc:1403] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.096s	user 0.037s	sys 0.013s
I20260709 13:09:51.416541 30218 raft_consensus.cc:359] T 632c5405056e40be8152973f0c966318 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.417279 30218 raft_consensus.cc:385] T 632c5405056e40be8152973f0c966318 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.417574 30218 raft_consensus.cc:740] T 632c5405056e40be8152973f0c966318 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.418345 30218 consensus_queue.cc:260] T 632c5405056e40be8152973f0c966318 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.419514 30217 raft_consensus.cc:359] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.420118 30217 raft_consensus.cc:385] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.420377 30217 raft_consensus.cc:740] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.420935 30218 ts_tablet_manager.cc:1434] T 632c5405056e40be8152973f0c966318 P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:09:51.424628 30218 tablet_bootstrap.cc:492] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:51.432581 30217 consensus_queue.cc:260] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.434881 30217 ts_tablet_manager.cc:1434] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:09:51.435904 30217 tablet_bootstrap.cc:492] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:51.448937 30218 tablet_bootstrap.cc:654] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.450764 30217 tablet_bootstrap.cc:654] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.453222 30219 tablet_bootstrap.cc:492] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:51.453683 30219 ts_tablet_manager.cc:1403] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.078s	user 0.026s	sys 0.019s
I20260709 13:09:51.456466 30219 raft_consensus.cc:359] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.457130 30219 raft_consensus.cc:385] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.457391 30219 raft_consensus.cc:740] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.458153 30219 consensus_queue.cc:260] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.469401 30219 ts_tablet_manager.cc:1434] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.003s
I20260709 13:09:51.471022 30219 tablet_bootstrap.cc:492] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:51.475338 30217 tablet_bootstrap.cc:492] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:51.475814 30217 ts_tablet_manager.cc:1403] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.040s	user 0.013s	sys 0.015s
I20260709 13:09:51.478555 30219 tablet_bootstrap.cc:654] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.478442 30217 raft_consensus.cc:359] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.479074 30217 raft_consensus.cc:385] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.479348 30217 raft_consensus.cc:740] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.479974 30217 consensus_queue.cc:260] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.482128 30217 ts_tablet_manager.cc:1434] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:09:51.483049 30217 tablet_bootstrap.cc:492] T 0a722bee3f14472ebed5b798e61c64b3 P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:51.490099 30303 raft_consensus.cc:493] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.490533 30303 raft_consensus.cc:515] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.492317 30303 leader_election.cc:290] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:51.493343 30303 raft_consensus.cc:493] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.493476 30217 tablet_bootstrap.cc:654] T 0a722bee3f14472ebed5b798e61c64b3 P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.495108 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:09:51.497200 29993 leader_election.cc:343] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:51.504136 30219 tablet_bootstrap.cc:492] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:51.504626 30219 ts_tablet_manager.cc:1403] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.034s	user 0.016s	sys 0.013s
I20260709 13:09:51.507081 30219 raft_consensus.cc:359] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.507737 30219 raft_consensus.cc:385] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.507828 30217 tablet_bootstrap.cc:492] T 0a722bee3f14472ebed5b798e61c64b3 P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:51.508154 30219 raft_consensus.cc:740] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.508345 30217 ts_tablet_manager.cc:1403] T 0a722bee3f14472ebed5b798e61c64b3 P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.010s
I20260709 13:09:51.508889 30219 consensus_queue.cc:260] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.509902 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:51.510725 30217 raft_consensus.cc:359] T 0a722bee3f14472ebed5b798e61c64b3 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.511312 30217 raft_consensus.cc:385] T 0a722bee3f14472ebed5b798e61c64b3 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.511535 30217 raft_consensus.cc:740] T 0a722bee3f14472ebed5b798e61c64b3 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.512094 30217 consensus_queue.cc:260] T 0a722bee3f14472ebed5b798e61c64b3 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.513921 30217 ts_tablet_manager.cc:1434] T 0a722bee3f14472ebed5b798e61c64b3 P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
W20260709 13:09:51.514410 29994 leader_election.cc:343] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:51.514933 30217 tablet_bootstrap.cc:492] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:51.515465 30219 ts_tablet_manager.cc:1434] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:09:51.516439 30219 tablet_bootstrap.cc:492] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4: Bootstrap starting.
I20260709 13:09:51.514827 29994 leader_election.cc:304] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:09:51.520560 30404 raft_consensus.cc:2749] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:51.521449 30217 tablet_bootstrap.cc:654] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.522703 30219 tablet_bootstrap.cc:654] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.523213 30303 raft_consensus.cc:515] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.524930 30303 leader_election.cc:290] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:51.525869 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:51.526409 30176 raft_consensus.cc:2468] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 0.
I20260709 13:09:51.527302 29993 leader_election.cc:304] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:51.528961 30303 raft_consensus.cc:2804] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:51.529273 30303 raft_consensus.cc:493] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.529556 30303 raft_consensus.cc:3060] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:51.531015 30219 tablet_bootstrap.cc:492] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4: No bootstrap required, opened a new log
I20260709 13:09:51.531544 30219 ts_tablet_manager.cc:1403] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:09:51.532631 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:51.533193 30098 raft_consensus.cc:2468] T 632c5405056e40be8152973f0c966318 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 0.
I20260709 13:09:51.534958 30219 raft_consensus.cc:359] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.536586 30219 raft_consensus.cc:385] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.536890 30219 raft_consensus.cc:740] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.536929 30303 raft_consensus.cc:515] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.537693 30217 tablet_bootstrap.cc:492] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:51.537678 30219 consensus_queue.cc:260] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.538229 30217 ts_tablet_manager.cc:1403] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.007s
I20260709 13:09:51.539511 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:09:51.539994 30176 raft_consensus.cc:3060] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:51.540650 30217 raft_consensus.cc:359] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.541250 30217 raft_consensus.cc:385] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.541477 30217 raft_consensus.cc:740] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.542075 30217 consensus_queue.cc:260] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.543946 30217 ts_tablet_manager.cc:1434] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.001s
I20260709 13:09:51.544229 30219 ts_tablet_manager.cc:1434] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:09:51.544998 30217 tablet_bootstrap.cc:492] T 57ce415a86d343cb8bdff28acc41c6a6 P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:51.548120 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:09:51.548708 30098 raft_consensus.cc:3060] T 632c5405056e40be8152973f0c966318 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:51.549638 30217 tablet_bootstrap.cc:654] T 57ce415a86d343cb8bdff28acc41c6a6 P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.553673 30217 tablet_bootstrap.cc:492] T 57ce415a86d343cb8bdff28acc41c6a6 P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:51.554082 30217 ts_tablet_manager.cc:1403] T 57ce415a86d343cb8bdff28acc41c6a6 P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:09:51.554229 30098 raft_consensus.cc:2468] T 632c5405056e40be8152973f0c966318 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 1.
I20260709 13:09:51.556360 30217 raft_consensus.cc:359] T 57ce415a86d343cb8bdff28acc41c6a6 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.556948 30217 raft_consensus.cc:385] T 57ce415a86d343cb8bdff28acc41c6a6 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.557205 30217 raft_consensus.cc:740] T 57ce415a86d343cb8bdff28acc41c6a6 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.558951 30303 leader_election.cc:290] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:51.558238 30217 consensus_queue.cc:260] T 57ce415a86d343cb8bdff28acc41c6a6 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.559933 30218 tablet_bootstrap.cc:492] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:51.560348 30218 ts_tablet_manager.cc:1403] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.136s	user 0.005s	sys 0.005s
I20260709 13:09:51.561136 30217 ts_tablet_manager.cc:1434] T 57ce415a86d343cb8bdff28acc41c6a6 P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:09:51.562058 30217 tablet_bootstrap.cc:492] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:51.563252 30218 raft_consensus.cc:359] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.563858 30218 raft_consensus.cc:385] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.564201 30218 raft_consensus.cc:740] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.564878 30218 consensus_queue.cc:260] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.568833 30217 tablet_bootstrap.cc:654] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.569021 30218 ts_tablet_manager.cc:1434] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:09:51.572126 29994 leader_election.cc:304] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:09:51.546214 30176 raft_consensus.cc:2468] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 1.
I20260709 13:09:51.573046 30218 tablet_bootstrap.cc:492] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:51.576073 30562 raft_consensus.cc:2804] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:51.576488 30562 raft_consensus.cc:697] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:09:51.577119 30562 consensus_queue.cc:237] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.580845 30175 raft_consensus.cc:3060] T 0a722bee3f14472ebed5b798e61c64b3 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:51.583499 30218 tablet_bootstrap.cc:654] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.589519 30024 raft_consensus.cc:3060] T b52e70a06b534fbf90cbcb6a010e9d43 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:51.589983 30303 consensus_queue.cc:1048] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:51.605060 30562 raft_consensus.cc:493] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.605707 30562 raft_consensus.cc:515] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.607847 30562 leader_election.cc:290] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:51.609341 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
W20260709 13:09:51.613734 29994 leader_election.cc:343] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:51.619570 30217 tablet_bootstrap.cc:492] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:51.620030 30217 ts_tablet_manager.cc:1403] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.058s	user 0.018s	sys 0.016s
I20260709 13:09:51.623147 30217 raft_consensus.cc:359] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.623837 30217 raft_consensus.cc:385] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.624109 30217 raft_consensus.cc:740] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.624764 30217 consensus_queue.cc:260] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.626875 30217 ts_tablet_manager.cc:1434] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:09:51.628166 30217 tablet_bootstrap.cc:492] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:51.630002 30552 consensus_queue.cc:1048] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:51.633831 30217 tablet_bootstrap.cc:654] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.635800 29926 catalog_manager.cc:5697] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:51.644240 30478 raft_consensus.cc:493] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.644662 30217 tablet_bootstrap.cc:492] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:51.698549 30217 ts_tablet_manager.cc:1403] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.071s	user 0.012s	sys 0.004s
I20260709 13:09:51.698312 30478 raft_consensus.cc:515] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.644954 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:51.702099 30478 leader_election.cc:290] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:51.703339 30478 raft_consensus.cc:493] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.651153 30282 raft_consensus.cc:493] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.703783 30478 raft_consensus.cc:515] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.703948 30282 raft_consensus.cc:515] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.701839 30217 raft_consensus.cc:359] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.705377 30217 raft_consensus.cc:385] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.705653 30217 raft_consensus.cc:740] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.705830 30478 leader_election.cc:290] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:51.705994 30177 raft_consensus.cc:2468] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 0.
I20260709 13:09:51.706377 30217 consensus_queue.cc:260] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.653813 30218 tablet_bootstrap.cc:492] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:51.707883 30217 ts_tablet_manager.cc:1434] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.003s
I20260709 13:09:51.707929 30218 ts_tablet_manager.cc:1403] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.138s	user 0.025s	sys 0.004s
I20260709 13:09:51.709867 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:51.710850 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:51.712201 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:51.714970 30218 raft_consensus.cc:359] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.715643 30218 raft_consensus.cc:385] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.715883 30218 raft_consensus.cc:740] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.717113 30217 tablet_bootstrap.cc:492] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124: Bootstrap starting.
I20260709 13:09:51.717720 30218 consensus_queue.cc:260] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.706055 30282 leader_election.cc:290] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:51.719950 30218 ts_tablet_manager.cc:1434] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
W20260709 13:09:51.727082 30143 leader_election.cc:343] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:51.728796 30217 tablet_bootstrap.cc:654] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.729770 30218 tablet_bootstrap.cc:492] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:51.737862 30218 tablet_bootstrap.cc:654] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:51.752126 30217 tablet_bootstrap.cc:492] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124: No bootstrap required, opened a new log
I20260709 13:09:51.752832 30217 ts_tablet_manager.cc:1403] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.003s
I20260709 13:09:51.756259 30278 raft_consensus.cc:493] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.756722 30278 raft_consensus.cc:515] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.758522 30278 leader_election.cc:290] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:51.759275 30217 raft_consensus.cc:359] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.759910 30217 raft_consensus.cc:385] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:51.760154 30217 raft_consensus.cc:740] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Initialized, Role: FOLLOWER
I20260709 13:09:51.760823 30217 consensus_queue.cc:260] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.762925 30217 ts_tablet_manager.cc:1434] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 13:09:51.767570 30478 raft_consensus.cc:493] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.768460 30478 raft_consensus.cc:515] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.771140 30478 leader_election.cc:290] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:51.773422 30096 raft_consensus.cc:2468] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 0.
I20260709 13:09:51.787463 30143 leader_election.cc:304] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:51.789655 30176 raft_consensus.cc:3060] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:51.790249 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:51.790854 30173 raft_consensus.cc:2468] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 0.
I20260709 13:09:51.792249 30478 raft_consensus.cc:2804] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:51.792593 30478 raft_consensus.cc:493] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.792906 30478 raft_consensus.cc:3060] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:51.797782 30549 raft_consensus.cc:493] T 7d7c81315a41495eafb4a8020a99cb7c P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:51.798168 30478 raft_consensus.cc:515] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.798264 30549 raft_consensus.cc:515] T 7d7c81315a41495eafb4a8020a99cb7c P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:51.800333 30549 leader_election.cc:290] T 7d7c81315a41495eafb4a8020a99cb7c P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:51.801882 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:51.802070 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:51.802443 30028 raft_consensus.cc:2468] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 0.
I20260709 13:09:51.802682 30025 raft_consensus.cc:2468] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 0.
I20260709 13:09:51.803083 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:51.806121 30068 leader_election.cc:304] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:51.809326 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:51.811153 30552 raft_consensus.cc:2804] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:51.811550 30552 raft_consensus.cc:493] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:51.811872 30552 raft_consensus.cc:3060] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:51.814467 30221 consensus_queue.cc:1048] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:51.816010 30221 consensus_queue.cc:1048] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:51.821997 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:51.822789 30027 raft_consensus.cc:2468] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 0.
I20260709 13:09:51.824129 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:51.824846 30103 raft_consensus.cc:2468] T 31b19922895c4885a5a8bc5030afcba3 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 0.
I20260709 13:09:51.836944 30096 raft_consensus.cc:3060] T 7d7c81315a41495eafb4a8020a99cb7c P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:51.843375 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:51.844063 30023 raft_consensus.cc:2468] T 30a540a1b03746b785f2fc4692e05833 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 0.
I20260709 13:09:51.845722 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:09:51.996194 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 181186us
I20260709 13:09:52.055986 30628 raft_consensus.cc:493] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.067425 30552 raft_consensus.cc:515] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:52.071523 30140 leader_election.cc:304] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:52.071648 30552 leader_election.cc:290] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:52.072460 30628 raft_consensus.cc:515] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:52.074756 30628 leader_election.cc:290] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:52.072376 30140 leader_election.cc:304] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:09:52.076561 30140 leader_election.cc:304] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:09:52.077910 30634 raft_consensus.cc:2749] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:52.078971 30634 raft_consensus.cc:2804] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:52.079310 30634 raft_consensus.cc:493] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:52.079638 30634 raft_consensus.cc:3060] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:52.085027 30626 raft_consensus.cc:493] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.085525 30626 raft_consensus.cc:515] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:52.087389 30626 leader_election.cc:290] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:52.090480 30630 consensus_queue.cc:1048] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:52.091516 30066 leader_election.cc:304] T 7d7c81315a41495eafb4a8020a99cb7c P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:09:52.095625 30626 consensus_queue.cc:1048] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:52.100148 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:52.072510 30629 raft_consensus.cc:2804] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:52.100474 30634 raft_consensus.cc:515] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:09:52.156785 29994 leader_election.cc:343] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:09:52.155551 30629 raft_consensus.cc:493] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:52.171985 30632 consensus_queue.cc:1048] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
W20260709 13:09:52.186779 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 79073.8us
I20260709 13:09:52.173440 30629 raft_consensus.cc:3060] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:52.344731 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:52.387452 30172 raft_consensus.cc:2468] T 57ce415a86d343cb8bdff28acc41c6a6 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 0.
W20260709 13:09:52.390714 29974 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260709 13:09:52.493969 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 65084.5us
I20260709 13:09:52.497983 30627 raft_consensus.cc:2749] T 7d7c81315a41495eafb4a8020a99cb7c P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:09:52.522662 30629 raft_consensus.cc:515] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:52.534720 30643 raft_consensus.cc:493] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:09:52.535243 30643 raft_consensus.cc:515] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:52.562000 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:09:52.562649 30173 raft_consensus.cc:3060] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:52.569459 30173 raft_consensus.cc:2468] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 1.
I20260709 13:09:52.573971 30218 tablet_bootstrap.cc:492] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:52.574436 30218 ts_tablet_manager.cc:1403] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.850s	user 0.028s	sys 0.027s
I20260709 13:09:52.576798 30218 raft_consensus.cc:359] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:52.577390 30218 raft_consensus.cc:385] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:52.577629 30218 raft_consensus.cc:740] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.578337 30218 consensus_queue.cc:260] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:52.580844 30218 ts_tablet_manager.cc:1434] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:09:52.582355 30218 tablet_bootstrap.cc:492] T 935127b9887c4175b5b65fd739c5cffe P 5ec73dc157ed476ca903a7d596271719: Bootstrap starting.
I20260709 13:09:52.588091 30218 tablet_bootstrap.cc:654] T 935127b9887c4175b5b65fd739c5cffe P 5ec73dc157ed476ca903a7d596271719: Neither blocks nor log segments found. Creating new log.
I20260709 13:09:52.588939 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:09:52.589536 30022 raft_consensus.cc:3060] T 30a540a1b03746b785f2fc4692e05833 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:09:52.591976 29993 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.783s	user 0.012s	sys 0.006s
W20260709 13:09:52.592295 29993 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.783s	user 0.012s	sys 0.006s
W20260709 13:09:52.592556 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 783276us
I20260709 13:09:52.599099 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:52.599649 30027 raft_consensus.cc:2468] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 0.
I20260709 13:09:52.612849 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:09:52.613540 30177 raft_consensus.cc:2468] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 0.
I20260709 13:09:52.615746 30634 leader_election.cc:290] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:52.617321 30478 leader_election.cc:290] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:52.627043 29993 leader_election.cc:304] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:09:52.628150 30630 raft_consensus.cc:2804] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:52.628517 30630 raft_consensus.cc:493] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:52.629240 30630 raft_consensus.cc:3060] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:52.629462 30643 leader_election.cc:290] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:52.632071 30066 leader_election.cc:304] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:09:52.639707 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:09:52.640390 30026 raft_consensus.cc:3060] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:52.640527 30633 raft_consensus.cc:2804] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:52.640915 30633 raft_consensus.cc:493] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:52.641224 30633 raft_consensus.cc:3060] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:52.623970 30022 raft_consensus.cc:2468] T 30a540a1b03746b785f2fc4692e05833 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 1.
I20260709 13:09:52.655849 30633 raft_consensus.cc:515] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:52.666041 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:09:52.666689 30023 raft_consensus.cc:2468] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 0.
I20260709 13:09:52.658026 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:09:52.665400 30026 raft_consensus.cc:2468] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 1.
I20260709 13:09:52.679519 30629 leader_election.cc:290] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:52.693689 30630 raft_consensus.cc:515] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:52.702735 30633 leader_election.cc:290] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:52.708375 30024 raft_consensus.cc:2393] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 1: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:09:52.711602 30630 leader_election.cc:290] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:52.714708 30218 tablet_bootstrap.cc:492] T 935127b9887c4175b5b65fd739c5cffe P 5ec73dc157ed476ca903a7d596271719: No bootstrap required, opened a new log
I20260709 13:09:52.715162 30218 ts_tablet_manager.cc:1403] T 935127b9887c4175b5b65fd739c5cffe P 5ec73dc157ed476ca903a7d596271719: Time spent bootstrapping tablet: real 0.133s	user 0.028s	sys 0.029s
I20260709 13:09:52.717801 30218 raft_consensus.cc:359] T 935127b9887c4175b5b65fd739c5cffe P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:52.718454 30218 raft_consensus.cc:385] T 935127b9887c4175b5b65fd739c5cffe P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:09:52.718699 30218 raft_consensus.cc:740] T 935127b9887c4175b5b65fd739c5cffe P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Initialized, Role: FOLLOWER
I20260709 13:09:52.719264 30218 consensus_queue.cc:260] T 935127b9887c4175b5b65fd739c5cffe P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:52.721261 30218 ts_tablet_manager.cc:1434] T 935127b9887c4175b5b65fd739c5cffe P 5ec73dc157ed476ca903a7d596271719: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
W20260709 13:09:52.727129 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 83604.3us
I20260709 13:09:52.729779 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:09:52.730721 30096 raft_consensus.cc:3060] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:52.731254 30066 leader_election.cc:304] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:09:52.732050 30633 raft_consensus.cc:2804] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:52.732826 30140 leader_election.cc:304] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:52.733842 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:09:52.733726 30629 raft_consensus.cc:2804] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:52.734408 30629 raft_consensus.cc:493] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:52.734771 30629 raft_consensus.cc:3060] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:52.738008 30096 raft_consensus.cc:2468] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 1.
I20260709 13:09:52.738791 30140 leader_election.cc:304] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:52.732872 30633 raft_consensus.cc:697] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:09:52.738960 30103 raft_consensus.cc:3060] T 935127b9887c4175b5b65fd739c5cffe P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:52.739499 30481 raft_consensus.cc:2804] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:52.740038 30481 raft_consensus.cc:697] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:09:52.740808 30481 consensus_queue.cc:237] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:52.741393 30629 raft_consensus.cc:515] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:52.742605 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:09:52.743180 30100 raft_consensus.cc:2468] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 0.
I20260709 13:09:52.744174 30629 leader_election.cc:290] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:09:52.744779 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:09:52.745368 30100 raft_consensus.cc:3060] T 31b19922895c4885a5a8bc5030afcba3 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:52.745242 30633 consensus_queue.cc:237] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:09:52.747084 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 107499us
I20260709 13:09:52.749838 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:09:52.750301 30027 raft_consensus.cc:3060] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:52.755595 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:09:52.756307 30171 raft_consensus.cc:2393] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 1: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:09:52.757043 29993 leader_election.cc:304] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:09:52.759881 30404 raft_consensus.cc:2804] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:09:52.760249 30404 raft_consensus.cc:493] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:09:52.760573 30404 raft_consensus.cc:3060] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:52.764879 30100 raft_consensus.cc:2468] T 31b19922895c4885a5a8bc5030afcba3 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 1.
I20260709 13:09:52.772711 30659 consensus_queue.cc:1048] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:09:52.765576 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:09:52.766278 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:09:52.773595 30022 raft_consensus.cc:3060] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:52.774128 29922 catalog_manager.cc:5697] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 0 to 1, leader changed from <none> to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 1 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:52.767284 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:09:52.780773 30022 raft_consensus.cc:2468] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 1.
I20260709 13:09:52.781137 30103 raft_consensus.cc:2468] T 935127b9887c4175b5b65fd739c5cffe P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 1.
I20260709 13:09:52.781844 30027 raft_consensus.cc:2468] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 1.
I20260709 13:09:52.787082 30404 raft_consensus.cc:515] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:52.788200 30026 raft_consensus.cc:2393] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 1: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:09:52.795074 30404 leader_election.cc:290] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:52.796377 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:09:52.797206 30171 raft_consensus.cc:2393] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 1: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:09:52.799270 29994 leader_election.cc:304] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:09:52.799975 30632 raft_consensus.cc:2749] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:52.806651 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:09:52.807262 30171 raft_consensus.cc:3060] T 57ce415a86d343cb8bdff28acc41c6a6 P c99569d27a6f4c648eae7119fe3db124 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:52.816977 30140 leader_election.cc:304] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:09:52.817896 30481 raft_consensus.cc:2804] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:52.818377 30481 raft_consensus.cc:697] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:09:52.819150 30481 consensus_queue.cc:237] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:52.823880 30066 leader_election.cc:304] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:09:52.824592 30633 raft_consensus.cc:2804] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:52.825044 30633 raft_consensus.cc:697] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:09:52.825820 30633 consensus_queue.cc:237] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:52.827960 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:09:52.828553 30100 raft_consensus.cc:3060] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:09:52.829972 30171 raft_consensus.cc:2468] T 57ce415a86d343cb8bdff28acc41c6a6 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 1.
W20260709 13:09:52.834196 30124 debug-util.cc:398] Leaking SignalData structure 0x7b08001f0740 after lost signal to thread 28892
W20260709 13:09:52.835137 30124 debug-util.cc:398] Leaking SignalData structure 0x7b0800044d00 after lost signal to thread 29960
W20260709 13:09:52.836146 30124 debug-util.cc:398] Leaking SignalData structure 0x7b0800118d00 after lost signal to thread 30052
W20260709 13:09:52.837057 30124 debug-util.cc:398] Leaking SignalData structure 0x7b0800145360 after lost signal to thread 30127
W20260709 13:09:52.838011 30124 debug-util.cc:398] Leaking SignalData structure 0x7b080013ff20 after lost signal to thread 30201
I20260709 13:09:52.839102 30100 raft_consensus.cc:2468] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 1.
I20260709 13:09:52.848129 29994 leader_election.cc:304] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:09:52.848907 30632 raft_consensus.cc:2804] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:52.849414 30632 raft_consensus.cc:697] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:09:52.850286 30632 consensus_queue.cc:237] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:52.856642 30143 leader_election.cc:304] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:09:52.857683 30629 raft_consensus.cc:2804] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:09:52.858592 30629 raft_consensus.cc:697] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:09:52.859409 30629 consensus_queue.cc:237] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:09:52.869949 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:09:52.870770 30100 raft_consensus.cc:2393] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 1: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:09:52.870103 29923 catalog_manager.cc:5697] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 0 to 1, leader changed from <none> to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:52.879765 30143 leader_election.cc:304] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:09:52.880903 30643 raft_consensus.cc:2749] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:09:52.911226 29923 catalog_manager.cc:5697] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 0 to 1, leader changed from <none> to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 1 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:52.914072 29923 catalog_manager.cc:5697] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 0 to 1, leader changed from <none> to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 1 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } }
I20260709 13:09:52.926651 29922 catalog_manager.cc:5697] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:52.928464 29922 catalog_manager.cc:5697] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:53.209106 30552 consensus_queue.cc:1048] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:53.240589 30646 consensus_queue.cc:1048] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:53.297160 30481 consensus_queue.cc:1048] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:53.305812 30629 consensus_queue.cc:1048] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:53.315843 30643 consensus_queue.cc:1048] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:53.325266 30643 consensus_queue.cc:1048] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:53.345052 30481 consensus_queue.cc:1048] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:53.346876 30481 consensus_queue.cc:1048] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:53.379091 30505 consensus_queue.cc:1048] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:53.424039 30632 consensus_queue.cc:1048] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:53.435585 30552 consensus_queue.cc:1048] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:53.455544 30552 consensus_queue.cc:1048] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:09:54.483692 28889 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:09:54.510206 30690 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:54.510226 30691 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:09:54.523890 30694 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:09:54.525097 28889 server_base.cc:1061] running on GCE node
I20260709 13:09:54.526412 28889 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:09:54.526762 28889 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:09:54.527019 28889 hybrid_clock.cc:648] HybridClock initialized: now 1783602594526999 us; error 0 us; skew 500 ppm
I20260709 13:09:54.527806 28889 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:09:54.626513 28889 webserver.cc:533] Webserver started at http://127.28.54.68:32831/ using document root <none> and password file <none>
I20260709 13:09:54.627277 28889 fs_manager.cc:362] Metadata directory not provided
I20260709 13:09:54.627741 28889 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:09:54.628199 28889 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:09:54.629854 28889 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-3-root/instance:
uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
format_stamp: "Formatted at 2026-07-09 13:09:54 on dist-test-slave-vpdx"
I20260709 13:09:54.639320 28889 fs_manager.cc:696] Time spent creating directory manager: real 0.009s	user 0.002s	sys 0.004s
I20260709 13:09:54.643915 30699 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:54.644801 28889 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.001s
I20260709 13:09:54.645131 28889 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-3-root
uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
format_stamp: "Formatted at 2026-07-09 13:09:54 on dist-test-slave-vpdx"
I20260709 13:09:54.645475 28889 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:09:54.678788 28889 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:09:54.680580 28889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:09:54.682830 28889 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:09:54.685649 28889 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:09:54.685912 28889 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:54.686167 28889 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:09:54.686332 28889 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:09:54.778158 28889 rpc_server.cc:307] RPC server started. Bound to: 127.28.54.68:46469
I20260709 13:09:54.779883 30761 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.54.68:46469 every 8 connection(s)
I20260709 13:09:54.789280 28889 auto_leader_rebalancer-test.cc:384] add a tserver: 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:09:54.808727 30762 heartbeater.cc:344] Connected to a master server at 127.28.54.126:45283
I20260709 13:09:54.809211 30762 heartbeater.cc:461] Registering TS with master...
I20260709 13:09:54.810144 30762 heartbeater.cc:507] Master 127.28.54.126:45283 requested a full tablet report, sending...
I20260709 13:09:54.813333 29923 ts_manager.cc:194] Registered new tserver with Master: 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:09:54.815150 29923 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39956
I20260709 13:09:55.738899 30176 consensus_queue.cc:237] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:09:55.745404 30100 raft_consensus.cc:1275] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:55.746814 30681 consensus_queue.cc:1048] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:55.753397 30026 raft_consensus.cc:1275] T 2ef07e332d8e432eaf9fc64b07cd74f0 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:55.754976 30681 consensus_queue.cc:1048] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:55.757730 30681 raft_consensus.cc:2955] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:09:55.758643 30103 raft_consensus.cc:2955] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:09:55.774538 29922 catalog_manager.cc:5697] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New cstate: current_term: 1 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
W20260709 13:09:55.780690 30142 consensus_peers.cc:597] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 -> Peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469): Couldn't send request to peer 6f3eb161e2194f6891f12e2cfcaaf73a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2ef07e332d8e432eaf9fc64b07cd74f0. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:55.817480 30762 heartbeater.cc:499] Master 127.28.54.126:45283 was elected leader, sending a full tablet report...
I20260709 13:09:55.869441 30026 raft_consensus.cc:2955] T 2ef07e332d8e432eaf9fc64b07cd74f0 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:09:55.902460 30027 consensus_queue.cc:237] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:09:55.920691 30176 raft_consensus.cc:1275] T 48d3196b43924d35bf72234ad500783e P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:55.924530 30781 consensus_queue.cc:1048] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:55.931216 30103 raft_consensus.cc:1275] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:55.933723 30782 consensus_queue.cc:1048] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 13:09:55.951006 29993 consensus_peers.cc:597] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 -> Peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469): Couldn't send request to peer 6f3eb161e2194f6891f12e2cfcaaf73a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 48d3196b43924d35bf72234ad500783e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:55.952562 30632 raft_consensus.cc:2955] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:09:55.968511 30176 consensus_queue.cc:237] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:09:55.973659 30103 raft_consensus.cc:2955] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:09:55.982391 29923 catalog_manager.cc:5697] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:56.000156 30177 raft_consensus.cc:2955] T 48d3196b43924d35bf72234ad500783e P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
W20260709 13:09:56.005033 30142 consensus_peers.cc:597] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 -> Peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469): Couldn't send request to peer 6f3eb161e2194f6891f12e2cfcaaf73a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 935127b9887c4175b5b65fd739c5cffe. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:56.006505 30103 raft_consensus.cc:1275] T 935127b9887c4175b5b65fd739c5cffe P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:56.008033 30780 consensus_queue.cc:1048] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:56.010515 30027 raft_consensus.cc:1275] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:56.045132 30689 consensus_queue.cc:1048] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:56.056979 30779 raft_consensus.cc:2955] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:09:56.058537 30103 raft_consensus.cc:2955] T 935127b9887c4175b5b65fd739c5cffe P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:09:56.078541 30177 consensus_queue.cc:237] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:09:56.091316 29926 catalog_manager.cc:5697] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New cstate: current_term: 1 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:56.094012 30100 raft_consensus.cc:1275] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:56.095417 30689 consensus_queue.cc:1048] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:56.096611 30026 raft_consensus.cc:1275] T 38e941311158407e8c0e2f4ca4b31d32 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:56.098423 30779 consensus_queue.cc:1048] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:56.099397 30142 consensus_peers.cc:597] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 -> Peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469): Couldn't send request to peer 6f3eb161e2194f6891f12e2cfcaaf73a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 38e941311158407e8c0e2f4ca4b31d32. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:56.108456 30027 raft_consensus.cc:2955] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:09:56.126188 30780 raft_consensus.cc:2955] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:09:56.130617 30022 raft_consensus.cc:2955] T 38e941311158407e8c0e2f4ca4b31d32 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:09:56.150650 29926 catalog_manager.cc:5697] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New cstate: current_term: 1 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:56.154042 30096 raft_consensus.cc:2955] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:09:56.209339 30793 ts_tablet_manager.cc:933] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a: Initiating tablet copy from peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:56.223591 30793 tablet_copy_client.cc:323] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Beginning tablet copy session from remote peer at address 127.28.54.67:45001
I20260709 13:09:56.242552 30187 tablet_copy_service.cc:140] P c99569d27a6f4c648eae7119fe3db124: Received BeginTabletCopySession request for tablet 2ef07e332d8e432eaf9fc64b07cd74f0 from peer 6f3eb161e2194f6891f12e2cfcaaf73a ({username='slave'} at 127.0.0.1:54540)
I20260709 13:09:56.243172 30187 tablet_copy_service.cc:161] P c99569d27a6f4c648eae7119fe3db124: Beginning new tablet copy session on tablet 2ef07e332d8e432eaf9fc64b07cd74f0 from peer 6f3eb161e2194f6891f12e2cfcaaf73a at {username='slave'} at 127.0.0.1:54540: session id = 6f3eb161e2194f6891f12e2cfcaaf73a-2ef07e332d8e432eaf9fc64b07cd74f0
I20260709 13:09:56.249737 30187 tablet_copy_source_session.cc:215] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:56.254086 30793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2ef07e332d8e432eaf9fc64b07cd74f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:56.271453 30793 tablet_copy_client.cc:806] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:56.272192 30793 tablet_copy_client.cc:670] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:56.282416 30793 tablet_copy_client.cc:538] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:56.293958 30793 tablet_bootstrap.cc:492] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap starting.
I20260709 13:09:56.339507 30793 tablet_bootstrap.cc:492] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:56.340428 30793 tablet_bootstrap.cc:492] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap complete.
I20260709 13:09:56.341055 30793 ts_tablet_manager.cc:1403] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent bootstrapping tablet: real 0.047s	user 0.017s	sys 0.005s
I20260709 13:09:56.343859 30793 raft_consensus.cc:359] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:09:56.344696 30793 raft_consensus.cc:740] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Initialized, Role: LEARNER
I20260709 13:09:56.345312 30793 consensus_queue.cc:260] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:09:56.358464 30793 ts_tablet_manager.cc:1434] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.001s
I20260709 13:09:56.360457 30187 tablet_copy_service.cc:342] P c99569d27a6f4c648eae7119fe3db124: Request end of tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-2ef07e332d8e432eaf9fc64b07cd74f0 received from {username='slave'} at 127.0.0.1:54540
I20260709 13:09:56.360944 30187 tablet_copy_service.cc:434] P c99569d27a6f4c648eae7119fe3db124: ending tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-2ef07e332d8e432eaf9fc64b07cd74f0 on tablet 2ef07e332d8e432eaf9fc64b07cd74f0 with peer 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:09:56.435607 30793 ts_tablet_manager.cc:933] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a: Initiating tablet copy from peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451)
I20260709 13:09:56.439606 30793 tablet_copy_client.cc:323] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Beginning tablet copy session from remote peer at address 127.28.54.65:34451
I20260709 13:09:56.479460 30038 tablet_copy_service.cc:140] P b2cea0098c1040f69755ea4d3dab7fc4: Received BeginTabletCopySession request for tablet 48d3196b43924d35bf72234ad500783e from peer 6f3eb161e2194f6891f12e2cfcaaf73a ({username='slave'} at 127.0.0.1:52098)
I20260709 13:09:56.480034 30038 tablet_copy_service.cc:161] P b2cea0098c1040f69755ea4d3dab7fc4: Beginning new tablet copy session on tablet 48d3196b43924d35bf72234ad500783e from peer 6f3eb161e2194f6891f12e2cfcaaf73a at {username='slave'} at 127.0.0.1:52098: session id = 6f3eb161e2194f6891f12e2cfcaaf73a-48d3196b43924d35bf72234ad500783e
I20260709 13:09:56.493958 30800 ts_tablet_manager.cc:933] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a: Initiating tablet copy from peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:56.495060 30038 tablet_copy_source_session.cc:215] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:56.498574 30793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 48d3196b43924d35bf72234ad500783e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:56.502206 30800 tablet_copy_client.cc:323] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Beginning tablet copy session from remote peer at address 127.28.54.67:45001
I20260709 13:09:56.504009 30187 tablet_copy_service.cc:140] P c99569d27a6f4c648eae7119fe3db124: Received BeginTabletCopySession request for tablet 935127b9887c4175b5b65fd739c5cffe from peer 6f3eb161e2194f6891f12e2cfcaaf73a ({username='slave'} at 127.0.0.1:54540)
I20260709 13:09:56.504516 30187 tablet_copy_service.cc:161] P c99569d27a6f4c648eae7119fe3db124: Beginning new tablet copy session on tablet 935127b9887c4175b5b65fd739c5cffe from peer 6f3eb161e2194f6891f12e2cfcaaf73a at {username='slave'} at 127.0.0.1:54540: session id = 6f3eb161e2194f6891f12e2cfcaaf73a-935127b9887c4175b5b65fd739c5cffe
I20260709 13:09:56.512352 30187 tablet_copy_source_session.cc:215] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:56.524850 30800 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 935127b9887c4175b5b65fd739c5cffe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:56.537467 30793 tablet_copy_client.cc:806] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:56.538064 30793 tablet_copy_client.cc:670] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:56.543041 30793 tablet_copy_client.cc:538] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:56.548538 30800 tablet_copy_client.cc:806] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:56.549216 30800 tablet_copy_client.cc:670] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:56.553077 30800 tablet_copy_client.cc:538] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:56.555279 30793 tablet_bootstrap.cc:492] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap starting.
I20260709 13:09:56.570590 30800 tablet_bootstrap.cc:492] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap starting.
I20260709 13:09:56.605602 30800 tablet_bootstrap.cc:492] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:56.606560 30800 tablet_bootstrap.cc:492] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap complete.
I20260709 13:09:56.607348 30800 ts_tablet_manager.cc:1403] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.010s
I20260709 13:09:56.610155 30793 tablet_bootstrap.cc:492] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:56.610205 30800 raft_consensus.cc:359] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:09:56.611541 30793 tablet_bootstrap.cc:492] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap complete.
I20260709 13:09:56.611802 30800 raft_consensus.cc:740] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Initialized, Role: LEARNER
I20260709 13:09:56.612248 30793 ts_tablet_manager.cc:1403] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent bootstrapping tablet: real 0.057s	user 0.018s	sys 0.007s
I20260709 13:09:56.612589 30800 consensus_queue.cc:260] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:09:56.615108 30793 raft_consensus.cc:359] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:09:56.615859 30793 raft_consensus.cc:740] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Initialized, Role: LEARNER
I20260709 13:09:56.616447 30793 consensus_queue.cc:260] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:09:56.617668 30800 ts_tablet_manager.cc:1434] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260709 13:09:56.619642 30187 tablet_copy_service.cc:342] P c99569d27a6f4c648eae7119fe3db124: Request end of tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-935127b9887c4175b5b65fd739c5cffe received from {username='slave'} at 127.0.0.1:54540
I20260709 13:09:56.620040 30187 tablet_copy_service.cc:434] P c99569d27a6f4c648eae7119fe3db124: ending tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-935127b9887c4175b5b65fd739c5cffe on tablet 935127b9887c4175b5b65fd739c5cffe with peer 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:09:56.631685 30793 ts_tablet_manager.cc:1434] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.001s
I20260709 13:09:56.634368 30038 tablet_copy_service.cc:342] P b2cea0098c1040f69755ea4d3dab7fc4: Request end of tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-48d3196b43924d35bf72234ad500783e received from {username='slave'} at 127.0.0.1:52098
I20260709 13:09:56.634793 30038 tablet_copy_service.cc:434] P b2cea0098c1040f69755ea4d3dab7fc4: ending tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-48d3196b43924d35bf72234ad500783e on tablet 48d3196b43924d35bf72234ad500783e with peer 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:09:56.700448 30793 ts_tablet_manager.cc:933] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a: Initiating tablet copy from peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:09:56.735927 30737 raft_consensus.cc:1217] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:56.773867 30793 tablet_copy_client.cc:323] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Beginning tablet copy session from remote peer at address 127.28.54.67:45001
I20260709 13:09:56.775563 30187 tablet_copy_service.cc:140] P c99569d27a6f4c648eae7119fe3db124: Received BeginTabletCopySession request for tablet 38e941311158407e8c0e2f4ca4b31d32 from peer 6f3eb161e2194f6891f12e2cfcaaf73a ({username='slave'} at 127.0.0.1:54540)
I20260709 13:09:56.776075 30187 tablet_copy_service.cc:161] P c99569d27a6f4c648eae7119fe3db124: Beginning new tablet copy session on tablet 38e941311158407e8c0e2f4ca4b31d32 from peer 6f3eb161e2194f6891f12e2cfcaaf73a at {username='slave'} at 127.0.0.1:54540: session id = 6f3eb161e2194f6891f12e2cfcaaf73a-38e941311158407e8c0e2f4ca4b31d32
I20260709 13:09:56.785629 30187 tablet_copy_source_session.cc:215] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:09:56.790738 30793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38e941311158407e8c0e2f4ca4b31d32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:09:56.809484 30793 tablet_copy_client.cc:806] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 0 data blocks...
I20260709 13:09:56.809978 30793 tablet_copy_client.cc:670] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:09:56.813844 30793 tablet_copy_client.cc:538] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:09:56.822305 30793 tablet_bootstrap.cc:492] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap starting.
I20260709 13:09:56.841745 30793 tablet_bootstrap.cc:492] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:09:56.842684 30793 tablet_bootstrap.cc:492] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap complete.
I20260709 13:09:56.843690 30793 ts_tablet_manager.cc:1403] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent bootstrapping tablet: real 0.022s	user 0.011s	sys 0.007s
I20260709 13:09:56.846076 30793 raft_consensus.cc:359] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:09:56.846808 30793 raft_consensus.cc:740] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Initialized, Role: LEARNER
I20260709 13:09:56.847416 30793 consensus_queue.cc:260] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:09:56.849432 30793 ts_tablet_manager.cc:1434] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:09:56.851935 30187 tablet_copy_service.cc:342] P c99569d27a6f4c648eae7119fe3db124: Request end of tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-38e941311158407e8c0e2f4ca4b31d32 received from {username='slave'} at 127.0.0.1:54540
I20260709 13:09:56.852339 30187 tablet_copy_service.cc:434] P c99569d27a6f4c648eae7119fe3db124: ending tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-38e941311158407e8c0e2f4ca4b31d32 on tablet 38e941311158407e8c0e2f4ca4b31d32 with peer 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:09:57.049978 30737 raft_consensus.cc:1217] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:57.101280 30737 raft_consensus.cc:1217] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:57.138784 30737 raft_consensus.cc:1217] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:09:57.140251 30689 raft_consensus.cc:1064] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124: attempting to promote NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a to VOTER
I20260709 13:09:57.158516 30689 consensus_queue.cc:237] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:09:57.181005 30737 raft_consensus.cc:1275] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:57.190404 30804 consensus_queue.cc:1048] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:57.194585 30103 raft_consensus.cc:1275] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:57.196535 30804 consensus_queue.cc:1048] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:57.220839 30025 raft_consensus.cc:1275] T 2ef07e332d8e432eaf9fc64b07cd74f0 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:57.226099 30779 raft_consensus.cc:2955] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:09:57.227475 30096 raft_consensus.cc:2955] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:09:57.242892 30804 consensus_queue.cc:1048] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:57.244273 29926 catalog_manager.cc:5697] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 reported cstate change: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:09:57.249791 30737 raft_consensus.cc:2955] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:09:57.259009 30025 raft_consensus.cc:2955] T 2ef07e332d8e432eaf9fc64b07cd74f0 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:09:57.335392 30171 consensus_queue.cc:237] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:09:57.342563 30737 raft_consensus.cc:1275] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:57.343647 30103 raft_consensus.cc:1275] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:57.343974 30813 consensus_queue.cc:1048] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:57.345415 30779 consensus_queue.cc:1048] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:57.352097 30779 raft_consensus.cc:2955] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:09:57.358847 30096 raft_consensus.cc:2955] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:09:57.363142 30737 raft_consensus.cc:2955] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:09:57.378458 29912 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2ef07e332d8e432eaf9fc64b07cd74f0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:57.375995 29923 catalog_manager.cc:5697] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 reported cstate change: config changed from index 3 to 4, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New cstate: current_term: 1 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:09:57.408771 30009 tablet_service.cc:1558] Processing DeleteTablet for tablet 2ef07e332d8e432eaf9fc64b07cd74f0 with delete_type TABLET_DATA_TOMBSTONED (TS b2cea0098c1040f69755ea4d3dab7fc4 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54192
I20260709 13:09:57.422377 30819 tablet_replica.cc:333] T 2ef07e332d8e432eaf9fc64b07cd74f0 P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:09:57.423182 30819 raft_consensus.cc:2243] T 2ef07e332d8e432eaf9fc64b07cd74f0 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.423743 30819 raft_consensus.cc:2272] T 2ef07e332d8e432eaf9fc64b07cd74f0 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.426334 30819 ts_tablet_manager.cc:1916] T 2ef07e332d8e432eaf9fc64b07cd74f0 P b2cea0098c1040f69755ea4d3dab7fc4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:57.439890 30819 ts_tablet_manager.cc:1929] T 2ef07e332d8e432eaf9fc64b07cd74f0 P b2cea0098c1040f69755ea4d3dab7fc4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:57.442322 30819 log.cc:1199] T 2ef07e332d8e432eaf9fc64b07cd74f0 P b2cea0098c1040f69755ea4d3dab7fc4: Deleting WAL directory at /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-0-root/wals/2ef07e332d8e432eaf9fc64b07cd74f0
I20260709 13:09:57.444324 29910 catalog_manager.cc:5028] TS b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): tablet 2ef07e332d8e432eaf9fc64b07cd74f0 (table test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]) successfully deleted
I20260709 13:09:57.538311 30779 raft_consensus.cc:1064] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124: attempting to promote NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a to VOTER
I20260709 13:09:57.546656 30781 raft_consensus.cc:1064] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4: attempting to promote NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a to VOTER
I20260709 13:09:57.552053 30779 consensus_queue.cc:237] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:09:57.549371 30781 consensus_queue.cc:237] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:09:57.553936 30813 raft_consensus.cc:1064] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124: attempting to promote NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a to VOTER
I20260709 13:09:57.556322 30813 consensus_queue.cc:237] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:09:57.603427 30171 raft_consensus.cc:1275] T 48d3196b43924d35bf72234ad500783e P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:57.605189 30737 raft_consensus.cc:1275] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:57.606129 30404 consensus_queue.cc:1048] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:57.607848 30781 consensus_queue.cc:1048] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:57.628264 30809 raft_consensus.cc:2955] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:09:57.647965 29925 catalog_manager.cc:5697] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:09:57.649379 30096 raft_consensus.cc:1275] T 935127b9887c4175b5b65fd739c5cffe P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:57.662261 30096 raft_consensus.cc:1275] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:57.663578 30813 consensus_queue.cc:1048] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:09:57.657544 30737 raft_consensus.cc:1275] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:57.671337 30103 raft_consensus.cc:1275] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:57.671890 30736 raft_consensus.cc:1275] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:57.674486 30689 consensus_queue.cc:1048] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:57.678831 30780 consensus_queue.cc:1048] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:57.680576 30780 consensus_queue.cc:1048] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:57.676561 30171 raft_consensus.cc:2955] T 48d3196b43924d35bf72234ad500783e P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:09:57.679036 30737 raft_consensus.cc:2955] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:09:57.722091 30782 consensus_queue.cc:1048] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:57.747782 30804 raft_consensus.cc:2955] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:09:57.758778 30736 raft_consensus.cc:2955] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:09:57.761301 30098 raft_consensus.cc:2955] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:09:57.772297 29925 catalog_manager.cc:5697] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
W20260709 13:09:57.786095 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 67297.8us
I20260709 13:09:57.789804 30171 consensus_queue.cc:237] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:09:57.799201 30736 raft_consensus.cc:1275] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:57.800978 30780 consensus_queue.cc:1048] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:57.807677 30830 raft_consensus.cc:2955] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:09:57.816910 30736 raft_consensus.cc:2955] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:09:57.835235 30103 raft_consensus.cc:1275] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:57.838354 30780 consensus_queue.cc:1048] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:57.842953 30101 raft_consensus.cc:2955] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:09:57.847563 29912 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 38e941311158407e8c0e2f4ca4b31d32 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:57.852675 30022 raft_consensus.cc:1275] T 38e941311158407e8c0e2f4ca4b31d32 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:57.853653 30024 raft_consensus.cc:1275] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:09:57.860195 30830 raft_consensus.cc:2955] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:09:57.862429 30736 raft_consensus.cc:2955] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:09:57.862952 29925 catalog_manager.cc:5697] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: config changed from index 3 to 4, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New cstate: current_term: 1 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:09:57.872946 30098 raft_consensus.cc:2955] T 935127b9887c4175b5b65fd739c5cffe P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:09:57.882277 30830 consensus_queue.cc:1048] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:09:57.909543 29926 catalog_manager.cc:5697] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:09:57.911873 30009 tablet_service.cc:1558] Processing DeleteTablet for tablet 38e941311158407e8c0e2f4ca4b31d32 with delete_type TABLET_DATA_TOMBSTONED (TS b2cea0098c1040f69755ea4d3dab7fc4 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54192
I20260709 13:09:57.912767 30819 tablet_replica.cc:333] T 38e941311158407e8c0e2f4ca4b31d32 P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:09:57.913937 30819 raft_consensus.cc:2243] T 38e941311158407e8c0e2f4ca4b31d32 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:57.914600 30819 raft_consensus.cc:2272] T 38e941311158407e8c0e2f4ca4b31d32 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:57.917520 30819 ts_tablet_manager.cc:1916] T 38e941311158407e8c0e2f4ca4b31d32 P b2cea0098c1040f69755ea4d3dab7fc4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:57.923262 30027 raft_consensus.cc:2955] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:09:57.958159 30819 ts_tablet_manager.cc:1929] T 38e941311158407e8c0e2f4ca4b31d32 P b2cea0098c1040f69755ea4d3dab7fc4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.2
I20260709 13:09:57.958709 30819 log.cc:1199] T 38e941311158407e8c0e2f4ca4b31d32 P b2cea0098c1040f69755ea4d3dab7fc4: Deleting WAL directory at /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-0-root/wals/38e941311158407e8c0e2f4ca4b31d32
I20260709 13:09:57.964375 29910 catalog_manager.cc:5028] TS b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): tablet 38e941311158407e8c0e2f4ca4b31d32 (table test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]) successfully deleted
I20260709 13:09:57.966758 30102 raft_consensus.cc:2955] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:09:58.248453 30026 consensus_queue.cc:237] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:09:58.253571 30102 raft_consensus.cc:1275] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:58.253664 30736 raft_consensus.cc:1275] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:58.255028 30782 consensus_queue.cc:1048] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:58.256466 30404 consensus_queue.cc:1048] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:58.262001 30782 raft_consensus.cc:2955] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:09:58.263985 30736 raft_consensus.cc:2955] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:09:58.279425 29926 catalog_manager.cc:5697] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: config changed from index 3 to 4, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:58.284201 29910 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 48d3196b43924d35bf72234ad500783e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:58.292243 30164 tablet_service.cc:1558] Processing DeleteTablet for tablet 48d3196b43924d35bf72234ad500783e with delete_type TABLET_DATA_TOMBSTONED (TS c99569d27a6f4c648eae7119fe3db124 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43828
I20260709 13:09:58.291020 30102 raft_consensus.cc:2955] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:09:58.315536 30838 tablet_replica.cc:333] T 48d3196b43924d35bf72234ad500783e P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:09:58.317993 30838 raft_consensus.cc:2243] T 48d3196b43924d35bf72234ad500783e P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:58.318725 30838 raft_consensus.cc:2272] T 48d3196b43924d35bf72234ad500783e P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:58.321956 30838 ts_tablet_manager.cc:1916] T 48d3196b43924d35bf72234ad500783e P c99569d27a6f4c648eae7119fe3db124: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:58.335872 30838 ts_tablet_manager.cc:1929] T 48d3196b43924d35bf72234ad500783e P c99569d27a6f4c648eae7119fe3db124: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:58.336184 30838 log.cc:1199] T 48d3196b43924d35bf72234ad500783e P c99569d27a6f4c648eae7119fe3db124: Deleting WAL directory at /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-2-root/wals/48d3196b43924d35bf72234ad500783e
I20260709 13:09:58.337689 29912 catalog_manager.cc:5028] TS c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): tablet 48d3196b43924d35bf72234ad500783e (table test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]) successfully deleted
I20260709 13:09:58.480398 30177 consensus_queue.cc:237] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:09:58.486436 30736 raft_consensus.cc:1275] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:58.488299 30026 raft_consensus.cc:1275] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:09:58.489152 30780 consensus_queue.cc:1048] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:58.490091 30804 consensus_queue.cc:1048] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:09:58.496963 30830 raft_consensus.cc:2955] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:09:58.499186 30735 raft_consensus.cc:2955] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:09:58.510454 29912 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 935127b9887c4175b5b65fd739c5cffe with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:09:58.521828 29926 catalog_manager.cc:5697] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 reported cstate change: config changed from index 3 to 4, VOTER 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) evicted. New cstate: current_term: 1 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:09:58.521939 30026 raft_consensus.cc:2955] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:09:58.538955 30091 tablet_service.cc:1558] Processing DeleteTablet for tablet 935127b9887c4175b5b65fd739c5cffe with delete_type TABLET_DATA_TOMBSTONED (TS 5ec73dc157ed476ca903a7d596271719 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33984
I20260709 13:09:58.540657 30839 tablet_replica.cc:333] T 935127b9887c4175b5b65fd739c5cffe P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:09:58.541720 30839 raft_consensus.cc:2243] T 935127b9887c4175b5b65fd739c5cffe P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:09:58.542557 30839 raft_consensus.cc:2272] T 935127b9887c4175b5b65fd739c5cffe P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:09:58.549153 30839 ts_tablet_manager.cc:1916] T 935127b9887c4175b5b65fd739c5cffe P 5ec73dc157ed476ca903a7d596271719: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:09:58.561439 30839 ts_tablet_manager.cc:1929] T 935127b9887c4175b5b65fd739c5cffe P 5ec73dc157ed476ca903a7d596271719: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:09:58.561720 30839 log.cc:1199] T 935127b9887c4175b5b65fd739c5cffe P 5ec73dc157ed476ca903a7d596271719: Deleting WAL directory at /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-1-root/wals/935127b9887c4175b5b65fd739c5cffe
I20260709 13:09:58.563195 29913 catalog_manager.cc:5028] TS 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): tablet 935127b9887c4175b5b65fd739c5cffe (table test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]) successfully deleted
I20260709 13:09:59.632459 30102 consensus_queue.cc:237] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:09:59.639619 30177 raft_consensus.cc:1275] T c41a6d79ca9c459eb4b0b41302fb76a9 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:59.641111 30024 raft_consensus.cc:1275] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:59.641420 30806 consensus_queue.cc:1048] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:59.642691 30840 consensus_queue.cc:1048] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:59.652752 30840 raft_consensus.cc:2955] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:09:59.654163 30171 raft_consensus.cc:2955] T c41a6d79ca9c459eb4b0b41302fb76a9 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:09:59.655184 30024 raft_consensus.cc:2955] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
W20260709 13:09:59.659492 30068 consensus_peers.cc:597] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 -> Peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469): Couldn't send request to peer 6f3eb161e2194f6891f12e2cfcaaf73a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c41a6d79ca9c459eb4b0b41302fb76a9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:59.669538 30027 consensus_queue.cc:237] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:09:59.678377 29926 catalog_manager.cc:5697] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
W20260709 13:09:59.685497 29993 consensus_peers.cc:597] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 -> Peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469): Couldn't send request to peer 6f3eb161e2194f6891f12e2cfcaaf73a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 817d4a23671d4a1d9c3b9db3b4e77b0f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:59.684743 30171 raft_consensus.cc:1275] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:59.686414 30102 raft_consensus.cc:1275] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:59.687287 30843 consensus_queue.cc:1048] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:59.688328 30827 consensus_queue.cc:1048] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:09:59.707808 30827 raft_consensus.cc:2955] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:09:59.709844 30102 raft_consensus.cc:2955] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:09:59.713955 30171 raft_consensus.cc:2955] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:09:59.738473 30102 consensus_queue.cc:237] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:09:59.749847 29925 catalog_manager.cc:5697] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
W20260709 13:09:59.766387 30068 consensus_peers.cc:597] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 -> Peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469): Couldn't send request to peer 6f3eb161e2194f6891f12e2cfcaaf73a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5c8539fb97344b07aed5af91eaf0806f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:59.767380 30176 raft_consensus.cc:1275] T 5c8539fb97344b07aed5af91eaf0806f P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:59.768640 30027 raft_consensus.cc:1275] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:59.768661 30806 consensus_queue.cc:1048] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:59.769887 30844 consensus_queue.cc:1048] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:59.778745 30844 raft_consensus.cc:2955] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:09:59.780397 30027 raft_consensus.cc:2955] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:09:59.785053 30176 raft_consensus.cc:2955] T 5c8539fb97344b07aed5af91eaf0806f P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:09:59.797279 30026 consensus_queue.cc:237] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:09:59.797330 29926 catalog_manager.cc:5697] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:09:59.808102 30102 raft_consensus.cc:1275] T f5616428acc64e24945a779e1aee597f P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:59.808305 30176 raft_consensus.cc:1275] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:09:59.810699 30843 consensus_queue.cc:1048] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:09:59.812309 30782 consensus_queue.cc:1048] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:09:59.813184 29993 consensus_peers.cc:597] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 -> Peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469): Couldn't send request to peer 6f3eb161e2194f6891f12e2cfcaaf73a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f5616428acc64e24945a779e1aee597f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:09:59.818689 30843 raft_consensus.cc:2955] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:09:59.820499 30102 raft_consensus.cc:2955] T f5616428acc64e24945a779e1aee597f P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:09:59.824283 30171 raft_consensus.cc:2955] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:09:59.840479 29923 catalog_manager.cc:5697] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:00.062809 30866 ts_tablet_manager.cc:933] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a: Initiating tablet copy from peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:00.064793 30866 tablet_copy_client.cc:323] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Beginning tablet copy session from remote peer at address 127.28.54.66:43821
I20260709 13:10:00.079246 30113 tablet_copy_service.cc:140] P 5ec73dc157ed476ca903a7d596271719: Received BeginTabletCopySession request for tablet c41a6d79ca9c459eb4b0b41302fb76a9 from peer 6f3eb161e2194f6891f12e2cfcaaf73a ({username='slave'} at 127.0.0.1:48558)
I20260709 13:10:00.079878 30113 tablet_copy_service.cc:161] P 5ec73dc157ed476ca903a7d596271719: Beginning new tablet copy session on tablet c41a6d79ca9c459eb4b0b41302fb76a9 from peer 6f3eb161e2194f6891f12e2cfcaaf73a at {username='slave'} at 127.0.0.1:48558: session id = 6f3eb161e2194f6891f12e2cfcaaf73a-c41a6d79ca9c459eb4b0b41302fb76a9
I20260709 13:10:00.087839 30113 tablet_copy_source_session.cc:215] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:00.091341 30866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c41a6d79ca9c459eb4b0b41302fb76a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:00.108949 30866 tablet_copy_client.cc:806] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:00.109570 30866 tablet_copy_client.cc:670] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:00.115504 30866 tablet_copy_client.cc:538] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:00.124743 30866 tablet_bootstrap.cc:492] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap starting.
I20260709 13:10:00.145566 30866 tablet_bootstrap.cc:492] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:00.146591 30866 tablet_bootstrap.cc:492] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap complete.
I20260709 13:10:00.147293 30866 ts_tablet_manager.cc:1403] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent bootstrapping tablet: real 0.023s	user 0.019s	sys 0.004s
I20260709 13:10:00.151029 30866 raft_consensus.cc:359] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:00.151921 30866 raft_consensus.cc:740] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Initialized, Role: LEARNER
I20260709 13:10:00.152583 30866 consensus_queue.cc:260] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:00.156389 30866 ts_tablet_manager.cc:1434] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:10:00.158113 30113 tablet_copy_service.cc:342] P 5ec73dc157ed476ca903a7d596271719: Request end of tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-c41a6d79ca9c459eb4b0b41302fb76a9 received from {username='slave'} at 127.0.0.1:48558
I20260709 13:10:00.158577 30113 tablet_copy_service.cc:434] P 5ec73dc157ed476ca903a7d596271719: ending tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-c41a6d79ca9c459eb4b0b41302fb76a9 on tablet c41a6d79ca9c459eb4b0b41302fb76a9 with peer 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:00.174738 30866 ts_tablet_manager.cc:933] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a: Initiating tablet copy from peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451)
I20260709 13:10:00.176141 30866 tablet_copy_client.cc:323] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Beginning tablet copy session from remote peer at address 127.28.54.65:34451
I20260709 13:10:00.177919 30038 tablet_copy_service.cc:140] P b2cea0098c1040f69755ea4d3dab7fc4: Received BeginTabletCopySession request for tablet 817d4a23671d4a1d9c3b9db3b4e77b0f from peer 6f3eb161e2194f6891f12e2cfcaaf73a ({username='slave'} at 127.0.0.1:52098)
I20260709 13:10:00.178350 30038 tablet_copy_service.cc:161] P b2cea0098c1040f69755ea4d3dab7fc4: Beginning new tablet copy session on tablet 817d4a23671d4a1d9c3b9db3b4e77b0f from peer 6f3eb161e2194f6891f12e2cfcaaf73a at {username='slave'} at 127.0.0.1:52098: session id = 6f3eb161e2194f6891f12e2cfcaaf73a-817d4a23671d4a1d9c3b9db3b4e77b0f
I20260709 13:10:00.184147 30038 tablet_copy_source_session.cc:215] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:00.188031 30866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 817d4a23671d4a1d9c3b9db3b4e77b0f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:00.203203 30866 tablet_copy_client.cc:806] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:00.203732 30866 tablet_copy_client.cc:670] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:00.209203 30866 tablet_copy_client.cc:538] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:00.218199 30866 tablet_bootstrap.cc:492] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap starting.
I20260709 13:10:00.240010 30866 tablet_bootstrap.cc:492] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:00.240914 30866 tablet_bootstrap.cc:492] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap complete.
I20260709 13:10:00.241577 30866 ts_tablet_manager.cc:1403] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.000s
I20260709 13:10:00.244390 30866 raft_consensus.cc:359] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:00.245404 30866 raft_consensus.cc:740] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Initialized, Role: LEARNER
I20260709 13:10:00.246311 30866 consensus_queue.cc:260] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:00.300122 30866 ts_tablet_manager.cc:1434] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent starting tablet: real 0.058s	user 0.006s	sys 0.000s
I20260709 13:10:00.302471 30038 tablet_copy_service.cc:342] P b2cea0098c1040f69755ea4d3dab7fc4: Request end of tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-817d4a23671d4a1d9c3b9db3b4e77b0f received from {username='slave'} at 127.0.0.1:52098
I20260709 13:10:00.302959 30038 tablet_copy_service.cc:434] P b2cea0098c1040f69755ea4d3dab7fc4: ending tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-817d4a23671d4a1d9c3b9db3b4e77b0f on tablet 817d4a23671d4a1d9c3b9db3b4e77b0f with peer 6f3eb161e2194f6891f12e2cfcaaf73a
W20260709 13:10:00.333873 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 85335us
I20260709 13:10:00.366389 30866 ts_tablet_manager.cc:933] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a: Initiating tablet copy from peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:00.371557 30866 tablet_copy_client.cc:323] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Beginning tablet copy session from remote peer at address 127.28.54.66:43821
I20260709 13:10:00.379787 30113 tablet_copy_service.cc:140] P 5ec73dc157ed476ca903a7d596271719: Received BeginTabletCopySession request for tablet 5c8539fb97344b07aed5af91eaf0806f from peer 6f3eb161e2194f6891f12e2cfcaaf73a ({username='slave'} at 127.0.0.1:48558)
I20260709 13:10:00.380344 30113 tablet_copy_service.cc:161] P 5ec73dc157ed476ca903a7d596271719: Beginning new tablet copy session on tablet 5c8539fb97344b07aed5af91eaf0806f from peer 6f3eb161e2194f6891f12e2cfcaaf73a at {username='slave'} at 127.0.0.1:48558: session id = 6f3eb161e2194f6891f12e2cfcaaf73a-5c8539fb97344b07aed5af91eaf0806f
I20260709 13:10:00.386706 30113 tablet_copy_source_session.cc:215] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:00.389204 30866 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c8539fb97344b07aed5af91eaf0806f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:00.406213 30880 ts_tablet_manager.cc:933] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a: Initiating tablet copy from peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451)
I20260709 13:10:00.410014 30866 tablet_copy_client.cc:806] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:00.410555 30866 tablet_copy_client.cc:670] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:00.411527 30880 tablet_copy_client.cc:323] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Beginning tablet copy session from remote peer at address 127.28.54.65:34451
I20260709 13:10:00.414345 30038 tablet_copy_service.cc:140] P b2cea0098c1040f69755ea4d3dab7fc4: Received BeginTabletCopySession request for tablet f5616428acc64e24945a779e1aee597f from peer 6f3eb161e2194f6891f12e2cfcaaf73a ({username='slave'} at 127.0.0.1:52098)
I20260709 13:10:00.414880 30038 tablet_copy_service.cc:161] P b2cea0098c1040f69755ea4d3dab7fc4: Beginning new tablet copy session on tablet f5616428acc64e24945a779e1aee597f from peer 6f3eb161e2194f6891f12e2cfcaaf73a at {username='slave'} at 127.0.0.1:52098: session id = 6f3eb161e2194f6891f12e2cfcaaf73a-f5616428acc64e24945a779e1aee597f
I20260709 13:10:00.415400 30866 tablet_copy_client.cc:538] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:00.424401 30038 tablet_copy_source_session.cc:215] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:00.426811 30866 tablet_bootstrap.cc:492] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap starting.
I20260709 13:10:00.427495 30880 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5616428acc64e24945a779e1aee597f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:00.444099 30880 tablet_copy_client.cc:806] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:00.444645 30880 tablet_copy_client.cc:670] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:00.448660 30880 tablet_copy_client.cc:538] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:00.449345 30866 tablet_bootstrap.cc:492] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:00.450284 30866 tablet_bootstrap.cc:492] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap complete.
I20260709 13:10:00.450943 30866 ts_tablet_manager.cc:1403] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.000s
I20260709 13:10:00.453691 30866 raft_consensus.cc:359] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:00.454670 30866 raft_consensus.cc:740] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Initialized, Role: LEARNER
I20260709 13:10:00.455296 30866 consensus_queue.cc:260] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:00.459079 30880 tablet_bootstrap.cc:492] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap starting.
I20260709 13:10:00.459407 30866 ts_tablet_manager.cc:1434] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:10:00.460934 30113 tablet_copy_service.cc:342] P 5ec73dc157ed476ca903a7d596271719: Request end of tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-5c8539fb97344b07aed5af91eaf0806f received from {username='slave'} at 127.0.0.1:48558
I20260709 13:10:00.461352 30113 tablet_copy_service.cc:434] P 5ec73dc157ed476ca903a7d596271719: ending tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-5c8539fb97344b07aed5af91eaf0806f on tablet 5c8539fb97344b07aed5af91eaf0806f with peer 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:00.483635 30880 tablet_bootstrap.cc:492] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:00.484552 30880 tablet_bootstrap.cc:492] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap complete.
I20260709 13:10:00.485186 30880 ts_tablet_manager.cc:1403] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent bootstrapping tablet: real 0.026s	user 0.017s	sys 0.003s
I20260709 13:10:00.487816 30880 raft_consensus.cc:359] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:00.488541 30880 raft_consensus.cc:740] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Initialized, Role: LEARNER
I20260709 13:10:00.489089 30880 consensus_queue.cc:260] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:00.491031 30880 ts_tablet_manager.cc:1434] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:10:00.492566 30038 tablet_copy_service.cc:342] P b2cea0098c1040f69755ea4d3dab7fc4: Request end of tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-f5616428acc64e24945a779e1aee597f received from {username='slave'} at 127.0.0.1:52098
I20260709 13:10:00.492993 30038 tablet_copy_service.cc:434] P b2cea0098c1040f69755ea4d3dab7fc4: ending tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-f5616428acc64e24945a779e1aee597f on tablet f5616428acc64e24945a779e1aee597f with peer 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:00.576021 30735 raft_consensus.cc:1217] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:00.683090 30735 raft_consensus.cc:1217] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:00.865221 30735 raft_consensus.cc:1217] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:00.888058 30735 raft_consensus.cc:1217] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:01.115191 30844 raft_consensus.cc:1064] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719: attempting to promote NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a to VOTER
I20260709 13:10:01.117092 30884 raft_consensus.cc:1064] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4: attempting to promote NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a to VOTER
I20260709 13:10:01.117895 30844 consensus_queue.cc:237] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:01.119692 30884 consensus_queue.cc:237] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:01.125943 30171 raft_consensus.cc:1275] T c41a6d79ca9c459eb4b0b41302fb76a9 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:01.126600 30735 raft_consensus.cc:1275] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:01.127907 30026 raft_consensus.cc:1275] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:01.128901 30876 consensus_queue.cc:1048] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:01.129863 30877 consensus_queue.cc:1048] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:01.132678 30844 consensus_queue.cc:1048] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:01.161705 30736 raft_consensus.cc:1275] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:01.161892 30102 raft_consensus.cc:1275] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:01.162235 30173 raft_consensus.cc:1275] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:01.163546 30843 consensus_queue.cc:1048] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:01.165683 30827 consensus_queue.cc:1048] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:01.166968 30876 raft_consensus.cc:2955] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:01.171697 30736 raft_consensus.cc:2955] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:01.187707 29926 catalog_manager.cc:5697] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:01.190994 30827 consensus_queue.cc:1048] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:01.202358 30173 raft_consensus.cc:2955] T c41a6d79ca9c459eb4b0b41302fb76a9 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:01.205879 30026 raft_consensus.cc:2955] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:01.226152 30827 raft_consensus.cc:2955] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:01.228474 30735 raft_consensus.cc:2955] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:01.238687 30173 raft_consensus.cc:2955] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:01.244735 30103 raft_consensus.cc:2955] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:01.267141 30103 consensus_queue.cc:237] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:01.279573 30735 raft_consensus.cc:1275] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:01.281033 30027 raft_consensus.cc:1275] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:01.281893 30844 consensus_queue.cc:1048] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:01.288748 30844 consensus_queue.cc:1048] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:01.300040 30877 raft_consensus.cc:2955] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:01.303972 29921 catalog_manager.cc:5697] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:01.310205 30026 raft_consensus.cc:2955] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:01.312494 30735 raft_consensus.cc:2955] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:01.345113 30827 raft_consensus.cc:1064] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4: attempting to promote NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a to VOTER
I20260709 13:10:01.348500 30827 consensus_queue.cc:237] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:01.350172 29913 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c41a6d79ca9c459eb4b0b41302fb76a9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:01.356271 30026 consensus_queue.cc:237] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:01.361462 30173 raft_consensus.cc:1275] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:01.364044 30884 consensus_queue.cc:1048] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:01.366279 30103 raft_consensus.cc:1275] T f5616428acc64e24945a779e1aee597f P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:01.370086 29921 catalog_manager.cc:5697] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: config changed from index 3 to 4, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:01.371132 30736 raft_consensus.cc:1275] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
W20260709 13:10:01.370154 29913 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet c41a6d79ca9c459eb4b0b41302fb76a9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 3 but the committed config has opid_index of 4
I20260709 13:10:01.373580 30173 raft_consensus.cc:1275] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:01.376753 30884 consensus_queue.cc:1048] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:01.376971 30843 consensus_queue.cc:1048] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:01.378432 30782 consensus_queue.cc:1048] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:01.384332 30735 raft_consensus.cc:1275] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:01.390929 30843 consensus_queue.cc:1048] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:01.391896 30782 raft_consensus.cc:2955] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:01.395490 30164 tablet_service.cc:1558] Processing DeleteTablet for tablet c41a6d79ca9c459eb4b0b41302fb76a9 with delete_type TABLET_DATA_TOMBSTONED (TS c99569d27a6f4c648eae7119fe3db124 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43828
I20260709 13:10:01.403383 30736 raft_consensus.cc:2955] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:01.411535 29910 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 817d4a23671d4a1d9c3b9db3b4e77b0f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:01.454344 30877 raft_consensus.cc:1064] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719: attempting to promote NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a to VOTER
I20260709 13:10:01.457206 30877 consensus_queue.cc:237] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:01.461828 30902 tablet_replica.cc:333] T c41a6d79ca9c459eb4b0b41302fb76a9 P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:10:01.461354 30171 raft_consensus.cc:2955] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:01.466200 30902 raft_consensus.cc:2243] T c41a6d79ca9c459eb4b0b41302fb76a9 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:01.466873 30902 raft_consensus.cc:2272] T c41a6d79ca9c459eb4b0b41302fb76a9 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:01.467723 30843 raft_consensus.cc:2955] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:01.470413 30735 raft_consensus.cc:2955] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:01.493451 30173 raft_consensus.cc:1275] T 5c8539fb97344b07aed5af91eaf0806f P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:01.496037 30026 raft_consensus.cc:1275] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:01.495217 29922 catalog_manager.cc:5697] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 reported cstate change: config changed from index 3 to 4, VOTER 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) evicted. New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:01.511942 30877 consensus_queue.cc:1048] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:01.497257 30737 raft_consensus.cc:1275] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:01.514688 30101 raft_consensus.cc:2955] T f5616428acc64e24945a779e1aee597f P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:01.518162 30877 consensus_queue.cc:1048] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:01.521656 30877 consensus_queue.cc:1048] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:01.527061 30091 tablet_service.cc:1558] Processing DeleteTablet for tablet 817d4a23671d4a1d9c3b9db3b4e77b0f with delete_type TABLET_DATA_TOMBSTONED (TS 5ec73dc157ed476ca903a7d596271719 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33984
I20260709 13:10:01.531646 30171 raft_consensus.cc:2955] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:01.540501 29922 catalog_manager.cc:5697] T f5616428acc64e24945a779e1aee597f P 5ec73dc157ed476ca903a7d596271719 reported cstate change: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:01.553809 30908 tablet_replica.cc:333] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:10:01.559141 30902 ts_tablet_manager.cc:1916] T c41a6d79ca9c459eb4b0b41302fb76a9 P c99569d27a6f4c648eae7119fe3db124: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:01.587231 30908 raft_consensus.cc:2243] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:01.588084 30908 raft_consensus.cc:2272] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:01.590754 30876 raft_consensus.cc:2955] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:01.593413 30908 ts_tablet_manager.cc:1916] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 5ec73dc157ed476ca903a7d596271719: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:01.604454 30173 raft_consensus.cc:2955] T 5c8539fb97344b07aed5af91eaf0806f P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:01.609735 30026 raft_consensus.cc:2955] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:01.610951 30024 consensus_queue.cc:237] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:01.608207 30737 raft_consensus.cc:2955] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:01.617554 30735 raft_consensus.cc:1275] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:01.617735 30177 raft_consensus.cc:1275] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:01.616671 29921 catalog_manager.cc:5697] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 reported cstate change: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:01.619494 30884 consensus_queue.cc:1048] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:01.620368 30827 consensus_queue.cc:1048] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:01.631651 30827 raft_consensus.cc:2955] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:01.641479 30902 ts_tablet_manager.cc:1929] T c41a6d79ca9c459eb4b0b41302fb76a9 P c99569d27a6f4c648eae7119fe3db124: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:01.638605 30177 raft_consensus.cc:2955] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:01.642859 30735 raft_consensus.cc:2955] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:01.642001 30902 log.cc:1199] T c41a6d79ca9c459eb4b0b41302fb76a9 P c99569d27a6f4c648eae7119fe3db124: Deleting WAL directory at /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-2-root/wals/c41a6d79ca9c459eb4b0b41302fb76a9
I20260709 13:10:01.647047 29912 catalog_manager.cc:5028] TS c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): tablet c41a6d79ca9c459eb4b0b41302fb76a9 (table test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]) successfully deleted
I20260709 13:10:01.653986 29910 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f5616428acc64e24945a779e1aee597f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:01.654874 30908 ts_tablet_manager.cc:1929] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 5ec73dc157ed476ca903a7d596271719: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:01.655373 30908 log.cc:1199] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 5ec73dc157ed476ca903a7d596271719: Deleting WAL directory at /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-1-root/wals/817d4a23671d4a1d9c3b9db3b4e77b0f
I20260709 13:10:01.657038 29913 catalog_manager.cc:5028] TS 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): tablet 817d4a23671d4a1d9c3b9db3b4e77b0f (table test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]) successfully deleted
I20260709 13:10:01.664350 30102 consensus_queue.cc:237] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:01.681602 30026 raft_consensus.cc:1275] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:01.680549 29923 catalog_manager.cc:5697] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: config changed from index 3 to 4, VOTER 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) evicted. New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:01.683336 30876 consensus_queue.cc:1048] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:01.683579 30735 raft_consensus.cc:1275] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:01.686625 30876 consensus_queue.cc:1048] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:01.690853 30877 raft_consensus.cc:2955] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:01.695377 30735 raft_consensus.cc:2955] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:01.702069 29913 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5c8539fb97344b07aed5af91eaf0806f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:01.701778 30026 raft_consensus.cc:2955] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:01.707662 30091 tablet_service.cc:1558] Processing DeleteTablet for tablet f5616428acc64e24945a779e1aee597f with delete_type TABLET_DATA_TOMBSTONED (TS 5ec73dc157ed476ca903a7d596271719 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33984
I20260709 13:10:01.711148 30908 tablet_replica.cc:333] T f5616428acc64e24945a779e1aee597f P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:10:01.712370 30908 raft_consensus.cc:2243] T f5616428acc64e24945a779e1aee597f P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:01.715545 30908 raft_consensus.cc:2272] T f5616428acc64e24945a779e1aee597f P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:01.716166 29921 catalog_manager.cc:5697] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: config changed from index 3 to 4, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:01.724251 30908 ts_tablet_manager.cc:1916] T f5616428acc64e24945a779e1aee597f P 5ec73dc157ed476ca903a7d596271719: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:01.729933 30164 tablet_service.cc:1558] Processing DeleteTablet for tablet 5c8539fb97344b07aed5af91eaf0806f with delete_type TABLET_DATA_TOMBSTONED (TS c99569d27a6f4c648eae7119fe3db124 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43828
I20260709 13:10:01.730943 30902 tablet_replica.cc:333] T 5c8539fb97344b07aed5af91eaf0806f P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:10:01.731998 30902 raft_consensus.cc:2243] T 5c8539fb97344b07aed5af91eaf0806f P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:01.732731 30902 raft_consensus.cc:2272] T 5c8539fb97344b07aed5af91eaf0806f P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:01.736016 30902 ts_tablet_manager.cc:1916] T 5c8539fb97344b07aed5af91eaf0806f P c99569d27a6f4c648eae7119fe3db124: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:01.742669 30908 ts_tablet_manager.cc:1929] T f5616428acc64e24945a779e1aee597f P 5ec73dc157ed476ca903a7d596271719: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:01.743135 30908 log.cc:1199] T f5616428acc64e24945a779e1aee597f P 5ec73dc157ed476ca903a7d596271719: Deleting WAL directory at /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-1-root/wals/f5616428acc64e24945a779e1aee597f
I20260709 13:10:01.744794 29913 catalog_manager.cc:5028] TS 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): tablet f5616428acc64e24945a779e1aee597f (table test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]) successfully deleted
I20260709 13:10:01.747990 30902 ts_tablet_manager.cc:1929] T 5c8539fb97344b07aed5af91eaf0806f P c99569d27a6f4c648eae7119fe3db124: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:01.748348 30902 log.cc:1199] T 5c8539fb97344b07aed5af91eaf0806f P c99569d27a6f4c648eae7119fe3db124: Deleting WAL directory at /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-2-root/wals/5c8539fb97344b07aed5af91eaf0806f
I20260709 13:10:01.749671 29912 catalog_manager.cc:5028] TS c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): tablet 5c8539fb97344b07aed5af91eaf0806f (table test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]) successfully deleted
I20260709 13:10:02.796545 30102 consensus_queue.cc:237] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:02.802353 30177 raft_consensus.cc:1275] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:02.802704 30024 raft_consensus.cc:1275] T 1cd924402bd0402aa7ad47fac1308ac9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:10:02.802866 30068 consensus_peers.cc:597] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 -> Peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469): Couldn't send request to peer 6f3eb161e2194f6891f12e2cfcaaf73a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1cd924402bd0402aa7ad47fac1308ac9. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:02.803589 30844 consensus_queue.cc:1048] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:02.804200 30876 consensus_queue.cc:1048] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:02.811488 30912 raft_consensus.cc:2955] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:02.812942 30177 raft_consensus.cc:2955] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:02.816088 30024 raft_consensus.cc:2955] T 1cd924402bd0402aa7ad47fac1308ac9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:02.830335 29922 catalog_manager.cc:5697] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:02.831806 30026 consensus_queue.cc:237] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:02.853888 30177 raft_consensus.cc:1275] T d3f3f9c9793f4390874e250718c41697 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:02.855640 30102 raft_consensus.cc:1275] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:10:02.857146 29993 consensus_peers.cc:597] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 -> Peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469): Couldn't send request to peer 6f3eb161e2194f6891f12e2cfcaaf73a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d3f3f9c9793f4390874e250718c41697. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:02.857720 30884 consensus_queue.cc:1048] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:02.858741 30827 consensus_queue.cc:1048] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:02.882623 30827 raft_consensus.cc:2955] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:02.887207 30173 raft_consensus.cc:2955] T d3f3f9c9793f4390874e250718c41697 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:02.911917 30101 raft_consensus.cc:2955] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:02.919620 30177 consensus_queue.cc:237] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:02.933060 30027 raft_consensus.cc:1275] T c6d87bb3ff11400cbdaf30e614c4b3da P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:02.934293 30873 consensus_queue.cc:1048] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:02.934666 30098 raft_consensus.cc:1275] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:02.936039 30873 consensus_queue.cc:1048] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:02.937860 30142 consensus_peers.cc:597] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 -> Peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469): Couldn't send request to peer 6f3eb161e2194f6891f12e2cfcaaf73a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c6d87bb3ff11400cbdaf30e614c4b3da. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:02.944841 29921 catalog_manager.cc:5697] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:02.949720 30102 raft_consensus.cc:2955] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:02.947571 30873 raft_consensus.cc:2955] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:02.968799 30024 raft_consensus.cc:2955] T c6d87bb3ff11400cbdaf30e614c4b3da P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:02.970583 30027 consensus_queue.cc:237] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:02.971679 29923 catalog_manager.cc:5697] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New cstate: current_term: 1 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:03.003611 30177 raft_consensus.cc:1275] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:03.004269 30102 raft_consensus.cc:1275] T 64e2b2bd54d3454a9f64030c149e2e25 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:03.005084 30921 consensus_queue.cc:1048] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:03.006052 30884 consensus_queue.cc:1048] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:03.008852 29993 consensus_peers.cc:597] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 -> Peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469): Couldn't send request to peer 6f3eb161e2194f6891f12e2cfcaaf73a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 64e2b2bd54d3454a9f64030c149e2e25. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:03.016628 30884 raft_consensus.cc:2955] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:03.018107 30102 raft_consensus.cc:2955] T 64e2b2bd54d3454a9f64030c149e2e25 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:03.018843 30177 raft_consensus.cc:2955] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:03.034816 29923 catalog_manager.cc:5697] T 64e2b2bd54d3454a9f64030c149e2e25 P 5ec73dc157ed476ca903a7d596271719 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:03.205780 30930 ts_tablet_manager.cc:933] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a: Initiating tablet copy from peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:03.208552 30930 tablet_copy_client.cc:323] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Beginning tablet copy session from remote peer at address 127.28.54.66:43821
I20260709 13:10:03.209969 30113 tablet_copy_service.cc:140] P 5ec73dc157ed476ca903a7d596271719: Received BeginTabletCopySession request for tablet 1cd924402bd0402aa7ad47fac1308ac9 from peer 6f3eb161e2194f6891f12e2cfcaaf73a ({username='slave'} at 127.0.0.1:48558)
I20260709 13:10:03.210389 30113 tablet_copy_service.cc:161] P 5ec73dc157ed476ca903a7d596271719: Beginning new tablet copy session on tablet 1cd924402bd0402aa7ad47fac1308ac9 from peer 6f3eb161e2194f6891f12e2cfcaaf73a at {username='slave'} at 127.0.0.1:48558: session id = 6f3eb161e2194f6891f12e2cfcaaf73a-1cd924402bd0402aa7ad47fac1308ac9
I20260709 13:10:03.215706 30113 tablet_copy_source_session.cc:215] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:03.218322 30930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1cd924402bd0402aa7ad47fac1308ac9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:03.230937 30930 tablet_copy_client.cc:806] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:03.231436 30930 tablet_copy_client.cc:670] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:03.234480 30930 tablet_copy_client.cc:538] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:03.240535 30930 tablet_bootstrap.cc:492] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap starting.
I20260709 13:10:03.255719 30930 tablet_bootstrap.cc:492] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:03.256672 30930 tablet_bootstrap.cc:492] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap complete.
I20260709 13:10:03.257375 30930 ts_tablet_manager.cc:1403] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent bootstrapping tablet: real 0.017s	user 0.019s	sys 0.000s
I20260709 13:10:03.259905 30930 raft_consensus.cc:359] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:03.260462 30930 raft_consensus.cc:740] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Initialized, Role: LEARNER
I20260709 13:10:03.260905 30930 consensus_queue.cc:260] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:03.263453 30930 ts_tablet_manager.cc:1434] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.004s
I20260709 13:10:03.265342 30113 tablet_copy_service.cc:342] P 5ec73dc157ed476ca903a7d596271719: Request end of tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-1cd924402bd0402aa7ad47fac1308ac9 received from {username='slave'} at 127.0.0.1:48558
I20260709 13:10:03.265674 30113 tablet_copy_service.cc:434] P 5ec73dc157ed476ca903a7d596271719: ending tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-1cd924402bd0402aa7ad47fac1308ac9 on tablet 1cd924402bd0402aa7ad47fac1308ac9 with peer 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:03.323107 30930 ts_tablet_manager.cc:933] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a: Initiating tablet copy from peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:03.324609 30930 tablet_copy_client.cc:323] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Beginning tablet copy session from remote peer at address 127.28.54.67:45001
I20260709 13:10:03.326292 30187 tablet_copy_service.cc:140] P c99569d27a6f4c648eae7119fe3db124: Received BeginTabletCopySession request for tablet c6d87bb3ff11400cbdaf30e614c4b3da from peer 6f3eb161e2194f6891f12e2cfcaaf73a ({username='slave'} at 127.0.0.1:54540)
I20260709 13:10:03.326833 30187 tablet_copy_service.cc:161] P c99569d27a6f4c648eae7119fe3db124: Beginning new tablet copy session on tablet c6d87bb3ff11400cbdaf30e614c4b3da from peer 6f3eb161e2194f6891f12e2cfcaaf73a at {username='slave'} at 127.0.0.1:54540: session id = 6f3eb161e2194f6891f12e2cfcaaf73a-c6d87bb3ff11400cbdaf30e614c4b3da
I20260709 13:10:03.332685 30187 tablet_copy_source_session.cc:215] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:03.335711 30935 ts_tablet_manager.cc:933] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a: Initiating tablet copy from peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451)
I20260709 13:10:03.335852 30930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6d87bb3ff11400cbdaf30e614c4b3da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:03.337412 30935 tablet_copy_client.cc:323] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Beginning tablet copy session from remote peer at address 127.28.54.65:34451
I20260709 13:10:03.338817 30038 tablet_copy_service.cc:140] P b2cea0098c1040f69755ea4d3dab7fc4: Received BeginTabletCopySession request for tablet d3f3f9c9793f4390874e250718c41697 from peer 6f3eb161e2194f6891f12e2cfcaaf73a ({username='slave'} at 127.0.0.1:52098)
I20260709 13:10:03.339351 30038 tablet_copy_service.cc:161] P b2cea0098c1040f69755ea4d3dab7fc4: Beginning new tablet copy session on tablet d3f3f9c9793f4390874e250718c41697 from peer 6f3eb161e2194f6891f12e2cfcaaf73a at {username='slave'} at 127.0.0.1:52098: session id = 6f3eb161e2194f6891f12e2cfcaaf73a-d3f3f9c9793f4390874e250718c41697
I20260709 13:10:03.345436 30038 tablet_copy_source_session.cc:215] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:03.349031 30935 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3f3f9c9793f4390874e250718c41697. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:03.365720 30935 tablet_copy_client.cc:806] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:03.366329 30935 tablet_copy_client.cc:670] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:03.370303 30935 tablet_copy_client.cc:538] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:03.370599 30930 tablet_copy_client.cc:806] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:03.372503 30930 tablet_copy_client.cc:670] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:03.376487 30930 tablet_copy_client.cc:538] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:03.384599 30935 tablet_bootstrap.cc:492] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap starting.
I20260709 13:10:03.391124 30930 tablet_bootstrap.cc:492] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap starting.
I20260709 13:10:03.454038 30935 tablet_bootstrap.cc:492] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:03.457852 30935 tablet_bootstrap.cc:492] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap complete.
I20260709 13:10:03.458585 30935 ts_tablet_manager.cc:1403] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent bootstrapping tablet: real 0.074s	user 0.028s	sys 0.013s
I20260709 13:10:03.464495 30935 raft_consensus.cc:359] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:03.465472 30935 raft_consensus.cc:740] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Initialized, Role: LEARNER
I20260709 13:10:03.466174 30935 consensus_queue.cc:260] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:03.469034 30935 ts_tablet_manager.cc:1434] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:10:03.470933 30038 tablet_copy_service.cc:342] P b2cea0098c1040f69755ea4d3dab7fc4: Request end of tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-d3f3f9c9793f4390874e250718c41697 received from {username='slave'} at 127.0.0.1:52098
I20260709 13:10:03.471326 30038 tablet_copy_service.cc:434] P b2cea0098c1040f69755ea4d3dab7fc4: ending tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-d3f3f9c9793f4390874e250718c41697 on tablet d3f3f9c9793f4390874e250718c41697 with peer 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:03.507324 30930 tablet_bootstrap.cc:492] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:03.508288 30930 tablet_bootstrap.cc:492] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap complete.
I20260709 13:10:03.508888 30930 ts_tablet_manager.cc:1403] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent bootstrapping tablet: real 0.118s	user 0.029s	sys 0.011s
I20260709 13:10:03.512285 30930 raft_consensus.cc:359] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:03.512862 30930 raft_consensus.cc:740] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Initialized, Role: LEARNER
I20260709 13:10:03.513341 30930 consensus_queue.cc:260] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:03.515089 30930 ts_tablet_manager.cc:1434] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:10:03.517127 30187 tablet_copy_service.cc:342] P c99569d27a6f4c648eae7119fe3db124: Request end of tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-c6d87bb3ff11400cbdaf30e614c4b3da received from {username='slave'} at 127.0.0.1:54540
I20260709 13:10:03.517550 30187 tablet_copy_service.cc:434] P c99569d27a6f4c648eae7119fe3db124: ending tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-c6d87bb3ff11400cbdaf30e614c4b3da on tablet c6d87bb3ff11400cbdaf30e614c4b3da with peer 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:03.546357 30930 ts_tablet_manager.cc:933] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a: Initiating tablet copy from peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451)
I20260709 13:10:03.548084 30930 tablet_copy_client.cc:323] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Beginning tablet copy session from remote peer at address 127.28.54.65:34451
I20260709 13:10:03.549532 30038 tablet_copy_service.cc:140] P b2cea0098c1040f69755ea4d3dab7fc4: Received BeginTabletCopySession request for tablet 64e2b2bd54d3454a9f64030c149e2e25 from peer 6f3eb161e2194f6891f12e2cfcaaf73a ({username='slave'} at 127.0.0.1:52098)
I20260709 13:10:03.550024 30038 tablet_copy_service.cc:161] P b2cea0098c1040f69755ea4d3dab7fc4: Beginning new tablet copy session on tablet 64e2b2bd54d3454a9f64030c149e2e25 from peer 6f3eb161e2194f6891f12e2cfcaaf73a at {username='slave'} at 127.0.0.1:52098: session id = 6f3eb161e2194f6891f12e2cfcaaf73a-64e2b2bd54d3454a9f64030c149e2e25
I20260709 13:10:03.555603 30038 tablet_copy_source_session.cc:215] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:03.558054 30930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64e2b2bd54d3454a9f64030c149e2e25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:03.571810 30930 tablet_copy_client.cc:806] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:03.572476 30930 tablet_copy_client.cc:670] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:03.575523 30930 tablet_copy_client.cc:538] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:03.581796 30930 tablet_bootstrap.cc:492] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap starting.
I20260709 13:10:03.596102 30930 tablet_bootstrap.cc:492] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:03.596911 30930 tablet_bootstrap.cc:492] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap complete.
I20260709 13:10:03.597386 30930 ts_tablet_manager.cc:1403] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent bootstrapping tablet: real 0.016s	user 0.018s	sys 0.000s
I20260709 13:10:03.599550 30930 raft_consensus.cc:359] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:03.600057 30930 raft_consensus.cc:740] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Initialized, Role: LEARNER
I20260709 13:10:03.600464 30930 consensus_queue.cc:260] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:03.602231 30930 ts_tablet_manager.cc:1434] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.004s
I20260709 13:10:03.605154 30038 tablet_copy_service.cc:342] P b2cea0098c1040f69755ea4d3dab7fc4: Request end of tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-64e2b2bd54d3454a9f64030c149e2e25 received from {username='slave'} at 127.0.0.1:52098
I20260709 13:10:03.605489 30038 tablet_copy_service.cc:434] P b2cea0098c1040f69755ea4d3dab7fc4: ending tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-64e2b2bd54d3454a9f64030c149e2e25 on tablet 64e2b2bd54d3454a9f64030c149e2e25 with peer 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:03.741503 30735 raft_consensus.cc:1217] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:03.925258 30735 raft_consensus.cc:1217] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:03.930619 30735 raft_consensus.cc:1217] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:04.074436 30735 raft_consensus.cc:1217] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:04.302477 30844 raft_consensus.cc:1064] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719: attempting to promote NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a to VOTER
I20260709 13:10:04.304687 30844 consensus_queue.cc:237] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:04.312705 30177 raft_consensus.cc:1275] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:04.315021 30737 raft_consensus.cc:1275] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:04.317354 30912 consensus_queue.cc:1048] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:04.321020 30912 consensus_queue.cc:1048] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260709 13:10:04.331149 30027 raft_consensus.cc:1275] T 1cd924402bd0402aa7ad47fac1308ac9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:04.333921 30912 consensus_queue.cc:1048] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:04.337693 30844 raft_consensus.cc:2955] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:04.340934 30177 raft_consensus.cc:2955] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:04.343963 30027 raft_consensus.cc:2955] T 1cd924402bd0402aa7ad47fac1308ac9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:04.354905 30737 raft_consensus.cc:2955] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:04.362079 29923 catalog_manager.cc:5697] T 1cd924402bd0402aa7ad47fac1308ac9 P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:04.409612 30098 consensus_queue.cc:237] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:04.414149 30737 raft_consensus.cc:1275] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:04.414340 30177 raft_consensus.cc:1275] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:04.415490 30912 consensus_queue.cc:1048] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:04.416311 30844 consensus_queue.cc:1048] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:04.427512 30937 raft_consensus.cc:1064] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124: attempting to promote NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a to VOTER
I20260709 13:10:04.427384 30945 raft_consensus.cc:2955] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:04.429652 30937 consensus_queue.cc:237] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:04.438823 29913 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1cd924402bd0402aa7ad47fac1308ac9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:04.443205 30737 raft_consensus.cc:2955] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:04.443271 30177 raft_consensus.cc:2955] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:04.452462 29924 catalog_manager.cc:5697] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 reported cstate change: config changed from index 3 to 4, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:04.458359 30735 raft_consensus.cc:1275] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:04.459975 30924 consensus_queue.cc:1048] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:04.466257 30025 raft_consensus.cc:1275] T c6d87bb3ff11400cbdaf30e614c4b3da P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:04.467847 30873 consensus_queue.cc:1048] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:04.472465 30098 raft_consensus.cc:1275] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:04.480849 30873 consensus_queue.cc:1048] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:04.482961 30922 raft_consensus.cc:1064] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4: attempting to promote NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a to VOTER
I20260709 13:10:04.484938 30922 consensus_queue.cc:237] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:04.489060 30009 tablet_service.cc:1558] Processing DeleteTablet for tablet 1cd924402bd0402aa7ad47fac1308ac9 with delete_type TABLET_DATA_TOMBSTONED (TS b2cea0098c1040f69755ea4d3dab7fc4 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54192
I20260709 13:10:04.507274 30873 raft_consensus.cc:2955] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:04.515276 30098 raft_consensus.cc:2955] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:04.531409 30024 raft_consensus.cc:2955] T c6d87bb3ff11400cbdaf30e614c4b3da P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:04.608820 30177 raft_consensus.cc:1275] T d3f3f9c9793f4390874e250718c41697 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:04.612491 30737 raft_consensus.cc:1275] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:04.617087 29924 catalog_manager.cc:5697] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 reported cstate change: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:04.622948 30965 consensus_queue.cc:1048] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:10:04.625087 30142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 105157us
I20260709 13:10:04.627146 30735 raft_consensus.cc:2955] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:04.631891 30884 raft_consensus.cc:1064] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4: attempting to promote NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a to VOTER
I20260709 13:10:04.635346 30177 consensus_queue.cc:237] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:04.643455 30956 tablet_replica.cc:333] T 1cd924402bd0402aa7ad47fac1308ac9 P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
W20260709 13:10:04.645116 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 128921us
I20260709 13:10:04.645563 30737 raft_consensus.cc:1275] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:04.648058 30937 consensus_queue.cc:1048] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:04.648664 30098 raft_consensus.cc:1275] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:04.625675 30966 consensus_queue.cc:1048] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:04.652850 30924 consensus_queue.cc:1048] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:04.655536 30873 raft_consensus.cc:2955] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:04.660089 30735 raft_consensus.cc:2955] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:04.663971 30956 raft_consensus.cc:2243] T 1cd924402bd0402aa7ad47fac1308ac9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.664812 30956 raft_consensus.cc:2272] T 1cd924402bd0402aa7ad47fac1308ac9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.685542 30956 ts_tablet_manager.cc:1916] T 1cd924402bd0402aa7ad47fac1308ac9 P b2cea0098c1040f69755ea4d3dab7fc4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:04.687219 30098 raft_consensus.cc:2955] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:04.691147 30884 consensus_queue.cc:237] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:04.698480 29912 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c6d87bb3ff11400cbdaf30e614c4b3da with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:04.703339 29922 catalog_manager.cc:5697] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: config changed from index 3 to 4, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New cstate: current_term: 1 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:04.705163 30102 raft_consensus.cc:1275] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:04.719147 30964 raft_consensus.cc:2955] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:04.733601 30171 raft_consensus.cc:1275] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:04.736163 30171 raft_consensus.cc:2955] T d3f3f9c9793f4390874e250718c41697 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:04.736354 30737 raft_consensus.cc:2955] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:04.740721 30735 raft_consensus.cc:1275] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:04.742983 30884 consensus_queue.cc:1048] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:04.744510 30884 consensus_queue.cc:1048] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:04.757522 30956 ts_tablet_manager.cc:1929] T 1cd924402bd0402aa7ad47fac1308ac9 P b2cea0098c1040f69755ea4d3dab7fc4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:04.758437 30956 log.cc:1199] T 1cd924402bd0402aa7ad47fac1308ac9 P b2cea0098c1040f69755ea4d3dab7fc4: Deleting WAL directory at /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-0-root/wals/1cd924402bd0402aa7ad47fac1308ac9
I20260709 13:10:04.760968 29921 catalog_manager.cc:5697] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:04.766762 30009 tablet_service.cc:1558] Processing DeleteTablet for tablet c6d87bb3ff11400cbdaf30e614c4b3da with delete_type TABLET_DATA_TOMBSTONED (TS b2cea0098c1040f69755ea4d3dab7fc4 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54192
I20260709 13:10:04.767102 30884 consensus_queue.cc:1048] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:04.768147 30956 tablet_replica.cc:333] T c6d87bb3ff11400cbdaf30e614c4b3da P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:10:04.769162 30956 raft_consensus.cc:2243] T c6d87bb3ff11400cbdaf30e614c4b3da P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.775591 30098 raft_consensus.cc:1275] T 64e2b2bd54d3454a9f64030c149e2e25 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:04.776111 30956 raft_consensus.cc:2272] T c6d87bb3ff11400cbdaf30e614c4b3da P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.777472 29910 catalog_manager.cc:5028] TS b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): tablet 1cd924402bd0402aa7ad47fac1308ac9 (table test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]) successfully deleted
I20260709 13:10:04.782307 30956 ts_tablet_manager.cc:1916] T c6d87bb3ff11400cbdaf30e614c4b3da P b2cea0098c1040f69755ea4d3dab7fc4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:04.785830 30098 raft_consensus.cc:2955] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:04.791368 30964 consensus_queue.cc:1048] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:04.794591 30884 raft_consensus.cc:2955] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:04.799319 30735 raft_consensus.cc:2955] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:04.823180 29922 catalog_manager.cc:5697] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:04.825156 30956 ts_tablet_manager.cc:1929] T c6d87bb3ff11400cbdaf30e614c4b3da P b2cea0098c1040f69755ea4d3dab7fc4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:04.825645 30956 log.cc:1199] T c6d87bb3ff11400cbdaf30e614c4b3da P b2cea0098c1040f69755ea4d3dab7fc4: Deleting WAL directory at /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-0-root/wals/c6d87bb3ff11400cbdaf30e614c4b3da
I20260709 13:10:04.827188 29910 catalog_manager.cc:5028] TS b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): tablet c6d87bb3ff11400cbdaf30e614c4b3da (table test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]) successfully deleted
I20260709 13:10:04.830224 30171 raft_consensus.cc:2955] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:04.847918 30027 consensus_queue.cc:237] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:04.853591 30737 raft_consensus.cc:1275] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:04.855360 30921 consensus_queue.cc:1048] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:04.857221 30171 raft_consensus.cc:1275] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:04.858563 30922 consensus_queue.cc:1048] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:04.863170 30921 raft_consensus.cc:2955] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:04.866957 30737 raft_consensus.cc:2955] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:04.870157 30173 raft_consensus.cc:2955] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:04.872753 29910 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 64e2b2bd54d3454a9f64030c149e2e25 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:04.885360 29921 catalog_manager.cc:5697] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: config changed from index 3 to 4, VOTER 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) evicted. New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:04.902560 30091 tablet_service.cc:1558] Processing DeleteTablet for tablet 64e2b2bd54d3454a9f64030c149e2e25 with delete_type TABLET_DATA_TOMBSTONED (TS 5ec73dc157ed476ca903a7d596271719 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33984
I20260709 13:10:04.917280 30975 tablet_replica.cc:333] T 64e2b2bd54d3454a9f64030c149e2e25 P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:10:04.918437 30975 raft_consensus.cc:2243] T 64e2b2bd54d3454a9f64030c149e2e25 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:04.919013 30975 pending_rounds.cc:70] T 64e2b2bd54d3454a9f64030c149e2e25 P 5ec73dc157ed476ca903a7d596271719: Trying to abort 1 pending ops.
I20260709 13:10:04.919341 30975 pending_rounds.cc:77] T 64e2b2bd54d3454a9f64030c149e2e25 P 5ec73dc157ed476ca903a7d596271719: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305636268576104448 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } } }
I20260709 13:10:04.920645 30975 raft_consensus.cc:2917] T 64e2b2bd54d3454a9f64030c149e2e25 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 13:10:04.921079 30975 raft_consensus.cc:2889] T 64e2b2bd54d3454a9f64030c149e2e25 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:10:04.921442 30975 raft_consensus.cc:2272] T 64e2b2bd54d3454a9f64030c149e2e25 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:04.924250 30975 ts_tablet_manager.cc:1916] T 64e2b2bd54d3454a9f64030c149e2e25 P 5ec73dc157ed476ca903a7d596271719: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:04.939420 30975 ts_tablet_manager.cc:1929] T 64e2b2bd54d3454a9f64030c149e2e25 P 5ec73dc157ed476ca903a7d596271719: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:04.939869 30975 log.cc:1199] T 64e2b2bd54d3454a9f64030c149e2e25 P 5ec73dc157ed476ca903a7d596271719: Deleting WAL directory at /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-1-root/wals/64e2b2bd54d3454a9f64030c149e2e25
I20260709 13:10:04.941555 29913 catalog_manager.cc:5028] TS 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): tablet 64e2b2bd54d3454a9f64030c149e2e25 (table test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]) successfully deleted
I20260709 13:10:05.164517 30027 consensus_queue.cc:237] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:05.170552 30737 raft_consensus.cc:1275] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:05.173370 30103 raft_consensus.cc:1275] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:05.173465 30884 consensus_queue.cc:1048] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:05.176550 30962 consensus_queue.cc:1048] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:05.181938 30962 raft_consensus.cc:2955] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:05.183104 30737 raft_consensus.cc:2955] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:05.189432 30098 raft_consensus.cc:2955] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:05.192940 29910 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d3f3f9c9793f4390874e250718c41697 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:05.203836 29924 catalog_manager.cc:5697] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: config changed from index 3 to 4, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:05.215215 30164 tablet_service.cc:1558] Processing DeleteTablet for tablet d3f3f9c9793f4390874e250718c41697 with delete_type TABLET_DATA_TOMBSTONED (TS c99569d27a6f4c648eae7119fe3db124 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43828
I20260709 13:10:05.218510 30977 tablet_replica.cc:333] T d3f3f9c9793f4390874e250718c41697 P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:10:05.219553 30977 raft_consensus.cc:2243] T d3f3f9c9793f4390874e250718c41697 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:05.220283 30977 raft_consensus.cc:2272] T d3f3f9c9793f4390874e250718c41697 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:05.223078 30977 ts_tablet_manager.cc:1916] T d3f3f9c9793f4390874e250718c41697 P c99569d27a6f4c648eae7119fe3db124: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:05.235532 30977 ts_tablet_manager.cc:1929] T d3f3f9c9793f4390874e250718c41697 P c99569d27a6f4c648eae7119fe3db124: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:05.235841 30977 log.cc:1199] T d3f3f9c9793f4390874e250718c41697 P c99569d27a6f4c648eae7119fe3db124: Deleting WAL directory at /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-2-root/wals/d3f3f9c9793f4390874e250718c41697
I20260709 13:10:05.237078 29912 catalog_manager.cc:5028] TS c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): tablet d3f3f9c9793f4390874e250718c41697 (table test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]) successfully deleted
I20260709 13:10:06.278038 30024 consensus_queue.cc:237] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:06.283087 30173 raft_consensus.cc:1275] T 0a722bee3f14472ebed5b798e61c64b3 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:10:06.283588 29993 consensus_peers.cc:597] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 -> Peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469): Couldn't send request to peer 6f3eb161e2194f6891f12e2cfcaaf73a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0a722bee3f14472ebed5b798e61c64b3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.283947 30103 raft_consensus.cc:1275] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:06.284425 30884 consensus_queue.cc:1048] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:06.285138 30982 consensus_queue.cc:1048] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:06.294409 30103 raft_consensus.cc:2955] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:06.294479 30173 raft_consensus.cc:2955] T 0a722bee3f14472ebed5b798e61c64b3 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:06.304119 30985 raft_consensus.cc:2955] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:06.308749 29924 catalog_manager.cc:5697] T 0a722bee3f14472ebed5b798e61c64b3 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:06.315505 30173 consensus_queue.cc:237] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
W20260709 13:10:06.340562 30142 consensus_peers.cc:597] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 -> Peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469): Couldn't send request to peer 6f3eb161e2194f6891f12e2cfcaaf73a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 80006b8186d74baba29992ade1966048. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.346366 30103 raft_consensus.cc:1275] T 80006b8186d74baba29992ade1966048 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:06.348364 30924 consensus_queue.cc:1048] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:06.350208 30024 raft_consensus.cc:1275] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:06.351438 30961 consensus_queue.cc:1048] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:06.359120 30961 raft_consensus.cc:2955] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:06.361188 30024 raft_consensus.cc:2955] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:06.374651 30103 consensus_queue.cc:237] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:06.376804 29924 catalog_manager.cc:5697] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New cstate: current_term: 1 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:06.379869 30098 raft_consensus.cc:2955] T 80006b8186d74baba29992ade1966048 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:06.388031 30173 raft_consensus.cc:1275] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:06.389268 30978 consensus_queue.cc:1048] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:06.391940 30024 raft_consensus.cc:1275] T 8a3e809a994e4cbf98d7ea56807b8dad P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:06.396042 30980 consensus_queue.cc:1048] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:06.393621 30068 consensus_peers.cc:597] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 -> Peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469): Couldn't send request to peer 6f3eb161e2194f6891f12e2cfcaaf73a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a3e809a994e4cbf98d7ea56807b8dad. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.405184 30978 raft_consensus.cc:2955] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:06.410207 30027 raft_consensus.cc:2955] T 8a3e809a994e4cbf98d7ea56807b8dad P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:06.413611 30173 raft_consensus.cc:2955] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:06.424199 30024 consensus_queue.cc:237] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:06.425899 29924 catalog_manager.cc:5697] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:06.434070 29993 consensus_peers.cc:597] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 -> Peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469): Couldn't send request to peer 6f3eb161e2194f6891f12e2cfcaaf73a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 21562b36aa874c9cba1acd5dc79cf517. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:06.435050 30098 raft_consensus.cc:1275] T 21562b36aa874c9cba1acd5dc79cf517 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:06.435243 30173 raft_consensus.cc:1275] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:06.436244 30921 consensus_queue.cc:1048] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:06.437049 30982 consensus_queue.cc:1048] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:06.453194 30985 raft_consensus.cc:2955] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:06.456248 30098 raft_consensus.cc:2955] T 21562b36aa874c9cba1acd5dc79cf517 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:06.461092 30177 raft_consensus.cc:2955] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:06.479869 29922 catalog_manager.cc:5697] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:06.854728 31001 ts_tablet_manager.cc:933] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a: Initiating tablet copy from peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:06.856427 31001 tablet_copy_client.cc:323] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Beginning tablet copy session from remote peer at address 127.28.54.67:45001
I20260709 13:10:06.857748 30187 tablet_copy_service.cc:140] P c99569d27a6f4c648eae7119fe3db124: Received BeginTabletCopySession request for tablet 80006b8186d74baba29992ade1966048 from peer 6f3eb161e2194f6891f12e2cfcaaf73a ({username='slave'} at 127.0.0.1:54540)
I20260709 13:10:06.858191 30187 tablet_copy_service.cc:161] P c99569d27a6f4c648eae7119fe3db124: Beginning new tablet copy session on tablet 80006b8186d74baba29992ade1966048 from peer 6f3eb161e2194f6891f12e2cfcaaf73a at {username='slave'} at 127.0.0.1:54540: session id = 6f3eb161e2194f6891f12e2cfcaaf73a-80006b8186d74baba29992ade1966048
I20260709 13:10:06.863061 30187 tablet_copy_source_session.cc:215] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:06.866799 31001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80006b8186d74baba29992ade1966048. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.900122 31001 tablet_copy_client.cc:806] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:06.900770 31001 tablet_copy_client.cc:670] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:06.907508 31003 ts_tablet_manager.cc:933] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a: Initiating tablet copy from peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451)
I20260709 13:10:06.910724 31001 tablet_copy_client.cc:538] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:06.922154 31001 tablet_bootstrap.cc:492] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap starting.
I20260709 13:10:06.924520 31003 tablet_copy_client.cc:323] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Beginning tablet copy session from remote peer at address 127.28.54.65:34451
I20260709 13:10:06.928464 30038 tablet_copy_service.cc:140] P b2cea0098c1040f69755ea4d3dab7fc4: Received BeginTabletCopySession request for tablet 0a722bee3f14472ebed5b798e61c64b3 from peer 6f3eb161e2194f6891f12e2cfcaaf73a ({username='slave'} at 127.0.0.1:52098)
I20260709 13:10:06.928995 30038 tablet_copy_service.cc:161] P b2cea0098c1040f69755ea4d3dab7fc4: Beginning new tablet copy session on tablet 0a722bee3f14472ebed5b798e61c64b3 from peer 6f3eb161e2194f6891f12e2cfcaaf73a at {username='slave'} at 127.0.0.1:52098: session id = 6f3eb161e2194f6891f12e2cfcaaf73a-0a722bee3f14472ebed5b798e61c64b3
I20260709 13:10:06.936969 30038 tablet_copy_source_session.cc:215] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:06.939919 31001 tablet_bootstrap.cc:492] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:06.940055 31003 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a722bee3f14472ebed5b798e61c64b3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:06.940663 31001 tablet_bootstrap.cc:492] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap complete.
I20260709 13:10:06.941201 31001 ts_tablet_manager.cc:1403] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 13:10:06.943756 31001 raft_consensus.cc:359] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:06.944571 31001 raft_consensus.cc:740] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Initialized, Role: LEARNER
I20260709 13:10:06.945231 31001 consensus_queue.cc:260] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:06.960142 31003 tablet_copy_client.cc:806] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:06.960798 31003 tablet_copy_client.cc:670] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:06.963675 31001 ts_tablet_manager.cc:1434] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent starting tablet: real 0.022s	user 0.018s	sys 0.002s
I20260709 13:10:06.965813 30187 tablet_copy_service.cc:342] P c99569d27a6f4c648eae7119fe3db124: Request end of tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-80006b8186d74baba29992ade1966048 received from {username='slave'} at 127.0.0.1:54540
I20260709 13:10:06.966234 30187 tablet_copy_service.cc:434] P c99569d27a6f4c648eae7119fe3db124: ending tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-80006b8186d74baba29992ade1966048 on tablet 80006b8186d74baba29992ade1966048 with peer 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:06.972819 31003 tablet_copy_client.cc:538] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:06.983155 31003 tablet_bootstrap.cc:492] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap starting.
I20260709 13:10:06.986186 31001 ts_tablet_manager.cc:933] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a: Initiating tablet copy from peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:06.995977 31001 tablet_copy_client.cc:323] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Beginning tablet copy session from remote peer at address 127.28.54.66:43821
I20260709 13:10:06.998394 30113 tablet_copy_service.cc:140] P 5ec73dc157ed476ca903a7d596271719: Received BeginTabletCopySession request for tablet 8a3e809a994e4cbf98d7ea56807b8dad from peer 6f3eb161e2194f6891f12e2cfcaaf73a ({username='slave'} at 127.0.0.1:48558)
I20260709 13:10:06.998950 30113 tablet_copy_service.cc:161] P 5ec73dc157ed476ca903a7d596271719: Beginning new tablet copy session on tablet 8a3e809a994e4cbf98d7ea56807b8dad from peer 6f3eb161e2194f6891f12e2cfcaaf73a at {username='slave'} at 127.0.0.1:48558: session id = 6f3eb161e2194f6891f12e2cfcaaf73a-8a3e809a994e4cbf98d7ea56807b8dad
I20260709 13:10:07.008212 30113 tablet_copy_source_session.cc:215] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:07.011605 31003 tablet_bootstrap.cc:492] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:07.012562 31003 tablet_bootstrap.cc:492] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap complete.
I20260709 13:10:07.013715 31001 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a3e809a994e4cbf98d7ea56807b8dad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:07.013199 31003 ts_tablet_manager.cc:1403] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.011s
I20260709 13:10:07.022544 31007 ts_tablet_manager.cc:933] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a: Initiating tablet copy from peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451)
I20260709 13:10:07.022977 31003 raft_consensus.cc:359] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:07.025604 31003 raft_consensus.cc:740] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Initialized, Role: LEARNER
I20260709 13:10:07.026328 31003 consensus_queue.cc:260] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:07.032215 31003 ts_tablet_manager.cc:1434] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:10:07.033905 30038 tablet_copy_service.cc:342] P b2cea0098c1040f69755ea4d3dab7fc4: Request end of tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-0a722bee3f14472ebed5b798e61c64b3 received from {username='slave'} at 127.0.0.1:52098
I20260709 13:10:07.034359 30038 tablet_copy_service.cc:434] P b2cea0098c1040f69755ea4d3dab7fc4: ending tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-0a722bee3f14472ebed5b798e61c64b3 on tablet 0a722bee3f14472ebed5b798e61c64b3 with peer 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:07.045630 31007 tablet_copy_client.cc:323] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Beginning tablet copy session from remote peer at address 127.28.54.65:34451
I20260709 13:10:07.047314 30038 tablet_copy_service.cc:140] P b2cea0098c1040f69755ea4d3dab7fc4: Received BeginTabletCopySession request for tablet 21562b36aa874c9cba1acd5dc79cf517 from peer 6f3eb161e2194f6891f12e2cfcaaf73a ({username='slave'} at 127.0.0.1:52098)
I20260709 13:10:07.047818 30038 tablet_copy_service.cc:161] P b2cea0098c1040f69755ea4d3dab7fc4: Beginning new tablet copy session on tablet 21562b36aa874c9cba1acd5dc79cf517 from peer 6f3eb161e2194f6891f12e2cfcaaf73a at {username='slave'} at 127.0.0.1:52098: session id = 6f3eb161e2194f6891f12e2cfcaaf73a-21562b36aa874c9cba1acd5dc79cf517
I20260709 13:10:07.047899 31001 tablet_copy_client.cc:806] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:07.048496 31001 tablet_copy_client.cc:670] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:07.064253 30038 tablet_copy_source_session.cc:215] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:07.067325 31007 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 21562b36aa874c9cba1acd5dc79cf517. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:07.080196 31001 tablet_copy_client.cc:538] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:07.089473 31007 tablet_copy_client.cc:806] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:07.090132 31007 tablet_copy_client.cc:670] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:07.092990 31007 tablet_copy_client.cc:538] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:07.093357 31001 tablet_bootstrap.cc:492] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap starting.
I20260709 13:10:07.101193 31007 tablet_bootstrap.cc:492] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap starting.
I20260709 13:10:07.129804 31007 tablet_bootstrap.cc:492] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:07.130300 31001 tablet_bootstrap.cc:492] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:07.130638 31007 tablet_bootstrap.cc:492] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap complete.
I20260709 13:10:07.131342 31007 ts_tablet_manager.cc:1403] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent bootstrapping tablet: real 0.030s	user 0.021s	sys 0.004s
I20260709 13:10:07.131974 31001 tablet_bootstrap.cc:492] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap complete.
I20260709 13:10:07.132673 31001 ts_tablet_manager.cc:1403] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent bootstrapping tablet: real 0.040s	user 0.022s	sys 0.007s
I20260709 13:10:07.134087 31007 raft_consensus.cc:359] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:07.134758 31007 raft_consensus.cc:740] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Initialized, Role: LEARNER
I20260709 13:10:07.135236 31007 consensus_queue.cc:260] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:07.135373 31001 raft_consensus.cc:359] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:07.136178 31001 raft_consensus.cc:740] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Initialized, Role: LEARNER
I20260709 13:10:07.137188 31007 ts_tablet_manager.cc:1434] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:10:07.136785 31001 consensus_queue.cc:260] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:07.138839 30038 tablet_copy_service.cc:342] P b2cea0098c1040f69755ea4d3dab7fc4: Request end of tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-21562b36aa874c9cba1acd5dc79cf517 received from {username='slave'} at 127.0.0.1:52098
I20260709 13:10:07.139122 30038 tablet_copy_service.cc:434] P b2cea0098c1040f69755ea4d3dab7fc4: ending tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-21562b36aa874c9cba1acd5dc79cf517 on tablet 21562b36aa874c9cba1acd5dc79cf517 with peer 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:07.139328 31001 ts_tablet_manager.cc:1434] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:10:07.140841 30113 tablet_copy_service.cc:342] P 5ec73dc157ed476ca903a7d596271719: Request end of tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-8a3e809a994e4cbf98d7ea56807b8dad received from {username='slave'} at 127.0.0.1:48558
I20260709 13:10:07.141271 30113 tablet_copy_service.cc:434] P 5ec73dc157ed476ca903a7d596271719: ending tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-8a3e809a994e4cbf98d7ea56807b8dad on tablet 8a3e809a994e4cbf98d7ea56807b8dad with peer 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:07.279613 30737 raft_consensus.cc:1217] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:07.399646 30737 raft_consensus.cc:1217] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:07.434304 30737 raft_consensus.cc:1217] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:07.631801 30737 raft_consensus.cc:1217] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:07.690488 30985 raft_consensus.cc:1064] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4: attempting to promote NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a to VOTER
I20260709 13:10:07.692797 30985 consensus_queue.cc:237] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:07.709424 30171 raft_consensus.cc:1275] T 0a722bee3f14472ebed5b798e61c64b3 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:07.709514 30737 raft_consensus.cc:1275] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:07.711215 30098 raft_consensus.cc:1275] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:07.711341 31013 consensus_queue.cc:1048] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:07.713220 31015 consensus_queue.cc:1048] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:07.714066 31013 consensus_queue.cc:1048] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:07.731743 30985 raft_consensus.cc:2955] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:07.733774 30737 raft_consensus.cc:2955] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:07.737051 30098 raft_consensus.cc:2955] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:07.747545 29922 catalog_manager.cc:5697] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:07.761147 30171 raft_consensus.cc:2955] T 0a722bee3f14472ebed5b798e61c64b3 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:07.792004 30025 consensus_queue.cc:237] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:07.798049 30737 raft_consensus.cc:1275] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:07.800907 30098 raft_consensus.cc:1275] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:07.802186 31013 consensus_queue.cc:1048] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:07.803889 31013 consensus_queue.cc:1048] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:07.809890 30985 raft_consensus.cc:2955] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:07.813517 30102 raft_consensus.cc:2955] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:07.822628 30735 raft_consensus.cc:2955] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:07.826005 29910 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0a722bee3f14472ebed5b798e61c64b3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:07.831574 29924 catalog_manager.cc:5697] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: config changed from index 3 to 4, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:07.836978 30961 raft_consensus.cc:1064] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124: attempting to promote NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a to VOTER
I20260709 13:10:07.839550 30961 consensus_queue.cc:237] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:07.899618 30735 raft_consensus.cc:1275] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:07.901335 30924 consensus_queue.cc:1048] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:07.902719 30102 raft_consensus.cc:1275] T 80006b8186d74baba29992ade1966048 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:07.905371 30164 tablet_service.cc:1558] Processing DeleteTablet for tablet 0a722bee3f14472ebed5b798e61c64b3 with delete_type TABLET_DATA_TOMBSTONED (TS c99569d27a6f4c648eae7119fe3db124 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43828
I20260709 13:10:07.906771 30027 raft_consensus.cc:1275] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:07.909559 30924 consensus_queue.cc:1048] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:07.928218 30961 consensus_queue.cc:1048] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:07.943019 31026 raft_consensus.cc:2955] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:07.948179 30737 raft_consensus.cc:2955] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:08.001013 29921 catalog_manager.cc:5697] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:08.022100 31027 tablet_replica.cc:333] T 0a722bee3f14472ebed5b798e61c64b3 P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:10:08.022255 31000 raft_consensus.cc:1064] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719: attempting to promote NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a to VOTER
I20260709 13:10:08.028275 30027 raft_consensus.cc:2955] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:08.039947 31000 consensus_queue.cc:237] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:08.043445 31027 raft_consensus.cc:2243] T 0a722bee3f14472ebed5b798e61c64b3 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:08.044202 31027 raft_consensus.cc:2272] T 0a722bee3f14472ebed5b798e61c64b3 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:08.052981 31027 ts_tablet_manager.cc:1916] T 0a722bee3f14472ebed5b798e61c64b3 P c99569d27a6f4c648eae7119fe3db124: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 13:10:08.067781 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 62537.8us
I20260709 13:10:08.078914 30175 consensus_queue.cc:237] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:08.083690 30735 raft_consensus.cc:1275] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:08.083698 30027 raft_consensus.cc:1275] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:08.086239 31030 consensus_queue.cc:1048] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:08.088553 31033 consensus_queue.cc:1048] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:08.095491 31027 ts_tablet_manager.cc:1929] T 0a722bee3f14472ebed5b798e61c64b3 P c99569d27a6f4c648eae7119fe3db124: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:08.095950 30027 raft_consensus.cc:1275] T 8a3e809a994e4cbf98d7ea56807b8dad P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:08.095976 31027 log.cc:1199] T 0a722bee3f14472ebed5b798e61c64b3 P c99569d27a6f4c648eae7119fe3db124: Deleting WAL directory at /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-2-root/wals/0a722bee3f14472ebed5b798e61c64b3
I20260709 13:10:08.096740 31031 raft_consensus.cc:2955] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
W20260709 13:10:08.095882 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 75716.3us
I20260709 13:10:08.098286 31000 consensus_queue.cc:1048] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:08.098615 30027 raft_consensus.cc:2955] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:08.101141 30735 raft_consensus.cc:2955] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:08.111068 29912 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 80006b8186d74baba29992ade1966048 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:08.114607 30736 raft_consensus.cc:1275] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260709 13:10:08.118407 29912 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 80006b8186d74baba29992ade1966048 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 3 but the committed config has opid_index of 4
I20260709 13:10:08.119081 30177 raft_consensus.cc:1275] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:08.121140 29912 catalog_manager.cc:5028] TS c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): tablet 0a722bee3f14472ebed5b798e61c64b3 (table test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]) successfully deleted
I20260709 13:10:08.131852 30978 consensus_queue.cc:1048] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:08.133450 30978 consensus_queue.cc:1048] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:08.133042 29921 catalog_manager.cc:5697] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: config changed from index 3 to 4, VOTER 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) evicted. New cstate: current_term: 1 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:08.155586 31035 raft_consensus.cc:2955] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:08.157263 30091 tablet_service.cc:1558] Processing DeleteTablet for tablet 80006b8186d74baba29992ade1966048 with delete_type TABLET_DATA_TOMBSTONED (TS 5ec73dc157ed476ca903a7d596271719 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33984
I20260709 13:10:08.159238 30736 raft_consensus.cc:2955] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:08.163334 31039 tablet_replica.cc:333] T 80006b8186d74baba29992ade1966048 P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:10:08.164347 31039 raft_consensus.cc:2243] T 80006b8186d74baba29992ade1966048 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:08.164959 31039 pending_rounds.cc:70] T 80006b8186d74baba29992ade1966048 P 5ec73dc157ed476ca903a7d596271719: Trying to abort 1 pending ops.
I20260709 13:10:08.166694 31039 pending_rounds.cc:77] T 80006b8186d74baba29992ade1966048 P 5ec73dc157ed476ca903a7d596271719: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305636281704886272 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "80006b8186d74baba29992ade1966048" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } } }
I20260709 13:10:08.175117 31039 raft_consensus.cc:2917] T 80006b8186d74baba29992ade1966048 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 13:10:08.177848 31039 raft_consensus.cc:2889] T 80006b8186d74baba29992ade1966048 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:10:08.179023 31039 raft_consensus.cc:2272] T 80006b8186d74baba29992ade1966048 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:08.179843 30982 raft_consensus.cc:1064] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4: attempting to promote NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a to VOTER
I20260709 13:10:08.183187 31039 ts_tablet_manager.cc:1916] T 80006b8186d74baba29992ade1966048 P 5ec73dc157ed476ca903a7d596271719: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:08.187425 30982 consensus_queue.cc:237] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:08.196185 31039 ts_tablet_manager.cc:1929] T 80006b8186d74baba29992ade1966048 P 5ec73dc157ed476ca903a7d596271719: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:08.196625 31039 log.cc:1199] T 80006b8186d74baba29992ade1966048 P 5ec73dc157ed476ca903a7d596271719: Deleting WAL directory at /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-1-root/wals/80006b8186d74baba29992ade1966048
I20260709 13:10:08.198241 29913 catalog_manager.cc:5028] TS 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): tablet 80006b8186d74baba29992ade1966048 (table test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]) successfully deleted
I20260709 13:10:08.198552 30024 raft_consensus.cc:2955] T 8a3e809a994e4cbf98d7ea56807b8dad P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:08.213909 29924 catalog_manager.cc:5697] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 reported cstate change: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:08.216032 30173 raft_consensus.cc:2955] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:08.230558 30171 raft_consensus.cc:1275] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:08.231662 30736 raft_consensus.cc:1275] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:08.233283 30098 raft_consensus.cc:1275] T 21562b36aa874c9cba1acd5dc79cf517 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:08.234750 31013 consensus_queue.cc:1048] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:08.237439 30982 consensus_queue.cc:1048] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:08.240262 31019 consensus_queue.cc:1048] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:08.257612 30098 consensus_queue.cc:237] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:08.254834 30982 raft_consensus.cc:2955] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:08.262804 30735 raft_consensus.cc:2955] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:08.264505 30737 raft_consensus.cc:1275] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:08.269397 31000 consensus_queue.cc:1048] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:08.274379 30177 raft_consensus.cc:2955] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:08.276885 30173 raft_consensus.cc:1275] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:08.280432 29923 catalog_manager.cc:5697] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:08.288316 31000 consensus_queue.cc:1048] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:08.289983 31035 raft_consensus.cc:2955] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:08.298393 30098 raft_consensus.cc:2955] T 21562b36aa874c9cba1acd5dc79cf517 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:08.309183 30024 consensus_queue.cc:237] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:08.307138 30735 raft_consensus.cc:2955] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:08.312245 30171 raft_consensus.cc:2955] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:08.314023 29913 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8a3e809a994e4cbf98d7ea56807b8dad with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:08.323251 30737 raft_consensus.cc:1275] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:08.328496 31019 consensus_queue.cc:1048] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:08.333949 29921 catalog_manager.cc:5697] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 reported cstate change: config changed from index 3 to 4, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:08.335487 30171 raft_consensus.cc:1275] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:08.338107 31019 consensus_queue.cc:1048] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:08.339733 31013 raft_consensus.cc:2955] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:08.344010 30735 raft_consensus.cc:2955] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:08.346690 30171 raft_consensus.cc:2955] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:08.349349 30009 tablet_service.cc:1558] Processing DeleteTablet for tablet 8a3e809a994e4cbf98d7ea56807b8dad with delete_type TABLET_DATA_TOMBSTONED (TS b2cea0098c1040f69755ea4d3dab7fc4 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54192
I20260709 13:10:08.357045 29910 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 21562b36aa874c9cba1acd5dc79cf517 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:08.357457 31044 tablet_replica.cc:333] T 8a3e809a994e4cbf98d7ea56807b8dad P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:10:08.358493 31044 raft_consensus.cc:2243] T 8a3e809a994e4cbf98d7ea56807b8dad P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:08.359952 31044 raft_consensus.cc:2272] T 8a3e809a994e4cbf98d7ea56807b8dad P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:08.366968 31044 ts_tablet_manager.cc:1916] T 8a3e809a994e4cbf98d7ea56807b8dad P b2cea0098c1040f69755ea4d3dab7fc4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:08.363909 29921 catalog_manager.cc:5697] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: config changed from index 3 to 4, VOTER 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) evicted. New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:08.384061 30091 tablet_service.cc:1558] Processing DeleteTablet for tablet 21562b36aa874c9cba1acd5dc79cf517 with delete_type TABLET_DATA_TOMBSTONED (TS 5ec73dc157ed476ca903a7d596271719 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33984
I20260709 13:10:08.385036 31039 tablet_replica.cc:333] T 21562b36aa874c9cba1acd5dc79cf517 P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:10:08.385121 31044 ts_tablet_manager.cc:1929] T 8a3e809a994e4cbf98d7ea56807b8dad P b2cea0098c1040f69755ea4d3dab7fc4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:08.385586 31044 log.cc:1199] T 8a3e809a994e4cbf98d7ea56807b8dad P b2cea0098c1040f69755ea4d3dab7fc4: Deleting WAL directory at /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-0-root/wals/8a3e809a994e4cbf98d7ea56807b8dad
I20260709 13:10:08.385849 31039 raft_consensus.cc:2243] T 21562b36aa874c9cba1acd5dc79cf517 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:08.386435 31039 raft_consensus.cc:2272] T 21562b36aa874c9cba1acd5dc79cf517 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:08.387533 29910 catalog_manager.cc:5028] TS b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): tablet 8a3e809a994e4cbf98d7ea56807b8dad (table test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]) successfully deleted
I20260709 13:10:08.389509 31039 ts_tablet_manager.cc:1916] T 21562b36aa874c9cba1acd5dc79cf517 P 5ec73dc157ed476ca903a7d596271719: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:08.400880 31039 ts_tablet_manager.cc:1929] T 21562b36aa874c9cba1acd5dc79cf517 P 5ec73dc157ed476ca903a7d596271719: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:08.401155 31039 log.cc:1199] T 21562b36aa874c9cba1acd5dc79cf517 P 5ec73dc157ed476ca903a7d596271719: Deleting WAL directory at /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-1-root/wals/21562b36aa874c9cba1acd5dc79cf517
I20260709 13:10:08.402201 29913 catalog_manager.cc:5028] TS 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): tablet 21562b36aa874c9cba1acd5dc79cf517 (table test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]) successfully deleted
I20260709 13:10:09.459306 30027 consensus_queue.cc:237] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:09.464591 30177 raft_consensus.cc:1275] T d968b6d22e3243bfb840139be8b6dddd P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:09.464686 30098 raft_consensus.cc:1275] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:10:09.465317 29993 consensus_peers.cc:597] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 -> Peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469): Couldn't send request to peer 6f3eb161e2194f6891f12e2cfcaaf73a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d968b6d22e3243bfb840139be8b6dddd. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:09.466133 30982 consensus_queue.cc:1048] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:09.466892 30985 consensus_queue.cc:1048] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:09.474601 30985 raft_consensus.cc:2955] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:09.477253 30177 raft_consensus.cc:2955] T d968b6d22e3243bfb840139be8b6dddd P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:09.480943 30098 raft_consensus.cc:2955] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:09.492735 29921 catalog_manager.cc:5697] T d968b6d22e3243bfb840139be8b6dddd P c99569d27a6f4c648eae7119fe3db124 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:09.494633 30171 consensus_queue.cc:237] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
W20260709 13:10:09.508983 30142 consensus_peers.cc:597] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 -> Peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469): Couldn't send request to peer 6f3eb161e2194f6891f12e2cfcaaf73a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2964592ff08b4434889d830c05501d8e. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:09.510172 30098 raft_consensus.cc:1275] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:09.511752 31045 consensus_queue.cc:1048] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:09.513648 30025 raft_consensus.cc:1275] T 2964592ff08b4434889d830c05501d8e P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:09.515105 31045 consensus_queue.cc:1048] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:09.634876 31045 raft_consensus.cc:2955] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:09.639639 30027 raft_consensus.cc:2955] T 2964592ff08b4434889d830c05501d8e P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:09.653343 30103 raft_consensus.cc:2955] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:09.673998 30103 consensus_queue.cc:237] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:09.681720 29922 catalog_manager.cc:5697] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New cstate: current_term: 1 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:09.700820 30171 raft_consensus.cc:1275] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:09.701308 30024 raft_consensus.cc:1275] T 30a540a1b03746b785f2fc4692e05833 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:10:09.701663 30068 consensus_peers.cc:597] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 -> Peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469): Couldn't send request to peer 6f3eb161e2194f6891f12e2cfcaaf73a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 30a540a1b03746b785f2fc4692e05833. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:09.702977 31047 consensus_queue.cc:1048] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:09.703800 31060 consensus_queue.cc:1048] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:09.726037 31000 raft_consensus.cc:2955] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:09.731426 30027 raft_consensus.cc:2955] T 30a540a1b03746b785f2fc4692e05833 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:09.733634 30177 raft_consensus.cc:2955] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:09.746548 30103 consensus_queue.cc:237] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:09.748504 29924 catalog_manager.cc:5697] T 30a540a1b03746b785f2fc4692e05833 P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:09.754771 30177 raft_consensus.cc:1275] T 0be979412dd54241bd212ddbb7611046 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:09.755939 30027 raft_consensus.cc:1275] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:10:09.756289 30068 consensus_peers.cc:597] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 -> Peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469): Couldn't send request to peer 6f3eb161e2194f6891f12e2cfcaaf73a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0be979412dd54241bd212ddbb7611046. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:09.756593 31060 consensus_queue.cc:1048] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:09.758096 31000 consensus_queue.cc:1048] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:09.767372 31035 raft_consensus.cc:2955] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:09.768817 30171 raft_consensus.cc:2955] T 0be979412dd54241bd212ddbb7611046 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:09.785737 29921 catalog_manager.cc:5697] T 0be979412dd54241bd212ddbb7611046 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:09.790643 30027 raft_consensus.cc:2955] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:09.851220 31071 ts_tablet_manager.cc:933] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a: Initiating tablet copy from peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451)
I20260709 13:10:09.858094 31071 tablet_copy_client.cc:323] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Beginning tablet copy session from remote peer at address 127.28.54.65:34451
I20260709 13:10:09.860195 30038 tablet_copy_service.cc:140] P b2cea0098c1040f69755ea4d3dab7fc4: Received BeginTabletCopySession request for tablet d968b6d22e3243bfb840139be8b6dddd from peer 6f3eb161e2194f6891f12e2cfcaaf73a ({username='slave'} at 127.0.0.1:52098)
I20260709 13:10:09.860819 30038 tablet_copy_service.cc:161] P b2cea0098c1040f69755ea4d3dab7fc4: Beginning new tablet copy session on tablet d968b6d22e3243bfb840139be8b6dddd from peer 6f3eb161e2194f6891f12e2cfcaaf73a at {username='slave'} at 127.0.0.1:52098: session id = 6f3eb161e2194f6891f12e2cfcaaf73a-d968b6d22e3243bfb840139be8b6dddd
I20260709 13:10:09.868562 30038 tablet_copy_source_session.cc:215] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:09.871621 31071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d968b6d22e3243bfb840139be8b6dddd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.896977 31071 tablet_copy_client.cc:806] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:09.897652 31071 tablet_copy_client.cc:670] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:09.901540 31071 tablet_copy_client.cc:538] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:09.907938 31071 tablet_bootstrap.cc:492] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap starting.
I20260709 13:10:09.923728 31071 tablet_bootstrap.cc:492] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:09.924623 31071 tablet_bootstrap.cc:492] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap complete.
I20260709 13:10:09.925372 31071 ts_tablet_manager.cc:1403] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.003s
I20260709 13:10:09.928846 31071 raft_consensus.cc:359] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:09.929978 31071 raft_consensus.cc:740] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Initialized, Role: LEARNER
I20260709 13:10:09.930516 31071 consensus_queue.cc:260] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:09.931658 31074 ts_tablet_manager.cc:933] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a: Initiating tablet copy from peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:09.933843 31071 ts_tablet_manager.cc:1434] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:10:09.937391 30038 tablet_copy_service.cc:342] P b2cea0098c1040f69755ea4d3dab7fc4: Request end of tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-d968b6d22e3243bfb840139be8b6dddd received from {username='slave'} at 127.0.0.1:52098
I20260709 13:10:09.937923 30038 tablet_copy_service.cc:434] P b2cea0098c1040f69755ea4d3dab7fc4: ending tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-d968b6d22e3243bfb840139be8b6dddd on tablet d968b6d22e3243bfb840139be8b6dddd with peer 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:09.944466 31074 tablet_copy_client.cc:323] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Beginning tablet copy session from remote peer at address 127.28.54.67:45001
I20260709 13:10:09.946595 30187 tablet_copy_service.cc:140] P c99569d27a6f4c648eae7119fe3db124: Received BeginTabletCopySession request for tablet 2964592ff08b4434889d830c05501d8e from peer 6f3eb161e2194f6891f12e2cfcaaf73a ({username='slave'} at 127.0.0.1:54540)
I20260709 13:10:09.947006 30187 tablet_copy_service.cc:161] P c99569d27a6f4c648eae7119fe3db124: Beginning new tablet copy session on tablet 2964592ff08b4434889d830c05501d8e from peer 6f3eb161e2194f6891f12e2cfcaaf73a at {username='slave'} at 127.0.0.1:54540: session id = 6f3eb161e2194f6891f12e2cfcaaf73a-2964592ff08b4434889d830c05501d8e
I20260709 13:10:09.956893 30187 tablet_copy_source_session.cc:215] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:09.959617 31074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2964592ff08b4434889d830c05501d8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:09.974619 31074 tablet_copy_client.cc:806] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:09.975214 31074 tablet_copy_client.cc:670] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:09.980916 31074 tablet_copy_client.cc:538] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:09.986776 31074 tablet_bootstrap.cc:492] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap starting.
I20260709 13:10:10.002221 31074 tablet_bootstrap.cc:492] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:10.002857 31074 tablet_bootstrap.cc:492] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap complete.
I20260709 13:10:10.003403 31074 ts_tablet_manager.cc:1403] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent bootstrapping tablet: real 0.017s	user 0.006s	sys 0.009s
I20260709 13:10:10.005465 31074 raft_consensus.cc:359] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:10.006057 31074 raft_consensus.cc:740] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Initialized, Role: LEARNER
I20260709 13:10:10.006524 31074 consensus_queue.cc:260] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:10.008993 31074 ts_tablet_manager.cc:1434] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:10:10.010803 30187 tablet_copy_service.cc:342] P c99569d27a6f4c648eae7119fe3db124: Request end of tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-2964592ff08b4434889d830c05501d8e received from {username='slave'} at 127.0.0.1:54540
I20260709 13:10:10.011138 30187 tablet_copy_service.cc:434] P c99569d27a6f4c648eae7119fe3db124: ending tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-2964592ff08b4434889d830c05501d8e on tablet 2964592ff08b4434889d830c05501d8e with peer 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:10.125144 31074 ts_tablet_manager.cc:933] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a: Initiating tablet copy from peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:10.126894 31074 tablet_copy_client.cc:323] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Beginning tablet copy session from remote peer at address 127.28.54.66:43821
I20260709 13:10:10.128530 30113 tablet_copy_service.cc:140] P 5ec73dc157ed476ca903a7d596271719: Received BeginTabletCopySession request for tablet 30a540a1b03746b785f2fc4692e05833 from peer 6f3eb161e2194f6891f12e2cfcaaf73a ({username='slave'} at 127.0.0.1:48558)
I20260709 13:10:10.129055 30113 tablet_copy_service.cc:161] P 5ec73dc157ed476ca903a7d596271719: Beginning new tablet copy session on tablet 30a540a1b03746b785f2fc4692e05833 from peer 6f3eb161e2194f6891f12e2cfcaaf73a at {username='slave'} at 127.0.0.1:48558: session id = 6f3eb161e2194f6891f12e2cfcaaf73a-30a540a1b03746b785f2fc4692e05833
I20260709 13:10:10.136950 30113 tablet_copy_source_session.cc:215] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:10.139915 31074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 30a540a1b03746b785f2fc4692e05833. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.165612 31074 tablet_copy_client.cc:806] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:10.166258 31074 tablet_copy_client.cc:670] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:10.169793 31074 tablet_copy_client.cc:538] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:10.181202 31074 tablet_bootstrap.cc:492] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap starting.
I20260709 13:10:10.200150 31074 tablet_bootstrap.cc:492] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:10.200979 31074 tablet_bootstrap.cc:492] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap complete.
I20260709 13:10:10.201593 31074 ts_tablet_manager.cc:1403] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent bootstrapping tablet: real 0.021s	user 0.020s	sys 0.000s
I20260709 13:10:10.204272 31074 raft_consensus.cc:359] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:10.205098 31074 raft_consensus.cc:740] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Initialized, Role: LEARNER
I20260709 13:10:10.205739 31074 consensus_queue.cc:260] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:10.208045 31074 ts_tablet_manager.cc:1434] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:10:10.209781 30113 tablet_copy_service.cc:342] P 5ec73dc157ed476ca903a7d596271719: Request end of tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-30a540a1b03746b785f2fc4692e05833 received from {username='slave'} at 127.0.0.1:48558
I20260709 13:10:10.210183 30113 tablet_copy_service.cc:434] P 5ec73dc157ed476ca903a7d596271719: ending tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-30a540a1b03746b785f2fc4692e05833 on tablet 30a540a1b03746b785f2fc4692e05833 with peer 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:10.244400 30735 raft_consensus.cc:1217] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:10.310878 30735 raft_consensus.cc:1217] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:10.378093 31074 ts_tablet_manager.cc:933] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a: Initiating tablet copy from peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:10.381172 31074 tablet_copy_client.cc:323] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Beginning tablet copy session from remote peer at address 127.28.54.66:43821
I20260709 13:10:10.382633 30113 tablet_copy_service.cc:140] P 5ec73dc157ed476ca903a7d596271719: Received BeginTabletCopySession request for tablet 0be979412dd54241bd212ddbb7611046 from peer 6f3eb161e2194f6891f12e2cfcaaf73a ({username='slave'} at 127.0.0.1:48558)
I20260709 13:10:10.383039 30113 tablet_copy_service.cc:161] P 5ec73dc157ed476ca903a7d596271719: Beginning new tablet copy session on tablet 0be979412dd54241bd212ddbb7611046 from peer 6f3eb161e2194f6891f12e2cfcaaf73a at {username='slave'} at 127.0.0.1:48558: session id = 6f3eb161e2194f6891f12e2cfcaaf73a-0be979412dd54241bd212ddbb7611046
I20260709 13:10:10.388484 30113 tablet_copy_source_session.cc:215] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:10.392468 31074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0be979412dd54241bd212ddbb7611046. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:10.410135 31074 tablet_copy_client.cc:806] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:10.410676 31074 tablet_copy_client.cc:670] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:10.414942 31074 tablet_copy_client.cc:538] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:10.425529 31074 tablet_bootstrap.cc:492] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap starting.
I20260709 13:10:10.453404 31074 tablet_bootstrap.cc:492] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:10.454295 31074 tablet_bootstrap.cc:492] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap complete.
I20260709 13:10:10.454901 31074 ts_tablet_manager.cc:1403] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent bootstrapping tablet: real 0.030s	user 0.021s	sys 0.002s
I20260709 13:10:10.457355 31074 raft_consensus.cc:359] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:10.458113 31074 raft_consensus.cc:740] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Initialized, Role: LEARNER
I20260709 13:10:10.458730 31074 consensus_queue.cc:260] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:10.460729 31074 ts_tablet_manager.cc:1434] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:10.462682 30113 tablet_copy_service.cc:342] P 5ec73dc157ed476ca903a7d596271719: Request end of tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-0be979412dd54241bd212ddbb7611046 received from {username='slave'} at 127.0.0.1:48558
I20260709 13:10:10.463068 30113 tablet_copy_service.cc:434] P 5ec73dc157ed476ca903a7d596271719: ending tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-0be979412dd54241bd212ddbb7611046 on tablet 0be979412dd54241bd212ddbb7611046 with peer 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:10.634668 30737 raft_consensus.cc:1217] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:10.726203 30982 raft_consensus.cc:1064] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4: attempting to promote NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a to VOTER
I20260709 13:10:10.726716 31064 raft_consensus.cc:1064] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124: attempting to promote NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a to VOTER
I20260709 13:10:10.728526 30982 consensus_queue.cc:237] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:10.729147 31064 consensus_queue.cc:237] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:10.735037 30171 raft_consensus.cc:1275] T d968b6d22e3243bfb840139be8b6dddd P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:10.736121 30737 raft_consensus.cc:1275] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:10.741349 31058 consensus_queue.cc:1048] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:10.736366 30098 raft_consensus.cc:1275] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:10.744546 30982 consensus_queue.cc:1048] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:10.745664 31058 consensus_queue.cc:1048] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:10.750079 30735 raft_consensus.cc:1275] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:10.753032 31031 consensus_queue.cc:1048] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:10.759491 30103 raft_consensus.cc:1275] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:10.762894 30027 raft_consensus.cc:1275] T 2964592ff08b4434889d830c05501d8e P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:10.766534 31031 consensus_queue.cc:1048] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:10.779337 30982 raft_consensus.cc:2955] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:10.779855 31045 raft_consensus.cc:2955] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:10.787740 30098 raft_consensus.cc:2955] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:10.795204 30177 raft_consensus.cc:2955] T d968b6d22e3243bfb840139be8b6dddd P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:10.787751 30103 raft_consensus.cc:2955] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:10.806468 29922 catalog_manager.cc:5697] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 reported cstate change: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:10.789673 30735 raft_consensus.cc:2955] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
W20260709 13:10:10.816311 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 50110.7us
I20260709 13:10:10.820665 31064 consensus_queue.cc:1048] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:10.832218 30737 raft_consensus.cc:2955] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:10.855903 29924 catalog_manager.cc:5697] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:10.866432 30027 raft_consensus.cc:2955] T 2964592ff08b4434889d830c05501d8e P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:10.896883 30027 consensus_queue.cc:237] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:10.904799 30737 raft_consensus.cc:1275] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:10.909401 30103 raft_consensus.cc:1275] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:10.909222 31058 consensus_queue.cc:1048] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:10.913054 31094 consensus_queue.cc:1048] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:10.923629 30982 raft_consensus.cc:2955] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:10.924909 30737 raft_consensus.cc:2955] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:10.941221 30103 raft_consensus.cc:2955] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:10.949616 29925 catalog_manager.cc:5697] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: config changed from index 3 to 4, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:10.961033 30164 tablet_service.cc:1558] Processing DeleteTablet for tablet d968b6d22e3243bfb840139be8b6dddd with delete_type TABLET_DATA_TOMBSTONED (TS c99569d27a6f4c648eae7119fe3db124 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43828
I20260709 13:10:10.967674 30177 consensus_queue.cc:237] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:10.976434 31099 tablet_replica.cc:333] T d968b6d22e3243bfb840139be8b6dddd P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:10:10.971331 29910 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d968b6d22e3243bfb840139be8b6dddd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:11.001142 30735 raft_consensus.cc:1275] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:11.005502 31099 raft_consensus.cc:2243] T d968b6d22e3243bfb840139be8b6dddd P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:11.006433 31099 raft_consensus.cc:2272] T d968b6d22e3243bfb840139be8b6dddd P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:11.010490 30103 raft_consensus.cc:1275] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:11.012207 31064 consensus_queue.cc:1048] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:11.014935 30737 raft_consensus.cc:1217] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:11.017992 31099 ts_tablet_manager.cc:1916] T d968b6d22e3243bfb840139be8b6dddd P c99569d27a6f4c648eae7119fe3db124: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:11.019070 31091 consensus_queue.cc:1048] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:11.024632 31090 raft_consensus.cc:2955] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:11.026098 30103 raft_consensus.cc:2955] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:11.040295 29912 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 2964592ff08b4434889d830c05501d8e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:11.047457 29925 catalog_manager.cc:5697] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 reported cstate change: config changed from index 3 to 4, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New cstate: current_term: 1 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:11.053644 31099 ts_tablet_manager.cc:1929] T d968b6d22e3243bfb840139be8b6dddd P c99569d27a6f4c648eae7119fe3db124: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:11.054267 31099 log.cc:1199] T d968b6d22e3243bfb840139be8b6dddd P c99569d27a6f4c648eae7119fe3db124: Deleting WAL directory at /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-2-root/wals/d968b6d22e3243bfb840139be8b6dddd
I20260709 13:10:11.055841 29912 catalog_manager.cc:5028] TS c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): tablet d968b6d22e3243bfb840139be8b6dddd (table test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]) successfully deleted
I20260709 13:10:11.058033 30009 tablet_service.cc:1558] Processing DeleteTablet for tablet 2964592ff08b4434889d830c05501d8e with delete_type TABLET_DATA_TOMBSTONED (TS b2cea0098c1040f69755ea4d3dab7fc4 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54192
I20260709 13:10:11.059774 30737 raft_consensus.cc:2955] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:11.072417 31100 tablet_replica.cc:333] T 2964592ff08b4434889d830c05501d8e P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:10:11.073562 31100 raft_consensus.cc:2243] T 2964592ff08b4434889d830c05501d8e P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:11.074323 31100 raft_consensus.cc:2272] T 2964592ff08b4434889d830c05501d8e P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:11.078276 31100 ts_tablet_manager.cc:1916] T 2964592ff08b4434889d830c05501d8e P b2cea0098c1040f69755ea4d3dab7fc4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:11.092772 31100 ts_tablet_manager.cc:1929] T 2964592ff08b4434889d830c05501d8e P b2cea0098c1040f69755ea4d3dab7fc4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:11.093163 31100 log.cc:1199] T 2964592ff08b4434889d830c05501d8e P b2cea0098c1040f69755ea4d3dab7fc4: Deleting WAL directory at /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-0-root/wals/2964592ff08b4434889d830c05501d8e
I20260709 13:10:11.094856 29910 catalog_manager.cc:5028] TS b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): tablet 2964592ff08b4434889d830c05501d8e (table test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]) successfully deleted
I20260709 13:10:11.174647 31035 raft_consensus.cc:1064] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719: attempting to promote NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a to VOTER
I20260709 13:10:11.177132 31035 consensus_queue.cc:237] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:11.183204 30177 raft_consensus.cc:1275] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:11.183913 30737 raft_consensus.cc:1275] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:11.184005 30024 raft_consensus.cc:1275] T 30a540a1b03746b785f2fc4692e05833 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:11.184876 31035 consensus_queue.cc:1048] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:11.186623 31062 consensus_queue.cc:1048] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:11.188251 31035 consensus_queue.cc:1048] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:11.197454 31062 raft_consensus.cc:2955] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:11.199033 30737 raft_consensus.cc:2955] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:11.203012 30024 raft_consensus.cc:2955] T 30a540a1b03746b785f2fc4692e05833 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:11.216758 29921 catalog_manager.cc:5697] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:11.218176 30177 raft_consensus.cc:2955] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:11.238556 30103 consensus_queue.cc:237] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:11.243669 30737 raft_consensus.cc:1275] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:11.244453 30177 raft_consensus.cc:1275] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:11.244897 31062 consensus_queue.cc:1048] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:10:11.247282 31105 consensus_queue.cc:1048] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:11.258822 31035 raft_consensus.cc:2955] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:11.259773 30737 raft_consensus.cc:2955] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:11.273072 29923 catalog_manager.cc:5697] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: config changed from index 3 to 4, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:11.288445 30177 raft_consensus.cc:2955] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:11.292482 30009 tablet_service.cc:1558] Processing DeleteTablet for tablet 30a540a1b03746b785f2fc4692e05833 with delete_type TABLET_DATA_TOMBSTONED (TS b2cea0098c1040f69755ea4d3dab7fc4 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54192
I20260709 13:10:11.301575 31100 tablet_replica.cc:333] T 30a540a1b03746b785f2fc4692e05833 P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:10:11.303020 29913 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 30a540a1b03746b785f2fc4692e05833 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:11.308282 31100 raft_consensus.cc:2243] T 30a540a1b03746b785f2fc4692e05833 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:11.309188 31100 raft_consensus.cc:2272] T 30a540a1b03746b785f2fc4692e05833 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:11.312381 31100 ts_tablet_manager.cc:1916] T 30a540a1b03746b785f2fc4692e05833 P b2cea0098c1040f69755ea4d3dab7fc4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:11.331513 31100 ts_tablet_manager.cc:1929] T 30a540a1b03746b785f2fc4692e05833 P b2cea0098c1040f69755ea4d3dab7fc4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:11.333114 31100 log.cc:1199] T 30a540a1b03746b785f2fc4692e05833 P b2cea0098c1040f69755ea4d3dab7fc4: Deleting WAL directory at /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-0-root/wals/30a540a1b03746b785f2fc4692e05833
I20260709 13:10:11.335438 29910 catalog_manager.cc:5028] TS b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): tablet 30a540a1b03746b785f2fc4692e05833 (table test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]) successfully deleted
I20260709 13:10:11.604137 31106 raft_consensus.cc:1064] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719: attempting to promote NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a to VOTER
I20260709 13:10:11.606849 31106 consensus_queue.cc:237] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:11.613845 30171 raft_consensus.cc:1275] T 0be979412dd54241bd212ddbb7611046 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:11.614529 30735 raft_consensus.cc:1275] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:11.614616 30024 raft_consensus.cc:1275] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:11.616140 31106 consensus_queue.cc:1048] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:11.617074 31035 consensus_queue.cc:1048] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:11.617825 31047 consensus_queue.cc:1048] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:11.628738 31047 raft_consensus.cc:2955] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:11.632270 30171 raft_consensus.cc:2955] T 0be979412dd54241bd212ddbb7611046 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:11.638471 30024 raft_consensus.cc:2955] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:11.648260 30737 raft_consensus.cc:2955] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:11.646118 29922 catalog_manager.cc:5697] T 0be979412dd54241bd212ddbb7611046 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:11.663139 30098 consensus_queue.cc:237] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:11.670955 30024 raft_consensus.cc:1275] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:11.674330 30737 raft_consensus.cc:1275] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:11.674620 31047 consensus_queue.cc:1048] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:11.675540 31105 consensus_queue.cc:1048] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:11.684165 31106 raft_consensus.cc:2955] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:11.684585 30024 raft_consensus.cc:2955] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:11.686858 30735 raft_consensus.cc:2955] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:11.693320 29913 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0be979412dd54241bd212ddbb7611046 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:11.704955 29925 catalog_manager.cc:5697] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: config changed from index 3 to 4, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:11.714442 30164 tablet_service.cc:1558] Processing DeleteTablet for tablet 0be979412dd54241bd212ddbb7611046 with delete_type TABLET_DATA_TOMBSTONED (TS c99569d27a6f4c648eae7119fe3db124 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43828
I20260709 13:10:11.716315 31111 tablet_replica.cc:333] T 0be979412dd54241bd212ddbb7611046 P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:10:11.717410 31111 raft_consensus.cc:2243] T 0be979412dd54241bd212ddbb7611046 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:11.718407 31111 raft_consensus.cc:2272] T 0be979412dd54241bd212ddbb7611046 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:11.721026 31111 ts_tablet_manager.cc:1916] T 0be979412dd54241bd212ddbb7611046 P c99569d27a6f4c648eae7119fe3db124: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:11.731756 31111 ts_tablet_manager.cc:1929] T 0be979412dd54241bd212ddbb7611046 P c99569d27a6f4c648eae7119fe3db124: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:11.732108 31111 log.cc:1199] T 0be979412dd54241bd212ddbb7611046 P c99569d27a6f4c648eae7119fe3db124: Deleting WAL directory at /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-2-root/wals/0be979412dd54241bd212ddbb7611046
I20260709 13:10:11.733348 29912 catalog_manager.cc:5028] TS c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): tablet 0be979412dd54241bd212ddbb7611046 (table test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]) successfully deleted
I20260709 13:10:12.775774 30027 consensus_queue.cc:237] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:12.781385 30171 raft_consensus.cc:1275] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:12.782814 30098 raft_consensus.cc:1275] T 632c5405056e40be8152973f0c966318 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:12.784909 30982 consensus_queue.cc:1048] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:12.785802 31013 consensus_queue.cc:1048] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:12.786412 29993 consensus_peers.cc:597] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 -> Peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469): Couldn't send request to peer 6f3eb161e2194f6891f12e2cfcaaf73a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 632c5405056e40be8152973f0c966318. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:12.794397 31114 raft_consensus.cc:2955] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:12.796826 30101 raft_consensus.cc:2955] T 632c5405056e40be8152973f0c966318 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:12.798676 30171 raft_consensus.cc:2955] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:12.808290 30027 consensus_queue.cc:237] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:12.810732 29922 catalog_manager.cc:5697] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:12.821075 30171 raft_consensus.cc:1275] T ea42d6bd0dbb4438a96c31b335069e3c P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:10:12.822206 29993 consensus_peers.cc:597] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 -> Peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469): Couldn't send request to peer 6f3eb161e2194f6891f12e2cfcaaf73a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ea42d6bd0dbb4438a96c31b335069e3c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:12.822257 30101 raft_consensus.cc:1275] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:12.823086 31114 consensus_queue.cc:1048] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:12.823959 30982 consensus_queue.cc:1048] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:12.836766 30982 raft_consensus.cc:2955] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:12.838176 30098 raft_consensus.cc:2955] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:12.839238 30171 raft_consensus.cc:2955] T ea42d6bd0dbb4438a96c31b335069e3c P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:12.851671 30177 consensus_queue.cc:237] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:12.856634 29925 catalog_manager.cc:5697] T ea42d6bd0dbb4438a96c31b335069e3c P c99569d27a6f4c648eae7119fe3db124 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:12.875379 30027 raft_consensus.cc:1275] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:10:12.875963 30142 consensus_peers.cc:597] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 -> Peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469): Couldn't send request to peer 6f3eb161e2194f6891f12e2cfcaaf73a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d7be23af8c824b3bb048a59d6bdf884c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:12.877854 31064 consensus_queue.cc:1048] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:12.885344 30098 raft_consensus.cc:1275] T d7be23af8c824b3bb048a59d6bdf884c P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:12.888352 31125 consensus_queue.cc:1048] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:12.903466 31064 raft_consensus.cc:2955] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:12.905118 30027 raft_consensus.cc:2955] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:12.906618 30098 raft_consensus.cc:2955] T d7be23af8c824b3bb048a59d6bdf884c P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:12.919145 30103 consensus_queue.cc:237] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:12.922374 29922 catalog_manager.cc:5697] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New cstate: current_term: 2 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:12.930389 30177 raft_consensus.cc:1275] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:10:12.933542 30068 consensus_peers.cc:597] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 -> Peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469): Couldn't send request to peer 6f3eb161e2194f6891f12e2cfcaaf73a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fe9a5ae7a3c04826a4bdde9445be46bb. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:12.934166 30027 raft_consensus.cc:1275] T fe9a5ae7a3c04826a4bdde9445be46bb P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:12.934535 31062 consensus_queue.cc:1048] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:12.939975 31047 consensus_queue.cc:1048] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:12.948516 31062 raft_consensus.cc:2955] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 2 LEADER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:12.951191 30027 raft_consensus.cc:2955] T fe9a5ae7a3c04826a4bdde9445be46bb P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:12.952518 30177 raft_consensus.cc:2955] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Committing config change with OpId 2.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:12.961969 29925 catalog_manager.cc:5697] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New cstate: current_term: 2 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:13.240453 31131 ts_tablet_manager.cc:933] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a: Initiating tablet copy from peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451)
I20260709 13:10:13.244431 31131 tablet_copy_client.cc:323] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Beginning tablet copy session from remote peer at address 127.28.54.65:34451
I20260709 13:10:13.245999 30038 tablet_copy_service.cc:140] P b2cea0098c1040f69755ea4d3dab7fc4: Received BeginTabletCopySession request for tablet 632c5405056e40be8152973f0c966318 from peer 6f3eb161e2194f6891f12e2cfcaaf73a ({username='slave'} at 127.0.0.1:52098)
I20260709 13:10:13.246507 30038 tablet_copy_service.cc:161] P b2cea0098c1040f69755ea4d3dab7fc4: Beginning new tablet copy session on tablet 632c5405056e40be8152973f0c966318 from peer 6f3eb161e2194f6891f12e2cfcaaf73a at {username='slave'} at 127.0.0.1:52098: session id = 6f3eb161e2194f6891f12e2cfcaaf73a-632c5405056e40be8152973f0c966318
I20260709 13:10:13.253931 30038 tablet_copy_source_session.cc:215] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:13.257540 31131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 632c5405056e40be8152973f0c966318. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:13.269793 31131 tablet_copy_client.cc:806] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:13.270442 31131 tablet_copy_client.cc:670] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:13.273718 31131 tablet_copy_client.cc:538] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:13.281628 31131 tablet_bootstrap.cc:492] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap starting.
I20260709 13:10:13.300999 31131 tablet_bootstrap.cc:492] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:13.301931 31131 tablet_bootstrap.cc:492] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap complete.
I20260709 13:10:13.302588 31131 ts_tablet_manager.cc:1403] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.012s
I20260709 13:10:13.307060 31131 raft_consensus.cc:359] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:13.308730 31131 raft_consensus.cc:740] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Initialized, Role: LEARNER
I20260709 13:10:13.309504 31131 consensus_queue.cc:260] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:13.314774 31131 ts_tablet_manager.cc:1434] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 13:10:13.324679 30038 tablet_copy_service.cc:342] P b2cea0098c1040f69755ea4d3dab7fc4: Request end of tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-632c5405056e40be8152973f0c966318 received from {username='slave'} at 127.0.0.1:52098
I20260709 13:10:13.325093 30038 tablet_copy_service.cc:434] P b2cea0098c1040f69755ea4d3dab7fc4: ending tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-632c5405056e40be8152973f0c966318 on tablet 632c5405056e40be8152973f0c966318 with peer 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:13.369731 31131 ts_tablet_manager.cc:933] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a: Initiating tablet copy from peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451)
I20260709 13:10:13.371297 31131 tablet_copy_client.cc:323] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Beginning tablet copy session from remote peer at address 127.28.54.65:34451
I20260709 13:10:13.372535 30038 tablet_copy_service.cc:140] P b2cea0098c1040f69755ea4d3dab7fc4: Received BeginTabletCopySession request for tablet ea42d6bd0dbb4438a96c31b335069e3c from peer 6f3eb161e2194f6891f12e2cfcaaf73a ({username='slave'} at 127.0.0.1:52098)
I20260709 13:10:13.373057 30038 tablet_copy_service.cc:161] P b2cea0098c1040f69755ea4d3dab7fc4: Beginning new tablet copy session on tablet ea42d6bd0dbb4438a96c31b335069e3c from peer 6f3eb161e2194f6891f12e2cfcaaf73a at {username='slave'} at 127.0.0.1:52098: session id = 6f3eb161e2194f6891f12e2cfcaaf73a-ea42d6bd0dbb4438a96c31b335069e3c
I20260709 13:10:13.380880 30038 tablet_copy_source_session.cc:215] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:13.383888 31131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea42d6bd0dbb4438a96c31b335069e3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:13.401448 31131 tablet_copy_client.cc:806] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:13.402086 31131 tablet_copy_client.cc:670] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:13.407258 31131 tablet_copy_client.cc:538] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:13.427369 31136 ts_tablet_manager.cc:933] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a: Initiating tablet copy from peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:13.429632 31131 tablet_bootstrap.cc:492] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap starting.
I20260709 13:10:13.435853 31136 tablet_copy_client.cc:323] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Beginning tablet copy session from remote peer at address 127.28.54.66:43821
I20260709 13:10:13.437939 30113 tablet_copy_service.cc:140] P 5ec73dc157ed476ca903a7d596271719: Received BeginTabletCopySession request for tablet fe9a5ae7a3c04826a4bdde9445be46bb from peer 6f3eb161e2194f6891f12e2cfcaaf73a ({username='slave'} at 127.0.0.1:48558)
I20260709 13:10:13.438452 30113 tablet_copy_service.cc:161] P 5ec73dc157ed476ca903a7d596271719: Beginning new tablet copy session on tablet fe9a5ae7a3c04826a4bdde9445be46bb from peer 6f3eb161e2194f6891f12e2cfcaaf73a at {username='slave'} at 127.0.0.1:48558: session id = 6f3eb161e2194f6891f12e2cfcaaf73a-fe9a5ae7a3c04826a4bdde9445be46bb
I20260709 13:10:13.445665 30113 tablet_copy_source_session.cc:215] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:13.449378 31136 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe9a5ae7a3c04826a4bdde9445be46bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:13.458001 31131 tablet_bootstrap.cc:492] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:13.458676 31131 tablet_bootstrap.cc:492] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap complete.
I20260709 13:10:13.459184 31131 ts_tablet_manager.cc:1403] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.011s
I20260709 13:10:13.462827 31131 raft_consensus.cc:359] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:13.463392 31131 raft_consensus.cc:740] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Initialized, Role: LEARNER
I20260709 13:10:13.463925 31131 consensus_queue.cc:260] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:13.464350 31136 tablet_copy_client.cc:806] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:13.466797 31131 ts_tablet_manager.cc:1434] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:13.469885 31136 tablet_copy_client.cc:670] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:13.470634 30038 tablet_copy_service.cc:342] P b2cea0098c1040f69755ea4d3dab7fc4: Request end of tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-ea42d6bd0dbb4438a96c31b335069e3c received from {username='slave'} at 127.0.0.1:52098
I20260709 13:10:13.471154 30038 tablet_copy_service.cc:434] P b2cea0098c1040f69755ea4d3dab7fc4: ending tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-ea42d6bd0dbb4438a96c31b335069e3c on tablet ea42d6bd0dbb4438a96c31b335069e3c with peer 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:13.476511 31136 tablet_copy_client.cc:538] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:13.484805 31136 tablet_bootstrap.cc:492] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap starting.
I20260709 13:10:13.497051 31131 ts_tablet_manager.cc:933] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a: Initiating tablet copy from peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:13.506975 31136 tablet_bootstrap.cc:492] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:13.507879 31136 tablet_bootstrap.cc:492] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap complete.
I20260709 13:10:13.508555 31136 ts_tablet_manager.cc:1403] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent bootstrapping tablet: real 0.024s	user 0.022s	sys 0.001s
I20260709 13:10:13.511315 31136 raft_consensus.cc:359] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:13.512137 31136 raft_consensus.cc:740] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Initialized, Role: LEARNER
I20260709 13:10:13.512800 31136 consensus_queue.cc:260] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:13.515022 31136 ts_tablet_manager.cc:1434] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:13.517158 31131 tablet_copy_client.cc:323] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Beginning tablet copy session from remote peer at address 127.28.54.67:45001
I20260709 13:10:13.519182 30187 tablet_copy_service.cc:140] P c99569d27a6f4c648eae7119fe3db124: Received BeginTabletCopySession request for tablet d7be23af8c824b3bb048a59d6bdf884c from peer 6f3eb161e2194f6891f12e2cfcaaf73a ({username='slave'} at 127.0.0.1:54540)
I20260709 13:10:13.519729 30187 tablet_copy_service.cc:161] P c99569d27a6f4c648eae7119fe3db124: Beginning new tablet copy session on tablet d7be23af8c824b3bb048a59d6bdf884c from peer 6f3eb161e2194f6891f12e2cfcaaf73a at {username='slave'} at 127.0.0.1:54540: session id = 6f3eb161e2194f6891f12e2cfcaaf73a-d7be23af8c824b3bb048a59d6bdf884c
I20260709 13:10:13.526889 30187 tablet_copy_source_session.cc:215] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:13.519210 30113 tablet_copy_service.cc:342] P 5ec73dc157ed476ca903a7d596271719: Request end of tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-fe9a5ae7a3c04826a4bdde9445be46bb received from {username='slave'} at 127.0.0.1:48558
I20260709 13:10:13.528313 30113 tablet_copy_service.cc:434] P 5ec73dc157ed476ca903a7d596271719: ending tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-fe9a5ae7a3c04826a4bdde9445be46bb on tablet fe9a5ae7a3c04826a4bdde9445be46bb with peer 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:13.532910 31131 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7be23af8c824b3bb048a59d6bdf884c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:13.544287 31131 tablet_copy_client.cc:806] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:13.544754 31131 tablet_copy_client.cc:670] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:13.547595 31131 tablet_copy_client.cc:538] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:13.553395 31131 tablet_bootstrap.cc:492] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap starting.
I20260709 13:10:13.568295 31131 tablet_bootstrap.cc:492] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:13.568866 31131 tablet_bootstrap.cc:492] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap complete.
I20260709 13:10:13.569301 31131 ts_tablet_manager.cc:1403] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 13:10:13.571450 31131 raft_consensus.cc:359] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:13.571944 31131 raft_consensus.cc:740] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Initialized, Role: LEARNER
I20260709 13:10:13.572350 31131 consensus_queue.cc:260] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:13.573812 31131 ts_tablet_manager.cc:1434] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.004s
I20260709 13:10:13.575299 30187 tablet_copy_service.cc:342] P c99569d27a6f4c648eae7119fe3db124: Request end of tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-d7be23af8c824b3bb048a59d6bdf884c received from {username='slave'} at 127.0.0.1:54540
I20260709 13:10:13.575615 30187 tablet_copy_service.cc:434] P c99569d27a6f4c648eae7119fe3db124: ending tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-d7be23af8c824b3bb048a59d6bdf884c on tablet d7be23af8c824b3bb048a59d6bdf884c with peer 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:13.853945 30737 raft_consensus.cc:1217] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:13.865551 30737 raft_consensus.cc:1217] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:13.938980 30737 raft_consensus.cc:1217] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 13:10:13.998180 30737 raft_consensus.cc:1217] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEARNER]: Deduplicated request from leader. Original: 2.1->[2.2-2.2]   Dedup: 2.2->[]
I20260709 13:10:14.232309 30982 raft_consensus.cc:1064] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4: attempting to promote NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a to VOTER
I20260709 13:10:14.236789 30982 consensus_queue.cc:237] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:14.243325 30173 raft_consensus.cc:1275] T ea42d6bd0dbb4438a96c31b335069e3c P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:14.243860 30737 raft_consensus.cc:1275] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:14.244891 30098 raft_consensus.cc:1275] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:14.244675 31114 consensus_queue.cc:1048] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:14.246120 31013 consensus_queue.cc:1048] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:14.247259 30982 consensus_queue.cc:1048] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:14.257550 30982 raft_consensus.cc:2955] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:14.258981 30103 raft_consensus.cc:2955] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:14.279790 30173 raft_consensus.cc:2955] T ea42d6bd0dbb4438a96c31b335069e3c P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:14.282197 30737 raft_consensus.cc:2955] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:14.283926 29925 catalog_manager.cc:5697] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:14.324599 30025 consensus_queue.cc:237] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:14.330547 30735 raft_consensus.cc:1275] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:14.330994 30103 raft_consensus.cc:1275] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:14.332123 31114 consensus_queue.cc:1048] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:14.333001 31146 raft_consensus.cc:1064] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4: attempting to promote NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a to VOTER
I20260709 13:10:14.332923 31013 consensus_queue.cc:1048] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:14.335460 31146 consensus_queue.cc:237] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:14.339473 30982 raft_consensus.cc:2955] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:14.345073 30173 raft_consensus.cc:1275] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:14.347851 31114 consensus_queue.cc:1048] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:14.350919 30737 raft_consensus.cc:1275] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:14.350965 30098 raft_consensus.cc:1275] T 632c5405056e40be8152973f0c966318 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:14.345044 30735 raft_consensus.cc:2955] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:14.358772 31114 consensus_queue.cc:1048] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:14.362347 31152 consensus_queue.cc:1048] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:14.366333 30103 raft_consensus.cc:2955] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:14.375653 29910 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ea42d6bd0dbb4438a96c31b335069e3c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:14.388485 29922 catalog_manager.cc:5697] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: config changed from index 3 to 4, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:14.403072 30164 tablet_service.cc:1558] Processing DeleteTablet for tablet ea42d6bd0dbb4438a96c31b335069e3c with delete_type TABLET_DATA_TOMBSTONED (TS c99569d27a6f4c648eae7119fe3db124 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43828
I20260709 13:10:14.407627 31155 raft_consensus.cc:2955] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:14.409730 30177 raft_consensus.cc:2955] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:14.418433 30098 raft_consensus.cc:2955] T 632c5405056e40be8152973f0c966318 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:14.421371 31125 raft_consensus.cc:1064] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124: attempting to promote NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a to VOTER
I20260709 13:10:14.423368 30737 raft_consensus.cc:2955] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:14.424007 31125 consensus_queue.cc:237] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:14.430796 31159 tablet_replica.cc:333] T ea42d6bd0dbb4438a96c31b335069e3c P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:10:14.431890 31159 raft_consensus.cc:2243] T ea42d6bd0dbb4438a96c31b335069e3c P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:14.432643 31159 raft_consensus.cc:2272] T ea42d6bd0dbb4438a96c31b335069e3c P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.450400 30027 raft_consensus.cc:1275] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:14.451471 31125 consensus_queue.cc:1048] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:14.459332 29922 catalog_manager.cc:5697] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:14.465242 30737 raft_consensus.cc:1275] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEARNER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:14.516111 30024 consensus_queue.cc:237] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:14.520066 30098 raft_consensus.cc:1275] T d7be23af8c824b3bb048a59d6bdf884c P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:14.515795 31161 consensus_queue.cc:1048] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 13:10:14.520677 30737 raft_consensus.cc:1275] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:14.521915 31155 consensus_queue.cc:1048] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:14.527643 30177 raft_consensus.cc:1275] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:14.528890 31153 consensus_queue.cc:1048] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:14.534889 31155 raft_consensus.cc:2955] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:14.551895 31047 raft_consensus.cc:1064] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719: attempting to promote NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a to VOTER
I20260709 13:10:14.552989 30177 raft_consensus.cc:2955] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:14.553897 31047 consensus_queue.cc:237] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 0, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:14.557662 31064 consensus_queue.cc:1048] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:14.554764 30737 raft_consensus.cc:2955] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:14.557288 29910 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 632c5405056e40be8152973f0c966318 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:14.569975 31159 ts_tablet_manager.cc:1916] T ea42d6bd0dbb4438a96c31b335069e3c P c99569d27a6f4c648eae7119fe3db124: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:14.570312 29922 catalog_manager.cc:5697] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: config changed from index 3 to 4, VOTER 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) evicted. New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:14.590848 31064 raft_consensus.cc:2955] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:14.594923 30103 raft_consensus.cc:2955] T d7be23af8c824b3bb048a59d6bdf884c P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:14.598860 30735 raft_consensus.cc:2955] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:14.616420 30173 raft_consensus.cc:1275] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:14.617774 30027 raft_consensus.cc:1275] T fe9a5ae7a3c04826a4bdde9445be46bb P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:14.618768 30735 raft_consensus.cc:1275] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEARNER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:14.619016 31047 consensus_queue.cc:1048] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:14.621270 29921 catalog_manager.cc:5697] T d7be23af8c824b3bb048a59d6bdf884c P 5ec73dc157ed476ca903a7d596271719 reported cstate change: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:14.625355 30027 raft_consensus.cc:2955] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:14.627893 31159 ts_tablet_manager.cc:1929] T ea42d6bd0dbb4438a96c31b335069e3c P c99569d27a6f4c648eae7119fe3db124: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:14.628345 31159 log.cc:1199] T ea42d6bd0dbb4438a96c31b335069e3c P c99569d27a6f4c648eae7119fe3db124: Deleting WAL directory at /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-2-root/wals/ea42d6bd0dbb4438a96c31b335069e3c
I20260709 13:10:14.631212 29912 catalog_manager.cc:5028] TS c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): tablet ea42d6bd0dbb4438a96c31b335069e3c (table test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]) successfully deleted
I20260709 13:10:14.631036 31047 consensus_queue.cc:1048] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:14.635035 31112 consensus_queue.cc:1048] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:14.638176 30091 tablet_service.cc:1558] Processing DeleteTablet for tablet 632c5405056e40be8152973f0c966318 with delete_type TABLET_DATA_TOMBSTONED (TS 5ec73dc157ed476ca903a7d596271719 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33984
I20260709 13:10:14.664693 31047 raft_consensus.cc:2955] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:14.666997 30736 raft_consensus.cc:2955] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:14.681449 30177 consensus_queue.cc:237] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:14.683708 30171 raft_consensus.cc:2955] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:14.700229 30023 raft_consensus.cc:2955] T fe9a5ae7a3c04826a4bdde9445be46bb P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:14.704277 31167 tablet_replica.cc:333] T 632c5405056e40be8152973f0c966318 P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:10:14.706137 31167 raft_consensus.cc:2243] T 632c5405056e40be8152973f0c966318 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:14.707474 31167 raft_consensus.cc:2272] T 632c5405056e40be8152973f0c966318 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.712536 31167 ts_tablet_manager.cc:1916] T 632c5405056e40be8152973f0c966318 P 5ec73dc157ed476ca903a7d596271719: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:14.681918 29924 catalog_manager.cc:5697] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:14.733494 30736 raft_consensus.cc:1275] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:10:14.734992 31161 consensus_queue.cc:1048] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:14.736967 30023 raft_consensus.cc:1275] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:10:14.738246 31161 consensus_queue.cc:1048] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:14.740032 30103 consensus_queue.cc:237] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:14.743778 31167 ts_tablet_manager.cc:1929] T 632c5405056e40be8152973f0c966318 P 5ec73dc157ed476ca903a7d596271719: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:14.744253 31167 log.cc:1199] T 632c5405056e40be8152973f0c966318 P 5ec73dc157ed476ca903a7d596271719: Deleting WAL directory at /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-1-root/wals/632c5405056e40be8152973f0c966318
I20260709 13:10:14.744711 31064 raft_consensus.cc:2955] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:14.746626 30736 raft_consensus.cc:1275] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:10:14.753969 31047 consensus_queue.cc:1048] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:14.749841 29913 catalog_manager.cc:5028] TS 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): tablet 632c5405056e40be8152973f0c966318 (table test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]) successfully deleted
I20260709 13:10:14.763387 30735 raft_consensus.cc:2955] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:14.765607 31112 raft_consensus.cc:2955] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:14.768786 30736 raft_consensus.cc:2955] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:14.775287 30023 raft_consensus.cc:2955] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:14.747375 30177 raft_consensus.cc:1275] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:10:14.778508 29912 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d7be23af8c824b3bb048a59d6bdf884c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:14.790767 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:14.792721 31047 consensus_queue.cc:1048] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:14.794137 29923 catalog_manager.cc:5697] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: config changed from index 3 to 4, VOTER 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) evicted. New cstate: current_term: 2 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:14.801535 29913 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet fe9a5ae7a3c04826a4bdde9445be46bb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:14.801604 30177 raft_consensus.cc:2955] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:14.814935 30091 tablet_service.cc:1558] Processing DeleteTablet for tablet d7be23af8c824b3bb048a59d6bdf884c with delete_type TABLET_DATA_TOMBSTONED (TS 5ec73dc157ed476ca903a7d596271719 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33984
I20260709 13:10:14.815917 31167 tablet_replica.cc:333] T d7be23af8c824b3bb048a59d6bdf884c P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:10:14.816915 31167 raft_consensus.cc:2243] T d7be23af8c824b3bb048a59d6bdf884c P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:14.817667 31167 raft_consensus.cc:2272] T d7be23af8c824b3bb048a59d6bdf884c P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.821934 29922 catalog_manager.cc:5697] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: config changed from index 3 to 4, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New cstate: current_term: 2 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:14.829015 31167 ts_tablet_manager.cc:1916] T d7be23af8c824b3bb048a59d6bdf884c P 5ec73dc157ed476ca903a7d596271719: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:14.837543 30009 tablet_service.cc:1558] Processing DeleteTablet for tablet fe9a5ae7a3c04826a4bdde9445be46bb with delete_type TABLET_DATA_TOMBSTONED (TS b2cea0098c1040f69755ea4d3dab7fc4 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54192
I20260709 13:10:14.858232 31167 ts_tablet_manager.cc:1929] T d7be23af8c824b3bb048a59d6bdf884c P 5ec73dc157ed476ca903a7d596271719: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 13:10:14.858786 31167 log.cc:1199] T d7be23af8c824b3bb048a59d6bdf884c P 5ec73dc157ed476ca903a7d596271719: Deleting WAL directory at /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-1-root/wals/d7be23af8c824b3bb048a59d6bdf884c
I20260709 13:10:14.860453 29913 catalog_manager.cc:5028] TS 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): tablet d7be23af8c824b3bb048a59d6bdf884c (table test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]) successfully deleted
I20260709 13:10:14.862290 31171 tablet_replica.cc:333] T fe9a5ae7a3c04826a4bdde9445be46bb P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:10:14.864881 31171 raft_consensus.cc:2243] T fe9a5ae7a3c04826a4bdde9445be46bb P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:14.865669 31171 raft_consensus.cc:2272] T fe9a5ae7a3c04826a4bdde9445be46bb P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:14.870182 31171 ts_tablet_manager.cc:1916] T fe9a5ae7a3c04826a4bdde9445be46bb P b2cea0098c1040f69755ea4d3dab7fc4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:14.886054 31171 ts_tablet_manager.cc:1929] T fe9a5ae7a3c04826a4bdde9445be46bb P b2cea0098c1040f69755ea4d3dab7fc4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.3
I20260709 13:10:14.886504 31171 log.cc:1199] T fe9a5ae7a3c04826a4bdde9445be46bb P b2cea0098c1040f69755ea4d3dab7fc4: Deleting WAL directory at /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-0-root/wals/fe9a5ae7a3c04826a4bdde9445be46bb
I20260709 13:10:14.888324 29910 catalog_manager.cc:5028] TS b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): tablet fe9a5ae7a3c04826a4bdde9445be46bb (table test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]) successfully deleted
I20260709 13:10:14.903333 30098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9"
dest_uuid: "5ec73dc157ed476ca903a7d596271719"
mode: GRACEFUL
new_leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
 from {username='slave'} at 127.0.0.1:37340
I20260709 13:10:14.903816 30098 raft_consensus.cc:606] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Received request to transfer leadership to TS 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:14.905882 30098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833"
dest_uuid: "5ec73dc157ed476ca903a7d596271719"
mode: GRACEFUL
new_leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
 from {username='slave'} at 127.0.0.1:37340
I20260709 13:10:14.906273 30098 raft_consensus.cc:606] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Received request to transfer leadership to TS 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:14.908267 30098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f"
dest_uuid: "5ec73dc157ed476ca903a7d596271719"
mode: GRACEFUL
new_leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
 from {username='slave'} at 127.0.0.1:37340
I20260709 13:10:14.908663 30098 raft_consensus.cc:606] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Received request to transfer leadership to TS 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:14.919459 30025 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
mode: GRACEFUL
new_leader_uuid: "5ec73dc157ed476ca903a7d596271719"
 from {username='slave'} at 127.0.0.1:47450
I20260709 13:10:14.919984 30025 raft_consensus.cc:606] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Received request to transfer leadership to TS 5ec73dc157ed476ca903a7d596271719
I20260709 13:10:14.922302 30098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad"
dest_uuid: "5ec73dc157ed476ca903a7d596271719"
mode: GRACEFUL
new_leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
 from {username='slave'} at 127.0.0.1:37340
I20260709 13:10:14.922825 30098 raft_consensus.cc:606] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Received request to transfer leadership to TS 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:14.926016 30098 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b38ec265ce704d799b58d99914a46422"
dest_uuid: "5ec73dc157ed476ca903a7d596271719"
mode: GRACEFUL
new_leader_uuid: "c99569d27a6f4c648eae7119fe3db124"
 from {username='slave'} at 127.0.0.1:37340
I20260709 13:10:14.926469 30098 raft_consensus.cc:606] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Received request to transfer leadership to TS c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:14.936617 30177 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c"
dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
mode: GRACEFUL
new_leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
 from {username='slave'} at 127.0.0.1:38454
I20260709 13:10:14.937150 30177 raft_consensus.cc:606] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 2 LEADER]: Received request to transfer leadership to TS 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:14.938508 28889 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 13:10:14.939898 28889 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:14.954483 31112 raft_consensus.cc:993] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719: : Instructing follower 6f3eb161e2194f6891f12e2cfcaaf73a to start an election
I20260709 13:10:14.954955 31047 raft_consensus.cc:1081] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Signalling peer 6f3eb161e2194f6891f12e2cfcaaf73a to start an election
I20260709 13:10:14.956135 30736 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9"
dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
 from {username='slave'} at 127.0.0.1:56954
I20260709 13:10:14.956564 30736 raft_consensus.cc:493] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:14.956815 30736 raft_consensus.cc:3060] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.961251 30736 raft_consensus.cc:515] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:14.963701 30736 leader_election.cc:290] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:14.964607 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:14.964617 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:14.965365 30098 raft_consensus.cc:3055] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:14.965523 30177 raft_consensus.cc:3060] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.965801 30098 raft_consensus.cc:740] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:14.966670 30098 consensus_queue.cc:260] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:14.967594 31112 raft_consensus.cc:993] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719: : Instructing follower 6f3eb161e2194f6891f12e2cfcaaf73a to start an election
I20260709 13:10:14.968782 31047 raft_consensus.cc:1081] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Signalling peer 6f3eb161e2194f6891f12e2cfcaaf73a to start an election
I20260709 13:10:14.969834 30098 raft_consensus.cc:3060] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.970199 30735 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833"
dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
 from {username='slave'} at 127.0.0.1:56954
I20260709 13:10:14.970722 30735 raft_consensus.cc:493] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:14.970741 31153 raft_consensus.cc:993] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4: : Instructing follower 5ec73dc157ed476ca903a7d596271719 to start an election
I20260709 13:10:14.971159 30735 raft_consensus.cc:3060] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.971345 31153 raft_consensus.cc:1081] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Signalling peer 5ec73dc157ed476ca903a7d596271719 to start an election
I20260709 13:10:14.972975 30103 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8"
dest_uuid: "5ec73dc157ed476ca903a7d596271719"
 from {username='slave'} at 127.0.0.1:33990
I20260709 13:10:14.973433 30103 raft_consensus.cc:493] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:14.973717 30103 raft_consensus.cc:3060] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.975355 30177 raft_consensus.cc:2468] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 2.
I20260709 13:10:14.976281 30098 raft_consensus.cc:2468] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 2.
I20260709 13:10:14.977317 30703 leader_election.cc:304] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:10:14.977182 30735 raft_consensus.cc:515] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:14.978085 31134 raft_consensus.cc:2804] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:14.980958 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:14.981540 30101 raft_consensus.cc:3055] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:14.981833 30101 raft_consensus.cc:740] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:14.982544 30101 consensus_queue.cc:260] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:14.983549 30101 raft_consensus.cc:3060] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.983970 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:14.983860 30103 raft_consensus.cc:515] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:14.984557 30177 raft_consensus.cc:3060] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.980983 30735 leader_election.cc:290] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:14.982547 31134 raft_consensus.cc:697] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:14.988999 31134 consensus_queue.cc:237] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:14.990041 30101 raft_consensus.cc:2468] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 2.
I20260709 13:10:14.993000 30703 leader_election.cc:304] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:10:14.993687 31176 raft_consensus.cc:2804] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:14.995275 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:14.995848 30023 raft_consensus.cc:3055] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:14.993394 30177 raft_consensus.cc:2468] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 2.
I20260709 13:10:14.996142 30023 raft_consensus.cc:740] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:14.997136 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:14.991844 30103 leader_election.cc:290] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:14.997212 30023 consensus_queue.cc:260] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:14.998413 30023 raft_consensus.cc:3060] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.998837 31176 raft_consensus.cc:697] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:14.997772 30171 raft_consensus.cc:3060] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:14.999683 31176 consensus_queue.cc:237] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:15.006295 30171 raft_consensus.cc:2468] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
I20260709 13:10:15.008087 30068 leader_election.cc:304] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:15.008821 30023 raft_consensus.cc:2468] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
I20260709 13:10:15.009199 31047 raft_consensus.cc:2804] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:15.010366 31047 raft_consensus.cc:697] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 2 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:15.010105 29922 catalog_manager.cc:5697] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: term changed from 1 to 2, leader changed from 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) to 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68). New cstate: current_term: 2 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:15.012895 31047 consensus_queue.cc:237] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:15.023873 29924 catalog_manager.cc:5697] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: term changed from 1 to 2, leader changed from 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) to 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68). New cstate: current_term: 2 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:15.024003 29922 catalog_manager.cc:5697] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 1 to 2, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 2 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:15.134363 31112 raft_consensus.cc:993] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719: : Instructing follower 6f3eb161e2194f6891f12e2cfcaaf73a to start an election
I20260709 13:10:15.134776 31112 raft_consensus.cc:1081] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Signalling peer 6f3eb161e2194f6891f12e2cfcaaf73a to start an election
I20260709 13:10:15.136034 30736 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f"
dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
 from {username='slave'} at 127.0.0.1:56954
I20260709 13:10:15.136518 30736 raft_consensus.cc:493] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:15.136752 30736 raft_consensus.cc:3060] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:15.141618 30736 raft_consensus.cc:515] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:15.143100 30736 leader_election.cc:290] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:15.143786 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:15.144136 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:15.144330 30023 raft_consensus.cc:3060] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:15.144589 30102 raft_consensus.cc:3055] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:15.144850 30102 raft_consensus.cc:740] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:15.145354 30102 consensus_queue.cc:260] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:15.146389 30102 raft_consensus.cc:3060] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:15.149533 30023 raft_consensus.cc:2468] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 2.
I20260709 13:10:15.150867 30700 leader_election.cc:304] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:15.151614 31176 raft_consensus.cc:2804] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:15.151769 30102 raft_consensus.cc:2468] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 2.
I20260709 13:10:15.152145 31176 raft_consensus.cc:697] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:15.153043 31176 consensus_queue.cc:237] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:15.160566 29922 catalog_manager.cc:5697] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: term changed from 1 to 2, leader changed from 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) to 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68). New cstate: current_term: 2 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:15.162087 31047 raft_consensus.cc:993] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719: : Instructing follower 6f3eb161e2194f6891f12e2cfcaaf73a to start an election
I20260709 13:10:15.162474 31112 raft_consensus.cc:1081] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Signalling peer 6f3eb161e2194f6891f12e2cfcaaf73a to start an election
I20260709 13:10:15.163796 30736 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad"
dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
 from {username='slave'} at 127.0.0.1:56954
I20260709 13:10:15.164268 30736 raft_consensus.cc:493] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:15.164588 30736 raft_consensus.cc:3060] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:15.169809 30736 raft_consensus.cc:515] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:15.171388 30736 leader_election.cc:290] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:15.171908 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:15.172217 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:15.172353 30102 raft_consensus.cc:3055] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:15.172678 30171 raft_consensus.cc:3060] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:15.172688 30102 raft_consensus.cc:740] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:15.173465 30102 consensus_queue.cc:260] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:15.174436 30102 raft_consensus.cc:3060] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:15.177681 30171 raft_consensus.cc:2468] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 2.
I20260709 13:10:15.178808 30702 leader_election.cc:304] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:15.178936 30102 raft_consensus.cc:2468] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 2.
I20260709 13:10:15.179556 31176 raft_consensus.cc:2804] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:15.179920 31176 raft_consensus.cc:697] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:15.180629 31176 consensus_queue.cc:237] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:15.185000 31064 raft_consensus.cc:993] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124: : Instructing follower 6f3eb161e2194f6891f12e2cfcaaf73a to start an election
I20260709 13:10:15.185415 31160 raft_consensus.cc:1081] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 2 LEADER]: Signalling peer 6f3eb161e2194f6891f12e2cfcaaf73a to start an election
I20260709 13:10:15.187501 30736 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c"
dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
 from {username='slave'} at 127.0.0.1:51004
I20260709 13:10:15.188037 30736 raft_consensus.cc:493] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:15.189733 30736 raft_consensus.cc:3060] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:15.189185 29922 catalog_manager.cc:5697] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: term changed from 1 to 2, leader changed from 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) to 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68). New cstate: current_term: 2 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:15.204531 30736 raft_consensus.cc:515] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:15.206346 30736 leader_election.cc:290] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 3 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:15.206802 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:15.207293 30171 raft_consensus.cc:3055] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:15.207515 30171 raft_consensus.cc:740] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:15.208086 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:15.208076 30171 consensus_queue.cc:260] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:15.208582 30023 raft_consensus.cc:3060] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:15.209056 30171 raft_consensus.cc:3060] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:15.212622 30023 raft_consensus.cc:2468] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 3.
I20260709 13:10:15.213207 30171 raft_consensus.cc:2468] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 3.
I20260709 13:10:15.213496 30700 leader_election.cc:304] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:15.214279 31176 raft_consensus.cc:2804] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:15.214685 31176 raft_consensus.cc:697] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:15.215261 31176 consensus_queue.cc:237] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:15.224927 29922 catalog_manager.cc:5697] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: term changed from 2 to 3, leader changed from c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) to 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68). New cstate: current_term: 3 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:15.334102 31047 raft_consensus.cc:993] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719: : Instructing follower c99569d27a6f4c648eae7119fe3db124 to start an election
I20260709 13:10:15.334592 31062 raft_consensus.cc:1081] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Signalling peer c99569d27a6f4c648eae7119fe3db124 to start an election
I20260709 13:10:15.335772 30171 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b38ec265ce704d799b58d99914a46422"
dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
 from {username='slave'} at 127.0.0.1:43840
I20260709 13:10:15.336179 30171 raft_consensus.cc:493] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:15.336443 30171 raft_consensus.cc:3060] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:15.341550 30171 raft_consensus.cc:515] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:15.343107 30171 leader_election.cc:290] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 2 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:15.344166 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:15.344188 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:15.344784 30103 raft_consensus.cc:3055] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:15.345072 30023 raft_consensus.cc:3060] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:15.345073 30103 raft_consensus.cc:740] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:15.345919 30103 consensus_queue.cc:260] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:15.346712 30103 raft_consensus.cc:3060] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:15.351658 30023 raft_consensus.cc:2468] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 2.
I20260709 13:10:15.353492 30140 leader_election.cc:304] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:15.353747 30103 raft_consensus.cc:2468] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 2.
I20260709 13:10:15.354406 31064 raft_consensus.cc:2804] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:15.354803 31064 raft_consensus.cc:697] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 2 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:15.355510 31064 consensus_queue.cc:237] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:15.366653 29922 catalog_manager.cc:5697] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 1 to 2, leader changed from 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 2 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:15.383350 30171 raft_consensus.cc:1275] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:15.384384 31176 consensus_queue.cc:1048] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:15.402099 30102 raft_consensus.cc:1275] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:15.403348 31176 consensus_queue.cc:1048] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:15.406776 30103 raft_consensus.cc:1275] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:15.409489 31176 consensus_queue.cc:1048] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:15.420835 30171 raft_consensus.cc:1275] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:15.422137 31176 consensus_queue.cc:1048] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:15.448130 30023 raft_consensus.cc:1275] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:15.449342 31112 consensus_queue.cc:1048] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:15.459702 30171 raft_consensus.cc:1275] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:15.465255 31047 consensus_queue.cc:1048] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:15.542452 30102 raft_consensus.cc:1275] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:15.543519 31176 consensus_queue.cc:1048] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:15.556218 30024 raft_consensus.cc:1275] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:15.557893 31134 consensus_queue.cc:1048] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:15.688753 30171 raft_consensus.cc:1275] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:15.690160 31134 consensus_queue.cc:1048] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:15.696967 30024 raft_consensus.cc:1275] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:15.698501 31134 consensus_queue.cc:1048] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:15.707415 30171 raft_consensus.cc:1275] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:15.709805 30103 raft_consensus.cc:1275] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:15.710227 31177 consensus_queue.cc:1048] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:15.712343 31177 consensus_queue.cc:1048] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:15.737596 30103 raft_consensus.cc:1275] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:15.738866 31064 consensus_queue.cc:1048] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:15.752188 30024 raft_consensus.cc:1275] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:15.753334 31200 consensus_queue.cc:1048] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:15.906404 30177 consensus_queue.cc:237] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
W20260709 13:10:15.912875 30142 consensus_peers.cc:597] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 -> Peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469): Couldn't send request to peer 6f3eb161e2194f6891f12e2cfcaaf73a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 64effd13e9a741368e16bc2f52fb573c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:15.913625 30024 raft_consensus.cc:1275] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:15.914711 31200 consensus_queue.cc:1048] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:15.915128 30102 raft_consensus.cc:1275] T 64effd13e9a741368e16bc2f52fb573c P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:15.916285 31064 consensus_queue.cc:1048] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:15.924990 31200 raft_consensus.cc:2955] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:15.926663 30024 raft_consensus.cc:2955] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:15.931223 30102 raft_consensus.cc:2955] T 64effd13e9a741368e16bc2f52fb573c P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:15.940856 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:15.948033 30101 consensus_queue.cc:237] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:15.949689 29924 catalog_manager.cc:5697] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New cstate: current_term: 1 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:15.972592 30023 raft_consensus.cc:1275] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:15.973938 31062 consensus_queue.cc:1048] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:15.977144 30177 raft_consensus.cc:1275] T f5c869d5410b4a83adc1ca35397defb6 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:10:15.979135 30068 consensus_peers.cc:597] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 -> Peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469): Couldn't send request to peer 6f3eb161e2194f6891f12e2cfcaaf73a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f5c869d5410b4a83adc1ca35397defb6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:15.982901 31062 consensus_queue.cc:1048] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:15.987183 31112 raft_consensus.cc:2955] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:15.996583 30023 raft_consensus.cc:2955] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:16.005128 30171 consensus_queue.cc:237] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:16.016453 29923 catalog_manager.cc:5697] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:16.024181 30023 raft_consensus.cc:1275] T b52e70a06b534fbf90cbcb6a010e9d43 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:16.024402 30102 raft_consensus.cc:1275] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:16.026253 31200 consensus_queue.cc:1048] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:16.028021 31200 consensus_queue.cc:1048] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:16.028771 30142 consensus_peers.cc:597] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 -> Peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469): Couldn't send request to peer 6f3eb161e2194f6891f12e2cfcaaf73a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b52e70a06b534fbf90cbcb6a010e9d43. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:16.040820 31160 raft_consensus.cc:2955] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:16.040759 30171 raft_consensus.cc:2955] T f5c869d5410b4a83adc1ca35397defb6 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:16.060518 30023 raft_consensus.cc:2955] T b52e70a06b534fbf90cbcb6a010e9d43 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:16.066864 29923 catalog_manager.cc:5697] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New cstate: current_term: 1 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.068511 30024 consensus_queue.cc:237] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:16.059162 30101 raft_consensus.cc:2955] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:16.085507 30177 raft_consensus.cc:1275] T 9cd772608bf64bf9b1c1aec00dc57eee P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:16.088786 31155 consensus_queue.cc:1048] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:16.098636 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:10:16.118062 29993 consensus_peers.cc:597] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 -> Peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469): Couldn't send request to peer 6f3eb161e2194f6891f12e2cfcaaf73a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9cd772608bf64bf9b1c1aec00dc57eee. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:16.122525 30102 raft_consensus.cc:1275] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:16.123879 31153 consensus_queue.cc:1048] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:16.126185 30177 raft_consensus.cc:2955] T 9cd772608bf64bf9b1c1aec00dc57eee P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:16.129093 30101 raft_consensus.cc:2955] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:16.145066 29923 catalog_manager.cc:5697] T 9cd772608bf64bf9b1c1aec00dc57eee P c99569d27a6f4c648eae7119fe3db124 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:16.121788 31215 raft_consensus.cc:2955] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:16.192653 30024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
mode: GRACEFUL
new_leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
 from {username='slave'} at 127.0.0.1:47450
I20260709 13:10:16.193209 30024 raft_consensus.cc:606] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Received request to transfer leadership to TS 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:16.198439 30177 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c"
dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
mode: GRACEFUL
new_leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
 from {username='slave'} at 127.0.0.1:38454
I20260709 13:10:16.198891 30177 raft_consensus.cc:606] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Received request to transfer leadership to TS b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:16.201043 30024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
mode: GRACEFUL
new_leader_uuid: "5ec73dc157ed476ca903a7d596271719"
 from {username='slave'} at 127.0.0.1:47450
I20260709 13:10:16.201419 30024 raft_consensus.cc:606] T b66f98d7fcfe4102a01ace9ed64355ed P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Received request to transfer leadership to TS 5ec73dc157ed476ca903a7d596271719
I20260709 13:10:16.203439 30101 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9"
dest_uuid: "5ec73dc157ed476ca903a7d596271719"
mode: GRACEFUL
new_leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
 from {username='slave'} at 127.0.0.1:37340
I20260709 13:10:16.203804 30101 raft_consensus.cc:606] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Received request to transfer leadership to TS 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:16.205746 30024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5616428acc64e24945a779e1aee597f"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
mode: GRACEFUL
new_leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
 from {username='slave'} at 127.0.0.1:47450
I20260709 13:10:16.206175 30024 raft_consensus.cc:606] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Received request to transfer leadership to TS 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:16.208355 30024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
mode: GRACEFUL
new_leader_uuid: "5ec73dc157ed476ca903a7d596271719"
 from {username='slave'} at 127.0.0.1:47450
I20260709 13:10:16.208801 30024 raft_consensus.cc:606] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Received request to transfer leadership to TS 5ec73dc157ed476ca903a7d596271719
I20260709 13:10:16.209954 28889 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:10:16.211309 28889 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:16.226665 31153 raft_consensus.cc:993] T b66f98d7fcfe4102a01ace9ed64355ed P b2cea0098c1040f69755ea4d3dab7fc4: : Instructing follower 5ec73dc157ed476ca903a7d596271719 to start an election
I20260709 13:10:16.227181 31216 raft_consensus.cc:1081] T b66f98d7fcfe4102a01ace9ed64355ed P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Signalling peer 5ec73dc157ed476ca903a7d596271719 to start an election
I20260709 13:10:16.228559 30101 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed"
dest_uuid: "5ec73dc157ed476ca903a7d596271719"
 from {username='slave'} at 127.0.0.1:33990
I20260709 13:10:16.229058 30101 raft_consensus.cc:493] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:16.229377 30101 raft_consensus.cc:3060] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.235388 30101 raft_consensus.cc:515] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:16.237113 30101 leader_election.cc:290] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:16.237723 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:16.238253 30024 raft_consensus.cc:3055] T b66f98d7fcfe4102a01ace9ed64355ed P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:16.238370 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:16.238559 30024 raft_consensus.cc:740] T b66f98d7fcfe4102a01ace9ed64355ed P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:16.238891 30177 raft_consensus.cc:3060] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.239241 30024 consensus_queue.cc:260] T b66f98d7fcfe4102a01ace9ed64355ed P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:16.240330 30024 raft_consensus.cc:3060] T b66f98d7fcfe4102a01ace9ed64355ed P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.246196 30024 raft_consensus.cc:2468] T b66f98d7fcfe4102a01ace9ed64355ed P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
I20260709 13:10:16.247315 30066 leader_election.cc:304] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:16.247442 30177 raft_consensus.cc:2468] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
I20260709 13:10:16.247987 31047 raft_consensus.cc:2804] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:16.248365 31047 raft_consensus.cc:697] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 2 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:16.249033 31047 consensus_queue.cc:237] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:16.257892 29922 catalog_manager.cc:5697] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 1 to 2, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 2 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.297572 31153 raft_consensus.cc:993] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4: : Instructing follower 6f3eb161e2194f6891f12e2cfcaaf73a to start an election
I20260709 13:10:16.298074 31216 raft_consensus.cc:1081] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Signalling peer 6f3eb161e2194f6891f12e2cfcaaf73a to start an election
I20260709 13:10:16.299304 30736 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5616428acc64e24945a779e1aee597f"
dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
 from {username='slave'} at 127.0.0.1:51014
I20260709 13:10:16.299687 30736 raft_consensus.cc:493] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:16.299937 30736 raft_consensus.cc:3060] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.305531 30736 raft_consensus.cc:515] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:16.309455 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:16.310017 30024 raft_consensus.cc:3055] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:16.310318 30024 raft_consensus.cc:740] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:16.310967 30024 consensus_queue.cc:260] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:16.311919 30024 raft_consensus.cc:3060] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.311164 30736 leader_election.cc:290] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:16.312376 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:16.314019 30177 raft_consensus.cc:3060] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.318634 30024 raft_consensus.cc:2468] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 2.
I20260709 13:10:16.319763 30700 leader_election.cc:304] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:16.320801 31176 raft_consensus.cc:2804] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:16.321240 31176 raft_consensus.cc:697] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:16.321991 31176 consensus_queue.cc:237] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:16.324189 30177 raft_consensus.cc:2468] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 2.
I20260709 13:10:16.332006 29922 catalog_manager.cc:5697] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: term changed from 1 to 2, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68). New cstate: current_term: 2 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:16.369524 31221 ts_tablet_manager.cc:933] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a: Initiating tablet copy from peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:16.371142 31221 tablet_copy_client.cc:323] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Beginning tablet copy session from remote peer at address 127.28.54.67:45001
I20260709 13:10:16.372553 30187 tablet_copy_service.cc:140] P c99569d27a6f4c648eae7119fe3db124: Received BeginTabletCopySession request for tablet 64effd13e9a741368e16bc2f52fb573c from peer 6f3eb161e2194f6891f12e2cfcaaf73a ({username='slave'} at 127.0.0.1:54540)
I20260709 13:10:16.373044 30187 tablet_copy_service.cc:161] P c99569d27a6f4c648eae7119fe3db124: Beginning new tablet copy session on tablet 64effd13e9a741368e16bc2f52fb573c from peer 6f3eb161e2194f6891f12e2cfcaaf73a at {username='slave'} at 127.0.0.1:54540: session id = 6f3eb161e2194f6891f12e2cfcaaf73a-64effd13e9a741368e16bc2f52fb573c
I20260709 13:10:16.378098 30187 tablet_copy_source_session.cc:215] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:16.381161 31221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64effd13e9a741368e16bc2f52fb573c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:16.391685 31153 raft_consensus.cc:993] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4: : Instructing follower 5ec73dc157ed476ca903a7d596271719 to start an election
I20260709 13:10:16.392168 31153 raft_consensus.cc:1081] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Signalling peer 5ec73dc157ed476ca903a7d596271719 to start an election
I20260709 13:10:16.394290 30102 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11"
dest_uuid: "5ec73dc157ed476ca903a7d596271719"
 from {username='slave'} at 127.0.0.1:33990
I20260709 13:10:16.394770 30102 raft_consensus.cc:493] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:16.395095 30102 raft_consensus.cc:3060] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.400076 31221 tablet_copy_client.cc:806] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:16.400591 31221 tablet_copy_client.cc:670] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:16.401191 30102 raft_consensus.cc:515] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:16.404170 31221 tablet_copy_client.cc:538] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:16.404102 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:16.404632 30024 raft_consensus.cc:3055] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:16.404930 30024 raft_consensus.cc:740] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:16.405587 30024 consensus_queue.cc:260] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:16.406589 30024 raft_consensus.cc:3060] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.412392 31221 tablet_bootstrap.cc:492] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap starting.
I20260709 13:10:16.414264 30024 raft_consensus.cc:2468] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
I20260709 13:10:16.415266 30066 leader_election.cc:304] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:16.416004 31047 raft_consensus.cc:2804] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:16.416397 31047 raft_consensus.cc:697] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 2 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:16.417110 31047 consensus_queue.cc:237] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:16.425894 30102 leader_election.cc:290] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:16.434733 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:16.435343 30177 raft_consensus.cc:3060] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.447093 29922 catalog_manager.cc:5697] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 1 to 2, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 2 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.454734 30177 raft_consensus.cc:2468] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
I20260709 13:10:16.456523 31221 tablet_bootstrap.cc:492] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:16.457407 31221 tablet_bootstrap.cc:492] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap complete.
I20260709 13:10:16.458045 31221 ts_tablet_manager.cc:1403] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent bootstrapping tablet: real 0.046s	user 0.021s	sys 0.012s
I20260709 13:10:16.461630 31221 raft_consensus.cc:359] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:16.462423 31221 raft_consensus.cc:740] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Initialized, Role: LEARNER
I20260709 13:10:16.463044 31221 consensus_queue.cc:260] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:16.465353 31221 ts_tablet_manager.cc:1434] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.003s
I20260709 13:10:16.465804 31062 raft_consensus.cc:993] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719: : Instructing follower 6f3eb161e2194f6891f12e2cfcaaf73a to start an election
I20260709 13:10:16.466248 31062 raft_consensus.cc:1081] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Signalling peer 6f3eb161e2194f6891f12e2cfcaaf73a to start an election
I20260709 13:10:16.468196 30187 tablet_copy_service.cc:342] P c99569d27a6f4c648eae7119fe3db124: Request end of tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-64effd13e9a741368e16bc2f52fb573c received from {username='slave'} at 127.0.0.1:54540
I20260709 13:10:16.468600 30187 tablet_copy_service.cc:434] P c99569d27a6f4c648eae7119fe3db124: ending tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-64effd13e9a741368e16bc2f52fb573c on tablet 64effd13e9a741368e16bc2f52fb573c with peer 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:16.470291 30736 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9"
dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
 from {username='slave'} at 127.0.0.1:56954
I20260709 13:10:16.470789 30736 raft_consensus.cc:493] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:16.471124 30736 raft_consensus.cc:3060] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.476438 30736 raft_consensus.cc:515] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:16.477988 30736 leader_election.cc:290] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:16.478619 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:16.479470 30024 raft_consensus.cc:3060] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.482833 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:16.483372 30102 raft_consensus.cc:3055] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:16.483642 30102 raft_consensus.cc:740] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:16.484370 30102 consensus_queue.cc:260] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:16.485229 30024 raft_consensus.cc:2468] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 2.
I20260709 13:10:16.485469 30102 raft_consensus.cc:3060] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.486266 30700 leader_election.cc:304] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:16.487073 31176 raft_consensus.cc:2804] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:16.487498 31176 raft_consensus.cc:697] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:16.488281 31176 consensus_queue.cc:237] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:16.495577 30102 raft_consensus.cc:2468] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 2.
I20260709 13:10:16.498924 29922 catalog_manager.cc:5697] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: term changed from 1 to 2, leader changed from 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) to 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68). New cstate: current_term: 2 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:16.527627 31200 raft_consensus.cc:993] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124: : Instructing follower b2cea0098c1040f69755ea4d3dab7fc4 to start an election
I20260709 13:10:16.528110 31200 raft_consensus.cc:1081] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Signalling peer b2cea0098c1040f69755ea4d3dab7fc4 to start an election
I20260709 13:10:16.529359 30024 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
 from {username='slave'} at 127.0.0.1:54206
I20260709 13:10:16.529743 30024 raft_consensus.cc:493] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:16.530026 30024 raft_consensus.cc:3060] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.534929 30024 raft_consensus.cc:515] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:16.535614 31221 ts_tablet_manager.cc:933] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a: Initiating tablet copy from peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:16.537151 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:16.537389 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:16.537788 30102 raft_consensus.cc:3060] T 7d7c81315a41495eafb4a8020a99cb7c P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.537876 30177 raft_consensus.cc:3055] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:16.538188 30024 leader_election.cc:290] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:16.538231 30177 raft_consensus.cc:740] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:16.539137 30177 consensus_queue.cc:260] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:16.539523 31221 tablet_copy_client.cc:323] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Beginning tablet copy session from remote peer at address 127.28.54.67:45001
I20260709 13:10:16.540935 30177 raft_consensus.cc:3060] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.541065 30187 tablet_copy_service.cc:140] P c99569d27a6f4c648eae7119fe3db124: Received BeginTabletCopySession request for tablet b52e70a06b534fbf90cbcb6a010e9d43 from peer 6f3eb161e2194f6891f12e2cfcaaf73a ({username='slave'} at 127.0.0.1:54540)
I20260709 13:10:16.541637 30187 tablet_copy_service.cc:161] P c99569d27a6f4c648eae7119fe3db124: Beginning new tablet copy session on tablet b52e70a06b534fbf90cbcb6a010e9d43 from peer 6f3eb161e2194f6891f12e2cfcaaf73a at {username='slave'} at 127.0.0.1:54540: session id = 6f3eb161e2194f6891f12e2cfcaaf73a-b52e70a06b534fbf90cbcb6a010e9d43
I20260709 13:10:16.548353 30187 tablet_copy_source_session.cc:215] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:16.546883 30177 raft_consensus.cc:2468] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 2.
I20260709 13:10:16.551103 31221 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b52e70a06b534fbf90cbcb6a010e9d43. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:16.551221 29993 leader_election.cc:304] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:16.552593 31216 raft_consensus.cc:2804] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:16.553221 31216 raft_consensus.cc:697] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:16.554046 31216 consensus_queue.cc:237] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:16.560339 30102 raft_consensus.cc:2468] T 7d7c81315a41495eafb4a8020a99cb7c P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 2.
I20260709 13:10:16.566689 31229 ts_tablet_manager.cc:933] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a: Initiating tablet copy from peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451)
I20260709 13:10:16.567431 29922 catalog_manager.cc:5697] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 1 to 2, leader changed from c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 2 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:16.568509 31229 tablet_copy_client.cc:323] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Beginning tablet copy session from remote peer at address 127.28.54.65:34451
I20260709 13:10:16.569969 30038 tablet_copy_service.cc:140] P b2cea0098c1040f69755ea4d3dab7fc4: Received BeginTabletCopySession request for tablet 9cd772608bf64bf9b1c1aec00dc57eee from peer 6f3eb161e2194f6891f12e2cfcaaf73a ({username='slave'} at 127.0.0.1:52098)
I20260709 13:10:16.570468 30038 tablet_copy_service.cc:161] P b2cea0098c1040f69755ea4d3dab7fc4: Beginning new tablet copy session on tablet 9cd772608bf64bf9b1c1aec00dc57eee from peer 6f3eb161e2194f6891f12e2cfcaaf73a at {username='slave'} at 127.0.0.1:52098: session id = 6f3eb161e2194f6891f12e2cfcaaf73a-9cd772608bf64bf9b1c1aec00dc57eee
I20260709 13:10:16.579479 30038 tablet_copy_source_session.cc:215] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:16.581817 31221 tablet_copy_client.cc:806] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:16.582402 31221 tablet_copy_client.cc:670] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:16.584156 31229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9cd772608bf64bf9b1c1aec00dc57eee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:16.586253 31221 tablet_copy_client.cc:538] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:16.599455 31155 raft_consensus.cc:993] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4: : Instructing follower 6f3eb161e2194f6891f12e2cfcaaf73a to start an election
I20260709 13:10:16.599927 31155 raft_consensus.cc:1081] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Signalling peer 6f3eb161e2194f6891f12e2cfcaaf73a to start an election
I20260709 13:10:16.604465 31221 tablet_bootstrap.cc:492] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap starting.
I20260709 13:10:16.607120 31229 tablet_copy_client.cc:806] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:16.607857 31229 tablet_copy_client.cc:670] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:16.609967 30735 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517"
dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
 from {username='slave'} at 127.0.0.1:51014
I20260709 13:10:16.610538 30735 raft_consensus.cc:493] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:16.610858 30735 raft_consensus.cc:3060] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.611260 31229 tablet_copy_client.cc:538] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:16.616448 31231 ts_tablet_manager.cc:933] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a: Initiating tablet copy from peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:16.619196 31231 tablet_copy_client.cc:323] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Beginning tablet copy session from remote peer at address 127.28.54.66:43821
I20260709 13:10:16.620792 30113 tablet_copy_service.cc:140] P 5ec73dc157ed476ca903a7d596271719: Received BeginTabletCopySession request for tablet f5c869d5410b4a83adc1ca35397defb6 from peer 6f3eb161e2194f6891f12e2cfcaaf73a ({username='slave'} at 127.0.0.1:48558)
I20260709 13:10:16.621192 30113 tablet_copy_service.cc:161] P 5ec73dc157ed476ca903a7d596271719: Beginning new tablet copy session on tablet f5c869d5410b4a83adc1ca35397defb6 from peer 6f3eb161e2194f6891f12e2cfcaaf73a at {username='slave'} at 127.0.0.1:48558: session id = 6f3eb161e2194f6891f12e2cfcaaf73a-f5c869d5410b4a83adc1ca35397defb6
I20260709 13:10:16.623670 31229 tablet_bootstrap.cc:492] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap starting.
I20260709 13:10:16.621194 30735 raft_consensus.cc:515] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:16.631875 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:16.632414 30024 raft_consensus.cc:3055] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:16.632730 30024 raft_consensus.cc:740] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:16.632507 30735 leader_election.cc:290] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:16.633610 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:16.633461 30024 consensus_queue.cc:260] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:16.634123 30171 raft_consensus.cc:3060] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.634544 30024 raft_consensus.cc:3060] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:16.641036 30024 raft_consensus.cc:2468] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 2.
I20260709 13:10:16.642027 30700 leader_election.cc:304] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:16.644510 31176 raft_consensus.cc:2804] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:16.644935 31176 raft_consensus.cc:697] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:16.645776 31176 consensus_queue.cc:237] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:16.666078 30171 raft_consensus.cc:2468] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 2.
I20260709 13:10:16.668920 30113 tablet_copy_source_session.cc:215] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:16.679719 29922 catalog_manager.cc:5697] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: term changed from 1 to 2, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68). New cstate: current_term: 2 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:16.688477 31231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f5c869d5410b4a83adc1ca35397defb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:16.707145 31231 tablet_copy_client.cc:806] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:16.707705 31231 tablet_copy_client.cc:670] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:16.711613 31231 tablet_copy_client.cc:538] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:16.714474 31221 tablet_bootstrap.cc:492] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:16.715384 31221 tablet_bootstrap.cc:492] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap complete.
I20260709 13:10:16.716002 31221 ts_tablet_manager.cc:1403] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent bootstrapping tablet: real 0.112s	user 0.041s	sys 0.030s
I20260709 13:10:16.718806 31221 raft_consensus.cc:359] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:16.719575 31221 raft_consensus.cc:740] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Initialized, Role: LEARNER
I20260709 13:10:16.720184 31221 consensus_queue.cc:260] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:16.721179 31229 tablet_bootstrap.cc:492] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:16.722016 31229 tablet_bootstrap.cc:492] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap complete.
I20260709 13:10:16.722608 31229 ts_tablet_manager.cc:1403] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent bootstrapping tablet: real 0.099s	user 0.016s	sys 0.008s
I20260709 13:10:16.724722 30023 raft_consensus.cc:1275] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:16.725239 31229 raft_consensus.cc:359] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:16.726016 31229 raft_consensus.cc:740] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Initialized, Role: LEARNER
I20260709 13:10:16.726227 31177 consensus_queue.cc:1048] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:16.726629 31229 consensus_queue.cc:260] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:16.736338 31229 ts_tablet_manager.cc:1434] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:10:16.747247 30038 tablet_copy_service.cc:342] P b2cea0098c1040f69755ea4d3dab7fc4: Request end of tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-9cd772608bf64bf9b1c1aec00dc57eee received from {username='slave'} at 127.0.0.1:52098
I20260709 13:10:16.747717 30038 tablet_copy_service.cc:434] P b2cea0098c1040f69755ea4d3dab7fc4: ending tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-9cd772608bf64bf9b1c1aec00dc57eee on tablet 9cd772608bf64bf9b1c1aec00dc57eee with peer 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:16.748685 31221 ts_tablet_manager.cc:1434] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 13:10:16.750967 30187 tablet_copy_service.cc:342] P c99569d27a6f4c648eae7119fe3db124: Request end of tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-b52e70a06b534fbf90cbcb6a010e9d43 received from {username='slave'} at 127.0.0.1:54540
I20260709 13:10:16.751385 30187 tablet_copy_service.cc:434] P c99569d27a6f4c648eae7119fe3db124: ending tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-b52e70a06b534fbf90cbcb6a010e9d43 on tablet b52e70a06b534fbf90cbcb6a010e9d43 with peer 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:16.784641 30177 raft_consensus.cc:1275] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:16.786350 31177 consensus_queue.cc:1048] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:16.797525 31231 tablet_bootstrap.cc:492] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap starting.
I20260709 13:10:16.828969 31231 tablet_bootstrap.cc:492] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:16.829862 31231 tablet_bootstrap.cc:492] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap complete.
I20260709 13:10:16.830495 31231 ts_tablet_manager.cc:1403] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent bootstrapping tablet: real 0.033s	user 0.029s	sys 0.005s
I20260709 13:10:16.833205 31231 raft_consensus.cc:359] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:16.834033 31231 raft_consensus.cc:740] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Initialized, Role: LEARNER
I20260709 13:10:16.834643 31231 consensus_queue.cc:260] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:16.836951 31231 ts_tablet_manager.cc:1434] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:10:16.840153 30113 tablet_copy_service.cc:342] P 5ec73dc157ed476ca903a7d596271719: Request end of tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-f5c869d5410b4a83adc1ca35397defb6 received from {username='slave'} at 127.0.0.1:48558
I20260709 13:10:16.840572 30113 tablet_copy_service.cc:434] P 5ec73dc157ed476ca903a7d596271719: ending tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-f5c869d5410b4a83adc1ca35397defb6 on tablet f5c869d5410b4a83adc1ca35397defb6 with peer 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:16.845043 30024 raft_consensus.cc:1275] T b66f98d7fcfe4102a01ace9ed64355ed P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:16.850179 31112 consensus_queue.cc:1048] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:16.860919 30024 raft_consensus.cc:1275] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:16.862564 31112 consensus_queue.cc:1048] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:16.869657 30171 raft_consensus.cc:1275] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:16.872660 31062 consensus_queue.cc:1048] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:16.882107 30024 raft_consensus.cc:1275] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:16.883494 31176 consensus_queue.cc:1048] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:16.898034 30177 raft_consensus.cc:1275] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:16.901868 31047 consensus_queue.cc:1048] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:16.935194 30101 raft_consensus.cc:1275] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:16.937816 31176 consensus_queue.cc:1048] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:16.947146 30736 raft_consensus.cc:1217] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:16.974673 30737 raft_consensus.cc:1217] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:17.002241 30171 raft_consensus.cc:1275] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:17.003692 31215 consensus_queue.cc:1048] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:17.027737 30101 raft_consensus.cc:1275] T 7d7c81315a41495eafb4a8020a99cb7c P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:17.029187 31216 consensus_queue.cc:1048] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:17.035565 30025 raft_consensus.cc:1275] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:17.039829 31176 consensus_queue.cc:1048] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:17.058382 30171 raft_consensus.cc:1275] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:17.059806 31239 consensus_queue.cc:1048] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:17.139097 30737 raft_consensus.cc:1217] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:17.168773 30737 raft_consensus.cc:1217] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:17.212179 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:17.262048 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:17.323457 30173 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0"
dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
mode: GRACEFUL
new_leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
 from {username='slave'} at 127.0.0.1:38454
I20260709 13:10:17.324002 30173 raft_consensus.cc:606] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Received request to transfer leadership to TS 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:17.327275 30103 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa"
dest_uuid: "5ec73dc157ed476ca903a7d596271719"
mode: GRACEFUL
new_leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
 from {username='slave'} at 127.0.0.1:37340
I20260709 13:10:17.327796 30103 raft_consensus.cc:606] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Received request to transfer leadership to TS b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:17.331565 30025 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
mode: GRACEFUL
new_leader_uuid: "5ec73dc157ed476ca903a7d596271719"
 from {username='slave'} at 127.0.0.1:47450
I20260709 13:10:17.332062 30025 raft_consensus.cc:606] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Received request to transfer leadership to TS 5ec73dc157ed476ca903a7d596271719
I20260709 13:10:17.337260 30173 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "80006b8186d74baba29992ade1966048"
dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
mode: GRACEFUL
new_leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
 from {username='slave'} at 127.0.0.1:38454
I20260709 13:10:17.337673 30173 raft_consensus.cc:606] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Received request to transfer leadership to TS b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:17.338833 28889 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:10:17.340236 28889 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:17.358385 31223 raft_consensus.cc:1064] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719: attempting to promote NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a to VOTER
I20260709 13:10:17.360808 31223 consensus_queue.cc:237] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:17.362121 31248 raft_consensus.cc:993] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124: : Instructing follower 6f3eb161e2194f6891f12e2cfcaaf73a to start an election
I20260709 13:10:17.362627 31200 raft_consensus.cc:1081] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Signalling peer 6f3eb161e2194f6891f12e2cfcaaf73a to start an election
I20260709 13:10:17.364044 30737 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0"
dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
 from {username='slave'} at 127.0.0.1:51004
I20260709 13:10:17.364539 30737 raft_consensus.cc:493] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:17.364867 30737 raft_consensus.cc:3060] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:17.368062 30171 raft_consensus.cc:1275] T f5c869d5410b4a83adc1ca35397defb6 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:17.369097 30025 raft_consensus.cc:1275] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:17.370018 30735 raft_consensus.cc:1275] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:17.371659 31112 consensus_queue.cc:1048] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:17.372385 30737 raft_consensus.cc:515] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:17.373198 31062 consensus_queue.cc:1048] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:17.374322 30737 leader_election.cc:290] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:17.375133 31223 consensus_queue.cc:1048] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:17.376691 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:17.377254 30173 raft_consensus.cc:3055] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:17.377543 30173 raft_consensus.cc:740] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:17.378218 30173 consensus_queue.cc:260] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:17.379338 30173 raft_consensus.cc:3060] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:17.380070 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:17.380630 30103 raft_consensus.cc:3060] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:17.389366 30173 raft_consensus.cc:2468] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 2.
I20260709 13:10:17.392815 30702 leader_election.cc:304] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:17.393647 31177 raft_consensus.cc:2804] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:17.394115 31177 raft_consensus.cc:697] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:17.394924 31177 consensus_queue.cc:237] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:17.397629 30103 raft_consensus.cc:2468] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 2.
I20260709 13:10:17.402863 31062 raft_consensus.cc:2955] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:17.407016 29922 catalog_manager.cc:5697] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: term changed from 1 to 2, leader changed from c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) to 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68). New cstate: current_term: 2 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:17.412842 30025 raft_consensus.cc:2955] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:17.416342 30737 raft_consensus.cc:2955] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:17.430023 30173 raft_consensus.cc:2955] T f5c869d5410b4a83adc1ca35397defb6 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:17.437846 29924 catalog_manager.cc:5697] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 reported cstate change: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:17.469725 30103 consensus_queue.cc:237] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:17.476608 30025 raft_consensus.cc:1275] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:17.477705 30737 raft_consensus.cc:1275] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:17.477777 31062 consensus_queue.cc:1048] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:17.480546 31062 consensus_queue.cc:1048] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:17.484107 31047 raft_consensus.cc:2955] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:17.488029 30025 raft_consensus.cc:2955] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:17.492282 29913 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f5c869d5410b4a83adc1ca35397defb6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:17.498241 30737 raft_consensus.cc:2955] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:17.502818 29925 catalog_manager.cc:5697] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: config changed from index 3 to 4, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:17.518612 30164 tablet_service.cc:1558] Processing DeleteTablet for tablet f5c869d5410b4a83adc1ca35397defb6 with delete_type TABLET_DATA_TOMBSTONED (TS c99569d27a6f4c648eae7119fe3db124 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43828
I20260709 13:10:17.520483 31268 tablet_replica.cc:333] T f5c869d5410b4a83adc1ca35397defb6 P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:10:17.521189 31268 raft_consensus.cc:2243] T f5c869d5410b4a83adc1ca35397defb6 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:17.521733 31268 raft_consensus.cc:2272] T f5c869d5410b4a83adc1ca35397defb6 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:17.525727 31268 ts_tablet_manager.cc:1916] T f5c869d5410b4a83adc1ca35397defb6 P c99569d27a6f4c648eae7119fe3db124: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:17.533854 31200 raft_consensus.cc:1064] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124: attempting to promote NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a to VOTER
I20260709 13:10:17.536597 31200 consensus_queue.cc:237] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:17.538892 31268 ts_tablet_manager.cc:1929] T f5c869d5410b4a83adc1ca35397defb6 P c99569d27a6f4c648eae7119fe3db124: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:17.539355 31268 log.cc:1199] T f5c869d5410b4a83adc1ca35397defb6 P c99569d27a6f4c648eae7119fe3db124: Deleting WAL directory at /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-2-root/wals/f5c869d5410b4a83adc1ca35397defb6
I20260709 13:10:17.540788 29912 catalog_manager.cc:5028] TS c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): tablet f5c869d5410b4a83adc1ca35397defb6 (table test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]) successfully deleted
I20260709 13:10:17.563709 30103 raft_consensus.cc:1275] T 64effd13e9a741368e16bc2f52fb573c P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:17.565622 30025 raft_consensus.cc:1275] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:17.574157 31248 consensus_queue.cc:1048] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:17.575930 31248 consensus_queue.cc:1048] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:17.576740 30737 raft_consensus.cc:1275] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:17.578948 31200 consensus_queue.cc:1048] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:17.619798 31249 raft_consensus.cc:2955] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:17.620929 30025 raft_consensus.cc:2955] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:17.624388 30098 raft_consensus.cc:2955] T 64effd13e9a741368e16bc2f52fb573c P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:17.637406 30737 raft_consensus.cc:2955] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:17.646660 29925 catalog_manager.cc:5697] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:17.651625 31215 raft_consensus.cc:1064] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4: attempting to promote NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a to VOTER
I20260709 13:10:17.653985 31215 consensus_queue.cc:237] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:17.665966 30173 raft_consensus.cc:1275] T 9cd772608bf64bf9b1c1aec00dc57eee P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:17.668010 31270 raft_consensus.cc:993] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124: : Instructing follower b2cea0098c1040f69755ea4d3dab7fc4 to start an election
I20260709 13:10:17.668444 31270 raft_consensus.cc:1081] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Signalling peer b2cea0098c1040f69755ea4d3dab7fc4 to start an election
I20260709 13:10:17.669997 30173 consensus_queue.cc:237] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:17.670511 30025 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "80006b8186d74baba29992ade1966048"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
 from {username='slave'} at 127.0.0.1:54206
I20260709 13:10:17.671026 30025 raft_consensus.cc:493] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:17.671334 30025 raft_consensus.cc:3060] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:17.675696 31216 consensus_queue.cc:1048] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:17.680681 30025 raft_consensus.cc:515] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:17.682533 30025 leader_election.cc:290] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:17.683910 30737 raft_consensus.cc:1275] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:17.687410 30024 raft_consensus.cc:1275] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:17.689046 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:17.689491 31249 consensus_queue.cc:1048] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:17.690138 31153 consensus_queue.cc:1048] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:17.693089 31047 raft_consensus.cc:993] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 5ec73dc157ed476ca903a7d596271719: : Instructing follower b2cea0098c1040f69755ea4d3dab7fc4 to start an election
I20260709 13:10:17.693516 31047 raft_consensus.cc:1081] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Signalling peer b2cea0098c1040f69755ea4d3dab7fc4 to start an election
I20260709 13:10:17.695077 30023 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
 from {username='slave'} at 127.0.0.1:54198
I20260709 13:10:17.695565 30023 raft_consensus.cc:493] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:17.695928 30023 raft_consensus.cc:3060] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:17.697101 31270 raft_consensus.cc:2955] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:17.698083 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:17.689556 30735 raft_consensus.cc:3060] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:17.699383 30173 raft_consensus.cc:3055] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:17.700196 30173 raft_consensus.cc:740] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:17.708529 30023 raft_consensus.cc:515] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:17.703987 30024 raft_consensus.cc:2955] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:17.710592 30023 leader_election.cc:290] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:17.713413 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:17.713949 30177 raft_consensus.cc:3060] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:17.702715 30173 consensus_queue.cc:260] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:17.715451 30173 raft_consensus.cc:3060] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:17.701335 30737 raft_consensus.cc:1275] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:17.719091 29912 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 64effd13e9a741368e16bc2f52fb573c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:17.719167 31249 consensus_queue.cc:1048] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:17.721069 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:17.721815 30101 raft_consensus.cc:3055] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:17.722150 30101 raft_consensus.cc:740] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:17.718065 30098 raft_consensus.cc:1275] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:17.713891 30735 raft_consensus.cc:2468] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 2.
I20260709 13:10:17.757450 29993 leader_election.cc:304] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:17.758203 31215 raft_consensus.cc:2804] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:17.758734 31215 raft_consensus.cc:697] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:17.759899 31215 consensus_queue.cc:237] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:17.776043 30734 raft_consensus.cc:2955] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:17.794723 31153 consensus_queue.cc:1048] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:17.797794 30173 raft_consensus.cc:2468] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 2.
I20260709 13:10:17.767184 30101 consensus_queue.cc:260] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:17.770383 29923 catalog_manager.cc:5697] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 reported cstate change: config changed from index 3 to 4, VOTER 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) evicted. New cstate: current_term: 1 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:17.799072 30101 raft_consensus.cc:3060] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:17.783725 31248 raft_consensus.cc:1064] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124: attempting to promote NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a to VOTER
I20260709 13:10:17.766515 30177 raft_consensus.cc:2468] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 2.
I20260709 13:10:17.802559 31248 consensus_queue.cc:237] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:17.819638 30734 raft_consensus.cc:1275] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:17.820650 30103 raft_consensus.cc:1275] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:17.821200 31248 consensus_queue.cc:1048] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:17.825515 31270 consensus_queue.cc:1048] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:17.833637 30091 tablet_service.cc:1558] Processing DeleteTablet for tablet 64effd13e9a741368e16bc2f52fb573c with delete_type TABLET_DATA_TOMBSTONED (TS 5ec73dc157ed476ca903a7d596271719 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33984
I20260709 13:10:17.858928 31283 tablet_replica.cc:333] T 64effd13e9a741368e16bc2f52fb573c P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:10:17.865685 30023 raft_consensus.cc:1275] T b52e70a06b534fbf90cbcb6a010e9d43 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:17.872502 30101 raft_consensus.cc:2468] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 2.
W20260709 13:10:17.859823 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 79232.4us
I20260709 13:10:17.876968 31216 raft_consensus.cc:993] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4: : Instructing follower 5ec73dc157ed476ca903a7d596271719 to start an election
I20260709 13:10:17.877398 31216 raft_consensus.cc:1081] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Signalling peer 5ec73dc157ed476ca903a7d596271719 to start an election
I20260709 13:10:17.859941 31283 raft_consensus.cc:2243] T 64effd13e9a741368e16bc2f52fb573c P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:17.880158 31283 raft_consensus.cc:2272] T 64effd13e9a741368e16bc2f52fb573c P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:17.882066 29994 leader_election.cc:304] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:17.883632 31215 raft_consensus.cc:2804] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:17.885429 31153 raft_consensus.cc:2955] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:17.886669 31283 ts_tablet_manager.cc:1916] T 64effd13e9a741368e16bc2f52fb573c P 5ec73dc157ed476ca903a7d596271719: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:17.896868 30102 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08"
dest_uuid: "5ec73dc157ed476ca903a7d596271719"
 from {username='slave'} at 127.0.0.1:33990
I20260709 13:10:17.897526 30102 raft_consensus.cc:493] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:17.898191 30102 raft_consensus.cc:3060] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:17.898936 31249 consensus_queue.cc:1048] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:17.907608 31283 ts_tablet_manager.cc:1929] T 64effd13e9a741368e16bc2f52fb573c P 5ec73dc157ed476ca903a7d596271719: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:17.908133 31283 log.cc:1199] T 64effd13e9a741368e16bc2f52fb573c P 5ec73dc157ed476ca903a7d596271719: Deleting WAL directory at /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-1-root/wals/64effd13e9a741368e16bc2f52fb573c
I20260709 13:10:17.909770 29913 catalog_manager.cc:5028] TS 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): tablet 64effd13e9a741368e16bc2f52fb573c (table test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]) successfully deleted
I20260709 13:10:17.905223 30102 raft_consensus.cc:515] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:17.916499 30736 raft_consensus.cc:2955] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:17.930444 30173 raft_consensus.cc:2955] T 9cd772608bf64bf9b1c1aec00dc57eee P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:17.934459 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:17.935055 30024 raft_consensus.cc:3055] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:17.935338 30024 raft_consensus.cc:740] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:17.936009 30024 consensus_queue.cc:260] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:17.936970 30024 raft_consensus.cc:3060] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:17.955463 30024 raft_consensus.cc:2468] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
I20260709 13:10:17.956806 30066 leader_election.cc:304] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:17.957639 31062 raft_consensus.cc:2804] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:17.957036 29923 catalog_manager.cc:5697] T 9cd772608bf64bf9b1c1aec00dc57eee P c99569d27a6f4c648eae7119fe3db124 reported cstate change: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:17.958071 31062 raft_consensus.cc:697] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 2 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:17.959666 31062 consensus_queue.cc:237] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:17.971729 30103 raft_consensus.cc:2955] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:17.973872 31248 raft_consensus.cc:2955] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:17.978725 30101 raft_consensus.cc:1275] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:17.980578 31176 consensus_queue.cc:1048] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:17.989118 30102 leader_election.cc:290] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:17.992880 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:17.997044 30173 raft_consensus.cc:3060] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.008597 29924 catalog_manager.cc:5697] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 1 to 2, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 2 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:17.993610 30736 raft_consensus.cc:2955] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:18.061137 30171 raft_consensus.cc:1275] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:18.062273 30173 raft_consensus.cc:2468] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
I20260709 13:10:18.064531 31177 consensus_queue.cc:1048] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:18.086205 29923 catalog_manager.cc:5697] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:18.082880 31215 raft_consensus.cc:697] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:18.105894 31215 consensus_queue.cc:237] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:18.118770 30171 consensus_queue.cc:237] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:18.125739 30102 raft_consensus.cc:2955] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:18.139256 30734 raft_consensus.cc:1275] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:18.140782 31248 consensus_queue.cc:1048] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:18.144833 30103 raft_consensus.cc:1275] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:18.146796 31270 consensus_queue.cc:1048] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:18.156857 31273 raft_consensus.cc:2955] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:18.168613 30101 raft_consensus.cc:2955] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:18.169906 30735 raft_consensus.cc:2955] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:18.172627 29912 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b52e70a06b534fbf90cbcb6a010e9d43 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:18.191730 29924 catalog_manager.cc:5697] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: config changed from index 3 to 4, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New cstate: current_term: 1 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:18.204427 30009 tablet_service.cc:1558] Processing DeleteTablet for tablet b52e70a06b534fbf90cbcb6a010e9d43 with delete_type TABLET_DATA_TOMBSTONED (TS b2cea0098c1040f69755ea4d3dab7fc4 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54192
I20260709 13:10:18.215271 31295 tablet_replica.cc:333] T b52e70a06b534fbf90cbcb6a010e9d43 P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:10:18.216326 31295 raft_consensus.cc:2243] T b52e70a06b534fbf90cbcb6a010e9d43 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:18.216951 31295 pending_rounds.cc:70] T b52e70a06b534fbf90cbcb6a010e9d43 P b2cea0098c1040f69755ea4d3dab7fc4: Trying to abort 1 pending ops.
I20260709 13:10:18.217244 31295 pending_rounds.cc:77] T b52e70a06b534fbf90cbcb6a010e9d43 P b2cea0098c1040f69755ea4d3dab7fc4: Aborting op as it isn't in flight: id { term: 1 index: 3 } timestamp: 7305636322513379328 op_type: CHANGE_CONFIG_OP change_config_record { tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" old_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } } new_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } } }
I20260709 13:10:18.218415 31295 raft_consensus.cc:2917] T b52e70a06b534fbf90cbcb6a010e9d43 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted
I20260709 13:10:18.218858 31295 raft_consensus.cc:2889] T b52e70a06b534fbf90cbcb6a010e9d43 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted
I20260709 13:10:18.219246 31295 raft_consensus.cc:2272] T b52e70a06b534fbf90cbcb6a010e9d43 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:18.222420 29922 catalog_manager.cc:5697] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 1 to 2, leader changed from c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 2 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:18.224133 29922 catalog_manager.cc:5697] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 1 to 2, leader changed from 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 2 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:18.225116 31295 ts_tablet_manager.cc:1916] T b52e70a06b534fbf90cbcb6a010e9d43 P b2cea0098c1040f69755ea4d3dab7fc4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:18.250914 31295 ts_tablet_manager.cc:1929] T b52e70a06b534fbf90cbcb6a010e9d43 P b2cea0098c1040f69755ea4d3dab7fc4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:18.251390 31295 log.cc:1199] T b52e70a06b534fbf90cbcb6a010e9d43 P b2cea0098c1040f69755ea4d3dab7fc4: Deleting WAL directory at /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-0-root/wals/b52e70a06b534fbf90cbcb6a010e9d43
I20260709 13:10:18.253363 30735 raft_consensus.cc:1275] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:18.254289 29910 catalog_manager.cc:5028] TS b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): tablet b52e70a06b534fbf90cbcb6a010e9d43 (table test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]) successfully deleted
I20260709 13:10:18.256145 31216 consensus_queue.cc:1048] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:18.257104 30177 raft_consensus.cc:1275] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:18.258589 31215 consensus_queue.cc:1048] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:18.262673 30026 consensus_queue.cc:237] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:18.306380 30101 raft_consensus.cc:1275] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:18.315582 31286 consensus_queue.cc:1048] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:18.318816 30735 raft_consensus.cc:1275] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:18.326596 31285 consensus_queue.cc:1048] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:18.331455 31285 raft_consensus.cc:2955] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:18.332417 30103 raft_consensus.cc:2955] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:18.341030 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:18.352181 29924 catalog_manager.cc:5697] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 reported cstate change: config changed from index 3 to 4, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New cstate: current_term: 1 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:18.361310 29910 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 9cd772608bf64bf9b1c1aec00dc57eee with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:18.365808 30736 raft_consensus.cc:2955] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:18.369993 30164 tablet_service.cc:1558] Processing DeleteTablet for tablet 9cd772608bf64bf9b1c1aec00dc57eee with delete_type TABLET_DATA_TOMBSTONED (TS c99569d27a6f4c648eae7119fe3db124 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43828
I20260709 13:10:18.371971 31299 tablet_replica.cc:333] T 9cd772608bf64bf9b1c1aec00dc57eee P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:10:18.372980 31299 raft_consensus.cc:2243] T 9cd772608bf64bf9b1c1aec00dc57eee P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:18.373584 31299 raft_consensus.cc:2272] T 9cd772608bf64bf9b1c1aec00dc57eee P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:18.376434 31299 ts_tablet_manager.cc:1916] T 9cd772608bf64bf9b1c1aec00dc57eee P c99569d27a6f4c648eae7119fe3db124: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:18.395596 31299 ts_tablet_manager.cc:1929] T 9cd772608bf64bf9b1c1aec00dc57eee P c99569d27a6f4c648eae7119fe3db124: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:18.395987 31299 log.cc:1199] T 9cd772608bf64bf9b1c1aec00dc57eee P c99569d27a6f4c648eae7119fe3db124: Deleting WAL directory at /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-2-root/wals/9cd772608bf64bf9b1c1aec00dc57eee
I20260709 13:10:18.399097 29912 catalog_manager.cc:5028] TS c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): tablet 9cd772608bf64bf9b1c1aec00dc57eee (table test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]) successfully deleted
I20260709 13:10:18.411839 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:18.447619 30173 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "407fb380b889498d94c7525edbc34b23"
dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
mode: GRACEFUL
new_leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
 from {username='slave'} at 127.0.0.1:38454
I20260709 13:10:18.448086 30173 raft_consensus.cc:606] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Received request to transfer leadership to TS b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:18.450285 30023 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
mode: GRACEFUL
new_leader_uuid: "5ec73dc157ed476ca903a7d596271719"
 from {username='slave'} at 127.0.0.1:47450
I20260709 13:10:18.450795 30023 raft_consensus.cc:606] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Received request to transfer leadership to TS 5ec73dc157ed476ca903a7d596271719
I20260709 13:10:18.453303 30102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2"
dest_uuid: "5ec73dc157ed476ca903a7d596271719"
mode: GRACEFUL
new_leader_uuid: "c99569d27a6f4c648eae7119fe3db124"
 from {username='slave'} at 127.0.0.1:37340
I20260709 13:10:18.453825 30102 raft_consensus.cc:606] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Received request to transfer leadership to TS c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:18.454943 28889 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:10:18.455972 28889 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:18.458060 30023 raft_consensus.cc:1275] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:18.459169 31047 consensus_queue.cc:1048] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:18.471276 30173 raft_consensus.cc:1275] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:18.472268 31301 consensus_queue.cc:1048] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:18.538803 31249 raft_consensus.cc:993] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124: : Instructing follower b2cea0098c1040f69755ea4d3dab7fc4 to start an election
I20260709 13:10:18.539321 31248 raft_consensus.cc:1081] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Signalling peer b2cea0098c1040f69755ea4d3dab7fc4 to start an election
I20260709 13:10:18.541083 30026 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "407fb380b889498d94c7525edbc34b23"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
 from {username='slave'} at 127.0.0.1:54206
I20260709 13:10:18.541587 30026 raft_consensus.cc:493] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:18.541960 30026 raft_consensus.cc:3060] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.546277 30026 raft_consensus.cc:515] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:18.547865 30026 leader_election.cc:290] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:18.548661 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:18.549196 30177 raft_consensus.cc:3055] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:18.549304 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:18.549818 30103 raft_consensus.cc:3060] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.549437 30177 raft_consensus.cc:740] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:18.550904 30177 consensus_queue.cc:260] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:18.551784 30177 raft_consensus.cc:3060] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.555460 30103 raft_consensus.cc:2468] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 2.
I20260709 13:10:18.556453 29994 leader_election.cc:304] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:18.557055 31216 raft_consensus.cc:2804] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:18.557394 30177 raft_consensus.cc:2468] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 2.
I20260709 13:10:18.557483 31216 raft_consensus.cc:697] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:18.558828 31216 consensus_queue.cc:237] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:18.567667 29922 catalog_manager.cc:5697] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 1 to 2, leader changed from c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 2 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:18.573589 30103 raft_consensus.cc:1275] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:18.574782 31216 consensus_queue.cc:1048] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:18.582864 30173 raft_consensus.cc:1275] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:18.584272 31215 consensus_queue.cc:1048] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:18.606091 31286 raft_consensus.cc:993] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4: : Instructing follower 5ec73dc157ed476ca903a7d596271719 to start an election
I20260709 13:10:18.606526 31286 raft_consensus.cc:1081] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Signalling peer 5ec73dc157ed476ca903a7d596271719 to start an election
I20260709 13:10:18.607766 30103 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043"
dest_uuid: "5ec73dc157ed476ca903a7d596271719"
 from {username='slave'} at 127.0.0.1:33990
I20260709 13:10:18.608210 30103 raft_consensus.cc:493] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:18.608462 30103 raft_consensus.cc:3060] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.612521 30103 raft_consensus.cc:515] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:18.613903 30103 leader_election.cc:290] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:18.614734 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:18.615285 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:18.615864 30173 raft_consensus.cc:3060] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.615325 30026 raft_consensus.cc:3055] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:18.616707 30026 raft_consensus.cc:740] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:18.617450 30026 consensus_queue.cc:260] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:18.618939 30026 raft_consensus.cc:3060] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.622458 30173 raft_consensus.cc:2468] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
I20260709 13:10:18.623426 30068 leader_election.cc:304] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:18.624140 31301 raft_consensus.cc:2804] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:18.624532 31301 raft_consensus.cc:697] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 2 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:18.625165 31301 consensus_queue.cc:237] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:18.626217 30026 raft_consensus.cc:2468] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
I20260709 13:10:18.636096 29924 catalog_manager.cc:5697] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 1 to 2, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 2 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:18.766108 31062 raft_consensus.cc:993] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719: : Instructing follower c99569d27a6f4c648eae7119fe3db124 to start an election
I20260709 13:10:18.766485 31301 raft_consensus.cc:1081] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Signalling peer c99569d27a6f4c648eae7119fe3db124 to start an election
I20260709 13:10:18.767565 30177 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2"
dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
 from {username='slave'} at 127.0.0.1:43840
I20260709 13:10:18.767961 30177 raft_consensus.cc:493] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:18.768213 30177 raft_consensus.cc:3060] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.773578 30177 raft_consensus.cc:515] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:18.775069 30177 leader_election.cc:290] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 2 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:18.775558 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:18.775938 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:18.776132 30023 raft_consensus.cc:3060] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.776464 30102 raft_consensus.cc:3055] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:18.776748 30102 raft_consensus.cc:740] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:18.777416 30102 consensus_queue.cc:260] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:18.778487 30102 raft_consensus.cc:3060] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:18.781879 30023 raft_consensus.cc:2468] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 2.
I20260709 13:10:18.782874 30140 leader_election.cc:304] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:18.783418 31273 raft_consensus.cc:2804] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:18.783761 31273 raft_consensus.cc:697] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 2 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:18.784061 30102 raft_consensus.cc:2468] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 2.
I20260709 13:10:18.784441 31273 consensus_queue.cc:237] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:18.792459 29924 catalog_manager.cc:5697] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 1 to 2, leader changed from 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 2 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:18.976748 30102 raft_consensus.cc:1275] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:18.978523 31215 consensus_queue.cc:1048] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:18.988600 30177 raft_consensus.cc:1275] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:18.991164 31286 consensus_queue.cc:1048] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:19.118929 30026 raft_consensus.cc:1275] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:19.119935 31301 consensus_queue.cc:1048] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:19.127506 30177 raft_consensus.cc:1275] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:19.128700 31047 consensus_queue.cc:1048] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:19.178130 30026 raft_consensus.cc:1275] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:19.179260 31248 consensus_queue.cc:1048] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:19.190541 30103 raft_consensus.cc:1275] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:19.191640 31273 consensus_queue.cc:1048] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:19.453953 30102 consensus_queue.cc:237] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:19.457177 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:19.465566 30024 raft_consensus.cc:1275] T 8495d060d6b042a3b7bd9dba1055dbbf P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:19.465970 30177 raft_consensus.cc:1275] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:19.467041 31062 consensus_queue.cc:1048] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:19.473635 30068 consensus_peers.cc:597] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 -> Peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469): Couldn't send request to peer 6f3eb161e2194f6891f12e2cfcaaf73a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8495d060d6b042a3b7bd9dba1055dbbf. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:19.474949 31062 consensus_queue.cc:1048] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:19.480477 31301 raft_consensus.cc:2955] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:19.493604 30024 raft_consensus.cc:2955] T 8495d060d6b042a3b7bd9dba1055dbbf P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:19.509656 30026 consensus_queue.cc:237] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:19.525722 29922 catalog_manager.cc:5697] T 8495d060d6b042a3b7bd9dba1055dbbf P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:19.550539 30177 raft_consensus.cc:2955] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:19.595938 30177 raft_consensus.cc:1275] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:19.598611 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:10:19.606295 29993 consensus_peers.cc:597] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 -> Peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469): Couldn't send request to peer 6f3eb161e2194f6891f12e2cfcaaf73a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7d7c81315a41495eafb4a8020a99cb7c. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:19.613883 31286 consensus_queue.cc:1048] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:19.625485 30103 raft_consensus.cc:1275] T 7d7c81315a41495eafb4a8020a99cb7c P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:19.626856 31322 consensus_queue.cc:1048] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:19.649896 31286 raft_consensus.cc:2955] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:19.655207 30103 raft_consensus.cc:2955] T 7d7c81315a41495eafb4a8020a99cb7c P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:19.669303 30102 consensus_queue.cc:237] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:19.685801 30177 raft_consensus.cc:2955] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:19.690685 29924 catalog_manager.cc:5697] T 7d7c81315a41495eafb4a8020a99cb7c P 5ec73dc157ed476ca903a7d596271719 reported cstate change: config changed from index -1 to 3, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New cstate: current_term: 2 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:19.700421 30172 raft_consensus.cc:1275] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:19.702332 31047 consensus_queue.cc:1048] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:19.703406 30024 raft_consensus.cc:1275] T 978900c67750481aba3e58987ac43180 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:19.705719 31301 consensus_queue.cc:1048] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:19.707965 30068 consensus_peers.cc:597] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 -> Peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469): Couldn't send request to peer 6f3eb161e2194f6891f12e2cfcaaf73a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 978900c67750481aba3e58987ac43180. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:19.709581 30026 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
mode: GRACEFUL
new_leader_uuid: "5ec73dc157ed476ca903a7d596271719"
 from {username='slave'} at 127.0.0.1:47450
I20260709 13:10:19.710361 30026 raft_consensus.cc:606] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Received request to transfer leadership to TS 5ec73dc157ed476ca903a7d596271719
I20260709 13:10:19.719161 30026 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
mode: GRACEFUL
new_leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
 from {username='slave'} at 127.0.0.1:47450
I20260709 13:10:19.719713 30026 raft_consensus.cc:606] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Received request to transfer leadership to TS 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:19.727962 30103 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "98e11967c3504e11865ed831f2584aea"
dest_uuid: "5ec73dc157ed476ca903a7d596271719"
mode: GRACEFUL
new_leader_uuid: "c99569d27a6f4c648eae7119fe3db124"
 from {username='slave'} at 127.0.0.1:37340
I20260709 13:10:19.728533 30103 raft_consensus.cc:606] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Received request to transfer leadership to TS c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:19.737087 31047 raft_consensus.cc:2955] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:19.744976 30172 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8fcd3026125450694af59415c94e029"
dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
mode: GRACEFUL
new_leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
 from {username='slave'} at 127.0.0.1:38454
I20260709 13:10:19.746116 30172 raft_consensus.cc:606] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Received request to transfer leadership to TS b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:19.748548 28889 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:10:19.752050 28889 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:19.759755 30177 consensus_queue.cc:237] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:19.758342 29924 catalog_manager.cc:5697] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:19.769821 30024 raft_consensus.cc:2955] T 978900c67750481aba3e58987ac43180 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:19.788183 30103 raft_consensus.cc:1275] T 31b19922895c4885a5a8bc5030afcba3 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:10:19.788192 30142 consensus_peers.cc:597] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 -> Peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469): Couldn't send request to peer 6f3eb161e2194f6891f12e2cfcaaf73a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 31b19922895c4885a5a8bc5030afcba3. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:19.787704 30172 raft_consensus.cc:2955] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:19.790201 31325 consensus_queue.cc:1048] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:19.793346 30024 raft_consensus.cc:1275] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:19.798705 31314 consensus_queue.cc:1048] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:19.828377 31325 raft_consensus.cc:2955] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:19.832226 30102 raft_consensus.cc:2955] T 31b19922895c4885a5a8bc5030afcba3 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:19.836877 30023 raft_consensus.cc:2955] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:19.848841 29924 catalog_manager.cc:5697] T 31b19922895c4885a5a8bc5030afcba3 P 5ec73dc157ed476ca903a7d596271719 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New cstate: current_term: 1 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:19.876691 31286 raft_consensus.cc:993] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4: : Instructing follower 5ec73dc157ed476ca903a7d596271719 to start an election
I20260709 13:10:19.877234 31328 raft_consensus.cc:1081] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Signalling peer 5ec73dc157ed476ca903a7d596271719 to start an election
I20260709 13:10:19.878561 30103 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3"
dest_uuid: "5ec73dc157ed476ca903a7d596271719"
 from {username='slave'} at 127.0.0.1:33990
I20260709 13:10:19.878993 30103 raft_consensus.cc:493] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:19.879246 30103 raft_consensus.cc:3060] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:19.885716 30103 raft_consensus.cc:515] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:19.888432 30103 leader_election.cc:290] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:19.889112 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:19.889806 30736 raft_consensus.cc:3060] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:19.889145 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:19.890872 30023 raft_consensus.cc:3055] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:19.891083 30023 raft_consensus.cc:740] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:19.891745 30023 consensus_queue.cc:260] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:19.892580 30023 raft_consensus.cc:3060] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:19.896319 30736 raft_consensus.cc:2468] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
I20260709 13:10:19.897178 30023 raft_consensus.cc:2468] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
I20260709 13:10:19.897389 30068 leader_election.cc:304] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:10:19.898277 31301 raft_consensus.cc:2804] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:19.898721 31301 raft_consensus.cc:697] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 2 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:19.899569 31301 consensus_queue.cc:237] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:19.910079 29922 catalog_manager.cc:5697] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 1 to 2, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 2 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:20.013659 31301 raft_consensus.cc:993] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719: : Instructing follower c99569d27a6f4c648eae7119fe3db124 to start an election
I20260709 13:10:20.014276 31335 raft_consensus.cc:1081] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Signalling peer c99569d27a6f4c648eae7119fe3db124 to start an election
I20260709 13:10:20.015787 30177 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "98e11967c3504e11865ed831f2584aea"
dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
 from {username='slave'} at 127.0.0.1:43840
I20260709 13:10:20.016269 30177 raft_consensus.cc:493] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:20.016587 30177 raft_consensus.cc:3060] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:20.022989 30177 raft_consensus.cc:515] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:20.024744 30177 leader_election.cc:290] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 2 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:20.025606 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:20.025954 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:20.026206 30103 raft_consensus.cc:3055] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:20.026515 30103 raft_consensus.cc:740] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:20.026522 30023 raft_consensus.cc:3060] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:20.027295 30103 consensus_queue.cc:260] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:20.028487 30103 raft_consensus.cc:3060] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:20.034315 30023 raft_consensus.cc:2468] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 2.
I20260709 13:10:20.034704 30103 raft_consensus.cc:2468] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 2.
I20260709 13:10:20.035490 30140 leader_election.cc:304] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:20.036242 31314 raft_consensus.cc:2804] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:20.036697 31314 raft_consensus.cc:697] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 2 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:20.037555 31314 consensus_queue.cc:237] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:20.038866 31286 raft_consensus.cc:993] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4: : Instructing follower 6f3eb161e2194f6891f12e2cfcaaf73a to start an election
I20260709 13:10:20.039312 31286 raft_consensus.cc:1081] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Signalling peer 6f3eb161e2194f6891f12e2cfcaaf73a to start an election
I20260709 13:10:20.040678 30736 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f"
dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
 from {username='slave'} at 127.0.0.1:51014
I20260709 13:10:20.041181 30736 raft_consensus.cc:493] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:20.041554 30736 raft_consensus.cc:3060] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:20.049820 30736 raft_consensus.cc:515] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:20.053797 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:20.053273 29922 catalog_manager.cc:5697] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 1 to 2, leader changed from 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 2 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:20.054354 30023 raft_consensus.cc:3055] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:20.054673 30023 raft_consensus.cc:740] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:20.055239 30736 leader_election.cc:290] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:20.055949 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:20.057089 30172 raft_consensus.cc:3060] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:20.059692 30023 consensus_queue.cc:260] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:20.061204 30023 raft_consensus.cc:3060] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:20.073916 30023 raft_consensus.cc:2468] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 2.
I20260709 13:10:20.077365 30700 leader_election.cc:304] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:20.078449 31324 raft_consensus.cc:2804] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:20.079113 31341 ts_tablet_manager.cc:933] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a: Initiating tablet copy from peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:20.079202 31324 raft_consensus.cc:697] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:20.080960 31324 consensus_queue.cc:237] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:20.092218 30172 raft_consensus.cc:2468] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 2.
I20260709 13:10:20.102226 29922 catalog_manager.cc:5697] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: term changed from 1 to 2, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68). New cstate: current_term: 2 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:20.118348 31341 tablet_copy_client.cc:323] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Beginning tablet copy session from remote peer at address 127.28.54.66:43821
I20260709 13:10:20.121189 30113 tablet_copy_service.cc:140] P 5ec73dc157ed476ca903a7d596271719: Received BeginTabletCopySession request for tablet 8495d060d6b042a3b7bd9dba1055dbbf from peer 6f3eb161e2194f6891f12e2cfcaaf73a ({username='slave'} at 127.0.0.1:48558)
I20260709 13:10:20.121709 30113 tablet_copy_service.cc:161] P 5ec73dc157ed476ca903a7d596271719: Beginning new tablet copy session on tablet 8495d060d6b042a3b7bd9dba1055dbbf from peer 6f3eb161e2194f6891f12e2cfcaaf73a at {username='slave'} at 127.0.0.1:48558: session id = 6f3eb161e2194f6891f12e2cfcaaf73a-8495d060d6b042a3b7bd9dba1055dbbf
I20260709 13:10:20.130086 30113 tablet_copy_source_session.cc:215] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:20.133682 31341 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8495d060d6b042a3b7bd9dba1055dbbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:20.138511 31345 ts_tablet_manager.cc:933] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a: Initiating tablet copy from peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451)
I20260709 13:10:20.148046 31345 tablet_copy_client.cc:323] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Beginning tablet copy session from remote peer at address 127.28.54.65:34451
I20260709 13:10:20.149832 30038 tablet_copy_service.cc:140] P b2cea0098c1040f69755ea4d3dab7fc4: Received BeginTabletCopySession request for tablet 7d7c81315a41495eafb4a8020a99cb7c from peer 6f3eb161e2194f6891f12e2cfcaaf73a ({username='slave'} at 127.0.0.1:52098)
I20260709 13:10:20.150383 30038 tablet_copy_service.cc:161] P b2cea0098c1040f69755ea4d3dab7fc4: Beginning new tablet copy session on tablet 7d7c81315a41495eafb4a8020a99cb7c from peer 6f3eb161e2194f6891f12e2cfcaaf73a at {username='slave'} at 127.0.0.1:52098: session id = 6f3eb161e2194f6891f12e2cfcaaf73a-7d7c81315a41495eafb4a8020a99cb7c
I20260709 13:10:20.151356 31341 tablet_copy_client.cc:806] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:20.151942 31341 tablet_copy_client.cc:670] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:20.155700 31341 tablet_copy_client.cc:538] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:20.157382 31314 raft_consensus.cc:993] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124: : Instructing follower b2cea0098c1040f69755ea4d3dab7fc4 to start an election
I20260709 13:10:20.157970 31248 raft_consensus.cc:1081] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Signalling peer b2cea0098c1040f69755ea4d3dab7fc4 to start an election
I20260709 13:10:20.159543 30038 tablet_copy_source_session.cc:215] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:20.159516 30023 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f8fcd3026125450694af59415c94e029"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
 from {username='slave'} at 127.0.0.1:54206
I20260709 13:10:20.160100 30023 raft_consensus.cc:493] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:20.160435 30023 raft_consensus.cc:3060] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:20.162595 31345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d7c81315a41495eafb4a8020a99cb7c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:20.166492 30023 raft_consensus.cc:515] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:20.168857 30023 leader_election.cc:290] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:20.169005 31341 tablet_bootstrap.cc:492] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap starting.
I20260709 13:10:20.169495 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:20.170418 30103 raft_consensus.cc:3060] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:20.178584 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:20.179136 30177 raft_consensus.cc:3055] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:20.179419 30177 raft_consensus.cc:740] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:20.180172 30177 consensus_queue.cc:260] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:20.182477 30177 raft_consensus.cc:3060] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:20.184854 30103 raft_consensus.cc:2468] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 2.
I20260709 13:10:20.187737 29994 leader_election.cc:304] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:20.188553 31328 raft_consensus.cc:2804] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:20.188997 31328 raft_consensus.cc:697] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:20.189780 31328 consensus_queue.cc:237] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:20.193636 30177 raft_consensus.cc:2468] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 2.
I20260709 13:10:20.198877 31345 tablet_copy_client.cc:806] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:20.199836 31345 tablet_copy_client.cc:670] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:20.204103 31345 tablet_copy_client.cc:538] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:20.208506 29922 catalog_manager.cc:5697] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 1 to 2, leader changed from c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 2 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:20.210646 31345 tablet_bootstrap.cc:492] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap starting.
I20260709 13:10:20.214535 31341 tablet_bootstrap.cc:492] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:20.215286 31341 tablet_bootstrap.cc:492] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap complete.
I20260709 13:10:20.215794 31341 ts_tablet_manager.cc:1403] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent bootstrapping tablet: real 0.047s	user 0.022s	sys 0.001s
I20260709 13:10:20.219781 31341 raft_consensus.cc:359] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:20.220574 31341 raft_consensus.cc:740] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Initialized, Role: LEARNER
I20260709 13:10:20.221175 31341 consensus_queue.cc:260] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:20.226198 31341 ts_tablet_manager.cc:1434] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:10:20.232735 31345 tablet_bootstrap.cc:492] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:20.233644 31345 tablet_bootstrap.cc:492] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap complete.
I20260709 13:10:20.234385 31345 ts_tablet_manager.cc:1403] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent bootstrapping tablet: real 0.024s	user 0.023s	sys 0.000s
I20260709 13:10:20.236460 30113 tablet_copy_service.cc:342] P 5ec73dc157ed476ca903a7d596271719: Request end of tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-8495d060d6b042a3b7bd9dba1055dbbf received from {username='slave'} at 127.0.0.1:48558
I20260709 13:10:20.236967 30113 tablet_copy_service.cc:434] P 5ec73dc157ed476ca903a7d596271719: ending tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-8495d060d6b042a3b7bd9dba1055dbbf on tablet 8495d060d6b042a3b7bd9dba1055dbbf with peer 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:20.237375 31345 raft_consensus.cc:359] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:20.238291 31345 raft_consensus.cc:740] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Initialized, Role: LEARNER
I20260709 13:10:20.238956 31345 consensus_queue.cc:260] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:20.241683 31345 ts_tablet_manager.cc:1434] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:10:20.243306 30038 tablet_copy_service.cc:342] P b2cea0098c1040f69755ea4d3dab7fc4: Request end of tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-7d7c81315a41495eafb4a8020a99cb7c received from {username='slave'} at 127.0.0.1:52098
I20260709 13:10:20.243706 30038 tablet_copy_service.cc:434] P b2cea0098c1040f69755ea4d3dab7fc4: ending tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-7d7c81315a41495eafb4a8020a99cb7c on tablet 7d7c81315a41495eafb4a8020a99cb7c with peer 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:20.246407 31345 ts_tablet_manager.cc:933] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a: Initiating tablet copy from peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:20.258549 31345 tablet_copy_client.cc:323] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Beginning tablet copy session from remote peer at address 127.28.54.67:45001
I20260709 13:10:20.260375 30187 tablet_copy_service.cc:140] P c99569d27a6f4c648eae7119fe3db124: Received BeginTabletCopySession request for tablet 31b19922895c4885a5a8bc5030afcba3 from peer 6f3eb161e2194f6891f12e2cfcaaf73a ({username='slave'} at 127.0.0.1:54540)
I20260709 13:10:20.260896 30187 tablet_copy_service.cc:161] P c99569d27a6f4c648eae7119fe3db124: Beginning new tablet copy session on tablet 31b19922895c4885a5a8bc5030afcba3 from peer 6f3eb161e2194f6891f12e2cfcaaf73a at {username='slave'} at 127.0.0.1:54540: session id = 6f3eb161e2194f6891f12e2cfcaaf73a-31b19922895c4885a5a8bc5030afcba3
I20260709 13:10:20.268638 30187 tablet_copy_source_session.cc:215] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:20.274624 31345 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31b19922895c4885a5a8bc5030afcba3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:20.286008 31345 tablet_copy_client.cc:806] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:20.286586 31345 tablet_copy_client.cc:670] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:20.290510 31345 tablet_copy_client.cc:538] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:20.298918 31345 tablet_bootstrap.cc:492] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap starting.
I20260709 13:10:20.318315 31345 tablet_bootstrap.cc:492] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:20.319159 31345 tablet_bootstrap.cc:492] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap complete.
I20260709 13:10:20.319787 31345 ts_tablet_manager.cc:1403] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.004s
I20260709 13:10:20.321962 31350 ts_tablet_manager.cc:933] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a: Initiating tablet copy from peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:20.322583 31345 raft_consensus.cc:359] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:20.323419 31345 raft_consensus.cc:740] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Initialized, Role: LEARNER
I20260709 13:10:20.324368 31350 tablet_copy_client.cc:323] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Beginning tablet copy session from remote peer at address 127.28.54.66:43821
I20260709 13:10:20.324057 31345 consensus_queue.cc:260] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:20.325979 30113 tablet_copy_service.cc:140] P 5ec73dc157ed476ca903a7d596271719: Received BeginTabletCopySession request for tablet 978900c67750481aba3e58987ac43180 from peer 6f3eb161e2194f6891f12e2cfcaaf73a ({username='slave'} at 127.0.0.1:48558)
I20260709 13:10:20.326484 30113 tablet_copy_service.cc:161] P 5ec73dc157ed476ca903a7d596271719: Beginning new tablet copy session on tablet 978900c67750481aba3e58987ac43180 from peer 6f3eb161e2194f6891f12e2cfcaaf73a at {username='slave'} at 127.0.0.1:48558: session id = 6f3eb161e2194f6891f12e2cfcaaf73a-978900c67750481aba3e58987ac43180
I20260709 13:10:20.326879 31345 ts_tablet_manager.cc:1434] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:10:20.328625 30187 tablet_copy_service.cc:342] P c99569d27a6f4c648eae7119fe3db124: Request end of tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-31b19922895c4885a5a8bc5030afcba3 received from {username='slave'} at 127.0.0.1:54540
I20260709 13:10:20.328969 30187 tablet_copy_service.cc:434] P c99569d27a6f4c648eae7119fe3db124: ending tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-31b19922895c4885a5a8bc5030afcba3 on tablet 31b19922895c4885a5a8bc5030afcba3 with peer 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:20.333244 30113 tablet_copy_source_session.cc:215] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:20.336247 31350 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 978900c67750481aba3e58987ac43180. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:20.351279 31350 tablet_copy_client.cc:806] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:20.351797 31350 tablet_copy_client.cc:670] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:20.355080 31350 tablet_copy_client.cc:538] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:20.380923 31350 tablet_bootstrap.cc:492] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap starting.
I20260709 13:10:20.394775 30736 raft_consensus.cc:1275] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:20.396679 31354 consensus_queue.cc:1048] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:20.413118 31350 tablet_bootstrap.cc:492] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:20.414024 31350 tablet_bootstrap.cc:492] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap complete.
I20260709 13:10:20.414647 31350 ts_tablet_manager.cc:1403] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent bootstrapping tablet: real 0.034s	user 0.018s	sys 0.001s
I20260709 13:10:20.418219 31350 raft_consensus.cc:359] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:20.419052 31350 raft_consensus.cc:740] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Initialized, Role: LEARNER
I20260709 13:10:20.419734 31350 consensus_queue.cc:260] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:20.420792 30023 raft_consensus.cc:1275] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:20.422227 31350 ts_tablet_manager.cc:1434] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:10:20.422304 31301 consensus_queue.cc:1048] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:20.431767 30113 tablet_copy_service.cc:342] P 5ec73dc157ed476ca903a7d596271719: Request end of tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-978900c67750481aba3e58987ac43180 received from {username='slave'} at 127.0.0.1:48558
I20260709 13:10:20.432195 30113 tablet_copy_service.cc:434] P 5ec73dc157ed476ca903a7d596271719: ending tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-978900c67750481aba3e58987ac43180 on tablet 978900c67750481aba3e58987ac43180 with peer 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:20.558636 30026 raft_consensus.cc:1275] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:20.559746 31344 consensus_queue.cc:1048] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:20.567313 30102 raft_consensus.cc:1275] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:20.574555 31314 consensus_queue.cc:1048] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:20.589919 30177 raft_consensus.cc:1275] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:20.597256 30026 raft_consensus.cc:1275] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:20.599874 31314 consensus_queue.cc:1048] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:20.604619 30102 raft_consensus.cc:1275] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:20.607726 31328 consensus_queue.cc:1048] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:20.597122 31323 consensus_queue.cc:1048] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:20.630093 30172 raft_consensus.cc:1275] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:20.631508 31328 consensus_queue.cc:1048] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:20.689865 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 83570.8us
I20260709 13:10:20.719449 30736 raft_consensus.cc:1217] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:20.752986 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:10:20.948964 30142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 105610us
I20260709 13:10:20.953732 30736 raft_consensus.cc:1217] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:21.043956 30736 raft_consensus.cc:1217] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
W20260709 13:10:21.059093 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 44084.2us
I20260709 13:10:21.083156 30736 raft_consensus.cc:1217] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260709 13:10:21.101411 31390 log.cc:927] Time spent T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.105s	user 0.000s	sys 0.003s
W20260709 13:10:21.107266 31367 log.cc:927] Time spent T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.118s	user 0.000s	sys 0.007s
W20260709 13:10:21.125844 30142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 109648us
W20260709 13:10:21.142813 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 87412.1us
I20260709 13:10:21.143718 31391 raft_consensus.cc:1064] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719: attempting to promote NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a to VOTER
I20260709 13:10:21.152078 31391 consensus_queue.cc:237] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:21.170571 30022 raft_consensus.cc:1275] T 8495d060d6b042a3b7bd9dba1055dbbf P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:21.172802 31358 consensus_queue.cc:1048] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:21.186460 30736 raft_consensus.cc:1275] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:21.188124 30171 raft_consensus.cc:1275] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:21.193470 31391 consensus_queue.cc:1048] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:21.195149 31358 consensus_queue.cc:1048] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:21.214874 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:21.233083 31358 raft_consensus.cc:2955] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:21.234609 30736 raft_consensus.cc:2955] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:21.238587 30171 raft_consensus.cc:2955] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:21.244750 30022 raft_consensus.cc:2955] T 8495d060d6b042a3b7bd9dba1055dbbf P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:21.261463 29924 catalog_manager.cc:5697] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:21.289088 30102 consensus_queue.cc:237] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:21.298491 30736 raft_consensus.cc:1275] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:21.298887 30171 raft_consensus.cc:1275] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:21.300125 31397 consensus_queue.cc:1048] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:21.301786 31397 consensus_queue.cc:1048] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:21.307466 31358 raft_consensus.cc:2955] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:21.315500 29913 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8495d060d6b042a3b7bd9dba1055dbbf with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:21.325335 30736 raft_consensus.cc:2955] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:21.326604 30102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24644eca754d40189c8264977160368a"
dest_uuid: "5ec73dc157ed476ca903a7d596271719"
mode: GRACEFUL
new_leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
 from {username='slave'} at 127.0.0.1:37340
I20260709 13:10:21.327164 30102 raft_consensus.cc:606] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Received request to transfer leadership to TS b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:21.330639 30171 raft_consensus.cc:2955] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:21.340442 30022 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
mode: GRACEFUL
new_leader_uuid: "c99569d27a6f4c648eae7119fe3db124"
 from {username='slave'} at 127.0.0.1:47450
I20260709 13:10:21.340122 29925 catalog_manager.cc:5697] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: config changed from index 3 to 4, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:21.341032 30022 raft_consensus.cc:606] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Received request to transfer leadership to TS c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:21.347581 30171 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe"
dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
mode: GRACEFUL
new_leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
 from {username='slave'} at 127.0.0.1:38454
I20260709 13:10:21.348084 30171 raft_consensus.cc:606] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Received request to transfer leadership to TS b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:21.350172 30009 tablet_service.cc:1558] Processing DeleteTablet for tablet 8495d060d6b042a3b7bd9dba1055dbbf with delete_type TABLET_DATA_TOMBSTONED (TS b2cea0098c1040f69755ea4d3dab7fc4 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54192
I20260709 13:10:21.352790 28889 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:10:21.353127 31409 tablet_replica.cc:333] T 8495d060d6b042a3b7bd9dba1055dbbf P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:10:21.355155 31409 raft_consensus.cc:2243] T 8495d060d6b042a3b7bd9dba1055dbbf P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.355769 28889 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:21.358935 31409 raft_consensus.cc:2272] T 8495d060d6b042a3b7bd9dba1055dbbf P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.364046 31409 ts_tablet_manager.cc:1916] T 8495d060d6b042a3b7bd9dba1055dbbf P b2cea0098c1040f69755ea4d3dab7fc4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:21.379536 31409 ts_tablet_manager.cc:1929] T 8495d060d6b042a3b7bd9dba1055dbbf P b2cea0098c1040f69755ea4d3dab7fc4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:21.380017 31409 log.cc:1199] T 8495d060d6b042a3b7bd9dba1055dbbf P b2cea0098c1040f69755ea4d3dab7fc4: Deleting WAL directory at /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-0-root/wals/8495d060d6b042a3b7bd9dba1055dbbf
I20260709 13:10:21.381680 29910 catalog_manager.cc:5028] TS b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): tablet 8495d060d6b042a3b7bd9dba1055dbbf (table test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]) successfully deleted
I20260709 13:10:21.420352 31373 raft_consensus.cc:993] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124: : Instructing follower b2cea0098c1040f69755ea4d3dab7fc4 to start an election
I20260709 13:10:21.421033 31398 raft_consensus.cc:1081] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Signalling peer b2cea0098c1040f69755ea4d3dab7fc4 to start an election
I20260709 13:10:21.425881 30022 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
 from {username='slave'} at 127.0.0.1:54206
I20260709 13:10:21.426451 30022 raft_consensus.cc:493] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:21.427121 30022 raft_consensus.cc:3060] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:21.441512 30022 raft_consensus.cc:515] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:21.444417 30022 leader_election.cc:290] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:21.449064 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:21.449635 30735 raft_consensus.cc:3060] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:21.449004 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:21.451309 30171 raft_consensus.cc:3055] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:21.451574 30171 raft_consensus.cc:740] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:21.452226 30171 consensus_queue.cc:260] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:21.452692 31358 raft_consensus.cc:1064] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719: attempting to promote NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a to VOTER
I20260709 13:10:21.453519 30171 raft_consensus.cc:3060] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:21.455358 31358 consensus_queue.cc:237] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:21.460845 30171 raft_consensus.cc:2468] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 2.
I20260709 13:10:21.465268 29993 leader_election.cc:304] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:21.466125 31370 raft_consensus.cc:2804] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:21.466570 31370 raft_consensus.cc:697] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:21.466936 31399 raft_consensus.cc:1064] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124: attempting to promote NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a to VOTER
I20260709 13:10:21.467360 31370 consensus_queue.cc:237] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:21.469834 31399 consensus_queue.cc:237] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:21.461642 30735 raft_consensus.cc:2468] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 2.
I20260709 13:10:21.482816 29922 catalog_manager.cc:5697] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 1 to 2, leader changed from c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 2 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:21.518507 30171 raft_consensus.cc:1275] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:21.518863 30022 raft_consensus.cc:1275] T 978900c67750481aba3e58987ac43180 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:21.520845 30736 raft_consensus.cc:1275] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:21.521157 30735 raft_consensus.cc:1275] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:21.523283 31398 consensus_queue.cc:1048] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:21.524142 31358 consensus_queue.cc:1048] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:21.526301 31395 consensus_queue.cc:1048] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:21.539235 30026 raft_consensus.cc:1275] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:21.550917 31395 raft_consensus.cc:993] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719: : Instructing follower b2cea0098c1040f69755ea4d3dab7fc4 to start an election
I20260709 13:10:21.551415 31395 raft_consensus.cc:1081] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Signalling peer b2cea0098c1040f69755ea4d3dab7fc4 to start an election
I20260709 13:10:21.550659 31399 consensus_queue.cc:1048] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:21.553033 30022 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "24644eca754d40189c8264977160368a"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
 from {username='slave'} at 127.0.0.1:54198
I20260709 13:10:21.553534 30022 raft_consensus.cc:493] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:21.553894 30022 raft_consensus.cc:3060] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:21.555171 30098 raft_consensus.cc:1275] T 31b19922895c4885a5a8bc5030afcba3 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:21.559218 31385 raft_consensus.cc:1064] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4: attempting to promote NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a to VOTER
I20260709 13:10:21.560883 31397 consensus_queue.cc:1048] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:21.563875 30022 raft_consensus.cc:515] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:21.565834 30022 leader_election.cc:290] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:21.567283 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:21.567811 30101 raft_consensus.cc:3055] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:21.568090 30101 raft_consensus.cc:740] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:21.568536 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:21.569058 30171 raft_consensus.cc:3060] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:21.568845 30101 consensus_queue.cc:260] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:21.570775 30101 raft_consensus.cc:3060] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:21.561631 31385 consensus_queue.cc:237] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:21.576324 31399 consensus_queue.cc:1048] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:21.585139 30101 raft_consensus.cc:2468] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 2.
I20260709 13:10:21.586350 29994 leader_election.cc:304] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:21.587113 31370 raft_consensus.cc:2804] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:21.587568 31370 raft_consensus.cc:697] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:21.588354 31370 consensus_queue.cc:237] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:21.597591 31391 raft_consensus.cc:2955] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:21.604712 30171 raft_consensus.cc:2468] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 2.
I20260709 13:10:21.605999 30023 raft_consensus.cc:2955] T 978900c67750481aba3e58987ac43180 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:21.608952 30736 raft_consensus.cc:2955] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:21.615070 30172 raft_consensus.cc:1275] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:10:21.616874 31375 consensus_queue.cc:1048] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:21.627077 30735 raft_consensus.cc:1275] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEARNER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:10:21.628695 31286 consensus_queue.cc:1048] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:21.628963 29922 catalog_manager.cc:5697] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 1 to 2, leader changed from 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 2 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:21.630052 31379 raft_consensus.cc:2955] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:21.634207 30101 raft_consensus.cc:1275] T 7d7c81315a41495eafb4a8020a99cb7c P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:10:21.635715 31286 consensus_queue.cc:1048] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:21.656909 30173 raft_consensus.cc:2955] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:21.659590 29922 catalog_manager.cc:5697] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:21.688120 31385 raft_consensus.cc:993] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4: : Instructing follower c99569d27a6f4c648eae7119fe3db124 to start an election
I20260709 13:10:21.689073 31375 raft_consensus.cc:1081] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Signalling peer c99569d27a6f4c648eae7119fe3db124 to start an election
I20260709 13:10:21.688400 30022 raft_consensus.cc:2955] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:21.690590 30172 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25"
dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
 from {username='slave'} at 127.0.0.1:43838
I20260709 13:10:21.691119 30172 raft_consensus.cc:493] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:21.691476 30172 raft_consensus.cc:3060] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:21.692273 30735 raft_consensus.cc:2955] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:21.698491 30172 raft_consensus.cc:515] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:21.697878 31385 raft_consensus.cc:2955] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:21.711176 30172 leader_election.cc:290] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 2 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:21.712348 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:21.712953 30736 raft_consensus.cc:3060] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:21.712356 30101 consensus_queue.cc:237] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:21.718845 30734 raft_consensus.cc:1275] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:21.719691 30736 raft_consensus.cc:2468] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 2.
I20260709 13:10:21.720805 30142 leader_election.cc:304] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:21.720731 31335 consensus_queue.cc:1048] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:21.721598 31379 raft_consensus.cc:2804] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:21.722347 31379 raft_consensus.cc:697] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 2 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:21.723246 31379 consensus_queue.cc:237] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:21.727113 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:21.726363 30735 raft_consensus.cc:2955] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:21.727644 30022 raft_consensus.cc:3055] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:21.728000 30022 raft_consensus.cc:740] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:21.720146 30171 raft_consensus.cc:2955] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:21.727780 29923 catalog_manager.cc:5697] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: config changed from index 3 to 4, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:21.728792 30022 consensus_queue.cc:260] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:21.736528 30022 raft_consensus.cc:3060] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:21.738349 30177 raft_consensus.cc:1275] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:21.752130 30022 raft_consensus.cc:2468] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 2.
I20260709 13:10:21.753659 31391 consensus_queue.cc:1048] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:21.756897 31397 raft_consensus.cc:2955] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:21.758286 29922 catalog_manager.cc:5697] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
W20260709 13:10:21.764253 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 74282.4us
I20260709 13:10:21.770071 29913 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 978900c67750481aba3e58987ac43180 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:21.781418 30101 raft_consensus.cc:2955] T 7d7c81315a41495eafb4a8020a99cb7c P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:21.782320 29925 catalog_manager.cc:5697] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 1 to 2, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 2 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:21.783636 30735 raft_consensus.cc:2955] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:21.789628 30102 raft_consensus.cc:2955] T 31b19922895c4885a5a8bc5030afcba3 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:21.798350 29923 catalog_manager.cc:5697] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 reported cstate change: config changed from index 3 to 4, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:21.802203 30171 raft_consensus.cc:2955] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:21.816960 30009 tablet_service.cc:1558] Processing DeleteTablet for tablet 978900c67750481aba3e58987ac43180 with delete_type TABLET_DATA_TOMBSTONED (TS b2cea0098c1040f69755ea4d3dab7fc4 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:54192
I20260709 13:10:21.817986 31409 tablet_replica.cc:333] T 978900c67750481aba3e58987ac43180 P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:10:21.818977 31409 raft_consensus.cc:2243] T 978900c67750481aba3e58987ac43180 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.819782 31409 raft_consensus.cc:2272] T 978900c67750481aba3e58987ac43180 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.815908 30022 consensus_queue.cc:237] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:21.823019 31409 ts_tablet_manager.cc:1916] T 978900c67750481aba3e58987ac43180 P b2cea0098c1040f69755ea4d3dab7fc4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:21.822934 30171 consensus_queue.cc:237] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:21.835299 30173 raft_consensus.cc:1275] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:21.836643 31286 consensus_queue.cc:1048] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:21.837347 30735 raft_consensus.cc:1275] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:21.839561 31286 consensus_queue.cc:1048] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:21.845132 31375 raft_consensus.cc:2955] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:21.851162 31409 ts_tablet_manager.cc:1929] T 978900c67750481aba3e58987ac43180 P b2cea0098c1040f69755ea4d3dab7fc4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:21.851673 31409 log.cc:1199] T 978900c67750481aba3e58987ac43180 P b2cea0098c1040f69755ea4d3dab7fc4: Deleting WAL directory at /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-0-root/wals/978900c67750481aba3e58987ac43180
I20260709 13:10:21.854871 29910 catalog_manager.cc:5028] TS b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): tablet 978900c67750481aba3e58987ac43180 (table test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]) successfully deleted
I20260709 13:10:21.858367 30734 raft_consensus.cc:2955] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:21.858932 30173 raft_consensus.cc:2955] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:21.862803 29910 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7d7c81315a41495eafb4a8020a99cb7c with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:21.873027 30735 raft_consensus.cc:1275] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:21.874866 31379 consensus_queue.cc:1048] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:21.879185 29922 catalog_manager.cc:5697] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: config changed from index 4 to 5, VOTER 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) evicted. New cstate: current_term: 2 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:21.881122 31399 raft_consensus.cc:2955] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:21.882709 30736 raft_consensus.cc:2955] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:21.886157 30735 raft_consensus.cc:1275] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:21.888197 31385 consensus_queue.cc:1048] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:21.889308 29912 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 31b19922895c4885a5a8bc5030afcba3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:21.896911 30091 tablet_service.cc:1558] Processing DeleteTablet for tablet 7d7c81315a41495eafb4a8020a99cb7c with delete_type TABLET_DATA_TOMBSTONED (TS 5ec73dc157ed476ca903a7d596271719 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:33984
I20260709 13:10:21.899281 30023 raft_consensus.cc:1275] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:21.900990 31424 consensus_queue.cc:1048] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:21.913825 29922 catalog_manager.cc:5697] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: config changed from index 3 to 4, VOTER 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) evicted. New cstate: current_term: 1 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:21.914335 30022 raft_consensus.cc:2955] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:21.929240 30087 tablet_service.cc:1558] Processing DeleteTablet for tablet 31b19922895c4885a5a8bc5030afcba3 with delete_type TABLET_DATA_TOMBSTONED (TS 5ec73dc157ed476ca903a7d596271719 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:33984
I20260709 13:10:21.930873 31426 tablet_replica.cc:333] T 7d7c81315a41495eafb4a8020a99cb7c P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:10:21.933205 31426 raft_consensus.cc:2243] T 7d7c81315a41495eafb4a8020a99cb7c P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.933954 30171 raft_consensus.cc:1275] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:21.939574 31426 raft_consensus.cc:2272] T 7d7c81315a41495eafb4a8020a99cb7c P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.940753 31375 consensus_queue.cc:1048] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:21.944391 31426 ts_tablet_manager.cc:1916] T 7d7c81315a41495eafb4a8020a99cb7c P 5ec73dc157ed476ca903a7d596271719: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:21.967171 31426 ts_tablet_manager.cc:1929] T 7d7c81315a41495eafb4a8020a99cb7c P 5ec73dc157ed476ca903a7d596271719: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:10:21.967682 31426 log.cc:1199] T 7d7c81315a41495eafb4a8020a99cb7c P 5ec73dc157ed476ca903a7d596271719: Deleting WAL directory at /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-1-root/wals/7d7c81315a41495eafb4a8020a99cb7c
I20260709 13:10:21.969416 29913 catalog_manager.cc:5028] TS 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): tablet 7d7c81315a41495eafb4a8020a99cb7c (table test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]) successfully deleted
I20260709 13:10:21.969659 31426 tablet_replica.cc:333] T 31b19922895c4885a5a8bc5030afcba3 P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:10:21.970707 31426 raft_consensus.cc:2243] T 31b19922895c4885a5a8bc5030afcba3 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:21.971395 31426 raft_consensus.cc:2272] T 31b19922895c4885a5a8bc5030afcba3 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:21.974025 31426 ts_tablet_manager.cc:1916] T 31b19922895c4885a5a8bc5030afcba3 P 5ec73dc157ed476ca903a7d596271719: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:21.985080 31426 ts_tablet_manager.cc:1929] T 31b19922895c4885a5a8bc5030afcba3 P 5ec73dc157ed476ca903a7d596271719: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:21.985357 31426 log.cc:1199] T 31b19922895c4885a5a8bc5030afcba3 P 5ec73dc157ed476ca903a7d596271719: Deleting WAL directory at /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-1-root/wals/31b19922895c4885a5a8bc5030afcba3
I20260709 13:10:21.986508 29913 catalog_manager.cc:5028] TS 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): tablet 31b19922895c4885a5a8bc5030afcba3 (table test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]) successfully deleted
I20260709 13:10:22.091615 30102 raft_consensus.cc:1275] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:22.092705 31375 consensus_queue.cc:1048] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:22.100102 30171 raft_consensus.cc:1275] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:22.101228 31370 consensus_queue.cc:1048] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:22.132123 30734 raft_consensus.cc:1275] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:22.133104 31398 consensus_queue.cc:1048] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:22.141279 30023 raft_consensus.cc:1275] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:22.142751 31399 consensus_queue.cc:1048] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:22.357425 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:22.420210 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:22.454274 30101 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "978900c67750481aba3e58987ac43180"
dest_uuid: "5ec73dc157ed476ca903a7d596271719"
mode: GRACEFUL
new_leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
 from {username='slave'} at 127.0.0.1:37340
I20260709 13:10:22.454741 30101 raft_consensus.cc:606] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Received request to transfer leadership to TS 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:22.456949 30171 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43"
dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
mode: GRACEFUL
new_leader_uuid: "5ec73dc157ed476ca903a7d596271719"
 from {username='slave'} at 127.0.0.1:38454
I20260709 13:10:22.457505 30171 raft_consensus.cc:606] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Received request to transfer leadership to TS 5ec73dc157ed476ca903a7d596271719
I20260709 13:10:22.459583 30023 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
mode: GRACEFUL
new_leader_uuid: "c99569d27a6f4c648eae7119fe3db124"
 from {username='slave'} at 127.0.0.1:47450
I20260709 13:10:22.459990 30023 raft_consensus.cc:606] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Received request to transfer leadership to TS c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:22.462011 30023 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f8fcd3026125450694af59415c94e029"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
mode: GRACEFUL
new_leader_uuid: "5ec73dc157ed476ca903a7d596271719"
 from {username='slave'} at 127.0.0.1:47450
I20260709 13:10:22.462399 30023 raft_consensus.cc:606] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 LEADER]: Received request to transfer leadership to TS 5ec73dc157ed476ca903a7d596271719
I20260709 13:10:22.463346 28889 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 13:10:22.464711 28889 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:22.545975 31399 raft_consensus.cc:993] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124: : Instructing follower 5ec73dc157ed476ca903a7d596271719 to start an election
I20260709 13:10:22.546501 31424 raft_consensus.cc:1081] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Signalling peer 5ec73dc157ed476ca903a7d596271719 to start an election
I20260709 13:10:22.547873 30102 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43"
dest_uuid: "5ec73dc157ed476ca903a7d596271719"
 from {username='slave'} at 127.0.0.1:33992
I20260709 13:10:22.548365 30102 raft_consensus.cc:493] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:22.548686 30102 raft_consensus.cc:3060] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:22.553766 30102 raft_consensus.cc:515] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:22.555140 30102 leader_election.cc:290] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:22.555728 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:22.555933 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:22.556429 30171 raft_consensus.cc:3055] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:22.556483 30734 raft_consensus.cc:3060] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:22.556856 30171 raft_consensus.cc:740] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:22.557590 30171 consensus_queue.cc:260] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:22.558578 30171 raft_consensus.cc:3060] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:22.561484 30734 raft_consensus.cc:2468] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
I20260709 13:10:22.562465 30068 leader_election.cc:304] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:10:22.562788 30171 raft_consensus.cc:2468] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
I20260709 13:10:22.563056 31378 raft_consensus.cc:2804] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:22.563551 31378 raft_consensus.cc:697] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 2 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:22.564327 31378 consensus_queue.cc:237] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:22.572867 29922 catalog_manager.cc:5697] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 1 to 2, leader changed from c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 2 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:22.637348 31370 raft_consensus.cc:993] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4: : Instructing follower 5ec73dc157ed476ca903a7d596271719 to start an election
I20260709 13:10:22.637791 31286 raft_consensus.cc:1081] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 LEADER]: Signalling peer 5ec73dc157ed476ca903a7d596271719 to start an election
I20260709 13:10:22.639087 30102 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f8fcd3026125450694af59415c94e029"
dest_uuid: "5ec73dc157ed476ca903a7d596271719"
 from {username='slave'} at 127.0.0.1:33990
I20260709 13:10:22.639577 30102 raft_consensus.cc:493] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:22.639935 30102 raft_consensus.cc:3060] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:22.644570 30102 raft_consensus.cc:515] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:22.645889 30102 leader_election.cc:290] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:22.646471 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:22.646847 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:22.647051 30023 raft_consensus.cc:3055] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:22.647364 30171 raft_consensus.cc:3060] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:22.652226 30171 raft_consensus.cc:2468] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 3.
I20260709 13:10:22.647344 30023 raft_consensus.cc:740] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:22.652958 30068 leader_election.cc:304] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:22.653014 30023 consensus_queue.cc:260] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:22.653681 31335 raft_consensus.cc:2804] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:22.654155 31335 raft_consensus.cc:697] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 3 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:22.654227 30023 raft_consensus.cc:3060] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:22.655078 31335 consensus_queue.cc:237] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:22.659531 30023 raft_consensus.cc:2468] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 3.
I20260709 13:10:22.663053 29922 catalog_manager.cc:5697] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 2 to 3, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 3 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:22.684073 31378 raft_consensus.cc:993] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719: : Instructing follower 6f3eb161e2194f6891f12e2cfcaaf73a to start an election
I20260709 13:10:22.684546 31378 raft_consensus.cc:1081] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Signalling peer 6f3eb161e2194f6891f12e2cfcaaf73a to start an election
I20260709 13:10:22.685940 30734 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "978900c67750481aba3e58987ac43180"
dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
 from {username='slave'} at 127.0.0.1:56954
I20260709 13:10:22.686475 30734 raft_consensus.cc:493] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:22.686761 30734 raft_consensus.cc:3060] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:22.695050 30734 raft_consensus.cc:515] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:22.696862 30734 leader_election.cc:290] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:22.697417 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:22.697717 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:22.698000 30102 raft_consensus.cc:3055] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:22.698216 30171 raft_consensus.cc:3060] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:22.698262 30102 raft_consensus.cc:740] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:22.698915 30102 consensus_queue.cc:260] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:22.699680 30102 raft_consensus.cc:3060] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:22.703318 30171 raft_consensus.cc:2468] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 2.
I20260709 13:10:22.704347 30702 leader_election.cc:304] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:22.705014 31324 raft_consensus.cc:2804] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:22.705781 31324 raft_consensus.cc:697] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:22.706588 31324 consensus_queue.cc:237] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:22.707881 30102 raft_consensus.cc:2468] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 2.
I20260709 13:10:22.714824 29922 catalog_manager.cc:5697] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: term changed from 1 to 2, leader changed from 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) to 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68). New cstate: current_term: 2 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:22.879979 31286 raft_consensus.cc:993] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4: : Instructing follower c99569d27a6f4c648eae7119fe3db124 to start an election
I20260709 13:10:22.880442 31370 raft_consensus.cc:1081] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Signalling peer c99569d27a6f4c648eae7119fe3db124 to start an election
I20260709 13:10:22.881610 30171 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b"
dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
 from {username='slave'} at 127.0.0.1:43838
I20260709 13:10:22.882057 30171 raft_consensus.cc:493] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:22.882311 30171 raft_consensus.cc:3060] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:22.886299 30171 raft_consensus.cc:515] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:22.887554 30171 leader_election.cc:290] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 2 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:22.888283 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:22.888662 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:22.888846 30023 raft_consensus.cc:3055] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:22.889146 30102 raft_consensus.cc:3060] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:22.889240 30023 raft_consensus.cc:740] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:22.891224 30023 consensus_queue.cc:260] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:22.892238 30023 raft_consensus.cc:3060] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:22.895413 30102 raft_consensus.cc:2468] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 2.
I20260709 13:10:22.896349 30023 raft_consensus.cc:2468] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 2.
I20260709 13:10:22.896361 30143 leader_election.cc:304] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:22.897186 31398 raft_consensus.cc:2804] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:22.897543 31398 raft_consensus.cc:697] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 2 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:22.898252 31398 consensus_queue.cc:237] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:22.906967 29922 catalog_manager.cc:5697] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 1 to 2, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 2 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:22.991106 30102 consensus_queue.cc:237] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:22.996999 30171 raft_consensus.cc:1275] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 13:10:22.997128 30068 consensus_peers.cc:597] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 -> Peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469): Couldn't send request to peer 6f3eb161e2194f6891f12e2cfcaaf73a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 88d3759f7fe14a4d8e7ba8670ce5cfeb. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:22.997191 30023 raft_consensus.cc:1275] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:22.998178 31446 consensus_queue.cc:1048] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:22.998842 31335 consensus_queue.cc:1048] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:23.006705 31335 raft_consensus.cc:2955] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:23.007732 30023 raft_consensus.cc:2955] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:23.009052 30171 raft_consensus.cc:2955] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:23.012017 30173 raft_consensus.cc:1275] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:23.018226 31378 consensus_queue.cc:1048] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:23.024842 30101 consensus_queue.cc:237] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:23.025895 29925 catalog_manager.cc:5697] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:23.061589 30734 raft_consensus.cc:1275] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:23.063561 30171 raft_consensus.cc:1275] T 57ce415a86d343cb8bdff28acc41c6a6 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:23.068590 31453 consensus_queue.cc:1048] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:23.069356 31378 consensus_queue.cc:1048] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:23.072413 30068 consensus_peers.cc:597] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 -> Peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469): Couldn't send request to peer 6f3eb161e2194f6891f12e2cfcaaf73a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 57ce415a86d343cb8bdff28acc41c6a6. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:23.078922 30023 raft_consensus.cc:1275] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:23.084185 31446 consensus_queue.cc:1048] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:23.094424 31446 raft_consensus.cc:2955] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:23.099599 30022 raft_consensus.cc:2955] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:23.109086 30101 consensus_queue.cc:237] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:23.116062 29925 catalog_manager.cc:5697] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:23.118242 30173 raft_consensus.cc:2955] T 57ce415a86d343cb8bdff28acc41c6a6 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:23.123142 30022 raft_consensus.cc:1275] T b66f98d7fcfe4102a01ace9ed64355ed P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 13:10:23.124178 30068 consensus_peers.cc:597] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 -> Peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469): Couldn't send request to peer 6f3eb161e2194f6891f12e2cfcaaf73a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b66f98d7fcfe4102a01ace9ed64355ed. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:23.124931 31335 consensus_queue.cc:1048] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:23.126919 30171 raft_consensus.cc:1275] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:23.129937 31335 consensus_queue.cc:1048] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:23.234156 30023 raft_consensus.cc:1275] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:23.234186 31453 raft_consensus.cc:2955] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:23.236879 30173 raft_consensus.cc:1275] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:23.243531 30023 raft_consensus.cc:2955] T b66f98d7fcfe4102a01ace9ed64355ed P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:23.245041 31335 consensus_queue.cc:1048] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:23.254591 30026 consensus_queue.cc:237] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:23.270068 31446 consensus_queue.cc:1048] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:23.276830 30173 raft_consensus.cc:1275] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:23.278671 30173 raft_consensus.cc:2955] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:23.292007 29924 catalog_manager.cc:5697] T b66f98d7fcfe4102a01ace9ed64355ed P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: config changed from index -1 to 3, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New cstate: current_term: 2 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:23.307281 31324 consensus_queue.cc:1048] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:23.312492 30172 raft_consensus.cc:1275] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:23.313824 31370 consensus_queue.cc:1048] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:23.316836 30099 raft_consensus.cc:1275] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:10:23.326751 31400 consensus_queue.cc:1048] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:23.388667 30099 raft_consensus.cc:1275] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:23.398998 30099 raft_consensus.cc:1275] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 13:10:23.400290 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 71611.4us
W20260709 13:10:23.408950 29993 consensus_peers.cc:597] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 -> Peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469): Couldn't send request to peer 6f3eb161e2194f6891f12e2cfcaaf73a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3a0f0dc1823e4c99aa3cc53ce8a58efa. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:23.412288 31441 consensus_queue.cc:1048] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:10:23.421036 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 93073.1us
W20260709 13:10:23.425848 30142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 46492.5us
W20260709 13:10:23.439430 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 48322.9us
I20260709 13:10:23.439430 31286 raft_consensus.cc:2955] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:23.435750 31424 consensus_queue.cc:1048] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20260709 13:10:23.465528 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:23.479379 31477 ts_tablet_manager.cc:933] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a: Initiating tablet copy from peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:23.494944 29924 catalog_manager.cc:5697] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: config changed from index -1 to 3, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New cstate: current_term: 2 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:23.509047 30176 raft_consensus.cc:2955] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:23.544973 30026 raft_consensus.cc:1275] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:10:23.551146 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 98851.2us
I20260709 13:10:23.569310 31398 consensus_queue.cc:1048] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:23.589603 30099 raft_consensus.cc:2955] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:23.597918 31477 tablet_copy_client.cc:323] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Beginning tablet copy session from remote peer at address 127.28.54.66:43821
I20260709 13:10:23.602403 30113 tablet_copy_service.cc:140] P 5ec73dc157ed476ca903a7d596271719: Received BeginTabletCopySession request for tablet 88d3759f7fe14a4d8e7ba8670ce5cfeb from peer 6f3eb161e2194f6891f12e2cfcaaf73a ({username='slave'} at 127.0.0.1:48558)
I20260709 13:10:23.602968 30113 tablet_copy_service.cc:161] P 5ec73dc157ed476ca903a7d596271719: Beginning new tablet copy session on tablet 88d3759f7fe14a4d8e7ba8670ce5cfeb from peer 6f3eb161e2194f6891f12e2cfcaaf73a at {username='slave'} at 127.0.0.1:48558: session id = 6f3eb161e2194f6891f12e2cfcaaf73a-88d3759f7fe14a4d8e7ba8670ce5cfeb
I20260709 13:10:23.622658 30113 tablet_copy_source_session.cc:215] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:23.628964 31477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88d3759f7fe14a4d8e7ba8670ce5cfeb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.650204 31477 tablet_copy_client.cc:806] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:23.650818 31477 tablet_copy_client.cc:670] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:23.669535 31490 ts_tablet_manager.cc:933] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a: Initiating tablet copy from peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:23.670017 31477 tablet_copy_client.cc:538] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:23.680011 31491 ts_tablet_manager.cc:933] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a: Initiating tablet copy from peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:23.682137 31490 tablet_copy_client.cc:323] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Beginning tablet copy session from remote peer at address 127.28.54.66:43821
I20260709 13:10:23.685652 31477 tablet_bootstrap.cc:492] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap starting.
I20260709 13:10:23.686569 30113 tablet_copy_service.cc:140] P 5ec73dc157ed476ca903a7d596271719: Received BeginTabletCopySession request for tablet b66f98d7fcfe4102a01ace9ed64355ed from peer 6f3eb161e2194f6891f12e2cfcaaf73a ({username='slave'} at 127.0.0.1:48558)
I20260709 13:10:23.687721 30113 tablet_copy_service.cc:161] P 5ec73dc157ed476ca903a7d596271719: Beginning new tablet copy session on tablet b66f98d7fcfe4102a01ace9ed64355ed from peer 6f3eb161e2194f6891f12e2cfcaaf73a at {username='slave'} at 127.0.0.1:48558: session id = 6f3eb161e2194f6891f12e2cfcaaf73a-b66f98d7fcfe4102a01ace9ed64355ed
I20260709 13:10:23.697074 30113 tablet_copy_source_session.cc:215] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:23.714639 31477 tablet_bootstrap.cc:492] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:23.715214 31491 tablet_copy_client.cc:323] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Beginning tablet copy session from remote peer at address 127.28.54.66:43821
I20260709 13:10:23.715680 31477 tablet_bootstrap.cc:492] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap complete.
I20260709 13:10:23.716460 31477 ts_tablet_manager.cc:1403] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.014s
I20260709 13:10:23.716866 30113 tablet_copy_service.cc:140] P 5ec73dc157ed476ca903a7d596271719: Received BeginTabletCopySession request for tablet 57ce415a86d343cb8bdff28acc41c6a6 from peer 6f3eb161e2194f6891f12e2cfcaaf73a ({username='slave'} at 127.0.0.1:48558)
I20260709 13:10:23.717398 30113 tablet_copy_service.cc:161] P 5ec73dc157ed476ca903a7d596271719: Beginning new tablet copy session on tablet 57ce415a86d343cb8bdff28acc41c6a6 from peer 6f3eb161e2194f6891f12e2cfcaaf73a at {username='slave'} at 127.0.0.1:48558: session id = 6f3eb161e2194f6891f12e2cfcaaf73a-57ce415a86d343cb8bdff28acc41c6a6
I20260709 13:10:23.719640 31490 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b66f98d7fcfe4102a01ace9ed64355ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.720373 31477 raft_consensus.cc:359] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:23.721616 31477 raft_consensus.cc:740] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Initialized, Role: LEARNER
I20260709 13:10:23.722586 31477 consensus_queue.cc:260] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:23.725046 31477 ts_tablet_manager.cc:1434] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:10:23.726279 30113 tablet_copy_source_session.cc:215] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:23.729732 30113 tablet_copy_service.cc:342] P 5ec73dc157ed476ca903a7d596271719: Request end of tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-88d3759f7fe14a4d8e7ba8670ce5cfeb received from {username='slave'} at 127.0.0.1:48558
I20260709 13:10:23.730193 30113 tablet_copy_service.cc:434] P 5ec73dc157ed476ca903a7d596271719: ending tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-88d3759f7fe14a4d8e7ba8670ce5cfeb on tablet 88d3759f7fe14a4d8e7ba8670ce5cfeb with peer 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:23.730566 31491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 57ce415a86d343cb8bdff28acc41c6a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.744176 31490 tablet_copy_client.cc:806] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:23.744822 31490 tablet_copy_client.cc:670] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:23.746368 31491 tablet_copy_client.cc:806] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:23.746939 31491 tablet_copy_client.cc:670] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:23.749305 31490 tablet_copy_client.cc:538] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:23.750382 31491 tablet_copy_client.cc:538] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:23.758188 31491 tablet_bootstrap.cc:492] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap starting.
I20260709 13:10:23.758546 31490 tablet_bootstrap.cc:492] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap starting.
I20260709 13:10:23.765789 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:23.773814 31477 ts_tablet_manager.cc:933] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a: Initiating tablet copy from peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451)
I20260709 13:10:23.791020 31477 tablet_copy_client.cc:323] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Beginning tablet copy session from remote peer at address 127.28.54.65:34451
I20260709 13:10:23.792955 30038 tablet_copy_service.cc:140] P b2cea0098c1040f69755ea4d3dab7fc4: Received BeginTabletCopySession request for tablet 3a0f0dc1823e4c99aa3cc53ce8a58efa from peer 6f3eb161e2194f6891f12e2cfcaaf73a ({username='slave'} at 127.0.0.1:52098)
I20260709 13:10:23.793550 30038 tablet_copy_service.cc:161] P b2cea0098c1040f69755ea4d3dab7fc4: Beginning new tablet copy session on tablet 3a0f0dc1823e4c99aa3cc53ce8a58efa from peer 6f3eb161e2194f6891f12e2cfcaaf73a at {username='slave'} at 127.0.0.1:52098: session id = 6f3eb161e2194f6891f12e2cfcaaf73a-3a0f0dc1823e4c99aa3cc53ce8a58efa
I20260709 13:10:23.801898 30038 tablet_copy_source_session.cc:215] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:23.805359 31477 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3a0f0dc1823e4c99aa3cc53ce8a58efa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:23.831807 31477 tablet_copy_client.cc:806] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:23.832414 31477 tablet_copy_client.cc:670] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:23.841012 31477 tablet_copy_client.cc:538] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:23.851806 31490 tablet_bootstrap.cc:492] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:23.857052 31490 tablet_bootstrap.cc:492] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap complete.
I20260709 13:10:23.857772 31490 ts_tablet_manager.cc:1403] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent bootstrapping tablet: real 0.100s	user 0.031s	sys 0.029s
I20260709 13:10:23.861735 31490 raft_consensus.cc:359] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:23.858507 31477 tablet_bootstrap.cc:492] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap starting.
I20260709 13:10:23.864396 31490 raft_consensus.cc:740] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Initialized, Role: LEARNER
I20260709 13:10:23.865128 31490 consensus_queue.cc:260] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:23.867882 31490 ts_tablet_manager.cc:1434] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 13:10:23.871238 30113 tablet_copy_service.cc:342] P 5ec73dc157ed476ca903a7d596271719: Request end of tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-b66f98d7fcfe4102a01ace9ed64355ed received from {username='slave'} at 127.0.0.1:48558
I20260709 13:10:23.871673 30113 tablet_copy_service.cc:434] P 5ec73dc157ed476ca903a7d596271719: ending tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-b66f98d7fcfe4102a01ace9ed64355ed on tablet b66f98d7fcfe4102a01ace9ed64355ed with peer 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:23.883519 31491 tablet_bootstrap.cc:492] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:23.884477 31491 tablet_bootstrap.cc:492] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap complete.
I20260709 13:10:23.885210 31491 ts_tablet_manager.cc:1403] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent bootstrapping tablet: real 0.127s	user 0.044s	sys 0.062s
I20260709 13:10:23.885797 30736 raft_consensus.cc:1217] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:23.887938 31491 raft_consensus.cc:359] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:23.888685 31491 raft_consensus.cc:740] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Initialized, Role: LEARNER
I20260709 13:10:23.889307 31491 consensus_queue.cc:260] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:23.891987 31491 ts_tablet_manager.cc:1434] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:10:23.894191 30113 tablet_copy_service.cc:342] P 5ec73dc157ed476ca903a7d596271719: Request end of tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-57ce415a86d343cb8bdff28acc41c6a6 received from {username='slave'} at 127.0.0.1:48558
I20260709 13:10:23.894586 30113 tablet_copy_service.cc:434] P 5ec73dc157ed476ca903a7d596271719: ending tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-57ce415a86d343cb8bdff28acc41c6a6 on tablet 57ce415a86d343cb8bdff28acc41c6a6 with peer 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:23.921066 31477 tablet_bootstrap.cc:492] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:23.922683 31477 tablet_bootstrap.cc:492] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap complete.
I20260709 13:10:23.923352 31477 ts_tablet_manager.cc:1403] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent bootstrapping tablet: real 0.065s	user 0.019s	sys 0.006s
I20260709 13:10:23.926148 31477 raft_consensus.cc:359] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:23.926973 31477 raft_consensus.cc:740] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Initialized, Role: LEARNER
I20260709 13:10:23.927635 31477 consensus_queue.cc:260] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:23.930008 31477 ts_tablet_manager.cc:1434] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:10:23.933583 30038 tablet_copy_service.cc:342] P b2cea0098c1040f69755ea4d3dab7fc4: Request end of tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-3a0f0dc1823e4c99aa3cc53ce8a58efa received from {username='slave'} at 127.0.0.1:52098
I20260709 13:10:23.933982 30038 tablet_copy_service.cc:434] P b2cea0098c1040f69755ea4d3dab7fc4: ending tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-3a0f0dc1823e4c99aa3cc53ce8a58efa on tablet 3a0f0dc1823e4c99aa3cc53ce8a58efa with peer 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:23.947091 30099 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3"
dest_uuid: "5ec73dc157ed476ca903a7d596271719"
mode: GRACEFUL
new_leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
 from {username='slave'} at 127.0.0.1:37340
I20260709 13:10:23.947697 30099 raft_consensus.cc:606] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 2 LEADER]: Received request to transfer leadership to TS b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:23.951041 30172 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f"
dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
mode: GRACEFUL
new_leader_uuid: "5ec73dc157ed476ca903a7d596271719"
 from {username='slave'} at 127.0.0.1:38454
I20260709 13:10:23.951568 30172 raft_consensus.cc:606] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Received request to transfer leadership to TS 5ec73dc157ed476ca903a7d596271719
I20260709 13:10:23.954450 30099 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb"
dest_uuid: "5ec73dc157ed476ca903a7d596271719"
mode: GRACEFUL
new_leader_uuid: "c99569d27a6f4c648eae7119fe3db124"
 from {username='slave'} at 127.0.0.1:37340
I20260709 13:10:23.954981 30099 raft_consensus.cc:606] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 2 LEADER]: Received request to transfer leadership to TS c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:23.955875 28889 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:10:23.957378 28889 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:24.098500 30736 raft_consensus.cc:1217] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:10:24.123842 30736 raft_consensus.cc:1217] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 13:10:24.135430 31483 raft_consensus.cc:993] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719: : Instructing follower b2cea0098c1040f69755ea4d3dab7fc4 to start an election
I20260709 13:10:24.135879 31335 raft_consensus.cc:1081] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 2 LEADER]: Signalling peer b2cea0098c1040f69755ea4d3dab7fc4 to start an election
I20260709 13:10:24.137428 30026 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
 from {username='slave'} at 127.0.0.1:54198
I20260709 13:10:24.137859 30026 raft_consensus.cc:493] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:24.138113 30026 raft_consensus.cc:3060] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:24.142612 30026 raft_consensus.cc:515] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:24.144622 30026 leader_election.cc:290] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:24.146009 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:24.146513 30736 raft_consensus.cc:3060] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:24.146009 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:24.148017 30102 raft_consensus.cc:3055] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:24.148295 30102 raft_consensus.cc:740] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:24.148963 30102 consensus_queue.cc:260] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:24.149802 30102 raft_consensus.cc:3060] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:24.155092 30736 raft_consensus.cc:2468] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 3.
I20260709 13:10:24.155115 30102 raft_consensus.cc:2468] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 3.
I20260709 13:10:24.156311 29993 leader_election.cc:304] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:24.157047 31482 raft_consensus.cc:2804] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:24.157502 31482 raft_consensus.cc:697] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:24.158907 31482 consensus_queue.cc:237] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:24.168167 29924 catalog_manager.cc:5697] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 2 to 3, leader changed from 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 3 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:24.242434 31484 raft_consensus.cc:993] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124: : Instructing follower 5ec73dc157ed476ca903a7d596271719 to start an election
I20260709 13:10:24.242856 31474 raft_consensus.cc:1081] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Signalling peer 5ec73dc157ed476ca903a7d596271719 to start an election
I20260709 13:10:24.244086 30102 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f"
dest_uuid: "5ec73dc157ed476ca903a7d596271719"
 from {username='slave'} at 127.0.0.1:33992
I20260709 13:10:24.244629 30102 raft_consensus.cc:493] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:24.244943 30102 raft_consensus.cc:3060] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.251349 30102 raft_consensus.cc:515] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:24.253543 30102 leader_election.cc:290] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:24.253597 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:24.254341 30022 raft_consensus.cc:3060] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.254424 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:24.254963 30176 raft_consensus.cc:3055] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:24.255234 30176 raft_consensus.cc:740] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:24.255999 30176 consensus_queue.cc:260] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:24.257073 30176 raft_consensus.cc:3060] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:24.263091 30176 raft_consensus.cc:2468] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
I20260709 13:10:24.262545 30022 raft_consensus.cc:2468] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
I20260709 13:10:24.264235 30068 leader_election.cc:304] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:24.265053 31335 raft_consensus.cc:2804] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:24.265447 31335 raft_consensus.cc:697] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 2 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:24.266084 31335 consensus_queue.cc:237] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:24.277973 29924 catalog_manager.cc:5697] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 1 to 2, leader changed from c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 2 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:24.285898 30736 raft_consensus.cc:1217] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 13:10:24.451102 31483 raft_consensus.cc:1064] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719: attempting to promote NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a to VOTER
I20260709 13:10:24.453802 31483 consensus_queue.cc:237] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:24.460706 30172 raft_consensus.cc:1275] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:24.462307 30026 raft_consensus.cc:1275] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:24.462608 31483 consensus_queue.cc:1048] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:24.463357 30734 raft_consensus.cc:1275] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:24.464815 31335 consensus_queue.cc:1048] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:24.466982 31446 consensus_queue.cc:1048] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:24.483157 31483 raft_consensus.cc:993] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719: : Instructing follower c99569d27a6f4c648eae7119fe3db124 to start an election
I20260709 13:10:24.491223 31335 raft_consensus.cc:1081] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 2 LEADER]: Signalling peer c99569d27a6f4c648eae7119fe3db124 to start an election
I20260709 13:10:24.493928 30176 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb"
dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
 from {username='slave'} at 127.0.0.1:43840
I20260709 13:10:24.494474 30176 raft_consensus.cc:493] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:24.553893 30176 raft_consensus.cc:3060] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:24.556072 31505 raft_consensus.cc:2955] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
W20260709 13:10:24.562675 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 67685.8us
I20260709 13:10:24.567224 30176 raft_consensus.cc:515] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:24.575846 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:24.576459 30736 raft_consensus.cc:3060] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:24.577026 30734 raft_consensus.cc:2955] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:24.584082 30736 raft_consensus.cc:2468] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 3.
I20260709 13:10:24.584985 30735 raft_consensus.cc:1240] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:24.588634 30142 leader_election.cc:304] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:24.589740 30176 leader_election.cc:290] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:24.593712 31510 raft_consensus.cc:2804] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:24.594468 31510 raft_consensus.cc:697] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 3 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:24.603361 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: true dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:24.603956 30102 raft_consensus.cc:3055] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:24.604223 30102 raft_consensus.cc:740] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:24.604888 30102 consensus_queue.cc:260] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:24.605736 30102 raft_consensus.cc:3060] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:24.606429 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 52801.6us
I20260709 13:10:24.602833 29922 catalog_manager.cc:5697] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:24.595417 31510 consensus_queue.cc:237] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:24.609745 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 50120.1us
I20260709 13:10:24.621964 30026 raft_consensus.cc:2955] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:24.627385 30176 raft_consensus.cc:2955] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:24.631772 31483 raft_consensus.cc:1064] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719: attempting to promote NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a to VOTER
I20260709 13:10:24.634243 31483 consensus_queue.cc:237] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:24.634795 29924 catalog_manager.cc:5697] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 2 to 3, leader changed from 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 3 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:24.640350 30102 raft_consensus.cc:2468] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 3.
I20260709 13:10:24.662462 30734 raft_consensus.cc:1275] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:24.665625 31467 consensus_queue.cc:1048] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:24.690011 30102 raft_consensus.cc:1275] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:24.692430 30176 raft_consensus.cc:1275] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:10:24.695358 31446 consensus_queue.cc:1048] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:24.695037 31467 consensus_queue.cc:1048] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:24.704361 31335 raft_consensus.cc:1064] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719: attempting to promote NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a to VOTER
I20260709 13:10:24.706585 31335 consensus_queue.cc:237] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:24.710237 30102 consensus_queue.cc:237] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:24.721649 30172 raft_consensus.cc:1275] T 57ce415a86d343cb8bdff28acc41c6a6 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:24.722633 30022 raft_consensus.cc:1275] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:24.724133 31505 consensus_queue.cc:1048] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:24.725219 30022 raft_consensus.cc:1275] T b66f98d7fcfe4102a01ace9ed64355ed P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:10:24.726960 31483 consensus_queue.cc:1048] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:24.727679 31505 consensus_queue.cc:1048] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:24.729167 30737 raft_consensus.cc:1275] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEARNER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:10:24.730803 30737 raft_consensus.cc:1275] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:24.731483 30023 raft_consensus.cc:1275] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:24.732411 30735 raft_consensus.cc:1275] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 LEARNER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 13:10:24.732833 31335 consensus_queue.cc:1048] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:24.734372 31446 consensus_queue.cc:1048] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:24.736388 31446 consensus_queue.cc:1048] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:24.746995 31482 raft_consensus.cc:1064] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4: attempting to promote NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a to VOTER
I20260709 13:10:24.759861 31446 consensus_queue.cc:1048] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 13:10:24.866467 31528 log.cc:927] Time spent T 57ce415a86d343cb8bdff28acc41c6a6 P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:10:24.749591 31482 consensus_queue.cc:237] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:24.929013 30172 raft_consensus.cc:1275] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:10:24.930651 31467 consensus_queue.cc:1048] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:24.933517 30734 raft_consensus.cc:1275] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEARNER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:10:24.937054 31467 consensus_queue.cc:1048] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:24.956771 31526 raft_consensus.cc:2955] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:24.959955 30102 raft_consensus.cc:1275] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 13:10:24.963529 31482 consensus_queue.cc:1048] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:24.976889 31483 raft_consensus.cc:2955] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:25.001140 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:25.031869 29913 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 88d3759f7fe14a4d8e7ba8670ce5cfeb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:25.089833 30102 raft_consensus.cc:2955] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:25.090588 31537 raft_consensus.cc:2955] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:25.160192 30022 raft_consensus.cc:1275] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:25.165115 30022 raft_consensus.cc:2955] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:25.167742 30028 raft_consensus.cc:2955] T b66f98d7fcfe4102a01ace9ed64355ed P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:25.167737 30025 raft_consensus.cc:2955] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:25.180833 31538 consensus_queue.cc:1048] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:25.195001 30735 raft_consensus.cc:2955] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:25.209069 30736 raft_consensus.cc:2955] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:25.215914 30172 raft_consensus.cc:1275] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:25.233433 31539 consensus_queue.cc:1048] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:25.240710 30172 raft_consensus.cc:2955] T 57ce415a86d343cb8bdff28acc41c6a6 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:25.263129 30177 raft_consensus.cc:2955] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:25.263836 29922 catalog_manager.cc:5697] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: config changed from index 3 to 4, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:25.265318 29922 catalog_manager.cc:5697] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:25.280081 30734 raft_consensus.cc:1275] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:25.279399 31541 raft_consensus.cc:2955] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:25.290762 31544 consensus_queue.cc:1048] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:25.304689 30737 raft_consensus.cc:2955] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:25.341948 30102 raft_consensus.cc:1275] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:25.341225 30731 raft_consensus.cc:2955] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:25.345651 31510 consensus_queue.cc:1048] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:10:25.365682 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 89927us
I20260709 13:10:25.368602 30176 raft_consensus.cc:2955] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:25.390828 29926 catalog_manager.cc:5697] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 reported cstate change: config changed from index 3 to 4, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:25.392549 29926 catalog_manager.cc:5697] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 5ec73dc157ed476ca903a7d596271719 reported cstate change: config changed from index 3 to 4, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:25.443429 30164 tablet_service.cc:1558] Processing DeleteTablet for tablet 88d3759f7fe14a4d8e7ba8670ce5cfeb with delete_type TABLET_DATA_TOMBSTONED (TS c99569d27a6f4c648eae7119fe3db124 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43828
I20260709 13:10:25.447364 31559 tablet_replica.cc:333] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:10:25.448474 31559 raft_consensus.cc:2243] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.449259 31559 raft_consensus.cc:2272] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.451776 30102 consensus_queue.cc:237] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:25.460470 31559 ts_tablet_manager.cc:1916] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P c99569d27a6f4c648eae7119fe3db124: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:25.473796 30022 consensus_queue.cc:237] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:25.480540 30735 raft_consensus.cc:1275] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:25.480880 30172 raft_consensus.cc:1275] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:25.482090 31370 consensus_queue.cc:1048] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:25.483155 31513 consensus_queue.cc:1048] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:25.488408 30101 consensus_queue.cc:237] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:25.492413 31467 raft_consensus.cc:2955] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:25.497797 30735 raft_consensus.cc:1275] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:25.498857 30736 raft_consensus.cc:1275] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:25.495294 30172 raft_consensus.cc:2955] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:25.507257 30022 raft_consensus.cc:1275] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 13:10:25.509068 31526 consensus_queue.cc:1048] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:25.511690 31538 consensus_queue.cc:1048] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:25.513623 31541 consensus_queue.cc:1048] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:25.518260 31483 raft_consensus.cc:2955] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:25.527971 29910 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3a0f0dc1823e4c99aa3cc53ce8a58efa with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:25.530011 30028 raft_consensus.cc:2955] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:25.533669 29913 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 57ce415a86d343cb8bdff28acc41c6a6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:25.531390 31559 ts_tablet_manager.cc:1929] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P c99569d27a6f4c648eae7119fe3db124: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:25.535401 31559 log.cc:1199] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P c99569d27a6f4c648eae7119fe3db124: Deleting WAL directory at /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-2-root/wals/88d3759f7fe14a4d8e7ba8670ce5cfeb
I20260709 13:10:25.534746 30735 raft_consensus.cc:2955] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:25.539199 29912 catalog_manager.cc:5028] TS c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): tablet 88d3759f7fe14a4d8e7ba8670ce5cfeb (table test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]) successfully deleted
I20260709 13:10:25.540045 30176 raft_consensus.cc:1275] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:25.542933 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:25.544574 31526 consensus_queue.cc:1048] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:25.551352 30736 raft_consensus.cc:2955] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:25.558169 31541 raft_consensus.cc:2955] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:25.568867 29913 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b66f98d7fcfe4102a01ace9ed64355ed with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:10:25.569747 30735 raft_consensus.cc:2955] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:25.571921 29924 catalog_manager.cc:5697] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: config changed from index 4 to 5, VOTER 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) evicted. New cstate: current_term: 2 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:25.571513 30172 raft_consensus.cc:2955] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:25.586207 30087 tablet_service.cc:1558] Processing DeleteTablet for tablet 3a0f0dc1823e4c99aa3cc53ce8a58efa with delete_type TABLET_DATA_TOMBSTONED (TS 5ec73dc157ed476ca903a7d596271719 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:33984
I20260709 13:10:25.594480 31560 tablet_replica.cc:333] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:10:25.597774 31560 raft_consensus.cc:2243] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.598479 31560 raft_consensus.cc:2272] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.615299 29921 catalog_manager.cc:5697] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: config changed from index 4 to 5, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New cstate: current_term: 2 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:25.616992 31560 ts_tablet_manager.cc:1916] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 5ec73dc157ed476ca903a7d596271719: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:25.628453 30009 tablet_service.cc:1558] Processing DeleteTablet for tablet b66f98d7fcfe4102a01ace9ed64355ed with delete_type TABLET_DATA_TOMBSTONED (TS b2cea0098c1040f69755ea4d3dab7fc4 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:54192
I20260709 13:10:25.630384 29924 catalog_manager.cc:5697] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 reported cstate change: config changed from index 3 to 4, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:25.644301 31561 tablet_replica.cc:333] T b66f98d7fcfe4102a01ace9ed64355ed P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:10:25.645339 31561 raft_consensus.cc:2243] T b66f98d7fcfe4102a01ace9ed64355ed P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.646021 31561 raft_consensus.cc:2272] T b66f98d7fcfe4102a01ace9ed64355ed P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.650861 31560 ts_tablet_manager.cc:1929] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 5ec73dc157ed476ca903a7d596271719: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:10:25.651331 31560 log.cc:1199] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 5ec73dc157ed476ca903a7d596271719: Deleting WAL directory at /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-1-root/wals/3a0f0dc1823e4c99aa3cc53ce8a58efa
I20260709 13:10:25.653421 29913 catalog_manager.cc:5028] TS 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): tablet 3a0f0dc1823e4c99aa3cc53ce8a58efa (table test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]) successfully deleted
I20260709 13:10:25.655876 31561 ts_tablet_manager.cc:1916] T b66f98d7fcfe4102a01ace9ed64355ed P b2cea0098c1040f69755ea4d3dab7fc4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:25.658599 30164 tablet_service.cc:1558] Processing DeleteTablet for tablet 57ce415a86d343cb8bdff28acc41c6a6 with delete_type TABLET_DATA_TOMBSTONED (TS c99569d27a6f4c648eae7119fe3db124 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43828
I20260709 13:10:25.659454 31559 tablet_replica.cc:333] T 57ce415a86d343cb8bdff28acc41c6a6 P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:10:25.660243 31559 raft_consensus.cc:2243] T 57ce415a86d343cb8bdff28acc41c6a6 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:10:25.660810 31559 raft_consensus.cc:2272] T 57ce415a86d343cb8bdff28acc41c6a6 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:10:25.664366 31559 ts_tablet_manager.cc:1916] T 57ce415a86d343cb8bdff28acc41c6a6 P c99569d27a6f4c648eae7119fe3db124: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:10:25.671846 31561 ts_tablet_manager.cc:1929] T b66f98d7fcfe4102a01ace9ed64355ed P b2cea0098c1040f69755ea4d3dab7fc4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260709 13:10:25.672331 31561 log.cc:1199] T b66f98d7fcfe4102a01ace9ed64355ed P b2cea0098c1040f69755ea4d3dab7fc4: Deleting WAL directory at /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-0-root/wals/b66f98d7fcfe4102a01ace9ed64355ed
I20260709 13:10:25.673910 29910 catalog_manager.cc:5028] TS b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): tablet b66f98d7fcfe4102a01ace9ed64355ed (table test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]) successfully deleted
I20260709 13:10:25.677999 30172 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712"
dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
mode: GRACEFUL
new_leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
 from {username='slave'} at 127.0.0.1:38454
I20260709 13:10:25.678429 30172 raft_consensus.cc:606] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Received request to transfer leadership to TS b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:25.682840 31559 ts_tablet_manager.cc:1929] T 57ce415a86d343cb8bdff28acc41c6a6 P c99569d27a6f4c648eae7119fe3db124: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 13:10:25.683301 31559 log.cc:1199] T 57ce415a86d343cb8bdff28acc41c6a6 P c99569d27a6f4c648eae7119fe3db124: Deleting WAL directory at /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-2-root/wals/57ce415a86d343cb8bdff28acc41c6a6
I20260709 13:10:25.683454 30101 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf"
dest_uuid: "5ec73dc157ed476ca903a7d596271719"
mode: GRACEFUL
new_leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
 from {username='slave'} at 127.0.0.1:37340
I20260709 13:10:25.684813 30101 raft_consensus.cc:606] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Received request to transfer leadership to TS 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:25.685385 29912 catalog_manager.cc:5028] TS c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): tablet 57ce415a86d343cb8bdff28acc41c6a6 (table test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]) successfully deleted
I20260709 13:10:25.687252 30028 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
mode: GRACEFUL
new_leader_uuid: "5ec73dc157ed476ca903a7d596271719"
 from {username='slave'} at 127.0.0.1:47450
I20260709 13:10:25.687778 30028 raft_consensus.cc:606] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Received request to transfer leadership to TS 5ec73dc157ed476ca903a7d596271719
I20260709 13:10:25.688927 28889 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:10:25.689973 28889 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:26.040112 31541 raft_consensus.cc:993] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719: : Instructing follower 6f3eb161e2194f6891f12e2cfcaaf73a to start an election
I20260709 13:10:26.040557 31541 raft_consensus.cc:1081] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Signalling peer 6f3eb161e2194f6891f12e2cfcaaf73a to start an election
I20260709 13:10:26.041817 30735 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf"
dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
 from {username='slave'} at 127.0.0.1:56954
I20260709 13:10:26.042276 30735 raft_consensus.cc:493] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:26.042518 30735 raft_consensus.cc:3060] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.047717 30735 raft_consensus.cc:515] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:26.050199 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:26.050272 30735 leader_election.cc:290] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:26.050451 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:26.050762 30101 raft_consensus.cc:3055] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:26.051013 30173 raft_consensus.cc:3060] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.051113 30101 raft_consensus.cc:740] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:26.052520 30101 consensus_queue.cc:260] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:26.053604 30101 raft_consensus.cc:3060] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.057816 30173 raft_consensus.cc:2468] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 2.
I20260709 13:10:26.058912 30702 leader_election.cc:304] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:26.059618 31471 raft_consensus.cc:2804] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:26.059698 30101 raft_consensus.cc:2468] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 2.
I20260709 13:10:26.060037 31471 raft_consensus.cc:697] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:26.060843 31471 consensus_queue.cc:237] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:26.069325 29924 catalog_manager.cc:5697] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: term changed from 1 to 2, leader changed from 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) to 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68). New cstate: current_term: 2 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:10:26.082739 30124 debug-util.cc:398] Leaking SignalData structure 0x7b0800263a20 after lost signal to thread 28892
W20260709 13:10:26.083460 30124 debug-util.cc:398] Leaking SignalData structure 0x7b0800274f80 after lost signal to thread 29960
W20260709 13:10:26.084255 30124 debug-util.cc:398] Leaking SignalData structure 0x7b08000ac0a0 after lost signal to thread 30052
W20260709 13:10:26.085211 30124 debug-util.cc:398] Leaking SignalData structure 0x7b08000d4bc0 after lost signal to thread 30127
W20260709 13:10:26.085932 30124 debug-util.cc:398] Leaking SignalData structure 0x7b08003594a0 after lost signal to thread 30201
W20260709 13:10:26.086660 30124 debug-util.cc:398] Leaking SignalData structure 0x7b0800037be0 after lost signal to thread 30761
I20260709 13:10:26.154693 31467 raft_consensus.cc:993] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4: : Instructing follower 5ec73dc157ed476ca903a7d596271719 to start an election
I20260709 13:10:26.155195 31467 raft_consensus.cc:1081] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Signalling peer 5ec73dc157ed476ca903a7d596271719 to start an election
I20260709 13:10:26.156782 30101 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd"
dest_uuid: "5ec73dc157ed476ca903a7d596271719"
 from {username='slave'} at 127.0.0.1:33990
I20260709 13:10:26.157279 30101 raft_consensus.cc:493] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:26.157599 30101 raft_consensus.cc:3060] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.167979 30101 raft_consensus.cc:515] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:26.169340 30101 leader_election.cc:290] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:26.170120 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:26.170802 30028 raft_consensus.cc:3055] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:26.171103 30028 raft_consensus.cc:740] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:26.171828 30028 consensus_queue.cc:260] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:26.170243 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:26.172758 30736 raft_consensus.cc:3060] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.172979 30028 raft_consensus.cc:3060] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.178653 30736 raft_consensus.cc:2468] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
I20260709 13:10:26.179601 30068 leader_election.cc:304] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:10:26.180202 31541 raft_consensus.cc:2804] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:26.180174 30028 raft_consensus.cc:2468] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
I20260709 13:10:26.180764 31541 raft_consensus.cc:697] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 2 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:26.182639 31541 consensus_queue.cc:237] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:26.195874 31546 raft_consensus.cc:993] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124: : Instructing follower b2cea0098c1040f69755ea4d3dab7fc4 to start an election
I20260709 13:10:26.196327 31546 raft_consensus.cc:1081] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Signalling peer b2cea0098c1040f69755ea4d3dab7fc4 to start an election
I20260709 13:10:26.197786 30022 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
 from {username='slave'} at 127.0.0.1:54206
I20260709 13:10:26.198321 30022 raft_consensus.cc:493] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:26.198643 30022 raft_consensus.cc:3060] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.201522 29924 catalog_manager.cc:5697] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 1 to 2, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 2 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:26.204645 30022 raft_consensus.cc:515] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:26.206812 30022 leader_election.cc:290] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:26.207007 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:26.207630 30173 raft_consensus.cc:3055] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:26.207918 30173 raft_consensus.cc:740] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:26.208276 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:26.208794 30101 raft_consensus.cc:3060] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.208565 30173 consensus_queue.cc:260] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:26.210299 30173 raft_consensus.cc:3060] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:26.217242 30173 raft_consensus.cc:2468] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 2.
I20260709 13:10:26.217363 30101 raft_consensus.cc:2468] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 2.
I20260709 13:10:26.219566 29993 leader_election.cc:304] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:26.220328 31513 raft_consensus.cc:2804] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:26.221473 31513 raft_consensus.cc:697] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:26.222366 31513 consensus_queue.cc:237] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:26.234308 29924 catalog_manager.cc:5697] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 1 to 2, leader changed from c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 2 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:26.698701 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:27.325963 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:27.414283 31568 raft_consensus.cc:493] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:27.414955 31568 raft_consensus.cc:515] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:27.416994 31568 leader_election.cc:290] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:27.461906 31566 raft_consensus.cc:493] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:27.462517 31566 raft_consensus.cc:515] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:27.464710 31566 leader_election.cc:290] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:27.468106 31566 raft_consensus.cc:493] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:27.468653 31566 raft_consensus.cc:515] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:27.470798 31566 leader_election.cc:290] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:27.490952 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:27.504483 31471 raft_consensus.cc:493] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:27.505231 31471 raft_consensus.cc:515] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:27.507433 31471 leader_election.cc:290] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:27.509140 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:27.509866 30028 raft_consensus.cc:2468] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 1.
I20260709 13:10:27.511094 30700 leader_election.cc:304] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:27.511948 31471 raft_consensus.cc:2804] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:27.512382 31471 raft_consensus.cc:493] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:27.512791 31471 raft_consensus.cc:3060] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:27.522876 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:27.532706 31471 raft_consensus.cc:515] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:27.535070 31513 raft_consensus.cc:493] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:27.535501 31568 raft_consensus.cc:493] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:27.535723 31513 raft_consensus.cc:515] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:27.535986 31568 raft_consensus.cc:515] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:27.538368 31568 leader_election.cc:290] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:27.537736 31513 leader_election.cc:290] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:27.539732 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:27.540148 30734 raft_consensus.cc:2393] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 2: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:10:27.541739 31471 leader_election.cc:290] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:27.543051 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:27.543546 30028 raft_consensus.cc:3060] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:27.548734 31513 raft_consensus.cc:493] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:27.549289 31513 raft_consensus.cc:515] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:27.550451 30028 raft_consensus.cc:2468] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 2.
I20260709 13:10:27.551471 31566 raft_consensus.cc:493] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:27.551954 31566 raft_consensus.cc:515] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:27.552472 31568 raft_consensus.cc:493] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:27.552963 31568 raft_consensus.cc:515] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:27.551846 31513 leader_election.cc:290] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:27.553985 31566 leader_election.cc:290] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:27.554827 30700 leader_election.cc:304] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:27.555269 31568 leader_election.cc:290] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:27.556324 31543 raft_consensus.cc:2804] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:27.556843 31543 raft_consensus.cc:697] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:27.557643 31543 consensus_queue.cc:237] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:27.608218 31471 raft_consensus.cc:493] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:27.608855 31471 raft_consensus.cc:515] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:27.611083 31471 leader_election.cc:290] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:27.611599 31471 raft_consensus.cc:493] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:27.612033 31471 raft_consensus.cc:515] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:27.686709 31513 raft_consensus.cc:493] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:27.687906 31568 raft_consensus.cc:493] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:27.687477 31513 raft_consensus.cc:515] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:27.688525 31568 raft_consensus.cc:515] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:27.691071 31568 leader_election.cc:290] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:27.696887 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:27.699810 31568 raft_consensus.cc:493] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:27.722801 31566 raft_consensus.cc:493] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:27.814378 31543 raft_consensus.cc:493] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:27.887064 31543 raft_consensus.cc:515] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:27.890005 31543 leader_election.cc:290] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:27.881237 31568 raft_consensus.cc:515] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:27.881717 31471 leader_election.cc:290] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:27.900593 31573 raft_consensus.cc:493] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:27.901484 31573 raft_consensus.cc:515] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:27.904498 31573 leader_election.cc:290] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:27.905114 31573 raft_consensus.cc:493] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:27.882009 31566 raft_consensus.cc:515] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:27.910094 31566 leader_election.cc:290] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:27.910787 31566 raft_consensus.cc:493] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:27.911391 31566 raft_consensus.cc:515] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:27.938040 31513 leader_election.cc:290] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:27.905598 31573 raft_consensus.cc:515] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:27.938895 31513 raft_consensus.cc:493] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:27.942504 31513 raft_consensus.cc:515] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:27.895545 31543 raft_consensus.cc:493] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:27.953833 31471 raft_consensus.cc:493] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:27.942523 31573 leader_election.cc:290] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:27.943137 31566 leader_election.cc:290] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:27.972210 31471 raft_consensus.cc:515] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:27.980911 31513 leader_election.cc:290] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:27.978551 31543 raft_consensus.cc:515] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:27.982509 31576 raft_consensus.cc:493] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:27.989542 31566 raft_consensus.cc:493] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:27.986493 31575 raft_consensus.cc:493] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:28.014896 31566 raft_consensus.cc:515] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:28.015059 31575 raft_consensus.cc:515] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:28.016923 31566 leader_election.cc:290] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:28.017248 31575 leader_election.cc:290] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:28.017392 31566 raft_consensus.cc:493] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:28.014518 31570 raft_consensus.cc:493] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:28.069646 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:28.073975 30028 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24644eca754d40189c8264977160368a"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
mode: GRACEFUL
new_leader_uuid: "5ec73dc157ed476ca903a7d596271719"
 from {username='slave'} at 127.0.0.1:47450
I20260709 13:10:28.074616 30028 raft_consensus.cc:606] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 LEADER]: Received request to transfer leadership to TS 5ec73dc157ed476ca903a7d596271719
I20260709 13:10:28.080272 30736 raft_consensus.cc:2468] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 1.
I20260709 13:10:27.991118 31579 raft_consensus.cc:493] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:28.053481 30025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 1294) took 1131 ms. Trace:
I20260709 13:10:28.052872 31581 raft_consensus.cc:493] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:28.123562 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:28.131253 30028 raft_consensus.cc:2468] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 2.
I20260709 13:10:28.029016 31576 raft_consensus.cc:515] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:28.115617 31575 raft_consensus.cc:493] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:28.115545 31574 raft_consensus.cc:493] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:28.109863 31566 raft_consensus.cc:515] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:28.138497 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:28.138701 30700 leader_election.cc:304] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:28.121470 31587 raft_consensus.cc:493] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:28.111619 31570 raft_consensus.cc:515] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:28.135149 31580 raft_consensus.cc:493] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:28.117843 30025 rpcz_store.cc:276] 0709 13:10:26.921896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:28.024579 (+1102683us) service_pool.cc:224] Handling call
0709 13:10:28.053004 (+ 28425us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:28.053174 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:28.053197 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:28.053237 (+    40us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:28.053264 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:28.053316 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:28.053430 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:28.157015 31577 raft_consensus.cc:493] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:28.155663 31583 raft_consensus.cc:493] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:28.133324 31581 raft_consensus.cc:515] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:10:28.210709 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 60831.1us
I20260709 13:10:28.200316 31471 leader_election.cc:290] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:28.212368 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:28.213961 30025 raft_consensus.cc:2468] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 1.
I20260709 13:10:28.196301 31568 leader_election.cc:290] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:28.202772 31578 raft_consensus.cc:493] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:28.150966 31575 raft_consensus.cc:515] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:28.120530 31579 raft_consensus.cc:515] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:28.206321 31590 raft_consensus.cc:493] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:28.157712 31587 raft_consensus.cc:515] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:28.289055 30028 raft_consensus.cc:2468] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 1.
I20260709 13:10:28.218438 31584 raft_consensus.cc:493] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:28.255903 31601 raft_consensus.cc:2804] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:28.250396 31586 raft_consensus.cc:493] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.254752 31569 raft_consensus.cc:493] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:28.210987 31577 raft_consensus.cc:515] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:28.293685 31543 leader_election.cc:290] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:28.155833 31574 raft_consensus.cc:515] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:28.315129 31598 raft_consensus.cc:493] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:28.202697 31580 raft_consensus.cc:515] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:28.337883 31570 leader_election.cc:290] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:28.338642 31566 leader_election.cc:290] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:28.300980 31601 raft_consensus.cc:493] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:28.212827 31583 raft_consensus.cc:515] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:28.255147 31578 raft_consensus.cc:515] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:28.250391 31590 raft_consensus.cc:515] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:28.343185 31601 raft_consensus.cc:3060] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:28.300810 31584 raft_consensus.cc:515] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:28.344491 31576 leader_election.cc:290] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:28.356290 31594 raft_consensus.cc:493] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:28.356715 31585 raft_consensus.cc:493] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:28.357142 31595 raft_consensus.cc:493] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:28.357144 31577 leader_election.cc:290] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:28.370965 31606 raft_consensus.cc:493] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:28.510597 29993 leader_election.cc:304] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:28.308856 31586 raft_consensus.cc:515] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:28.336059 31569 raft_consensus.cc:515] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:28.371592 31606 raft_consensus.cc:515] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:28.530030 31569 leader_election.cc:290] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:28.346066 31598 raft_consensus.cc:515] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:28.586701 31598 leader_election.cc:290] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:28.514181 31570 raft_consensus.cc:493] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:28.658083 31621 raft_consensus.cc:493] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:28.509635 31576 raft_consensus.cc:493] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:28.522884 31602 raft_consensus.cc:493] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:28.523192 31582 raft_consensus.cc:493] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:28.526217 31575 leader_election.cc:290] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:28.667999 31612 raft_consensus.cc:493] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:28.671473 31588 raft_consensus.cc:493] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:28.672412 31586 leader_election.cc:290] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:28.672737 31574 leader_election.cc:290] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:28.515362 31581 leader_election.cc:290] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:28.522519 31608 raft_consensus.cc:493] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:28.596365 31570 raft_consensus.cc:515] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:28.661062 31569 raft_consensus.cc:493] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
W20260709 13:10:28.702796 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 192265us
I20260709 13:10:28.704066 31613 raft_consensus.cc:493] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:28.704574 31620 raft_consensus.cc:493] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:28.643033 31606 leader_election.cc:290] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:28.730233 31610 raft_consensus.cc:493] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:28.510142 31594 raft_consensus.cc:515] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:28.731474 31611 raft_consensus.cc:493] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.752533 31603 raft_consensus.cc:493] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:28.753083 31609 raft_consensus.cc:493] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:28.728288 31566 raft_consensus.cc:2804] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:28.675901 31579 leader_election.cc:290] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:28.769872 31589 raft_consensus.cc:493] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:28.770409 31589 raft_consensus.cc:515] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:28.772611 31589 leader_election.cc:290] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:28.773293 31624 raft_consensus.cc:493] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:28.773828 31624 raft_consensus.cc:515] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:28.776036 31624 leader_election.cc:290] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:28.706707 31576 raft_consensus.cc:515] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:28.754566 31578 leader_election.cc:290] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:28.756819 31577 raft_consensus.cc:493] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.658758 31621 raft_consensus.cc:515] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:28.776604 31609 raft_consensus.cc:515] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:28.790244 31609 leader_election.cc:290] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:28.510911 31585 raft_consensus.cc:515] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:28.792404 31585 leader_election.cc:290] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:28.731436 31601 raft_consensus.cc:515] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:28.796329 31601 leader_election.cc:290] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 3 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:28.797175 31609 raft_consensus.cc:493] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:28.797698 31609 raft_consensus.cc:515] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:28.800099 31589 raft_consensus.cc:493] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:28.800585 31589 raft_consensus.cc:515] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:28.802529 31589 leader_election.cc:290] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:28.802968 31589 raft_consensus.cc:493] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:28.803399 31589 raft_consensus.cc:515] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:28.760447 31566 raft_consensus.cc:493] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:28.732858 31582 raft_consensus.cc:515] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:28.826529 31582 leader_election.cc:290] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:28.729103 31602 raft_consensus.cc:515] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:28.828701 31602 leader_election.cc:290] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:28.514745 31595 raft_consensus.cc:515] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:28.830835 31595 leader_election.cc:290] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:28.768764 31587 leader_election.cc:290] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:28.777160 31583 leader_election.cc:290] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:28.756160 31569 raft_consensus.cc:515] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:28.760004 31610 raft_consensus.cc:515] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:28.836006 31566 raft_consensus.cc:3060] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:28.787995 31580 leader_election.cc:290] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:28.840821 31602 raft_consensus.cc:493] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:28.842078 31595 raft_consensus.cc:493] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:28.823787 31577 raft_consensus.cc:515] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:28.756889 31608 raft_consensus.cc:515] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:28.780691 31603 raft_consensus.cc:515] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:28.779069 31611 raft_consensus.cc:515] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:28.777603 31613 raft_consensus.cc:515] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:28.754081 31588 raft_consensus.cc:515] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:28.845419 31624 raft_consensus.cc:493] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:28.755893 31612 raft_consensus.cc:515] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:28.910260 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:28.907781 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:28.968321 30737 raft_consensus.cc:2468] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 1.
I20260709 13:10:28.769050 31620 raft_consensus.cc:515] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:28.856400 31590 leader_election.cc:290] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:28.970395 30735 raft_consensus.cc:2468] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 1.
I20260709 13:10:28.996518 31603 leader_election.cc:290] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:28.859757 31606 raft_consensus.cc:493] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:28.890123 31628 raft_consensus.cc:493] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:28.907470 31580 raft_consensus.cc:493] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:29.005331 31588 leader_election.cc:290] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:29.012360 31596 raft_consensus.cc:493] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:28.861498 31602 raft_consensus.cc:515] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:29.021385 31597 raft_consensus.cc:493] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:29.021811 31614 raft_consensus.cc:493] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:29.022195 31619 raft_consensus.cc:493] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:28.969689 31624 raft_consensus.cc:515] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:10:29.026027 29993 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.54.67:45001 timed out after 1.558s (SENT) [suppressed 3 similar messages]
I20260709 13:10:29.028427 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:28.877774 31595 raft_consensus.cc:515] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:28.999712 31570 leader_election.cc:290] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:28.997484 31584 leader_election.cc:290] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:29.056304 31621 leader_election.cc:290] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:29.058197 30737 raft_consensus.cc:2468] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 1.
I20260709 13:10:29.025219 31623 raft_consensus.cc:493] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:29.039572 31582 raft_consensus.cc:493] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:29.058571 31622 raft_consensus.cc:493] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:29.023901 31606 raft_consensus.cc:515] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:29.054297 31583 raft_consensus.cc:493] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:29.025527 31628 raft_consensus.cc:515] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:29.058966 31588 raft_consensus.cc:493] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:29.084432 31595 leader_election.cc:290] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:29.026842 31580 raft_consensus.cc:515] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:29.063632 31570 raft_consensus.cc:493] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:29.085027 31622 raft_consensus.cc:515] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:29.100895 31612 leader_election.cc:290] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:29.101418 31632 raft_consensus.cc:493] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:29.105930 31611 leader_election.cc:290] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:29.107476 31627 raft_consensus.cc:493] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:29.112607 30177 raft_consensus.cc:1275] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:29.113018 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:29.113519 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:29.090600 31576 leader_election.cc:290] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:29.090394 31621 raft_consensus.cc:493] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:29.115434 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:29.116688 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:29.097908 31594 leader_election.cc:290] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:29.112623 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
W20260709 13:10:29.124126 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 98127.7us
I20260709 13:10:29.128546 29993 leader_election.cc:304] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:29.129269 31612 raft_consensus.cc:2804] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:29.129652 31612 raft_consensus.cc:493] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:29.130023 31612 raft_consensus.cc:3060] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:29.135131 29993 leader_election.cc:304] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:29.136916 31587 raft_consensus.cc:2804] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:29.137295 31587 raft_consensus.cc:493] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:29.137660 31587 raft_consensus.cc:3060] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:29.054129 31596 raft_consensus.cc:515] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:29.088270 31583 raft_consensus.cc:515] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:29.091391 31582 raft_consensus.cc:515] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:29.150420 29993 leader_election.cc:304] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:29.095000 31623 raft_consensus.cc:515] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:29.153357 31629 raft_consensus.cc:493] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:29.116811 31599 raft_consensus.cc:493] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:29.118242 31569 leader_election.cc:290] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:29.097435 31588 raft_consensus.cc:515] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:29.193962 30102 raft_consensus.cc:1275] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:29.080135 31619 raft_consensus.cc:515] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:29.189795 31578 raft_consensus.cc:2804] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:29.189954 31603 raft_consensus.cc:493] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:29.104056 31570 raft_consensus.cc:515] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:29.189214 31630 raft_consensus.cc:493] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:29.063112 31597 raft_consensus.cc:515] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:29.142278 31627 raft_consensus.cc:515] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:29.203202 31626 raft_consensus.cc:493] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:29.196858 31578 raft_consensus.cc:493] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:29.066505 31614 raft_consensus.cc:515] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:29.190459 31615 raft_consensus.cc:493] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:29.153738 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:29.174049 31577 leader_election.cc:290] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:29.141324 31621 raft_consensus.cc:515] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:29.154000 31629 raft_consensus.cc:515] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:29.123168 31632 raft_consensus.cc:515] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:29.192580 31637 raft_consensus.cc:493] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:29.214923 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:29.208782 31578 raft_consensus.cc:3060] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:29.215551 31602 leader_election.cc:290] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:29.210119 31610 leader_election.cc:290] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:29.224346 30094 raft_consensus.cc:3055] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:29.203910 31625 raft_consensus.cc:493] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:29.215706 31613 leader_election.cc:290] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:29.215055 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:29.221082 31626 raft_consensus.cc:515] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:29.209484 31603 raft_consensus.cc:515] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:29.250023 30700 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.037s	user 0.035s	sys 0.041s
W20260709 13:10:29.250929 30700 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.038s	user 0.035s	sys 0.041s
I20260709 13:10:29.252027 30700 leader_election.cc:304] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:29.252835 30700 leader_election.cc:304] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:29.252914 31601 raft_consensus.cc:2804] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:29.253379 31601 raft_consensus.cc:493] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:29.253800 31601 raft_consensus.cc:3060] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:29.261138 31589 leader_election.cc:290] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:29.265776 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:29.243480 31631 raft_consensus.cc:493] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:29.266438 30730 raft_consensus.cc:2468] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 2.
I20260709 13:10:29.266515 31631 raft_consensus.cc:515] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:29.275818 31471 raft_consensus.cc:493] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
W20260709 13:10:29.253479 30702 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.047s	user 0.034s	sys 0.041s
W20260709 13:10:29.279608 30702 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.073s	user 0.034s	sys 0.041s
I20260709 13:10:29.243655 31625 raft_consensus.cc:515] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:29.296573 30101 raft_consensus.cc:2468] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 3.
I20260709 13:10:29.199535 31599 raft_consensus.cc:515] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:29.324764 30731 raft_consensus.cc:1240] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEADER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:29.241540 30094 raft_consensus.cc:740] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:29.327759 30094 consensus_queue.cc:260] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:29.332270 30094 raft_consensus.cc:3060] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:29.298866 31579 raft_consensus.cc:493] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:29.344583 31609 leader_election.cc:290] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:10:29.348083 30142 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.976s	user 0.000s	sys 0.026s
W20260709 13:10:29.348425 30142 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.979s	user 0.000s	sys 0.026s
I20260709 13:10:29.218395 31615 raft_consensus.cc:515] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:29.355017 31609 raft_consensus.cc:493] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:29.358317 31609 raft_consensus.cc:515] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:29.393790 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:29.211553 31630 raft_consensus.cc:515] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:29.231066 31637 raft_consensus.cc:515] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:29.401110 30096 raft_consensus.cc:2468] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 1.
I20260709 13:10:29.422755 30176 raft_consensus.cc:1275] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:29.357525 31589 raft_consensus.cc:493] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:29.357299 31579 raft_consensus.cc:515] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:29.552663 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 299882us
I20260709 13:10:29.556572 30028 raft_consensus.cc:1275] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:29.550108 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:29.567585 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:29.570443 31608 leader_election.cc:290] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:29.568243 30025 raft_consensus.cc:2468] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 1.
W20260709 13:10:29.573899 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 378541us
I20260709 13:10:29.575901 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:29.576187 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:29.576459 30737 raft_consensus.cc:2468] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 1.
I20260709 13:10:29.576565 30735 raft_consensus.cc:1240] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:29.586170 31620 leader_election.cc:290] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:29.577441 30096 raft_consensus.cc:2468] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 1.
I20260709 13:10:29.588577 30734 raft_consensus.cc:1275] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:29.564384 31471 raft_consensus.cc:515] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:29.550418 31589 raft_consensus.cc:515] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:29.936929 30069 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.819s	user 0.040s	sys 0.043s
I20260709 13:10:29.594215 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
W20260709 13:10:29.997288 30069 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.883s	user 0.067s	sys 0.076s
I20260709 13:10:29.946787 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:29.982574 29993 leader_election.cc:304] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:29.944319 30020 raft_consensus.cc:1275] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:29.945513 30028 raft_consensus.cc:1240] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:29.946684 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:10:29.945878 30067 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.822s	user 0.015s	sys 0.051s
I20260709 13:10:30.008668 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:30.009481 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:29.942643 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:30.011193 31646 raft_consensus.cc:493] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:30.012248 30068 leader_election.cc:304] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
W20260709 13:10:30.024516 30094 consensus_meta.cc:287] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719: Time spent flushing consensus metadata: real 0.692s	user 0.010s	sys 0.005s
I20260709 13:10:29.793306 31619 leader_election.cc:290] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:29.605891 31601 raft_consensus.cc:515] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:30.051156 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:29.607504 31587 raft_consensus.cc:515] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:30.052337 31639 raft_consensus.cc:493] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:30.052567 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:30.053133 31639 raft_consensus.cc:515] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:29.673277 31615 leader_election.cc:290] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:29.611828 31584 raft_consensus.cc:493] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
W20260709 13:10:29.748054 31612 consensus_meta.cc:287] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent flushing consensus metadata: real 0.618s	user 0.018s	sys 0.057s
I20260709 13:10:29.738185 31609 leader_election.cc:290] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:29.792644 31597 leader_election.cc:290] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:30.053709 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:30.061985 31632 leader_election.cc:290] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:30.054402 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:30.053721 31601 leader_election.cc:290] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:30.058802 31584 raft_consensus.cc:515] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:30.066241 30019 raft_consensus.cc:2468] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
I20260709 13:10:30.058379 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.067795 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:30.068104 31582 leader_election.cc:290] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:30.057897 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.069852 30027 raft_consensus.cc:2468] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 1.
I20260709 13:10:30.057302 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.070986 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:30.071141 30172 raft_consensus.cc:2468] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
I20260709 13:10:30.072233 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:30.072470 31637 leader_election.cc:290] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:10:30.047410 30067 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.926s	user 0.021s	sys 0.052s
I20260709 13:10:30.073498 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:30.078863 31646 raft_consensus.cc:515] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:30.079182 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.080678 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:29.567065 31543 raft_consensus.cc:2804] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:30.054661 31587 leader_election.cc:290] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:30.083217 31637 raft_consensus.cc:2804] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:10:29.658725 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 95499.5us
I20260709 13:10:30.086534 31583 leader_election.cc:290] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:29.674544 31580 leader_election.cc:290] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:30.092769 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:10:30.082135 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 70193.8us
I20260709 13:10:30.083847 30025 raft_consensus.cc:3060] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:30.087819 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:30.065630 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.086907 31570 leader_election.cc:290] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:10:30.094089 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 111924us
W20260709 13:10:30.083376 30198 debug-util.cc:398] Leaking SignalData structure 0x7b08000fb2a0 after lost signal to thread 28892
I20260709 13:10:29.673511 31603 leader_election.cc:290] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:30.112500 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:30.054695 31615 raft_consensus.cc:493] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:30.094722 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:29.725374 31624 leader_election.cc:290] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:29.658618 31579 leader_election.cc:290] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:29.791133 31627 leader_election.cc:290] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:29.789860 31614 leader_election.cc:290] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:29.674017 31588 leader_election.cc:290] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:30.069384 31601 raft_consensus.cc:493] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:29.790437 31629 leader_election.cc:290] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:30.092012 30094 raft_consensus.cc:1275] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:30.127118 30098 consensus_queue.cc:237] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:30.083956 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:30.133975 31630 leader_election.cc:290] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:30.135159 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:30.136025 31623 leader_election.cc:290] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:30.136549 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:30.136842 31603 raft_consensus.cc:493] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:29.606603 31578 raft_consensus.cc:515] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:30.137100 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.137321 31628 leader_election.cc:290] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:30.137606 31603 raft_consensus.cc:515] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:30.138245 30024 raft_consensus.cc:1240] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:30.138458 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.139706 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.139866 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.140882 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.141219 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.118666 31615 raft_consensus.cc:515] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:30.119179 31582 raft_consensus.cc:493] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:30.120082 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.120465 30096 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8"
dest_uuid: "5ec73dc157ed476ca903a7d596271719"
mode: GRACEFUL
new_leader_uuid: "c99569d27a6f4c648eae7119fe3db124"
 from {username='slave'} at 127.0.0.1:37340
I20260709 13:10:30.123982 30732 raft_consensus.cc:1240] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:30.110948 30021 raft_consensus.cc:2468] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 1.
I20260709 13:10:30.127745 30094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48558 (request call id 203) took 1011 ms. Trace:
I20260709 13:10:30.150025 31640 raft_consensus.cc:493] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:30.127074 31601 raft_consensus.cc:515] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:30.151643 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.091961 31543 raft_consensus.cc:493] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:30.091629 31585 raft_consensus.cc:493] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:30.121742 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:30.084576 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:30.147928 31599 leader_election.cc:290] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:30.149099 30096 raft_consensus.cc:606] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Received request to transfer leadership to TS c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:30.112519 31568 raft_consensus.cc:2804] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:30.115777 31471 leader_election.cc:290] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:30.170801 30102 raft_consensus.cc:1275] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:30.170976 31471 consensus_queue.cc:1048] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:30.170248 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:30.172338 30099 raft_consensus.cc:2468] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 1.
I20260709 13:10:30.171957 31640 raft_consensus.cc:515] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:30.174175 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:30.090437 31637 raft_consensus.cc:493] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:30.059803 31612 raft_consensus.cc:515] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:30.153136 30028 raft_consensus.cc:2468] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 1.
I20260709 13:10:30.149724 30094 rpcz_store.cc:276] 0709 13:10:29.116647 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.147175 (+ 30528us) service_pool.cc:224] Handling call
0709 13:10:29.206988 (+ 59813us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:30.127449 (+920461us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:30.127678 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:30.154335 31543 raft_consensus.cc:3060] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.179386 31612 leader_election.cc:290] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:30.179693 31585 raft_consensus.cc:515] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:30.182063 31585 leader_election.cc:290] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:30.182780 31584 leader_election.cc:290] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:30.158196 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:30.184031 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.157797 31582 raft_consensus.cc:515] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:30.185637 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:30.186420 30099 raft_consensus.cc:2468] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 1.
I20260709 13:10:30.164600 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:30.187005 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:30.187609 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.188063 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:30.188670 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.189204 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:30.163097 31601 leader_election.cc:290] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:30.189484 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:30.165984 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:10:30.166888 30198 debug-util.cc:398] Leaking SignalData structure 0x7b08000fb280 after lost signal to thread 29960
I20260709 13:10:30.158259 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:30.168927 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:30.202299 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.169090 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.148198 31631 leader_election.cc:290] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:30.159899 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:30.183079 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:30.186482 31582 leader_election.cc:290] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:30.165686 31623 consensus_queue.cc:1048] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:30.166410 31568 raft_consensus.cc:493] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.215868 31568 raft_consensus.cc:3060] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:30.216315 31566 consensus_meta.cc:287] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent flushing consensus metadata: real 1.365s	user 0.013s	sys 0.036s
I20260709 13:10:30.216712 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:30.189823 31589 leader_election.cc:290] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:30.203476 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:30.204211 31646 leader_election.cc:290] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:30.225456 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:30.226263 30099 raft_consensus.cc:2468] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 2.
I20260709 13:10:30.226598 31640 leader_election.cc:290] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:30.226825 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.227324 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:30.208853 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:30.228152 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.228534 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:30.229229 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.230160 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
W20260709 13:10:30.230685 30198 debug-util.cc:398] Leaking SignalData structure 0x7b0800367000 after lost signal to thread 30052
I20260709 13:10:30.229249 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:30.231936 31603 leader_election.cc:290] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:10:30.232157 30198 debug-util.cc:398] Leaking SignalData structure 0x7b0800355440 after lost signal to thread 30127
I20260709 13:10:30.232648 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:30.192807 31637 raft_consensus.cc:3060] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.213881 31606 leader_election.cc:290] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:30.236119 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:30.218729 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:30.223727 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:30.223968 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:30.224504 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.224650 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.218040 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:30.225006 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:30.234432 30025 raft_consensus.cc:2468] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 3.
I20260709 13:10:30.234930 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:10:30.235311 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 73080.6us
I20260709 13:10:30.224815 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
W20260709 13:10:30.235651 30198 debug-util.cc:398] Leaking SignalData structure 0x7b0800328320 after lost signal to thread 30201
I20260709 13:10:30.241883 30101 raft_consensus.cc:2468] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 1.
I20260709 13:10:30.243811 29924 catalog_manager.cc:5697] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: term changed from 1 to 2, leader changed from 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) to 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68). New cstate: current_term: 2 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:30.248343 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.252889 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:30.222121 30094 raft_consensus.cc:2468] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 2.
I20260709 13:10:30.255239 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.230643 31644 consensus_queue.cc:1048] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:10:30.256083 31596 leader_election.cc:290] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:30.256534 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.258097 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:30.253891 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:30.254757 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:10:30.246795 30198 debug-util.cc:398] Leaking SignalData structure 0x7b08003286e0 after lost signal to thread 30202
I20260709 13:10:30.260896 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:30.261122 31625 leader_election.cc:290] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:30.262377 30022 raft_consensus.cc:2393] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 2: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:30.262804 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:30.216727 31566 raft_consensus.cc:515] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:30.263279 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:30.263489 30094 raft_consensus.cc:2468] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 2.
I20260709 13:10:30.262286 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:30.263986 30022 raft_consensus.cc:2468] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
I20260709 13:10:30.264468 30023 raft_consensus.cc:1240] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:30.263307 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.264813 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:30.263195 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:30.266626 31566 leader_election.cc:290] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:30.266863 31622 leader_election.cc:290] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:30.267275 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:10:30.263432 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 63183.2us
W20260709 13:10:30.269368 30198 debug-util.cc:398] Leaking SignalData structure 0x7b08002afa20 after lost signal to thread 30761
I20260709 13:10:30.270494 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:30.272135 31543 raft_consensus.cc:515] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:30.274456 31615 leader_election.cc:290] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:30.276731 30095 raft_consensus.cc:2468] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 2.
I20260709 13:10:30.277242 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.279289 30703 leader_election.cc:304] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:30.269767 30022 raft_consensus.cc:1240] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:30.280566 30700 leader_election.cc:304] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:30.282536 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:30.283545 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:30.328549 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:30.287317 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
W20260709 13:10:30.304215 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 57591us
I20260709 13:10:30.305012 31566 raft_consensus.cc:493] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:30.284782 28889 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:10:30.316917 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.308046 30140 leader_election.cc:304] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:30.299472 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:30.281708 31568 raft_consensus.cc:515] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:30.314607 30198 debug-util.cc:398] Leaking SignalData structure 0x7b0800232a80 after lost signal to thread 30762
I20260709 13:10:30.318792 30068 leader_election.cc:304] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:30.324790 30703 leader_election.cc:304] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:10:30.288946 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:30.334824 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:10:30.336885 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 128893us
I20260709 13:10:30.329694 30023 raft_consensus.cc:1240] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:30.304690 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:10:30.339051 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 78141.7us
I20260709 13:10:30.317996 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.335301 30027 raft_consensus.cc:1240] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:30.294874 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:30.330835 31580 consensus_queue.cc:1048] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:10:30.349092 30094 raft_consensus.cc:2468] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 1.
I20260709 13:10:30.315784 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:30.336097 31589 raft_consensus.cc:2804] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:30.352334 31589 raft_consensus.cc:493] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:30.352738 31589 raft_consensus.cc:3060] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.351826 31643 raft_consensus.cc:2804] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:30.351821 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.338191 28889 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:30.337355 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:30.355249 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.351825 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:30.351081 30098 raft_consensus.cc:2468] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 2.
I20260709 13:10:30.356252 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:30.357472 30103 raft_consensus.cc:2468] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 2.
I20260709 13:10:30.357604 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:30.335942 30142 leader_election.cc:304] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:30.358428 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:30.312417 31606 consensus_queue.cc:1059] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:10:30.360401 30096 raft_consensus.cc:2468] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 2.
I20260709 13:10:30.360715 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.330380 31566 raft_consensus.cc:515] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:30.314365 31621 leader_election.cc:290] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:30.358152 30100 raft_consensus.cc:2468] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 1.
I20260709 13:10:30.319315 31578 leader_election.cc:290] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:30.362527 31639 leader_election.cc:290] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:30.360710 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:30.362710 31648 raft_consensus.cc:2804] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:30.365495 31648 raft_consensus.cc:493] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:30.364964 31606 raft_consensus.cc:3055] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:30.365715 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.365998 31606 raft_consensus.cc:740] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:30.366883 30140 leader_election.cc:304] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:30.367445 31566 leader_election.cc:290] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:30.368264 31597 raft_consensus.cc:2749] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:30.369094 31643 raft_consensus.cc:493] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:30.369649 31643 raft_consensus.cc:3060] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.338393 31626 leader_election.cc:290] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:30.336145 31644 consensus_queue.cc:1048] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:10:30.324548 31471 raft_consensus.cc:2749] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:30.319293 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.362557 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.378829 30174 raft_consensus.cc:2468] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 2.
I20260709 13:10:30.334118 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:30.372773 30066 leader_election.cc:304] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:30.383634 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.386065 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.386301 30168 raft_consensus.cc:2468] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 3.
I20260709 13:10:30.387231 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.388871 29993 leader_election.cc:304] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:30.390195 31580 raft_consensus.cc:2749] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:30.396353 30736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51014 (request call id 539) took 1551 ms. Trace:
I20260709 13:10:30.396611 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:30.396931 31647 raft_consensus.cc:493] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:30.396338 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.398587 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.372393 31648 raft_consensus.cc:3060] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:30.399506 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:30.400142 31543 leader_election.cc:290] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:30.401038 30703 leader_election.cc:304] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:10:30.400816 31647 raft_consensus.cc:515] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:30.402664 31570 raft_consensus.cc:2749] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:30.403506 31651 raft_consensus.cc:2804] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:30.403841 31647 leader_election.cc:290] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:30.396443 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:30.406240 30735 raft_consensus.cc:2468] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 1.
I20260709 13:10:30.407196 31603 raft_consensus.cc:2804] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:30.407634 31603 raft_consensus.cc:493] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:30.408011 31603 raft_consensus.cc:3060] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:30.408699 30142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 81095.3us
I20260709 13:10:30.380802 31568 leader_election.cc:290] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:30.396867 30736 rpcz_store.cc:276] 0709 13:10:28.844416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.277924 (+433508us) service_pool.cc:224] Handling call
0709 13:10:29.278176 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:30.115401 (+837225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:30.115451 (+    50us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:30.115505 (+    54us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:30.115548 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:30.394979 (+279431us) spinlock_profiling.cc:243] Waited 833 ms on lock 0x7b5400651b54. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:10:30.395022 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:30.396190 (+  1168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1915591552}
W20260709 13:10:30.410270 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 60238.8us
I20260709 13:10:30.411984 30066 leader_election.cc:304] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:30.410249 30700 leader_election.cc:304] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:30.414419 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.402168 31644 raft_consensus.cc:493] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:30.403893 31651 raft_consensus.cc:493] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:30.418211 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:30.416023 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.409399 31543 raft_consensus.cc:2804] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:30.418913 30730 raft_consensus.cc:2468] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 2.
I20260709 13:10:30.409369 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.423204 31606 consensus_queue.cc:260] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:30.424216 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.426458 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:30.425598 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:30.430011 31647 raft_consensus.cc:2804] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:30.429950 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.430333 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:30.431159 31647 raft_consensus.cc:697] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:30.432168 31647 consensus_queue.cc:237] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:30.433125 31628 raft_consensus.cc:2804] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:30.433569 31628 raft_consensus.cc:493] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:30.434715 31628 raft_consensus.cc:3060] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.435186 30168 raft_consensus.cc:2468] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 2.
I20260709 13:10:30.442783 31606 raft_consensus.cc:3060] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:30.420324 31651 raft_consensus.cc:3060] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:30.421747 31543 raft_consensus.cc:493] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:30.453055 31632 raft_consensus.cc:993] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719: : Instructing follower c99569d27a6f4c648eae7119fe3db124 to start an election
I20260709 13:10:30.453538 31626 raft_consensus.cc:1081] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Signalling peer c99569d27a6f4c648eae7119fe3db124 to start an election
I20260709 13:10:30.448401 30142 leader_election.cc:304] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:30.454763 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:30.456089 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:30.457000 30024 raft_consensus.cc:2468] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 2.
I20260709 13:10:30.449723 31543 raft_consensus.cc:3060] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.466974 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:30.467687 30024 raft_consensus.cc:2393] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 2: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:30.469429 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:30.447377 31603 raft_consensus.cc:515] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:30.446162 31644 raft_consensus.cc:515] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:30.472856 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:30.474907 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:30.475564 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:30.475975 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:30.476146 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:30.479490 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:30.481506 30103 raft_consensus.cc:1240] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:30.482738 30066 leader_election.cc:304] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:30.481766 31570 raft_consensus.cc:2749] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:30.473670 31644 leader_election.cc:290] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:30.483362 29993 leader_election.cc:304] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:30.488665 31640 raft_consensus.cc:2804] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:30.490473 31640 raft_consensus.cc:493] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:30.490900 31640 raft_consensus.cc:3060] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.492538 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:30.495513 30730 raft_consensus.cc:2393] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 2: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:10:30.495703 31568 raft_consensus.cc:2804] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:30.496131 31568 raft_consensus.cc:493] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:30.496336 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:30.494087 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:30.496511 31568 raft_consensus.cc:3060] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:30.497471 30027 raft_consensus.cc:2393] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 2: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:30.497997 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:30.501830 31589 raft_consensus.cc:515] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:30.499434 29993 leader_election.cc:304] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:30.503531 31580 raft_consensus.cc:2804] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:30.503897 31580 raft_consensus.cc:493] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:30.504262 31580 raft_consensus.cc:3060] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:30.510047 31578 consensus_queue.cc:1048] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:30.479985 31626 consensus_queue.cc:1048] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260709 13:10:30.527419 31589 leader_election.cc:290] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 2 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:30.529812 29993 leader_election.cc:304] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:30.531487 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:30.540369 31568 raft_consensus.cc:515] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:30.543872 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:30.545141 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:30.545682 30736 raft_consensus.cc:3060] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:30.560346 31588 raft_consensus.cc:2749] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:30.561075 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:30.564042 31632 consensus_queue.cc:1059] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:30.543329 31637 raft_consensus.cc:515] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:30.568619 31632 raft_consensus.cc:3055] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:30.568971 31632 raft_consensus.cc:740] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:30.569801 31632 consensus_queue.cc:260] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:30.570904 31632 raft_consensus.cc:3060] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.572022 30066 leader_election.cc:304] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:30.550619 31643 raft_consensus.cc:515] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:30.573701 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 68467.5us
I20260709 13:10:30.574136 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:30.578806 31626 raft_consensus.cc:2804] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:30.558530 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:30.561625 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:30.564445 31543 raft_consensus.cc:515] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:30.582823 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:30.582019 31637 leader_election.cc:290] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:30.578869 31646 consensus_queue.cc:1059] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:30.572266 29994 leader_election.cc:304] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:30.590521 31639 raft_consensus.cc:3055] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:30.587152 31603 leader_election.cc:290] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:30.590950 31639 raft_consensus.cc:740] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:30.587083 31568 leader_election.cc:290] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:30.592044 31639 consensus_queue.cc:260] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:30.592593 30142 leader_election.cc:304] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:30.593304 31639 raft_consensus.cc:3060] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.594511 31570 raft_consensus.cc:2749] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:30.594730 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:30.595115 30142 leader_election.cc:304] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:30.595399 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:30.595965 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:30.596542 30096 raft_consensus.cc:2468] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 2.
I20260709 13:10:30.597512 30736 raft_consensus.cc:2468] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 3.
I20260709 13:10:30.596992 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:30.599716 29994 leader_election.cc:304] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:30.600780 29994 leader_election.cc:304] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:30.581291 31648 raft_consensus.cc:515] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:30.581946 31626 raft_consensus.cc:493] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:30.610978 31626 raft_consensus.cc:3060] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:30.586557 31543 leader_election.cc:290] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:30.588583 31580 raft_consensus.cc:515] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:30.616569 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:30.617283 30103 raft_consensus.cc:2393] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 3: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:10:30.617364 31580 leader_election.cc:290] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:30.589565 31621 raft_consensus.cc:493] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:30.617820 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:30.618213 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:30.600931 31589 raft_consensus.cc:2804] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:30.602007 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:30.621420 31589 raft_consensus.cc:493] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:30.621564 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:30.621717 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:30.580369 31643 leader_election.cc:290] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:30.622396 30103 raft_consensus.cc:2468] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 2.
I20260709 13:10:30.622236 31621 raft_consensus.cc:515] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:30.622663 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:30.602329 30142 leader_election.cc:304] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:30.607635 29994 leader_election.cc:304] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:30.608518 31568 raft_consensus.cc:2749] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:30.623000 30097 raft_consensus.cc:2468] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 2.
I20260709 13:10:30.608960 31612 raft_consensus.cc:2804] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:30.615553 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:30.620645 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:30.620936 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:30.621860 31589 raft_consensus.cc:3060] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.608124 31578 raft_consensus.cc:2749] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:30.623798 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:30.623889 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:30.626646 31612 raft_consensus.cc:493] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:30.630033 30097 raft_consensus.cc:1240] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 1. Current term is 2. Ops: []
W20260709 13:10:30.630371 30141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:30.619086 30066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:30.615005 31648 leader_election.cc:290] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:30.629345 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:30.622958 31640 raft_consensus.cc:515] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:30.632113 31612 raft_consensus.cc:3060] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:30.633121 31568 raft_consensus.cc:2804] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:30.615402 31628 raft_consensus.cc:515] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:30.644568 31570 raft_consensus.cc:2804] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:30.651734 29994 leader_election.cc:304] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:30.645345 29993 leader_election.cc:304] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:30.660919 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:30.662557 30098 raft_consensus.cc:1240] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:30.663576 31628 leader_election.cc:290] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:30.664264 30703 leader_election.cc:304] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:30.660202 31570 raft_consensus.cc:493] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:30.665491 31543 raft_consensus.cc:3060] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.665553 31570 raft_consensus.cc:3060] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:30.666445 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.644382 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:30.664283 31578 raft_consensus.cc:2804] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:30.670348 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.671036 31588 raft_consensus.cc:2804] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:30.672034 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.672688 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.673858 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.659601 31568 raft_consensus.cc:493] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:30.685981 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.690266 29994 leader_election.cc:304] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:30.691437 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.692150 30177 raft_consensus.cc:2468] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 3.
I20260709 13:10:30.675235 31621 leader_election.cc:290] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:30.688944 31568 raft_consensus.cc:3060] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:30.694027 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:30.694510 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:30.676923 31578 raft_consensus.cc:493] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:30.696770 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:30.688326 31588 raft_consensus.cc:493] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:30.707060 31579 raft_consensus.cc:2749] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:30.707050 30703 leader_election.cc:304] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:30.708207 31640 leader_election.cc:290] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:30.708896 31643 raft_consensus.cc:2804] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:30.709496 31643 raft_consensus.cc:493] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:30.677489 31651 raft_consensus.cc:515] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:30.694012 30168 raft_consensus.cc:2468] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 2.
I20260709 13:10:30.702189 31588 raft_consensus.cc:3060] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.710008 31643 raft_consensus.cc:3060] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.700556 31578 raft_consensus.cc:3060] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:30.717902 29994 leader_election.cc:304] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:30.726498 31580 raft_consensus.cc:2764] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:10:30.736912 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.719393 31612 raft_consensus.cc:515] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:30.735970 29994 leader_election.cc:304] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:30.746424 30737 raft_consensus.cc:1240] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:30.735219 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:30.754601 31624 consensus_queue.cc:1059] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:30.754969 31570 raft_consensus.cc:515] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:30.756127 31627 raft_consensus.cc:3055] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:30.756577 31627 raft_consensus.cc:740] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:30.754721 30702 leader_election.cc:304] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:30.758467 31627 consensus_queue.cc:260] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:30.761684 31627 raft_consensus.cc:3060] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:30.759086 31612 leader_election.cc:290] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:30.766855 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:30.756119 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:30.780499 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:30.763705 31579 raft_consensus.cc:2804] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:30.782860 31579 raft_consensus.cc:493] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:30.783247 31579 raft_consensus.cc:3060] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:30.783634 31589 raft_consensus.cc:515] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:30.787067 31589 leader_election.cc:290] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 2 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:30.762961 31651 leader_election.cc:290] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:30.788508 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:30.757078 31570 leader_election.cc:290] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:30.790285 31626 raft_consensus.cc:515] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:30.791131 30702 leader_election.cc:304] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:30.795073 31578 raft_consensus.cc:515] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:30.797132 31578 leader_election.cc:290] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:30.801535 31647 raft_consensus.cc:2749] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:30.802260 31647 raft_consensus.cc:493] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:30.803021 31601 raft_consensus.cc:2749] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:30.802763 31647 raft_consensus.cc:515] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:30.802143 30702 leader_election.cc:304] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:30.810798 30702 leader_election.cc:304] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:30.811748 31601 raft_consensus.cc:2749] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:30.814885 31647 leader_election.cc:290] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:30.822697 31471 raft_consensus.cc:2749] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:30.830881 30703 leader_election.cc:304] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
W20260709 13:10:30.985720 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 162066us
I20260709 13:10:30.986500 30702 leader_election.cc:304] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:30.860257 31543 raft_consensus.cc:2749] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:30.826084 31568 raft_consensus.cc:515] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:10:31.055630 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 224830us
I20260709 13:10:30.944782 31626 leader_election.cc:290] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:31.105438 30737 raft_consensus.cc:1240] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:31.108078 30736 raft_consensus.cc:1240] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:31.109542 30730 raft_consensus.cc:1240] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:30.985930 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:31.001556 31651 raft_consensus.cc:2749] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:31.033330 31647 raft_consensus.cc:2804] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:10:31.130934 30141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:31.147213 30066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.156248 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:10:31.160686 30069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.127108 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:31.221571 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:31.219936 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:31.137585 31647 raft_consensus.cc:493] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:31.172722 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:31.137776 31643 raft_consensus.cc:515] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:31.246243 31647 raft_consensus.cc:3060] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:31.287081 31588 consensus_meta.cc:287] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent flushing consensus metadata: real 0.559s	user 0.008s	sys 0.000s
W20260709 13:10:31.291970 31579 consensus_meta.cc:287] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4: Time spent flushing consensus metadata: real 0.508s	user 0.009s	sys 0.000s
I20260709 13:10:31.292443 31579 raft_consensus.cc:515] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:31.265722 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:31.231138 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:10:31.595722 30066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.626379 30177 raft_consensus.cc:2468] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
W20260709 13:10:31.636433 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 191856us
I20260709 13:10:31.627003 30732 raft_consensus.cc:1240] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 1. Current term is 2. Ops: []
W20260709 13:10:31.654633 30703 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.015s	sys 0.043s
I20260709 13:10:31.287570 31588 raft_consensus.cc:515] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:10:31.654946 30703 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.015s	sys 0.043s
W20260709 13:10:31.626649 31664 log.cc:927] Time spent T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.862s	user 0.002s	sys 0.000s
I20260709 13:10:31.629362 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:31.658633 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:31.612282 31589 consensus_queue.cc:1059] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260709 13:10:31.653275 31568 leader_election.cc:290] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:10:31.696450 30702 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.004s	sys 0.029s
W20260709 13:10:31.699985 30702 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.005s	sys 0.029s
I20260709 13:10:31.656153 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:10:31.700290 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 695902us
I20260709 13:10:31.704140 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:31.701982 30702 leader_election.cc:304] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
W20260709 13:10:31.712749 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 976765us
W20260709 13:10:31.726538 30141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:31.741263 31543 consensus_queue.cc:1048] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:31.744127 31579 leader_election.cc:290] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:31.762336 29994 leader_election.cc:304] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
W20260709 13:10:31.762795 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 60911.8us
I20260709 13:10:31.765018 30175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54540 (request call id 242) took 1085 ms. Trace:
W20260709 13:10:31.753729 31627 consensus_meta.cc:287] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124: Time spent flushing consensus metadata: real 0.990s	user 0.006s	sys 0.003s
I20260709 13:10:31.774427 31566 raft_consensus.cc:2804] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:31.774853 31566 raft_consensus.cc:493] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:31.775179 31566 raft_consensus.cc:3060] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:31.779675 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:31.758909 31588 leader_election.cc:290] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:31.763933 31543 raft_consensus.cc:2749] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:10:31.789947 31667 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.052s	sys 0.076s
I20260709 13:10:31.765969 30175 rpcz_store.cc:276] 0709 13:10:30.676005 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:30.676119 (+   114us) service_pool.cc:224] Handling call
0709 13:10:30.688833 (+ 12714us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:30.694149 (+  5316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:30.694174 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:30.694598 (+   424us) log.cc:844] Serialized 26 byte log entry
0709 13:10:30.738698 (+ 44100us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:30.738733 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:30.738793 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:31.760684 (+1021891us) raft_consensus.cc:1685] finished
0709 13:10:31.760706 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:31.760839 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":952,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":3142,"thread_start_us":43752,"threads_started":1,"wal-append.queue_time_us":69724}
I20260709 13:10:31.794283 31643 leader_election.cc:290] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:31.819128 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:31.821655 31566 raft_consensus.cc:515] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:31.981417 31566 leader_election.cc:290] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:32.089150 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:10:32.092862 30172 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43840 (request call id 1467) took 1264 ms (client timeout 1631 ms). Trace:
W20260709 13:10:32.094041 30172 rpcz_store.cc:269] 0709 13:10:30.828281 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:30.828702 (+   421us) service_pool.cc:224] Handling call
0709 13:10:32.088964 (+1260262us) spinlock_profiling.cc:243] Waited 1.16 ms on lock 0x7b5800003c98. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eef95b71 00007f99eef95a22 00007f99f7eaec09 00007f99f7008ee0 00007f99f70d20ab 00007f99f70d2131 00007f99f70800a0 00007f99f707f984 00007f99f05fa6d4 00007f99f05fa662
0709 13:10:32.091770 (+  2806us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2664320}
W20260709 13:10:32.090659 31647 consensus_meta.cc:287] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent flushing consensus metadata: real 0.586s	user 0.008s	sys 0.000s
I20260709 13:10:32.194823 31647 raft_consensus.cc:515] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:32.196341 31647 leader_election.cc:290] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 3 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:10:32.204147 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 465883us
I20260709 13:10:32.205987 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:32.206197 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:32.206842 30024 raft_consensus.cc:2468] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 3.
I20260709 13:10:32.210011 30024 raft_consensus.cc:1240] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:32.212044 30024 raft_consensus.cc:1240] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:32.213332 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:32.213901 30024 raft_consensus.cc:3060] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:32.215309 29993 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.445s	user 0.033s	sys 0.076s
I20260709 13:10:32.215874 30023 raft_consensus.cc:1240] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 1. Current term is 2. Ops: []
W20260709 13:10:32.216051 29993 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.446s	user 0.033s	sys 0.076s
I20260709 13:10:32.217142 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:32.218524 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
W20260709 13:10:32.218751 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 1.47499e+06us
I20260709 13:10:32.219401 29993 leader_election.cc:304] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:32.220237 31663 raft_consensus.cc:2749] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:32.221164 30024 raft_consensus.cc:2468] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 2.
I20260709 13:10:32.221426 29993 leader_election.cc:304] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:32.222213 31663 raft_consensus.cc:2749] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:32.223733 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:32.224409 30023 raft_consensus.cc:2393] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 3: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:32.225267 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:32.224391 29993 leader_election.cc:304] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:32.226052 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:32.226579 31663 raft_consensus.cc:2749] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:32.227236 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:32.227339 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:32.227893 30026 raft_consensus.cc:2393] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 2: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:32.227758 29993 leader_election.cc:304] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:32.228020 30025 raft_consensus.cc:2393] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 2: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:32.226684 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:32.228677 30021 raft_consensus.cc:2468] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
I20260709 13:10:32.228781 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:32.228840 31663 raft_consensus.cc:2749] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:32.230564 29993 leader_election.cc:304] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:32.231256 31663 raft_consensus.cc:2749] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:32.230752 30023 raft_consensus.cc:1275] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:32.232549 30025 raft_consensus.cc:1240] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:10:32.233807 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:32.234475 30025 raft_consensus.cc:2393] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 3: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:32.235780 30025 raft_consensus.cc:1240] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:32.237016 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:32.238433 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:32.240625 29993 leader_election.cc:304] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:32.241214 30025 raft_consensus.cc:1240] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:32.242511 31663 raft_consensus.cc:2749] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:32.244280 30025 raft_consensus.cc:1240] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:32.245214 30732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51004 (request call id 418) took 1138 ms. Trace:
I20260709 13:10:32.245482 29993 leader_election.cc:304] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:32.246663 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:32.247098 31663 raft_consensus.cc:2749] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:32.248104 29993 leader_election.cc:304] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:32.245591 30732 rpcz_store.cc:276] 0709 13:10:31.106332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:31.106487 (+   155us) service_pool.cc:224] Handling call
0709 13:10:31.106780 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:31.660685 (+553905us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:32.244977 (+584292us) spinlock_profiling.cc:243] Waited 398 ms on lock 0x7b54005c1a54. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:10:32.245152 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":915731840}
I20260709 13:10:32.248138 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:32.251154 30021 raft_consensus.cc:3060] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:32.251751 30066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.253521 31663 raft_consensus.cc:2804] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:32.254046 31663 raft_consensus.cc:697] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:32.254908 31663 consensus_queue.cc:237] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:32.257704 30069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.268224 30026 raft_consensus.cc:1240] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:32.268277 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:32.269142 30025 raft_consensus.cc:2393] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 3: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:32.269402 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:32.270044 30024 raft_consensus.cc:2468] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
I20260709 13:10:32.269187 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:32.272716 30021 raft_consensus.cc:2468] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
I20260709 13:10:32.273721 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:32.274272 30023 raft_consensus.cc:2468] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
I20260709 13:10:32.276361 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:32.278306 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:32.278839 30098 raft_consensus.cc:2468] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 2.
I20260709 13:10:32.280448 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:32.280963 30098 raft_consensus.cc:2468] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 2.
W20260709 13:10:32.286532 30068 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.005s	sys 0.051s
W20260709 13:10:32.286845 30068 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.005s	sys 0.051s
I20260709 13:10:32.293831 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:32.295331 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:32.297246 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:32.297719 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:32.297801 30102 raft_consensus.cc:2468] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 1.
I20260709 13:10:32.307734 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:32.307914 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:32.310258 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:32.310827 30103 raft_consensus.cc:2468] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 3.
I20260709 13:10:32.317485 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:32.318060 30103 raft_consensus.cc:2468] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 1.
I20260709 13:10:32.318826 31589 raft_consensus.cc:3055] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:32.319211 31589 raft_consensus.cc:740] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:32.320025 31589 consensus_queue.cc:260] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:32.321375 31589 raft_consensus.cc:3060] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:32.321449 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:32.321705 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:32.322109 30102 raft_consensus.cc:3060] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:32.322291 30100 raft_consensus.cc:3060] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:32.328832 31674 consensus_queue.cc:1059] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:32.329216 30102 raft_consensus.cc:2468] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 2.
I20260709 13:10:32.329589 30100 raft_consensus.cc:2468] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 4.
I20260709 13:10:32.330624 31670 consensus_queue.cc:1059] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:32.331611 31675 consensus_queue.cc:1059] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:32.334515 31682 raft_consensus.cc:3055] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:32.334975 31670 raft_consensus.cc:3055] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:32.335141 31682 raft_consensus.cc:740] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:32.335367 31670 raft_consensus.cc:740] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:32.336136 31670 consensus_queue.cc:260] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:32.337221 31670 raft_consensus.cc:3060] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:32.340066 30141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.342377 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:32.342377 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:32.343116 30102 raft_consensus.cc:2468] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 1.
I20260709 13:10:32.344131 31624 raft_consensus.cc:493] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.352118 31624 raft_consensus.cc:515] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:32.354171 31624 leader_election.cc:290] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:32.355425 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:32.356042 30170 raft_consensus.cc:2468] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
I20260709 13:10:32.356196 30171 raft_consensus.cc:1275] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 13:10:32.356863 30170 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8"
dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
 from {username='slave'} at 127.0.0.1:43840
I20260709 13:10:32.357437 30170 raft_consensus.cc:493] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:32.358177 30170 raft_consensus.cc:3060] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:32.359990 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:32.361727 30103 raft_consensus.cc:3060] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:32.366076 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:32.367900 30171 raft_consensus.cc:1240] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:32.348670 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:32.368909 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:32.369746 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:32.370066 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:32.348956 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:32.374327 30170 raft_consensus.cc:515] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:10:32.375829 30703 leader_election.cc:336] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Timed out: RequestConsensusVote RPC to 127.28.54.66:43821 timed out after 1.537s (SENT)
W20260709 13:10:32.376540 30140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.376338 30703 leader_election.cc:304] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:32.377008 30171 raft_consensus.cc:1240] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:32.378847 31601 raft_consensus.cc:2749] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:32.350342 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:32.380064 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:32.350791 30177 raft_consensus.cc:1240] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:32.380971 30168 raft_consensus.cc:3060] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:32.350598 29924 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39956 (request call id 227) took 3068 ms. Trace:
I20260709 13:10:32.374794 30068 leader_election.cc:304] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:32.384476 30100 raft_consensus.cc:2393] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 2: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:10:32.394598 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:32.387495 31673 raft_consensus.cc:2749] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:32.387892 30068 leader_election.cc:304] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:32.376281 30170 leader_election.cc:290] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 2 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:32.346122 30094 raft_consensus.cc:2468] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 2.
I20260709 13:10:32.390229 30098 raft_consensus.cc:2468] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 2.
I20260709 13:10:32.391490 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:32.381491 29924 rpcz_store.cc:276] 0709 13:10:29.282123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:29.282270 (+   147us) service_pool.cc:224] Handling call
0709 13:10:32.350520 (+3068250us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:30.449554 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:30.561215 (+111661us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:30.566652 (+  5437us) write_op.cc:435] Acquired schema lock
0709 13:10:30.573208 (+  6556us) tablet.cc:662] Decoding operations
0709 13:10:30.575993 (+  2785us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:30.576082 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:30.576113 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:10:30.576412 (+   299us) tablet.cc:701] Row locks acquired
0709 13:10:30.576458 (+    46us) write_op.cc:260] PREPARE: finished
0709 13:10:30.576615 (+   157us) write_op.cc:270] Start()
0709 13:10:30.576743 (+   128us) write_op.cc:276] Timestamp: P: 1783602630576562 usec, L: 0
0709 13:10:30.576775 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:10:30.577495 (+   720us) log.cc:844] Serialized 533 byte log entry
0709 13:10:31.242634 (+665139us) op_driver.cc:464] REPLICATION: finished
0709 13:10:31.819499 (+576865us) write_op.cc:301] APPLY: starting
0709 13:10:31.819588 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:31.819686 (+    98us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:31.819806 (+   120us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:31.820071 (+   265us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:31.820311 (+   240us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:10:31.820370 (+    59us) write_op.cc:312] APPLY: finished
0709 13:10:31.820625 (+   255us) log.cc:844] Serialized 23 byte log entry
0709 13:10:31.820794 (+   169us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:31.820863 (+    69us) write_op.cc:454] Released schema lock
0709 13:10:31.820911 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:31.821274 (+   363us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:31.821301 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":554544,"apply.run_cpu_time_us":1775,"apply.run_wall_time_us":1775,"num_ops":1,"prepare.queue_time_us":125284,"prepare.run_cpu_time_us":21746,"prepare.run_wall_time_us":191553,"raft.queue_time_us":477930,"raft.run_cpu_time_us":129578,"raft.run_wall_time_us":667115,"replication_time_us":580808,"thread_start_us":847276,"threads_started":4,"wal-append.queue_time_us":79811}]]}
I20260709 13:10:32.392331 31676 consensus_queue.cc:1059] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:32.397408 31684 consensus_queue.cc:1059] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:32.398636 31673 raft_consensus.cc:2749] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:10:32.399598 30143 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.762s	user 0.016s	sys 0.034s
W20260709 13:10:32.416206 30143 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.778s	user 0.017s	sys 0.035s
W20260709 13:10:32.416514 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 778807us
I20260709 13:10:32.399768 30068 leader_election.cc:304] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:32.406383 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:32.417411 30096 raft_consensus.cc:2393] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 2: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:10:32.407070 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:32.407914 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:32.408433 30103 raft_consensus.cc:2468] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 2.
I20260709 13:10:32.419353 31676 raft_consensus.cc:3055] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:32.419302 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:32.419914 31674 consensus_queue.cc:1059] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:32.420809 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:32.419481 30140 leader_election.cc:304] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:32.421101 30143 leader_election.cc:304] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:32.422204 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:32.424719 30103 raft_consensus.cc:3060] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:32.430399 30096 raft_consensus.cc:2393] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 3: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
W20260709 13:10:32.435899 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 51341us
W20260709 13:10:32.438405 30703 leader_election.cc:336] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Timed out: RequestConsensusVote RPC to 127.28.54.66:43821 timed out after 1.745s (SENT)
I20260709 13:10:32.440414 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:32.459486 30140 leader_election.cc:304] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:32.473850 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:32.474673 30096 raft_consensus.cc:3060] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:32.424584 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:32.422336 31676 raft_consensus.cc:740] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
W20260709 13:10:32.476683 30703 leader_election.cc:336] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Timed out: RequestConsensusVote RPC to 127.28.54.66:43821 timed out after 1.829s (SENT)
W20260709 13:10:32.521876 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 62492.3us
I20260709 13:10:32.522590 30140 leader_election.cc:304] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:32.524523 30103 raft_consensus.cc:2468] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 2.
W20260709 13:10:32.533332 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 112323us
I20260709 13:10:32.534447 30143 leader_election.cc:304] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:32.340018 31682 consensus_queue.cc:260] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:32.540697 31676 consensus_queue.cc:260] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:32.540526 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 63872.5us
I20260709 13:10:32.539187 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:32.521601 31624 raft_consensus.cc:2804] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:32.549849 31675 raft_consensus.cc:2749] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:32.550493 31675 consensus_queue.cc:1059] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:32.551558 30170 raft_consensus.cc:1240] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:32.555228 30096 raft_consensus.cc:2468] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 2.
I20260709 13:10:32.543113 30103 raft_consensus.cc:3060] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:32.522039 31663 raft_consensus.cc:493] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:32.506155 31686 consensus_queue.cc:1048] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
I20260709 13:10:32.525444 31685 raft_consensus.cc:2749] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:32.539441 31670 raft_consensus.cc:2749] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:32.539556 31589 raft_consensus.cc:2749] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:32.541522 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:32.588605 30096 raft_consensus.cc:1240] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:10:32.626952 29992 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:32.628221 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 86836.4us
I20260709 13:10:32.541788 31680 raft_consensus.cc:2804] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:10:32.628469 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 211326us
I20260709 13:10:32.546527 31624 raft_consensus.cc:493] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:32.582355 31601 raft_consensus.cc:493] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:32.632218 31682 raft_consensus.cc:3060] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:32.638221 30103 raft_consensus.cc:2468] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 3.
I20260709 13:10:32.546237 31674 consensus_queue.cc:1059] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.091s
I20260709 13:10:32.648761 31690 consensus_queue.cc:1059] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:32.637317 31676 raft_consensus.cc:3060] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:32.650876 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 251159us
I20260709 13:10:32.582226 31663 raft_consensus.cc:515] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:32.634054 31680 raft_consensus.cc:493] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:32.637359 31624 raft_consensus.cc:3060] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:32.662147 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 109353us
I20260709 13:10:32.650624 30094 raft_consensus.cc:2393] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 3: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:10:32.668735 31698 consensus_queue.cc:1059] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:32.650223 31583 raft_consensus.cc:493] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:32.672139 30703 leader_election.cc:304] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:10:32.686968 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:32.688200 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:32.689067 30068 leader_election.cc:304] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
W20260709 13:10:32.691310 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 97374us
I20260709 13:10:32.701933 31694 raft_consensus.cc:3055] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:32.702482 31694 raft_consensus.cc:740] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
W20260709 13:10:32.702621 31687 log.cc:927] Time spent T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:10:32.703404 31694 consensus_queue.cc:260] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:32.704202 30103 raft_consensus.cc:2468] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 1.
I20260709 13:10:32.704623 31694 raft_consensus.cc:3060] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:32.706365 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:32.706990 30096 raft_consensus.cc:2468] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 1.
I20260709 13:10:32.679348 31583 raft_consensus.cc:515] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:32.672323 31685 raft_consensus.cc:3055] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:32.710001 31685 raft_consensus.cc:740] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:32.710227 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:32.710867 31685 consensus_queue.cc:260] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:32.712942 31663 leader_election.cc:290] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:32.662886 31689 raft_consensus.cc:493] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.647770 31601 raft_consensus.cc:515] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:32.713614 31689 raft_consensus.cc:515] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:32.715428 31601 leader_election.cc:290] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:32.715557 31689 leader_election.cc:290] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:32.664005 31680 raft_consensus.cc:3060] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:32.716799 31601 raft_consensus.cc:2804] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:32.709637 31583 leader_election.cc:290] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:32.717240 31601 raft_consensus.cc:697] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:32.637878 31693 consensus_queue.cc:1059] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:10:32.763787 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:32.718283 31675 consensus_queue.cc:1059] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 13:10:32.767711 30168 raft_consensus.cc:2410] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:10:32.759138 30140 leader_election.cc:304] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:32.775880 30140 leader_election.cc:304] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:32.778223 31601 consensus_queue.cc:237] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:32.788678 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:32.817327 31693 raft_consensus.cc:493] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.817965 31693 raft_consensus.cc:515] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:32.820188 31693 leader_election.cc:290] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:32.820710 31693 raft_consensus.cc:2749] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:32.821309 31693 raft_consensus.cc:3055] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:32.869632 31583 raft_consensus.cc:493] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:32.869097 31647 raft_consensus.cc:493] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.870298 31583 raft_consensus.cc:515] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:32.776969 30140 leader_election.cc:304] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
W20260709 13:10:32.874183 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 202112us
I20260709 13:10:32.884821 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:32.885563 30737 raft_consensus.cc:2393] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 2: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:10:32.887893 31681 raft_consensus.cc:3055] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:32.888319 31681 raft_consensus.cc:740] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:32.889184 31681 consensus_queue.cc:260] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:32.890589 31681 raft_consensus.cc:3060] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:32.894482 31692 raft_consensus.cc:3055] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:32.895371 31692 raft_consensus.cc:740] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:32.896402 31692 consensus_queue.cc:260] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:32.897480 31692 raft_consensus.cc:3060] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:32.898645 31681 raft_consensus.cc:2749] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:32.901460 31681 raft_consensus.cc:2804] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:32.901947 31681 raft_consensus.cc:697] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 2 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:32.773519 31624 raft_consensus.cc:515] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:32.903293 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:32.911844 30736 raft_consensus.cc:2393] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 2: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:10:32.871973 31674 raft_consensus.cc:2749] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:32.903918 29924 catalog_manager.cc:5697] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 2 to 3, leader changed from 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 3 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:32.915364 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:32.821646 31693 raft_consensus.cc:740] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
W20260709 13:10:32.925163 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 288172us
I20260709 13:10:32.921357 30737 raft_consensus.cc:2468] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 1.
I20260709 13:10:32.775298 31695 consensus_queue.cc:1059] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.139s
I20260709 13:10:32.927337 30174 raft_consensus.cc:1240] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:32.927281 31704 consensus_queue.cc:1059] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:32.927663 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:32.928508 31704 raft_consensus.cc:3055] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:32.928838 31704 raft_consensus.cc:740] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:32.928874 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:32.929152 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:32.929622 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:32.929706 31704 consensus_queue.cc:260] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:32.930410 30732 raft_consensus.cc:1240] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:32.930886 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:32.931252 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:32.930887 31704 raft_consensus.cc:3060] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:32.932479 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:32.933018 30736 raft_consensus.cc:2468] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 1.
I20260709 13:10:32.933918 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:32.935585 31583 leader_election.cc:290] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:32.936018 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:32.937086 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:32.937839 30736 raft_consensus.cc:2468] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 1.
I20260709 13:10:32.930347 30730 raft_consensus.cc:2468] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 3.
I20260709 13:10:32.939055 31704 consensus_queue.cc:1059] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:10:32.941076 31680 raft_consensus.cc:515] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:32.941319 31681 consensus_queue.cc:237] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:32.942750 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:32.943064 31680 leader_election.cc:290] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:32.944715 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:32.945613 31624 leader_election.cc:290] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:32.871260 31647 raft_consensus.cc:515] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:32.948305 30728 raft_consensus.cc:1240] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:10:32.949275 31647 leader_election.cc:290] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:32.952601 30101 raft_consensus.cc:2468] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 3.
W20260709 13:10:32.954607 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 265585us
I20260709 13:10:32.955370 30068 leader_election.cc:304] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
W20260709 13:10:32.962102 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 330386us
W20260709 13:10:32.965296 30141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:32.954041 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:32.965466 30068 leader_election.cc:304] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:32.953773 31684 consensus_queue.cc:1059] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
W20260709 13:10:32.983693 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 102222us
W20260709 13:10:32.985019 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 208103us
I20260709 13:10:32.989420 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:32.989962 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:32.991580 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:32.991945 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:32.992100 30023 raft_consensus.cc:2468] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
W20260709 13:10:33.005923 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 124655us
W20260709 13:10:33.008719 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 68225.5us
I20260709 13:10:32.962231 31697 raft_consensus.cc:493] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:33.011785 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:33.010672 30066 leader_election.cc:304] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:33.013156 30143 leader_election.cc:304] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:32.982947 31601 raft_consensus.cc:493] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:32.986213 31715 raft_consensus.cc:493] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:33.014230 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:33.014873 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:33.016517 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:33.016976 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:33.018847 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:33.019052 31712 raft_consensus.cc:2749] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:33.020539 30177 raft_consensus.cc:2393] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 3: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:10:33.022071 30027 raft_consensus.cc:2468] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 3.
I20260709 13:10:33.023053 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
W20260709 13:10:33.025548 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 60159.6us
I20260709 13:10:33.026257 30068 leader_election.cc:304] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:33.039191 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:33.041338 30025 raft_consensus.cc:1275] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:33.048591 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:33.049341 30173 raft_consensus.cc:2468] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 1.
I20260709 13:10:33.050118 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:33.050693 30172 raft_consensus.cc:2468] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 3.
I20260709 13:10:33.013314 31663 consensus_queue.cc:1059] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:10:33.053929 31708 raft_consensus.cc:3055] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:33.054284 31708 raft_consensus.cc:740] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:33.015255 31697 raft_consensus.cc:515] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:33.057431 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:33.058682 29994 leader_election.cc:304] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:33.059403 30171 raft_consensus.cc:2468] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 2.
I20260709 13:10:33.030637 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:33.043084 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:33.060765 30021 raft_consensus.cc:3060] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:33.061435 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:33.062491 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:33.063443 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:33.064191 31680 raft_consensus.cc:2749] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.067838 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:33.068557 30028 raft_consensus.cc:2393] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 2: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:33.069041 31697 leader_election.cc:290] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:33.069253 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:10:33.069363 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 58763.1us
I20260709 13:10:33.069584 31703 raft_consensus.cc:2804] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:33.023636 31601 raft_consensus.cc:515] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:33.070082 30066 leader_election.cc:304] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:33.071581 31601 leader_election.cc:290] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:33.072322 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
W20260709 13:10:33.072641 30066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.031069 31715 raft_consensus.cc:515] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:33.073479 30023 raft_consensus.cc:2468] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 2.
I20260709 13:10:33.074584 31715 leader_election.cc:290] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:33.075160 31589 raft_consensus.cc:3055] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:10:33.075400 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 62321.4us
I20260709 13:10:33.076206 30143 leader_election.cc:304] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:33.076946 31589 raft_consensus.cc:740] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:33.077042 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:33.077355 30143 leader_election.cc:304] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:33.020032 31693 consensus_queue.cc:260] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:33.069999 31703 raft_consensus.cc:493] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:33.077885 31589 consensus_queue.cc:260] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:33.078977 30022 raft_consensus.cc:2468] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 3.
I20260709 13:10:33.055141 31708 consensus_queue.cc:260] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:33.079540 29993 leader_election.cc:304] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
W20260709 13:10:33.099540 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 75975.8us
I20260709 13:10:33.102686 30702 leader_election.cc:304] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
W20260709 13:10:33.103062 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 76876.5us
W20260709 13:10:33.096390 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 111918us
I20260709 13:10:33.097834 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:33.100780 29993 leader_election.cc:304] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:33.069972 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:10:33.107921 29991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:33.108390 30069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.109067 30068 leader_election.cc:304] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:33.077919 31674 raft_consensus.cc:2749] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:33.091435 31695 raft_consensus.cc:2749] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.100030 31703 raft_consensus.cc:3060] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:33.114113 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 55497.4us
I20260709 13:10:33.116039 29994 leader_election.cc:304] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:33.117164 29994 leader_election.cc:304] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:33.118196 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:33.119688 31721 raft_consensus.cc:2749] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:33.120260 30143 leader_election.cc:304] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:33.120410 31721 raft_consensus.cc:2804] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:33.120762 31721 raft_consensus.cc:493] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:33.120982 31692 raft_consensus.cc:2749] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.121133 31721 raft_consensus.cc:3060] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:33.122705 30143 leader_election.cc:304] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:33.123435 31692 raft_consensus.cc:2749] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:33.124401 30143 leader_election.cc:304] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:33.125065 31692 raft_consensus.cc:2804] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:33.125401 31692 raft_consensus.cc:493] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:33.105011 31694 raft_consensus.cc:2804] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:33.125722 31692 raft_consensus.cc:3060] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:33.125861 31694 raft_consensus.cc:493] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:33.126266 31694 raft_consensus.cc:3060] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:33.115302 31583 raft_consensus.cc:493] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:33.127279 31583 raft_consensus.cc:515] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:33.128513 30143 leader_election.cc:304] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:33.129230 31583 leader_election.cc:290] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:33.130034 31715 raft_consensus.cc:3060] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:33.132984 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:33.104650 31663 raft_consensus.cc:2804] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:33.133919 31681 raft_consensus.cc:2749] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.134233 31663 raft_consensus.cc:493] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:33.134665 31663 raft_consensus.cc:3060] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:33.136457 30143 leader_election.cc:304] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:33.111838 31719 raft_consensus.cc:2804] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:33.137146 31719 raft_consensus.cc:697] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 2 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:33.139252 30143 leader_election.cc:304] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:10:33.141559 30069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.142832 30737 raft_consensus.cc:1275] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:33.108407 31689 raft_consensus.cc:2804] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:33.111776 31647 raft_consensus.cc:2804] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:33.146426 31674 raft_consensus.cc:2749] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:33.147347 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:33.115351 31708 raft_consensus.cc:3060] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:33.148145 30173 raft_consensus.cc:1240] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:33.148440 30731 raft_consensus.cc:1240] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:33.148600 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:33.149406 31579 raft_consensus.cc:2749] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.145084 31680 consensus_queue.cc:1059] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:10:33.164386 31712 raft_consensus.cc:3055] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:33.164484 31680 raft_consensus.cc:3055] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:33.164783 31712 raft_consensus.cc:740] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:33.164856 31680 raft_consensus.cc:740] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:33.165678 31680 consensus_queue.cc:260] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:33.166929 31680 raft_consensus.cc:3060] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:33.151085 30174 raft_consensus.cc:1275] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:33.147852 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:33.172444 31682 raft_consensus.cc:3055] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:33.172847 31682 raft_consensus.cc:740] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:33.152918 30175 raft_consensus.cc:2468] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 2.
I20260709 13:10:33.173651 31682 consensus_queue.cc:260] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:33.174917 31682 raft_consensus.cc:3060] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:33.137250 31705 raft_consensus.cc:2749] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:33.181404 31728 consensus_queue.cc:1048] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:33.161335 30143 leader_election.cc:304] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:33.162544 31686 raft_consensus.cc:2749] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.162874 31706 raft_consensus.cc:3055] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:33.183105 31706 raft_consensus.cc:740] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:33.184123 31627 raft_consensus.cc:2749] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.184005 31706 consensus_queue.cc:260] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:33.184825 31627 consensus_queue.cc:1059] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:33.185123 31706 raft_consensus.cc:3060] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:33.163429 31688 raft_consensus.cc:3055] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:33.165652 31712 consensus_queue.cc:260] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:33.114292 31589 raft_consensus.cc:3060] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:33.138643 30021 raft_consensus.cc:2468] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 2.
I20260709 13:10:33.145646 31689 raft_consensus.cc:493] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.133688 31692 raft_consensus.cc:515] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:33.190706 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 86374.9us
I20260709 13:10:33.194002 30068 leader_election.cc:304] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:33.138089 31719 consensus_queue.cc:237] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:33.161365 31647 raft_consensus.cc:697] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:33.187304 31675 raft_consensus.cc:3055] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 13:10:33.200467 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 83466.4us
I20260709 13:10:33.189291 30700 leader_election.cc:304] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:33.200634 30702 leader_election.cc:304] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:33.187103 31688 raft_consensus.cc:740] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:33.204490 30068 leader_election.cc:304] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
W20260709 13:10:33.192534 30143 connection.cc:256] RPC call timeout handler was delayed by -1.0110932459999731s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15810000000000002s for a response
W20260709 13:10:33.207934 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 90823.9us
I20260709 13:10:33.205119 30700 leader_election.cc:304] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:33.195070 31689 raft_consensus.cc:3060] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:33.194826 31695 raft_consensus.cc:493] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.197052 31712 raft_consensus.cc:3060] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:33.201498 31693 raft_consensus.cc:3060] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:33.211795 31722 raft_consensus.cc:2749] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.212064 30176 raft_consensus.cc:1240] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:33.209398 29994 leader_election.cc:304] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:33.202157 31675 raft_consensus.cc:740] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:33.212209 31710 consensus_queue.cc:1048] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:10:33.201856 31686 raft_consensus.cc:2804] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:33.209399 29993 leader_election.cc:304] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:33.207355 31583 raft_consensus.cc:2804] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:33.202703 31601 consensus_queue.cc:1059] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:10:33.217557 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:33.217876 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:33.202883 31690 consensus_queue.cc:1048] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
W20260709 13:10:33.223001 30049 debug-util.cc:398] Leaking SignalData structure 0x7b08001dbde0 after lost signal to thread 28892
I20260709 13:10:33.226641 31716 raft_consensus.cc:2749] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.221676 31686 raft_consensus.cc:493] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:33.227396 31686 raft_consensus.cc:3060] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:33.224814 30023 raft_consensus.cc:2468] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 2.
I20260709 13:10:33.225059 29994 leader_election.cc:304] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:33.225244 30068 leader_election.cc:304] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:33.226475 31601 raft_consensus.cc:3055] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:33.229218 31673 consensus_queue.cc:1059] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:33.231381 29994 leader_election.cc:304] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:33.232620 30068 leader_election.cc:304] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:33.233553 31673 raft_consensus.cc:3055] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:33.226538 31688 consensus_queue.cc:260] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:33.233932 31673 raft_consensus.cc:740] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:33.223205 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:33.235184 30700 leader_election.cc:304] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:33.223399 31566 raft_consensus.cc:2749] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:33.224435 31583 raft_consensus.cc:493] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.239049 29994 leader_election.cc:304] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:33.229688 31684 raft_consensus.cc:2749] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:33.243279 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:33.248974 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:33.249217 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:33.244943 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:33.251358 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:33.250720 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:33.246019 30143 leader_election.cc:304] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:33.247184 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:33.231088 31601 raft_consensus.cc:740] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:33.256325 30737 raft_consensus.cc:2468] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
I20260709 13:10:33.215924 31695 raft_consensus.cc:515] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:33.249799 30102 raft_consensus.cc:2376] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 2. Re-sending same reply.
I20260709 13:10:33.258996 29994 leader_election.cc:304] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:33.251624 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:33.267179 31695 leader_election.cc:290] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:33.267275 31700 raft_consensus.cc:2804] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:33.259822 31676 raft_consensus.cc:2749] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.267747 31700 raft_consensus.cc:493] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:33.267750 31601 consensus_queue.cc:260] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:33.239566 31697 raft_consensus.cc:2749] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.240078 31688 raft_consensus.cc:3060] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:33.251302 31685 raft_consensus.cc:3060] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:33.263720 31715 raft_consensus.cc:2749] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:33.239630 31568 raft_consensus.cc:2749] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:33.262763 30143 leader_election.cc:304] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:33.242390 31583 raft_consensus.cc:3060] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:33.262125 31674 raft_consensus.cc:2749] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.254124 31675 consensus_queue.cc:260] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:33.265990 30019 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "80006b8186d74baba29992ade1966048"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
mode: GRACEFUL
new_leader_uuid: "c99569d27a6f4c648eae7119fe3db124"
 from {username='slave'} at 127.0.0.1:47450
W20260709 13:10:33.254375 30049 debug-util.cc:398] Leaking SignalData structure 0x7b080003f740 after lost signal to thread 29960
I20260709 13:10:33.270080 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:33.281237 30737 raft_consensus.cc:2468] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 2.
I20260709 13:10:33.253152 31647 consensus_queue.cc:237] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:33.282197 30142 leader_election.cc:304] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:33.271039 29994 leader_election.cc:304] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:33.261525 30700 leader_election.cc:304] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:33.238085 31694 raft_consensus.cc:515] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:33.251005 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:33.253314 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:33.252332 31692 leader_election.cc:290] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:33.253482 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:33.268148 31700 raft_consensus.cc:3060] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:33.265931 31702 raft_consensus.cc:2749] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.270941 31676 raft_consensus.cc:2749] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.239411 31673 consensus_queue.cc:260] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:33.258137 31663 raft_consensus.cc:515] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:33.251096 31729 raft_consensus.cc:2749] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:33.285202 29994 leader_election.cc:304] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:33.248380 31716 consensus_queue.cc:1059] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.021s
W20260709 13:10:33.283250 30049 debug-util.cc:398] Leaking SignalData structure 0x7b08001b00a0 after lost signal to thread 29974
I20260709 13:10:33.293274 30143 leader_election.cc:304] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:33.289894 31568 raft_consensus.cc:2804] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:33.285058 30019 raft_consensus.cc:606] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 LEADER]: Received request to transfer leadership to TS c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:33.281044 31695 raft_consensus.cc:2804] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:33.285713 30095 raft_consensus.cc:2376] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 2. Re-sending same reply.
I20260709 13:10:33.276912 31715 consensus_queue.cc:1059] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 13:10:33.285272 31601 raft_consensus.cc:3060] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:33.296635 29994 leader_election.cc:304] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:33.286016 31681 raft_consensus.cc:2804] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:33.276698 31698 consensus_queue.cc:1048] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 13:10:33.297914 31702 raft_consensus.cc:2749] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.301285 31568 raft_consensus.cc:697] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:33.302112 30143 leader_election.cc:304] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:33.304736 31675 raft_consensus.cc:3060] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:33.306109 31681 raft_consensus.cc:493] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.314392 31718 raft_consensus.cc:2749] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.314909 30100 raft_consensus.cc:1275] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:10:33.325371 28889 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 13:10:33.328351 30100 pending_rounds.cc:85] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719: Aborting all ops after (but not including) 4
I20260709 13:10:33.303320 31692 raft_consensus.cc:2804] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:33.300241 31695 raft_consensus.cc:493] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:33.329658 28889 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:33.326746 31674 raft_consensus.cc:2749] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.328589 30100 pending_rounds.cc:107] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:10:33.332940 30100 raft_consensus.cc:2889] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:33.335498 30049 debug-util.cc:398] Leaking SignalData structure 0x7b0800357320 after lost signal to thread 30052
W20260709 13:10:33.336578 30049 debug-util.cc:398] Leaking SignalData structure 0x7b080035e200 after lost signal to thread 30127
W20260709 13:10:33.336858 30049 debug-util.cc:398] Leaking SignalData structure 0x7b080031be80 after lost signal to thread 30128
W20260709 13:10:33.337890 30049 debug-util.cc:398] Leaking SignalData structure 0x7b080039a2e0 after lost signal to thread 30201
I20260709 13:10:33.331676 31721 raft_consensus.cc:515] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:33.342939 31721 leader_election.cc:290] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:33.343675 30103 raft_consensus.cc:1240] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 2. Current term is 3. Ops: []
W20260709 13:10:33.345218 30143 leader_election.cc:336] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Timed out: RequestConsensusVote RPC to 127.28.54.66:43821 timed out after 1.581s (SENT)
I20260709 13:10:33.346531 30143 leader_election.cc:304] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:33.310245 31726 raft_consensus.cc:2749] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.330686 31673 raft_consensus.cc:3060] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:33.327854 31681 raft_consensus.cc:3060] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:33.379316 29993 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:33.350190 30049 debug-util.cc:398] Leaking SignalData structure 0x7b0800339e40 after lost signal to thread 30761
I20260709 13:10:33.326479 31568 consensus_queue.cc:237] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:33.359661 31579 raft_consensus.cc:2804] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:33.331521 31692 raft_consensus.cc:493] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:33.344225 31695 raft_consensus.cc:3060] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:33.387904 29994 leader_election.cc:304] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:33.397722 29994 leader_election.cc:304] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
W20260709 13:10:33.388011 30049 debug-util.cc:398] Leaking SignalData structure 0x7b0800361b80 after lost signal to thread 30762
I20260709 13:10:33.384524 31680 raft_consensus.cc:2749] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.406627 31566 raft_consensus.cc:2749] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.398384 31692 raft_consensus.cc:3060] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:33.415467 30177 raft_consensus.cc:1275] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:33.414990 31583 raft_consensus.cc:515] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:33.410804 31729 raft_consensus.cc:2804] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:10:33.422621 31731 log.cc:927] Time spent T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 13:10:33.422775 31717 consensus_queue.cc:1048] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260709 13:10:33.421813 31694 leader_election.cc:290] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:10:33.448601 30141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.445067 31689 raft_consensus.cc:515] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:33.453243 30022 raft_consensus.cc:1240] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:10:33.454223 31689 leader_election.cc:290] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:33.418720 31703 raft_consensus.cc:515] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:33.433525 31663 leader_election.cc:290] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:33.441533 30094 raft_consensus.cc:2468] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 3.
I20260709 13:10:33.451610 31729 raft_consensus.cc:697] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:33.487757 30096 raft_consensus.cc:2468] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 2.
I20260709 13:10:33.520103 31714 raft_consensus.cc:3055] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:10:33.520521 31732 log.cc:927] Time spent T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:10:33.520601 31714 raft_consensus.cc:740] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:33.490634 31717 consensus_queue.cc:1059] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 13:10:33.527339 31703 leader_election.cc:290] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:33.526810 31729 consensus_queue.cc:237] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:33.539534 31681 raft_consensus.cc:515] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:33.546160 31717 raft_consensus.cc:3055] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:33.546587 31717 raft_consensus.cc:740] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:33.547437 31717 consensus_queue.cc:260] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:33.548600 31717 raft_consensus.cc:3060] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:33.549872 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 152227us
I20260709 13:10:33.553632 29994 leader_election.cc:304] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:33.558161 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:33.557574 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
W20260709 13:10:33.567924 30141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.573199 31699 raft_consensus.cc:3055] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:33.573624 31699 raft_consensus.cc:740] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:33.554984 31714 consensus_queue.cc:260] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:33.574368 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:33.583379 29994 leader_election.cc:304] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:33.587633 31677 raft_consensus.cc:2804] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:33.595374 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:33.596086 30022 raft_consensus.cc:3060] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:33.598938 30066 leader_election.cc:304] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:33.601826 30140 leader_election.cc:304] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:33.602084 30066 leader_election.cc:304] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:33.603070 30140 leader_election.cc:304] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:33.603297 30066 leader_election.cc:304] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:33.604171 30140 leader_election.cc:304] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:33.607220 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:33.606828 31688 raft_consensus.cc:2749] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:33.618355 31681 leader_election.cc:290] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:33.618976 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:33.609880 31677 raft_consensus.cc:697] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:33.619992 31730 raft_consensus.cc:2749] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.607509 31706 raft_consensus.cc:2749] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.621850 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:33.622435 30732 raft_consensus.cc:3060] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:33.617843 30140 leader_election.cc:304] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:33.610311 31703 raft_consensus.cc:2804] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:33.627463 30022 raft_consensus.cc:2468] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 3.
I20260709 13:10:33.616257 31675 raft_consensus.cc:2749] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:33.629340 30700 leader_election.cc:304] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:33.581056 31579 raft_consensus.cc:697] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:33.620208 31677 consensus_queue.cc:237] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:33.641201 31716 raft_consensus.cc:2804] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:33.641850 31716 raft_consensus.cc:697] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:33.642048 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:33.612547 31682 raft_consensus.cc:2804] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:33.642604 30176 raft_consensus.cc:3060] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:33.642771 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 387009us
I20260709 13:10:33.623242 31705 raft_consensus.cc:2804] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:10:33.633656 30702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:33.647843 30700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.622782 31686 raft_consensus.cc:515] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:33.609860 31676 consensus_queue.cc:1048] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:10:33.628029 31681 raft_consensus.cc:2804] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:33.628994 31703 raft_consensus.cc:493] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
W20260709 13:10:33.653355 30068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.632575 31583 leader_election.cc:290] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 3 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:33.649006 31682 raft_consensus.cc:493] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:33.647646 31705 raft_consensus.cc:493] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:33.610124 31700 raft_consensus.cc:515] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:33.664269 31579 consensus_queue.cc:237] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:33.659821 31703 raft_consensus.cc:3060] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:33.667533 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:33.612763 31699 consensus_queue.cc:260] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:33.662626 31681 raft_consensus.cc:697] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [term 2 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:33.676764 31738 raft_consensus.cc:993] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4: : Instructing follower c99569d27a6f4c648eae7119fe3db124 to start an election
I20260709 13:10:33.667253 31705 raft_consensus.cc:3060] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:33.667374 31682 raft_consensus.cc:3060] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:33.658003 31695 raft_consensus.cc:515] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:10:33.680748 30068 consensus_peers.cc:597] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 -> Peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469): Couldn't send request to peer 6f3eb161e2194f6891f12e2cfcaaf73a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 18a72905c2e24e33af2e64672417cfcf. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:10:33.686614 30068 leader_election.cc:304] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:33.686887 31689 raft_consensus.cc:1081] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 LEADER]: Signalling peer c99569d27a6f4c648eae7119fe3db124 to start an election
I20260709 13:10:33.734277 30068 leader_election.cc:304] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:10:33.710696 30177 raft_consensus.cc:1240] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:33.708436 31712 raft_consensus.cc:2749] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.743690 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:33.686527 31714 raft_consensus.cc:3060] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:33.736316 31737 raft_consensus.cc:493] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:33.746363 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:33.747926 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:33.748222 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:33.749310 30097 raft_consensus.cc:1240] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 2 LEADER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:33.754000 30730 raft_consensus.cc:2410] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:33.758093 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:33.757920 31681 consensus_queue.cc:237] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:33.761085 31682 raft_consensus.cc:515] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:33.739960 31706 raft_consensus.cc:2804] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:33.766010 30177 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "80006b8186d74baba29992ade1966048"
dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
 from {username='slave'} at 127.0.0.1:43838
I20260709 13:10:33.767005 30177 raft_consensus.cc:493] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:33.767277 30177 raft_consensus.cc:3060] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:33.774071 30703 leader_election.cc:304] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:33.778952 30703 leader_election.cc:304] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:33.747435 31738 raft_consensus.cc:493] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.689582 31716 consensus_queue.cc:237] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:33.783092 30098 raft_consensus.cc:1275] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:33.783984 30703 leader_election.cc:304] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:33.771821 31706 raft_consensus.cc:493] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.761574 31692 raft_consensus.cc:515] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:33.786255 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:33.765188 30732 raft_consensus.cc:2468] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 3.
I20260709 13:10:33.788044 31601 raft_consensus.cc:2749] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:33.775070 31689 consensus_queue.cc:1059] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260709 13:10:33.762907 31737 raft_consensus.cc:515] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:33.791172 31715 raft_consensus.cc:3055] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:33.791509 31715 raft_consensus.cc:740] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:33.792309 31715 consensus_queue.cc:260] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:33.793351 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:33.775744 31717 raft_consensus.cc:493] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:33.785883 30703 leader_election.cc:304] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:33.800279 30703 leader_election.cc:304] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:33.783299 31647 raft_consensus.cc:2749] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:33.803112 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:33.803730 31601 raft_consensus.cc:2749] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:33.804255 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:33.782088 31703 raft_consensus.cc:515] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:33.808544 31703 leader_election.cc:290] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:33.809669 30100 raft_consensus.cc:2393] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 3: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:10:33.811477 31686 leader_election.cc:290] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:33.816143 30019 raft_consensus.cc:2468] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 3.
I20260709 13:10:33.827965 30094 raft_consensus.cc:1240] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:33.829104 30143 leader_election.cc:304] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:33.819078 31737 leader_election.cc:290] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:33.830145 31681 raft_consensus.cc:2749] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.820755 30174 raft_consensus.cc:1240] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:33.799430 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:33.788192 31706 raft_consensus.cc:3060] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:33.821709 31699 raft_consensus.cc:3060] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:33.794729 31738 raft_consensus.cc:515] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:33.822686 30176 raft_consensus.cc:2468] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 3.
I20260709 13:10:33.823031 31695 leader_election.cc:290] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 2 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:33.823063 30142 leader_election.cc:304] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:33.823874 30101 raft_consensus.cc:1240] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:33.823753 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:33.824648 31692 leader_election.cc:290] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 2 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:33.840065 31583 raft_consensus.cc:2804] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:33.840584 31583 raft_consensus.cc:697] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:33.834619 30143 leader_election.cc:304] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:33.834151 31715 raft_consensus.cc:3060] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:33.845384 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:33.845966 30022 raft_consensus.cc:2468] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
I20260709 13:10:33.849387 30099 raft_consensus.cc:1275] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:33.850530 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:33.851055 31688 consensus_queue.cc:1059] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:33.851991 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:33.853080 31681 raft_consensus.cc:2804] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:33.853648 31676 raft_consensus.cc:493] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.854137 31676 raft_consensus.cc:515] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:33.856024 31676 leader_election.cc:290] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:33.857874 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:33.858027 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:33.858500 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:33.858762 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:33.859073 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:33.843665 31698 raft_consensus.cc:493] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:33.860106 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:33.860359 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:33.860257 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:33.861053 30729 raft_consensus.cc:2393] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 2: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:10:33.861382 30172 raft_consensus.cc:2393] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 3: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:10:33.861948 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:33.849332 31675 raft_consensus.cc:2749] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.862828 31738 leader_election.cc:290] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:33.863716 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:33.859764 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:33.864498 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:33.869407 30068 leader_election.cc:304] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:33.869648 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:33.864516 30172 raft_consensus.cc:2468] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 2.
I20260709 13:10:33.840485 31700 leader_election.cc:290] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 3 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:33.877622 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:33.878480 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:33.879057 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:33.879963 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
W20260709 13:10:33.880993 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 46437.7us
I20260709 13:10:33.801054 31717 raft_consensus.cc:515] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:33.882583 30143 leader_election.cc:304] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:33.883380 30027 raft_consensus.cc:1240] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:33.884095 30068 leader_election.cc:304] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:33.885803 29993 leader_election.cc:304] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:33.890164 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:33.890954 30021 raft_consensus.cc:2393] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 3: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:33.891753 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:33.860231 31698 raft_consensus.cc:515] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:33.893584 30021 raft_consensus.cc:2468] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 1.
I20260709 13:10:33.894255 30020 raft_consensus.cc:1240] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:33.896579 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:33.897228 30027 raft_consensus.cc:2393] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 4: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:33.898412 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:33.899045 30019 raft_consensus.cc:1240] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 1. Current term is 2. Ops: [1.2-1.2]
I20260709 13:10:33.899343 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:33.899586 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:33.900115 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:33.900892 30028 raft_consensus.cc:1240] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:33.902001 30028 raft_consensus.cc:1240] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:33.903162 30024 raft_consensus.cc:1275] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:33.904392 30026 raft_consensus.cc:1240] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:33.905632 30700 leader_election.cc:304] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
W20260709 13:10:33.907065 30141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:33.852013 31688 raft_consensus.cc:3055] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:33.912046 30066 leader_election.cc:304] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:33.901540 30019 raft_consensus.cc:1275] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:33.866503 31681 raft_consensus.cc:697] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 3 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:33.914937 30068 leader_election.cc:304] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:33.903743 31703 raft_consensus.cc:2955] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:33.916800 29994 leader_election.cc:304] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
W20260709 13:10:33.919337 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 76141.1us
I20260709 13:10:33.921530 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:33.944607 30703 leader_election.cc:304] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:33.944691 30101 raft_consensus.cc:2468] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 2.
I20260709 13:10:33.905553 31568 raft_consensus.cc:2804] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:33.895485 31712 raft_consensus.cc:2749] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.905268 31710 raft_consensus.cc:2749] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:33.962224 30096 raft_consensus.cc:1240] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 2. Current term is 3. Ops: []
W20260709 13:10:33.960853 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 78334.1us
I20260709 13:10:33.964367 30143 leader_election.cc:304] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:33.947820 29994 leader_election.cc:304] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:33.894749 31698 leader_election.cc:290] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:33.915695 31688 raft_consensus.cc:740] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:33.914112 31726 raft_consensus.cc:2749] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:33.919435 31692 raft_consensus.cc:2749] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.896435 31695 consensus_queue.cc:1059] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 13:10:33.957996 31700 raft_consensus.cc:2804] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:33.986554 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:33.885932 31705 raft_consensus.cc:515] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:33.982741 30143 leader_election.cc:304] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:33.919744 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:33.946933 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:33.962944 31568 raft_consensus.cc:493] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:33.959518 31693 raft_consensus.cc:2749] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:33.958753 31737 raft_consensus.cc:2749] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:33.976359 31689 raft_consensus.cc:2749] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.975386 31682 leader_election.cc:290] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:33.920645 31583 consensus_queue.cc:237] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:34.002265 31681 consensus_queue.cc:237] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:34.016510 30734 raft_consensus.cc:2468] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 4.
I20260709 13:10:34.018508 30142 leader_election.cc:304] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:33.979154 29994 leader_election.cc:304] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:33.960628 30169 raft_consensus.cc:1240] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 1. Current term is 2. Ops: []
W20260709 13:10:33.995404 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 50869.8us
I20260709 13:10:33.971578 31686 raft_consensus.cc:2749] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:33.982086 31675 raft_consensus.cc:2749] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.982179 31647 raft_consensus.cc:2749] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:33.985296 31712 raft_consensus.cc:493] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:34.014976 30177 raft_consensus.cc:515] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:33.994804 31729 raft_consensus.cc:493] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:33.991423 31568 raft_consensus.cc:3060] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:34.036105 31712 raft_consensus.cc:515] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:34.041476 31675 raft_consensus.cc:2749] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:34.042286 31675 raft_consensus.cc:2804] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:34.042734 31675 raft_consensus.cc:697] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 4 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:34.027738 31705 leader_election.cc:290] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:10:34.048035 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 133166us
W20260709 13:10:34.030874 31673 consensus_meta.cc:287] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719: Time spent flushing consensus metadata: real 0.643s	user 0.010s	sys 0.000s
I20260709 13:10:33.991766 31700 raft_consensus.cc:697] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:34.028553 31746 raft_consensus.cc:2749] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:10:34.022706 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 43631.6us
I20260709 13:10:33.984202 31680 consensus_queue.cc:1059] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.038s
I20260709 13:10:34.046280 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:34.046753 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:34.054268 30735 raft_consensus.cc:3060] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:34.054579 31680 raft_consensus.cc:3055] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:34.054958 31680 raft_consensus.cc:740] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:34.055401 31712 leader_election.cc:290] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:34.043550 31675 consensus_queue.cc:237] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:34.055719 31680 consensus_queue.cc:260] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:34.056865 31680 raft_consensus.cc:3060] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:34.060470 30168 raft_consensus.cc:1275] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:10:34.026305 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 43644.3us
I20260709 13:10:34.029665 31695 consensus_queue.cc:1243] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer 5ec73dc157ed476ca903a7d596271719 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:10:34.046697 30177 leader_election.cc:290] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:34.026456 30703 leader_election.cc:304] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:34.049105 30068 leader_election.cc:304] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
W20260709 13:10:34.050192 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 72517.6us
W20260709 13:10:34.051192 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 111786us
I20260709 13:10:34.066424 29994 leader_election.cc:304] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:34.064271 31692 consensus_queue.cc:1059] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:10:34.067924 31705 consensus_queue.cc:1059] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:34.068656 31705 consensus_queue.cc:1243] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer b2cea0098c1040f69755ea4d3dab7fc4 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:10:34.069340 31705 raft_consensus.cc:3055] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:34.069409 31700 consensus_queue.cc:237] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:34.069789 31675 consensus_queue.cc:1048] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:34.072697 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 46319.7us
I20260709 13:10:34.077355 30703 leader_election.cc:304] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:34.078293 30143 leader_election.cc:304] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:34.078632 30066 leader_election.cc:304] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:34.079031 31743 raft_consensus.cc:2804] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:34.078652 30735 raft_consensus.cc:2468] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 3.
I20260709 13:10:34.082804 30175 raft_consensus.cc:1240] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:34.083155 31743 raft_consensus.cc:697] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
W20260709 13:10:34.097467 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 48449.6us
I20260709 13:10:34.098264 30068 leader_election.cc:304] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:34.086035 30142 leader_election.cc:304] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:34.099195 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:34.100023 31761 consensus_queue.cc:1048] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 13:10:34.100449 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:34.050910 31706 raft_consensus.cc:515] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:34.101027 30019 raft_consensus.cc:3055] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:34.101343 30019 raft_consensus.cc:740] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:34.102670 31760 raft_consensus.cc:2749] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:34.080488 31695 consensus_queue.cc:1059] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 13:10:34.111543 30068 leader_election.cc:304] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:34.103102 31706 leader_election.cc:290] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:34.104944 30097 raft_consensus.cc:1240] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:34.079509 31756 raft_consensus.cc:2749] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:34.104854 31743 consensus_queue.cc:237] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:34.107151 30103 raft_consensus.cc:2468] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 2.
I20260709 13:10:34.107815 30703 leader_election.cc:304] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:34.113583 30068 leader_election.cc:304] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:34.072650 31705 raft_consensus.cc:740] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:34.115470 30140 leader_election.cc:304] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:34.049666 31729 raft_consensus.cc:515] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:34.079588 30095 raft_consensus.cc:1240] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 2. Current term is 3. Ops: []
W20260709 13:10:34.158977 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 61313us
I20260709 13:10:34.111382 31677 raft_consensus.cc:2804] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:34.144994 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:34.145296 31764 raft_consensus.cc:2749] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:34.145148 31758 consensus_queue.cc:1048] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:34.087149 31689 consensus_queue.cc:1048] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.059s
I20260709 13:10:34.145645 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:34.111990 31717 leader_election.cc:290] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:34.083310 31676 raft_consensus.cc:493] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.147086 29993 leader_election.cc:304] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:34.180719 31676 raft_consensus.cc:515] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:34.083065 31647 raft_consensus.cc:2749] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:34.182732 31676 leader_election.cc:290] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:34.183208 31676 raft_consensus.cc:2749] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:34.185678 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:34.147667 31705 consensus_queue.cc:260] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:34.150882 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:34.151938 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:34.152223 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:34.154055 31716 raft_consensus.cc:2804] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:34.141072 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:34.144477 30068 leader_election.cc:304] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:34.144276 30168 raft_consensus.cc:1240] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:34.140245 31756 raft_consensus.cc:2749] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:10:34.202883 31749 log.cc:927] Time spent T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.166s	user 0.003s	sys 0.000s
I20260709 13:10:34.139907 31712 raft_consensus.cc:2749] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:34.118872 31693 raft_consensus.cc:2749] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:34.122721 31543 consensus_queue.cc:1059] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 13:10:34.179193 30021 raft_consensus.cc:3060] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:34.118870 30019 consensus_queue.cc:260] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:34.163556 31677 raft_consensus.cc:493] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.118940 31736 consensus_queue.cc:1059] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.077s
I20260709 13:10:34.202579 30729 raft_consensus.cc:2368] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 2. Current term is 3.
I20260709 13:10:34.144992 31726 consensus_queue.cc:1059] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260709 13:10:34.163203 31757 consensus_queue.cc:1059] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.041s
I20260709 13:10:34.212263 30094 raft_consensus.cc:1275] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:34.193881 31716 raft_consensus.cc:493] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:34.194157 30730 raft_consensus.cc:2468] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 1.
I20260709 13:10:34.206893 31762 consensus_queue.cc:1059] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.003s
I20260709 13:10:34.218415 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:34.230311 30101 raft_consensus.cc:2468] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 2.
I20260709 13:10:34.221730 30019 raft_consensus.cc:3060] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:34.235651 31680 raft_consensus.cc:2804] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:34.236174 31680 raft_consensus.cc:697] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 3 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:34.225585 31736 raft_consensus.cc:3055] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:34.220122 31677 raft_consensus.cc:3060] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:34.229212 31716 raft_consensus.cc:3060] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:34.243993 31736 raft_consensus.cc:740] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:34.245534 30732 raft_consensus.cc:2410] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:10:34.250125 31729 leader_election.cc:290] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:34.262339 30730 raft_consensus.cc:1240] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:34.262882 30174 raft_consensus.cc:3055] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:34.263259 30174 raft_consensus.cc:740] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:34.263921 29993 leader_election.cc:400] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469) with higher term. Message: Invalid argument: T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 2. Current term is 3.
I20260709 13:10:34.264322 29993 leader_election.cc:403] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:34.270018 31692 raft_consensus.cc:2749] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:34.281342 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:34.282218 29924 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51818 (request call id 319) took 1608 ms. Trace:
I20260709 13:10:34.282856 30021 raft_consensus.cc:2468] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 3.
I20260709 13:10:34.284163 31729 raft_consensus.cc:3060] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:10:34.260960 31680 consensus_queue.cc:237] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:34.282583 29924 rpcz_store.cc:276] 0709 13:10:32.665683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.665840 (+   157us) service_pool.cc:224] Handling call
0709 13:10:34.273744 (+1607904us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:33.196497 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:33.197025 (+   528us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:33.197057 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:10:33.197070 (+    13us) tablet.cc:662] Decoding operations
0709 13:10:33.197521 (+   451us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:33.197567 (+    46us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:33.197592 (+    25us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:10:33.201695 (+  4103us) tablet.cc:701] Row locks acquired
0709 13:10:33.203627 (+  1932us) write_op.cc:260] PREPARE: finished
0709 13:10:33.211313 (+  7686us) write_op.cc:270] Start()
0709 13:10:33.215627 (+  4314us) write_op.cc:276] Timestamp: P: 1783602633208915 usec, L: 0
0709 13:10:33.216067 (+   440us) op_driver.cc:348] REPLICATION: starting
0709 13:10:33.278017 (+ 61950us) log.cc:844] Serialized 533 byte log entry
0709 13:10:33.810159 (+532142us) op_driver.cc:464] REPLICATION: finished
0709 13:10:33.988190 (+178031us) write_op.cc:301] APPLY: starting
0709 13:10:33.994800 (+  6610us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:34.010334 (+ 15534us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:34.010459 (+   125us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:34.010665 (+   206us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:34.010809 (+   144us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:10:34.010857 (+    48us) write_op.cc:312] APPLY: finished
0709 13:10:34.030032 (+ 19175us) log.cc:844] Serialized 23 byte log entry
0709 13:10:34.049581 (+ 19549us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:34.052490 (+  2909us) write_op.cc:454] Released schema lock
0709 13:10:34.063322 (+ 10832us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:34.079311 (+ 15989us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:34.079349 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":161203,"apply.run_cpu_time_us":2080,"apply.run_wall_time_us":97253,"num_ops":1,"prepare.queue_time_us":236096,"prepare.run_cpu_time_us":68164,"prepare.run_wall_time_us":273914,"raft.queue_time_us":215094,"raft.run_cpu_time_us":9479,"raft.run_wall_time_us":106263,"replication_time_us":593954,"thread_start_us":595164,"threads_started":4,"wal-append.queue_time_us":280859}]]}
I20260709 13:10:34.263984 30174 consensus_queue.cc:260] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:34.290094 30174 raft_consensus.cc:3060] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:34.273584 30019 raft_consensus.cc:2468] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 3.
I20260709 13:10:34.299868 31688 consensus_queue.cc:260] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:34.300201 31736 consensus_queue.cc:260] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:34.301236 31688 raft_consensus.cc:3060] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:34.301486 31736 raft_consensus.cc:3060] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:34.307611 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:34.308235 30098 raft_consensus.cc:2468] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 2.
I20260709 13:10:34.243885 31699 consensus_queue.cc:1059] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 13:10:34.288700 31568 raft_consensus.cc:515] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:34.317255 30025 raft_consensus.cc:2368] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 2. Current term is 3.
I20260709 13:10:34.319862 31568 leader_election.cc:290] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:34.325786 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:34.326538 30168 raft_consensus.cc:3060] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:34.333161 30177 raft_consensus.cc:3060] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:34.334337 31705 raft_consensus.cc:3060] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:34.337728 29994 leader_election.cc:304] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:34.321378 30020 raft_consensus.cc:2468] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 2.
I20260709 13:10:34.341472 30172 raft_consensus.cc:1275] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:34.357113 30177 raft_consensus.cc:1275] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:34.359180 31739 consensus_queue.cc:1048] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:34.269454 31716 raft_consensus.cc:515] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:34.372274 31716 leader_election.cc:290] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:34.372792 31677 raft_consensus.cc:515] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:34.373394 31729 raft_consensus.cc:2749] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469) with higher term. Message: Invalid argument: T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 2. Current term is 3.
I20260709 13:10:34.374938 31677 leader_election.cc:290] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:34.375746 30174 raft_consensus.cc:1275] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:10:34.376278 31682 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:10:34.385083 30169 raft_consensus.cc:1275] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:34.358533 31568 raft_consensus.cc:2804] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:34.386355 31568 raft_consensus.cc:493] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.386682 31568 raft_consensus.cc:3060] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:34.396355 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 251938us
I20260709 13:10:34.397107 30068 leader_election.cc:304] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:34.398317 31686 raft_consensus.cc:2749] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:34.398486 31579 consensus_queue.cc:1048] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:34.398962 31686 raft_consensus.cc:2749] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:34.399117 30068 leader_election.cc:304] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:34.399997 31726 raft_consensus.cc:2749] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:34.400291 30068 leader_election.cc:304] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:34.401391 30068 leader_election.cc:304] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:34.396513 29994 leader_election.cc:304] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:34.406741 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:34.407639 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:34.409451 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:34.409941 30103 raft_consensus.cc:3060] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:34.410797 30099 raft_consensus.cc:1240] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:34.414943 30096 raft_consensus.cc:1275] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:34.419405 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:34.419979 30737 raft_consensus.cc:3060] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:34.419350 30068 leader_election.cc:304] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:34.419284 30103 raft_consensus.cc:2468] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 3.
I20260709 13:10:34.422036 30102 raft_consensus.cc:1275] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:34.422973 31730 raft_consensus.cc:3055] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:34.423339 30101 raft_consensus.cc:1275] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:34.428200 29994 leader_election.cc:304] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
W20260709 13:10:34.436631 29993 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.438618 30098 raft_consensus.cc:1275] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:34.405682 31685 raft_consensus.cc:2749] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:34.445533 29924 catalog_manager.cc:5697] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 1 to 2, leader changed from c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 2 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:34.447625 29924 catalog_manager.cc:5697] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 1 to 2, leader changed from c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 2 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:34.411350 31693 raft_consensus.cc:3060] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:34.454069 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 177599us
I20260709 13:10:34.449038 29924 catalog_manager.cc:5697] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 2 to 3, leader changed from c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 3 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:34.455710 30700 leader_election.cc:400] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 pre-election: Vote denied by peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451) with higher term. Message: Invalid argument: T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 2. Current term is 3.
I20260709 13:10:34.456360 30700 leader_election.cc:403] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:34.424849 30068 leader_election.cc:304] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:34.418634 31677 raft_consensus.cc:2804] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:34.460050 29924 catalog_manager.cc:5697] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 2 to 3, leader changed from 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 3 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:34.424041 31718 raft_consensus.cc:3055] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:34.464821 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:34.468577 30735 raft_consensus.cc:2468] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 2.
I20260709 13:10:34.423345 31730 raft_consensus.cc:740] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:34.417917 31566 consensus_queue.cc:1048] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
W20260709 13:10:34.471725 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 46949.9us
I20260709 13:10:34.418064 31715 consensus_queue.cc:1048] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:10:34.443574 31758 raft_consensus.cc:2749] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:34.462463 31702 raft_consensus.cc:2804] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:34.463393 31677 raft_consensus.cc:493] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.482651 30068 leader_election.cc:304] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:34.462141 30168 raft_consensus.cc:2468] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 3.
I20260709 13:10:34.467686 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:34.468371 31718 raft_consensus.cc:740] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:34.462416 31729 consensus_queue.cc:1048] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:10:34.480223 31756 raft_consensus.cc:2749] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:34.494032 29921 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51828 (request call id 306) took 1788 ms. Trace:
I20260709 13:10:34.485600 31677 raft_consensus.cc:3060] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:34.443333 31746 consensus_queue.cc:1048] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.039s
I20260709 13:10:34.498571 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:34.490062 31685 raft_consensus.cc:2749] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:34.488502 31708 consensus_queue.cc:1048] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 13:10:34.495263 29921 rpcz_store.cc:276] 0709 13:10:32.666680 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:32.666806 (+   126us) service_pool.cc:224] Handling call
0709 13:10:34.454679 (+1787873us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":105723,"reported_tablets":3}
I20260709 13:10:34.494197 31601 raft_consensus.cc:3060] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:10:34.480413 31689 consensus_queue.cc:1059] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.016s
I20260709 13:10:34.499147 29993 leader_election.cc:304] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:34.490345 31703 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:48548 (request call id 13) took 4360 ms. Trace:
I20260709 13:10:34.488468 31702 raft_consensus.cc:697] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:34.510901 30737 raft_consensus.cc:2468] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 3.
I20260709 13:10:34.500067 31724 consensus_queue.cc:1048] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:10:34.514113 30068 leader_election.cc:304] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:10:34.500857 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:34.505309 31697 consensus_queue.cc:1048] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 13:10:34.505263 31703 rpcz_store.cc:276] 0709 13:10:30.120385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:30.121186 (+   801us) service_pool.cc:224] Handling call
0709 13:10:30.162932 (+ 41746us) log.cc:844] Serialized 499 byte log entry
0709 13:10:30.336143 (+173211us) spinlock_profiling.cc:243] Waited 5.16 ms on lock 0x7b1800051940. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f7e95de1 00007f99f7ea25b1 00007f99eef9b2a6 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f203ab26 00007f99f203449a 00007f99f2033714
0709 13:10:30.400902 (+ 64759us) spinlock_profiling.cc:243] Waited 2.38 ms on lock 0x7b5400273e20. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f203ab26 00007f99f203449a 00007f99f2033714 00007f99f2013eaa 00007f99f201ad53 00007f99f201acd9 00007f99f201ac69 00007f99f201ac31 00007f99f2019dfd 000000000038f354
0709 13:10:30.413688 (+ 12786us) spinlock_profiling.cc:243] Waited 1.18 ms on lock 0x7b5400273e20. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f2033142 00007f99f2013eaa 00007f99f201ad53 00007f99f201acd9 00007f99f201ac69 00007f99f201ac31 00007f99f2019dfd 000000000038f354 000000000038f199 00007f99eefcd475
0709 13:10:30.453716 (+ 40028us) spinlock_profiling.cc:243] Waited 4.75 ms on lock 0x7b5400273e20. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f2033142 00007f99f2013eaa 00007f99f201ad53 00007f99f201acd9 00007f99f201ac69 00007f99f201ac31 00007f99f2019dfd 000000000038f354 000000000038f199 00007f99eefcd475
0709 13:10:34.480460 (+4026744us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4438,"raft.queue_time_us":7026,"raft.run_cpu_time_us":26097,"raft.run_wall_time_us":571588,"spinlock_wait_cycles":30985344,"thread_start_us":72083,"threads_started":1,"wal-append.queue_time_us":110939,"wal-append.run_cpu_time_us":2224,"wal-append.run_wall_time_us":1003022}
I20260709 13:10:34.522318 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:34.526469 31756 raft_consensus.cc:2804] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:34.517637 31736 raft_consensus.cc:2804] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:34.512584 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:34.530663 31756 raft_consensus.cc:697] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 3 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
W20260709 13:10:34.222268 31738 consensus_queue.cc:1175] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c99569d27a6f4c648eae7119fe3db124" responder_term: 3 status { last_received { term: 2 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:10:34.527204 31739 raft_consensus.cc:493] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
W20260709 13:10:34.545262 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 429861us
I20260709 13:10:34.522675 31716 raft_consensus.cc:493] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:34.530720 31736 raft_consensus.cc:697] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:34.529510 31685 raft_consensus.cc:493] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.564333 30140 leader_election.cc:304] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
W20260709 13:10:34.559734 30142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 473751us
W20260709 13:10:34.568240 30143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:34.555089 30068 leader_election.cc:304] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:34.623148 30095 raft_consensus.cc:1240] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:34.585309 31695 raft_consensus.cc:493] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.586073 31758 raft_consensus.cc:2749] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:34.505708 31730 consensus_queue.cc:260] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:34.643170 30172 raft_consensus.cc:1275] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:34.624198 31681 raft_consensus.cc:2804] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:34.625643 31689 raft_consensus.cc:493] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.521652 31702 consensus_queue.cc:237] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:34.561919 31716 raft_consensus.cc:515] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:34.553099 31739 raft_consensus.cc:515] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:34.533803 31718 consensus_queue.cc:260] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:34.589512 31685 raft_consensus.cc:515] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:34.663662 30172 raft_consensus.cc:1275] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:34.664073 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:34.665125 30143 leader_election.cc:304] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:34.623790 31726 consensus_queue.cc:1048] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:10:34.667235 30177 raft_consensus.cc:2368] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 2. Current term is 3.
I20260709 13:10:34.647145 31771 raft_consensus.cc:493] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.666273 31730 raft_consensus.cc:3060] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:34.662473 31681 raft_consensus.cc:697] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 2 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:34.777983 31697 consensus_queue.cc:1048] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:10:34.784938 31773 raft_consensus.cc:2749] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:34.784786 31714 consensus_queue.cc:1048] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:10:34.666625 31579 consensus_queue.cc:1175] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c99569d27a6f4c648eae7119fe3db124" responder_term: 2 status { last_received { term: 2 index: 2 } last_committed_idx: 2 last_received_current_leader { term: 2 index: 2 } }
I20260709 13:10:34.652657 31695 raft_consensus.cc:515] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:34.554888 31756 consensus_queue.cc:237] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:34.662497 31689 raft_consensus.cc:515] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:34.799574 30024 raft_consensus.cc:1275] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:34.661720 31736 consensus_queue.cc:237] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:34.778426 31680 consensus_queue.cc:1059] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:10:34.820096 30026 raft_consensus.cc:1240] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 1. Current term is 2. Ops: [1.2-1.2]
I20260709 13:10:34.817327 31568 raft_consensus.cc:515] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:34.790098 31771 raft_consensus.cc:515] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:34.878793 30025 raft_consensus.cc:1240] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:10:34.858450 31766 log.cc:927] Time spent T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260709 13:10:34.886554 31770 raft_consensus.cc:493] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.889145 31770 raft_consensus.cc:515] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:34.857934 30097 raft_consensus.cc:2468] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 2.
I20260709 13:10:34.779392 30174 raft_consensus.cc:2955] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:34.895507 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:34.896210 30176 raft_consensus.cc:2468] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 3.
I20260709 13:10:34.900027 30068 leader_election.cc:304] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:34.847481 31681 consensus_queue.cc:237] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:34.894757 31685 leader_election.cc:290] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:10:34.901836 31583 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.014s	sys 0.041s
I20260709 13:10:34.894618 31716 leader_election.cc:290] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:10:34.927239 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 425646us
W20260709 13:10:34.931610 31700 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.008s	sys 0.037s
I20260709 13:10:34.893675 31739 leader_election.cc:290] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:34.905879 31710 raft_consensus.cc:3055] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:34.905591 31726 raft_consensus.cc:2804] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:10:34.929205 31583 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.015s	sys 0.041s
I20260709 13:10:34.939478 31699 raft_consensus.cc:3055] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:34.936362 31768 raft_consensus.cc:493] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:34.943264 31767 log.cc:927] Time spent T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
I20260709 13:10:34.978688 31768 raft_consensus.cc:515] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:34.980141 31729 raft_consensus.cc:493] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:34.937120 31695 leader_election.cc:290] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:34.980652 31729 raft_consensus.cc:515] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:34.953122 31601 raft_consensus.cc:2749] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451) with higher term. Message: Invalid argument: T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 2. Current term is 3.
I20260709 13:10:34.981860 31768 leader_election.cc:290] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:34.982651 31729 leader_election.cc:290] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:34.949019 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:34.955947 31703 raft_consensus.cc:3055] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:34.963433 31771 leader_election.cc:290] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:34.966993 31761 raft_consensus.cc:3055] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:34.994135 31761 raft_consensus.cc:740] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
W20260709 13:10:34.967805 31693 consensus_meta.cc:287] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719: Time spent flushing consensus metadata: real 0.505s	user 0.000s	sys 0.007s
I20260709 13:10:34.994968 31693 raft_consensus.cc:2749] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:34.965507 31718 raft_consensus.cc:3060] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:34.931970 31700 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.008s	sys 0.037s
I20260709 13:10:34.953397 31677 raft_consensus.cc:515] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:34.983914 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:34.996956 30171 raft_consensus.cc:2468] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
I20260709 13:10:34.956234 31568 leader_election.cc:290] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:34.980940 31770 leader_election.cc:290] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:35.000931 31677 leader_election.cc:290] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:35.001704 30020 raft_consensus.cc:2368] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 2. Current term is 3.
I20260709 13:10:34.957340 31726 raft_consensus.cc:493] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:34.938778 31710 raft_consensus.cc:740] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:35.018069 31726 raft_consensus.cc:3060] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:35.000028 30068 leader_election.cc:304] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:34.977727 31699 raft_consensus.cc:740] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:34.991686 30097 raft_consensus.cc:1240] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:34.995998 31703 raft_consensus.cc:740] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:35.029644 31706 raft_consensus.cc:2804] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:10:35.039948 30700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:35.049890 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:35.050617 30102 raft_consensus.cc:2393] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 2: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
W20260709 13:10:35.047204 30733 thread.cc:641] tablet-copy [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.006s	sys 0.011s
I20260709 13:10:35.018643 31710 consensus_queue.cc:260] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:35.048884 31706 raft_consensus.cc:493] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:35.083317 31703 consensus_queue.cc:260] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:35.090065 31703 raft_consensus.cc:3060] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:35.096253 30700 leader_election.cc:400] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 election: Vote denied by peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451) with higher term. Message: Invalid argument: T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 2. Current term is 3.
I20260709 13:10:35.096617 30700 leader_election.cc:403] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:10:35.103353 31706 raft_consensus.cc:3060] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:35.095561 30733 thread.cc:608] tablet-copy [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.007s	sys 0.012s
I20260709 13:10:35.086639 30021 raft_consensus.cc:1275] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:35.110126 31601 raft_consensus.cc:3060] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:35.121282 31774 log.cc:927] Time spent T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.451s	user 0.000s	sys 0.002s
I20260709 13:10:35.122541 31721 raft_consensus.cc:493] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:35.124781 31721 raft_consensus.cc:515] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:35.132578 31721 leader_election.cc:290] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:35.132392 31706 raft_consensus.cc:515] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:35.135300 31706 leader_election.cc:290] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:35.140429 30728 raft_consensus.cc:2468] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 3.
W20260709 13:10:35.150447 30066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:35.123907 31583 consensus_queue.cc:1048] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 13:10:35.114291 31699 consensus_queue.cc:260] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:35.158882 30021 raft_consensus.cc:1275] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 13:10:35.160565 29974 auto_rebalancer.cc:629] Failed to schedule move for tablet 56168b79f56f4dee859bee3ef7df4712: Illegal state: Replica b2cea0098c1040f69755ea4d3dab7fc4 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } }
W20260709 13:10:35.166335 31776 log.cc:927] Time spent T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.253s	user 0.000s	sys 0.001s
I20260709 13:10:35.166262 31543 consensus_queue.cc:1048] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:35.157717 31699 raft_consensus.cc:3060] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:35.170722 30702 leader_election.cc:400] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 pre-election: Vote denied by peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001) with higher term. Message: Invalid argument: T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 2. Current term is 3.
I20260709 13:10:35.174434 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:35.175165 30176 raft_consensus.cc:2393] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 4: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:10:35.178149 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:35.178758 30176 raft_consensus.cc:2468] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 3.
W20260709 13:10:35.179380 29993 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:35.188411 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:35.189088 30177 raft_consensus.cc:2468] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 2.
I20260709 13:10:35.174126 31695 raft_consensus.cc:493] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.187325 29993 leader_election.cc:304] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:35.184518 31721 raft_consensus.cc:493] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:35.202436 31786 log.cc:927] Time spent T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:10:35.192322 31759 raft_consensus.cc:493] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.197854 31579 raft_consensus.cc:2804] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:35.193101 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
W20260709 13:10:35.225957 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 560865us
I20260709 13:10:35.215225 31579 raft_consensus.cc:493] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:35.196933 31695 raft_consensus.cc:515] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:35.205164 31721 raft_consensus.cc:515] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:35.228736 30098 raft_consensus.cc:1240] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:35.232297 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:35.232851 30176 raft_consensus.cc:3060] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:35.233822 31579 raft_consensus.cc:3060] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:35.220120 31703 raft_consensus.cc:493] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.223658 30728 raft_consensus.cc:1275] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:35.235581 31689 leader_election.cc:290] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:35.242699 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:35.243036 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:35.253685 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:35.254434 30172 raft_consensus.cc:2468] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 3.
I20260709 13:10:35.243839 31797 ts_tablet_manager.cc:933] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a: Initiating tablet copy from peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:35.240285 31768 raft_consensus.cc:493] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:35.242375 31718 raft_consensus.cc:493] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.220949 31759 raft_consensus.cc:515] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:35.251775 31695 leader_election.cc:290] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:35.254349 31601 raft_consensus.cc:2749] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451) with higher term. Message: Invalid argument: T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 2. Current term is 3.
I20260709 13:10:35.241585 31703 raft_consensus.cc:515] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:35.283711 30176 raft_consensus.cc:2468] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 3.
I20260709 13:10:35.260541 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:35.285691 29993 leader_election.cc:304] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
W20260709 13:10:35.296023 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 103792us
I20260709 13:10:35.298919 30702 leader_election.cc:304] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:10:35.286252 31702 raft_consensus.cc:493] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.285243 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
W20260709 13:10:35.295526 31698 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.020s	sys 0.006s
I20260709 13:10:35.294615 30019 raft_consensus.cc:1240] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:35.272217 31718 raft_consensus.cc:515] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:35.290953 31790 raft_consensus.cc:2804] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:35.273836 31768 raft_consensus.cc:515] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:35.336612 30735 raft_consensus.cc:2468] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 4.
I20260709 13:10:35.338251 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:35.339547 30103 raft_consensus.cc:2468] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 3.
I20260709 13:10:35.341684 30103 raft_consensus.cc:1240] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:35.343294 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
W20260709 13:10:35.312788 31698 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.021s	sys 0.007s
I20260709 13:10:35.350086 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:35.349409 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:35.350744 30100 raft_consensus.cc:3060] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:35.351653 30103 raft_consensus.cc:2468] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 3.
I20260709 13:10:35.314077 31772 raft_consensus.cc:493] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.348115 31756 raft_consensus.cc:493] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.335804 31790 raft_consensus.cc:493] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:35.312098 31806 raft_consensus.cc:2804] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:35.317574 31702 raft_consensus.cc:515] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:35.371527 31676 raft_consensus.cc:493] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.370790 31685 raft_consensus.cc:493] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.345724 31762 consensus_queue.cc:1048] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260709 13:10:35.390041 31676 raft_consensus.cc:515] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:35.392189 31676 leader_election.cc:290] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:35.392618 31676 raft_consensus.cc:493] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:35.393061 31676 raft_consensus.cc:515] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:35.380087 31772 raft_consensus.cc:515] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:35.395076 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:35.378868 31789 raft_consensus.cc:493] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.379282 31568 raft_consensus.cc:493] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.384337 31729 raft_consensus.cc:493] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.404410 30100 raft_consensus.cc:2468] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 3.
I20260709 13:10:35.383095 31681 raft_consensus.cc:493] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:35.383194 31790 raft_consensus.cc:3060] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:35.387373 31721 leader_election.cc:290] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:35.389848 31718 leader_election.cc:290] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:35.382992 31806 raft_consensus.cc:493] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:35.383556 31756 raft_consensus.cc:515] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:35.418637 31730 raft_consensus.cc:493] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.393819 31685 raft_consensus.cc:515] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:35.451807 31810 consensus_queue.cc:1059] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.080s
I20260709 13:10:35.438396 31721 raft_consensus.cc:493] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.438640 31806 raft_consensus.cc:3060] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:35.414475 31568 raft_consensus.cc:515] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:35.417879 31729 raft_consensus.cc:515] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:35.449482 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:35.422065 31681 raft_consensus.cc:515] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:35.454734 31759 leader_election.cc:290] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:35.465166 31693 raft_consensus.cc:493] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:35.452893 31703 leader_election.cc:290] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:35.443010 31789 raft_consensus.cc:515] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:35.457290 31730 raft_consensus.cc:515] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:35.473925 31693 raft_consensus.cc:515] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:35.506943 31702 leader_election.cc:290] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:35.507181 31681 leader_election.cc:290] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:35.508512 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:35.508919 31730 leader_election.cc:290] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:35.462815 31721 raft_consensus.cc:515] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:35.471966 30174 raft_consensus.cc:2468] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 4.
I20260709 13:10:35.515738 31718 raft_consensus.cc:493] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.519065 30169 raft_consensus.cc:2468] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 3.
I20260709 13:10:35.520578 31693 leader_election.cc:290] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:35.520922 31768 leader_election.cc:290] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:35.521606 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:35.526348 29993 leader_election.cc:304] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:35.534976 31756 leader_election.cc:290] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:10:35.535473 31799 log.cc:927] Time spent T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.120s	user 0.003s	sys 0.000s
I20260709 13:10:35.536039 31730 raft_consensus.cc:2804] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:35.536427 31730 raft_consensus.cc:493] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:35.537711 30177 raft_consensus.cc:2468] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 2.
I20260709 13:10:35.525959 31583 consensus_queue.cc:1059] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:10:35.590339 31568 leader_election.cc:290] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:10:35.583010 29994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:35.576519 31809 log.cc:927] Time spent T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:10:35.598886 30702 leader_election.cc:304] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:35.537279 31676 leader_election.cc:290] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:35.527366 31718 raft_consensus.cc:515] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:35.552140 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:35.592109 31689 raft_consensus.cc:493] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:35.603514 30702 leader_election.cc:304] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:35.550971 31789 leader_election.cc:290] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:35.545809 31730 raft_consensus.cc:3060] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:35.684849 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:10:35.686367 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 87717.6us
I20260709 13:10:35.714570 30177 raft_consensus.cc:2468] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 3.
I20260709 13:10:35.590587 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:35.548911 31768 raft_consensus.cc:493] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.716691 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:35.719638 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:35.722781 30177 raft_consensus.cc:2468] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 3.
I20260709 13:10:35.727452 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:35.728066 30026 raft_consensus.cc:2468] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 3.
I20260709 13:10:35.729378 30019 raft_consensus.cc:1275] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:35.729781 30022 raft_consensus.cc:1275] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:35.730089 30026 raft_consensus.cc:1275] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:10:35.730687 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:35.731377 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:35.732182 30020 raft_consensus.cc:2393] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 3: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:35.734642 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:35.735214 30026 raft_consensus.cc:2468] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 3.
I20260709 13:10:35.713182 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:35.728117 30728 raft_consensus.cc:2468] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 3.
I20260709 13:10:35.748899 31718 leader_election.cc:290] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:35.761200 31718 raft_consensus.cc:2804] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:35.761555 31718 raft_consensus.cc:493] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:35.761883 31718 raft_consensus.cc:3060] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:35.763203 30140 leader_election.cc:304] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:35.764056 31773 raft_consensus.cc:2804] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:35.764410 31773 raft_consensus.cc:493] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:35.764709 31773 raft_consensus.cc:3060] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:35.714524 31689 raft_consensus.cc:515] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:35.751834 31806 raft_consensus.cc:515] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:35.753268 31726 consensus_meta.cc:287] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719: Time spent flushing consensus metadata: real 0.735s	user 0.009s	sys 0.000s
I20260709 13:10:35.746711 31717 raft_consensus.cc:2804] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:35.778044 31726 raft_consensus.cc:515] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:35.777629 31695 consensus_queue.cc:1048] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:35.757079 31721 leader_election.cc:290] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:35.688041 31772 leader_election.cc:290] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:35.766337 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:35.774832 30140 leader_election.cc:304] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:35.778407 31717 raft_consensus.cc:493] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:35.784807 31579 consensus_meta.cc:287] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4: Time spent flushing consensus metadata: real 0.550s	user 0.009s	sys 0.001s
I20260709 13:10:35.785372 31717 raft_consensus.cc:3060] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:35.728485 31699 consensus_meta.cc:287] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent flushing consensus metadata: real 0.559s	user 0.006s	sys 0.004s
I20260709 13:10:35.781447 30022 raft_consensus.cc:2468] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 3.
I20260709 13:10:35.777585 31762 consensus_queue.cc:1048] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:10:35.777733 31810 consensus_queue.cc:1048] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:10:35.795185 30140 leader_election.cc:304] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:35.823016 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:35.824681 30022 raft_consensus.cc:1240] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:10:35.826392 31726 leader_election.cc:290] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:35.837314 30734 raft_consensus.cc:2468] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 2.
I20260709 13:10:35.779790 30169 raft_consensus.cc:2468] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 2.
I20260709 13:10:35.836437 31790 raft_consensus.cc:515] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:35.743146 31768 raft_consensus.cc:515] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:35.780946 30733 raft_consensus.cc:2468] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 3.
I20260709 13:10:35.792373 31717 raft_consensus.cc:515] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:35.855438 30066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:35.856012 30066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:35.849926 31739 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.006s	sys 0.024s
W20260709 13:10:35.858919 31739 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.623s	user 0.006s	sys 0.024s
W20260709 13:10:35.865688 30176 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.032s	sys 0.085s
W20260709 13:10:35.866050 30176 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.032s	sys 0.086s
I20260709 13:10:35.840015 31680 raft_consensus.cc:2804] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:35.843917 31760 raft_consensus.cc:2804] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:35.837632 31729 leader_election.cc:290] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:35.785202 31579 raft_consensus.cc:515] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:35.897385 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:35.898700 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:35.840296 31762 consensus_queue.cc:1059] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:10:35.902084 30103 raft_consensus.cc:2393] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 5: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:10:35.903023 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:35.904481 30102 raft_consensus.cc:2468] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 3.
W20260709 13:10:35.901217 31706 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.032s	sys 0.087s
W20260709 13:10:35.920652 31706 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.032s	sys 0.088s
I20260709 13:10:35.869745 31680 raft_consensus.cc:493] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:35.930634 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:35.931511 30101 raft_consensus.cc:2393] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 3: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:10:35.890936 31764 raft_consensus.cc:493] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.931787 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:35.891525 31685 leader_election.cc:290] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:10:35.952021 31791 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.041s	sys 0.058s
W20260709 13:10:35.952452 31791 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.041s	sys 0.058s
I20260709 13:10:35.921933 31729 raft_consensus.cc:493] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.932355 31680 raft_consensus.cc:3060] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:35.983831 31693 raft_consensus.cc:493] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:35.984406 31693 raft_consensus.cc:515] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:35.986536 31693 leader_election.cc:290] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:35.986979 31756 raft_consensus.cc:493] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:35.987500 31756 raft_consensus.cc:515] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:35.992136 31762 raft_consensus.cc:493] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:35.992729 31762 raft_consensus.cc:515] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:35.997611 31768 leader_election.cc:290] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:35.998632 31762 leader_election.cc:290] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:35.999785 31717 leader_election.cc:290] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:36.001108 29994 leader_election.cc:304] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:36.002736 29994 leader_election.cc:304] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:35.993592 30021 raft_consensus.cc:2393] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 4: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:35.983006 31698 raft_consensus.cc:493] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:36.021605 31705 raft_consensus.cc:493] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:36.021780 31601 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.018s	sys 0.029s
W20260709 13:10:36.025507 31797 thread.cc:641] tablet-download-pool [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.006s	sys 0.045s
I20260709 13:10:35.993064 31756 leader_election.cc:290] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:36.042354 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:35.958319 31730 raft_consensus.cc:515] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:36.048033 30098 raft_consensus.cc:3060] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:36.026276 31566 raft_consensus.cc:2804] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:10:36.049552 30067 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.013s	sys 0.058s
W20260709 13:10:36.049858 30067 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.013s	sys 0.058s
I20260709 13:10:36.014137 31717 raft_consensus.cc:493] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:35.991132 31729 raft_consensus.cc:515] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:10:36.047446 31797 thread.cc:608] tablet-download-pool [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.006s	sys 0.045s
I20260709 13:10:35.953363 31764 raft_consensus.cc:515] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:36.044919 31693 raft_consensus.cc:493] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.056519 31566 raft_consensus.cc:493] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:36.086694 30172 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.029s	sys 0.043s
W20260709 13:10:36.087337 30172 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.029s	sys 0.043s
I20260709 13:10:36.056360 31756 raft_consensus.cc:493] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
W20260709 13:10:36.086068 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 482583us
I20260709 13:10:36.068976 31790 leader_election.cc:290] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:36.094808 30100 raft_consensus.cc:2468] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 2.
I20260709 13:10:36.046437 31698 raft_consensus.cc:515] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:36.047072 31705 raft_consensus.cc:515] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:36.076393 31699 raft_consensus.cc:493] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.070652 31717 raft_consensus.cc:515] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:36.087114 31693 raft_consensus.cc:515] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:36.135911 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:36.258275 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:36.329895 30024 raft_consensus.cc:2468] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 3.
I20260709 13:10:36.310518 30096 raft_consensus.cc:3060] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:36.338455 30066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:36.249107 30703 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.050s	sys 0.083s
W20260709 13:10:36.347436 30703 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.052s	sys 0.084s
I20260709 13:10:36.076251 31702 raft_consensus.cc:493] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:36.233125 30098 raft_consensus.cc:2468] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 4.
W20260709 13:10:36.203433 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 66029.8us
I20260709 13:10:36.096369 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:36.088546 31583 consensus_queue.cc:1243] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer b2cea0098c1040f69755ea4d3dab7fc4 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
W20260709 13:10:36.289672 31718 consensus_meta.cc:287] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent flushing consensus metadata: real 0.527s	user 0.006s	sys 0.001s
W20260709 13:10:36.421991 30066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:36.422452 29993 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.706s	user 0.006s	sys 0.023s
I20260709 13:10:36.089943 31566 raft_consensus.cc:3060] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:36.255144 31792 log.cc:927] Time spent T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260709 13:10:36.306003 31729 leader_election.cc:290] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:36.294503 31762 raft_consensus.cc:493] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:36.185417 31793 raft_consensus.cc:2804] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:36.148737 31768 raft_consensus.cc:493] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:36.251256 31772 raft_consensus.cc:493] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.096354 31806 leader_election.cc:290] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:36.304843 31770 raft_consensus.cc:493] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:36.438992 30094 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.020s	sys 0.046s
I20260709 13:10:36.426200 31702 raft_consensus.cc:515] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:36.429821 31718 raft_consensus.cc:515] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:36.413233 31726 raft_consensus.cc:493] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.128620 31764 leader_election.cc:290] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:36.184666 31816 raft_consensus.cc:493] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
W20260709 13:10:36.426508 29993 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.006s	sys 0.023s
I20260709 13:10:36.450615 31791 raft_consensus.cc:493] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:36.450071 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:36.441273 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:36.420298 31728 raft_consensus.cc:493] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:36.419775 31543 raft_consensus.cc:493] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
W20260709 13:10:36.443116 30700 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.718s	user 0.014s	sys 0.020s
W20260709 13:10:36.499356 30700 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.015s	sys 0.020s
I20260709 13:10:36.424118 31832 raft_consensus.cc:493] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.184906 31797 tablet_copy_client.cc:323] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Beginning tablet copy session from remote peer at address 127.28.54.66:43821
I20260709 13:10:36.504338 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:36.426460 31757 raft_consensus.cc:493] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:36.303500 31680 raft_consensus.cc:515] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:36.170545 31699 raft_consensus.cc:515] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:36.448750 31824 raft_consensus.cc:493] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:36.449327 31822 raft_consensus.cc:493] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:36.538039 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:36.129493 31810 raft_consensus.cc:493] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:36.430169 31583 raft_consensus.cc:493] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:36.468518 30096 raft_consensus.cc:2468] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 4.
I20260709 13:10:36.420254 29994 leader_election.cc:304] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
W20260709 13:10:36.453680 30094 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.020s	sys 0.046s
I20260709 13:10:36.450174 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:36.228839 31818 raft_consensus.cc:493] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:36.457903 31793 raft_consensus.cc:697] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:36.503430 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:36.464202 30168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43838 (request call id 1502) took 1290 ms. Trace:
I20260709 13:10:36.449831 31772 raft_consensus.cc:515] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:36.259588 31773 raft_consensus.cc:515] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:36.508147 30737 raft_consensus.cc:1275] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:36.509119 31816 raft_consensus.cc:515] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:36.509312 31832 raft_consensus.cc:515] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:36.507524 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 75696.1us
I20260709 13:10:36.445780 31762 raft_consensus.cc:515] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:36.505432 31543 raft_consensus.cc:515] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:36.098022 31756 raft_consensus.cc:515] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:36.538661 30024 raft_consensus.cc:2468] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 3.
I20260709 13:10:36.454459 31770 raft_consensus.cc:515] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:36.460317 31768 raft_consensus.cc:515] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:36.188566 31761 consensus_queue.cc:260] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:36.483362 31726 raft_consensus.cc:515] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:36.505699 31728 raft_consensus.cc:515] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:36.500818 31791 raft_consensus.cc:515] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:37.182055 30022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 1366) took 1385 ms. Trace:
I20260709 13:10:36.550303 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:36.543745 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:37.233028 30177 raft_consensus.cc:3060] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:37.229552 30024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54198 (request call id 1583) took 1376 ms. Trace:
I20260709 13:10:36.945614 29993 leader_election.cc:304] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
W20260709 13:10:37.243052 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 297507us
I20260709 13:10:37.233050 30171 raft_consensus.cc:2393] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 3: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:10:36.509048 31746 raft_consensus.cc:493] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:36.513265 31729 raft_consensus.cc:493] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:37.235661 30024 rpcz_store.cc:276] 0709 13:10:35.853279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.537718 (+684439us) service_pool.cc:224] Handling call
0709 13:10:37.229503 (+691785us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:37.299091 30172 raft_consensus.cc:2393] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 3: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:10:37.232272 30022 rpcz_store.cc:276] 0709 13:10:35.796254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.826368 (+ 30114us) service_pool.cc:224] Handling call
0709 13:10:35.826660 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:35.826975 (+   315us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:35.827003 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:35.827433 (+   430us) log.cc:844] Serialized 26 byte log entry
0709 13:10:36.149422 (+321989us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:36.149579 (+   157us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:36.149643 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:37.181807 (+1032164us) raft_consensus.cc:1685] finished
0709 13:10:37.181828 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:37.181977 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":124,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"thread_start_us":321644,"threads_started":1,"wal-append.queue_time_us":903654}
I20260709 13:10:37.307144 30096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33990 (request call id 1541) took 1109 ms. Trace:
W20260709 13:10:36.581113 30066 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.54.65:34451 timed out after 1.720s (SENT) [suppressed 63 similar messages]
W20260709 13:10:37.317103 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 72944us
I20260709 13:10:37.307526 30096 rpcz_store.cc:276] 0709 13:10:36.135240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.135649 (+   409us) service_pool.cc:224] Handling call
0709 13:10:37.244371 (+1108722us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:36.771811 31699 leader_election.cc:290] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:36.534536 31568 raft_consensus.cc:493] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:37.337976 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:37.338732 30024 raft_consensus.cc:2468] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
I20260709 13:10:37.339231 30024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54198 (request call id 1585) took 1484 ms. Trace:
I20260709 13:10:37.339509 30024 rpcz_store.cc:276] 0709 13:10:35.854806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.337670 (+1482864us) service_pool.cc:224] Handling call
0709 13:10:37.339176 (+  1506us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:36.505858 31830 raft_consensus.cc:493] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:37.157094 31833 log.cc:927] Time spent T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.643s	user 0.000s	sys 0.000s
W20260709 13:10:37.164678 31842 log.cc:927] Time spent T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.413s	user 0.000s	sys 0.000s
I20260709 13:10:37.220899 31680 leader_election.cc:290] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:37.221462 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:37.148895 31693 leader_election.cc:290] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:37.348093 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:36.545804 31820 raft_consensus.cc:493] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.344897 30023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54198 (request call id 1579) took 1607 ms. Trace:
I20260709 13:10:36.537796 31764 raft_consensus.cc:493] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:37.221747 31702 leader_election.cc:290] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:37.224020 31724 raft_consensus.cc:493] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:36.555974 30170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43838 (request call id 1505) took 1370 ms. Trace:
I20260709 13:10:36.545545 31829 raft_consensus.cc:493] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.229948 31718 leader_election.cc:290] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:36.774561 30169 raft_consensus.cc:1275] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:37.339437 30026 raft_consensus.cc:1275] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:10:37.357991 30095 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.820s	user 0.025s	sys 0.015s
W20260709 13:10:37.359160 30140 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.001s	sys 0.001s
W20260709 13:10:37.387463 30140 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.002s	sys 0.001s
I20260709 13:10:37.355242 31761 raft_consensus.cc:3060] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:36.547608 31717 leader_election.cc:290] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:36.600095 31790 raft_consensus.cc:493] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:37.100485 31698 leader_election.cc:290] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:36.804603 31705 leader_election.cc:290] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:37.365981 30024 raft_consensus.cc:2393] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 5: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:37.302431 31737 raft_consensus.cc:2804] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:36.627283 31721 raft_consensus.cc:493] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:37.371202 31816 leader_election.cc:290] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:37.367357 30023 rpcz_store.cc:276] 0709 13:10:35.737301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.744465 (+  7164us) service_pool.cc:224] Handling call
0709 13:10:37.344301 (+1599836us) spinlock_profiling.cc:243] Waited 23.2 ms on lock 0x7b5800003698. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eef95b71 00007f99eef95a22 00007f99f7eaec09 00007f99f7008ee0 00007f99f70d20ab 00007f99f70d2131 00007f99f7093fc0 00007f99f707e929 00007f99f707e3d2 00007f99f05f5bd4
0709 13:10:37.344478 (+   177us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:37.344628 (+   150us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:37.344652 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:37.344686 (+    34us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:37.344712 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.344758 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:37.344846 (+    88us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53285120}
I20260709 13:10:37.414762 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:37.377398 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:37.386989 30026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 1364) took 1650 ms. Trace:
W20260709 13:10:37.388381 30140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.415688 30022 raft_consensus.cc:2468] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
W20260709 13:10:37.359706 30143 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.779s	user 0.000s	sys 0.041s
I20260709 13:10:37.394078 30024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54198 (request call id 1589) took 1393 ms. Trace:
I20260709 13:10:36.535043 31757 raft_consensus.cc:515] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:37.415984 30140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:37.401521 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:37.416517 30024 rpcz_store.cc:276] 0709 13:10:36.000449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.347880 (+1347431us) service_pool.cc:224] Handling call
0709 13:10:37.394017 (+ 46137us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:37.416874 30025 raft_consensus.cc:2468] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
I20260709 13:10:37.306947 31583 raft_consensus.cc:515] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:37.396497 31737 raft_consensus.cc:493] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:37.416400 30022 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54198 (request call id 1587) took 1561 ms (client timeout 2079 ms). Trace:
I20260709 13:10:37.426174 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:10:37.419349 30143 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.839s	user 0.000s	sys 0.041s
I20260709 13:10:36.628151 31810 raft_consensus.cc:515] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:37.337561 31746 raft_consensus.cc:515] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:37.415627 30026 rpcz_store.cc:276] 0709 13:10:35.736263 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.737392 (+  1129us) service_pool.cc:224] Handling call
0709 13:10:37.338957 (+1601565us) spinlock_profiling.cc:243] Waited 8.95 ms on lock 0x7b5800003698. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eef95b71 00007f99eef95a22 00007f99f7eaec09 00007f99f7008ee0 00007f99f70d20ab 00007f99f70d2131 00007f99f7093fc0 00007f99f707e929 00007f99f707e3d2 00007f99f05f5bd4
0709 13:10:37.339140 (+   183us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:37.386718 (+ 47578us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.386938 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20576512}
I20260709 13:10:36.812028 31828 raft_consensus.cc:493] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:37.439350 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:10:37.421737 30735 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51014 (request call id 605) took 2166 ms (client timeout 1842 ms). Trace:
I20260709 13:10:37.386674 30170 rpcz_store.cc:276] 0709 13:10:35.172187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.177389 (+  5202us) service_pool.cc:224] Handling call
0709 13:10:36.442279 (+1264890us) spinlock_profiling.cc:243] Waited 1.16 ms on lock 0x7b5800003c98. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eef95b71 00007f99eef95a22 00007f99f7eaec09 00007f99f7008ee0 00007f99f70d20ab 00007f99f70d2131 00007f99f70800a0 00007f99f707f984 00007f99f05fa6d4 00007f99f05fa662
0709 13:10:36.542744 (+100465us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2677504}
W20260709 13:10:37.440073 30735 rpcz_store.cc:269] 0709 13:10:35.242708 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.242811 (+   103us) service_pool.cc:224] Handling call
0709 13:10:37.409283 (+2166472us) spinlock_profiling.cc:243] Waited 77.2 ms on lock 0x7b54004c3954. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:10:37.409401 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":177659648}
I20260709 13:10:37.440465 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:37.441211 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:37.441926 30735 raft_consensus.cc:2393] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 5: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:10:37.442776 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:37.443657 30735 raft_consensus.cc:2368] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 3. Current term is 4.
I20260709 13:10:37.444308 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:37.446202 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:37.447120 30169 raft_consensus.cc:2410] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:10:37.448210 31772 leader_election.cc:290] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:37.375339 31693 raft_consensus.cc:493] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
W20260709 13:10:37.390965 30095 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.856s	user 0.025s	sys 0.015s
I20260709 13:10:37.396226 31790 raft_consensus.cc:515] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:37.178663 31845 raft_consensus.cc:493] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:37.337545 31568 raft_consensus.cc:515] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:37.426200 30025 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54198 (request call id 1577) took 1680 ms (client timeout 1885 ms). Trace:
W20260709 13:10:37.426501 30022 rpcz_store.cc:269] 0709 13:10:35.855407 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.348384 (+1492977us) service_pool.cc:224] Handling call
0709 13:10:37.416340 (+ 67956us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:36.765811 31844 raft_consensus.cc:493] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.426908 30024 raft_consensus.cc:2468] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
I20260709 13:10:37.420585 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:37.428949 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:37.420794 31721 raft_consensus.cc:515] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:37.429366 31737 raft_consensus.cc:3060] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:36.770581 31821 raft_consensus.cc:493] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.413945 31705 raft_consensus.cc:493] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.430086 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:37.430446 30023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54198 (request call id 1590) took 1413 ms. Trace:
I20260709 13:10:37.502468 30023 rpcz_store.cc:276] 0709 13:10:36.016942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.414529 (+1397587us) service_pool.cc:224] Handling call
0709 13:10:37.430369 (+ 15840us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:37.503376 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:37.372618 30174 raft_consensus.cc:2468] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 2.
I20260709 13:10:37.354262 31729 raft_consensus.cc:515] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:37.392130 31702 raft_consensus.cc:2804] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 13:10:37.414460 31566 consensus_meta.cc:287] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent flushing consensus metadata: real 0.976s	user 0.008s	sys 0.001s
I20260709 13:10:37.447981 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:37.441848 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:37.418870 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:37.412948 31698 raft_consensus.cc:493] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.457563 30177 raft_consensus.cc:2468] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 4.
I20260709 13:10:37.382997 31764 raft_consensus.cc:515] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:37.460848 30175 raft_consensus.cc:2468] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 3.
I20260709 13:10:37.464592 31851 raft_consensus.cc:493] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:37.525652 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:37.446823 31726 leader_election.cc:290] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:37.467088 30024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54198 (request call id 1592) took 1332 ms. Trace:
I20260709 13:10:37.440828 31757 leader_election.cc:290] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:37.451675 31772 raft_consensus.cc:493] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:37.496601 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:37.446842 31770 leader_election.cc:290] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:10:37.466377 30025 rpcz_store.cc:269] 0709 13:10:35.736802 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.736912 (+   110us) service_pool.cc:224] Handling call
0709 13:10:37.401348 (+1664436us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b5800003698. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eef95b71 00007f99eef95a22 00007f99f7eaec09 00007f99f7008ee0 00007f99f70d20ab 00007f99f70d2131 00007f99f70800a0 00007f99f707f984 00007f99f05fa6d4 00007f99f05fa662
0709 13:10:37.417315 (+ 15967us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47923072}
I20260709 13:10:37.500948 31832 leader_election.cc:290] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:37.230676 30168 rpcz_store.cc:276] 0709 13:10:35.171203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.174353 (+  3150us) service_pool.cc:224] Handling call
0709 13:10:36.415647 (+1241294us) spinlock_profiling.cc:243] Waited 1.1 ms on lock 0x7b5800003c98. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eef95b71 00007f99eef95eee 0000000000375939 00007f99f70091e0 00007f99f70d20c4 00007f99f70d2131 00007f99f7093fc0 00007f99f707e929 00007f99f707e3d2 00007f99f05f5bd4
0709 13:10:36.419317 (+  3670us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:36.429383 (+ 10066us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:36.436250 (+  6867us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:36.440901 (+  4651us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:36.444577 (+  3676us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:36.451570 (+  6993us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:36.461996 (+ 10426us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2533760}
I20260709 13:10:37.515021 30171 raft_consensus.cc:2468] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 3.
I20260709 13:10:37.337967 31818 raft_consensus.cc:515] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:37.396206 31820 raft_consensus.cc:515] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:37.392241 31724 raft_consensus.cc:515] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:37.538365 31746 leader_election.cc:290] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:37.515256 30172 raft_consensus.cc:2393] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 2: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:10:37.465921 31693 raft_consensus.cc:515] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:37.356796 31830 raft_consensus.cc:515] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:37.517688 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:36.550539 31824 raft_consensus.cc:515] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:37.528164 30024 rpcz_store.cc:276] 0709 13:10:36.134514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.425960 (+1291446us) service_pool.cc:224] Handling call
0709 13:10:37.467033 (+ 41073us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:37.521847 30169 raft_consensus.cc:3060] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:10:36.769970 31822 raft_consensus.cc:515] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:37.429947 31793 consensus_queue.cc:237] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:37.437276 31829 raft_consensus.cc:515] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:37.537321 31726 raft_consensus.cc:493] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:37.509409 31705 raft_consensus.cc:515] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:37.519825 31566 raft_consensus.cc:515] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:37.538864 30020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 1361) took 1805 ms. Trace:
I20260709 13:10:37.540148 31770 raft_consensus.cc:493] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:37.569370 30026 raft_consensus.cc:2468] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 3.
I20260709 13:10:37.545148 31773 leader_election.cc:290] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:37.524178 31698 raft_consensus.cc:515] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:37.515363 31844 raft_consensus.cc:515] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:37.505332 31845 raft_consensus.cc:515] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:37.529098 31821 raft_consensus.cc:515] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:37.564724 31762 leader_election.cc:290] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:37.558203 31756 leader_election.cc:290] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:37.541822 31772 raft_consensus.cc:515] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:37.564930 30170 raft_consensus.cc:2468] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 3.
I20260709 13:10:37.565037 31768 leader_election.cc:290] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:37.571060 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:37.467110 31828 raft_consensus.cc:515] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:37.600997 31840 log.cc:927] Time spent T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.190s	user 0.001s	sys 0.000s
I20260709 13:10:37.542723 31851 raft_consensus.cc:515] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:37.581529 31543 leader_election.cc:290] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:37.610594 30022 raft_consensus.cc:2393] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 4: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:37.585897 31681 raft_consensus.cc:493] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:37.573139 31726 raft_consensus.cc:515] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:37.639853 31583 leader_election.cc:290] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:37.582870 31773 raft_consensus.cc:493] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:37.639585 31681 raft_consensus.cc:515] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:37.578565 31770 raft_consensus.cc:515] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:37.585275 31824 leader_election.cc:290] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:37.623273 31821 leader_election.cc:290] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:37.625032 30174 raft_consensus.cc:2468] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 3.
I20260709 13:10:37.639793 31568 leader_election.cc:290] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:37.678185 31851 leader_election.cc:290] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:37.653915 31729 leader_election.cc:290] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:37.653108 30728 raft_consensus.cc:1275] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:37.640218 31845 leader_election.cc:290] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:37.656750 31790 leader_election.cc:290] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:10:37.690996 30734 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51004 (request call id 435) took 2506 ms (client timeout 2064 ms). Trace:
W20260709 13:10:37.691862 30100 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33990 (request call id 1527) took 1794 ms (client timeout 2018 ms). Trace:
W20260709 13:10:37.713009 30100 rpcz_store.cc:269] 0709 13:10:35.897049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.897153 (+   104us) service_pool.cc:224] Handling call
0709 13:10:37.691710 (+1794557us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b5400265554. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:10:37.691810 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":448396672}
W20260709 13:10:37.712317 30734 rpcz_store.cc:269] 0709 13:10:35.184096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.184208 (+   112us) service_pool.cc:224] Handling call
0709 13:10:35.719481 (+535273us) spinlock_profiling.cc:243] Waited 3.46 ms on lock 0x7b5800004898. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eef95b71 00007f99eef95a22 00007f99f7eaec09 00007f99f7008ee0 00007f99f70d20ab 00007f99f70d2131 00007f99f70800a0 00007f99f707f984 00007f99f05fa6d4 00007f99f05fa662
0709 13:10:37.690824 (+1971343us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b54006effd4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:10:37.690928 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":271602816}
I20260709 13:10:37.656886 31728 leader_election.cc:290] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:37.687933 31721 leader_election.cc:290] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:37.572681 30020 rpcz_store.cc:276] 0709 13:10:35.733004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.733107 (+   103us) service_pool.cc:224] Handling call
0709 13:10:35.733432 (+   325us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:35.745063 (+ 11631us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:35.745101 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:35.745636 (+   535us) log.cc:844] Serialized 26 byte log entry
0709 13:10:36.169836 (+424200us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:36.195556 (+ 25720us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:36.195651 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:37.520931 (+1325280us) raft_consensus.cc:1685] finished
0709 13:10:37.523654 (+  2723us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:37.534984 (+ 11330us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11227,"raft.queue_time_us":11513,"raft.run_cpu_time_us":62,"raft.run_wall_time_us":63,"thread_start_us":351487,"threads_started":1,"wal-append.queue_time_us":706463}
W20260709 13:10:37.724568 30026 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54206 (request call id 1368) took 1704 ms (client timeout 2071 ms). Trace:
W20260709 13:10:37.725884 30142 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.218s	user 0.056s	sys 0.110s
W20260709 13:10:37.726171 30142 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.218s	user 0.056s	sys 0.110s
W20260709 13:10:37.729574 30175 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54540 (request call id 315) took 1634 ms (client timeout 2057 ms). Trace:
W20260709 13:10:37.729976 30175 rpcz_store.cc:269] 0709 13:10:36.095380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.096110 (+   730us) service_pool.cc:224] Handling call
0709 13:10:37.729428 (+1633318us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540011f8d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:10:37.729526 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2397683968}
W20260709 13:10:37.724972 30026 rpcz_store.cc:269] 0709 13:10:36.019700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.439108 (+1419408us) service_pool.cc:224] Handling call
0709 13:10:37.724401 (+285293us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b54004169d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:10:37.724511 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":297691904}
I20260709 13:10:37.731966 30026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52098 (request call id 258) took 1772 ms. Trace:
I20260709 13:10:37.732291 30026 rpcz_store.cc:276] 0709 13:10:35.959521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.731207 (+1771686us) service_pool.cc:224] Handling call
0709 13:10:37.731510 (+   303us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:37.731676 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:37.731708 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:37.731748 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:37.731776 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.731825 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:37.731915 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:37.736204 30026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52098 (request call id 259) took 1774 ms. Trace:
I20260709 13:10:37.736605 30026 rpcz_store.cc:276] 0709 13:10:35.959749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.733096 (+1773347us) service_pool.cc:224] Handling call
0709 13:10:37.733337 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:37.733493 (+   156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:37.733517 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:37.733554 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:37.733580 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:37.733626 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:37.733709 (+    83us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:37.657186 31773 raft_consensus.cc:515] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:38.217645 30173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54540 (request call id 301) took 3031 ms. Trace:
I20260709 13:10:38.228732 31820 leader_election.cc:290] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:37.887699 31758 raft_consensus.cc:493] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:37.851572 31851 raft_consensus.cc:493] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:37.888758 31724 leader_election.cc:290] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:38.194243 31772 leader_election.cc:290] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:10:37.904268 30066 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.011s	sys 0.013s
W20260709 13:10:38.230568 30066 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.922s	user 0.011s	sys 0.018s
I20260709 13:10:38.221941 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:37.738942 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
W20260709 13:10:38.047361 29992 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.006s	sys 0.011s
I20260709 13:10:37.718474 31764 leader_election.cc:290] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:10:37.753044 30069 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.023s	user 0.030s	sys 0.029s
I20260709 13:10:37.746768 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:37.843954 31845 raft_consensus.cc:493] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:38.221701 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:37.750183 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:38.229068 30173 rpcz_store.cc:276] 0709 13:10:35.163991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.165998 (+  2007us) service_pool.cc:224] Handling call
0709 13:10:35.596707 (+430709us) spinlock_profiling.cc:243] Waited 876 us on lock 0x7b5800003c98. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eef95b71 00007f99eef95a22 00007f99f7eaec09 00007f99f7008ee0 00007f99f70d20ab 00007f99f70d2131 00007f99f7093fc0 00007f99f707e929 00007f99f707e3d2 00007f99f05f5bd4
0709 13:10:35.596923 (+   216us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:35.897127 (+300204us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:35.897161 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:35.897625 (+   464us) log.cc:844] Serialized 26 byte log entry
0709 13:10:36.444788 (+547163us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:36.444826 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:38.194730 (+1749904us) spinlock_profiling.cc:243] Waited 270 ms on lock 0x7b5400314a54. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:10:38.194794 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:38.194844 (+    50us) raft_consensus.cc:1685] finished
0709 13:10:38.194858 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:38.195013 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":6465,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":21284,"spinlock_wait_cycles":623114880,"thread_start_us":488077,"threads_started":1,"wal-append.queue_time_us":1147782,"wal-append.run_cpu_time_us":10746,"wal-append.run_wall_time_us":1081246}
I20260709 13:10:37.720093 31844 leader_election.cc:290] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:10:37.739022 30703 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.009s	sys 0.042s
W20260709 13:10:38.236685 30703 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.143s	user 0.013s	sys 0.057s
I20260709 13:10:38.234609 30102 raft_consensus.cc:2468] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 3.
I20260709 13:10:37.827898 31756 raft_consensus.cc:493] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:38.240545 31756 raft_consensus.cc:515] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:38.096658 30067 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.365s	user 0.005s	sys 0.014s
I20260709 13:10:37.818624 31768 raft_consensus.cc:493] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:37.826467 31850 log.cc:927] Time spent T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 13:10:38.241262 31714 consensus_queue.cc:1059] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:37.738862 31693 leader_election.cc:290] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:38.242067 31768 raft_consensus.cc:515] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:38.242622 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:37.826105 31843 raft_consensus.cc:493] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:38.243376 30171 raft_consensus.cc:3060] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Advancing to term 4
W20260709 13:10:37.985116 31857 log.cc:927] Time spent T 00000000000000000000000000000000 P 1c91346f9a2a480e908d4e0323634aeb: Append to log took a long time: real 0.408s	user 0.001s	sys 0.000s
W20260709 13:10:37.761301 30700 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.000s	sys 0.013s
W20260709 13:10:38.244721 30700 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.005s	user 0.000s	sys 0.029s
W20260709 13:10:38.232115 29992 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.824s	user 0.011s	sys 0.014s
W20260709 13:10:38.244989 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 1.00515e+06us
I20260709 13:10:38.234323 31845 raft_consensus.cc:515] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:38.248595 31845 leader_election.cc:290] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:37.819753 31721 raft_consensus.cc:493] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:38.242571 31693 raft_consensus.cc:493] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:38.249536 31721 raft_consensus.cc:515] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:38.249946 30171 raft_consensus.cc:2468] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 4.
I20260709 13:10:38.250104 31693 raft_consensus.cc:515] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:37.826406 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:38.251510 30028 raft_consensus.cc:3060] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:38.241626 30067 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.510s	user 0.010s	sys 0.015s
I20260709 13:10:38.018172 31705 leader_election.cc:290] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:38.230032 31851 raft_consensus.cc:515] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:38.030965 31698 leader_election.cc:290] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:10:37.739533 30141 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.014s	sys 0.034s
W20260709 13:10:38.258226 29993 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.940s	user 0.047s	sys 0.072s
W20260709 13:10:38.258586 29993 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.941s	user 0.047s	sys 0.072s
W20260709 13:10:38.258829 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 940957us
I20260709 13:10:38.259462 29993 leader_election.cc:304] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:37.826453 31855 raft_consensus.cc:3055] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:38.260627 31855 raft_consensus.cc:740] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:38.261061 29993 leader_election.cc:304] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:38.261510 31855 consensus_queue.cc:260] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:10:38.262861 30025 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.008s	sys 0.005s
W20260709 13:10:38.263336 30141 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.191s	user 0.027s	sys 0.040s
I20260709 13:10:38.016867 31830 leader_election.cc:290] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:37.917304 31673 raft_consensus.cc:493] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:37.818701 31728 raft_consensus.cc:493] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:38.232708 30069 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.503s	user 0.037s	sys 0.039s
I20260709 13:10:38.231953 30175 raft_consensus.cc:2393] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 5: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
W20260709 13:10:38.230862 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 1.64968e+06us
W20260709 13:10:38.283530 29994 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.965s	user 0.002s	sys 0.013s
W20260709 13:10:38.283905 29994 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.966s	user 0.002s	sys 0.013s
W20260709 13:10:38.284220 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 1.8639e+06us
I20260709 13:10:38.287652 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:38.288425 30171 raft_consensus.cc:2468] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 2.
W20260709 13:10:38.263181 30025 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.008s	sys 0.005s
I20260709 13:10:38.294564 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:38.294991 31855 raft_consensus.cc:3060] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:38.234095 30019 raft_consensus.cc:2393] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 5: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:38.298247 31845 raft_consensus.cc:493] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:38.306361 31756 leader_election.cc:290] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:38.306732 31673 raft_consensus.cc:515] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:38.307029 30068 leader_election.cc:304] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:38.307631 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:38.299670 31843 raft_consensus.cc:515] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:38.299814 31758 raft_consensus.cc:515] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:38.279587 31705 raft_consensus.cc:493] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:37.721076 31818 leader_election.cc:290] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:38.298588 31738 raft_consensus.cc:493] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.309024 30174 raft_consensus.cc:2468] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 2.
I20260709 13:10:38.309715 30113 tablet_copy_service.cc:140] P 5ec73dc157ed476ca903a7d596271719: Received BeginTabletCopySession request for tablet 18a72905c2e24e33af2e64672417cfcf from peer 6f3eb161e2194f6891f12e2cfcaaf73a ({username='slave'} at 127.0.0.1:48558)
I20260709 13:10:38.298816 31760 raft_consensus.cc:493] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.381788 30098 raft_consensus.cc:2393] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 2: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:10:38.310328 31773 leader_election.cc:290] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:37.751833 30170 raft_consensus.cc:1240] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:37.910496 31566 leader_election.cc:290] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:38.312278 31768 leader_election.cc:290] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:38.313925 31721 leader_election.cc:290] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:37.920759 31737 raft_consensus.cc:515] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:38.345252 31728 raft_consensus.cc:515] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:38.322819 31681 leader_election.cc:290] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:38.278512 31822 leader_election.cc:290] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:38.325035 30028 raft_consensus.cc:2468] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 3.
I20260709 13:10:38.263167 31726 leader_election.cc:290] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:10:38.256829 31702 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.003s	sys 0.007s
W20260709 13:10:38.360098 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 99390.3us
I20260709 13:10:38.386822 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:38.367136 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:38.367277 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:38.369792 31845 raft_consensus.cc:515] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:38.380815 31705 raft_consensus.cc:515] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:38.278153 31729 raft_consensus.cc:493] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:38.492621 31702 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.978s	user 0.004s	sys 0.007s
I20260709 13:10:38.298429 31708 raft_consensus.cc:493] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:38.017724 31810 leader_election.cc:290] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:38.366763 31790 raft_consensus.cc:2749] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:38.370855 31756 raft_consensus.cc:493] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:38.378456 30095 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.871s	user 0.014s	sys 0.014s
I20260709 13:10:38.405232 30702 leader_election.cc:304] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
W20260709 13:10:38.406726 30142 connection.cc:256] RPC call timeout handler was delayed by -1.5682931110000027s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16310000000000002s for a response
I20260709 13:10:38.322211 31829 leader_election.cc:290] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:38.383106 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:38.381891 31818 raft_consensus.cc:493] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:38.383606 31760 raft_consensus.cc:3060] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:38.459823 30028 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54198 (request call id 1581) took 2713 ms (client timeout 1974 ms). Trace:
I20260709 13:10:38.308773 31770 leader_election.cc:290] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:38.547845 31856 raft_consensus.cc:2804] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:38.579057 31856 raft_consensus.cc:697] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 3 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
W20260709 13:10:38.385699 30019 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54198 (request call id 1576) took 2643 ms (client timeout 1720 ms). Trace:
W20260709 13:10:38.368112 30024 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.800s	user 0.009s	sys 0.017s
I20260709 13:10:38.383191 31738 raft_consensus.cc:515] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:38.495046 30027 raft_consensus.cc:2393] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 2: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:10:38.496869 29993 leader_election.cc:304] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:38.347618 29994 leader_election.cc:304] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:38.509698 30023 raft_consensus.cc:2393] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 4: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
W20260709 13:10:38.438967 30094 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.066s	user 0.072s	sys 0.094s
I20260709 13:10:38.512610 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:38.436714 31721 raft_consensus.cc:493] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:38.566262 30028 rpcz_store.cc:269] 0709 13:10:35.746569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.746661 (+    92us) service_pool.cc:224] Handling call
0709 13:10:37.826240 (+2079579us) spinlock_profiling.cc:243] Waited 21 ms on lock 0x7b5800003698. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eef95b71 00007f99eef95a22 00007f99f7eaec09 00007f99f7008ee0 00007f99f70d20ab 00007f99f70d2131 00007f99f70800a0 00007f99f707f984 00007f99f05fa6d4 00007f99f05fa662
0709 13:10:38.459749 (+633509us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48414080}
I20260709 13:10:38.434177 31828 leader_election.cc:290] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:38.386094 30113 tablet_copy_service.cc:161] P 5ec73dc157ed476ca903a7d596271719: Beginning new tablet copy session on tablet 18a72905c2e24e33af2e64672417cfcf from peer 6f3eb161e2194f6891f12e2cfcaaf73a at {username='slave'} at 127.0.0.1:48558: session id = 6f3eb161e2194f6891f12e2cfcaaf73a-18a72905c2e24e33af2e64672417cfcf
W20260709 13:10:38.494982 31793 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.933s	user 0.008s	sys 0.026s
I20260709 13:10:38.566262 31673 leader_election.cc:290] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:38.571858 31759 raft_consensus.cc:2804] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:38.572850 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:38.573670 31810 raft_consensus.cc:493] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:38.551816 31708 raft_consensus.cc:515] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:38.649076 31759 raft_consensus.cc:697] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
W20260709 13:10:38.580561 30024 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.013s	user 0.009s	sys 0.017s
I20260709 13:10:38.649334 31737 leader_election.cc:290] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:10:38.548744 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 143621us
I20260709 13:10:38.509632 31822 raft_consensus.cc:493] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:38.584429 30027 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54198 (request call id 1580) took 2839 ms (client timeout 2030 ms). Trace:
W20260709 13:10:38.650867 30027 rpcz_store.cc:269] 0709 13:10:35.746280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.746392 (+   112us) service_pool.cc:224] Handling call
0709 13:10:38.366982 (+2620590us) spinlock_profiling.cc:243] Waited 21.2 ms on lock 0x7b5800003698. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eef95b71 00007f99eef95a22 00007f99f7eaec09 00007f99f7008ee0 00007f99f70d20ab 00007f99f70d2131 00007f99f70800a0 00007f99f707f984 00007f99f05fa6d4 00007f99f05fa662
0709 13:10:38.584353 (+217371us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":48854400}
I20260709 13:10:38.651933 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:38.652148 31822 raft_consensus.cc:515] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:38.652509 30027 raft_consensus.cc:2468] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
I20260709 13:10:38.652526 31708 leader_election.cc:290] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:38.232715 31764 raft_consensus.cc:493] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:38.590233 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 372498us
I20260709 13:10:38.653993 31764 raft_consensus.cc:515] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:38.655898 31764 leader_election.cc:290] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:10:38.656404 30143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.658164 30025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 1367) took 2829 ms. Trace:
W20260709 13:10:38.591071 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 243529us
I20260709 13:10:38.658551 30025 rpcz_store.cc:276] 0709 13:10:35.828596 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.530326 (+1701730us) service_pool.cc:224] Handling call
0709 13:10:37.530625 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:37.534254 (+  3629us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:37.534284 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:37.540577 (+  6293us) log.cc:844] Serialized 26 byte log entry
0709 13:10:38.291298 (+750721us) raft_consensus.cc:1645] Marking committed up to 1
0709 13:10:38.291339 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:38.291422 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:38.657947 (+366525us) raft_consensus.cc:1685] finished
0709 13:10:38.657972 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:38.658107 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8685,"raft.queue_time_us":157618,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":1904,"thread_start_us":741705,"threads_started":1,"wal-append.queue_time_us":1094664}
I20260709 13:10:38.659963 29994 leader_election.cc:304] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:38.660347 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:38.662076 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:10:38.548403 30095 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.062s	user 0.015s	sys 0.014s
W20260709 13:10:38.583809 30019 rpcz_store.cc:269] 0709 13:10:35.736547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.743992 (+  7445us) service_pool.cc:224] Handling call
0709 13:10:37.733926 (+1989934us) spinlock_profiling.cc:243] Waited 23.3 ms on lock 0x7b5800003698. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eef95b71 00007f99eef95a22 00007f99f7eaec09 00007f99f7008ee0 00007f99f70d20ab 00007f99f70d2131 00007f99f70800a0 00007f99f707f984 00007f99f05fa6d4 00007f99f05fa662
0709 13:10:38.376472 (+642546us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":53533952}
I20260709 13:10:38.617456 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:38.669328 30028 raft_consensus.cc:3060] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:10:38.545116 31702 raft_consensus.cc:697] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:38.623521 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:38.589454 30731 raft_consensus.cc:2393] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 5: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
W20260709 13:10:38.590132 30094 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.221s	user 0.073s	sys 0.094s
W20260709 13:10:38.549232 30142 connection.cc:256] RPC call timeout handler was delayed by -1.2645786009999256s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20640000000000003s for a response
I20260709 13:10:38.650329 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
W20260709 13:10:38.591778 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 94982.5us
I20260709 13:10:38.653488 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:38.677639 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:38.695744 30025 raft_consensus.cc:2393] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 3: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:38.688508 30736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51014 (request call id 615) took 2162 ms. Trace:
W20260709 13:10:38.643494 31793 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.059s	user 0.008s	sys 0.026s
I20260709 13:10:38.545547 31729 raft_consensus.cc:515] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:38.619776 31790 raft_consensus.cc:2804] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:38.696122 30736 rpcz_store.cc:276] 0709 13:10:36.507051 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.507159 (+   108us) service_pool.cc:224] Handling call
0709 13:10:36.507451 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:37.454095 (+946644us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:37.454126 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:37.454167 (+    41us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:37.454196 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:38.669116 (+1214920us) spinlock_profiling.cc:243] Waited 946 ms on lock 0x7b54005203d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:10:38.669159 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:38.669278 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2176672128}
I20260709 13:10:38.697747 30027 raft_consensus.cc:2410] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:38.697945 30142 leader_election.cc:400] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469) with higher term. Message: Invalid argument: T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 3. Current term is 4.
I20260709 13:10:38.698299 30735 raft_consensus.cc:1275] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:10:38.703184 29993 leader_election.cc:304] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:38.644488 31830 raft_consensus.cc:2749] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:38.566349 31818 raft_consensus.cc:515] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:38.661957 31851 leader_election.cc:290] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:10:38.710498 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 403492us
I20260709 13:10:38.659718 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:38.579885 31856 consensus_queue.cc:237] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:38.668870 31708 raft_consensus.cc:2804] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:38.582022 31756 raft_consensus.cc:515] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:38.705511 30142 leader_election.cc:304] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
W20260709 13:10:38.704268 30169 consensus_meta.cc:287] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124: Time spent flushing consensus metadata: real 1.129s	user 0.007s	sys 0.003s
I20260709 13:10:38.719694 30028 raft_consensus.cc:2468] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 5.
I20260709 13:10:38.618746 31721 raft_consensus.cc:515] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:38.721041 30066 connection.cc:256] RPC call timeout handler was delayed by -1.6278431119999368s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1885s for a response
W20260709 13:10:38.755650 30142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 50191.9us
I20260709 13:10:38.659976 31810 raft_consensus.cc:515] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:38.760840 31714 raft_consensus.cc:493] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:38.713848 31726 raft_consensus.cc:493] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:38.706308 30730 raft_consensus.cc:2468] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 3.
I20260709 13:10:38.785538 30702 leader_election.cc:304] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:38.713285 31737 raft_consensus.cc:493] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
W20260709 13:10:38.786983 30066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:38.545068 31677 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.855s	user 0.025s	sys 0.055s
W20260709 13:10:38.761119 30703 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.020s	sys 0.034s
I20260709 13:10:38.781536 30700 leader_election.cc:304] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
W20260709 13:10:38.784889 30142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:38.703104 31695 consensus_queue.cc:1048] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 13:10:38.722262 31854 raft_consensus.cc:493] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:38.792461 30066 connection.cc:256] RPC call timeout handler was delayed by -1.3703947599999537s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19740000000000002s for a response
W20260709 13:10:38.800444 30066 connection.cc:256] RPC call timeout handler was delayed by -1.3207145819999369s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20299999999999999s for a response
W20260709 13:10:38.793515 30703 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.023s	sys 0.041s
I20260709 13:10:38.790459 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:10:38.801620 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 561105us
I20260709 13:10:38.720407 31790 raft_consensus.cc:697] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:38.745666 31708 raft_consensus.cc:493] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:38.756331 31829 raft_consensus.cc:493] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:38.760586 30095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33990 (request call id 1534) took 2823 ms. Trace:
I20260709 13:10:38.782127 31851 raft_consensus.cc:2804] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:38.782460 31828 raft_consensus.cc:493] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
W20260709 13:10:38.797133 31677 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.107s	user 0.025s	sys 0.055s
I20260709 13:10:38.765159 31830 raft_consensus.cc:2749] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:38.754604 31824 raft_consensus.cc:493] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:38.821992 30099 raft_consensus.cc:1275] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:38.813117 31822 leader_election.cc:290] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:38.787750 30094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33990 (request call id 1533) took 2887 ms. Trace:
I20260709 13:10:38.879120 31728 leader_election.cc:290] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:38.821102 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:38.821739 31829 raft_consensus.cc:515] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:38.818676 31869 raft_consensus.cc:493] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:38.838677 30027 raft_consensus.cc:2468] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 2.
I20260709 13:10:38.964607 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:10:38.966040 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 180563us
W20260709 13:10:38.966609 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 185129us
I20260709 13:10:38.762104 31860 consensus_queue.cc:1048] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.076s
I20260709 13:10:38.818264 31708 raft_consensus.cc:3060] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:38.822836 31851 raft_consensus.cc:493] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:38.780112 30169 raft_consensus.cc:2468] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 5.
I20260709 13:10:38.813877 31758 leader_election.cc:290] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:10:38.819170 31861 log.cc:927] Time spent T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 13:10:38.882277 31843 leader_election.cc:290] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:38.827319 30066 leader_election.cc:304] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:38.857388 30024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54198 (request call id 1584) took 3003 ms. Trace:
I20260709 13:10:38.821038 30113 tablet_copy_source_session.cc:215] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:10:38.795266 31852 raft_consensus.cc:493] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:38.795318 31771 raft_consensus.cc:493] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:38.972440 30019 raft_consensus.cc:2393] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 5: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
W20260709 13:10:38.946110 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 242989us
I20260709 13:10:38.785193 31853 consensus_queue.cc:1048] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.144s
I20260709 13:10:39.003859 29993 leader_election.cc:304] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:38.796176 31759 consensus_queue.cc:237] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:38.955856 31689 leader_election.cc:290] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:38.955940 31818 leader_election.cc:290] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:38.956359 30099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33990 (request call id 1532) took 3056 ms. Trace:
I20260709 13:10:38.956790 31844 raft_consensus.cc:2804] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:38.785179 31714 raft_consensus.cc:515] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:38.783500 30733 raft_consensus.cc:2468] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 3.
I20260709 13:10:38.814465 31737 raft_consensus.cc:515] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:38.882071 31828 raft_consensus.cc:515] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:38.967845 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:38.953646 31820 raft_consensus.cc:2804] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:39.018466 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:38.822465 31790 consensus_queue.cc:237] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:38.969633 30700 leader_election.cc:304] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:39.026002 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
W20260709 13:10:39.026217 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 56655.4us
I20260709 13:10:39.026585 30101 raft_consensus.cc:2468] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 3.
I20260709 13:10:39.027257 31829 leader_election.cc:290] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:39.027448 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:39.005141 31771 raft_consensus.cc:515] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:39.028658 31781 raft_consensus.cc:2804] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:39.029039 31781 raft_consensus.cc:493] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.029357 31781 raft_consensus.cc:3060] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:39.029865 30020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52098 (request call id 257) took 3070 ms. Trace:
I20260709 13:10:39.030098 31705 leader_election.cc:290] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:39.030344 31828 leader_election.cc:290] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:39.030869 31721 leader_election.cc:290] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:38.954510 31738 leader_election.cc:290] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:38.961817 31845 leader_election.cc:290] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:10:38.980953 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 153716us
I20260709 13:10:39.010614 30099 rpcz_store.cc:276] 0709 13:10:35.900001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.900595 (+   594us) service_pool.cc:224] Handling call
0709 13:10:38.754002 (+2853407us) spinlock_profiling.cc:243] Waited 1.17 ms on lock 0x7b5800073598. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eef95b71 00007f99eef95a22 00007f99f7eaec09 00007f99f7008ee0 00007f99f70d20ab 00007f99f70d2131 00007f99f7093fc0 00007f99f707e929 00007f99f707e3d2 00007f99f05f5bd4
0709 13:10:38.794650 (+ 40648us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:38.947632 (+152982us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:38.956298 (+  8666us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2695936}
W20260709 13:10:39.036197 31761 consensus_meta.cc:287] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124: Time spent flushing consensus metadata: real 1.638s	user 0.005s	sys 0.005s
I20260709 13:10:39.036813 31762 raft_consensus.cc:493] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:38.836210 31854 raft_consensus.cc:515] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:39.037597 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:39.038628 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:39.039209 31854 leader_election.cc:290] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:39.039538 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:39.040477 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:39.040943 30027 raft_consensus.cc:2376] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 5. Re-sending same reply.
I20260709 13:10:39.041774 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:39.042414 30027 raft_consensus.cc:2393] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 5: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:39.043133 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:38.981256 30024 rpcz_store.cc:276] 0709 13:10:35.853875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.550774 (+1696899us) service_pool.cc:224] Handling call
0709 13:10:37.551037 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:37.551213 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:10:38.649743 (+1098530us) log.cc:844] Serialized 14 byte log entry
0709 13:10:38.857038 (+207295us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:38.857096 (+    58us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:38.857138 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:38.857206 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:38.857330 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17426,"prepare.queue_time_us":1118534,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":4489,"raft.queue_time_us":17648,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":30148,"thread_start_us":1271167,"threads_started":2,"wal-append.queue_time_us":311106}
I20260709 13:10:38.952158 31824 raft_consensus.cc:515] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:38.797482 31726 raft_consensus.cc:515] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:10:39.002326 31867 log.cc:927] Time spent T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
I20260709 13:10:39.001919 31852 raft_consensus.cc:515] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:38.972944 31851 raft_consensus.cc:3060] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:39.054303 31714 leader_election.cc:290] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:39.036110 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:38.815219 31764 raft_consensus.cc:493] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:39.056452 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:39.056581 31764 raft_consensus.cc:515] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:39.007302 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:39.057595 30101 raft_consensus.cc:2468] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 1.
I20260709 13:10:38.969453 31728 consensus_queue.cc:1059] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:10:39.011014 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
W20260709 13:10:38.979346 30169 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43840 (request call id 1527) took 1558 ms (client timeout 1933 ms). Trace:
W20260709 13:10:39.013190 29993 connection.cc:256] RPC call timeout handler was delayed by -2.1821644060000835s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18420000000000003s for a response
I20260709 13:10:38.985013 31758 raft_consensus.cc:2804] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:39.003777 31729 leader_election.cc:290] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:39.065900 31758 raft_consensus.cc:493] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:38.968528 31869 raft_consensus.cc:515] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:38.801129 31702 consensus_queue.cc:237] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:39.067183 31728 raft_consensus.cc:3055] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:39.022148 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:38.957084 31874 raft_consensus.cc:2804] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:39.007709 31881 raft_consensus.cc:2804] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:39.037228 31762 raft_consensus.cc:515] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:39.012822 31844 raft_consensus.cc:493] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:39.077525 31844 raft_consensus.cc:3060] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:39.048799 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:39.032161 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:39.043474 31760 raft_consensus.cc:515] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:38.953425 30094 rpcz_store.cc:276] 0709 13:10:35.900262 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.902515 (+  2253us) service_pool.cc:224] Handling call
0709 13:10:35.920755 (+ 18240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:35.920997 (+   242us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:10:37.338330 (+1417333us) log.cc:844] Serialized 14 byte log entry
0709 13:10:38.709926 (+1371596us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:38.714059 (+  4133us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:38.719514 (+  5455us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:38.746552 (+ 27038us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:38.782647 (+ 36095us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":774,"prepare.queue_time_us":634735,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":8399,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":13011,"thread_start_us":2632303,"threads_started":2,"wal-append.queue_time_us":1299437}
I20260709 13:10:39.067140 31781 raft_consensus.cc:515] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:39.116534 31760 leader_election.cc:290] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:39.029435 31771 leader_election.cc:290] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:39.059698 31810 leader_election.cc:290] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451)
I20260709 13:10:39.033411 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
W20260709 13:10:39.047981 31880 log.cc:927] Time spent T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260709 13:10:39.052532 31738 consensus_queue.cc:1048] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
W20260709 13:10:39.061810 29993 connection.cc:256] RPC call timeout handler was delayed by -1.4018046340000865s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2227s for a response
I20260709 13:10:39.062616 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:39.061970 30099 raft_consensus.cc:2468] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 1.
I20260709 13:10:39.066326 31758 raft_consensus.cc:3060] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:39.020367 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:39.060259 31761 raft_consensus.cc:493] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:39.122583 30728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51004 (request call id 437) took 1721 ms. Trace:
I20260709 13:10:39.078450 30024 raft_consensus.cc:2468] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 4.
I20260709 13:10:39.085742 30170 raft_consensus.cc:2393] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 3: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
W20260709 13:10:39.114629 30021 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54206 (request call id 1355) took 3388 ms (client timeout 2205 ms). Trace:
I20260709 13:10:39.123736 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:39.019157 31756 leader_election.cc:290] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:10:39.061335 30169 rpcz_store.cc:269] 0709 13:10:37.418609 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.447743 (+ 29134us) service_pool.cc:224] Handling call
0709 13:10:38.976953 (+1529210us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:38.822656 30095 rpcz_store.cc:276] 0709 13:10:35.900499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.902671 (+  2172us) service_pool.cc:224] Handling call
0709 13:10:35.994307 (+ 91636us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:36.013879 (+ 19572us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:10:36.475903 (+462024us) log.cc:844] Serialized 14 byte log entry
0709 13:10:38.678079 (+2202176us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:38.694906 (+ 16827us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:38.700039 (+  5133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:38.710781 (+ 10742us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:38.723726 (+ 12945us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1087732,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":9225,"raft.queue_time_us":222999,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":3864,"thread_start_us":2537097,"threads_started":3,"wal-append.queue_time_us":881612}
I20260709 13:10:39.061002 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:39.076640 31874 raft_consensus.cc:697] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
W20260709 13:10:39.128728 30022 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54198 (request call id 1586) took 3273 ms (client timeout 2696 ms). Trace:
I20260709 13:10:39.130290 30736 raft_consensus.cc:2368] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 3. Current term is 4.
I20260709 13:10:39.071193 31728 raft_consensus.cc:740] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:39.132138 29993 leader_election.cc:304] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:39.134833 30068 leader_election.cc:304] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:39.136569 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:39.134913 31739 consensus_queue.cc:1048] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:10:39.129693 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:39.127786 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
W20260709 13:10:39.138813 30022 rpcz_store.cc:269] 0709 13:10:35.855093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.495024 (+1639931us) service_pool.cc:224] Handling call
0709 13:10:39.128532 (+1633508us) spinlock_profiling.cc:243] Waited 57.8 ms on lock 0x7b54001a95d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:10:39.128663 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":132992896}
I20260709 13:10:39.145910 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:39.079018 31881 raft_consensus.cc:493] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.138774 30172 raft_consensus.cc:2468] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 2.
I20260709 13:10:39.143112 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:39.144090 31756 raft_consensus.cc:2749] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:39.133140 31761 raft_consensus.cc:515] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:10:39.134374 30021 rpcz_store.cc:269] 0709 13:10:35.726004 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.727335 (+  1331us) service_pool.cc:224] Handling call
0709 13:10:39.085815 (+3358480us) spinlock_profiling.cc:243] Waited 205 ms on lock 0x7b54003c91d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:10:39.114535 (+ 28720us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":470690688}
I20260709 13:10:39.144143 31874 consensus_queue.cc:237] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:39.142470 31866 raft_consensus.cc:2764] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:10:39.131332 31764 leader_election.cc:290] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:39.127007 31869 leader_election.cc:290] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:39.150353 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:39.144727 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:39.142872 30019 raft_consensus.cc:2410] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:10:39.152848 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:39.134863 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:39.154165 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:39.216414 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:39.216643 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:39.217005 30099 raft_consensus.cc:2468] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 1.
I20260709 13:10:39.217108 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:39.217991 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:39.218221 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:39.219066 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:39.219244 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:39.219630 30099 raft_consensus.cc:2468] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 1.
I20260709 13:10:39.220288 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:39.220484 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:39.221335 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
W20260709 13:10:39.204692 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 51974.5us
W20260709 13:10:39.167851 30143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:39.222160 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:39.222816 30730 raft_consensus.cc:2468] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 1.
I20260709 13:10:39.223613 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:39.224427 30730 raft_consensus.cc:2410] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:39.224795 31797 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18a72905c2e24e33af2e64672417cfcf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:10:39.153553 30732 raft_consensus.cc:3055] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:10:39.226256 31814 log.cc:927] Time spent T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 2.725s	user 0.012s	sys 0.028s
I20260709 13:10:39.226311 30732 raft_consensus.cc:740] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:39.227478 30176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54540 (request call id 308) took 3919 ms. Trace:
I20260709 13:10:39.227223 30732 consensus_queue.cc:260] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:39.132671 30728 rpcz_store.cc:276] 0709 13:10:37.401277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.427436 (+ 26159us) service_pool.cc:224] Handling call
0709 13:10:37.507699 (+ 80263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:37.709782 (+202083us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.122330 (+1412548us) spinlock_profiling.cc:243] Waited 92.7 ms on lock 0x7b5400532854. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:10:39.122521 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":213110528}
W20260709 13:10:39.205651 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 53484us
I20260709 13:10:39.227820 30176 rpcz_store.cc:276] 0709 13:10:35.308239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.308421 (+   182us) service_pool.cc:224] Handling call
0709 13:10:35.310234 (+  1813us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:35.310444 (+   210us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:35.310467 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:35.310869 (+   402us) log.cc:844] Serialized 26 byte log entry
0709 13:10:35.866369 (+555500us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:35.866410 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:35.866488 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:39.213917 (+3347429us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b4400022b4c. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eeef3c85 00007f99eeef46a2 00007f99f1c661db 00007f99f1c61aaf 00007f99f1c5586e 00007f99f1c54bb6 00007f99f1c547d8 00007f99f1c5e221 00007f99f1c5e1d9 00007f99f1c5e169
0709 13:10:39.227226 (+ 13309us) raft_consensus.cc:1685] finished
0709 13:10:39.227246 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:39.227426 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":36334464,"thread_start_us":515664,"threads_started":1,"wal-append.queue_time_us":1128224}
I20260709 13:10:39.229434 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:39.208725 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:39.209683 31726 leader_election.cc:290] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:39.212595 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:39.153385 30177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43840 (request call id 1529) took 1734 ms. Trace:
I20260709 13:10:39.214818 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:39.229638 29993 leader_election.cc:400] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469) with higher term. Message: Invalid argument: T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 3. Current term is 4.
I20260709 13:10:39.216261 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:39.216254 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:39.230968 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:39.233883 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:39.203018 31810 raft_consensus.cc:493] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:39.221546 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:39.238102 30176 raft_consensus.cc:2368] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 4. Current term is 5.
I20260709 13:10:39.269222 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:39.269680 30176 raft_consensus.cc:2468] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 2.
I20260709 13:10:39.270358 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:39.270718 30176 raft_consensus.cc:2468] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 3.
I20260709 13:10:39.239358 29993 leader_election.cc:403] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:39.239951 30172 raft_consensus.cc:2468] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 2.
W20260709 13:10:39.206962 30023 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52098 (request call id 261) took 3211 ms (client timeout 2717 ms). Trace:
I20260709 13:10:39.271333 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:10:39.271463 30023 rpcz_store.cc:269] 0709 13:10:36.002506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.503134 (+1500628us) service_pool.cc:224] Handling call
0709 13:10:39.206745 (+1703611us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b540013ddd4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:10:39.206892 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2312808320}
W20260709 13:10:39.272471 30066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:39.152789 31852 leader_election.cc:290] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:39.276269 30737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56954 (request call id 391) took 1868 ms. Trace:
I20260709 13:10:39.238780 30177 rpcz_store.cc:276] 0709 13:10:37.419057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.526564 (+107507us) service_pool.cc:224] Handling call
0709 13:10:37.526831 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:37.652394 (+125563us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:37.652425 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:37.652476 (+    51us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:37.652505 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.153175 (+1500670us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b540011f3d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:10:39.153220 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:39.153336 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":288341376}
I20260709 13:10:39.204977 31761 leader_election.cc:290] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:39.254863 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:39.234972 30728 raft_consensus.cc:1275] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:39.151868 31881 raft_consensus.cc:3060] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:39.261445 30021 raft_consensus.cc:2376] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 3. Re-sending same reply.
I20260709 13:10:39.262138 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:39.281277 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:39.263686 31844 raft_consensus.cc:515] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:39.265400 31791 leader_election.cc:290] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:39.266297 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:39.291105 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:39.292063 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:39.237965 31728 consensus_queue.cc:260] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:39.292544 30027 raft_consensus.cc:2468] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 2.
I20260709 13:10:39.285086 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:39.293392 30731 raft_consensus.cc:2468] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 3.
I20260709 13:10:39.293349 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:39.296204 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:39.274672 29993 leader_election.cc:304] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:39.302740 31738 raft_consensus.cc:2749] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:39.276729 31810 raft_consensus.cc:515] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:39.276678 30737 rpcz_store.cc:276] 0709 13:10:37.408114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.408231 (+   117us) service_pool.cc:224] Handling call
0709 13:10:37.408503 (+   272us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:37.430808 (+ 22305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:37.430835 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:37.430874 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:37.430915 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.276058 (+1845143us) spinlock_profiling.cc:243] Waited 22.1 ms on lock 0x7b54006e3554. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:10:39.276097 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:39.276212 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":50893568}
I20260709 13:10:39.277976 31866 raft_consensus.cc:3060] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:10:39.238752 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:39.226190 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:39.281817 30176 raft_consensus.cc:3060] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:39.281795 30024 raft_consensus.cc:2393] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 4: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:39.152839 31851 raft_consensus.cc:515] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:39.282821 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:39.282969 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:39.285153 30730 raft_consensus.cc:2393] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 4: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:10:39.284070 30099 raft_consensus.cc:2468] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 2.
I20260709 13:10:39.286121 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:39.282734 30729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51014 (request call id 613) took 2803 ms. Trace:
I20260709 13:10:39.288790 31881 raft_consensus.cc:515] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:39.289951 31730 leader_election.cc:290] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:39.261690 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:39.318245 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:39.319536 30099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48558 (request call id 270) took 1013 ms. Trace:
I20260709 13:10:39.267059 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:39.303046 29993 leader_election.cc:304] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:39.318209 31708 raft_consensus.cc:515] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:39.272444 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:39.306581 30102 raft_consensus.cc:2393] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 3: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:10:39.322584 31881 leader_election.cc:290] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:39.031613 30020 rpcz_store.cc:276] 0709 13:10:35.959217 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.721540 (+1762323us) service_pool.cc:224] Handling call
0709 13:10:37.736033 (+ 14493us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:38.275690 (+539657us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:38.280483 (+  4793us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:38.387642 (+107159us) log.cc:844] Serialized 26 byte log entry
0709 13:10:38.933659 (+546017us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:38.947113 (+ 13454us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:38.950626 (+  3513us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:39.029652 (+ 79026us) raft_consensus.cc:1685] finished
0709 13:10:39.029669 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:39.029809 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":398085,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":100,"thread_start_us":368550,"threads_started":1,"wal-append.queue_time_us":506730}
I20260709 13:10:39.306690 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:39.302683 31579 leader_election.cc:290] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:39.319813 31810 leader_election.cc:290] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:39.306572 30177 raft_consensus.cc:2468] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 3.
I20260709 13:10:39.324301 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:39.312201 30101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48558 (request call id 271) took 1006 ms. Trace:
I20260709 13:10:39.315362 30095 raft_consensus.cc:2468] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 3.
I20260709 13:10:39.324947 30101 rpcz_store.cc:276] 0709 13:10:38.306135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.027250 (+721115us) service_pool.cc:224] Handling call
0709 13:10:39.312054 (+284804us) spinlock_profiling.cc:243] Waited 29.5 ms on lock 0x7b54001f7054. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:10:39.312150 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67918592}
I20260709 13:10:39.326124 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:39.326717 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:39.327255 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:39.327997 30095 raft_consensus.cc:2393] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 5: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:10:39.323007 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:39.323211 31708 leader_election.cc:290] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:39.309425 30169 raft_consensus.cc:2410] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 for term 3 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:10:39.328380 31866 raft_consensus.cc:2749] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469) with higher term. Message: Invalid argument: T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 3. Current term is 4.
I20260709 13:10:39.328805 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:39.329030 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:39.329154 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:39.329769 30169 raft_consensus.cc:2468] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 2.
I20260709 13:10:39.330121 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:39.330638 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:39.321893 30023 raft_consensus.cc:2393] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 5: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:39.320763 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:39.331279 30169 raft_consensus.cc:2468] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 3.
I20260709 13:10:39.331828 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:39.332506 30023 raft_consensus.cc:2393] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 2: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:10:39.332823 30024 raft_consensus.cc:2468] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 4.
I20260709 13:10:39.333199 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:39.322906 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:39.322120 30022 raft_consensus.cc:2393] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 3: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:39.334164 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:39.320806 30027 raft_consensus.cc:2393] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 4: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:39.335201 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:39.327831 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:39.321522 30736 raft_consensus.cc:2468] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
I20260709 13:10:39.322238 29993 leader_election.cc:400] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 election: Vote denied by peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001) with higher term. Message: Invalid argument: T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 4. Current term is 5.
I20260709 13:10:39.336851 29993 leader_election.cc:403] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:10:39.335795 30022 raft_consensus.cc:2468] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
I20260709 13:10:39.332338 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:39.308791 30021 raft_consensus.cc:2376] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 3. Re-sending same reply.
I20260709 13:10:39.337531 31816 raft_consensus.cc:3060] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:39.337257 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:39.338331 29993 leader_election.cc:304] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:39.330646 30102 raft_consensus.cc:2468] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 1.
I20260709 13:10:39.335254 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:39.371320 30024 raft_consensus.cc:2468] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 3.
I20260709 13:10:39.371865 30024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54198 (request call id 1594) took 1028 ms. Trace:
I20260709 13:10:39.372258 30024 rpcz_store.cc:276] 0709 13:10:38.343310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.334993 (+991683us) service_pool.cc:224] Handling call
0709 13:10:39.371805 (+ 36812us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32256}
I20260709 13:10:39.338253 30177 raft_consensus.cc:2368] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 2. Current term is 3.
I20260709 13:10:39.336916 30023 raft_consensus.cc:2468] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
I20260709 13:10:39.315344 30729 rpcz_store.cc:276] 0709 13:10:36.479018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.482859 (+  3841us) service_pool.cc:224] Handling call
0709 13:10:36.660561 (+177702us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:37.368415 (+707854us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:37.374021 (+  5606us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:37.382843 (+  8822us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:37.387511 (+  4668us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.267639 (+1880128us) spinlock_profiling.cc:243] Waited 652 ms on lock 0x7b54005c0dd4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:10:39.269290 (+  1651us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:39.281143 (+ 11853us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1498489216}
I20260709 13:10:39.315358 30176 raft_consensus.cc:2468] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 4.
I20260709 13:10:39.374269 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:39.376169 30702 leader_election.cc:304] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:39.377321 29993 leader_election.cc:304] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:39.377328 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:39.378499 30101 raft_consensus.cc:2468] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 3.
I20260709 13:10:39.379462 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:39.380155 30101 raft_consensus.cc:2393] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 3: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:10:39.380048 31866 raft_consensus.cc:2804] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:39.381116 29993 leader_election.cc:304] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:39.374982 30102 raft_consensus.cc:2468] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 3.
I20260709 13:10:39.381906 30702 leader_election.cc:304] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:39.381461 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:39.382910 30702 leader_election.cc:304] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:39.383232 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:39.383387 29993 leader_election.cc:304] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:39.384091 30702 leader_election.cc:304] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:39.384124 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:39.320060 30099 rpcz_store.cc:276] 0709 13:10:38.305902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.317979 (+1012077us) service_pool.cc:224] Handling call
0709 13:10:39.319483 (+  1504us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:39.384668 29993 leader_election.cc:304] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:39.402360 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:39.385437 31715 raft_consensus.cc:2804] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:39.403498 30102 raft_consensus.cc:2393] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 4: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:39.401851 31831 raft_consensus.cc:2749] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:39.380635 31708 raft_consensus.cc:2804] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:39.386114 31874 raft_consensus.cc:2804] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:39.385809 31810 raft_consensus.cc:493] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.385785 31846 raft_consensus.cc:2804] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:39.385849 31716 raft_consensus.cc:2804] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:39.399629 31851 leader_election.cc:290] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:39.389876 31677 raft_consensus.cc:2749] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:39.322238 31730 raft_consensus.cc:2804] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:39.394194 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:39.380681 31866 raft_consensus.cc:493] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:39.385720 31758 raft_consensus.cc:515] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:39.383796 30169 raft_consensus.cc:2468] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 3.
I20260709 13:10:39.403976 31797 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:56954 (request call id 385) took 4993 ms. Trace:
I20260709 13:10:39.357709 31852 raft_consensus.cc:493] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:39.412449 30702 leader_election.cc:304] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:39.400935 30096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48558 (request call id 262) took 1181 ms. Trace:
I20260709 13:10:39.416071 30096 rpcz_store.cc:276] 0709 13:10:38.219215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.219327 (+   112us) service_pool.cc:224] Handling call
0709 13:10:38.219581 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:38.257477 (+ 37896us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:38.257507 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:38.257544 (+    37us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:38.257571 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.400716 (+1143145us) spinlock_profiling.cc:243] Waited 37.7 ms on lock 0x7b540043f654. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:10:39.400756 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:39.400859 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":86775168}
W20260709 13:10:39.402560 30700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:39.337028 30095 raft_consensus.cc:2468] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 2.
I20260709 13:10:39.403831 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:39.419121 30101 raft_consensus.cc:2410] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:10:39.383076 30170 raft_consensus.cc:2393] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 5: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:10:39.421025 30700 leader_election.cc:304] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:39.404563 29993 leader_election.cc:304] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:39.422214 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:39.422494 31816 raft_consensus.cc:2749] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001) with higher term. Message: Invalid argument: T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 4. Current term is 5.
I20260709 13:10:39.422871 30099 raft_consensus.cc:2468] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 3.
I20260709 13:10:39.423171 31816 raft_consensus.cc:2804] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:10:39.411811 30142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:39.423591 31816 raft_consensus.cc:493] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:39.423790 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:39.424467 30099 raft_consensus.cc:2468] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 3.
I20260709 13:10:39.425246 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:39.410945 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:39.404883 31874 raft_consensus.cc:493] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:39.407315 31730 raft_consensus.cc:493] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.426723 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:39.408335 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:39.411791 31866 raft_consensus.cc:3060] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:39.407552 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:39.437404 30024 raft_consensus.cc:2468] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
I20260709 13:10:39.404060 31715 raft_consensus.cc:493] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.404739 31708 raft_consensus.cc:493] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.407325 31566 raft_consensus.cc:2804] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:39.425436 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:39.429342 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:39.443200 30096 raft_consensus.cc:2468] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 3.
I20260709 13:10:39.405124 31810 raft_consensus.cc:515] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:39.429733 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:39.405352 31846 raft_consensus.cc:493] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.405558 31716 raft_consensus.cc:493] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:39.407222 31737 leader_election.cc:290] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:39.406117 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:39.442044 30021 raft_consensus.cc:2368] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 4. Current term is 5.
W20260709 13:10:39.375217 31697 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.994s	user 0.012s	sys 0.014s
I20260709 13:10:39.424005 31816 raft_consensus.cc:3060] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:39.428646 31831 raft_consensus.cc:2804] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:39.436080 31873 raft_consensus.cc:2804] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:39.432518 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:39.436097 31730 raft_consensus.cc:3060] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:39.448732 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:39.433485 31874 raft_consensus.cc:3060] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:39.450376 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:39.433020 30176 raft_consensus.cc:2393] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 5: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:10:39.439762 31708 raft_consensus.cc:3060] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:39.464795 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:39.465523 30102 raft_consensus.cc:2393] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 3: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:10:39.438933 31715 raft_consensus.cc:3060] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:39.452941 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:39.440496 31758 leader_election.cc:290] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:39.467235 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:39.467788 30176 raft_consensus.cc:3060] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:10:39.468145 31820 raft_consensus.cc:493] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:39.468571 31820 raft_consensus.cc:3060] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:39.410552 31797 rpcz_store.cc:276] 0709 13:10:34.418423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.424125 (+  5702us) service_pool.cc:224] Handling call
0709 13:10:35.263029 (+838904us) ts_tablet_manager.cc:934] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a: Initiating tablet copy from peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
0709 13:10:39.223491 (+3960462us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:10:39.265089 (+ 41598us) tablet_metadata.cc:665] Metadata flushed
0709 13:10:39.265203 (+   114us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:10:39.401073 (+135870us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:10:39.401352 (+   279us) tablet_replica.cc:206] Creating consensus instance
0709 13:10:39.401649 (+   297us) ts_tablet_manager.cc:989] Replica registered.
0709 13:10:39.401706 (+    57us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":109993,"tablet-copy.queue_time_us":751747,"thread_start_us":1280317,"threads_started":2}
I20260709 13:10:39.432036 30729 raft_consensus.cc:2468] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 3.
I20260709 13:10:39.430822 31852 raft_consensus.cc:515] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:39.441710 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:39.458288 31873 raft_consensus.cc:493] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.450711 31846 raft_consensus.cc:3060] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:39.530452 30176 raft_consensus.cc:2468] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 4.
I20260709 13:10:39.534512 30024 raft_consensus.cc:2468] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 4.
I20260709 13:10:39.535161 29993 leader_election.cc:304] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:39.451884 31716 raft_consensus.cc:3060] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:39.455693 31831 raft_consensus.cc:493] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:39.449563 31566 raft_consensus.cc:697] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
W20260709 13:10:39.453519 31697 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.072s	user 0.012s	sys 0.014s
I20260709 13:10:39.470225 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:39.454118 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:39.470551 30101 raft_consensus.cc:2468] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 2.
I20260709 13:10:39.555128 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:39.471318 30142 leader_election.cc:304] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:39.473592 29994 leader_election.cc:304] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:39.475817 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
W20260709 13:10:39.555871 30142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 84596.2us
I20260709 13:10:39.556205 30096 raft_consensus.cc:3060] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:39.533844 31873 raft_consensus.cc:3060] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:39.474208 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:39.560202 30102 raft_consensus.cc:2468] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 3.
I20260709 13:10:39.526001 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:39.540728 31579 raft_consensus.cc:2804] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:39.459066 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:39.536522 30700 leader_election.cc:304] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:39.550756 31831 raft_consensus.cc:3060] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:39.528303 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:39.467883 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
W20260709 13:10:39.565007 30140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:39.565536 30140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:39.552564 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:39.555389 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:39.451576 30099 raft_consensus.cc:2468] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 3.
I20260709 13:10:39.566388 30101 raft_consensus.cc:2468] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 1.
I20260709 13:10:39.567190 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:39.555728 30024 raft_consensus.cc:2468] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 3.
I20260709 13:10:39.557669 30142 leader_election.cc:304] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:39.567750 30101 raft_consensus.cc:2468] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 3.
I20260709 13:10:39.527684 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:39.538189 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:39.541007 31797 tablet_copy_client.cc:806] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 0 data blocks...
I20260709 13:10:39.563764 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:39.562837 30172 raft_consensus.cc:3060] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:39.465081 30174 raft_consensus.cc:2468] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 2.
I20260709 13:10:39.562506 30095 raft_consensus.cc:2393] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 4: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
W20260709 13:10:39.560472 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 86935.1us
I20260709 13:10:39.787396 29994 leader_election.cc:304] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:39.776204 31710 raft_consensus.cc:3060] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:39.788398 29994 leader_election.cc:304] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
W20260709 13:10:39.565920 30140 connection.cc:256] RPC call timeout handler was delayed by -1.6869318310000381s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20710000000000003s for a response
I20260709 13:10:39.560846 31851 raft_consensus.cc:2804] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:10:39.617039 30143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:39.567080 31579 raft_consensus.cc:697] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:39.603030 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:39.726927 31693 leader_election.cc:290] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:39.806937 31579 consensus_queue.cc:237] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:39.797197 31810 leader_election.cc:290] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:10:39.798499 31896 log.cc:927] Time spent T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.245s	user 0.000s	sys 0.010s
I20260709 13:10:39.810842 31781 leader_election.cc:290] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:39.811380 31728 raft_consensus.cc:3060] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:39.812433 31715 raft_consensus.cc:515] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:39.813436 30028 raft_consensus.cc:1240] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 2. Current term is 4. Ops: []
I20260709 13:10:39.568614 30020 raft_consensus.cc:3060] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:39.603278 31680 consensus_queue.cc:1048] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.134s
I20260709 13:10:39.741791 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:39.815018 30171 raft_consensus.cc:2468] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 2.
I20260709 13:10:39.815127 31715 leader_election.cc:290] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:39.815877 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:39.816556 30171 raft_consensus.cc:2393] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 3: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:10:39.817351 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:39.742167 30100 raft_consensus.cc:3060] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:39.818912 31846 raft_consensus.cc:515] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:39.820142 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:39.820815 31846 leader_election.cc:290] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:39.823674 31831 raft_consensus.cc:515] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:39.802208 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:37.710127 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:39.743535 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:39.826104 30173 raft_consensus.cc:2468] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 2.
I20260709 13:10:39.826910 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:39.827409 30173 raft_consensus.cc:2468] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 4.
I20260709 13:10:39.571118 30102 raft_consensus.cc:2468] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 3.
I20260709 13:10:39.827533 30732 raft_consensus.cc:3060] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:39.798095 31851 raft_consensus.cc:493] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.564872 31714 raft_consensus.cc:2804] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:39.828176 31851 raft_consensus.cc:3060] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:39.828608 31714 raft_consensus.cc:697] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:39.828905 30100 raft_consensus.cc:1275] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.563176 31737 raft_consensus.cc:2804] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:10:39.829825 30019 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52098 (request call id 269) took 1523 ms (client timeout 1935 ms). Trace:
I20260709 13:10:39.829957 30094 raft_consensus.cc:1240] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:39.780712 31824 leader_election.cc:290] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:39.830199 31737 raft_consensus.cc:493] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.830796 31737 raft_consensus.cc:3060] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:39.831321 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:39.832355 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:39.834157 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:39.829442 31714 consensus_queue.cc:237] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:39.835489 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:39.781198 30021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52098 (request call id 264) took 1475 ms. Trace:
I20260709 13:10:39.837271 31866 raft_consensus.cc:515] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:39.830057 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:39.838627 31844 leader_election.cc:290] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 3 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:39.839331 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:10:39.839527 30098 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48558 (request call id 265) took 1618 ms (client timeout 1897 ms). Trace:
I20260709 13:10:39.836757 30021 rpcz_store.cc:276] 0709 13:10:38.305391 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.780017 (+1474626us) service_pool.cc:224] Handling call
0709 13:10:39.780438 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:39.780698 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:39.780725 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:39.780789 (+    64us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:39.780847 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.780950 (+   103us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:39.781106 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:39.839870 30098 rpcz_store.cc:269] 0709 13:10:38.221595 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.221700 (+   105us) service_pool.cc:224] Handling call
0709 13:10:39.839348 (+1617648us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b5400266454. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:10:39.839468 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":344977152}
I20260709 13:10:39.840325 30143 leader_election.cc:304] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:39.840878 30027 raft_consensus.cc:1240] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:39.841359 31680 raft_consensus.cc:2749] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:39.839926 30173 raft_consensus.cc:2468] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
I20260709 13:10:39.841954 30027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52098 (request call id 267) took 1535 ms. Trace:
I20260709 13:10:39.842494 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:39.742987 29921 catalog_manager.cc:5697] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 1 to 2, leader changed from 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 2 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:39.843068 30173 raft_consensus.cc:2468] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
I20260709 13:10:39.793043 29994 leader_election.cc:304] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:39.794919 31815 raft_consensus.cc:493] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:39.843317 30143 leader_election.cc:304] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:39.843667 31815 raft_consensus.cc:515] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:39.845306 30143 leader_election.cc:304] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:39.773341 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:39.808598 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:39.846247 30177 raft_consensus.cc:2468] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 3.
W20260709 13:10:39.846313 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 53351.6us
I20260709 13:10:39.846681 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:39.846961 29994 leader_election.cc:304] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
W20260709 13:10:39.786151 31895 log.cc:927] Time spent T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.215s	user 0.002s	sys 0.006s
I20260709 13:10:39.797848 31699 raft_consensus.cc:2749] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:39.838275 30028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 1369) took 3818 ms. Trace:
I20260709 13:10:39.829427 30100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33992 (request call id 1438) took 1078 ms. Trace:
I20260709 13:10:39.842272 30027 rpcz_store.cc:276] 0709 13:10:38.306207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.809296 (+1503089us) service_pool.cc:224] Handling call
0709 13:10:39.809582 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:39.841223 (+ 31641us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.841720 (+   497us) spinlock_profiling.cc:243] Waited 31.1 ms on lock 0x7b54004173d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:10:39.841906 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71574912}
I20260709 13:10:39.847275 30177 raft_consensus.cc:1240] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:39.859637 30028 rpcz_store.cc:276] 0709 13:10:36.019971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.770212 (+3750241us) service_pool.cc:224] Handling call
0709 13:10:39.770458 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:39.813778 (+ 43320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.838080 (+ 24302us) spinlock_profiling.cc:243] Waited 42.8 ms on lock 0x7b54000749d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:10:39.838223 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":98471296}
I20260709 13:10:39.861070 30028 raft_consensus.cc:1240] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260709 13:10:39.861637 30028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52098 (request call id 272) took 1554 ms. Trace:
I20260709 13:10:39.802474 31790 raft_consensus.cc:2804] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:39.799180 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:39.803121 30172 raft_consensus.cc:2468] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 4.
I20260709 13:10:39.806032 30729 raft_consensus.cc:3060] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:39.748587 30066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:39.850410 30700 leader_election.cc:304] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
W20260709 13:10:39.867070 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 62895.9us
I20260709 13:10:39.842221 31737 raft_consensus.cc:515] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:39.569877 31791 raft_consensus.cc:2804] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:39.711095 31566 consensus_queue.cc:237] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:39.835427 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:39.797088 31675 raft_consensus.cc:493] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:39.841477 30021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52098 (request call id 268) took 1535 ms. Trace:
I20260709 13:10:39.849818 30100 rpcz_store.cc:276] 0709 13:10:38.773908 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.741733 (+967825us) service_pool.cc:224] Handling call
0709 13:10:39.742059 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:39.829212 (+ 87153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.829377 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:39.883610 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:39.884174 30100 raft_consensus.cc:2468] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 3.
I20260709 13:10:39.885087 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:39.864867 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:39.864672 30143 leader_election.cc:304] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:39.854122 29921 catalog_manager.cc:5697] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:39.867802 30700 leader_election.cc:400] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Vote denied by peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451) with higher term. Message: Invalid argument: T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 4. Current term is 5.
I20260709 13:10:39.886785 30171 raft_consensus.cc:2468] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 1.
I20260709 13:10:39.887655 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:39.870368 30101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33990 (request call id 1543) took 1134 ms. Trace:
I20260709 13:10:39.825513 31831 leader_election.cc:290] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:39.872649 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:39.873777 29924 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51818 (request call id 320) took 5533 ms. Trace:
I20260709 13:10:39.889681 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:39.888653 30101 rpcz_store.cc:276] 0709 13:10:38.735634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.583360 (+847726us) service_pool.cc:224] Handling call
0709 13:10:39.869710 (+286350us) spinlock_profiling.cc:243] Waited 35.7 ms on lock 0x7b5800073598. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eef95b71 00007f99eef95a22 00007f99f7eaec09 00007f99f7008ee0 00007f99f70d20ab 00007f99f70d2131 00007f99f7093fc0 00007f99f707e929 00007f99f707e3d2 00007f99f05f5bd4
0709 13:10:39.869921 (+   211us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:39.870084 (+   163us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:39.870108 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:39.870147 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:39.870175 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.870224 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:39.870315 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82083584}
I20260709 13:10:39.864614 30703 leader_election.cc:304] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:39.867782 31790 raft_consensus.cc:493] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.848555 31762 leader_election.cc:290] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:39.839320 31866 leader_election.cc:290] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:39.861951 30028 rpcz_store.cc:276] 0709 13:10:38.307437 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.860550 (+1553113us) service_pool.cc:224] Handling call
0709 13:10:39.860839 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:39.861409 (+   570us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.861587 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:39.845568 31815 leader_election.cc:290] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:39.862529 30024 raft_consensus.cc:2393] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 4: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:39.783424 30096 raft_consensus.cc:2468] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 4.
I20260709 13:10:39.820735 30170 raft_consensus.cc:2468] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
I20260709 13:10:39.866451 31715 raft_consensus.cc:2804] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:39.847306 30168 raft_consensus.cc:2468] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 3.
I20260709 13:10:39.876857 31791 raft_consensus.cc:493] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.876828 31844 raft_consensus.cc:2804] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:39.948307 30096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33990 (request call id 1558) took 1018 ms. Trace:
I20260709 13:10:39.959802 30096 rpcz_store.cc:276] 0709 13:10:38.930156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.461971 (+531815us) service_pool.cc:224] Handling call
0709 13:10:39.948246 (+486275us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:39.889724 29924 rpcz_store.cc:276] 0709 13:10:34.316645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:34.340718 (+ 24073us) service_pool.cc:224] Handling call
0709 13:10:39.850285 (+5509567us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:35.111244 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:35.113292 (+  2048us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:35.113322 (+    30us) write_op.cc:435] Acquired schema lock
0709 13:10:35.113349 (+    27us) tablet.cc:662] Decoding operations
0709 13:10:35.115599 (+  2250us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:35.115651 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:35.115676 (+    25us) tablet.cc:685] Acquiring locks for 4 operations
0709 13:10:35.116050 (+   374us) tablet.cc:701] Row locks acquired
0709 13:10:35.116069 (+    19us) write_op.cc:260] PREPARE: finished
0709 13:10:35.116198 (+   129us) write_op.cc:270] Start()
0709 13:10:35.116299 (+   101us) write_op.cc:276] Timestamp: P: 1783602635116154 usec, L: 0
0709 13:10:35.116321 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:10:35.117906 (+  1585us) log.cc:844] Serialized 1690 byte log entry
0709 13:10:36.023928 (+906022us) op_driver.cc:464] REPLICATION: finished
0709 13:10:36.740363 (+716435us) write_op.cc:301] APPLY: starting
0709 13:10:36.772164 (+ 31801us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:36.792406 (+ 20242us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:36.792531 (+   125us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:37.182839 (+390308us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:37.183030 (+   191us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=4
0709 13:10:37.183074 (+    44us) write_op.cc:312] APPLY: finished
0709 13:10:37.216482 (+ 33408us) log.cc:844] Serialized 41 byte log entry
0709 13:10:37.360971 (+144489us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:37.361066 (+    95us) write_op.cc:454] Released schema lock
0709 13:10:37.361102 (+    36us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:37.361498 (+   396us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:37.361531 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":69509,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":673447,"apply.run_cpu_time_us":4685,"apply.run_wall_time_us":636643,"num_ops":4,"prepare.queue_time_us":626524,"prepare.run_cpu_time_us":14586,"prepare.run_wall_time_us":211391,"raft.queue_time_us":638559,"raft.run_cpu_time_us":13341,"raft.run_wall_time_us":125834,"replication_time_us":907458,"thread_start_us":1276050,"threads_started":5,"wal-append.queue_time_us":504323,"wal-append.run_cpu_time_us":44533,"wal-append.run_wall_time_us":3370000}]]}
I20260709 13:10:39.953608 31680 raft_consensus.cc:2749] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:39.893723 29921 catalog_manager.cc:5697] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 3 to 4, leader changed from c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) to 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68). New cstate: current_term: 4 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:39.964458 30171 raft_consensus.cc:1275] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:10:39.830245 30019 rpcz_store.cc:269] 0709 13:10:38.306719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.018210 (+711491us) service_pool.cc:224] Handling call
0709 13:10:39.829623 (+811413us) spinlock_profiling.cc:243] Waited 62.6 ms on lock 0x7b54000df054. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:10:39.829750 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":143922944}
I20260709 13:10:39.959503 31791 raft_consensus.cc:3060] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:39.910391 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:39.950263 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:39.893656 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:39.876504 31810 raft_consensus.cc:2804] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:39.890646 31675 raft_consensus.cc:515] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:39.930624 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:39.899288 30703 leader_election.cc:304] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:39.958636 30027 raft_consensus.cc:1275] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:39.947510 30099 raft_consensus.cc:1275] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:10:39.871709 31797 tablet_copy_client.cc:670] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:10:39.948910 31806 raft_consensus.cc:2804] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:39.904623 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:39.949131 31715 raft_consensus.cc:493] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:39.966174 31844 raft_consensus.cc:493] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:39.953857 31790 raft_consensus.cc:3060] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:39.966951 29921 catalog_manager.cc:5697] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 1 to 2, leader changed from 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 2 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:39.971758 31874 consensus_meta.cc:287] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent flushing consensus metadata: real 0.509s	user 0.014s	sys 0.004s
W20260709 13:10:40.031390 31708 consensus_meta.cc:287] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4: Time spent flushing consensus metadata: real 0.556s	user 0.011s	sys 0.001s
I20260709 13:10:40.057027 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:40.059109 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:40.020610 31810 raft_consensus.cc:493] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:40.032876 31724 raft_consensus.cc:2804] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:40.040923 31844 raft_consensus.cc:3060] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:39.972435 31852 leader_election.cc:290] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:39.916503 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:39.961313 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:39.882539 30021 rpcz_store.cc:276] 0709 13:10:38.306436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.840703 (+1534267us) service_pool.cc:224] Handling call
0709 13:10:39.840998 (+   295us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:39.841172 (+   174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:39.841197 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:39.841240 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:39.841270 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:39.841321 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:39.841423 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:39.981045 31851 raft_consensus.cc:515] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:39.983116 30019 raft_consensus.cc:1240] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 13:10:39.999531 31816 consensus_meta.cc:287] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4: Time spent flushing consensus metadata: real 0.543s	user 0.004s	sys 0.005s
I20260709 13:10:39.916019 31846 consensus_queue.cc:1059] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 13:10:40.075893 30169 raft_consensus.cc:2468] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 1.
I20260709 13:10:40.024416 30027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54198 (request call id 1597) took 1680 ms. Trace:
I20260709 13:10:40.115461 30176 raft_consensus.cc:1240] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:10:40.115370 30027 rpcz_store.cc:276] 0709 13:10:38.344126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.880532 (+1536406us) service_pool.cc:224] Handling call
0709 13:10:39.954138 (+ 73606us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:40.024191 (+ 70053us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.024366 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:40.024994 30102 raft_consensus.cc:1240] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:40.065183 31716 raft_consensus.cc:515] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:40.033202 30100 raft_consensus.cc:2393] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 2: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:10:40.041477 29921 catalog_manager.cc:5697] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:40.074316 31708 raft_consensus.cc:515] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:40.032754 31806 raft_consensus.cc:493] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:40.037040 31715 raft_consensus.cc:3060] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:40.122371 30019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 1371) took 1777 ms. Trace:
I20260709 13:10:40.129848 30027 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
mode: GRACEFUL
new_leader_uuid: "5ec73dc157ed476ca903a7d596271719"
 from {username='slave'} at 127.0.0.1:47450
I20260709 13:10:40.130503 30027 raft_consensus.cc:606] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Received request to transfer leadership to TS 5ec73dc157ed476ca903a7d596271719
W20260709 13:10:40.094969 30700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:40.095376 30142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:40.096230 30098 raft_consensus.cc:2468] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 3.
I20260709 13:10:40.101399 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:40.075794 31810 raft_consensus.cc:3060] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:40.074980 30099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33992 (request call id 1433) took 1338 ms. Trace:
I20260709 13:10:40.129635 31806 raft_consensus.cc:3060] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:40.139986 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 271446us
I20260709 13:10:40.141824 30729 raft_consensus.cc:2468] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 3.
I20260709 13:10:40.143719 31716 leader_election.cc:290] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 3 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:40.133313 30019 rpcz_store.cc:276] 0709 13:10:38.345037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.982556 (+1637519us) service_pool.cc:224] Handling call
0709 13:10:39.982894 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:40.110066 (+127172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.120318 (+ 10252us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:40.145533 31680 raft_consensus.cc:2804] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:40.145933 31680 raft_consensus.cc:493] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:40.146277 31680 raft_consensus.cc:3060] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:40.146591 31806 raft_consensus.cc:515] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:40.147032 31708 leader_election.cc:290] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:40.148080 30142 leader_election.cc:304] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
W20260709 13:10:40.140044 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 275375us
I20260709 13:10:40.151648 30143 leader_election.cc:304] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:40.153317 30175 raft_consensus.cc:1275] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:10:40.079218 31737 leader_election.cc:290] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:40.079403 31724 raft_consensus.cc:493] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:40.046875 31874 raft_consensus.cc:515] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:40.113960 30734 raft_consensus.cc:2468] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 3.
I20260709 13:10:39.955786 30024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54198 (request call id 1604) took 1137 ms. Trace:
I20260709 13:10:40.160915 30024 rpcz_store.cc:276] 0709 13:10:38.818782 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.667797 (+849015us) service_pool.cc:224] Handling call
0709 13:10:39.955732 (+287935us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:39.971993 30732 raft_consensus.cc:1275] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
W20260709 13:10:40.091290 30737 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.018s	sys 0.029s
W20260709 13:10:40.169792 30737 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.018s	sys 0.029s
I20260709 13:10:40.134838 30700 leader_election.cc:304] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:40.156478 30143 leader_election.cc:304] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
W20260709 13:10:40.025247 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 126038us
I20260709 13:10:40.112187 31816 raft_consensus.cc:515] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:40.172806 30703 leader_election.cc:304] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:40.104990 30702 leader_election.cc:400] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 election: Vote denied by peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001) with higher term. Message: Invalid argument: T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 2. Current term is 3.
I20260709 13:10:40.175053 30068 leader_election.cc:304] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:40.175351 30702 leader_election.cc:403] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:10:40.175999 30068 leader_election.cc:304] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:40.158806 30021 raft_consensus.cc:1240] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 4. Current term is 5. Ops: []
W20260709 13:10:40.171060 31873 consensus_meta.cc:287] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent flushing consensus metadata: real 0.608s	user 0.008s	sys 0.000s
I20260709 13:10:40.166345 30020 raft_consensus.cc:2468] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 3.
I20260709 13:10:40.138873 30099 rpcz_store.cc:276] 0709 13:10:38.736448 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.610567 (+874119us) service_pool.cc:224] Handling call
0709 13:10:39.871359 (+260792us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:40.032946 (+161587us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.071284 (+ 38338us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:40.202914 31676 raft_consensus.cc:2749] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:40.203114 31675 leader_election.cc:290] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:10:40.176047 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 327662us
I20260709 13:10:40.160467 31724 raft_consensus.cc:3060] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:40.204427 30026 raft_consensus.cc:1240] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:40.204783 31791 raft_consensus.cc:515] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:40.205513 30026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52098 (request call id 262) took 4195 ms. Trace:
I20260709 13:10:40.205852 30026 rpcz_store.cc:276] 0709 13:10:36.010002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:37.737574 (+1727572us) service_pool.cc:224] Handling call
0709 13:10:39.800807 (+2063233us) spinlock_profiling.cc:243] Waited 9.55 ms on lock 0x7b5800003698. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eef95b71 00007f99eef95a22 00007f99f7eaec09 00007f99f7008ee0 00007f99f70d20ab 00007f99f70d2131 00007f99f7093fc0 00007f99f707e929 00007f99f707e3d2 00007f99f05f5bd4
0709 13:10:40.204274 (+403467us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:40.204803 (+   529us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.205330 (+   527us) spinlock_profiling.cc:243] Waited 403 ms on lock 0x7b5400354b50. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20b98ad 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:10:40.205440 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":949436928}
I20260709 13:10:40.207355 31791 leader_election.cc:290] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:40.183271 30024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
mode: GRACEFUL
new_leader_uuid: "c99569d27a6f4c648eae7119fe3db124"
 from {username='slave'} at 127.0.0.1:47450
I20260709 13:10:40.209137 30024 raft_consensus.cc:606] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Received request to transfer leadership to TS c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:40.209499 30024 raft_consensus.cc:614] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:40.184366 31816 leader_election.cc:290] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:40.184499 30734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51004 (request call id 441) took 1900 ms. Trace:
I20260709 13:10:40.184914 31900 raft_consensus.cc:2804] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:40.185305 31874 leader_election.cc:290] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 3 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:40.186087 30025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 1370) took 4139 ms. Trace:
I20260709 13:10:40.188539 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:40.189131 31728 raft_consensus.cc:2749] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001) with higher term. Message: Invalid argument: T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 2. Current term is 3.
W20260709 13:10:40.189510 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 84684.6us
I20260709 13:10:40.189914 30027 raft_consensus.cc:1240] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:40.191540 31710 raft_consensus.cc:3055] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:40.192018 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:40.194259 31806 leader_election.cc:290] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:40.195118 31851 leader_election.cc:290] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:10:40.174973 31820 consensus_meta.cc:287] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4: Time spent flushing consensus metadata: real 0.706s	user 0.008s	sys 0.010s
I20260709 13:10:40.233075 31820 raft_consensus.cc:515] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:40.235196 31820 leader_election.cc:290] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:40.179946 30094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33992 (request call id 1442) took 1292 ms. Trace:
W20260709 13:10:40.198946 31730 consensus_meta.cc:287] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent flushing consensus metadata: real 0.729s	user 0.014s	sys 0.007s
I20260709 13:10:40.179818 31693 raft_consensus.cc:2804] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:40.161926 31700 raft_consensus.cc:493] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.201972 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:40.235811 30094 rpcz_store.cc:276] 0709 13:10:38.888103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.791302 (+903199us) service_pool.cc:224] Handling call
0709 13:10:39.829775 (+ 38473us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:39.830544 (+   769us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.170026 (+339482us) spinlock_profiling.cc:243] Waited 38.2 ms on lock 0x7b5400265a50. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20b98ad 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:10:40.177718 (+  7692us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":87759744}
I20260709 13:10:40.202766 31902 consensus_queue.cc:1059] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:40.172219 30732 pending_rounds.cc:85] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a: Aborting all ops after (but not including) 4
I20260709 13:10:40.210160 30734 rpcz_store.cc:276] 0709 13:10:38.283978 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:38.284125 (+   147us) service_pool.cc:224] Handling call
0709 13:10:40.184330 (+1900205us) spinlock_profiling.cc:243] Waited 1.76 s on lock 0x7b54006018d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:10:40.184427 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4053948288}
I20260709 13:10:40.214566 30068 leader_election.cc:304] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:40.239570 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:40.240808 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:40.218158 30171 raft_consensus.cc:2393] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 4: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
W20260709 13:10:40.219264 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 346650us
I20260709 13:10:40.242328 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:40.243387 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:40.243937 30098 raft_consensus.cc:2468] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 2.
I20260709 13:10:40.244660 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:40.245115 30098 raft_consensus.cc:3060] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:40.223515 30702 leader_election.cc:304] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:40.219069 30025 rpcz_store.cc:276] 0709 13:10:36.046642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.769473 (+3722831us) service_pool.cc:224] Handling call
0709 13:10:39.769825 (+   352us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:39.797135 (+ 27310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:39.797188 (+    53us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:39.801584 (+  4396us) log.cc:844] Serialized 52 byte log entry
0709 13:10:40.013422 (+211838us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:40.013462 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.013531 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:40.185894 (+172363us) raft_consensus.cc:1685] finished
0709 13:10:40.185912 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.186037 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26835,"raft.queue_time_us":31671,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":144,"spinlock_wait_cycles":229248,"thread_start_us":211201,"threads_started":1,"wal-append.queue_time_us":301693}
I20260709 13:10:40.246063 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:40.219142 31824 raft_consensus.cc:2764] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:10:40.228356 31791 raft_consensus.cc:2804] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:40.228554 31762 raft_consensus.cc:2749] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:40.228816 30140 leader_election.cc:304] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:40.229388 31915 consensus_queue.cc:1048] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:40.224215 31710 raft_consensus.cc:740] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:40.246639 30101 raft_consensus.cc:2468] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 2.
I20260709 13:10:40.227931 31675 raft_consensus.cc:2804] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:40.241653 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:40.250314 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:40.278312 30100 raft_consensus.cc:2410] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 for term 3 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:10:40.238983 30142 leader_election.cc:304] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:40.221248 31846 consensus_queue.cc:1059] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 13:10:40.236991 30732 pending_rounds.cc:107] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:10:40.248106 30066 leader_election.cc:304] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:40.265092 31728 raft_consensus.cc:2749] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:40.189034 31790 raft_consensus.cc:515] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:40.275038 30098 raft_consensus.cc:2468] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 3.
I20260709 13:10:40.237082 31902 raft_consensus.cc:3055] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:40.276320 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:40.269832 30140 leader_election.cc:304] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:40.246807 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:40.247772 31693 raft_consensus.cc:493] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.219291 31873 raft_consensus.cc:515] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:40.235966 31730 raft_consensus.cc:515] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:40.306471 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:40.313864 30102 raft_consensus.cc:3060] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:40.284843 31851 raft_consensus.cc:2804] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:40.263485 31815 raft_consensus.cc:2804] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:40.217223 31900 raft_consensus.cc:493] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
W20260709 13:10:40.291433 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 135020us
I20260709 13:10:40.291771 30736 raft_consensus.cc:1240] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:40.265486 31791 raft_consensus.cc:493] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:40.289341 31824 raft_consensus.cc:2749] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:40.285684 30732 raft_consensus.cc:2889] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:40.265928 31700 raft_consensus.cc:515] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:40.278023 31759 consensus_queue.cc:1048] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
W20260709 13:10:40.263707 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 391109us
I20260709 13:10:40.288187 30066 leader_election.cc:304] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:40.259001 30068 leader_election.cc:304] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:40.305109 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:40.526753 30101 raft_consensus.cc:3060] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:40.527277 30143 leader_election.cc:304] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:40.529052 30143 leader_election.cc:304] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:40.530766 30143 leader_election.cc:304] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:40.532351 30143 leader_election.cc:304] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:10:40.532404 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 262535us
W20260709 13:10:40.532603 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 244274us
W20260709 13:10:40.535873 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 276806us
W20260709 13:10:40.536646 30143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:40.515838 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:40.505856 30023 raft_consensus.cc:2393] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 4: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:40.514662 30027 raft_consensus.cc:1275] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:40.538179 29993 leader_election.cc:304] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:40.541448 30174 raft_consensus.cc:1240] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:40.539180 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:40.319494 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:40.509253 30022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54198 (request call id 1620) took 1457 ms. Trace:
I20260709 13:10:40.544167 30022 rpcz_store.cc:276] 0709 13:10:39.051700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.403428 (+351728us) service_pool.cc:224] Handling call
0709 13:10:40.508622 (+1105194us) spinlock_profiling.cc:243] Waited 850 ms on lock 0x7b54001a95d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:10:40.509006 (+   384us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1955134848}
I20260709 13:10:40.551255 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:40.543804 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:40.547411 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:40.574069 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:40.548816 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:40.574574 30019 raft_consensus.cc:2393] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 4: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:40.549813 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:40.575682 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:40.575932 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:40.576247 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:40.576556 30019 raft_consensus.cc:2468] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 2.
I20260709 13:10:40.545377 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:40.551391 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:40.578161 30094 raft_consensus.cc:2393] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 3: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:10:40.578640 30023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54198 (request call id 1602) took 1762 ms. Trace:
I20260709 13:10:40.550169 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:40.579113 30023 rpcz_store.cc:276] 0709 13:10:38.816261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.381243 (+564982us) service_pool.cc:224] Handling call
0709 13:10:40.578405 (+1197162us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b540013d3d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:10:40.578576 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2580618624}
I20260709 13:10:40.554649 30066 leader_election.cc:304] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:40.577219 30020 raft_consensus.cc:2393] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 3: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:40.580704 30019 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
mode: GRACEFUL
new_leader_uuid: "c99569d27a6f4c648eae7119fe3db124"
 from {username='slave'} at 127.0.0.1:47450
I20260709 13:10:40.555018 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:40.581267 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:40.582964 30095 raft_consensus.cc:2393] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 3: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:10:40.583294 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:40.584703 30099 raft_consensus.cc:1275] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:40.321339 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:40.557211 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:40.558591 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:40.536890 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:40.541687 29993 leader_election.cc:304] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:40.566004 30068 leader_election.cc:304] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:40.586050 30096 raft_consensus.cc:3060] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:40.566942 30702 leader_election.cc:304] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:40.568646 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:40.569052 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:40.398061 30730 raft_consensus.cc:1240] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 13:10:40.371734 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:40.571089 30731 raft_consensus.cc:2393] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 4: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:10:40.571480 30732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51014 (request call id 614) took 4085 ms. Trace:
I20260709 13:10:40.571807 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:40.572003 30737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51004 (request call id 455) took 1102 ms. Trace:
I20260709 13:10:40.574398 30021 raft_consensus.cc:2393] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 3: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:40.547801 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:40.552796 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:40.603991 30177 raft_consensus.cc:3060] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:40.604954 30098 raft_consensus.cc:3060] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:40.604624 30100 raft_consensus.cc:2468] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 3.
I20260709 13:10:40.318367 31851 raft_consensus.cc:493] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:40.603883 30028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:52092 (request call id 14) took 3097 ms. Trace:
W20260709 13:10:40.457269 31922 log.cc:927] Time spent T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.140s	user 0.002s	sys 0.001s
I20260709 13:10:40.782639 30028 rpcz_store.cc:276] 0709 13:10:37.506277 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.032509 (+2526232us) service_pool.cc:224] Handling call
0709 13:10:40.602074 (+569565us) spinlock_profiling.cc:243] Waited 378 ms on lock 0x7b54004164d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20c0735 00007f99f7080d29 00007f99f05ff1d4 00007f99f05ff162 00007f99f05ff091 00007f99f05ff00c 00007f99f05fe2c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:10:40.603627 (+  1553us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":869379456}
I20260709 13:10:40.397970 31907 raft_consensus.cc:2804] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:40.784395 31907 raft_consensus.cc:493] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.784876 31907 raft_consensus.cc:3060] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:40.673745 30737 rpcz_store.cc:276] 0709 13:10:39.472134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.569031 (+ 96897us) service_pool.cc:224] Handling call
0709 13:10:39.569316 (+   285us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:40.170239 (+600923us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:40.170274 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:40.181238 (+ 10964us) log.cc:844] Serialized 26 byte log entry
0709 13:10:40.315256 (+134018us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:40.315293 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.315360 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:40.571473 (+256113us) raft_consensus.cc:1685] finished
0709 13:10:40.571512 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:40.571809 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":41077,"raft.run_cpu_time_us":7899,"raft.run_wall_time_us":163998,"thread_start_us":690094,"threads_started":2,"wal-append.queue_time_us":206001}
W20260709 13:10:40.787271 30703 leader_election.cc:336] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Timed out: RequestConsensusVote RPC to 127.28.54.66:43821 timed out after 1.897s (SENT)
I20260709 13:10:40.609946 31918 raft_consensus.cc:2749] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:40.681501 31675 raft_consensus.cc:697] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 3 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:40.791078 31675 consensus_queue.cc:237] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:40.607172 31730 leader_election.cc:290] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:40.605162 31925 raft_consensus.cc:2749] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:40.602758 30732 rpcz_store.cc:276] 0709 13:10:36.486114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:36.514020 (+ 27906us) service_pool.cc:224] Handling call
0709 13:10:39.153222 (+2639202us) spinlock_profiling.cc:243] Waited 76.1 ms on lock 0x7b5800004898. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eef95b71 00007f99eef95a22 00007f99f7eaec09 00007f99f7008ee0 00007f99f70d20ab 00007f99f70d2131 00007f99f7093fc0 00007f99f707e929 00007f99f707e3d2 00007f99f05f5bd4
0709 13:10:39.153431 (+   209us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:39.827116 (+673685us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b58004901d0. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20160aa 00007f99f2098447 00007f99f20b0fe7 00007f99f20b27de 00007f99f20bcb49 00007f99f20bd416 00007f99f20b9d8f 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4
0709 13:10:40.570793 (+743677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.571226 (+   433us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1322460288}
I20260709 13:10:40.318500 31716 raft_consensus.cc:2749] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:40.610116 31910 raft_consensus.cc:2804] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:10:40.603682 31755 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:10:40.605362 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:40.782704 31851 raft_consensus.cc:3060] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:40.775987 30024 raft_consensus.cc:2393] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 2: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:40.796110 30101 raft_consensus.cc:2468] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 3.
I20260709 13:10:40.601450 30019 raft_consensus.cc:606] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Received request to transfer leadership to TS c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:40.776314 30734 raft_consensus.cc:2468] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 3.
I20260709 13:10:40.454401 31874 raft_consensus.cc:3055] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:40.682071 31900 raft_consensus.cc:3060] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:40.604770 31852 raft_consensus.cc:2749] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:40.610730 31923 raft_consensus.cc:2804] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:10:40.427263 31924 log.cc:927] Time spent T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 13:10:40.315807 31693 raft_consensus.cc:3060] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:40.306344 31902 raft_consensus.cc:740] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:40.452793 31873 leader_election.cc:290] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:40.804793 31910 raft_consensus.cc:493] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:40.816856 31815 raft_consensus.cc:697] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 5 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:40.817304 31915 raft_consensus.cc:2804] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:40.400900 31844 raft_consensus.cc:515] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:40.824317 31931 raft_consensus.cc:2749] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:10:40.824563 30142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:40.819034 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 277511us
W20260709 13:10:40.825120 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 194848us
I20260709 13:10:40.811898 30019 raft_consensus.cc:614] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:40.823066 30730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51004 (request call id 456) took 1348 ms. Trace:
I20260709 13:10:40.823632 31925 raft_consensus.cc:2804] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:40.819757 31698 raft_consensus.cc:3060] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:40.823813 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 283823us
I20260709 13:10:40.837280 31781 raft_consensus.cc:2749] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:40.843349 31831 consensus_queue.cc:1059] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.017s
W20260709 13:10:40.846117 29974 auto_rebalancer.cc:629] Failed to schedule move for tablet 3068102662114944a63195a8d764e93d: Illegal state: Replica b2cea0098c1040f69755ea4d3dab7fc4 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } }
I20260709 13:10:40.846777 30099 raft_consensus.cc:1275] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:10:40.847398 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 280775us
I20260709 13:10:40.847837 31824 raft_consensus.cc:2749] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:40.848739 30702 leader_election.cc:304] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
W20260709 13:10:40.850073 30143 leader_election.cc:336] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Timed out: RequestConsensusVote RPC to 127.28.54.66:43821 timed out after 1.513s (SENT)
W20260709 13:10:40.850730 30143 leader_election.cc:336] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Timed out: RequestConsensusVote RPC to 127.28.54.66:43821 timed out after 1.519s (SENT)
I20260709 13:10:40.851119 30143 leader_election.cc:304] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:40.822676 31910 raft_consensus.cc:3060] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:40.855605 31806 raft_consensus.cc:2749] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:40.856470 30019 raft_consensus.cc:1275] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:40.860606 29993 leader_election.cc:304] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:10:40.862089 31929 raft_consensus.cc:2749] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:40.862126 31738 raft_consensus.cc:2804] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:40.863591 31738 raft_consensus.cc:493] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:40.864063 31738 raft_consensus.cc:3060] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:40.864486 31710 consensus_queue.cc:260] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:40.837540 31832 consensus_queue.cc:1059] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
W20260709 13:10:40.872704 31715 consensus_meta.cc:287] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4: Time spent flushing consensus metadata: real 0.743s	user 0.001s	sys 0.010s
I20260709 13:10:40.873134 31715 raft_consensus.cc:515] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:40.815598 31923 raft_consensus.cc:493] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.881999 31789 raft_consensus.cc:2804] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:10:40.882863 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 328488us
W20260709 13:10:40.883291 30102 consensus_meta.cc:287] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719: Time spent flushing consensus metadata: real 0.501s	user 0.000s	sys 0.017s
W20260709 13:10:40.883641 31724 consensus_meta.cc:287] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent flushing consensus metadata: real 0.679s	user 0.006s	sys 0.002s
I20260709 13:10:40.883997 31791 raft_consensus.cc:3060] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:40.833248 31925 raft_consensus.cc:493] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:40.828199 31915 raft_consensus.cc:493] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.887638 30068 leader_election.cc:304] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:40.825831 30730 rpcz_store.cc:276] 0709 13:10:39.473246 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.611260 (+138014us) service_pool.cc:224] Handling call
0709 13:10:39.753279 (+142019us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:40.609960 (+856681us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:40.820269 (+210309us) spinlock_profiling.cc:243] Waited 627 ms on lock 0x7b5400188dd4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:10:40.821396 (+  1127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1441933184}
I20260709 13:10:40.860833 31790 leader_election.cc:290] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:40.895078 30096 raft_consensus.cc:2468] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 4.
W20260709 13:10:40.896924 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 48329us
I20260709 13:10:40.882190 31710 raft_consensus.cc:3060] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:40.893167 30143 leader_election.cc:336] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Timed out: RequestConsensusVote RPC to 127.28.54.66:43821 timed out after 1.549s (SENT)
I20260709 13:10:40.902047 30102 raft_consensus.cc:2468] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 3.
I20260709 13:10:40.904937 30066 leader_election.cc:304] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:40.906051 30025 raft_consensus.cc:2468] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 3.
I20260709 13:10:40.835368 31815 consensus_queue.cc:237] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:40.914177 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:40.915169 30022 raft_consensus.cc:2393] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 4: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:40.916613 31902 consensus_queue.cc:260] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:40.892488 31789 raft_consensus.cc:493] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:40.918046 31789 raft_consensus.cc:3060] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:40.893518 31923 raft_consensus.cc:3060] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:40.928968 31715 leader_election.cc:290] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:40.930977 31700 leader_election.cc:290] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:40.308291 31810 raft_consensus.cc:515] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:40.899176 31925 raft_consensus.cc:3060] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:40.898684 31915 raft_consensus.cc:3060] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:40.936717 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:10:40.946204 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 47208.2us
I20260709 13:10:40.946887 29993 leader_election.cc:304] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
W20260709 13:10:40.953080 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 143861us
I20260709 13:10:40.900180 31724 raft_consensus.cc:515] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:40.948596 30097 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.042s	sys 0.042s
W20260709 13:10:40.957697 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 70173.2us
I20260709 13:10:40.926020 31831 consensus_queue.cc:1048] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:10:40.945899 31874 raft_consensus.cc:740] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:40.959800 31934 raft_consensus.cc:2804] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:10:40.957386 30143 leader_election.cc:336] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Timed out: RequestConsensusVote RPC to 127.28.54.66:43821 timed out after 1.570s (SENT)
I20260709 13:10:40.962134 30143 leader_election.cc:304] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:40.964579 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:40.958513 31715 raft_consensus.cc:2804] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:40.967845 30173 raft_consensus.cc:1240] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 3. Current term is 4. Ops: []
W20260709 13:10:40.963732 30097 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.042s	sys 0.042s
I20260709 13:10:40.961236 31902 raft_consensus.cc:3060] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:40.955873 31937 raft_consensus.cc:2749] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:40.971769 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:40.973387 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:40.977243 30023 raft_consensus.cc:2468] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 3.
I20260709 13:10:40.977473 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:40.978585 30735 raft_consensus.cc:1240] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 1. Current term is 2. Ops: []
W20260709 13:10:40.979492 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 79856.9us
I20260709 13:10:40.971997 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:40.980106 31851 raft_consensus.cc:515] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:40.980934 30028 raft_consensus.cc:2368] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 3. Current term is 4.
I20260709 13:10:40.972664 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:40.973874 31929 raft_consensus.cc:2749] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:40.982239 29993 leader_election.cc:304] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:40.983201 31820 raft_consensus.cc:2749] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:40.985687 31820 consensus_queue.cc:1048] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:40.968700 31715 raft_consensus.cc:493] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:40.987759 31715 raft_consensus.cc:3060] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:40.989203 31907 raft_consensus.cc:515] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:40.974203 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:40.973613 31918 consensus_queue.cc:1059] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:40.974586 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:40.991425 31918 raft_consensus.cc:3055] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:40.991822 31918 raft_consensus.cc:740] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:40.992944 31918 consensus_queue.cc:260] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:40.994438 31918 raft_consensus.cc:3060] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:40.996333 30094 consensus_queue.cc:237] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:40.996678 31915 raft_consensus.cc:515] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:40.961943 31934 raft_consensus.cc:493] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:40.973451 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:40.974089 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:41.001415 30025 raft_consensus.cc:2393] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 4: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:40.985566 29993 leader_election.cc:304] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:40.973419 30066 leader_election.cc:304] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:41.002719 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:41.008240 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:41.010846 30102 raft_consensus.cc:3060] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:41.017923 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:41.018607 30028 raft_consensus.cc:3060] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:41.018954 31829 raft_consensus.cc:493] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:41.019510 31829 raft_consensus.cc:515] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:41.021706 31790 consensus_queue.cc:1059] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:10:41.018147 30701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.025619 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:41.026564 31907 leader_election.cc:290] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:41.026795 31936 raft_consensus.cc:2764] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:10:41.027487 31790 raft_consensus.cc:3055] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:41.027848 31790 raft_consensus.cc:740] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:41.026576 30101 raft_consensus.cc:1275] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:41.028962 31937 consensus_queue.cc:1048] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:41.028839 31790 consensus_queue.cc:260] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:41.029167 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:41.029803 31820 raft_consensus.cc:2749] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:41.002760 31810 leader_election.cc:290] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:10:41.024843 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 54570.9us
I20260709 13:10:41.031163 30066 leader_election.cc:304] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:41.032536 30068 leader_election.cc:304] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:10:41.034758 31852 raft_consensus.cc:2804] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:41.035148 31852 raft_consensus.cc:493] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:41.035503 31852 raft_consensus.cc:3060] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:41.035997 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:41.036844 30169 raft_consensus.cc:2393] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 4: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:10:40.997728 31844 leader_election.cc:290] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:41.038033 31935 raft_consensus.cc:2764] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:10:41.043427 31693 raft_consensus.cc:515] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:41.045373 31915 leader_election.cc:290] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:10:41.030826 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 95181.5us
I20260709 13:10:41.033535 30066 leader_election.cc:304] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:41.061574 30098 raft_consensus.cc:2468] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 4.
I20260709 13:10:41.002892 31908 raft_consensus.cc:493] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:40.997984 31934 raft_consensus.cc:3060] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:41.068470 30177 raft_consensus.cc:2468] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 3.
I20260709 13:10:41.041256 31900 raft_consensus.cc:515] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:41.045611 31698 raft_consensus.cc:2749] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:41.077492 30066 leader_election.cc:304] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:41.079027 31936 raft_consensus.cc:2749] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:41.080406 30066 leader_election.cc:304] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:41.080505 31936 consensus_queue.cc:1048] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:41.083650 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:41.077353 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:41.086445 30028 raft_consensus.cc:2468] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 4.
I20260709 13:10:41.087764 30025 raft_consensus.cc:1240] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:41.067413 31710 raft_consensus.cc:493] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.091276 30735 raft_consensus.cc:3060] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:41.080976 31738 raft_consensus.cc:515] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:41.096276 30700 leader_election.cc:304] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:41.100427 30173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43838 (request call id 1554) took 1695 ms. Trace:
I20260709 13:10:41.102874 31935 raft_consensus.cc:2804] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:41.045394 31925 raft_consensus.cc:515] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:41.105207 30702 leader_election.cc:304] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:41.100797 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:41.112341 30019 raft_consensus.cc:2468] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 5.
I20260709 13:10:41.113687 31738 leader_election.cc:290] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:41.102766 30173 rpcz_store.cc:276] 0709 13:10:39.404698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.957671 (+552973us) service_pool.cc:224] Handling call
0709 13:10:39.957932 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:40.976929 (+1018997us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:41.085208 (+108279us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54002882d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:10:41.100352 (+ 15144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2306343296}
I20260709 13:10:41.083231 31851 leader_election.cc:290] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:41.090553 31791 raft_consensus.cc:515] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:41.100304 31937 raft_consensus.cc:2804] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:41.132288 30026 raft_consensus.cc:1240] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 13:10:41.132181 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 61018us
I20260709 13:10:41.106093 31790 raft_consensus.cc:3060] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:41.137543 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 94780.4us
I20260709 13:10:41.137988 31951 consensus_queue.cc:1059] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:41.140962 30102 raft_consensus.cc:2468] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 4.
I20260709 13:10:41.118667 30095 raft_consensus.cc:1240] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:41.146504 30171 raft_consensus.cc:1240] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:41.118816 31710 raft_consensus.cc:515] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:41.146970 30729 raft_consensus.cc:1240] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:41.116349 31829 leader_election.cc:290] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:41.118408 31925 leader_election.cc:290] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:41.090003 31789 raft_consensus.cc:515] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:41.135963 31937 raft_consensus.cc:493] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:41.154573 31680 consensus_meta.cc:287] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124: Time spent flushing consensus metadata: real 0.939s	user 0.007s	sys 0.008s
I20260709 13:10:41.160733 30100 raft_consensus.cc:2368] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 3. Current term is 4.
I20260709 13:10:41.164633 31874 consensus_queue.cc:260] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:41.165928 31874 raft_consensus.cc:3060] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:41.166642 29994 leader_election.cc:304] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:41.169613 31729 raft_consensus.cc:2749] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:10:41.169423 31717 consensus_queue.cc:1175] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" responder_term: 3 status { last_received { term: 2 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:10:41.170730 31710 leader_election.cc:290] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:41.170879 31729 consensus_queue.cc:1048] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:41.171276 31937 raft_consensus.cc:3060] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:41.097196 31908 raft_consensus.cc:515] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:41.155426 31831 raft_consensus.cc:2804] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:41.160261 31951 raft_consensus.cc:3055] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:41.176534 30068 leader_election.cc:304] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:41.179754 30023 raft_consensus.cc:1240] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:41.178489 30702 leader_election.cc:304] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:41.178786 30735 raft_consensus.cc:2468] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 4.
I20260709 13:10:41.182693 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:41.183486 30142 leader_election.cc:304] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:41.187605 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:41.188330 30172 raft_consensus.cc:3060] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:41.189297 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:41.190207 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:41.190505 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:41.191403 30068 leader_election.cc:304] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:41.181641 31907 raft_consensus.cc:493] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.158674 30097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33992 (request call id 1437) took 2414 ms. Trace:
I20260709 13:10:41.195768 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:41.196892 31829 raft_consensus.cc:2804] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:10:41.197340 31941 log.cc:927] Time spent T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
I20260709 13:10:41.197888 30020 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "80006b8186d74baba29992ade1966048"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
mode: GRACEFUL
new_leader_uuid: "c99569d27a6f4c648eae7119fe3db124"
 from {username='slave'} at 127.0.0.1:47450
I20260709 13:10:41.198161 31900 leader_election.cc:290] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:10:41.200754 31938 log.cc:927] Time spent T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.273s	user 0.000s	sys 0.005s
I20260709 13:10:41.181919 31902 raft_consensus.cc:2749] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:41.201747 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:41.202895 30176 raft_consensus.cc:1275] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:41.204044 31693 leader_election.cc:290] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:41.204536 31791 leader_election.cc:290] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:41.204898 31851 raft_consensus.cc:2804] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:41.189442 31934 raft_consensus.cc:515] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:41.214898 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 46058.3us
I20260709 13:10:41.181533 31951 raft_consensus.cc:740] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:41.182650 31935 raft_consensus.cc:697] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 3 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:41.205458 31925 consensus_queue.cc:1048] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:10:41.219664 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:41.194422 31831 raft_consensus.cc:697] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:41.214293 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:41.187664 31715 raft_consensus.cc:515] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:41.215598 31824 raft_consensus.cc:2804] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:10:41.226116 30142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.229475 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:41.226449 30177 raft_consensus.cc:2393] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 3: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:10:41.177706 31680 raft_consensus.cc:515] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:41.220902 30020 raft_consensus.cc:606] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Received request to transfer leadership to TS c99569d27a6f4c648eae7119fe3db124
W20260709 13:10:41.231658 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 46157.5us
I20260709 13:10:41.234004 29994 leader_election.cc:304] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:41.225873 30021 raft_consensus.cc:1275] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:10:41.235831 30703 leader_election.cc:336] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Timed out: RequestConsensusVote RPC to 127.28.54.66:43821 timed out after 2.057s (SENT)
I20260709 13:10:41.223774 31829 raft_consensus.cc:697] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
W20260709 13:10:41.241722 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 47968.8us
I20260709 13:10:41.229182 30168 raft_consensus.cc:3060] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:10:41.233269 30169 raft_consensus.cc:2393] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 4: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:10:41.227977 31851 raft_consensus.cc:697] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 4 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:41.256250 30172 raft_consensus.cc:2468] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 4.
I20260709 13:10:41.260531 31755 raft_consensus.cc:493] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.261400 31680 leader_election.cc:290] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:41.212612 30097 rpcz_store.cc:276] 0709 13:10:38.737360 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.712481 (+975121us) service_pool.cc:224] Handling call
0709 13:10:39.968168 (+255687us) spinlock_profiling.cc:243] Waited 3.8 ms on lock 0x7b5800073598. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eef95b71 00007f99eef95a22 00007f99f7eaec09 00007f99f7008ee0 00007f99f70d20ab 00007f99f70d2131 00007f99f7093fc0 00007f99f707e929 00007f99f707e3d2 00007f99f05f5bd4
0709 13:10:39.968331 (+   163us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:39.968509 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:10:40.119976 (+151467us) log.cc:844] Serialized 14 byte log entry
0709 13:10:40.456768 (+336792us) spinlock_profiling.cc:243] Waited 26.5 ms on lock 0x7b4400022b4c. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eeef3c85 00007f99eeef46a2 00007f99f1c661db 00007f99f1c61aaf 00007f99f1c5586e 00007f99f1c54bb6 00007f99f1c547d8 00007f99f1c5e221 00007f99f1c5e1d9 00007f99f1c5e169
0709 13:10:41.076679 (+619911us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:41.097905 (+ 21226us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:41.106837 (+  8932us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:41.133285 (+ 26448us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:41.150832 (+ 17547us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":208454,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":96264,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":101,"spinlock_wait_cycles":69731328,"thread_start_us":967603,"threads_started":3,"wal-append.queue_time_us":180120}
W20260709 13:10:41.265594 30703 leader_election.cc:336] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Timed out: RequestConsensusVote RPC to 127.28.54.66:43821 timed out after 1.848s (SENT)
I20260709 13:10:41.266317 31789 leader_election.cc:290] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:41.250244 31831 consensus_queue.cc:237] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:41.237155 30020 raft_consensus.cc:614] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:41.269220 31715 leader_election.cc:290] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:41.269491 31934 leader_election.cc:290] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:41.249574 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:41.271935 30174 raft_consensus.cc:3060] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:41.272622 30143 leader_election.cc:336] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Timed out: RequestConsensusVote RPC to 127.28.54.66:43821 timed out after 2.071s (SENT)
I20260709 13:10:41.274127 31951 consensus_queue.cc:260] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:41.274396 31851 consensus_queue.cc:237] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:41.275424 31951 raft_consensus.cc:3060] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:41.240567 31852 raft_consensus.cc:515] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:41.276567 31910 raft_consensus.cc:515] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:41.277674 31852 leader_election.cc:290] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:41.233690 31824 raft_consensus.cc:493] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:41.280349 31829 consensus_queue.cc:237] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:41.281059 31824 raft_consensus.cc:3060] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:41.261108 31755 raft_consensus.cc:515] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:41.278548 30096 raft_consensus.cc:3060] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:41.241545 31954 raft_consensus.cc:2749] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:41.229823 31907 raft_consensus.cc:515] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:41.280186 31790 consensus_queue.cc:1048] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:41.247324 31791 consensus_queue.cc:1048] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 13:10:41.294634 31910 leader_election.cc:290] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451)
I20260709 13:10:41.283540 31923 raft_consensus.cc:515] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:41.295871 31715 consensus_queue.cc:1059] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:41.296890 31715 raft_consensus.cc:3055] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:41.297225 31715 raft_consensus.cc:740] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:41.297325 31923 leader_election.cc:290] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:10:41.282922 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 59339.6us
I20260709 13:10:41.284965 30735 raft_consensus.cc:1240] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:41.285987 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:41.286448 31755 leader_election.cc:290] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:41.286962 31724 leader_election.cc:290] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:41.287357 31907 leader_election.cc:290] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:41.288081 30175 raft_consensus.cc:1275] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:41.299714 30177 raft_consensus.cc:2393] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 3: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:10:41.300384 30096 raft_consensus.cc:2468] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 3.
I20260709 13:10:41.300804 31957 raft_consensus.cc:2749] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:41.301429 31738 raft_consensus.cc:493] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:41.301855 30173 raft_consensus.cc:2368] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 3. Current term is 4.
W20260709 13:10:41.308274 30700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.311911 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:41.319314 30176 raft_consensus.cc:2468] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 4.
I20260709 13:10:41.313836 30174 raft_consensus.cc:2468] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 3.
I20260709 13:10:41.303964 31789 consensus_queue.cc:1059] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 13:10:41.314870 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:41.316279 30735 raft_consensus.cc:1275] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:41.314003 31698 consensus_queue.cc:1048] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:41.322825 30066 leader_election.cc:304] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:41.326691 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:41.327560 30023 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
mode: GRACEFUL
new_leader_uuid: "5ec73dc157ed476ca903a7d596271719"
 from {username='slave'} at 127.0.0.1:47450
I20260709 13:10:41.329701 30023 raft_consensus.cc:606] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Received request to transfer leadership to TS 5ec73dc157ed476ca903a7d596271719
I20260709 13:10:41.330734 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:41.331249 30027 raft_consensus.cc:2468] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 4.
W20260709 13:10:41.332409 30143 leader_election.cc:336] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Timed out: RequestConsensusVote RPC to 127.28.54.66:43821 timed out after 2.179s (SENT)
I20260709 13:10:41.332767 30143 leader_election.cc:304] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:41.333736 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:41.337249 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:41.240906 31935 consensus_queue.cc:237] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:41.339555 29994 leader_election.cc:304] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:41.340502 30176 raft_consensus.cc:2393] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 4: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:10:41.334393 31954 raft_consensus.cc:2749] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:41.333240 30168 raft_consensus.cc:2468] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 4.
I20260709 13:10:41.345893 31730 raft_consensus.cc:493] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.336495 31923 raft_consensus.cc:2749] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:41.334791 31738 raft_consensus.cc:515] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:41.346202 30177 raft_consensus.cc:1240] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:41.347921 30700 leader_election.cc:304] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:41.298337 31715 consensus_queue.cc:260] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:41.343742 30729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51014 (request call id 636) took 1153 ms. Trace:
I20260709 13:10:41.347465 30735 raft_consensus.cc:1240] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 3. Current term is 4. Ops: []
W20260709 13:10:41.349320 30140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.354067 31729 raft_consensus.cc:2804] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:41.355229 31729 raft_consensus.cc:697] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:41.347466 31730 raft_consensus.cc:515] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:41.357126 31729 consensus_queue.cc:237] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:41.359870 29921 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51840 (request call id 325) took 6040 ms. Trace:
I20260709 13:10:41.360265 29921 rpcz_store.cc:276] 0709 13:10:35.282033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.286307 (+  4274us) service_pool.cc:224] Handling call
0709 13:10:41.317903 (+6031596us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:40.302883 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:40.314553 (+ 11670us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:40.314588 (+    35us) write_op.cc:435] Acquired schema lock
0709 13:10:40.314605 (+    17us) tablet.cc:662] Decoding operations
0709 13:10:40.317423 (+  2818us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:40.317502 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:40.317537 (+    35us) tablet.cc:685] Acquiring locks for 5 operations
0709 13:10:40.437045 (+119508us) tablet.cc:701] Row locks acquired
0709 13:10:40.437773 (+   728us) write_op.cc:260] PREPARE: finished
0709 13:10:40.445702 (+  7929us) write_op.cc:270] Start()
0709 13:10:40.447692 (+  1990us) write_op.cc:276] Timestamp: P: 1783602640444670 usec, L: 0
0709 13:10:40.448472 (+   780us) op_driver.cc:348] REPLICATION: starting
0709 13:10:40.453089 (+  4617us) log.cc:844] Serialized 2064 byte log entry
0709 13:10:41.003272 (+550183us) op_driver.cc:464] REPLICATION: finished
0709 13:10:41.192247 (+188975us) write_op.cc:301] APPLY: starting
0709 13:10:41.192371 (+   124us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:41.192596 (+   225us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:41.192729 (+   133us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:41.195443 (+  2714us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:41.195767 (+   324us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 13:10:41.195819 (+    52us) write_op.cc:312] APPLY: finished
0709 13:10:41.196180 (+   361us) log.cc:844] Serialized 47 byte log entry
0709 13:10:41.196386 (+   206us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:41.196526 (+   140us) write_op.cc:454] Released schema lock
0709 13:10:41.196585 (+    59us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:41.197005 (+   420us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:41.197032 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":727926,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":173611,"apply.run_cpu_time_us":3121,"apply.run_wall_time_us":12564,"num_ops":5,"prepare.queue_time_us":137943,"prepare.run_cpu_time_us":11864,"prepare.run_wall_time_us":200387,"raft.queue_time_us":281343,"raft.run_cpu_time_us":42055,"raft.run_wall_time_us":179545,"replication_time_us":521501,"spinlock_wait_cycles":40320,"thread_start_us":362204,"threads_started":4,"wal-append.queue_time_us":29856}]]}
I20260709 13:10:41.363471 31923 consensus_queue.cc:1048] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:41.364974 31730 leader_election.cc:290] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:41.366539 31738 leader_election.cc:290] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:41.344448 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:41.367684 30174 raft_consensus.cc:2410] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for term 5 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:10:41.368279 30734 raft_consensus.cc:2468] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 4.
I20260709 13:10:41.370229 28889 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:41.368769 31789 raft_consensus.cc:993] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4: : Instructing follower 5ec73dc157ed476ca903a7d596271719 to start an election
I20260709 13:10:41.370373 31717 raft_consensus.cc:2804] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:41.370934 31789 raft_consensus.cc:1081] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Signalling peer 5ec73dc157ed476ca903a7d596271719 to start an election
I20260709 13:10:41.371816 31717 raft_consensus.cc:493] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.372262 31717 raft_consensus.cc:3060] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:41.372802 28889 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:41.375011 31790 raft_consensus.cc:3055] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:41.375387 31790 raft_consensus.cc:740] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:41.376255 31790 consensus_queue.cc:260] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:41.350317 30729 rpcz_store.cc:276] 0709 13:10:40.190650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.190765 (+   115us) service_pool.cc:224] Handling call
0709 13:10:40.191047 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:41.169134 (+978087us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:41.332946 (+163812us) spinlock_profiling.cc:243] Waited 910 ms on lock 0x7b540058fa54. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:10:41.342613 (+  9667us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2093875456}
I20260709 13:10:41.379328 31717 raft_consensus.cc:515] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:41.382422 31715 raft_consensus.cc:3060] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:41.383452 31717 leader_election.cc:290] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:41.383908 31790 raft_consensus.cc:3060] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:41.387406 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 47904.4us
I20260709 13:10:41.395179 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:41.348057 31937 raft_consensus.cc:515] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:41.394526 29994 leader_election.cc:304] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:41.390070 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:41.389792 31908 leader_election.cc:290] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:41.405195 30140 leader_election.cc:304] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:41.408885 30177 raft_consensus.cc:1275] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:41.410370 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:41.410597 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:41.411247 30168 raft_consensus.cc:2468] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 5.
I20260709 13:10:41.411720 30729 raft_consensus.cc:1240] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:41.412142 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:41.412668 30168 raft_consensus.cc:3060] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:41.414816 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:41.415339 30026 raft_consensus.cc:3060] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:41.417120 29993 leader_election.cc:304] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:41.413663 31900 consensus_queue.cc:1048] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:10:41.418207 29993 leader_election.cc:304] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:41.418951 31820 raft_consensus.cc:2804] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:41.419425 31820 raft_consensus.cc:697] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:41.419544 31698 raft_consensus.cc:2804] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:41.420117 31698 raft_consensus.cc:697] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:41.394608 31738 consensus_queue.cc:1048] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:10:41.420960 31698 consensus_queue.cc:237] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:41.421468 29993 leader_election.cc:304] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:41.421950 31730 consensus_queue.cc:1059] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:41.424676 30169 raft_consensus.cc:1275] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:41.422122 31937 leader_election.cc:290] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:41.425621 31957 raft_consensus.cc:3055] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:41.426013 31957 raft_consensus.cc:740] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:41.426889 31957 consensus_queue.cc:260] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:41.427994 31957 raft_consensus.cc:3060] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:41.433319 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:41.422288 31699 raft_consensus.cc:2804] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:41.434051 31699 raft_consensus.cc:493] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:41.434172 30172 raft_consensus.cc:2410] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:10:41.434456 31699 raft_consensus.cc:3060] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:41.438555 30026 raft_consensus.cc:2468] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 5.
I20260709 13:10:41.439206 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:41.439854 30170 raft_consensus.cc:3060] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:41.440172 30700 leader_election.cc:304] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:41.441381 31902 raft_consensus.cc:2804] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:41.441859 31902 raft_consensus.cc:697] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:41.442734 31902 consensus_queue.cc:237] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:41.420326 31820 consensus_queue.cc:237] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:10:41.448760 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 46337.1us
W20260709 13:10:41.469123 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 76443.4us
I20260709 13:10:41.463774 31923 raft_consensus.cc:2804] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:41.473963 29993 leader_election.cc:400] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 election: Vote denied by peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001) with higher term. Message: Invalid argument: T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 3. Current term is 4.
I20260709 13:10:41.474507 29993 leader_election.cc:403] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:10:41.472940 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:41.491915 30168 raft_consensus.cc:2468] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 5.
W20260709 13:10:41.492554 31959 log.cc:927] Time spent T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260709 13:10:41.471042 31874 consensus_queue.cc:1059] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:10:41.477764 29994 leader_election.cc:304] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:41.500095 31730 raft_consensus.cc:3060] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:41.505532 31908 consensus_queue.cc:1048] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:41.505911 29993 leader_election.cc:304] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:41.508535 31715 consensus_queue.cc:1059] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:41.474452 31923 raft_consensus.cc:493] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.497969 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:41.513224 31866 raft_consensus.cc:2804] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:41.474515 31790 consensus_queue.cc:1048] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 13:10:41.520319 30730 raft_consensus.cc:2393] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 5: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:10:41.474696 31824 raft_consensus.cc:515] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:41.521253 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:41.522348 31824 leader_election.cc:290] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:41.523660 30176 raft_consensus.cc:1240] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:41.527066 31829 raft_consensus.cc:3055] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:41.527456 31829 raft_consensus.cc:740] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:41.528424 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:41.530166 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:41.530931 30175 raft_consensus.cc:2393] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 4: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:10:41.535167 31829 consensus_queue.cc:260] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:41.536911 31816 raft_consensus.cc:2749] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:41.537593 31931 consensus_queue.cc:1048] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:41.516279 31923 raft_consensus.cc:3060] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:41.540198 31730 raft_consensus.cc:2749] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001) with higher term. Message: Invalid argument: T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 3. Current term is 4.
I20260709 13:10:41.513202 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:41.552400 31729 raft_consensus.cc:3055] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:41.552856 31729 raft_consensus.cc:740] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:41.514926 31699 raft_consensus.cc:515] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:41.564786 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 89870.9us
I20260709 13:10:41.553910 31829 raft_consensus.cc:3060] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:41.566947 29993 leader_election.cc:304] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:41.570329 29993 leader_election.cc:304] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:41.549360 29922 catalog_manager.cc:5697] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 reported cstate change: config changed from index -1 to 2, term changed from 1 to 2, leader changed from 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) to <none>, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New cstate: current_term: 2 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:41.564450 31816 raft_consensus.cc:493] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:41.584085 31816 raft_consensus.cc:515] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:41.585646 30170 raft_consensus.cc:2468] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 3.
I20260709 13:10:41.586074 31816 leader_election.cc:290] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:41.564683 31790 raft_consensus.cc:2804] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:41.575057 31908 consensus_queue.cc:1059] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:10:41.576537 29992 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.556731 31729 consensus_queue.cc:260] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:41.594650 31738 raft_consensus.cc:2764] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:10:41.600386 29922 catalog_manager.cc:5697] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 1 to 2, leader changed from c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 2 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:41.602174 29922 catalog_manager.cc:5697] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:41.605074 31699 leader_election.cc:290] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:41.597292 31715 raft_consensus.cc:2749] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:41.607992 29993 leader_election.cc:304] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:41.610740 31923 raft_consensus.cc:515] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:41.611500 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:41.612275 30732 raft_consensus.cc:2393] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 5: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:10:41.612728 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:41.613335 30175 raft_consensus.cc:2468] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 2.
I20260709 13:10:41.614136 31715 consensus_queue.cc:1059] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:41.599412 31790 raft_consensus.cc:697] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:41.615342 31715 raft_consensus.cc:2749] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:41.612327 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:41.600310 31738 raft_consensus.cc:3055] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:41.622289 31738 raft_consensus.cc:740] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
W20260709 13:10:41.622810 30069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.623186 31738 consensus_queue.cc:260] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:41.624405 31738 raft_consensus.cc:3060] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:41.627390 31790 consensus_queue.cc:237] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:41.632515 30177 raft_consensus.cc:2468] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 5.
I20260709 13:10:41.594005 31866 raft_consensus.cc:697] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:41.636196 30143 leader_election.cc:304] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:41.639797 31851 raft_consensus.cc:2804] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:41.640219 31851 raft_consensus.cc:493] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.640584 31851 raft_consensus.cc:3060] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:41.639851 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:41.641317 30174 raft_consensus.cc:1240] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:41.641623 30730 raft_consensus.cc:2393] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 2: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:10:41.640503 30732 raft_consensus.cc:1240] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 LEADER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:10:41.643764 30174 raft_consensus.cc:1240] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:41.644196 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:41.644519 30177 raft_consensus.cc:1240] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:41.645051 31730 consensus_queue.cc:1059] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:41.647949 31730 raft_consensus.cc:3055] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:41.647735 31851 raft_consensus.cc:515] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:41.649646 30176 raft_consensus.cc:2393] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 4: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:10:41.650171 29993 leader_election.cc:304] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:41.653556 29993 leader_election.cc:304] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:41.656227 29993 leader_election.cc:304] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:41.640229 31907 raft_consensus.cc:493] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:41.657475 30703 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.54.66:43821 timed out after 1.590s (SENT) [suppressed 63 similar messages]
I20260709 13:10:41.657713 31907 raft_consensus.cc:515] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:10:41.668366 29991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.668509 31851 leader_election.cc:290] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:41.651970 31730 raft_consensus.cc:740] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:41.695653 31907 leader_election.cc:290] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:41.700847 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:41.701213 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:41.701649 30096 raft_consensus.cc:2393] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 4: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:10:41.707839 30100 raft_consensus.cc:3060] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:41.690878 31816 raft_consensus.cc:2804] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:41.710191 31816 raft_consensus.cc:493] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:41.710603 31816 raft_consensus.cc:3060] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:41.696239 31699 raft_consensus.cc:3055] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:41.713979 31699 raft_consensus.cc:740] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:41.714865 31699 consensus_queue.cc:260] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:41.715391 31866 consensus_queue.cc:237] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:41.716259 31699 raft_consensus.cc:3060] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:41.717039 31730 consensus_queue.cc:260] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:41.718144 31730 raft_consensus.cc:3060] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:41.690783 31975 raft_consensus.cc:2804] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:41.720273 30100 raft_consensus.cc:2468] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 4.
I20260709 13:10:41.720387 31975 raft_consensus.cc:697] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:41.727270 31975 consensus_queue.cc:237] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:10:41.731690 30142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.732601 31923 leader_election.cc:290] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:41.692672 31738 raft_consensus.cc:2804] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:41.743412 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:41.745482 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
W20260709 13:10:41.745816 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 172697us
I20260709 13:10:41.748142 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:41.748919 30099 raft_consensus.cc:2393] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 2: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:10:41.748230 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:41.751241 30098 raft_consensus.cc:2468] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 3.
I20260709 13:10:41.756265 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:41.758720 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:41.761935 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:41.770219 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:41.770820 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:41.770857 30099 raft_consensus.cc:2468] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 1.
I20260709 13:10:41.771770 30094 raft_consensus.cc:1275] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:41.771939 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:41.752942 31738 raft_consensus.cc:697] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:41.772425 30068 leader_election.cc:304] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:41.772904 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:41.773156 31738 consensus_queue.cc:237] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:41.774083 31951 raft_consensus.cc:2804] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:41.774526 31951 raft_consensus.cc:493] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:41.774895 31951 raft_consensus.cc:3060] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:41.774096 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:41.773546 30068 leader_election.cc:304] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:41.782915 30068 leader_election.cc:304] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:41.789994 30096 raft_consensus.cc:2468] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 3.
I20260709 13:10:41.771034 31729 raft_consensus.cc:3060] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:41.768078 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:41.787928 31935 raft_consensus.cc:2749] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:41.806255 30068 leader_election.cc:304] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:41.807595 29994 leader_election.cc:400] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 election: Vote denied by peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821) with higher term. Message: Invalid argument: T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 3. Current term is 4.
I20260709 13:10:41.758076 31816 raft_consensus.cc:515] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:41.791903 31824 raft_consensus.cc:2749] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:41.812218 29994 leader_election.cc:304] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:41.814090 31977 consensus_queue.cc:1048] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 13:10:41.808606 30174 raft_consensus.cc:3055] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:41.822474 30174 raft_consensus.cc:740] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:41.822896 30068 leader_election.cc:304] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:41.823279 30174 consensus_queue.cc:260] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:41.823705 31954 raft_consensus.cc:2749] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:41.824097 30068 leader_election.cc:304] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:41.824270 30174 raft_consensus.cc:3060] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:41.824375 31954 raft_consensus.cc:2749] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:41.825028 31954 raft_consensus.cc:2749] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:41.825348 30068 leader_election.cc:304] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:41.787909 31951 raft_consensus.cc:515] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:41.827246 31977 raft_consensus.cc:2804] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:41.827705 31951 leader_election.cc:290] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:41.829439 30140 leader_election.cc:304] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:41.809450 30097 raft_consensus.cc:2468] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 3.
I20260709 13:10:41.833035 30177 raft_consensus.cc:1275] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:41.827673 31977 raft_consensus.cc:697] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:41.835932 30140 leader_election.cc:304] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:41.836139 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:41.840143 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
W20260709 13:10:41.841079 29991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.844957 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:41.847098 30068 leader_election.cc:304] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:41.836935 31791 raft_consensus.cc:2749] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:41.849072 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:41.849510 30098 raft_consensus.cc:1275] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:41.850739 30024 raft_consensus.cc:3060] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:41.848138 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:41.849152 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:41.858300 30099 raft_consensus.cc:2410] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 13:10:41.849501 30102 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3"
dest_uuid: "5ec73dc157ed476ca903a7d596271719"
 from {username='slave'} at 127.0.0.1:33990
I20260709 13:10:41.842111 31907 raft_consensus.cc:2749] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:41.859153 30102 raft_consensus.cc:493] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:41.859540 30102 raft_consensus.cc:3060] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:41.849695 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:41.851962 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:41.844651 31829 consensus_queue.cc:1048] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:10:41.847896 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:41.846130 31824 raft_consensus.cc:2749] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:41.869683 30022 raft_consensus.cc:1240] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:41.870432 30174 raft_consensus.cc:1275] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:10:41.870743 30174 pending_rounds.cc:85] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124: Aborting all ops after (but not including) 1
I20260709 13:10:41.849658 30021 raft_consensus.cc:1240] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:10:41.867311 31977 consensus_queue.cc:237] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:41.868100 31907 consensus_queue.cc:1059] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:41.872346 30025 raft_consensus.cc:1240] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:41.870952 30174 pending_rounds.cc:107] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:10:41.884850 30174 raft_consensus.cc:2889] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:41.886400 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:41.886519 31983 consensus_queue.cc:1048] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:10:41.888747 30020 raft_consensus.cc:1240] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:41.890712 31791 raft_consensus.cc:493] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.891194 31791 raft_consensus.cc:515] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:10:41.892392 31984 log.cc:927] Time spent T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.080s	user 0.003s	sys 0.000s
I20260709 13:10:41.894120 31791 leader_election.cc:290] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:41.897298 30026 raft_consensus.cc:2468] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 4.
I20260709 13:10:41.873265 30023 raft_consensus.cc:2468] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
I20260709 13:10:41.877103 30028 raft_consensus.cc:1275] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:10:41.877882 31816 leader_election.cc:290] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:41.878867 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:41.873907 30068 leader_election.cc:304] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:41.883338 30021 raft_consensus.cc:1240] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:41.872783 30102 raft_consensus.cc:515] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:41.870290 31951 raft_consensus.cc:2764] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:10:41.904873 30177 raft_consensus.cc:3060] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:41.905481 30024 raft_consensus.cc:2468] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 3.
I20260709 13:10:41.907295 30023 raft_consensus.cc:1240] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:41.908708 30102 leader_election.cc:290] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:41.915531 30177 raft_consensus.cc:2468] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 3.
W20260709 13:10:41.916553 30142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.917447 29993 leader_election.cc:304] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
W20260709 13:10:41.923754 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 49928.8us
I20260709 13:10:41.925890 31951 raft_consensus.cc:2804] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:41.926362 31951 raft_consensus.cc:493] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:41.928476 30027 raft_consensus.cc:1240] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:10:41.931034 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:41.933013 30023 raft_consensus.cc:3060] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:41.934587 30068 leader_election.cc:304] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:41.925058 31816 raft_consensus.cc:2804] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:41.939390 30097 raft_consensus.cc:1240] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 3. Current term is 5. Ops: []
I20260709 13:10:41.929132 31951 raft_consensus.cc:3060] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:41.943775 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:41.950712 30026 raft_consensus.cc:1275] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 13:10:41.940330 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
W20260709 13:10:41.955905 29992 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:41.962217 31816 raft_consensus.cc:697] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:41.965374 31816 consensus_queue.cc:237] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:41.970752 30068 leader_election.cc:304] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:41.971556 31824 raft_consensus.cc:2804] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:41.971894 31824 raft_consensus.cc:493] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:41.972185 30068 leader_election.cc:304] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:41.972213 31824 raft_consensus.cc:3060] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:41.973305 30068 leader_election.cc:304] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:41.957093 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:41.981379 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:41.979991 31852 raft_consensus.cc:2804] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:41.984516 31852 raft_consensus.cc:493] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:41.984845 31852 raft_consensus.cc:3060] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:41.985484 31791 raft_consensus.cc:3055] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:41.985880 31791 raft_consensus.cc:740] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:41.986677 31791 consensus_queue.cc:260] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:41.987972 31791 raft_consensus.cc:3060] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:41.991158 30101 raft_consensus.cc:1275] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 13:10:41.992587 31982 log.cc:927] Time spent T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.201s	user 0.001s	sys 0.000s
I20260709 13:10:41.994073 31831 raft_consensus.cc:493] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:41.994597 31831 raft_consensus.cc:515] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:41.996562 31831 leader_election.cc:290] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:42.002365 30176 raft_consensus.cc:1275] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:42.018863 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:41.976912 31954 raft_consensus.cc:2804] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:42.036844 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:42.037657 30028 raft_consensus.cc:2368] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 2. Current term is 3.
W20260709 13:10:42.038897 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 65683.8us
I20260709 13:10:42.039702 30068 leader_election.cc:304] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:42.016793 31935 raft_consensus.cc:3060] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:42.046041 30023 raft_consensus.cc:2468] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 4.
I20260709 13:10:42.048626 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:42.051105 30028 raft_consensus.cc:2376] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 5. Re-sending same reply.
I20260709 13:10:42.051780 30176 raft_consensus.cc:1275] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:42.017691 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:42.028716 31954 raft_consensus.cc:493] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:42.065416 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:42.071074 32001 raft_consensus.cc:3060] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:42.071595 31954 raft_consensus.cc:3060] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:42.026661 31951 raft_consensus.cc:515] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:42.079803 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:42.082484 30028 raft_consensus.cc:2468] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 4.
I20260709 13:10:42.081827 30023 raft_consensus.cc:1275] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:42.085922 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:42.086975 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:42.088914 31699 consensus_queue.cc:1048] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:42.090157 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:42.090976 30020 raft_consensus.cc:2410] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:10:42.093385 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:42.094540 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:42.095479 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:42.096174 30024 raft_consensus.cc:2393] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 4: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:42.096812 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:42.096895 31951 leader_election.cc:290] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:42.052039 31975 consensus_queue.cc:1048] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:10:42.103798 30729 raft_consensus.cc:1275] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:42.085220 31954 raft_consensus.cc:515] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:42.105862 30169 raft_consensus.cc:1275] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:42.106086 31954 leader_election.cc:290] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:42.107249 31907 consensus_queue.cc:1048] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:42.115288 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:42.119946 30024 raft_consensus.cc:2468] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 3.
I20260709 13:10:42.112303 30176 raft_consensus.cc:1275] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:42.113782 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:42.114274 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:42.114589 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:42.122694 30025 raft_consensus.cc:2393] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 4: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:42.124061 30022 raft_consensus.cc:2468] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 4.
I20260709 13:10:42.115342 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:42.125618 30019 raft_consensus.cc:2376] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 4. Re-sending same reply.
I20260709 13:10:42.116223 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:42.116453 31996 consensus_queue.cc:1048] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:42.126313 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:42.126863 30026 raft_consensus.cc:2368] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 4. Current term is 5.
I20260709 13:10:42.127007 31954 consensus_queue.cc:1059] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:42.127853 30103 raft_consensus.cc:1275] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:42.128042 31954 raft_consensus.cc:3055] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:42.128381 31954 raft_consensus.cc:740] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:42.129699 31975 consensus_queue.cc:1048] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:42.130518 31954 consensus_queue.cc:260] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:42.117187 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:42.117573 31935 raft_consensus.cc:2749] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:42.118106 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:42.115353 31824 raft_consensus.cc:515] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:42.118947 32001 raft_consensus.cc:2749] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:42.095420 31852 raft_consensus.cc:515] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:42.139485 30140 leader_election.cc:304] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:42.116815 30027 raft_consensus.cc:2468] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 4.
I20260709 13:10:42.142844 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:42.143364 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:42.151620 30066 leader_election.cc:304] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
W20260709 13:10:42.153717 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 114104us
I20260709 13:10:42.169113 30024 raft_consensus.cc:2393] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 4: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:10:42.157217 30101 raft_consensus.cc:1275] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:42.167755 31699 raft_consensus.cc:993] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4: : Instructing follower 5ec73dc157ed476ca903a7d596271719 to start an election
I20260709 13:10:42.159679 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:42.160492 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:42.160938 32004 consensus_queue.cc:1059] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:42.172714 30068 leader_election.cc:304] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:42.166932 31789 consensus_queue.cc:1048] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:42.167151 32001 consensus_queue.cc:1059] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:42.150990 31907 consensus_queue.cc:1059] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:10:42.175257 31935 raft_consensus.cc:2804] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:42.175966 31852 leader_election.cc:290] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:42.177300 30019 raft_consensus.cc:1275] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:42.172278 30022 raft_consensus.cc:2468] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 3.
I20260709 13:10:42.152064 31791 consensus_queue.cc:1059] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:10:42.173692 31923 raft_consensus.cc:2749] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:42.175240 30140 leader_election.cc:304] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:42.175397 30099 raft_consensus.cc:1275] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:42.151679 31951 consensus_queue.cc:1059] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:10:42.172142 30025 raft_consensus.cc:2468] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 5.
I20260709 13:10:42.166210 29994 leader_election.cc:304] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
W20260709 13:10:42.181363 30142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.184916 31789 raft_consensus.cc:2749] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:42.186127 31824 leader_election.cc:290] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:42.187646 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:42.188467 30021 raft_consensus.cc:2393] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 4: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:10:42.175485 31996 consensus_queue.cc:1048] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 13:10:42.183497 32004 consensus_queue.cc:1243] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer b2cea0098c1040f69755ea4d3dab7fc4 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:10:42.190641 31907 consensus_queue.cc:1243] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer b2cea0098c1040f69755ea4d3dab7fc4 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:10:42.174636 31816 raft_consensus.cc:1081] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Signalling peer 5ec73dc157ed476ca903a7d596271719 to start an election
I20260709 13:10:42.182971 31954 raft_consensus.cc:3060] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:42.196179 30066 leader_election.cc:304] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:42.199067 31730 consensus_queue.cc:1048] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:42.195196 31923 raft_consensus.cc:2749] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:42.196300 31699 consensus_queue.cc:1059] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:10:42.206629 31789 raft_consensus.cc:3055] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:42.198283 31852 consensus_queue.cc:1048] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:10:42.209385 30700 leader_election.cc:304] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:42.214284 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:42.207072 31789 raft_consensus.cc:740] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:42.220614 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:42.221318 30022 raft_consensus.cc:2393] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 3: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:42.224136 30021 raft_consensus.cc:1275] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:42.197919 31983 consensus_queue.cc:1048] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:10:42.213151 31829 raft_consensus.cc:2804] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:42.207197 31866 consensus_queue.cc:1048] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:10:42.226895 31829 raft_consensus.cc:493] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.227260 31829 raft_consensus.cc:3060] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:42.229202 31789 consensus_queue.cc:260] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:42.227126 30177 raft_consensus.cc:3055] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:42.232069 30177 raft_consensus.cc:740] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:42.233553 30066 leader_election.cc:304] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
W20260709 13:10:42.235280 30069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.235780 31951 raft_consensus.cc:3055] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:42.236166 31951 raft_consensus.cc:740] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:42.236438 32004 raft_consensus.cc:2749] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:42.238544 30175 raft_consensus.cc:1275] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:10:42.242700 31951 consensus_queue.cc:260] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:42.243371 31931 raft_consensus.cc:3055] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:42.243794 31931 raft_consensus.cc:740] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:42.239408 30177 consensus_queue.cc:260] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:42.244599 31931 consensus_queue.cc:260] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:42.247341 31931 raft_consensus.cc:3060] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:42.222054 31824 raft_consensus.cc:3055] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:42.248975 31824 raft_consensus.cc:740] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:42.248971 31852 raft_consensus.cc:2804] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:42.249791 31824 consensus_queue.cc:260] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:42.231014 32001 consensus_queue.cc:1243] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer b2cea0098c1040f69755ea4d3dab7fc4 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:10:42.253108 30177 raft_consensus.cc:3060] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:42.254575 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 84200.8us
I20260709 13:10:42.219116 31700 consensus_queue.cc:1048] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:10:42.231436 31730 consensus_queue.cc:1048] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
W20260709 13:10:42.266808 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 92888us
I20260709 13:10:42.252965 31790 consensus_queue.cc:1048] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:10:42.262533 31824 raft_consensus.cc:3060] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:42.269878 30140 leader_election.cc:400] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 2 pre-election: Vote denied by peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451) with higher term. Message: Invalid argument: T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 2. Current term is 3.
I20260709 13:10:42.272421 30068 leader_election.cc:304] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:42.265662 31935 raft_consensus.cc:697] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 4 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:42.298277 30177 raft_consensus.cc:1275] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:42.299563 30140 leader_election.cc:403] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:42.270931 32004 raft_consensus.cc:2804] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:42.272586 31951 raft_consensus.cc:3060] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:42.314570 30140 leader_election.cc:304] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
W20260709 13:10:42.306042 31851 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:10:42.320483 30020 raft_consensus.cc:2468] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 3.
I20260709 13:10:42.328706 32012 consensus_queue.cc:1048] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:10:42.329299 32004 raft_consensus.cc:697] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 3 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:42.305722 32008 raft_consensus.cc:493] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.354384 32008 raft_consensus.cc:515] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:42.355988 32011 raft_consensus.cc:2804] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:42.356663 32011 raft_consensus.cc:697] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 5 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:42.357542 32011 consensus_queue.cc:237] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:42.337992 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 65631.5us
W20260709 13:10:42.338307 30142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.362578 30068 leader_election.cc:304] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:42.339449 31791 raft_consensus.cc:3060] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:10:42.346591 31935 consensus_queue.cc:237] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:42.329882 32016 raft_consensus.cc:2749] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:42.370872 30068 leader_election.cc:304] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:42.354089 31789 raft_consensus.cc:3060] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:10:42.382768 30096 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee"
dest_uuid: "5ec73dc157ed476ca903a7d596271719"
 from {username='slave'} at 127.0.0.1:33990
I20260709 13:10:42.383224 30096 raft_consensus.cc:493] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:42.383495 30096 raft_consensus.cc:3060] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:42.380049 32001 raft_consensus.cc:3060] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:42.397099 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:10:42.397625 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 88998us
I20260709 13:10:42.406410 30140 leader_election.cc:304] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:42.363955 31829 raft_consensus.cc:515] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:42.410553 30069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.387372 31852 raft_consensus.cc:697] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 2 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:42.423235 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
W20260709 13:10:42.424616 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 53819.8us
I20260709 13:10:42.430351 30177 raft_consensus.cc:2468] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 4.
I20260709 13:10:42.431721 30702 leader_election.cc:304] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:42.432556 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:42.433089 30024 raft_consensus.cc:2393] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 4: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:42.440649 30096 raft_consensus.cc:515] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:42.397775 32008 leader_election.cc:290] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:42.450588 30140 leader_election.cc:304] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:42.430830 32012 raft_consensus.cc:2749] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:42.456099 30102 raft_consensus.cc:1240] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:42.388024 32010 consensus_queue.cc:1048] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260709 13:10:42.434535 31931 raft_consensus.cc:2749] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:10:42.463356 30141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.456120 32008 raft_consensus.cc:2804] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:42.354410 32004 consensus_queue.cc:237] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:42.460062 32013 raft_consensus.cc:2749] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:42.464622 32021 raft_consensus.cc:493] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.467628 32008 raft_consensus.cc:493] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.483960 30169 raft_consensus.cc:1275] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:42.484730 30140 leader_election.cc:304] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:42.486675 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:42.462459 32022 consensus_queue.cc:1048] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.020s
I20260709 13:10:42.490465 30098 raft_consensus.cc:1275] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:42.491345 30097 raft_consensus.cc:2393] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 4: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:10:42.491366 32026 consensus_queue.cc:1059] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20260709 13:10:42.492558 32018 log.cc:927] Time spent T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:10:42.465034 32024 consensus_queue.cc:1059] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:10:42.495244 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:42.499333 30098 raft_consensus.cc:2393] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 4: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:10:42.485834 32008 raft_consensus.cc:3060] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:42.485324 31852 consensus_queue.cc:237] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:42.502478 30140 leader_election.cc:304] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:42.486220 32021 raft_consensus.cc:515] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:42.494726 32013 raft_consensus.cc:3060] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:42.512562 32026 raft_consensus.cc:3055] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:42.521073 30098 raft_consensus.cc:1275] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 3. (term mismatch)
I20260709 13:10:42.521435 30098 pending_rounds.cc:85] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719: Aborting all ops after (but not including) 2
I20260709 13:10:42.521673 30098 pending_rounds.cc:107] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 2.3
I20260709 13:10:42.531625 30098 raft_consensus.cc:2917] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Aborting config change with OpId 2.3: Aborted: Op aborted by new leader
I20260709 13:10:42.532007 30098 raft_consensus.cc:2889] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:42.513922 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:42.535876 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:42.520143 32026 raft_consensus.cc:740] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:42.540644 30140 leader_election.cc:400] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 election: Vote denied by peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451) with higher term. Message: Invalid argument: T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 4. Current term is 5.
I20260709 13:10:42.540915 30140 leader_election.cc:403] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
W20260709 13:10:42.541298 30066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.541792 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:42.546147 30098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:48548 (request call id 14) took 1543 ms. Trace:
I20260709 13:10:42.530300 31923 raft_consensus.cc:2804] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:42.530794 32024 raft_consensus.cc:493] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:42.573597 32024 raft_consensus.cc:515] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:42.575654 32024 leader_election.cc:290] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:42.571188 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:42.572305 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:42.576596 30102 raft_consensus.cc:2368] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 3. Current term is 4.
I20260709 13:10:42.573123 30094 raft_consensus.cc:3055] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:42.577271 30094 raft_consensus.cc:740] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:42.577780 30097 raft_consensus.cc:1275] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:42.578076 30094 consensus_queue.cc:260] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:42.578935 32021 leader_election.cc:290] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:42.579186 30094 raft_consensus.cc:3060] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:42.534462 31829 leader_election.cc:290] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:42.580680 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:42.581269 31829 raft_consensus.cc:493] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.582202 30103 raft_consensus.cc:2393] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 3: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
W20260709 13:10:42.586448 30142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.546559 30098 rpcz_store.cc:276] 0709 13:10:40.992478 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:40.993742 (+  1264us) service_pool.cc:224] Handling call
0709 13:10:41.000408 (+  6666us) log.cc:844] Serialized 499 byte log entry
0709 13:10:41.522084 (+521676us) spinlock_profiling.cc:243] Waited 9.64 ms on lock 0x7b18000528a0. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f7e95de1 00007f99f7ea25b1 00007f99f1c624bc 00007f99eefb048b 00007f99f7e0aab9 00007f99eefcc69b 00007f99eefca93f 00007f99eefca455 00007f99f2013b0b 00007f99f2098b63 00007f99f20c0752
0709 13:10:42.534411 (+1012327us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":47822,"raft.run_cpu_time_us":1615,"raft.run_wall_time_us":68036,"spinlock_wait_cycles":22166912,"thread_start_us":115332,"threads_started":2,"wal-append.queue_time_us":100560,"wal-append.run_cpu_time_us":2111,"wal-append.run_wall_time_us":1095161}
W20260709 13:10:42.685402 30143 leader_election.cc:336] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Timed out: RequestConsensusVote RPC to 127.28.54.66:43821 timed out after 2.095s (SENT)
I20260709 13:10:42.685525 30175 raft_consensus.cc:1275] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:42.539534 31935 raft_consensus.cc:493] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:42.728730 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:42.703469 32011 raft_consensus.cc:2749] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451) with higher term. Message: Invalid argument: T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 4. Current term is 5.
I20260709 13:10:42.730788 32008 raft_consensus.cc:515] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:42.734755 30101 raft_consensus.cc:1275] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:42.727847 30170 raft_consensus.cc:1275] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:10:42.735438 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 194846us
I20260709 13:10:42.743649 30140 leader_election.cc:304] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:42.617141 32001 raft_consensus.cc:2749] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:10:42.736183 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 50824.4us
I20260709 13:10:42.702994 30730 raft_consensus.cc:1275] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:10:42.734014 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:42.753576 30103 raft_consensus.cc:3060] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:42.747303 30098 raft_consensus.cc:1240] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 1. Current term is 2. Ops: []
I20260709 13:10:42.754616 30140 leader_election.cc:304] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:42.755448 30140 leader_election.cc:304] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:42.581715 31829 raft_consensus.cc:515] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:42.740569 32031 log.cc:927] Time spent T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 13:10:42.794054 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:42.797011 30098 raft_consensus.cc:2376] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 3. Re-sending same reply.
I20260709 13:10:42.797523 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:42.740072 31935 raft_consensus.cc:515] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:42.769304 32011 raft_consensus.cc:2804] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:42.837859 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:42.765983 32038 raft_consensus.cc:2804] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:42.745317 30732 raft_consensus.cc:2468] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 3.
I20260709 13:10:42.792004 32030 raft_consensus.cc:493] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.846117 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:42.849345 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:42.850525 30098 raft_consensus.cc:2393] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 4: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:10:42.797427 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
W20260709 13:10:42.861172 30142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.849669 32030 raft_consensus.cc:515] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:42.866472 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
W20260709 13:10:42.866757 32037 log.cc:927] Time spent T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:10:42.867475 30098 raft_consensus.cc:2393] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 4: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:10:42.842944 32011 raft_consensus.cc:493] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:42.845124 32013 raft_consensus.cc:2749] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:42.800089 31957 consensus_queue.cc:1048] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.062s
I20260709 13:10:42.803759 31789 consensus_queue.cc:1048] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 13:10:42.883107 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:42.856421 31738 raft_consensus.cc:493] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.837612 32022 consensus_queue.cc:1048] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 13:10:42.889231 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:42.892134 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:42.893441 31907 raft_consensus.cc:2804] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:42.894937 32030 leader_election.cc:290] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:42.902803 30096 leader_election.cc:290] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:42.905548 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:42.907198 30022 raft_consensus.cc:1240] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:42.908242 30100 raft_consensus.cc:2468] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 3.
I20260709 13:10:42.909022 30176 raft_consensus.cc:3060] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:42.880301 32011 raft_consensus.cc:3060] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:42.917325 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
W20260709 13:10:42.912510 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 120323us
I20260709 13:10:42.914031 30103 raft_consensus.cc:2468] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 3.
W20260709 13:10:42.921032 30068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:42.938365 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:42.939096 30098 raft_consensus.cc:2468] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 3.
I20260709 13:10:42.921903 30068 leader_election.cc:304] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:42.942466 30096 raft_consensus.cc:1275] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:42.867188 31902 raft_consensus.cc:493] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:42.912256 31907 raft_consensus.cc:493] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:42.916592 31791 consensus_meta.cc:287] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124: Time spent flushing consensus metadata: real 0.547s	user 0.008s	sys 0.000s
I20260709 13:10:42.945596 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:42.916695 31829 leader_election.cc:290] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:42.956185 30102 raft_consensus.cc:1275] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 13:10:42.942025 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:42.957681 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:42.958271 30096 raft_consensus.cc:3060] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:42.843950 32026 consensus_queue.cc:260] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:42.956575 30102 pending_rounds.cc:85] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719: Aborting all ops after (but not including) 4
I20260709 13:10:42.963672 30102 pending_rounds.cc:107] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719: Aborting uncommitted NO_OP operation due to leader change: 3.5
I20260709 13:10:42.911970 31738 raft_consensus.cc:515] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:42.946947 32004 raft_consensus.cc:2749] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:42.963140 30098 raft_consensus.cc:1275] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:42.963943 30102 raft_consensus.cc:2889] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:42.949683 31907 raft_consensus.cc:3060] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:42.972683 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:42.955154 31791 raft_consensus.cc:2749] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451) with higher term. Message: Invalid argument: T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 2. Current term is 3.
I20260709 13:10:42.978169 30100 raft_consensus.cc:2393] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 3: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:42.982077 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:42.982509 30096 raft_consensus.cc:2468] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 2.
I20260709 13:10:42.986744 30025 raft_consensus.cc:2468] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 5.
I20260709 13:10:42.962575 31923 raft_consensus.cc:697] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 4 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:42.989421 31923 consensus_queue.cc:237] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:42.975904 32038 raft_consensus.cc:697] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 4 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:42.993034 32038 consensus_queue.cc:237] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:42.993956 31797 tablet_copy_client.cc:538] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:10:42.969664 30094 raft_consensus.cc:1275] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:42.949005 31902 raft_consensus.cc:515] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:43.003147 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:42.970659 32008 leader_election.cc:290] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:42.968537 30019 raft_consensus.cc:2468] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
I20260709 13:10:43.005358 30143 leader_election.cc:400] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 election: Vote denied by peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821) with higher term. Message: Invalid argument: T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 3. Current term is 4.
I20260709 13:10:43.014072 30143 leader_election.cc:403] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:10:43.006810 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:43.014775 30098 raft_consensus.cc:2376] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 3. Re-sending same reply.
I20260709 13:10:42.977159 30097 raft_consensus.cc:1240] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:10:43.018604 30143 leader_election.cc:304] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:43.028677 30099 raft_consensus.cc:2468] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 4.
I20260709 13:10:43.030177 30143 leader_election.cc:304] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:43.031375 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:43.032015 30098 raft_consensus.cc:2376] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 4. Re-sending same reply.
I20260709 13:10:43.033157 30098 raft_consensus.cc:1240] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:43.034579 30143 leader_election.cc:304] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:10:43.036798 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 281399us
I20260709 13:10:43.036517 30143 leader_election.cc:304] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:43.020975 31791 raft_consensus.cc:2749] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821) with higher term. Message: Invalid argument: T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 3. Current term is 4.
W20260709 13:10:43.035595 32002 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 13:10:43.037386 32013 raft_consensus.cc:2749] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:43.045670 30143 leader_election.cc:304] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:10:43.046301 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 58149.4us
I20260709 13:10:43.046522 30140 leader_election.cc:304] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:10:43.038226 31931 raft_consensus.cc:2749] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:43.036346 32047 raft_consensus.cc:2749] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:43.048627 30143 leader_election.cc:304] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:43.048849 30703 leader_election.cc:304] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:43.054827 31797 tablet_bootstrap.cc:492] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap starting.
I20260709 13:10:43.065099 31902 leader_election.cc:290] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:43.068068 30176 raft_consensus.cc:2468] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 5.
I20260709 13:10:43.049373 32049 consensus_queue.cc:1048] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 13:10:43.068676 31923 raft_consensus.cc:2804] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:43.068858 32047 raft_consensus.cc:2804] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:43.048319 32048 raft_consensus.cc:2749] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:43.069337 32047 raft_consensus.cc:697] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 3 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:43.070017 31791 raft_consensus.cc:493] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:43.070363 32047 consensus_queue.cc:237] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:43.070963 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:43.070501 31791 raft_consensus.cc:515] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:43.057669 32051 raft_consensus.cc:2749] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:43.071744 30177 raft_consensus.cc:2368] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for earlier term 2. Current term is 3.
I20260709 13:10:43.069612 31923 raft_consensus.cc:697] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 3 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:43.073172 31791 leader_election.cc:290] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:43.073271 31923 consensus_queue.cc:237] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:43.069254 30143 leader_election.cc:304] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:43.074683 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:43.077801 30143 leader_election.cc:304] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:43.057287 31738 leader_election.cc:290] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:43.079795 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:43.080730 30703 leader_election.cc:304] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:43.078478 31791 raft_consensus.cc:2749] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:43.075182 31902 raft_consensus.cc:2749] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:43.084749 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:43.087463 30068 leader_election.cc:400] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 election: Vote denied by peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001) with higher term. Message: Invalid argument: T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for earlier term 2. Current term is 3.
I20260709 13:10:43.091295 30068 leader_election.cc:403] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:10:43.092142 32002 raft_consensus.cc:2749] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001) with higher term. Message: Invalid argument: T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for earlier term 2. Current term is 3.
I20260709 13:10:43.087744 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:43.088863 30143 leader_election.cc:304] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:43.097334 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:43.060575 32011 raft_consensus.cc:515] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:43.097600 32048 raft_consensus.cc:2749] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:43.104563 30703 leader_election.cc:304] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:43.087817 32051 raft_consensus.cc:2764] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 13:10:43.100078 30732 raft_consensus.cc:2393] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 3: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:10:43.110363 30177 raft_consensus.cc:2468] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 3.
I20260709 13:10:43.103223 30170 raft_consensus.cc:1240] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:43.114161 30172 raft_consensus.cc:2368] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for earlier term 3. Current term is 4.
I20260709 13:10:43.110522 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:43.115727 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:43.112898 31902 raft_consensus.cc:2749] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:43.116554 30173 raft_consensus.cc:2393] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 4: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:10:43.116648 32055 raft_consensus.cc:2804] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:43.118480 32055 raft_consensus.cc:493] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:43.118889 32055 raft_consensus.cc:3060] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:43.098021 32038 consensus_queue.cc:1048] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 13:10:43.122520 30173 raft_consensus.cc:1240] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:10:43.123466 30068 leader_election.cc:304] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:43.115778 30021 raft_consensus.cc:2468] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 4.
I20260709 13:10:43.124022 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
W20260709 13:10:43.145354 32036 log.cc:927] Time spent T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.417s	user 0.003s	sys 0.000s
I20260709 13:10:43.154306 30703 leader_election.cc:304] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:43.125923 32002 raft_consensus.cc:2749] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:43.145901 32055 raft_consensus.cc:515] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:43.158509 32020 raft_consensus.cc:493] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.161473 32020 raft_consensus.cc:515] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:43.162487 32055 leader_election.cc:290] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:43.163604 32020 leader_election.cc:290] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:43.140027 31907 raft_consensus.cc:515] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:43.167315 31907 leader_election.cc:290] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:43.168484 30171 raft_consensus.cc:1240] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:43.141160 32011 leader_election.cc:290] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:43.171159 31700 raft_consensus.cc:2749] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:43.127038 32014 consensus_queue.cc:1059] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
W20260709 13:10:43.173812 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 47138us
I20260709 13:10:43.174376 30703 leader_election.cc:304] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:43.175745 31700 raft_consensus.cc:2749] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:43.176110 30103 raft_consensus.cc:1217] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Deduplicated request from leader. Original: 1.1->[2.2-2.2]   Dedup: 2.2->[]
W20260709 13:10:43.176546 29974 auto_rebalancer.cc:629] Failed to schedule move for tablet ff758e6a87fa49b99c35558fafe39f11: Aborted: Op aborted by new leader
I20260709 13:10:43.177636 31954 raft_consensus.cc:493] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:43.176635 30103 raft_consensus.cc:1240] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:10:43.182435 31954 raft_consensus.cc:515] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:43.183727 31935 leader_election.cc:290] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:43.184518 31954 leader_election.cc:290] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:43.175474 30703 leader_election.cc:304] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:43.187279 31829 raft_consensus.cc:2749] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:43.190286 30703 leader_election.cc:304] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:43.193512 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:43.194200 30020 raft_consensus.cc:3060] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:43.194828 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:43.194263 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:43.196837 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:43.199468 30068 leader_election.cc:304] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:43.201828 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:43.202447 30022 raft_consensus.cc:2468] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 3.
I20260709 13:10:43.205920 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:43.206489 30019 raft_consensus.cc:3060] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:43.195436 30021 raft_consensus.cc:2468] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 5.
I20260709 13:10:43.215561 31700 consensus_queue.cc:1048] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:43.208233 32010 raft_consensus.cc:2749] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:43.216343 31829 consensus_queue.cc:1048] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:43.219162 30025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54198 (request call id 1645) took 1005 ms. Trace:
I20260709 13:10:43.219569 30025 rpcz_store.cc:276] 0709 13:10:42.213894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.214004 (+   110us) service_pool.cc:224] Handling call
0709 13:10:43.218966 (+1004962us) spinlock_profiling.cc:243] Waited 529 ms on lock 0x7b54002e45d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:10:43.219094 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1217511680}
I20260709 13:10:43.215584 31874 raft_consensus.cc:2749] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:43.222760 30068 leader_election.cc:400] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 election: Vote denied by peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001) with higher term. Message: Invalid argument: T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for earlier term 3. Current term is 4.
I20260709 13:10:43.223099 30068 leader_election.cc:403] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:10:43.227458 29993 leader_election.cc:304] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:43.228422 30703 leader_election.cc:304] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:43.229735 30732 raft_consensus.cc:1275] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:10:43.230207 31831 consensus_queue.cc:1048] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:10:43.219416 32032 log.cc:927] Time spent T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.454s	user 0.000s	sys 0.002s
I20260709 13:10:43.231173 31977 consensus_queue.cc:1048] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:43.232723 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:43.238723 30143 leader_election.cc:304] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:10:43.293576 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 54932.8us
I20260709 13:10:43.294713 30143 leader_election.cc:304] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:43.240943 30732 pending_rounds.cc:85] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a: Aborting all ops after (but not including) 5
I20260709 13:10:43.246469 30730 raft_consensus.cc:1240] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:43.246848 30020 raft_consensus.cc:2468] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 5.
I20260709 13:10:43.249747 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:43.250432 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:43.251127 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:43.311750 30096 raft_consensus.cc:2376] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 4. Re-sending same reply.
I20260709 13:10:43.233927 32010 raft_consensus.cc:3060] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:43.254745 30177 raft_consensus.cc:1275] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:43.257973 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:43.258363 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:43.258607 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:43.259541 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:43.266260 30703 leader_election.cc:304] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:43.268520 30728 raft_consensus.cc:1275] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:43.269155 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:43.269925 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:43.272653 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:43.335238 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:43.335807 30177 raft_consensus.cc:3060] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:43.273989 32042 raft_consensus.cc:2804] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:10:43.274577 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:43.275665 30066 leader_election.cc:304] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:43.338091 30736 raft_consensus.cc:2393] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 2: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:10:43.347263 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:43.281353 32026 raft_consensus.cc:3060] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:43.283342 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:10:43.285387 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 58002us
I20260709 13:10:42.379093 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:43.254660 32002 raft_consensus.cc:3055] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:43.330879 29926 catalog_manager.cc:5697] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: term changed from 1 to 2, leader changed from c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) to 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68). New cstate: current_term: 2 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:43.312346 31923 raft_consensus.cc:2749] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:10:43.326555 30700 leader_election.cc:304] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:43.300664 30732 pending_rounds.cc:107] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:10:43.330463 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:43.298718 31975 raft_consensus.cc:2804] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:43.300355 31729 raft_consensus.cc:493] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.345451 30068 leader_election.cc:304] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:43.358844 30177 raft_consensus.cc:2468] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 5.
W20260709 13:10:43.359541 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 83943.2us
I20260709 13:10:43.355279 30174 raft_consensus.cc:2468] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 2.
W20260709 13:10:43.374963 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 48473.6us
I20260709 13:10:43.375938 30700 leader_election.cc:304] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:43.356921 29922 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51828 (request call id 307) took 4219 ms. Trace:
I20260709 13:10:43.371068 32011 raft_consensus.cc:2749] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:43.378835 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:43.372288 30066 leader_election.cc:304] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:43.330935 30731 raft_consensus.cc:3060] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:10:43.311184 31738 consensus_queue.cc:1048] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 13:10:43.328908 30019 raft_consensus.cc:2468] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 5.
W20260709 13:10:43.391779 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 46217.4us
I20260709 13:10:43.369642 32016 raft_consensus.cc:2764] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 13:10:43.311677 31954 consensus_queue.cc:1059] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 13:10:43.386126 30700 leader_election.cc:304] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
W20260709 13:10:43.393959 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 127794us
I20260709 13:10:43.373934 32042 raft_consensus.cc:697] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:43.369333 30732 raft_consensus.cc:2889] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:43.332764 31935 consensus_queue.cc:1048] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 13:10:43.366226 32002 raft_consensus.cc:740] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:43.394780 30737 raft_consensus.cc:1275] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:43.397547 29926 catalog_manager.cc:5697] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: term changed from 1 to 3, leader changed from c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) to 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68). New cstate: current_term: 3 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:43.379151 31831 raft_consensus.cc:2804] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:43.369509 31975 raft_consensus.cc:493] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:43.373340 32004 raft_consensus.cc:2749] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:43.336257 31957 consensus_queue.cc:1048] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 13:10:43.337879 32020 consensus_queue.cc:1048] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.054s
I20260709 13:10:43.385780 32030 raft_consensus.cc:2804] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:43.373019 31820 consensus_queue.cc:1048] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:10:43.384282 31852 raft_consensus.cc:493] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:43.411201 31874 raft_consensus.cc:2804] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:43.411633 32025 consensus_queue.cc:1059] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.076s
I20260709 13:10:43.379531 31790 consensus_queue.cc:1048] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:10:43.382165 31729 raft_consensus.cc:515] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:43.407624 31996 consensus_queue.cc:1059] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
I20260709 13:10:43.418067 29926 catalog_manager.cc:5697] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: term changed from 1 to 2, leader changed from 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) to 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68). New cstate: current_term: 2 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:43.459836 30175 raft_consensus.cc:1240] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260709 13:10:43.447376 31797 tablet_bootstrap.cc:492] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:10:43.441241 32014 raft_consensus.cc:2804] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:43.421159 32023 raft_consensus.cc:493] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.429716 32030 raft_consensus.cc:493] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.417730 30731 raft_consensus.cc:2468] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 5.
I20260709 13:10:43.429425 31831 raft_consensus.cc:697] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
W20260709 13:10:43.508809 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 146123us
I20260709 13:10:43.471642 32055 raft_consensus.cc:3055] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:43.421439 31975 raft_consensus.cc:3060] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:43.431237 32008 raft_consensus.cc:2804] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:43.443424 31729 leader_election.cc:290] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:10:43.510715 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 109342us
I20260709 13:10:43.443984 32025 raft_consensus.cc:3055] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:10:43.465801 31874 raft_consensus.cc:697] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
W20260709 13:10:43.513641 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 155108us
W20260709 13:10:43.513823 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 141554us
W20260709 13:10:43.519160 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 114803us
I20260709 13:10:43.384074 29922 rpcz_store.cc:276] 0709 13:10:39.137485 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:39.143799 (+  6314us) service_pool.cc:224] Handling call
0709 13:10:43.356859 (+4213060us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:41.757777 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:41.769079 (+ 11302us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:41.769152 (+    73us) write_op.cc:435] Acquired schema lock
0709 13:10:41.769172 (+    20us) tablet.cc:662] Decoding operations
0709 13:10:41.769824 (+   652us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:41.799969 (+ 30145us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:41.802620 (+  2651us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:10:41.906311 (+103691us) tablet.cc:701] Row locks acquired
0709 13:10:41.918895 (+ 12584us) write_op.cc:260] PREPARE: finished
0709 13:10:41.919076 (+   181us) write_op.cc:270] Start()
0709 13:10:41.919225 (+   149us) write_op.cc:276] Timestamp: P: 1783602641919006 usec, L: 0
0709 13:10:41.919243 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:10:41.957192 (+ 37949us) log.cc:844] Serialized 1326 byte log entry
0709 13:10:42.167635 (+210443us) op_driver.cc:464] REPLICATION: finished
0709 13:10:42.311418 (+143783us) write_op.cc:301] APPLY: starting
0709 13:10:42.349989 (+ 38571us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:42.350126 (+   137us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:42.359075 (+  8949us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:42.359581 (+   506us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:42.359755 (+   174us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:10:42.359799 (+    44us) write_op.cc:312] APPLY: finished
0709 13:10:42.359981 (+   182us) log.cc:844] Serialized 35 byte log entry
0709 13:10:42.360133 (+   152us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:42.360230 (+    97us) write_op.cc:454] Released schema lock
0709 13:10:42.360270 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:42.360625 (+   355us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:42.360652 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":592770,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":128766,"apply.run_cpu_time_us":2140,"apply.run_wall_time_us":53408,"num_ops":3,"prepare.queue_time_us":95335,"prepare.run_cpu_time_us":5084,"prepare.run_wall_time_us":232519,"replication_time_us":248222,"thread_start_us":110215,"threads_started":2}]]}
I20260709 13:10:43.466130 32011 consensus_queue.cc:1048] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:10:43.445035 31852 raft_consensus.cc:515] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:43.525059 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 132375us
I20260709 13:10:43.516695 32055 raft_consensus.cc:740] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:43.512656 32030 raft_consensus.cc:3060] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:43.554802 30700 leader_election.cc:304] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:43.517288 32014 raft_consensus.cc:697] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 5 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:43.546952 30102 raft_consensus.cc:1275] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:43.548213 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:43.586050 30096 raft_consensus.cc:2393] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 2: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:10:43.556759 30702 leader_election.cc:304] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:43.455945 32042 consensus_queue.cc:237] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:43.460224 32002 consensus_queue.cc:260] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:43.540441 32025 raft_consensus.cc:740] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
W20260709 13:10:43.602483 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 46940.5us
W20260709 13:10:43.617249 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 76760.8us
W20260709 13:10:43.618477 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 71756.8us
I20260709 13:10:43.553033 32072 raft_consensus.cc:493] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.624210 30024 raft_consensus.cc:2468] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
W20260709 13:10:43.627871 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 71529.9us
I20260709 13:10:43.596522 32077 raft_consensus.cc:2804] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:43.620395 32001 raft_consensus.cc:493] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.602083 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:43.514510 32023 raft_consensus.cc:515] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:43.634268 31831 consensus_queue.cc:237] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:43.638506 30022 raft_consensus.cc:1275] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:43.639130 30023 raft_consensus.cc:1275] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:10:43.639343 30027 raft_consensus.cc:1275] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:43.639953 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:43.626519 31797 tablet_bootstrap.cc:492] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap complete.
I20260709 13:10:43.629081 32072 raft_consensus.cc:515] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:43.641865 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:43.642637 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:43.643352 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:43.644709 32010 raft_consensus.cc:2749] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001) with higher term. Message: Invalid argument: T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for earlier term 3. Current term is 4.
I20260709 13:10:43.649770 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:43.695946 30098 raft_consensus.cc:2468] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 1.
I20260709 13:10:43.651538 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:43.618674 31935 consensus_queue.cc:1059] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260709 13:10:43.651098 31874 consensus_queue.cc:237] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:43.655174 32014 consensus_queue.cc:237] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:43.692596 32051 raft_consensus.cc:493] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:43.695266 31907 consensus_queue.cc:1048] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:10:43.699136 29994 leader_election.cc:304] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:43.700464 30022 raft_consensus.cc:1275] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 13:10:43.704309 32075 raft_consensus.cc:493] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.732901 32075 raft_consensus.cc:515] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:43.734942 32075 leader_election.cc:290] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:10:43.719956 32080 log.cc:927] Time spent T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260709 13:10:43.713210 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 108814us
I20260709 13:10:43.710850 30019 raft_consensus.cc:3060] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:43.654906 32001 raft_consensus.cc:515] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:43.698335 30020 raft_consensus.cc:2468] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 3.
I20260709 13:10:43.736039 31797 ts_tablet_manager.cc:1403] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent bootstrapping tablet: real 0.681s	user 0.034s	sys 0.032s
I20260709 13:10:43.695308 32004 consensus_queue.cc:1048] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.044s
I20260709 13:10:43.751775 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:43.720201 32078 raft_consensus.cc:2749] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:43.739552 31699 raft_consensus.cc:2804] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:43.754175 30101 raft_consensus.cc:2468] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 4.
I20260709 13:10:43.757576 30068 leader_election.cc:304] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:43.758837 30068 leader_election.cc:304] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:43.759919 30068 leader_election.cc:304] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:43.765539 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:43.768100 30068 leader_election.cc:304] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:43.772861 31797 raft_consensus.cc:359] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:43.773773 31797 raft_consensus.cc:740] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Initialized, Role: LEARNER
I20260709 13:10:43.774468 31797 consensus_queue.cc:260] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:43.776399 31797 ts_tablet_manager.cc:1434] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent starting tablet: real 0.022s	user 0.004s	sys 0.000s
I20260709 13:10:43.779861 30025 raft_consensus.cc:1275] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:43.683341 32025 consensus_queue.cc:260] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:43.755420 31699 raft_consensus.cc:493] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:43.767124 32010 raft_consensus.cc:2749] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:43.764400 32012 raft_consensus.cc:2749] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:43.800048 30140 leader_election.cc:304] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:43.741160 31975 raft_consensus.cc:515] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:43.739733 32051 raft_consensus.cc:515] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:43.836491 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 68463us
I20260709 13:10:43.804618 31699 raft_consensus.cc:3060] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:43.850720 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 196953us
I20260709 13:10:43.855250 30027 raft_consensus.cc:1240] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:43.813124 32024 raft_consensus.cc:2749] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:43.790112 31851 consensus_queue.cc:1048] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
W20260709 13:10:43.887599 30069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:43.894785 32090 consensus_queue.cc:1048] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:10:43.896171 32090 raft_consensus.cc:2749] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:43.896857 32090 raft_consensus.cc:493] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:43.900640 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:43.836393 31852 leader_election.cc:290] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:10:43.891058 32063 log.cc:927] Time spent T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:10:43.892781 31951 raft_consensus.cc:3055] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:43.964313 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:43.979926 30734 raft_consensus.cc:2468] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 2.
I20260709 13:10:43.897330 32090 raft_consensus.cc:515] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:43.987608 32090 leader_election.cc:290] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:43.992679 30019 raft_consensus.cc:2468] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 4.
I20260709 13:10:43.954062 32069 raft_consensus.cc:493] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.007900 32069 raft_consensus.cc:515] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:44.009272 32097 consensus_queue.cc:1048] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:43.958657 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:44.011771 32021 raft_consensus.cc:493] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.012490 32051 leader_election.cc:290] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:44.015398 32002 raft_consensus.cc:3060] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:44.016671 32109 raft_consensus.cc:493] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:44.017171 32109 raft_consensus.cc:515] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:44.018883 32108 raft_consensus.cc:493] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.022621 32001 leader_election.cc:290] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:44.023126 32072 leader_election.cc:290] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:43.971213 31951 raft_consensus.cc:740] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:44.027734 31975 leader_election.cc:290] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:43.855266 32010 consensus_queue.cc:1059] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.113s
I20260709 13:10:43.955494 30020 raft_consensus.cc:1275] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:44.018316 32105 raft_consensus.cc:493] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:43.910465 32088 raft_consensus.cc:2749] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:44.081034 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:43.981249 32077 raft_consensus.cc:697] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:44.090031 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:10:44.098519 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 261298us
I20260709 13:10:44.059158 32023 leader_election.cc:290] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:44.099613 30068 leader_election.cc:304] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:44.059466 32090 raft_consensus.cc:493] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:44.015421 32030 raft_consensus.cc:515] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:44.012432 32021 raft_consensus.cc:515] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:44.123279 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 323311us
I20260709 13:10:44.096355 32069 leader_election.cc:290] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:44.124010 30140 leader_election.cc:304] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:44.114220 32072 raft_consensus.cc:493] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:44.061313 32108 raft_consensus.cc:515] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:44.117540 32023 raft_consensus.cc:493] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.118495 32001 raft_consensus.cc:493] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.137212 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:44.138108 30103 raft_consensus.cc:1275] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:44.122056 31789 raft_consensus.cc:493] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.119215 32090 raft_consensus.cc:515] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:44.130214 32010 raft_consensus.cc:493] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:44.116410 32105 raft_consensus.cc:515] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:44.185077 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:44.126760 31951 consensus_queue.cc:260] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:44.134948 32072 raft_consensus.cc:515] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:44.145292 32001 raft_consensus.cc:515] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:44.142473 32023 raft_consensus.cc:515] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:44.146872 31789 raft_consensus.cc:515] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:44.193810 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
W20260709 13:10:44.244310 32091 log.cc:927] Time spent T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.198s	user 0.000s	sys 0.001s
I20260709 13:10:44.185189 32010 raft_consensus.cc:515] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:44.245994 32087 raft_consensus.cc:493] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:44.245592 32107 raft_consensus.cc:2804] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:10:44.249265 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 51377.8us
I20260709 13:10:44.244964 32106 consensus_queue.cc:1048] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.103s
I20260709 13:10:44.279992 30023 raft_consensus.cc:2468] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 4.
I20260709 13:10:44.269420 30170 raft_consensus.cc:1240] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:10:44.269870 31907 raft_consensus.cc:493] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.283613 32023 leader_election.cc:290] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:44.285737 32010 leader_election.cc:290] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:44.286934 31790 raft_consensus.cc:493] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:44.289207 30102 raft_consensus.cc:1275] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:44.290916 32090 leader_election.cc:290] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:44.310878 31907 raft_consensus.cc:515] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:44.156117 32077 consensus_queue.cc:237] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:44.293056 32087 raft_consensus.cc:515] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:44.330293 32120 raft_consensus.cc:2749] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:44.316916 31790 raft_consensus.cc:515] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:44.272382 32096 raft_consensus.cc:493] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:44.283452 32118 consensus_queue.cc:1048] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:10:44.280618 32107 raft_consensus.cc:493] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:44.339365 32105 leader_election.cc:290] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:44.350358 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:44.341447 31790 leader_election.cc:290] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:44.324553 32023 raft_consensus.cc:493] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.351070 30102 raft_consensus.cc:2468] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 4.
W20260709 13:10:44.353785 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 234723us
I20260709 13:10:44.355058 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:44.354235 30703 leader_election.cc:304] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:44.334066 32109 leader_election.cc:290] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:44.362735 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:44.374720 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:44.377383 30703 leader_election.cc:304] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:44.344092 32021 leader_election.cc:290] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:44.355909 32107 raft_consensus.cc:3060] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:44.367846 32030 leader_election.cc:290] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:44.355764 32097 consensus_queue.cc:1059] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:10:44.398198 30140 leader_election.cc:304] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:44.376186 30732 raft_consensus.cc:2468] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 3.
I20260709 13:10:44.361671 32023 raft_consensus.cc:515] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:44.395917 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:44.358219 32096 raft_consensus.cc:515] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:44.406697 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:44.410920 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:44.404471 31851 raft_consensus.cc:2804] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:44.413933 32074 raft_consensus.cc:2749] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:10:44.405747 32108 leader_election.cc:290] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:44.410130 32128 raft_consensus.cc:2749] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:44.425321 30025 raft_consensus.cc:2468] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 3.
W20260709 13:10:44.428148 32124 log.cc:927] Time spent T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:10:44.420213 32106 consensus_queue.cc:1048] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:10:44.429738 32072 leader_election.cc:290] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:44.444270 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:44.420976 31790 raft_consensus.cc:493] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
W20260709 13:10:44.432067 31699 consensus_meta.cc:287] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4: Time spent flushing consensus metadata: real 0.545s	user 0.009s	sys 0.000s
I20260709 13:10:44.459534 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:44.429464 31789 leader_election.cc:290] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:44.429352 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:44.463797 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:44.432849 31851 raft_consensus.cc:697] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 4 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:44.475301 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:44.483484 32134 raft_consensus.cc:493] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:44.485585 30729 raft_consensus.cc:2393] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 2: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:10:44.485446 32134 raft_consensus.cc:515] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:44.467845 30021 raft_consensus.cc:3060] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:44.476747 31789 raft_consensus.cc:493] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.494807 31851 consensus_queue.cc:237] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:44.497212 31789 raft_consensus.cc:515] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:44.498486 32023 leader_election.cc:290] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:44.499186 31789 leader_election.cc:290] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:44.462453 31699 raft_consensus.cc:515] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:44.462627 31790 raft_consensus.cc:515] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:44.508263 30026 raft_consensus.cc:2368] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for earlier term 2. Current term is 3.
W20260709 13:10:44.525677 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 64200.5us
I20260709 13:10:44.535918 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:44.541364 32008 raft_consensus.cc:493] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:44.541556 32014 raft_consensus.cc:493] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:44.542222 32014 raft_consensus.cc:515] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:44.544520 32014 leader_election.cc:290] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:44.547390 30731 raft_consensus.cc:3060] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEARNER]: Advancing to term 3
I20260709 13:10:44.541905 32008 raft_consensus.cc:3060] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:44.524799 30021 raft_consensus.cc:2468] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 4.
W20260709 13:10:44.565502 30024 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54198 (request call id 1651) took 1661 ms (client timeout 1680 ms). Trace:
W20260709 13:10:44.567934 30024 rpcz_store.cc:269] 0709 13:10:42.903973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:42.905277 (+  1304us) service_pool.cc:224] Handling call
0709 13:10:44.565363 (+1660086us) spinlock_profiling.cc:243] Waited 642 ms on lock 0x7b540020f8d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:10:44.565446 (+    83us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1476258560}
W20260709 13:10:44.579248 30733 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56954 (request call id 425) took 1320 ms (client timeout 1661 ms). Trace:
W20260709 13:10:44.579708 30733 rpcz_store.cc:269] 0709 13:10:43.258904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.269585 (+ 10681us) service_pool.cc:224] Handling call
0709 13:10:44.579008 (+1309423us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54005c0dd4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:10:44.579160 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2720555776}
I20260709 13:10:44.582612 32055 consensus_queue.cc:260] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:44.583928 32055 raft_consensus.cc:3060] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:44.584618 31951 raft_consensus.cc:3060] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:44.573498 31699 leader_election.cc:290] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:10:44.601943 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 119492us
I20260709 13:10:44.603525 32104 raft_consensus.cc:493] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.604048 32104 raft_consensus.cc:515] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:44.616163 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:44.616731 30096 raft_consensus.cc:2468] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 4.
I20260709 13:10:44.621364 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:44.621899 30096 raft_consensus.cc:2468] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 4.
I20260709 13:10:44.623306 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:44.623821 30102 raft_consensus.cc:2468] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 3.
I20260709 13:10:44.645964 32134 leader_election.cc:290] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:44.646317 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:44.646970 30102 raft_consensus.cc:3060] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:10:44.647547 29994 leader_election.cc:304] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
W20260709 13:10:44.652585 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 67153.6us
I20260709 13:10:44.653388 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:44.657217 30068 leader_election.cc:304] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:44.660434 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:44.668877 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:44.626374 32104 leader_election.cc:290] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:44.622867 31907 leader_election.cc:290] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:44.620848 32012 raft_consensus.cc:493] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:44.776664 30026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54198 (request call id 1663) took 1029 ms. Trace:
I20260709 13:10:44.622861 32103 raft_consensus.cc:493] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.772948 30096 raft_consensus.cc:2468] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 3.
W20260709 13:10:44.773783 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 121642us
W20260709 13:10:44.776966 30703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:44.777022 30026 rpcz_store.cc:276] 0709 13:10:43.747068 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.748246 (+  1178us) service_pool.cc:224] Handling call
0709 13:10:44.671781 (+923535us) spinlock_profiling.cc:243] Waited 756 ms on lock 0x7b54001a90d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:10:44.776284 (+104503us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1737902336}
I20260709 13:10:44.779507 30113 tablet_copy_service.cc:342] P 5ec73dc157ed476ca903a7d596271719: Request end of tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-18a72905c2e24e33af2e64672417cfcf received from {username='slave'} at 127.0.0.1:48558
I20260709 13:10:44.779966 30113 tablet_copy_service.cc:434] P 5ec73dc157ed476ca903a7d596271719: ending tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-18a72905c2e24e33af2e64672417cfcf on tablet 18a72905c2e24e33af2e64672417cfcf with peer 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:44.777110 30022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54198 (request call id 1660) took 1126 ms. Trace:
I20260709 13:10:44.783234 30022 rpcz_store.cc:276] 0709 13:10:43.646063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.682178 (+ 36115us) service_pool.cc:224] Handling call
0709 13:10:43.682467 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:43.731521 (+ 49054us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:44.672599 (+941078us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x7b54001a8bd4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:10:44.772715 (+100116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40705280}
I20260709 13:10:44.772807 32024 raft_consensus.cc:3055] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:44.780359 32103 raft_consensus.cc:515] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:44.782945 32100 log.cc:927] Time spent T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.691s	user 0.005s	sys 0.000s
I20260709 13:10:44.775985 32140 raft_consensus.cc:2804] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:44.777540 31790 leader_election.cc:290] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:44.793308 32024 raft_consensus.cc:740] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:44.800326 32024 consensus_queue.cc:260] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:44.798168 30097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33990 (request call id 1629) took 1147 ms. Trace:
I20260709 13:10:44.803393 30097 rpcz_store.cc:276] 0709 13:10:43.648636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.651180 (+  2544us) service_pool.cc:224] Handling call
0709 13:10:43.700119 (+ 48939us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:43.889694 (+189575us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:43.889727 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:43.890266 (+   539us) log.cc:844] Serialized 26 byte log entry
0709 13:10:44.140135 (+249869us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:44.151102 (+ 10967us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:44.674547 (+523445us) spinlock_profiling.cc:243] Waited 50.7 ms on lock 0x7b54003b4f54. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:10:44.775761 (+101214us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:44.777829 (+  2068us) raft_consensus.cc:1685] finished
0709 13:10:44.778198 (+   369us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:44.796104 (+ 17906us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":181108,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":56254,"spinlock_wait_cycles":116624128,"thread_start_us":238507,"threads_started":2,"wal-append.queue_time_us":343414}
I20260709 13:10:44.807700 32008 raft_consensus.cc:515] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:44.812100 30097 raft_consensus.cc:1240] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:44.810089 30731 raft_consensus.cc:1275] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 LEARNER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:44.817301 32038 raft_consensus.cc:493] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:44.825055 30102 raft_consensus.cc:2468] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 3.
I20260709 13:10:44.826610 32134 raft_consensus.cc:493] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:44.828501 32134 raft_consensus.cc:515] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:44.830507 32134 leader_election.cc:290] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:44.809832 32140 raft_consensus.cc:493] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:44.841223 30700 leader_election.cc:304] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:44.826793 32038 raft_consensus.cc:515] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:44.782460 32012 raft_consensus.cc:515] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:44.860750 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:44.861577 30022 raft_consensus.cc:2393] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 4: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:44.866526 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:44.868603 30026 raft_consensus.cc:1275] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:10:44.869297 30027 raft_consensus.cc:2393] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 4: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:44.842389 32014 raft_consensus.cc:493] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.834215 32140 raft_consensus.cc:3060] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:44.880302 32038 leader_election.cc:290] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:44.856494 31700 raft_consensus.cc:2804] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:44.880966 32087 leader_election.cc:290] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:44.881431 32128 consensus_queue.cc:1048] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:44.884029 30143 leader_election.cc:304] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
W20260709 13:10:44.890249 30066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:44.856010 32008 leader_election.cc:290] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:44.868844 32085 raft_consensus.cc:493] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.934801 30174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54540 (request call id 424) took 1173 ms. Trace:
I20260709 13:10:44.947682 30174 rpcz_store.cc:276] 0709 13:10:43.761201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.767292 (+  6091us) service_pool.cc:224] Handling call
0709 13:10:43.767554 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:43.885260 (+117706us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:43.885291 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:43.885332 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:43.885364 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:44.934545 (+1049181us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b5400314a54. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:10:44.934597 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:44.934736 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":270212480}
W20260709 13:10:44.949190 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 162942us
I20260709 13:10:44.949355 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:44.952775 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:44.950878 32090 raft_consensus.cc:493] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:44.953428 30177 raft_consensus.cc:2468] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 4.
I20260709 13:10:44.881146 31700 raft_consensus.cc:697] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
W20260709 13:10:44.960819 29992 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:44.961349 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:44.954463 32145 raft_consensus.cc:493] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:44.913481 32134 raft_consensus.cc:2749] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:44.963634 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:44.962834 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:44.964905 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:44.967064 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:44.963654 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:44.967628 30735 raft_consensus.cc:2468] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 3.
I20260709 13:10:44.968309 30177 raft_consensus.cc:2393] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 6: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:10:44.968420 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:44.967079 30176 raft_consensus.cc:2468] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 4.
I20260709 13:10:44.911369 31907 raft_consensus.cc:493] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:44.993630 32139 log.cc:927] Time spent T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.484s	user 0.001s	sys 0.002s
I20260709 13:10:44.993997 31907 raft_consensus.cc:515] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:44.911263 31935 raft_consensus.cc:493] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:44.905298 32038 raft_consensus.cc:493] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:44.972767 30729 raft_consensus.cc:1275] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:44.973357 32134 raft_consensus.cc:493] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:44.974432 29994 leader_election.cc:304] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:44.976150 29993 leader_election.cc:304] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:44.959703 32090 raft_consensus.cc:515] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:10:44.980865 30101 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33992 (request call id 1500) took 1732 ms (client timeout 1577 ms). Trace:
I20260709 13:10:44.966444 32145 raft_consensus.cc:515] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:44.982861 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:44.943032 32012 leader_election.cc:290] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:44.989324 30094 raft_consensus.cc:2468] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 6.
W20260709 13:10:44.990053 32151 log.cc:927] Time spent T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.203s	user 0.001s	sys 0.000s
I20260709 13:10:44.990589 32001 leader_election.cc:290] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:44.914031 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:44.995267 30171 raft_consensus.cc:2468] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 4.
I20260709 13:10:44.913429 31923 consensus_queue.cc:1048] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.082s
I20260709 13:10:44.914038 32011 consensus_queue.cc:1048] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.083s
I20260709 13:10:44.999118 31935 raft_consensus.cc:515] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:44.955372 32085 raft_consensus.cc:515] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:45.024751 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:45.025805 32090 leader_election.cc:290] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:45.026329 32085 leader_election.cc:290] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:45.000368 31700 consensus_queue.cc:237] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:45.026943 31935 leader_election.cc:290] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:44.912693 32115 consensus_queue.cc:1048] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.089s
I20260709 13:10:45.001996 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
W20260709 13:10:45.002138 32122 log.cc:927] Time spent T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.652s	user 0.000s	sys 0.006s
I20260709 13:10:44.901815 32107 raft_consensus.cc:515] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:44.893836 32014 raft_consensus.cc:515] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:45.013363 29994 leader_election.cc:304] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
W20260709 13:10:45.015818 30101 rpcz_store.cc:269] 0709 13:10:43.247937 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.249546 (+  1609us) service_pool.cc:224] Handling call
0709 13:10:44.980656 (+1731110us) spinlock_profiling.cc:243] Waited 411 ms on lock 0x7b54003b4a54. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:10:44.980769 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":944156544}
I20260709 13:10:45.018107 29993 leader_election.cc:304] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:44.997848 31951 raft_consensus.cc:493] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:45.021458 31820 raft_consensus.cc:2804] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:45.019513 32134 raft_consensus.cc:515] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:45.023797 32001 raft_consensus.cc:493] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.029989 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:45.032163 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:45.034283 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:45.013067 32038 raft_consensus.cc:515] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:45.036587 29994 leader_election.cc:304] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:45.051306 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:45.052482 30101 raft_consensus.cc:1275] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:45.053933 30172 raft_consensus.cc:3060] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:45.054299 30734 raft_consensus.cc:2468] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 3.
I20260709 13:10:45.050796 30025 raft_consensus.cc:2468] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 2.
I20260709 13:10:45.056506 30102 raft_consensus.cc:2393] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 3: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:10:45.029503 32120 raft_consensus.cc:3055] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:45.058090 32157 raft_consensus.cc:2804] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:45.058928 32134 leader_election.cc:290] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:45.059280 32001 raft_consensus.cc:515] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:45.060403 29994 leader_election.cc:304] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:45.063407 30172 raft_consensus.cc:2468] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 4.
I20260709 13:10:45.037098 31820 raft_consensus.cc:493] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.050359 32143 raft_consensus.cc:2804] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:45.061257 32020 raft_consensus.cc:2804] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:45.076946 30066 leader_election.cc:400] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Vote denied by peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451) with higher term. Message: Invalid argument: T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for earlier term 2. Current term is 3.
I20260709 13:10:45.078542 30066 leader_election.cc:403] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:45.063874 32157 raft_consensus.cc:493] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.079818 30066 leader_election.cc:304] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:45.085199 30169 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43838 (request call id 1635) took 1439 ms. Trace:
I20260709 13:10:45.085481 30024 raft_consensus.cc:1275] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:45.087467 30019 raft_consensus.cc:1240] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:45.090606 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:45.066202 32120 raft_consensus.cc:740] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:45.071444 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:45.070384 32143 raft_consensus.cc:493] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.076707 32022 raft_consensus.cc:493] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.070477 31820 raft_consensus.cc:3060] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:45.080618 31699 raft_consensus.cc:2804] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:45.096854 30099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48558 (request call id 322) took 1546 ms. Trace:
I20260709 13:10:45.064278 31951 raft_consensus.cc:515] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:45.081466 32157 raft_consensus.cc:3060] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:45.079648 32020 raft_consensus.cc:493] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.082446 31975 raft_consensus.cc:493] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.067160 32140 raft_consensus.cc:515] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:45.082790 32129 raft_consensus.cc:2749] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451) with higher term. Message: Invalid argument: T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for earlier term 2. Current term is 3.
I20260709 13:10:45.101814 30099 rpcz_store.cc:276] 0709 13:10:43.550356 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.550467 (+   111us) service_pool.cc:224] Handling call
0709 13:10:43.619820 (+ 69353us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:43.778760 (+158940us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:43.778788 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:43.785448 (+  6660us) log.cc:844] Serialized 26 byte log entry
0709 13:10:44.100155 (+314707us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:44.118250 (+ 18095us) log.cc:844] Serialized 14 byte log entry
0709 13:10:44.124095 (+  5845us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:44.124164 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:45.064715 (+940551us) spinlock_profiling.cc:243] Waited 2.13 ms on lock 0x7b18003ca960. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f7e95de1 00007f99f7ea25b1 00007f99eefcd3f3 00007f99eefcf7c1 00007f99eefcf779 00007f99eefcf709 00007f99eefcf6d1 00007f99eefce9cd 000000000038f354 000000000038f199 00007f99eefb083a
0709 13:10:45.092939 (+ 28224us) raft_consensus.cc:1685] finished
0709 13:10:45.096675 (+  3736us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:45.096798 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2095,"prepare.queue_time_us":51685,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":176179,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":7401,"spinlock_wait_cycles":4904192,"thread_start_us":417679,"threads_started":2,"wal-append.queue_time_us":338527}
I20260709 13:10:45.090660 32014 leader_election.cc:290] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:10:45.110960 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 70484.7us
I20260709 13:10:45.097463 32143 raft_consensus.cc:3060] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:45.098703 31907 leader_election.cc:290] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:45.084218 32115 consensus_queue.cc:1048] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 13:10:45.107097 32020 raft_consensus.cc:3060] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:45.108651 31699 raft_consensus.cc:697] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:45.100425 31935 consensus_queue.cc:1048] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 13:10:45.102634 32022 raft_consensus.cc:515] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:45.137346 32022 leader_election.cc:290] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:45.137809 32145 leader_election.cc:290] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:45.139077 32038 leader_election.cc:290] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:45.139943 32140 leader_election.cc:290] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:45.118014 32014 raft_consensus.cc:493] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.142094 32014 raft_consensus.cc:515] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:45.111248 31975 raft_consensus.cc:515] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:45.142545 31699 consensus_queue.cc:237] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:45.104925 32120 consensus_queue.cc:260] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:45.143671 32120 raft_consensus.cc:3060] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:45.144237 31975 leader_election.cc:290] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:45.145013 30021 raft_consensus.cc:1275] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:45.132123 32001 leader_election.cc:290] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:45.143029 31951 leader_election.cc:290] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:45.122097 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:10:45.145740 31954 consensus_queue.cc:1175] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" responder_term: 4 status { last_received { term: 3 index: 6 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:10:45.146730 32107 leader_election.cc:290] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:45.152541 30019 raft_consensus.cc:2393] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 4: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:45.148789 31907 raft_consensus.cc:493] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:45.158403 31907 raft_consensus.cc:515] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:45.158885 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:45.160101 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:45.157938 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:45.163349 31907 leader_election.cc:290] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:45.163489 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:45.164489 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:45.165954 30103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33990 (request call id 1637) took 1467 ms. Trace:
I20260709 13:10:45.165431 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:45.170648 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:45.161257 30703 leader_election.cc:304] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:45.170783 30734 raft_consensus.cc:2468] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 3.
I20260709 13:10:45.174657 31996 raft_consensus.cc:493] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.166332 30103 rpcz_store.cc:276] 0709 13:10:43.698329 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.150805 (+452476us) service_pool.cc:224] Handling call
0709 13:10:44.151030 (+   225us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:44.279183 (+128153us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:44.279215 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:44.279255 (+    40us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:44.279289 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:45.165719 (+886430us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b54002152d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:10:45.165785 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:45.165892 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":294317440}
I20260709 13:10:45.180455 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:45.181608 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:45.182183 30103 raft_consensus.cc:2468] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 4.
I20260709 13:10:45.161193 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:45.179831 32145 raft_consensus.cc:2804] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:45.183969 32069 raft_consensus.cc:493] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:45.184098 30729 raft_consensus.cc:3060] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:45.184116 32145 raft_consensus.cc:493] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.184533 32069 raft_consensus.cc:515] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:45.185077 32145 raft_consensus.cc:3060] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:45.190044 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:45.190724 30099 raft_consensus.cc:2468] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 2.
I20260709 13:10:45.191644 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:45.191867 29994 leader_election.cc:304] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:45.192827 32068 raft_consensus.cc:2804] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:45.180032 31996 raft_consensus.cc:515] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:45.193248 32068 raft_consensus.cc:493] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.193846 32046 raft_consensus.cc:493] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.193626 32068 raft_consensus.cc:3060] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:45.194710 31996 leader_election.cc:290] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:45.194306 32046 raft_consensus.cc:515] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:45.093621 30169 rpcz_store.cc:276] 0709 13:10:43.645887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.650329 (+  4442us) service_pool.cc:224] Handling call
0709 13:10:43.700232 (+ 49903us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:43.752153 (+ 51921us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:43.753247 (+  1094us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:43.834882 (+ 81635us) log.cc:844] Serialized 26 byte log entry
0709 13:10:44.145312 (+310430us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:44.147465 (+  2153us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:44.153674 (+  6209us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:45.001580 (+847906us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b4400022b4c. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eeef3c85 00007f99eeef46a2 00007f99f1c661db 00007f99f1c61aaf 00007f99f1c5586e 00007f99f1c54bb6 00007f99f1c547d8 00007f99f1c5e221 00007f99f1c5e1d9 00007f99f1c5e169
0709 13:10:45.070246 (+ 68666us) raft_consensus.cc:1685] finished
0709 13:10:45.077541 (+  7295us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:45.085134 (+  7593us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3452,"raft.queue_time_us":8833,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":5447,"spinlock_wait_cycles":38692608,"thread_start_us":149572,"threads_started":1,"wal-append.queue_time_us":375780}
I20260709 13:10:45.186540 32069 leader_election.cc:290] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:45.196552 32046 leader_election.cc:290] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:45.199455 32020 raft_consensus.cc:515] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:45.200814 30025 raft_consensus.cc:2393] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 5: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:45.201609 32020 leader_election.cc:290] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:45.202018 32068 raft_consensus.cc:515] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:45.203517 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:10:45.204967 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 70978.9us
I20260709 13:10:45.205309 30143 leader_election.cc:304] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:45.215626 32068 leader_election.cc:290] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:45.216182 32001 raft_consensus.cc:493] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:45.219506 32001 raft_consensus.cc:515] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:45.221545 32001 leader_election.cc:290] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:45.216154 31820 raft_consensus.cc:515] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:45.224076 32157 raft_consensus.cc:515] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:45.187649 32072 raft_consensus.cc:493] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.179262 31907 consensus_queue.cc:1048] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:10:45.225915 30026 raft_consensus.cc:1240] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 13:10:45.218852 30068 leader_election.cc:304] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:45.222584 30729 raft_consensus.cc:2468] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 3.
I20260709 13:10:45.227375 29993 leader_election.cc:304] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:45.230016 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:45.231695 29993 leader_election.cc:304] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:45.232100 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:45.224375 31820 leader_election.cc:290] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:45.228271 30140 leader_election.cc:304] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:45.229293 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:45.236814 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:45.193557 32145 raft_consensus.cc:515] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:45.233072 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:45.233114 29993 leader_election.cc:304] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:45.232755 30176 raft_consensus.cc:2393] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 4: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:10:45.234795 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:45.235363 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:45.239149 30177 raft_consensus.cc:3060] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:45.243270 29993 leader_election.cc:304] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:45.246047 30177 raft_consensus.cc:2468] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 5.
I20260709 13:10:45.230098 32038 raft_consensus.cc:493] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.265930 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:45.266294 32038 raft_consensus.cc:515] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:45.267472 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:45.267793 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:45.268638 31975 raft_consensus.cc:2749] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:45.232570 32001 raft_consensus.cc:2749] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:45.269008 32161 raft_consensus.cc:2804] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:45.271502 32161 raft_consensus.cc:493] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.271834 32161 raft_consensus.cc:3060] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:45.275075 32138 raft_consensus.cc:2749] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:45.233929 32120 raft_consensus.cc:493] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:45.275977 32120 raft_consensus.cc:515] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:45.276209 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:45.273427 30100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48558 (request call id 323) took 1722 ms. Trace:
I20260709 13:10:45.204357 32143 raft_consensus.cc:515] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:45.277721 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:45.248543 29993 leader_election.cc:304] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:45.279938 30024 raft_consensus.cc:2393] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 5: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
W20260709 13:10:45.282105 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 53881.3us
W20260709 13:10:45.296183 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 47680.9us
I20260709 13:10:45.286602 30020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 1438) took 1150 ms. Trace:
I20260709 13:10:45.248257 32069 raft_consensus.cc:2749] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:45.287091 32134 raft_consensus.cc:2804] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:45.310515 32134 raft_consensus.cc:493] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:45.310990 32134 raft_consensus.cc:3060] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:45.311188 30019 raft_consensus.cc:2368] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 3. Current term is 4.
I20260709 13:10:45.287344 32145 leader_election.cc:290] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:45.278120 32038 leader_election.cc:290] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:45.287918 30729 raft_consensus.cc:2468] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 5.
I20260709 13:10:45.278348 30100 rpcz_store.cc:276] 0709 13:10:43.550722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.550826 (+   104us) service_pool.cc:224] Handling call
0709 13:10:43.551132 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:43.725665 (+174533us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:43.725698 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:43.726184 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 13:10:43.793135 (+ 66951us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:43.807401 (+ 14266us) log.cc:844] Serialized 14 byte log entry
0709 13:10:44.552862 (+745461us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b48001a0358. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f6fe3aa1 00007f99f6fdab37 00007f99f6fda9ca 00007f99f70d226f 00007f99f70d1f37 00007f99f70e655c 00007f99f70e6508 00007f99f70e6488 00007f99f70e6443 00007f99f70e56ec 00007f99f600fa96
0709 13:10:45.272350 (+719488us) spinlock_profiling.cc:243] Waited 4.67 ms on lock 0x7b18003ac0c0. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f7e95de1 00007f99f7ea25b1 00007f99f1c624bc 00007f99eefb048b 00007f99f7e0aab9 00007f99eefcc69b 00007f99eefca93f 00007f99eefca455 00007f99f20b2060 00007f99f20c4716 00007f99f20d5287
0709 13:10:45.272483 (+   133us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:45.273128 (+   645us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b5400021054. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:10:45.273166 (+    38us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:45.273211 (+    45us) raft_consensus.cc:1685] finished
0709 13:10:45.273222 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:45.273363 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2678,"prepare.queue_time_us":14091,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":178965,"raft.run_cpu_time_us":2700,"raft.run_wall_time_us":571000,"spinlock_wait_cycles":452534656,"thread_start_us":148070,"threads_started":2,"wal-append.queue_time_us":123748,"wal-append.run_cpu_time_us":2000,"wal-append.run_wall_time_us":1160555}
I20260709 13:10:45.289076 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:45.248088 32140 raft_consensus.cc:2749] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:45.236310 32068 raft_consensus.cc:2749] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:45.293196 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:45.297847 31729 raft_consensus.cc:2804] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:45.298789 30098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33990 (request call id 1633) took 1646 ms. Trace:
I20260709 13:10:45.299266 32157 leader_election.cc:290] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:45.299867 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:45.303831 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:45.303719 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:45.281497 32143 leader_election.cc:290] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:45.327190 30098 rpcz_store.cc:276] 0709 13:10:43.652491 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.714404 (+ 61913us) service_pool.cc:224] Handling call
0709 13:10:43.714744 (+   340us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:43.724419 (+  9675us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:43.724451 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:43.724901 (+   450us) log.cc:844] Serialized 26 byte log entry
0709 13:10:43.821061 (+ 96160us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:44.081510 (+260449us) log.cc:844] Serialized 14 byte log entry
0709 13:10:44.081750 (+   240us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:44.081847 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:45.288181 (+1206334us) spinlock_profiling.cc:243] Waited 9.48 ms on lock 0x7b1800052240. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f7e95de1 00007f99f7ea25b1 00007f99eefcd3f3 00007f99eefcf7c1 00007f99eefcf779 00007f99eefcf709 00007f99eefcf6d1 00007f99eefce9cd 000000000038f354 000000000038f199 00007f99eefb083a
0709 13:10:45.298479 (+ 10298us) raft_consensus.cc:1685] finished
0709 13:10:45.298573 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:45.298721 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":34994,"prepare.queue_time_us":78370,"prepare.run_cpu_time_us":106,"prepare.run_wall_time_us":4849,"raft.queue_time_us":12242,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":8137,"spinlock_wait_cycles":21802368,"thread_start_us":294106,"threads_started":2,"wal-append.queue_time_us":294339}
I20260709 13:10:45.332018 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:45.332489 30098 raft_consensus.cc:2376] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 4. Re-sending same reply.
I20260709 13:10:45.333369 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:45.235664 32072 raft_consensus.cc:515] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:45.316923 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:45.318903 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:45.319442 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:45.320387 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:45.329888 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:45.329902 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:45.336125 32138 raft_consensus.cc:493] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:45.336709 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:45.345293 30026 raft_consensus.cc:1275] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:10:45.341058 30177 raft_consensus.cc:2468] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
I20260709 13:10:45.345891 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:45.340775 30100 raft_consensus.cc:3060] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:45.350693 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:45.331070 32012 raft_consensus.cc:2804] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:45.352816 30099 raft_consensus.cc:2468] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 4.
I20260709 13:10:45.354758 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:45.338476 31729 raft_consensus.cc:697] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:45.355613 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:45.357784 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:45.395977 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:45.435393 32104 raft_consensus.cc:493] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:45.337879 30732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51004 (request call id 484) took 1190 ms. Trace:
W20260709 13:10:45.859195 32172 log.cc:927] Time spent T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.269s	user 0.000s	sys 0.001s
I20260709 13:10:45.358144 31729 consensus_queue.cc:237] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:45.931869 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:45.792273 31831 raft_consensus.cc:493] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:45.932750 30101 raft_consensus.cc:2410] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 13:10:45.635715 30069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:45.466655 30067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:45.423219 30100 raft_consensus.cc:2468] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 3.
I20260709 13:10:45.951555 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:45.952800 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:45.953861 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:45.929533 30735 raft_consensus.cc:3060] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:10:45.715600 32016 raft_consensus.cc:493] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:45.954437 30101 raft_consensus.cc:2468] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 5.
I20260709 13:10:45.961237 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:45.961342 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:45.961815 30100 raft_consensus.cc:3060] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:45.963989 30101 raft_consensus.cc:2393] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 2: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:10:45.964735 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
W20260709 13:10:45.879658 32134 consensus_meta.cc:287] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124: Time spent flushing consensus metadata: real 0.568s	user 0.007s	sys 0.002s
I20260709 13:10:45.792415 32145 raft_consensus.cc:493] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:45.974064 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:45.781814 32072 leader_election.cc:290] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:45.975641 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:45.976667 30026 raft_consensus.cc:1240] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:45.418131 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:45.963565 32107 raft_consensus.cc:493] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:45.951503 32001 raft_consensus.cc:493] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:45.351949 32138 raft_consensus.cc:515] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:45.987191 30174 raft_consensus.cc:2468] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 4.
I20260709 13:10:45.968875 32106 raft_consensus.cc:493] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:46.004827 30100 raft_consensus.cc:2468] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 4.
I20260709 13:10:45.929914 32104 raft_consensus.cc:515] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:45.415068 32161 raft_consensus.cc:515] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:46.010810 30735 raft_consensus.cc:2468] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 5.
I20260709 13:10:45.932602 31831 raft_consensus.cc:515] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:46.013890 30175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43838 (request call id 1645) took 1129 ms. Trace:
I20260709 13:10:45.978859 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:45.984966 32072 raft_consensus.cc:493] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:45.998262 32153 raft_consensus.cc:493] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:45.989104 31975 raft_consensus.cc:493] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:46.024672 31975 raft_consensus.cc:515] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:45.998709 30733 raft_consensus.cc:3060] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Advancing to term 5
I20260709 13:10:45.944751 30732 rpcz_store.cc:276] 0709 13:10:44.147042 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.149334 (+  2292us) service_pool.cc:224] Handling call
0709 13:10:45.329338 (+1180004us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b5400532854. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:10:45.336640 (+  7302us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":261597056}
I20260709 13:10:46.017257 32068 raft_consensus.cc:493] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:46.019580 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:46.026742 32153 raft_consensus.cc:515] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:46.033711 32153 leader_election.cc:290] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:46.017403 30175 rpcz_store.cc:276] 0709 13:10:44.884301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.885961 (+  1660us) service_pool.cc:224] Handling call
0709 13:10:44.914901 (+ 28940us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:45.066783 (+151882us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:10:45.094957 (+ 28174us) log.cc:844] Serialized 14 byte log entry
0709 13:10:45.120108 (+ 25151us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:45.120151 (+    43us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:45.120188 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:46.006647 (+886459us) spinlock_profiling.cc:243] Waited 1.71 ms on lock 0x7b1800439cc0. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f7e95de1 00007f99f7ea25b1 00007f99eef9b2a6 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419
0709 13:10:46.013670 (+  7023us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b540011f3d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:10:46.013706 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:46.013838 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":59844,"raft.queue_time_us":71,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":3990,"spinlock_wait_cycles":396517376,"thread_start_us":43028,"threads_started":2,"wal-append.queue_time_us":140873}
I20260709 13:10:46.030282 32025 raft_consensus.cc:3060] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:10:46.031144 31975 leader_election.cc:290] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:46.031386 32068 raft_consensus.cc:515] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:45.976230 32134 raft_consensus.cc:515] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:45.978093 32145 raft_consensus.cc:515] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:45.967224 32016 raft_consensus.cc:515] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:46.010084 32001 raft_consensus.cc:515] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:46.040349 32068 leader_election.cc:290] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:46.040439 32001 leader_election.cc:290] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:46.041075 32001 raft_consensus.cc:493] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:46.041555 32001 raft_consensus.cc:515] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:46.001000 32107 raft_consensus.cc:515] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:46.043442 32145 leader_election.cc:290] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:10:46.050941 30102 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.729s	user 0.049s	sys 0.050s
W20260709 13:10:46.051311 30102 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.049s	sys 0.050s
I20260709 13:10:46.055478 30734 raft_consensus.cc:1240] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:46.045152 32001 leader_election.cc:290] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:46.035801 32106 raft_consensus.cc:515] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:45.302201 30020 rpcz_store.cc:276] 0709 13:10:44.136425 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.137869 (+  1444us) service_pool.cc:224] Handling call
0709 13:10:44.178110 (+ 40241us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:44.202298 (+ 24188us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:44.248854 (+ 46556us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:45.153249 (+904395us) spinlock_profiling.cc:243] Waited 2.11 ms on lock 0x7b2c00000658. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f09b3a11 00007f99f09c3372 00007f99f20f5a01 00007f99f20ba43a 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2
0709 13:10:45.153652 (+   403us) log.cc:844] Serialized 26 byte log entry
0709 13:10:45.246899 (+ 93247us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:45.246943 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:45.247037 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:45.268716 (+ 21679us) raft_consensus.cc:1685] finished
0709 13:10:45.268742 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:45.286533 (+ 17791us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":73,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"spinlock_wait_cycles":4844800,"thread_start_us":81680,"threads_started":1,"wal-append.queue_time_us":111812}
I20260709 13:10:46.052031 32145 raft_consensus.cc:493] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:46.027707 32072 raft_consensus.cc:515] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:46.063586 30734 raft_consensus.cc:1240] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:46.065155 30177 raft_consensus.cc:2468] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
I20260709 13:10:46.070884 32016 leader_election.cc:290] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:46.071966 30102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33992 (request call id 1511) took 1043 ms. Trace:
I20260709 13:10:46.072355 30102 rpcz_store.cc:276] 0709 13:10:45.028690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.068732 (+ 40042us) service_pool.cc:224] Handling call
0709 13:10:45.077097 (+  8365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:45.078376 (+  1279us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:45.078405 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:45.079026 (+   621us) log.cc:844] Serialized 26 byte log entry
0709 13:10:45.322221 (+243195us) spinlock_profiling.cc:243] Waited 2.89 ms on lock 0x7b180041f980. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f7e95de1 00007f99f7ea25b1 00007f99eefafe07 00007f99f7e0aab9 00007f99eefcc69b 00007f99eefca93f 00007f99eefccc02 00007f99f1c5420b 00007f99f1c59d23 00007f99f1c5a0d1 00007f99f2075a0f
0709 13:10:46.051703 (+729482us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:46.051742 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:46.051809 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:46.071693 (+ 19884us) raft_consensus.cc:1685] finished
0709 13:10:46.071712 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:46.071906 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1340,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":1436,"spinlock_wait_cycles":6651776,"thread_start_us":729290,"threads_started":1,"wal-append.queue_time_us":982419}
I20260709 13:10:46.080345 32107 leader_election.cc:290] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:46.062937 31831 leader_election.cc:290] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:46.081410 32072 leader_election.cc:290] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:46.086577 30099 raft_consensus.cc:1240] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:46.063097 32145 raft_consensus.cc:515] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:46.092981 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:46.085330 30732 raft_consensus.cc:1240] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:46.085994 30019 raft_consensus.cc:2468] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 2.
I20260709 13:10:46.093921 32134 leader_election.cc:290] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:46.093670 32072 raft_consensus.cc:493] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:46.101929 32072 raft_consensus.cc:515] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:46.104043 32072 leader_election.cc:290] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:46.098255 30169 raft_consensus.cc:1275] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:10:46.099933 32104 leader_election.cc:290] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:46.099861 32161 leader_election.cc:290] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:46.115077 31730 raft_consensus.cc:2804] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:46.119568 32104 raft_consensus.cc:493] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:46.151088 30173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43838 (request call id 1640) took 2474 ms. Trace:
I20260709 13:10:46.142921 32182 raft_consensus.cc:493] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:46.151734 30173 rpcz_store.cc:276] 0709 13:10:43.668663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.684250 (+ 15587us) service_pool.cc:224] Handling call
0709 13:10:44.998128 (+1313878us) spinlock_profiling.cc:243] Waited 923 us on lock 0x7b5800003c98. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eef95b71 00007f99eef95a22 00007f99f7eaec09 00007f99f7008ee0 00007f99f70d20ab 00007f99f70d2131 00007f99f7093fc0 00007f99f707e929 00007f99f707e3d2 00007f99f05f5bd4
0709 13:10:44.998295 (+   167us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:45.022477 (+ 24182us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:10:45.069186 (+ 46709us) log.cc:844] Serialized 14 byte log entry
0709 13:10:45.113381 (+ 44195us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:45.113443 (+    62us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:45.113490 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:46.143088 (+1029598us) spinlock_profiling.cc:243] Waited 23 ms on lock 0x7b5400224054. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:10:46.143133 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:46.143241 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":86290,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":1969,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":4637,"spinlock_wait_cycles":55042176,"thread_start_us":79294,"threads_started":2,"wal-append.queue_time_us":89900}
I20260709 13:10:46.153009 32182 raft_consensus.cc:515] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:46.155341 32182 leader_election.cc:290] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:46.140365 32072 raft_consensus.cc:493] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:46.151949 32106 leader_election.cc:290] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:46.173035 30100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33990 (request call id 1656) took 1098 ms. Trace:
I20260709 13:10:46.173550 30100 rpcz_store.cc:276] 0709 13:10:45.075019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:46.016061 (+941042us) service_pool.cc:224] Handling call
0709 13:10:46.016222 (+   161us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:46.016341 (+   119us) raft_consensus.cc:1534] Early marking committed up to index 2
0709 13:10:46.121061 (+104720us) log.cc:844] Serialized 14 byte log entry
0709 13:10:46.172652 (+ 51591us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:46.172708 (+    56us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:46.172755 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:46.172822 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:46.172962 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":125344,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"thread_start_us":145445,"threads_started":2}
I20260709 13:10:46.190392 30735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56954 (request call id 445) took 1013 ms. Trace:
I20260709 13:10:46.190855 30735 rpcz_store.cc:276] 0709 13:10:45.176827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:46.036603 (+859776us) service_pool.cc:224] Handling call
0709 13:10:46.051118 (+ 14515us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:46.138835 (+ 87717us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:46.138865 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:46.139290 (+   425us) log.cc:844] Serialized 26 byte log entry
0709 13:10:46.159798 (+ 20508us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:46.159835 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:46.159896 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:46.190189 (+ 30293us) raft_consensus.cc:1685] finished
0709 13:10:46.190207 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:46.190330 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":28493,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"thread_start_us":106464,"threads_started":2,"wal-append.queue_time_us":22477}
I20260709 13:10:46.158422 32104 raft_consensus.cc:515] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:46.195535 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:46.204927 30023 raft_consensus.cc:3060] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:46.205507 29994 leader_election.cc:304] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
W20260709 13:10:46.206338 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 126853us
I20260709 13:10:46.206996 29994 leader_election.cc:304] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:46.222239 32153 raft_consensus.cc:2749] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:46.222999 31975 raft_consensus.cc:2804] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:46.223556 31975 raft_consensus.cc:697] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:46.223683 32138 leader_election.cc:290] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:46.224422 31975 consensus_queue.cc:237] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:46.227967 32197 log.cc:927] Time spent T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:10:46.190389 32180 raft_consensus.cc:493] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:46.232730 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:46.170884 32072 raft_consensus.cc:515] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:46.233887 32161 raft_consensus.cc:493] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:46.234186 32096 leader_election.cc:290] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:46.234364 32161 raft_consensus.cc:515] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:46.235520 32072 leader_election.cc:290] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:46.236397 32161 leader_election.cc:290] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:46.237860 29994 leader_election.cc:304] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:46.238181 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:46.229542 32145 leader_election.cc:290] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:46.239990 30172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54540 (request call id 433) took 1780 ms. Trace:
I20260709 13:10:46.240176 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:46.237223 32106 raft_consensus.cc:493] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:46.241609 30172 rpcz_store.cc:276] 0709 13:10:44.452681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.452914 (+   233us) service_pool.cc:224] Handling call
0709 13:10:46.232768 (+1779854us) spinlock_profiling.cc:243] Waited 589 ms on lock 0x7b540028a0d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:10:46.232863 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1355774208}
I20260709 13:10:46.242558 32106 raft_consensus.cc:515] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:46.243153 32012 raft_consensus.cc:493] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:46.243593 32012 raft_consensus.cc:3060] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:46.244239 32104 leader_election.cc:290] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:46.244539 32106 leader_election.cc:290] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:46.206573 32182 consensus_queue.cc:1048] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:10:46.246421 32153 raft_consensus.cc:2804] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:46.246858 32153 raft_consensus.cc:493] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:46.247229 32153 raft_consensus.cc:3060] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:46.247648 32120 leader_election.cc:290] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:46.250624 30733 raft_consensus.cc:2468] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 5.
W20260709 13:10:46.252789 30094 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33990 (request call id 1652) took 1626 ms (client timeout 1623 ms). Trace:
W20260709 13:10:46.253196 30094 rpcz_store.cc:269] 0709 13:10:44.626847 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.647661 (+ 20814us) service_pool.cc:224] Handling call
0709 13:10:46.252630 (+1604969us) spinlock_profiling.cc:243] Waited 217 ms on lock 0x7b5400266954. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:10:46.252723 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":498737408}
I20260709 13:10:46.254987 30094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48558 (request call id 334) took 1084 ms. Trace:
I20260709 13:10:46.256322 29994 leader_election.cc:304] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:46.230213 32180 raft_consensus.cc:515] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:46.241792 30096 raft_consensus.cc:3060] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:46.259542 29994 leader_election.cc:304] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:46.261219 30023 raft_consensus.cc:2468] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 6.
I20260709 13:10:46.255252 32153 raft_consensus.cc:515] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:46.266665 30023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52098 (request call id 349) took 1406 ms. Trace:
I20260709 13:10:46.255326 30094 rpcz_store.cc:276] 0709 13:10:45.170952 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:46.254163 (+1083211us) service_pool.cc:224] Handling call
0709 13:10:46.254502 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:46.254673 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:46.254700 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:46.254746 (+    46us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:46.254776 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:46.254834 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:46.254933 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:46.269021 30098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33992 (request call id 1517) took 1099 ms. Trace:
I20260709 13:10:46.268781 32152 raft_consensus.cc:2804] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:46.269443 30098 rpcz_store.cc:276] 0709 13:10:45.169717 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:46.075221 (+905504us) service_pool.cc:224] Handling call
0709 13:10:46.075416 (+   195us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:46.075541 (+   125us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:10:46.187412 (+111871us) log.cc:844] Serialized 14 byte log entry
0709 13:10:46.268488 (+ 81076us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:46.268543 (+    55us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:46.268777 (+   234us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:46.268846 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:46.268965 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":66542,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":117,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":1783,"thread_start_us":192309,"threads_started":2}
I20260709 13:10:46.273320 30098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48558 (request call id 335) took 1102 ms. Trace:
I20260709 13:10:46.267279 30023 rpcz_store.cc:276] 0709 13:10:44.859833 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:46.195250 (+1335417us) service_pool.cc:224] Handling call
0709 13:10:46.266612 (+ 71362us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:46.268007 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 93966.4us
I20260709 13:10:46.241485 32134 raft_consensus.cc:493] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.273648 30098 rpcz_store.cc:276] 0709 13:10:45.171189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:46.272596 (+1101407us) service_pool.cc:224] Handling call
0709 13:10:46.272876 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:46.273046 (+   170us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:46.273069 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:46.273107 (+    38us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:46.273137 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:46.273183 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:46.273270 (+    87us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:46.257668 32154 raft_consensus.cc:2749] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:46.283138 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:46.266391 32161 raft_consensus.cc:493] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:46.284684 32161 raft_consensus.cc:515] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:46.285183 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:46.285432 30168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43838 (request call id 1662) took 1056 ms. Trace:
I20260709 13:10:46.270905 32152 raft_consensus.cc:493] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:46.287199 32161 leader_election.cc:290] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:46.287328 30024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54206 (request call id 1450) took 1070 ms. Trace:
I20260709 13:10:46.288542 30098 raft_consensus.cc:2468] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 2.
I20260709 13:10:46.286355 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:46.291386 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:46.290541 30024 rpcz_store.cc:276] 0709 13:10:45.216825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.236615 (+ 19790us) service_pool.cc:224] Handling call
0709 13:10:46.287147 (+1050532us) spinlock_profiling.cc:243] Waited 42.4 ms on lock 0x7b54000749d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:10:46.287274 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":97551616}
I20260709 13:10:46.287602 30168 rpcz_store.cc:276] 0709 13:10:45.229184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.230417 (+  1233us) service_pool.cc:224] Handling call
0709 13:10:46.284765 (+1054348us) spinlock_profiling.cc:243] Waited 34.5 ms on lock 0x7b5800003c98. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eef95b71 00007f99eef95eee 0000000000375939 00007f99f70091e0 00007f99f70d20c4 00007f99f70d2131 00007f99f7093fc0 00007f99f707e929 00007f99f707e3d2 00007f99f05f5bd4
0709 13:10:46.284910 (+   145us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:46.285110 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:46.285137 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:46.285186 (+    49us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:46.285221 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:46.285282 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:46.285379 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":79433088}
I20260709 13:10:46.292860 30102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33990 (request call id 1657) took 1169 ms. Trace:
I20260709 13:10:46.281766 32120 raft_consensus.cc:493] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:46.294665 30094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48558 (request call id 337) took 1123 ms. Trace:
I20260709 13:10:46.294539 32120 raft_consensus.cc:515] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:46.295099 31730 raft_consensus.cc:493] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:46.295535 31730 raft_consensus.cc:3060] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:46.296926 32120 leader_election.cc:290] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:46.293787 30143 leader_election.cc:304] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:46.297984 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:46.323319 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:46.382273 30096 raft_consensus.cc:2468] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 5.
I20260709 13:10:46.410679 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:46.411459 30096 raft_consensus.cc:2393] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 5: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:10:46.412171 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:46.412781 30096 raft_consensus.cc:2393] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 5: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:46.392341 30098 raft_consensus.cc:2468] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 3.
I20260709 13:10:46.414872 30143 leader_election.cc:304] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:46.343118 30171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43838 (request call id 1657) took 1388 ms. Trace:
W20260709 13:10:46.329679 30069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:46.298465 30142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 57515.1us
I20260709 13:10:46.286289 32153 leader_election.cc:290] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:46.285205 32180 leader_election.cc:290] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:46.431023 30142 leader_election.cc:304] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:46.431382 29994 leader_election.cc:304] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:46.290201 32152 raft_consensus.cc:3060] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:46.293257 30102 rpcz_store.cc:276] 0709 13:10:45.123523 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:46.074265 (+950742us) service_pool.cc:224] Handling call
0709 13:10:46.074597 (+   332us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:46.074779 (+   182us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 13:10:46.167782 (+ 93003us) log.cc:844] Serialized 14 byte log entry
0709 13:10:46.292520 (+124738us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:46.292575 (+    55us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:46.292619 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:46.292687 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:46.292800 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":67105,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"raft.queue_time_us":1692,"raft.run_cpu_time_us":66,"raft.run_wall_time_us":66,"thread_start_us":215487,"threads_started":2,"wal-append.queue_time_us":154713}
I20260709 13:10:46.434748 30098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33990 (request call id 1662) took 1258 ms. Trace:
I20260709 13:10:46.442024 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:46.442271 32204 consensus_queue.cc:1059] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:46.443068 32204 raft_consensus.cc:3055] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:46.443394 32204 raft_consensus.cc:740] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:46.430576 32154 raft_consensus.cc:493] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:46.444023 30172 raft_consensus.cc:1275] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:10:46.445469 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:46.441113 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:46.446321 30168 raft_consensus.cc:2468] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 1.
I20260709 13:10:46.443960 32154 raft_consensus.cc:515] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:46.447219 30172 raft_consensus.cc:1275] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:46.448719 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:46.449402 30172 raft_consensus.cc:2368] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 4. Current term is 5.
I20260709 13:10:46.419391 31975 raft_consensus.cc:493] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.437291 31790 raft_consensus.cc:2804] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:46.438680 31730 raft_consensus.cc:515] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:46.437366 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:46.286953 32134 raft_consensus.cc:515] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:46.433692 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:46.429665 30171 rpcz_store.cc:276] 0709 13:10:44.954963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.963447 (+  8484us) service_pool.cc:224] Handling call
0709 13:10:46.342918 (+1379471us) spinlock_profiling.cc:243] Waited 28.3 ms on lock 0x7b54003dc2d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:10:46.343049 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64999296}
I20260709 13:10:46.436685 30028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 1440) took 2293 ms. Trace:
I20260709 13:10:46.441709 30098 rpcz_store.cc:276] 0709 13:10:45.176064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:46.434073 (+1258009us) service_pool.cc:224] Handling call
0709 13:10:46.434335 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:46.434522 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:46.434553 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:46.434584 (+    31us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:46.434603 (+    19us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:46.434637 (+    34us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:46.434708 (+    71us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:46.434542 31851 raft_consensus.cc:2804] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:46.322752 32106 raft_consensus.cc:2804] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:46.452662 31790 raft_consensus.cc:697] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
W20260709 13:10:46.457386 30067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:46.456863 30098 raft_consensus.cc:1240] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:10:46.441361 32192 raft_consensus.cc:2749] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:46.461730 31730 leader_election.cc:290] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:46.458564 30098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33992 (request call id 1520) took 1227 ms. Trace:
I20260709 13:10:46.463269 30098 rpcz_store.cc:276] 0709 13:10:45.231332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:46.456349 (+1225017us) service_pool.cc:224] Handling call
0709 13:10:46.456666 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:46.458320 (+  1654us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:46.458513 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:46.466964 32199 log.cc:927] Time spent T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.126s	user 0.003s	sys 0.000s
I20260709 13:10:46.457707 30028 rpcz_store.cc:276] 0709 13:10:44.140029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.140591 (+   562us) service_pool.cc:224] Handling call
0709 13:10:44.140868 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:44.247714 (+106846us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:44.247744 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:45.952351 (+1704607us) spinlock_profiling.cc:243] Waited 25.7 ms on lock 0x7b2c00000658. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f09b3a11 00007f99f09c3372 00007f99f20f5a01 00007f99f20ba43a 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2
0709 13:10:45.963678 (+ 11327us) log.cc:844] Serialized 26 byte log entry
0709 13:10:46.114130 (+150452us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:46.114169 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:46.322327 (+208158us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b5400240ed4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:10:46.322384 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:46.322436 (+    52us) raft_consensus.cc:1685] finished
0709 13:10:46.322450 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:46.430584 (+108134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2151,"raft.run_cpu_time_us":140,"raft.run_wall_time_us":11663,"spinlock_wait_cycles":300365952,"thread_start_us":108648,"threads_started":1,"wal-append.queue_time_us":151944}
I20260709 13:10:46.456096 32152 raft_consensus.cc:515] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:46.295055 30094 rpcz_store.cc:276] 0709 13:10:45.171645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:46.282538 (+1110893us) service_pool.cc:224] Handling call
0709 13:10:46.294132 (+ 11594us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:46.294315 (+   183us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:46.294350 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:46.294416 (+    66us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:46.294458 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:46.294512 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:46.294615 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:46.459332 31790 consensus_queue.cc:237] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:46.444105 32204 consensus_queue.cc:260] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:46.456897 32131 consensus_queue.cc:1048] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:10:46.477077 32024 raft_consensus.cc:3060] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:46.460405 30097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48558 (request call id 341) took 1174 ms. Trace:
I20260709 13:10:46.477653 30097 rpcz_store.cc:276] 0709 13:10:45.286148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:46.459628 (+1173480us) service_pool.cc:224] Handling call
0709 13:10:46.459894 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:46.460087 (+   193us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:46.460120 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:46.460162 (+    42us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:46.460197 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:46.460253 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:46.460353 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:46.478279 32068 raft_consensus.cc:493] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:46.478950 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:46.478824 32068 raft_consensus.cc:515] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:46.477273 32023 raft_consensus.cc:493] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:46.455003 32101 consensus_queue.cc:1048] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 13:10:46.479863 32023 raft_consensus.cc:515] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:46.462119 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:46.458009 30702 leader_election.cc:400] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Vote denied by peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001) with higher term. Message: Invalid argument: T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 4. Current term is 5.
I20260709 13:10:46.481716 32023 leader_election.cc:290] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:46.481885 30702 leader_election.cc:403] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:46.482606 32101 raft_consensus.cc:2749] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001) with higher term. Message: Invalid argument: T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 4. Current term is 5.
W20260709 13:10:46.482813 32202 log.cc:927] Time spent T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 13:10:46.468935 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:46.483819 30171 raft_consensus.cc:2468] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 4.
W20260709 13:10:46.454227 32198 log.cc:927] Time spent T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.222s	user 0.001s	sys 0.000s
I20260709 13:10:46.467525 30102 raft_consensus.cc:1275] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:46.459059 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:46.482714 32152 leader_election.cc:290] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:46.476737 32204 raft_consensus.cc:3060] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:46.480837 32068 leader_election.cc:290] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:46.448988 32154 leader_election.cc:290] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:46.497961 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:46.472371 31851 raft_consensus.cc:493] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:46.497605 30172 raft_consensus.cc:2468] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 4.
I20260709 13:10:46.499275 30096 raft_consensus.cc:2468] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 4.
I20260709 13:10:46.499782 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:46.510231 30171 raft_consensus.cc:2468] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 4.
I20260709 13:10:46.504508 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:46.510449 29994 leader_election.cc:304] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:46.507964 30102 raft_consensus.cc:2468] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 4.
I20260709 13:10:46.511281 31789 consensus_queue.cc:1048] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:10:46.511662 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:46.511831 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:46.512517 32103 leader_election.cc:290] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:46.513568 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:46.514039 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:46.515202 32154 raft_consensus.cc:2804] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:46.515695 32154 raft_consensus.cc:697] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:46.516520 32154 consensus_queue.cc:237] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:46.517030 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:46.518157 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:46.519145 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:46.519665 30730 raft_consensus.cc:2468] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 5.
I20260709 13:10:46.520476 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:46.520706 30101 raft_consensus.cc:2468] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 3.
I20260709 13:10:46.520893 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:46.521438 32088 raft_consensus.cc:493] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.521939 32088 raft_consensus.cc:515] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:46.525256 30731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56954 (request call id 433) took 1568 ms. Trace:
I20260709 13:10:46.526278 32014 leader_election.cc:290] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:46.526070 32012 raft_consensus.cc:515] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:46.528654 30736 raft_consensus.cc:2393] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 5: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:46.529022 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:46.530154 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:46.530741 32134 leader_election.cc:290] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:46.531213 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:46.532061 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:46.533041 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:46.535674 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:46.536283 30171 raft_consensus.cc:2468] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 4.
I20260709 13:10:46.536722 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:46.538519 30068 leader_election.cc:304] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:46.539422 30068 leader_election.cc:304] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:46.540544 29926 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39956 (request call id 228) took 11081 ms. Trace:
I20260709 13:10:46.454469 31975 raft_consensus.cc:515] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:46.544688 31975 leader_election.cc:290] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:46.546016 30068 leader_election.cc:304] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:46.546736 32014 raft_consensus.cc:2804] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:46.547081 32014 raft_consensus.cc:493] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:46.547418 32014 raft_consensus.cc:3060] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:46.550422 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:46.551103 30169 raft_consensus.cc:2468] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 2.
I20260709 13:10:46.551975 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:46.552584 30169 raft_consensus.cc:2468] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 5.
I20260709 13:10:46.553403 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:46.508351 30099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48558 (request call id 332) took 1337 ms. Trace:
I20260709 13:10:46.484382 32023 raft_consensus.cc:493] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:46.553617 31851 raft_consensus.cc:3060] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:46.473819 32106 raft_consensus.cc:493] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:46.554970 32024 raft_consensus.cc:2749] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:46.557811 32103 raft_consensus.cc:2804] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:46.558550 30068 leader_election.cc:304] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:46.582268 30068 leader_election.cc:304] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:46.582952 30068 leader_election.cc:304] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:46.560307 32014 raft_consensus.cc:515] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:46.561308 32001 consensus_queue.cc:1048] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:46.528136 32012 leader_election.cc:290] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:46.562872 30140 leader_election.cc:304] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:46.563028 30142 leader_election.cc:304] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
W20260709 13:10:46.563673 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 98618.7us
I20260709 13:10:46.564515 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:46.565038 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:46.512415 30733 raft_consensus.cc:2393] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 5: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:46.566941 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:46.528070 32107 consensus_queue.cc:1059] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:10:46.440649 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:46.569131 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:46.566092 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:46.624682 30171 raft_consensus.cc:2468] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 5.
I20260709 13:10:46.625258 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:46.574880 30099 rpcz_store.cc:276] 0709 13:10:45.170506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:46.091573 (+921067us) service_pool.cc:224] Handling call
0709 13:10:46.096623 (+  5050us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:46.096910 (+   287us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:10:46.190205 (+ 93295us) log.cc:844] Serialized 14 byte log entry
0709 13:10:46.508029 (+317824us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:46.508077 (+    48us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:46.508121 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:46.508180 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:46.508303 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":291,"prepare.queue_time_us":45304,"prepare.run_cpu_time_us":22,"prepare.run_wall_time_us":23,"raft.queue_time_us":7539,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":23392,"thread_start_us":351990,"threads_started":2}
I20260709 13:10:46.579346 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:46.580595 30703 leader_election.cc:304] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:10:46.575142 32161 raft_consensus.cc:493] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.540930 29926 rpcz_store.cc:276] 0709 13:10:35.459416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:35.467568 (+  8152us) service_pool.cc:224] Handling call
0709 13:10:46.540467 (+11072899us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:43.740385 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:43.748584 (+  8199us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:43.751679 (+  3095us) write_op.cc:435] Acquired schema lock
0709 13:10:43.752705 (+  1026us) tablet.cc:662] Decoding operations
0709 13:10:43.819870 (+ 67165us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:43.819947 (+    77us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:43.819987 (+    40us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:10:43.820342 (+   355us) tablet.cc:701] Row locks acquired
0709 13:10:43.820359 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:10:43.820558 (+   199us) write_op.cc:270] Start()
0709 13:10:43.820702 (+   144us) write_op.cc:276] Timestamp: P: 1783602643820474 usec, L: 0
0709 13:10:43.820725 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 13:10:43.821452 (+   727us) log.cc:844] Serialized 1293 byte log entry
0709 13:10:44.484945 (+663493us) op_driver.cc:464] REPLICATION: finished
0709 13:10:44.806280 (+321335us) write_op.cc:301] APPLY: starting
0709 13:10:44.806364 (+    84us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:44.806493 (+   129us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:44.806618 (+   125us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:44.807066 (+   448us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:44.807251 (+   185us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:10:44.807296 (+    45us) write_op.cc:312] APPLY: finished
0709 13:10:44.807502 (+   206us) log.cc:844] Serialized 35 byte log entry
0709 13:10:44.807661 (+   159us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:44.807761 (+   100us) write_op.cc:454] Released schema lock
0709 13:10:44.807801 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:44.808191 (+   390us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:44.808217 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":373928,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":319600,"apply.run_cpu_time_us":1863,"apply.run_wall_time_us":1864,"num_ops":3,"prepare.queue_time_us":184249,"prepare.run_cpu_time_us":13736,"prepare.run_wall_time_us":370346,"raft.queue_time_us":240386,"raft.run_cpu_time_us":127051,"raft.run_wall_time_us":335663,"replication_time_us":641089,"thread_start_us":832214,"threads_started":4,"wal-append.queue_time_us":320302,"wal-append.run_cpu_time_us":40880,"wal-append.run_wall_time_us":1676053}]]}
W20260709 13:10:46.618782 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 55977.6us
I20260709 13:10:46.618248 30023 raft_consensus.cc:2393] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 5: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:46.628609 30140 leader_election.cc:304] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:46.629158 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:46.621411 30025 raft_consensus.cc:2468] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
I20260709 13:10:46.630281 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:46.630789 29994 leader_election.cc:304] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:46.631232 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:46.567471 29993 leader_election.cc:304] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:46.622417 30028 raft_consensus.cc:2410] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:10:46.632609 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:46.626323 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:10:46.626708 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 46175.3us
I20260709 13:10:46.630195 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:46.633863 30703 leader_election.cc:304] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:10:46.625514 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:46.581270 32106 raft_consensus.cc:3060] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:46.581470 32103 raft_consensus.cc:493] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:46.636226 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:46.639384 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:46.639490 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:46.640388 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:46.634138 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:10:46.637195 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 69803.5us
I20260709 13:10:46.587380 32180 raft_consensus.cc:2804] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:46.642114 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:46.642449 29993 leader_election.cc:304] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:10:46.635469 30171 raft_consensus.cc:2468] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 4.
I20260709 13:10:46.643718 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:46.647275 30172 raft_consensus.cc:2393] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 6: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:10:46.647063 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:46.586704 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:46.644229 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
W20260709 13:10:46.642614 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 59709.4us
I20260709 13:10:46.647763 30023 raft_consensus.cc:2468] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 4.
I20260709 13:10:46.648380 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:46.650803 30025 raft_consensus.cc:2468] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
I20260709 13:10:46.609896 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:46.585027 32108 raft_consensus.cc:2804] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:46.606879 32014 leader_election.cc:290] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:46.649358 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:46.652022 30028 raft_consensus.cc:2393] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 4: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:46.652493 30068 leader_election.cc:304] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:46.655165 30171 raft_consensus.cc:2393] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 4: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:10:46.608373 30097 raft_consensus.cc:2468] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 6.
I20260709 13:10:46.657097 30099 raft_consensus.cc:1240] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:46.658165 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:46.625775 32208 raft_consensus.cc:2749] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:46.651919 32154 raft_consensus.cc:2749] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:46.645285 32103 raft_consensus.cc:3060] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:46.644404 32161 raft_consensus.cc:515] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:46.659195 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:46.648921 32136 raft_consensus.cc:2804] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:46.660293 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:46.662294 29993 leader_election.cc:304] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:46.662500 30102 raft_consensus.cc:1240] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:46.658311 32204 raft_consensus.cc:2749] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:46.665234 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:46.645087 32180 raft_consensus.cc:493] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.638840 32075 raft_consensus.cc:2804] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:46.643579 32022 raft_consensus.cc:2804] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:46.669925 30736 raft_consensus.cc:1275] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:46.621436 32207 consensus_queue.cc:1059] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.080s
I20260709 13:10:46.682938 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:46.684523 30024 raft_consensus.cc:1240] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:46.685132 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:46.648919 32012 raft_consensus.cc:2804] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:46.654803 32102 consensus_queue.cc:1059] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260709 13:10:46.655014 32108 raft_consensus.cc:493] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:46.581466 32023 raft_consensus.cc:515] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:46.998143 30142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 435148us
W20260709 13:10:47.003280 30069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.111171 30142 leader_election.cc:304] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
W20260709 13:10:47.092190 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 463642us
I20260709 13:10:47.110137 30026 raft_consensus.cc:2376] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2. Re-sending same reply.
W20260709 13:10:46.909432 30703 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.54.66:43821 timed out after 1.569s (SENT) [suppressed 15 similar messages]
I20260709 13:10:47.112452 30140 leader_election.cc:304] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:46.985818 32106 raft_consensus.cc:515] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:47.111167 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:46.668542 31954 raft_consensus.cc:2804] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:47.119130 30140 leader_election.cc:400] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 election: Vote denied by peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451) with higher term. Message: Invalid argument: T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 3. Current term is 4.
I20260709 13:10:47.119509 30140 leader_election.cc:403] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:10:47.123809 29994 leader_election.cc:304] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:46.686551 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:46.784108 32002 raft_consensus.cc:493] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:46.668769 30170 raft_consensus.cc:2468] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
I20260709 13:10:46.685796 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:46.987479 31729 raft_consensus.cc:2804] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:46.686837 32208 raft_consensus.cc:2749] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:47.111428 32075 raft_consensus.cc:493] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.138674 32075 raft_consensus.cc:3060] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:47.126360 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:47.140576 32107 raft_consensus.cc:493] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.115888 32180 raft_consensus.cc:3060] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:46.803057 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:46.934759 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:46.934242 32085 raft_consensus.cc:493] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:46.961285 30019 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54206 (request call id 1453) took 1743 ms (client timeout 2240 ms). Trace:
I20260709 13:10:47.111604 32022 raft_consensus.cc:493] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
W20260709 13:10:46.958436 30728 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51014 (request call id 666) took 3035 ms (client timeout 1867 ms). Trace:
I20260709 13:10:47.115814 32108 raft_consensus.cc:3060] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:47.138257 31789 raft_consensus.cc:2804] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:47.115571 32012 raft_consensus.cc:493] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:47.121637 31954 raft_consensus.cc:493] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:47.126868 32136 raft_consensus.cc:697] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:47.188416 32136 consensus_queue.cc:237] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:47.086829 31851 raft_consensus.cc:515] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:47.190774 32023 leader_election.cc:290] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:47.191179 30174 raft_consensus.cc:2393] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 4: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:10:46.525708 30731 rpcz_store.cc:276] 0709 13:10:44.956402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.964975 (+  8573us) service_pool.cc:224] Handling call
0709 13:10:44.973799 (+  8824us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:45.053955 (+ 80156us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:45.055692 (+  1737us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:46.101534 (+1045842us) spinlock_profiling.cc:243] Waited 1.01 ms on lock 0x7b2c00007878. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f09b3a11 00007f99f09c3372 00007f99f20f5a01 00007f99f20ba43a 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2
0709 13:10:46.116029 (+ 14495us) log.cc:844] Serialized 26 byte log entry
0709 13:10:46.170269 (+ 54240us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:46.205825 (+ 35556us) log.cc:844] Serialized 14 byte log entry
0709 13:10:46.232738 (+ 26913us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:46.524909 (+292171us) spinlock_profiling.cc:243] Waited 54.6 ms on lock 0x7b5400485654. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:10:46.524969 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:46.525018 (+    49us) raft_consensus.cc:1685] finished
0709 13:10:46.525035 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:46.525189 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":23640,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":33,"raft.queue_time_us":1568,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":14683,"spinlock_wait_cycles":127878272,"thread_start_us":49262,"threads_started":2,"wal-append.queue_time_us":50117}
I20260709 13:10:47.192842 30095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48558 (request call id 326) took 2543 ms. Trace:
I20260709 13:10:47.150944 30173 raft_consensus.cc:2468] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
I20260709 13:10:47.151542 30023 raft_consensus.cc:2955] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:47.141355 32107 raft_consensus.cc:515] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:47.186960 32012 raft_consensus.cc:3060] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:47.187398 31954 raft_consensus.cc:3060] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:47.194116 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 531858us
I20260709 13:10:47.155614 32022 raft_consensus.cc:3060] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:47.151942 30019 rpcz_store.cc:269] 0709 13:10:45.217739 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.319153 (+101414us) service_pool.cc:224] Handling call
0709 13:10:46.934875 (+1615722us) spinlock_profiling.cc:243] Waited 745 ms on lock 0x7b540013c9d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:10:46.961210 (+ 26335us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1713421184}
I20260709 13:10:47.136273 32002 raft_consensus.cc:515] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:47.154724 32208 raft_consensus.cc:2749] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:47.266377 29993 leader_election.cc:304] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:47.272271 29993 leader_election.cc:304] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:47.185501 32214 raft_consensus.cc:493] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:47.286695 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:47.287528 30176 raft_consensus.cc:2393] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 5: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:10:47.287906 30176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43838 (request call id 1666) took 2042 ms. Trace:
W20260709 13:10:47.290987 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 381576us
I20260709 13:10:47.288196 30176 rpcz_store.cc:276] 0709 13:10:45.245917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.246024 (+   107us) service_pool.cc:224] Handling call
0709 13:10:46.515246 (+1269222us) spinlock_profiling.cc:243] Waited 36.3 ms on lock 0x7b5800003c98. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eef95b71 00007f99eef95a22 00007f99f7eaec09 00007f99f7008ee0 00007f99f70d20ab 00007f99f70d2131 00007f99f70800a0 00007f99f707f984 00007f99f05fa6d4 00007f99f05fa662
0709 13:10:47.275231 (+759985us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b5800003c98. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eef95e9c 00007f99eef95a5b 00007f99f7eaec09 00007f99f7008ee0 00007f99f70d20ab 00007f99f70d2131 00007f99f70800a0 00007f99f707f984 00007f99f05fa6d4 00007f99f05fa662
0709 13:10:47.287848 (+ 12617us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":123357312}
I20260709 13:10:47.291818 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:47.250941 31816 raft_consensus.cc:2804] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:47.250560 31789 raft_consensus.cc:697] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:47.153987 32085 raft_consensus.cc:515] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:47.272109 32204 raft_consensus.cc:3060] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:47.291045 31975 raft_consensus.cc:2804] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:47.289146 32106 leader_election.cc:290] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:47.354699 32107 leader_election.cc:290] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:47.355746 32022 raft_consensus.cc:515] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:47.233608 32215 raft_consensus.cc:2749] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451) with higher term. Message: Invalid argument: T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 3. Current term is 4.
W20260709 13:10:47.301306 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 182340us
I20260709 13:10:47.307380 32108 raft_consensus.cc:515] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:47.302242 31816 raft_consensus.cc:697] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:47.299712 29993 leader_election.cc:304] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
W20260709 13:10:47.170496 30728 rpcz_store.cc:269] 0709 13:10:43.899438 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:43.908960 (+  9522us) service_pool.cc:224] Handling call
0709 13:10:46.934257 (+3025297us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540054f954. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:10:46.934473 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2341607680}
I20260709 13:10:47.318816 32085 leader_election.cc:290] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:47.332891 32075 raft_consensus.cc:515] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:47.297981 31851 leader_election.cc:290] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:10:47.359825 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 60188.1us
I20260709 13:10:47.336037 31954 raft_consensus.cc:515] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:47.338732 32012 raft_consensus.cc:515] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:47.342451 31789 consensus_queue.cc:237] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:47.345666 32161 leader_election.cc:290] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:47.297811 32025 raft_consensus.cc:2804] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:47.351774 32002 leader_election.cc:290] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:47.294539 32214 raft_consensus.cc:515] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:47.193219 30095 rpcz_store.cc:276] 0709 13:10:44.649498 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:44.652851 (+  3353us) service_pool.cc:224] Handling call
0709 13:10:44.775824 (+122973us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:44.925315 (+149491us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:44.931077 (+  5762us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:44.934079 (+  3002us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:44.938280 (+  4201us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:47.192606 (+2254326us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b540043f154. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:10:47.192654 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:47.192769 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":294785920}
I20260709 13:10:47.304061 31975 raft_consensus.cc:493] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:47.400902 31975 raft_consensus.cc:3060] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:47.402837 32214 leader_election.cc:290] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:47.358976 30140 leader_election.cc:304] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:47.404709 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:10:47.404865 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 45970.6us
I20260709 13:10:47.405364 30168 raft_consensus.cc:2468] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 3.
I20260709 13:10:47.360868 29993 leader_election.cc:304] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
W20260709 13:10:47.406066 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 45273.5us
I20260709 13:10:47.406975 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:47.407925 31975 raft_consensus.cc:515] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:47.408437 29993 leader_election.cc:304] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
W20260709 13:10:47.363790 30142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 252331us
I20260709 13:10:47.410089 30142 leader_election.cc:304] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:10:47.410245 32108 leader_election.cc:290] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:47.411670 32075 leader_election.cc:290] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:47.417317 32161 raft_consensus.cc:2749] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:47.416935 32180 raft_consensus.cc:515] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:47.416847 32211 raft_consensus.cc:2804] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:47.418087 30177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43840 (request call id 1589) took 2022 ms. Trace:
I20260709 13:10:47.418160 32211 raft_consensus.cc:493] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:47.418706 32211 raft_consensus.cc:3060] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:47.419014 30096 raft_consensus.cc:2393] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 5: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:10:47.419435 32180 leader_election.cc:290] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:47.423017 32088 leader_election.cc:290] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:47.423981 30100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48558 (request call id 333) took 2253 ms. Trace:
I20260709 13:10:47.418483 30177 rpcz_store.cc:276] 0709 13:10:45.396156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.958307 (+562151us) service_pool.cc:224] Handling call
0709 13:10:47.417945 (+1459638us) spinlock_profiling.cc:243] Waited 90.4 ms on lock 0x7b54004088d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:10:47.418037 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":207894400}
I20260709 13:10:47.425469 32211 raft_consensus.cc:515] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:47.426295 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:47.424314 30100 rpcz_store.cc:276] 0709 13:10:45.170718 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:46.193384 (+1022666us) service_pool.cc:224] Handling call
0709 13:10:46.193612 (+   228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:46.275646 (+ 82034us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:46.275673 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:46.275711 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:46.275743 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:47.423777 (+1148034us) spinlock_profiling.cc:243] Waited 81.8 ms on lock 0x7b54003b4554. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:10:47.423817 (+    40us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:47.423929 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":188254464}
W20260709 13:10:47.358686 32103 consensus_meta.cc:287] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719: Time spent flushing consensus metadata: real 0.671s	user 0.004s	sys 0.004s
I20260709 13:10:47.436734 32183 raft_consensus.cc:2804] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:47.357731 32022 leader_election.cc:290] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:47.395722 31816 consensus_queue.cc:237] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:47.437966 32020 raft_consensus.cc:2749] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:47.438908 31954 leader_election.cc:290] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:47.370143 32068 raft_consensus.cc:2804] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:47.439858 32068 raft_consensus.cc:493] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:47.440260 32068 raft_consensus.cc:3060] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:47.441416 30177 raft_consensus.cc:1275] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:10:47.437135 32183 raft_consensus.cc:493] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.442157 32183 raft_consensus.cc:3060] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:47.448724 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:47.449142 32183 raft_consensus.cc:515] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:47.450183 32192 raft_consensus.cc:3055] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:47.450557 32192 raft_consensus.cc:740] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:47.451156 32183 leader_election.cc:290] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:47.451973 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:47.452590 30168 raft_consensus.cc:2468] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 5.
W20260709 13:10:47.391873 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 267013us
I20260709 13:10:47.453142 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:47.453585 30731 raft_consensus.cc:1240] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:47.388103 32025 raft_consensus.cc:493] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:47.454752 32025 raft_consensus.cc:3060] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:47.455945 30097 raft_consensus.cc:1240] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:47.451274 32192 consensus_queue.cc:260] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:47.456971 32192 raft_consensus.cc:3060] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:47.458285 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:47.464313 32068 raft_consensus.cc:515] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:47.466185 32046 raft_consensus.cc:493] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.466325 30098 raft_consensus.cc:1275] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:10:47.466693 32046 raft_consensus.cc:515] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:47.467293 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:47.341516 32204 raft_consensus.cc:2749] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:47.414361 32101 raft_consensus.cc:3055] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEADER]: Stepping down as leader of term 2
W20260709 13:10:47.468464 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 839955us
I20260709 13:10:47.468856 32101 raft_consensus.cc:740] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:47.431093 32012 leader_election.cc:290] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:47.436503 32103 raft_consensus.cc:515] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:47.471572 32134 raft_consensus.cc:3055] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:10:47.454329 30101 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48558 (request call id 340) took 2222 ms (client timeout 2799 ms). Trace:
I20260709 13:10:47.471890 32103 leader_election.cc:290] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:10:47.472231 30101 rpcz_store.cc:269] 0709 13:10:45.232324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:45.964524 (+732200us) service_pool.cc:224] Handling call
0709 13:10:47.454190 (+1489666us) spinlock_profiling.cc:243] Waited 555 ms on lock 0x7b54004010d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:10:47.454276 (+    86us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1277220096}
I20260709 13:10:47.471961 32134 raft_consensus.cc:740] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:47.475329 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:47.475601 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:47.475751 32134 consensus_queue.cc:260] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:47.474848 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:47.476729 32134 raft_consensus.cc:3060] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:47.458956 31729 raft_consensus.cc:493] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:47.477946 31729 raft_consensus.cc:3060] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:47.478715 30728 raft_consensus.cc:3055] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:47.479087 30728 raft_consensus.cc:740] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:47.479861 30728 consensus_queue.cc:260] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:47.480808 30728 raft_consensus.cc:3060] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:47.481225 32022 raft_consensus.cc:493] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:47.459510 30100 raft_consensus.cc:1240] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:47.469772 32101 consensus_queue.cc:260] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:47.435591 32211 leader_election.cc:290] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:47.469779 32046 leader_election.cc:290] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:47.481724 32022 raft_consensus.cc:515] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:47.483711 32022 leader_election.cc:290] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:47.405612 30140 leader_election.cc:304] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:10:47.484724 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 79200.6us
I20260709 13:10:47.485379 30140 leader_election.cc:304] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:10:47.486857 30066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.487449 30140 leader_election.cc:304] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:47.487793 30066 leader_election.cc:304] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:47.494362 30066 leader_election.cc:304] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:47.498263 30025 raft_consensus.cc:1240] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:47.499475 31729 raft_consensus.cc:515] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:47.497629 32229 log.cc:927] Time spent T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.053s	user 0.000s	sys 0.005s
W20260709 13:10:47.490643 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 398892us
I20260709 13:10:47.500927 32204 raft_consensus.cc:2749] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:47.501425 31729 leader_election.cc:290] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:47.482170 32101 raft_consensus.cc:3060] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:47.501917 32103 consensus_queue.cc:1048] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:47.435077 31975 leader_election.cc:290] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:47.495004 32012 raft_consensus.cc:2804] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:47.496989 30020 raft_consensus.cc:1240] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:47.496959 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:47.489301 30700 leader_election.cc:304] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:10:47.504463 32012 raft_consensus.cc:493] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.504983 32012 raft_consensus.cc:3060] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:47.500420 30140 leader_election.cc:304] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:47.507248 30140 leader_election.cc:304] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:47.508765 30140 leader_election.cc:304] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:47.507781 32214 raft_consensus.cc:2749] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:47.509297 32222 raft_consensus.cc:2749] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:47.501578 32204 raft_consensus.cc:2749] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:47.510697 30700 leader_election.cc:304] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:47.511667 32075 raft_consensus.cc:2804] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:47.512061 32075 raft_consensus.cc:493] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:47.512460 32075 raft_consensus.cc:3060] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:47.512835 32136 consensus_queue.cc:1048] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:47.513685 30700 leader_election.cc:304] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:47.515462 32204 consensus_queue.cc:1059] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:47.516049 32131 raft_consensus.cc:2804] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:47.515050 32222 raft_consensus.cc:2749] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:47.489903 32025 raft_consensus.cc:515] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:47.516384 32214 raft_consensus.cc:3055] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:47.517081 32214 raft_consensus.cc:740] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:47.516521 32131 raft_consensus.cc:697] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:47.518277 32025 leader_election.cc:290] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:47.526211 30173 raft_consensus.cc:1240] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:47.517971 32214 consensus_queue.cc:260] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:47.527462 32214 raft_consensus.cc:3060] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:47.527179 29921 catalog_manager.cc:5697] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 2 to 1, leader changed from <none> to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 1 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:10:47.528795 29921 catalog_manager.cc:5697] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } }
I20260709 13:10:47.530889 29921 catalog_manager.cc:5697] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 2 to 4, leader changed from c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 4 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } }
I20260709 13:10:47.531549 30100 raft_consensus.cc:1240] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:47.514618 31954 raft_consensus.cc:2749] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:47.532217 29921 catalog_manager.cc:5697] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 2 to 3, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 3 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:47.518661 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:47.518929 32085 consensus_queue.cc:1059] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:47.519774 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:47.512573 32225 raft_consensus.cc:3060] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:47.520494 32046 consensus_queue.cc:1059] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:47.521719 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:47.546588 30023 raft_consensus.cc:2468] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 2.
I20260709 13:10:47.521911 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:47.522692 30066 leader_election.cc:304] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:47.504789 32223 raft_consensus.cc:2749] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:47.523845 30175 raft_consensus.cc:1240] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:47.550477 31954 raft_consensus.cc:2749] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:47.551929 29993 leader_election.cc:304] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:47.524906 30174 raft_consensus.cc:1275] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:10:47.525162 32230 log.cc:927] Time spent T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.056s	user 0.001s	sys 0.002s
W20260709 13:10:47.525504 32227 log.cc:927] Time spent T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.083s	user 0.005s	sys 0.000s
I20260709 13:10:47.466689 32068 leader_election.cc:290] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:47.518121 32131 consensus_queue.cc:237] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:47.533826 30140 leader_election.cc:304] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:10:47.566349 29993 leader_election.cc:304] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:47.567485 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:47.535915 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:47.536564 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:47.555435 31790 raft_consensus.cc:493] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.523073 30020 raft_consensus.cc:1240] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:47.533483 30068 leader_election.cc:304] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:47.534130 29921 catalog_manager.cc:5697] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 1 to 2, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 2 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } }
W20260709 13:10:47.569029 30140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.549774 30066 leader_election.cc:304] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:47.570928 30068 leader_election.cc:304] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:47.576457 30068 leader_election.cc:304] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:47.578153 30068 leader_election.cc:304] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:47.579236 30068 leader_election.cc:304] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:47.582623 30066 leader_election.cc:304] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:47.575379 29921 catalog_manager.cc:5697] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:47.596117 29921 catalog_manager.cc:5697] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 2 to 4, leader changed from 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 4 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:47.597203 30069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.598407 29921 catalog_manager.cc:5697] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:47.601210 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:47.570705 32223 raft_consensus.cc:2804] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:10:47.601725 30022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54198 (request call id 1678) took 1032 ms. Trace:
I20260709 13:10:47.600708 30066 leader_election.cc:304] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:47.601853 29921 catalog_manager.cc:5697] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 1 to 2, leader changed from c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) to 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68). New cstate: current_term: 2 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:47.604409 30022 rpcz_store.cc:276] 0709 13:10:46.569093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:46.655382 (+ 86289us) service_pool.cc:224] Handling call
0709 13:10:46.655658 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:47.098756 (+443098us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:47.098789 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:47.099270 (+   481us) log.cc:844] Serialized 26 byte log entry
0709 13:10:47.501936 (+402666us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:47.501974 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:47.502047 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:47.601530 (+ 99483us) raft_consensus.cc:1685] finished
0709 13:10:47.601549 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:47.601672 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":42094,"raft.queue_time_us":452928,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":108,"thread_start_us":387435,"threads_started":1,"wal-append.queue_time_us":354296}
I20260709 13:10:47.603775 30174 raft_consensus.cc:2368] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 4. Current term is 5.
I20260709 13:10:47.594204 30169 raft_consensus.cc:2410] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:47.575546 32068 raft_consensus.cc:2749] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:47.600711 32236 raft_consensus.cc:2804] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:47.606921 29993 leader_election.cc:304] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:47.605639 29921 catalog_manager.cc:5697] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 2 to 4, leader changed from c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 4 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } }
I20260709 13:10:47.565166 32025 consensus_queue.cc:1048] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:10:47.580631 32103 raft_consensus.cc:2764] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 13:10:47.592321 32180 raft_consensus.cc:2749] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:47.591774 32088 raft_consensus.cc:2749] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:47.581692 31954 raft_consensus.cc:2749] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:47.580657 32143 raft_consensus.cc:2749] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:47.592077 32002 raft_consensus.cc:2749] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:47.606429 32223 raft_consensus.cc:493] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:47.617550 29993 leader_election.cc:304] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:47.618860 30700 leader_election.cc:304] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
W20260709 13:10:47.621233 30701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:47.592232 32154 consensus_queue.cc:1048] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 13:10:47.591878 32108 raft_consensus.cc:2749] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:47.583602 31790 raft_consensus.cc:515] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:47.616873 32236 raft_consensus.cc:493] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:47.607625 32020 consensus_queue.cc:1059] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 13:10:47.645640 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:47.623484 31816 raft_consensus.cc:2749] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:47.646845 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:47.649338 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:47.658191 30172 raft_consensus.cc:1275] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:47.632159 32223 raft_consensus.cc:3060] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:10:47.650658 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 75489.5us
I20260709 13:10:47.633941 32103 raft_consensus.cc:2804] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:47.663609 30176 raft_consensus.cc:1275] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:10:47.638324 32046 raft_consensus.cc:2804] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:47.650061 32101 raft_consensus.cc:3055] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:47.647888 32136 raft_consensus.cc:3055] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:47.648978 32143 raft_consensus.cc:2749] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:47.683245 32075 raft_consensus.cc:515] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:47.684211 32235 log.cc:927] Time spent T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 13:10:47.685366 32075 leader_election.cc:290] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 3 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:47.686131 32108 raft_consensus.cc:1064] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719: attempting to promote NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a to VOTER
I20260709 13:10:47.687603 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:47.672516 32238 consensus_queue.cc:1048] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:10:47.679133 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 78495.7us
I20260709 13:10:47.689823 30175 raft_consensus.cc:1275] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:47.690040 30066 leader_election.cc:304] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:47.651962 32236 raft_consensus.cc:3060] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:47.680474 32136 raft_consensus.cc:740] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:47.694958 32228 consensus_queue.cc:1048] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:47.695725 29994 leader_election.cc:304] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:47.700312 32012 raft_consensus.cc:515] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:47.664314 32103 raft_consensus.cc:493] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:47.662983 32085 consensus_queue.cc:1059] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:10:47.679906 32234 raft_consensus.cc:493] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.711862 32143 raft_consensus.cc:2749] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:47.713109 32103 raft_consensus.cc:3060] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:47.726585 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:47.727313 30731 raft_consensus.cc:2368] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 5. Current term is 6.
I20260709 13:10:47.728116 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:47.728645 30175 raft_consensus.cc:3060] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:47.670140 32101 raft_consensus.cc:740] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:47.718593 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:47.718725 32136 consensus_queue.cc:260] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:47.703163 32075 raft_consensus.cc:493] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:47.719646 30728 raft_consensus.cc:1275] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 13:10:47.720475 32226 raft_consensus.cc:3055] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:47.667933 32046 raft_consensus.cc:493] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:47.711380 31790 leader_election.cc:290] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:10:47.686523 32108 raft_consensus.cc:1068] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719: Unable to promote non-voter 6f3eb161e2194f6891f12e2cfcaaf73a: Illegal state: Leader has not yet committed an operation in its own term
I20260709 13:10:47.726039 32134 raft_consensus.cc:493] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.738452 30142 leader_election.cc:400] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 election: Vote denied by peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469) with higher term. Message: Invalid argument: T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 5. Current term is 6.
I20260709 13:10:47.723105 32214 raft_consensus.cc:493] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:47.768050 30142 leader_election.cc:403] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:10:47.764889 30728 pending_rounds.cc:85] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a: Aborting all ops after (but not including) 4
W20260709 13:10:47.768476 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 82181us
I20260709 13:10:47.763247 30168 raft_consensus.cc:3060] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:47.763234 31954 raft_consensus.cc:2764] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:10:47.764760 32226 raft_consensus.cc:740] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:47.766376 32046 raft_consensus.cc:3060] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:47.761457 32154 consensus_queue.cc:1059] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 13:10:47.775331 30728 pending_rounds.cc:107] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 13:10:47.785460 30101 raft_consensus.cc:1275] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:47.775977 32136 raft_consensus.cc:3060] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:47.787122 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:47.793506 30027 raft_consensus.cc:1275] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:47.790495 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:47.790771 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:47.763785 32021 consensus_queue.cc:1059] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 13:10:47.796965 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:47.797919 30022 raft_consensus.cc:1240] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:47.782770 32101 consensus_queue.cc:260] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:47.797593 30027 raft_consensus.cc:2468] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 4.
I20260709 13:10:47.798952 32101 raft_consensus.cc:3060] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:47.799252 32012 leader_election.cc:290] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:47.802969 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:47.803633 30027 raft_consensus.cc:3060] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:47.766438 32075 raft_consensus.cc:515] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:47.806017 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:47.808703 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:47.775780 32214 raft_consensus.cc:515] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:47.797808 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:47.788851 30728 raft_consensus.cc:2889] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:47.772579 32134 raft_consensus.cc:515] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:47.813050 30025 raft_consensus.cc:1240] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:47.737206 32234 raft_consensus.cc:515] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:47.793051 32222 raft_consensus.cc:493] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:47.818156 30066 leader_election.cc:304] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:47.870548 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
W20260709 13:10:47.871127 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 53057.6us
I20260709 13:10:47.811522 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:47.802277 31975 raft_consensus.cc:493] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.838958 30027 raft_consensus.cc:2468] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 3.
W20260709 13:10:47.839983 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 224796us
I20260709 13:10:47.840730 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:47.840976 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:47.810205 32238 raft_consensus.cc:3055] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:47.871223 30100 raft_consensus.cc:2468] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 4.
I20260709 13:10:47.831084 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:47.880465 30736 raft_consensus.cc:3060] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:47.880115 31975 raft_consensus.cc:515] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:47.881016 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
W20260709 13:10:47.873965 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 56657.8us
I20260709 13:10:47.887250 32238 raft_consensus.cc:740] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:47.887547 32226 consensus_queue.cc:260] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:47.888686 32226 raft_consensus.cc:3060] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:47.888474 32238 consensus_queue.cc:260] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:47.889595 32238 raft_consensus.cc:3060] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:47.890169 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:47.890868 32143 raft_consensus.cc:3055] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:47.891251 32143 raft_consensus.cc:740] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:47.892004 32143 consensus_queue.cc:260] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:47.893203 32143 raft_consensus.cc:3060] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:47.876793 30068 leader_election.cc:304] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:47.899187 32183 consensus_queue.cc:1048] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:47.901504 30732 raft_consensus.cc:1275] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:10:47.901827 29993 leader_election.cc:304] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:47.902850 32153 raft_consensus.cc:2749] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:47.904959 29993 leader_election.cc:304] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:47.905355 31975 leader_election.cc:290] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:47.906430 30066 leader_election.cc:304] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:47.907146 32002 consensus_queue.cc:1059] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:47.907917 32002 raft_consensus.cc:2804] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:47.908304 32245 raft_consensus.cc:2749] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:47.908392 32002 raft_consensus.cc:697] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 3 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:47.908039 30068 leader_election.cc:304] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:47.909963 32088 raft_consensus.cc:2749] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:47.909335 32002 consensus_queue.cc:237] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:47.914121 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:47.917420 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:47.919534 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:47.923733 30143 leader_election.cc:304] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:47.948086 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:47.949150 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:47.951838 30736 raft_consensus.cc:2468] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 6.
I20260709 13:10:47.949643 30171 raft_consensus.cc:2468] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 2.
I20260709 13:10:47.957463 30068 leader_election.cc:304] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:47.959482 30068 leader_election.cc:304] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
W20260709 13:10:47.961352 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 47024.4us
I20260709 13:10:47.962148 29993 leader_election.cc:304] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:47.963657 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:47.877872 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:47.967818 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:47.949993 32012 raft_consensus.cc:2804] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:47.861745 32211 consensus_queue.cc:1048] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.098s
I20260709 13:10:47.966120 30068 leader_election.cc:304] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:47.972311 31789 raft_consensus.cc:2804] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:47.861598 32161 consensus_queue.cc:1059] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.097s
I20260709 13:10:47.952195 32228 raft_consensus.cc:2749] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:47.977643 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:47.979740 30068 leader_election.cc:304] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:47.980508 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:47.997066 30101 raft_consensus.cc:2410] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:10:47.956018 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:47.959371 32180 raft_consensus.cc:493] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:47.970584 32088 raft_consensus.cc:2749] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:47.966933 32245 raft_consensus.cc:2804] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:47.975392 32085 raft_consensus.cc:3055] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:47.996031 30703 leader_election.cc:304] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:10:48.003944 30174 raft_consensus.cc:2468] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 4.
I20260709 13:10:47.879099 32222 raft_consensus.cc:515] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:47.977547 30019 raft_consensus.cc:3060] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:48.008585 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:47.960939 32068 consensus_queue.cc:1048] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:10:48.023566 30171 raft_consensus.cc:2410] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 13:10:47.972553 32153 consensus_queue.cc:1048] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 13:10:48.059684 30171 raft_consensus.cc:1275] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:10:48.010916 32245 raft_consensus.cc:493] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:48.065948 32245 raft_consensus.cc:3060] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:48.011824 32085 raft_consensus.cc:740] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:48.094753 32085 consensus_queue.cc:260] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:48.095960 32085 raft_consensus.cc:3060] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:48.116503 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 120530us
I20260709 13:10:48.010821 32180 raft_consensus.cc:515] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:10:48.229882 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 250175us
I20260709 13:10:48.221405 30175 raft_consensus.cc:2468] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 6.
I20260709 13:10:48.246311 30068 leader_election.cc:304] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:48.097976 32020 consensus_queue.cc:1048] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 13:10:48.097831 31954 raft_consensus.cc:2804] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:10:48.251982 29991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.247243 30169 raft_consensus.cc:1240] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 2. Current term is 3. Ops: []
W20260709 13:10:48.255194 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 278291us
I20260709 13:10:48.158679 32161 raft_consensus.cc:493] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:48.246568 32131 raft_consensus.cc:2804] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:48.246296 32023 raft_consensus.cc:493] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:48.267395 30702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:48.269268 32253 log.cc:927] Time spent T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.294s	user 0.000s	sys 0.000s
W20260709 13:10:48.270303 32262 log.cc:927] Time spent T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.176s	user 0.000s	sys 0.000s
I20260709 13:10:48.269387 30068 leader_election.cc:304] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:48.274158 32012 raft_consensus.cc:493] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:48.277170 31851 raft_consensus.cc:3055] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:48.250643 32192 raft_consensus.cc:2749] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469) with higher term. Message: Invalid argument: T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 5. Current term is 6.
W20260709 13:10:48.258873 32225 consensus_meta.cc:287] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent flushing consensus metadata: real 0.710s	user 0.001s	sys 0.008s
W20260709 13:10:48.301838 30702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.264350 32204 raft_consensus.cc:3060] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:48.256458 31954 raft_consensus.cc:493] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
W20260709 13:10:48.270380 32250 log.cc:927] Time spent T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260709 13:10:48.357071 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:48.304262 32023 raft_consensus.cc:515] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:48.264806 31789 raft_consensus.cc:697] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
W20260709 13:10:48.349367 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 80021.7us
I20260709 13:10:48.451520 30068 leader_election.cc:304] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:48.452597 30068 leader_election.cc:304] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:48.352025 32245 raft_consensus.cc:515] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:48.268195 32002 raft_consensus.cc:3060] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:48.389576 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 465899us
I20260709 13:10:48.283793 32131 raft_consensus.cc:493] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:48.347065 32216 log.cc:927] Time spent T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 13:10:48.407147 32230 log.cc:927] Time spent T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.054s	user 0.000s	sys 0.003s
I20260709 13:10:48.407970 32225 raft_consensus.cc:2749] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:48.301945 32214 leader_election.cc:290] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:10:48.417421 30702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.384171 32088 raft_consensus.cc:493] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:48.485653 31789 consensus_queue.cc:237] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:48.486128 32088 raft_consensus.cc:515] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:10:48.423156 30168 consensus_meta.cc:287] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124: Time spent flushing consensus metadata: real 0.640s	user 0.006s	sys 0.002s
I20260709 13:10:48.347882 32012 raft_consensus.cc:3060] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:48.487865 30735 raft_consensus.cc:2468] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 4.
I20260709 13:10:48.419529 29994 leader_election.cc:304] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:48.353089 32075 leader_election.cc:290] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:48.453579 32237 raft_consensus.cc:493] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.395162 31851 raft_consensus.cc:740] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:48.475446 32131 raft_consensus.cc:3060] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:48.490545 32103 consensus_meta.cc:287] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719: Time spent flushing consensus metadata: real 0.764s	user 0.003s	sys 0.006s
W20260709 13:10:48.472513 30700 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.010s	sys 0.030s
I20260709 13:10:48.446134 31954 raft_consensus.cc:3060] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:48.490942 32103 raft_consensus.cc:515] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:48.487452 32269 raft_consensus.cc:2749] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:10:48.492136 30700 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.010s	sys 0.030s
I20260709 13:10:48.493268 32269 raft_consensus.cc:2804] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:48.493644 32269 raft_consensus.cc:493] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:48.493988 32269 raft_consensus.cc:3060] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:48.494760 30700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:48.452167 32223 consensus_meta.cc:287] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124: Time spent flushing consensus metadata: real 0.781s	user 0.008s	sys 0.000s
I20260709 13:10:48.495548 32223 raft_consensus.cc:515] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:48.496492 30176 raft_consensus.cc:3060] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:10:48.498155 32046 consensus_meta.cc:287] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent flushing consensus metadata: real 0.705s	user 0.006s	sys 0.002s
I20260709 13:10:48.498566 32046 raft_consensus.cc:515] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:48.499245 32134 leader_election.cc:290] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:48.490805 31851 consensus_queue.cc:260] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:48.503402 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:48.508270 32270 raft_consensus.cc:2804] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:48.508700 32270 raft_consensus.cc:493] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:48.509034 32270 raft_consensus.cc:3060] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:48.329401 32161 raft_consensus.cc:515] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:48.480929 32023 leader_election.cc:290] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:48.483217 32180 leader_election.cc:290] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:10:48.488739 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 69412.6us
I20260709 13:10:48.496033 32281 raft_consensus.cc:2804] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:48.544075 32281 raft_consensus.cc:493] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:48.544497 32281 raft_consensus.cc:3060] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:48.489015 32021 raft_consensus.cc:2804] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:48.545943 32021 raft_consensus.cc:493] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:48.546279 32021 raft_consensus.cc:3060] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:48.471565 32234 leader_election.cc:290] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:48.547600 32222 leader_election.cc:290] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:48.489526 32237 raft_consensus.cc:515] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:48.533895 30140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.540210 30026 raft_consensus.cc:1240] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:48.553025 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:48.553897 32180 raft_consensus.cc:493] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.554293 32103 leader_election.cc:290] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:48.558118 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:48.561640 30176 raft_consensus.cc:2468] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 3.
I20260709 13:10:48.559706 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:48.563120 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:48.563593 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:48.564278 30025 raft_consensus.cc:2368] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 2. Current term is 3.
I20260709 13:10:48.561864 30027 raft_consensus.cc:3060] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:48.578645 30028 raft_consensus.cc:1240] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:48.546388 32245 leader_election.cc:290] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:48.516938 31851 raft_consensus.cc:3060] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:48.593063 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:48.595852 30027 raft_consensus.cc:2468] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 3.
I20260709 13:10:48.596735 30028 raft_consensus.cc:1240] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:48.597923 30066 leader_election.cc:304] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
W20260709 13:10:48.600502 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 147970us
I20260709 13:10:48.599258 30702 leader_election.cc:304] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:48.555657 31816 raft_consensus.cc:493] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.517190 30168 raft_consensus.cc:2468] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 5.
I20260709 13:10:48.603341 30140 leader_election.cc:400] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 2 election: Vote denied by peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451) with higher term. Message: Invalid argument: T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 2. Current term is 3.
I20260709 13:10:48.606372 30140 leader_election.cc:403] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 13:10:48.606611 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:48.604123 30068 leader_election.cc:304] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:48.615826 30068 leader_election.cc:304] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:48.609223 30702 leader_election.cc:400] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Vote denied by peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001) with higher term. Message: Invalid argument: T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 4. Current term is 5.
I20260709 13:10:48.618911 30702 leader_election.cc:403] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:48.613095 30027 raft_consensus.cc:2393] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 5: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:48.616703 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:48.620045 32271 consensus_queue.cc:1059] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:10:48.622395 32246 raft_consensus.cc:2749] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:10:48.602210 32241 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.000s	sys 0.010s
I20260709 13:10:48.582258 32192 raft_consensus.cc:493] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.590142 32249 consensus_queue.cc:1059] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.107s
I20260709 13:10:48.590015 32258 consensus_queue.cc:1059] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.106s
I20260709 13:10:48.586689 32180 raft_consensus.cc:515] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:10:48.643083 29991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:48.982798 29993 leader_election.cc:304] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
W20260709 13:10:48.897915 30700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:48.983651 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 374554us
W20260709 13:10:48.722235 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 106471us
I20260709 13:10:48.988968 30068 leader_election.cc:304] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:48.996800 30068 leader_election.cc:304] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:10:48.830943 32085 consensus_meta.cc:287] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent flushing consensus metadata: real 0.735s	user 0.015s	sys 0.000s
W20260709 13:10:48.861841 30733 consensus_meta.cc:287] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent flushing consensus metadata: real 0.840s	user 0.005s	sys 0.006s
W20260709 13:10:48.909303 30019 consensus_meta.cc:287] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4: Time spent flushing consensus metadata: real 0.847s	user 0.005s	sys 0.004s
W20260709 13:10:48.987119 32241 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.932s	user 0.002s	sys 0.018s
I20260709 13:10:48.627163 32245 raft_consensus.cc:2804] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:10:48.613667 32143 consensus_meta.cc:287] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4: Time spent flushing consensus metadata: real 0.720s	user 0.010s	sys 0.000s
W20260709 13:10:48.900964 32293 log.cc:927] Time spent T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 13:10:48.908365 32236 consensus_meta.cc:287] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719: Time spent flushing consensus metadata: real 1.196s	user 0.011s	sys 0.000s
W20260709 13:10:48.717549 32235 log.cc:927] Time spent T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:10:49.003979 32288 raft_consensus.cc:493] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:49.000559 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
W20260709 13:10:48.816762 32238 consensus_meta.cc:287] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4: Time spent flushing consensus metadata: real 0.927s	user 0.010s	sys 0.000s
I20260709 13:10:48.715870 32272 consensus_queue.cc:1059] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.286s
I20260709 13:10:48.832005 32161 leader_election.cc:290] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:48.951318 32278 raft_consensus.cc:493] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:49.002491 32237 leader_election.cc:290] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:49.002710 32134 raft_consensus.cc:493] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:49.000926 32228 raft_consensus.cc:2749] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:48.923243 32269 raft_consensus.cc:515] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:49.004007 32249 raft_consensus.cc:3055] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:49.004428 30100 raft_consensus.cc:1275] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 13:10:48.906972 32226 consensus_meta.cc:287] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent flushing consensus metadata: real 1.018s	user 0.012s	sys 0.000s
I20260709 13:10:48.601573 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:49.006155 30702 leader_election.cc:304] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:48.632995 32261 raft_consensus.cc:2749] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:48.737546 32108 raft_consensus.cc:2804] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:48.943827 32204 raft_consensus.cc:2749] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:48.948904 32002 raft_consensus.cc:2749] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:48.627413 32214 raft_consensus.cc:2749] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451) with higher term. Message: Invalid argument: T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 2. Current term is 3.
I20260709 13:10:48.740221 32075 raft_consensus.cc:2749] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001) with higher term. Message: Invalid argument: T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 4. Current term is 5.
I20260709 13:10:48.736219 32046 leader_election.cc:290] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 3 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:48.800946 32088 leader_election.cc:290] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:48.843700 32222 raft_consensus.cc:493] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.950322 32289 raft_consensus.cc:493] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:48.900544 32276 raft_consensus.cc:493] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:49.068315 30173 raft_consensus.cc:1275] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:10:49.068791 30173 pending_rounds.cc:85] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124: Aborting all ops after (but not including) 5
I20260709 13:10:48.720458 31954 raft_consensus.cc:515] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:49.011315 30098 raft_consensus.cc:1240] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:48.999109 32286 raft_consensus.cc:2749] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:49.015451 30026 raft_consensus.cc:1275] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 13:10:48.719165 32136 consensus_meta.cc:287] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent flushing consensus metadata: real 0.916s	user 0.009s	sys 0.000s
I20260709 13:10:48.607133 32102 consensus_queue.cc:1048] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.399s
W20260709 13:10:49.080647 30140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.006843 30019 raft_consensus.cc:2468] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 3.
I20260709 13:10:49.081964 30019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54198 (request call id 1704) took 1266 ms. Trace:
I20260709 13:10:49.082298 30019 rpcz_store.cc:276] 0709 13:10:47.815468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.826382 (+ 10914us) service_pool.cc:224] Handling call
0709 13:10:49.081902 (+1255520us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:49.084239 30730 raft_consensus.cc:2410] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:49.085394 30730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51014 (request call id 698) took 1266 ms. Trace:
I20260709 13:10:49.085829 32276 raft_consensus.cc:515] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:49.019366 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 253441us
I20260709 13:10:49.087976 32276 leader_election.cc:290] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:48.931730 32012 raft_consensus.cc:515] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:49.006453 32280 raft_consensus.cc:3055] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:49.021075 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:48.916554 32131 raft_consensus.cc:515] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:49.022511 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:48.863341 32281 raft_consensus.cc:515] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:49.006999 30733 raft_consensus.cc:2468] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 6.
I20260709 13:10:48.936606 32021 raft_consensus.cc:515] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:48.629812 31816 raft_consensus.cc:515] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:49.035967 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:49.105173 30099 raft_consensus.cc:3060] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:49.106451 31816 leader_election.cc:290] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:49.107715 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:49.108330 30094 raft_consensus.cc:2468] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 4.
I20260709 13:10:49.009055 32245 raft_consensus.cc:697] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 3 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:49.019120 32246 raft_consensus.cc:493] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:48.999239 32192 raft_consensus.cc:515] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:49.001303 32270 raft_consensus.cc:515] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:49.110628 30728 raft_consensus.cc:2368] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 3. Current term is 4.
I20260709 13:10:49.110280 32245 consensus_queue.cc:237] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:49.031663 32241 raft_consensus.cc:3055] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:49.045300 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:49.111555 32241 raft_consensus.cc:740] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:49.036636 32249 raft_consensus.cc:740] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:49.113174 32249 consensus_queue.cc:260] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:49.114261 32211 raft_consensus.cc:493] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:49.114451 32249 raft_consensus.cc:3060] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:49.114826 32211 raft_consensus.cc:515] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:49.092633 32280 raft_consensus.cc:740] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:49.116734 32211 leader_election.cc:290] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:49.035068 32161 raft_consensus.cc:493] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:49.044385 32108 raft_consensus.cc:493] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.117245 32280 consensus_queue.cc:260] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:49.117946 32108 raft_consensus.cc:3060] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:49.118211 30733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51014 (request call id 699) took 1299 ms. Trace:
I20260709 13:10:49.110648 32246 raft_consensus.cc:515] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:49.120400 32246 leader_election.cc:290] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:49.120796 30026 raft_consensus.cc:1275] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:49.049841 32269 leader_election.cc:290] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:49.047398 32180 leader_election.cc:290] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:49.036266 32134 raft_consensus.cc:515] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:49.122977 32273 raft_consensus.cc:3055] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:49.123409 32134 leader_election.cc:290] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:49.051105 32299 raft_consensus.cc:493] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:49.124172 32299 raft_consensus.cc:515] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:49.117455 32161 raft_consensus.cc:515] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:49.125361 32223 leader_election.cc:290] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 2 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:49.085737 30730 rpcz_store.cc:276] 0709 13:10:47.818798 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.827486 (+  8688us) service_pool.cc:224] Handling call
0709 13:10:49.085204 (+1257718us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54002995d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:10:49.085337 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2744001408}
I20260709 13:10:49.126421 32299 leader_election.cc:290] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:49.053277 30022 raft_consensus.cc:2468] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 5.
W20260709 13:10:49.057093 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 43890.9us
I20260709 13:10:49.017963 32236 raft_consensus.cc:515] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:49.126645 32161 leader_election.cc:290] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:49.126751 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:49.112526 30176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43840 (request call id 1608) took 1195 ms. Trace:
I20260709 13:10:49.133033 30099 raft_consensus.cc:2468] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 6.
I20260709 13:10:49.065222 30171 raft_consensus.cc:1275] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:49.052531 32085 raft_consensus.cc:2804] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:49.066265 30095 raft_consensus.cc:1240] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:49.066430 31851 raft_consensus.cc:493] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.067039 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:49.001085 32283 raft_consensus.cc:2804] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:49.068395 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:48.675062 30168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43838 (request call id 1690) took 1030 ms. Trace:
I20260709 13:10:49.069074 30173 pending_rounds.cc:107] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:10:49.073223 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:49.147928 30173 raft_consensus.cc:2889] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:49.067729 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:49.079201 31954 leader_election.cc:290] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:49.088625 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:49.091996 30096 raft_consensus.cc:2468] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 3.
I20260709 13:10:49.093020 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:49.093149 30102 raft_consensus.cc:2468] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 3.
I20260709 13:10:49.021291 32288 raft_consensus.cc:515] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:49.104148 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:49.104396 32131 leader_election.cc:290] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:49.109338 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:49.118597 30733 rpcz_store.cc:276] 0709 13:10:47.819078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.826300 (+  7222us) service_pool.cc:224] Handling call
0709 13:10:49.118149 (+1291849us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:49.032436 32278 raft_consensus.cc:515] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:49.135030 30171 raft_consensus.cc:1275] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:49.128551 30176 rpcz_store.cc:276] 0709 13:10:47.917089 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.917219 (+   130us) service_pool.cc:224] Handling call
0709 13:10:49.112369 (+1195150us) spinlock_profiling.cc:243] Waited 578 ms on lock 0x7b5400406fd4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:10:49.112473 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1330324224}
I20260709 13:10:49.208588 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:49.139035 30103 raft_consensus.cc:2468] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 4.
I20260709 13:10:49.209597 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:49.073232 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:49.091533 32276 raft_consensus.cc:493] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.034680 32290 consensus_queue.cc:1048] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.070s
I20260709 13:10:49.216893 32236 leader_election.cc:290] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:49.149542 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:49.185639 30101 raft_consensus.cc:2468] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 4.
I20260709 13:10:49.120291 32281 leader_election.cc:290] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:49.112356 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:49.152884 30734 raft_consensus.cc:2393] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 4: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:10:49.223218 29994 leader_election.cc:304] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:49.190428 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:49.068197 32222 raft_consensus.cc:515] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:49.141992 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:49.123327 32273 raft_consensus.cc:740] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:49.110204 32204 raft_consensus.cc:493] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:49.203540 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:49.233922 30174 raft_consensus.cc:3060] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:49.209645 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:49.234668 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:49.235373 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:49.137362 30142 leader_election.cc:400] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469) with higher term. Message: Invalid argument: T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 3. Current term is 4.
I20260709 13:10:49.236029 30142 leader_election.cc:403] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:49.135339 32214 raft_consensus.cc:493] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.236485 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:49.236728 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:49.237200 30025 raft_consensus.cc:2393] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 6: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:49.125356 32021 leader_election.cc:290] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:49.211309 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:49.211443 30068 leader_election.cc:304] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:49.114256 32012 leader_election.cc:290] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:49.112561 32192 leader_election.cc:290] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:49.215992 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:49.223158 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:49.152385 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:49.185631 32085 raft_consensus.cc:697] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:49.195295 32283 raft_consensus.cc:697] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 4 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:49.198207 32299 raft_consensus.cc:493] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:49.194310 30732 raft_consensus.cc:2468] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 4.
I20260709 13:10:49.166311 30066 leader_election.cc:304] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:49.185736 32294 consensus_queue.cc:1048] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.076s
I20260709 13:10:49.214112 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:49.150432 32225 consensus_queue.cc:1059] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
I20260709 13:10:49.149923 31851 raft_consensus.cc:515] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:49.194998 32180 consensus_queue.cc:1048] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 13:10:49.391155 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:49.237473 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:10:49.364296 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 152926us
I20260709 13:10:49.365049 30736 raft_consensus.cc:2393] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 6: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:49.339171 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:49.237665 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:49.278198 30176 raft_consensus.cc:2393] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 6: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:10:49.366925 32214 raft_consensus.cc:515] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:49.395980 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:49.366966 32085 consensus_queue.cc:237] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:49.296029 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:49.369172 32299 raft_consensus.cc:515] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:49.397154 30101 raft_consensus.cc:2393] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 3: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:10:49.226240 32276 raft_consensus.cc:515] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:49.217514 32245 raft_consensus.cc:493] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:49.112430 32241 consensus_queue.cc:260] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:49.355803 30172 raft_consensus.cc:2468] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 5.
W20260709 13:10:49.371423 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 205199us
I20260709 13:10:49.370632 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:49.237432 30023 raft_consensus.cc:2393] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 3: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
W20260709 13:10:49.236495 30142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 108000us
I20260709 13:10:49.297057 32234 raft_consensus.cc:493] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.386984 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:49.412920 30098 raft_consensus.cc:2393] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 5: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
W20260709 13:10:49.296685 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 66467.6us
I20260709 13:10:49.238898 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:49.234347 30094 raft_consensus.cc:2368] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 5. Current term is 6.
I20260709 13:10:49.393509 30096 raft_consensus.cc:2468] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 4.
I20260709 13:10:49.414897 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:49.415859 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:49.416254 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:49.416867 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
W20260709 13:10:49.339109 32253 log.cc:927] Time spent T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:10:49.224975 30730 raft_consensus.cc:2393] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 3: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:10:49.400673 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:49.417902 30171 raft_consensus.cc:2468] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 6.
I20260709 13:10:49.188815 30168 rpcz_store.cc:276] 0709 13:10:47.644416 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.647835 (+  3419us) service_pool.cc:224] Handling call
0709 13:10:47.718450 (+ 70615us) spinlock_profiling.cc:243] Waited 1.03 ms on lock 0x7b5800003c98. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eef95b71 00007f99eef95a22 00007f99f7eaec09 00007f99f7008ee0 00007f99f70d20ab 00007f99f70d2131 00007f99f70800a0 00007f99f707f984 00007f99f05fa6d4 00007f99f05fa662
0709 13:10:48.627806 (+909356us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2377472}
I20260709 13:10:49.098677 32289 raft_consensus.cc:515] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:49.297618 32134 raft_consensus.cc:3060] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:10:49.341853 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:49.403693 30068 leader_election.cc:304] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:49.405778 30703 leader_election.cc:304] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:49.388406 32281 raft_consensus.cc:2749] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:49.296300 31789 raft_consensus.cc:2804] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:49.382398 30174 raft_consensus.cc:2468] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 3.
I20260709 13:10:49.427289 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:49.442823 30732 raft_consensus.cc:3060] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:49.339107 32075 raft_consensus.cc:493] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.443794 30068 leader_election.cc:304] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:49.444132 32075 raft_consensus.cc:515] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:49.409850 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:49.445106 30068 leader_election.cc:304] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:49.445575 30025 raft_consensus.cc:3060] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:49.388000 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:49.410517 30176 raft_consensus.cc:2468] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 6.
I20260709 13:10:49.392096 32236 raft_consensus.cc:2804] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:49.419003 30028 raft_consensus.cc:2393] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 5: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:49.395527 32136 raft_consensus.cc:493] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.413728 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:49.396036 32023 raft_consensus.cc:493] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:49.421542 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:49.477463 30096 raft_consensus.cc:2393] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 5: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:10:49.401584 32025 raft_consensus.cc:493] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.424345 29993 leader_election.cc:304] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:49.426561 30171 raft_consensus.cc:1275] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:10:49.401443 32269 raft_consensus.cc:493] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:49.479385 32269 raft_consensus.cc:515] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:10:49.479400 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 55123.7us
I20260709 13:10:49.297210 32204 raft_consensus.cc:515] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:49.481348 32269 leader_election.cc:290] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:49.404526 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:49.434664 30703 leader_election.cc:304] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:49.482183 30169 raft_consensus.cc:2393] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 3: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
W20260709 13:10:49.482406 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 47814.5us
I20260709 13:10:49.482821 32204 leader_election.cc:290] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:49.483084 30703 leader_election.cc:304] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:49.448388 30068 leader_election.cc:304] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:49.484086 30703 leader_election.cc:304] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:49.450999 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:49.484714 32246 raft_consensus.cc:2804] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:49.485110 32246 raft_consensus.cc:493] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:49.485455 32246 raft_consensus.cc:3060] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:49.488404 32247 raft_consensus.cc:2804] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:49.488782 32247 raft_consensus.cc:493] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:49.489141 32247 raft_consensus.cc:3060] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:49.441995 32285 raft_consensus.cc:493] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:49.490007 32285 raft_consensus.cc:515] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:49.480806 32023 raft_consensus.cc:515] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:49.489696 29993 leader_election.cc:304] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:49.495260 31790 raft_consensus.cc:2804] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:49.495755 31790 raft_consensus.cc:697] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:49.496203 32023 leader_election.cc:290] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:49.496589 31790 consensus_queue.cc:237] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:49.498905 30095 raft_consensus.cc:1240] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:49.500159 30095 raft_consensus.cc:1240] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:49.500437 32258 raft_consensus.cc:3055] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:49.500877 32258 raft_consensus.cc:740] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:49.501362 30095 raft_consensus.cc:1240] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 3 LEADER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:49.484036 32271 raft_consensus.cc:2749] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:49.502421 32226 consensus_queue.cc:1059] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:49.502704 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:49.446976 30101 raft_consensus.cc:2468] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 3.
I20260709 13:10:49.503386 32226 raft_consensus.cc:3055] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:49.492010 32285 leader_election.cc:290] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:49.503779 32226 raft_consensus.cc:740] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:49.443017 32306 raft_consensus.cc:493] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:49.427304 32290 raft_consensus.cc:493] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.407333 32245 raft_consensus.cc:515] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:49.446079 32272 raft_consensus.cc:2749] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:49.505043 32290 raft_consensus.cc:515] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:49.470566 30022 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54198 (request call id 1701) took 1660 ms (client timeout 1512 ms). Trace:
W20260709 13:10:49.505908 30022 rpcz_store.cc:269] 0709 13:10:47.810534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.811312 (+   778us) service_pool.cc:224] Handling call
0709 13:10:49.456367 (+1645055us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b54001a95d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:10:49.470269 (+ 13902us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2688275200}
I20260709 13:10:49.506582 32245 leader_election.cc:290] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:49.506837 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:49.478546 32025 raft_consensus.cc:515] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:49.431821 30066 leader_election.cc:304] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
W20260709 13:10:49.456529 32308 log.cc:927] Time spent T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:10:49.507092 32290 leader_election.cc:290] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:49.442190 31789 raft_consensus.cc:493] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.508888 30102 raft_consensus.cc:1240] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:10:49.454851 30098 raft_consensus.cc:2468] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 3.
I20260709 13:10:49.509234 31789 raft_consensus.cc:3060] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:49.510217 30098 raft_consensus.cc:1275] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:49.511610 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:49.504567 32226 consensus_queue.cc:260] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:49.511617 30096 raft_consensus.cc:1240] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:49.504547 32306 raft_consensus.cc:515] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:49.512778 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:49.508677 32025 leader_election.cc:290] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:49.479686 32267 raft_consensus.cc:2804] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:49.513888 30172 raft_consensus.cc:2468] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 4.
I20260709 13:10:49.514187 32267 raft_consensus.cc:697] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:49.515272 29993 leader_election.cc:304] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:49.515061 32267 consensus_queue.cc:237] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:49.515671 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:49.516062 32290 raft_consensus.cc:2804] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:49.516462 32290 raft_consensus.cc:493] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.516796 32290 raft_consensus.cc:3060] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:49.501715 32258 consensus_queue.cc:260] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:49.518194 32306 leader_election.cc:290] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:49.518338 32258 raft_consensus.cc:3060] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:49.521718 32246 raft_consensus.cc:515] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:49.512816 32226 raft_consensus.cc:3060] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:49.524552 32290 raft_consensus.cc:515] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:49.507170 30095 raft_consensus.cc:1275] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:49.528659 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:49.529799 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:49.531762 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:49.532328 30171 raft_consensus.cc:3060] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:10:49.520059 31789 raft_consensus.cc:515] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:49.534346 31789 leader_election.cc:290] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:49.527667 32290 leader_election.cc:290] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:49.535830 30095 raft_consensus.cc:1240] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:49.537148 30095 raft_consensus.cc:1240] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:49.538861 30022 raft_consensus.cc:2368] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 5. Current term is 6.
I20260709 13:10:49.512840 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:49.541960 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:49.542903 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:49.542995 32246 leader_election.cc:290] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:49.480309 30143 leader_election.cc:304] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:49.541616 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:49.545540 30734 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9"
dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
mode: GRACEFUL
new_leader_uuid: "5ec73dc157ed476ca903a7d596271719"
 from {username='slave'} at 127.0.0.1:55634
I20260709 13:10:49.546072 30734 raft_consensus.cc:606] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEADER]: Received request to transfer leadership to TS 5ec73dc157ed476ca903a7d596271719
W20260709 13:10:49.548146 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 67922.5us
I20260709 13:10:49.548832 30143 leader_election.cc:304] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:49.549515 32192 raft_consensus.cc:2749] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:49.549952 30143 leader_election.cc:304] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:49.550892 32192 raft_consensus.cc:2749] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:49.551232 30143 leader_election.cc:304] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:49.548847 32306 raft_consensus.cc:2804] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:49.552175 32306 raft_consensus.cc:493] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.553153 32306 raft_consensus.cc:3060] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:49.552680 32192 raft_consensus.cc:2749] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:49.553733 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:49.558048 30021 raft_consensus.cc:1240] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:49.552258 30737 raft_consensus.cc:1240] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:10:49.560393 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:49.560930 30173 raft_consensus.cc:3060] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:49.561317 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:49.564512 32226 consensus_queue.cc:1059] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:49.567955 30735 raft_consensus.cc:1240] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:49.424949 32234 raft_consensus.cc:515] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:49.589553 32284 raft_consensus.cc:493] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.570752 29993 leader_election.cc:304] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:49.572160 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:49.574685 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:49.644142 30172 raft_consensus.cc:2468] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 3.
I20260709 13:10:49.575445 31816 consensus_queue.cc:1048] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:49.576243 30142 leader_election.cc:304] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:49.436693 32211 raft_consensus.cc:493] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:49.422102 32131 consensus_queue.cc:1048] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 13:10:49.448150 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
W20260709 13:10:49.584372 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 136053us
I20260709 13:10:49.471890 32136 raft_consensus.cc:515] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:49.450947 32002 raft_consensus.cc:3060] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:49.586719 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:49.588584 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:49.583793 32101 consensus_queue.cc:1059] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 13:10:49.588958 32269 raft_consensus.cc:2749] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:49.589144 32277 raft_consensus.cc:493] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:49.589936 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 158196us
I20260709 13:10:49.590395 32274 raft_consensus.cc:2749] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:49.453423 32281 raft_consensus.cc:2804] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:10:49.594215 32302 log.cc:927] Time spent T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.192s	user 0.000s	sys 0.000s
I20260709 13:10:49.594730 32270 leader_election.cc:290] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:49.595175 32222 leader_election.cc:290] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:10:49.596609 32310 log.cc:927] Time spent T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 13:10:49.597285 32288 leader_election.cc:290] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:49.597915 32180 raft_consensus.cc:493] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:49.598515 32276 leader_election.cc:290] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:10:49.598910 32305 log.cc:927] Time spent T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.402s	user 0.000s	sys 0.001s
I20260709 13:10:49.446368 32225 consensus_queue.cc:1059] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.136s
I20260709 13:10:49.599320 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:49.600955 30025 raft_consensus.cc:2468] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 5.
I20260709 13:10:49.603992 30140 leader_election.cc:400] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Vote denied by peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451) with higher term. Message: Invalid argument: T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 5. Current term is 6.
I20260709 13:10:49.688953 30140 leader_election.cc:403] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:10:49.689373 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 85564.8us
W20260709 13:10:49.689800 30140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.600174 32108 raft_consensus.cc:515] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:49.568234 30173 raft_consensus.cc:2468] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 6.
I20260709 13:10:49.629557 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:49.588079 30171 raft_consensus.cc:2468] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 6.
I20260709 13:10:49.569324 32102 raft_consensus.cc:3055] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:49.681017 32238 raft_consensus.cc:2804] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:10:49.641227 30067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.600097 32075 leader_election.cc:290] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:49.582437 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
W20260709 13:10:49.646999 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 76329.7us
I20260709 13:10:49.703327 29993 leader_election.cc:304] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
W20260709 13:10:49.704005 32282 log.cc:927] Time spent T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
I20260709 13:10:49.704232 29993 leader_election.cc:304] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:49.646184 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:49.646059 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:49.708756 32226 raft_consensus.cc:2804] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:49.709267 32226 raft_consensus.cc:697] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:49.710136 32226 consensus_queue.cc:237] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:49.711336 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:49.711902 31816 raft_consensus.cc:2804] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:49.712306 32299 leader_election.cc:290] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:49.712435 31816 raft_consensus.cc:697] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:49.712648 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:49.713264 30177 raft_consensus.cc:2468] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 5.
I20260709 13:10:49.713368 31816 consensus_queue.cc:237] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:49.714998 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:49.712438 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:49.648804 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:49.650199 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:49.740429 30103 raft_consensus.cc:2368] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 3. Current term is 4.
I20260709 13:10:49.411110 32273 consensus_queue.cc:260] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:49.589883 32291 raft_consensus.cc:2749] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:10:49.653206 30142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 77014us
W20260709 13:10:49.654084 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 245027us
I20260709 13:10:49.744645 30142 leader_election.cc:304] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:49.655571 30737 raft_consensus.cc:1275] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:49.427134 31729 consensus_queue.cc:1048] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260709 13:10:49.696775 32222 raft_consensus.cc:2749] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451) with higher term. Message: Invalid argument: T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 5. Current term is 6.
I20260709 13:10:49.661245 30066 leader_election.cc:304] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
W20260709 13:10:49.775104 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 113946us
I20260709 13:10:49.659482 30703 leader_election.cc:304] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:49.668476 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:49.657208 32161 raft_consensus.cc:3060] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:49.671321 32281 raft_consensus.cc:493] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:49.470757 32283 consensus_queue.cc:237] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:49.647166 32284 raft_consensus.cc:515] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:49.674237 32278 leader_election.cc:290] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:10:49.640847 32223 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.007s	sys 0.007s
I20260709 13:10:49.656725 32211 raft_consensus.cc:515] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:49.718075 30171 raft_consensus.cc:2468] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 5.
I20260709 13:10:49.671977 32277 raft_consensus.cc:515] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:49.719717 29994 leader_election.cc:304] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:49.736075 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:49.740226 29993 leader_election.cc:304] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:49.582122 32236 raft_consensus.cc:697] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 3 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:49.740655 30101 raft_consensus.cc:2468] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 5.
I20260709 13:10:49.691062 31851 leader_election.cc:290] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:10:49.748767 30702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.657792 30143 leader_election.cc:304] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:49.772840 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:49.697134 32102 raft_consensus.cc:740] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:49.777607 32214 leader_election.cc:290] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:49.833956 32269 raft_consensus.cc:2749] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:49.834721 32136 leader_election.cc:290] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:49.834960 30102 raft_consensus.cc:1240] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:49.702970 32134 raft_consensus.cc:2749] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469) with higher term. Message: Invalid argument: T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 3. Current term is 4.
I20260709 13:10:49.836476 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:49.837966 32289 leader_election.cc:290] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:49.742331 30019 raft_consensus.cc:1240] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:49.861325 30733 raft_consensus.cc:1240] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:49.856871 30022 raft_consensus.cc:2393] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 6: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:49.862754 30733 raft_consensus.cc:1275] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:10:49.685690 32180 raft_consensus.cc:515] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:10:49.855883 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 198185us
I20260709 13:10:49.864184 30143 leader_election.cc:304] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:49.864966 32180 leader_election.cc:290] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:49.833863 32192 raft_consensus.cc:493] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:49.743108 32302 log.cc:927] Time spent T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:10:49.865443 32315 raft_consensus.cc:2804] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:49.865932 32315 raft_consensus.cc:493] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:49.866339 32315 raft_consensus.cc:3060] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:49.866082 32192 raft_consensus.cc:515] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:49.853947 32317 raft_consensus.cc:493] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:49.854202 30729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51014 (request call id 708) took 1953 ms. Trace:
I20260709 13:10:49.854592 32273 raft_consensus.cc:3060] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:49.854321 32102 consensus_queue.cc:260] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:49.777364 32085 consensus_queue.cc:1048] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:10:49.855264 32314 raft_consensus.cc:2749] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:49.855613 32236 consensus_queue.cc:237] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:49.856038 32108 leader_election.cc:290] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:49.839661 32299 raft_consensus.cc:2749] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:49.856446 32204 raft_consensus.cc:493] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:49.778363 30173 raft_consensus.cc:1240] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 2. Current term is 3. Ops: []
W20260709 13:10:49.831723 32292 log.cc:927] Time spent T 00000000000000000000000000000000 P 1c91346f9a2a480e908d4e0323634aeb: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
W20260709 13:10:49.857173 30702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:49.858175 32020 raft_consensus.cc:2749] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:10:49.858754 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 118604us
I20260709 13:10:49.911098 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:49.911736 30173 raft_consensus.cc:2468] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 5.
I20260709 13:10:49.860348 32234 leader_election.cc:290] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:49.914036 30702 leader_election.cc:304] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:49.739485 32288 raft_consensus.cc:493] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:49.859531 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:49.913349 32102 raft_consensus.cc:3060] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:49.920817 30730 raft_consensus.cc:2468] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 3.
I20260709 13:10:49.778543 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:49.934713 30177 raft_consensus.cc:2468] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 5.
W20260709 13:10:49.814860 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 119022us
W20260709 13:10:49.880421 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 103806us
W20260709 13:10:49.876544 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 217300us
I20260709 13:10:49.886324 30176 raft_consensus.cc:2468] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 4.
I20260709 13:10:49.881611 32136 raft_consensus.cc:2749] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:49.837615 32306 raft_consensus.cc:515] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:49.699972 32247 raft_consensus.cc:515] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:49.910557 29993 leader_election.cc:304] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:49.890786 32289 consensus_queue.cc:1048] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.018s
I20260709 13:10:49.927755 32277 leader_election.cc:290] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:10:49.928776 32223 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.802s	user 0.008s	sys 0.011s
I20260709 13:10:49.929103 30095 raft_consensus.cc:3060] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:49.928541 32288 raft_consensus.cc:515] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:49.929852 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 210211us
I20260709 13:10:49.908579 32204 raft_consensus.cc:515] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:49.930397 32281 raft_consensus.cc:3060] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:49.942528 30066 leader_election.cc:304] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
W20260709 13:10:49.866379 32311 log.cc:927] Time spent T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.424s	user 0.002s	sys 0.000s
I20260709 13:10:49.951126 29993 leader_election.cc:304] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:49.947260 32020 raft_consensus.cc:2749] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:10:49.966542 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 52586.8us
I20260709 13:10:49.982149 30028 raft_consensus.cc:1240] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:49.969409 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:49.969635 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:49.972015 30068 leader_election.cc:304] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:49.983803 30173 raft_consensus.cc:2468] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 5.
I20260709 13:10:49.984033 30100 raft_consensus.cc:2376] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 4. Re-sending same reply.
I20260709 13:10:49.985235 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:49.987248 30702 leader_election.cc:304] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:49.988687 30702 leader_election.cc:304] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
W20260709 13:10:49.991515 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 49069.2us
I20260709 13:10:49.897964 32317 raft_consensus.cc:515] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:49.963033 31816 raft_consensus.cc:2749] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:49.997687 30702 leader_election.cc:304] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:49.999632 30068 leader_election.cc:304] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:50.000689 30100 raft_consensus.cc:2468] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 2.
I20260709 13:10:49.966940 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:50.002223 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:49.985512 31729 raft_consensus.cc:2804] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:49.978315 32131 raft_consensus.cc:2804] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:50.008356 30068 leader_election.cc:304] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:50.014972 30143 leader_election.cc:304] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:50.018360 30068 leader_election.cc:304] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:50.006719 32269 raft_consensus.cc:2804] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:10:50.006951 32234 raft_consensus.cc:2749] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:50.011958 31729 raft_consensus.cc:493] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.021368 32131 raft_consensus.cc:493] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.079281 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:50.090622 30736 raft_consensus.cc:2393] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 4: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:10:50.006108 32274 raft_consensus.cc:2804] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:10:50.083797 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 80741.9us
I20260709 13:10:50.092203 32226 consensus_queue.cc:1048] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:50.094555 32204 leader_election.cc:290] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:50.095206 30103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33992 (request call id 1539) took 1002 ms. Trace:
I20260709 13:10:50.095580 30103 rpcz_store.cc:276] 0709 13:10:49.092849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.209393 (+116544us) service_pool.cc:224] Handling call
0709 13:10:50.095029 (+885636us) spinlock_profiling.cc:243] Waited 530 ms on lock 0x7b54004010d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:10:50.095150 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1219065088}
I20260709 13:10:50.096611 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:50.025897 32314 raft_consensus.cc:2804] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:50.022239 32246 raft_consensus.cc:2804] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:50.018234 32245 raft_consensus.cc:2749] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:50.022399 32012 raft_consensus.cc:2804] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:50.022858 32085 raft_consensus.cc:2804] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:50.085217 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:50.077895 30173 raft_consensus.cc:1240] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:10:50.096726 32131 raft_consensus.cc:3060] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:50.101387 32290 raft_consensus.cc:493] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.013199 32270 consensus_queue.cc:1048] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.076s
I20260709 13:10:50.077098 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:50.022607 32306 leader_election.cc:290] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:50.116406 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:50.011674 32316 consensus_queue.cc:1059] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.096s
I20260709 13:10:50.074836 31954 raft_consensus.cc:2749] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:50.089697 31729 raft_consensus.cc:3060] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:50.099720 31789 consensus_queue.cc:1059] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 13:10:50.124471 32290 raft_consensus.cc:515] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:50.124938 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:50.129438 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
W20260709 13:10:50.131212 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 153012us
I20260709 13:10:50.114550 32085 raft_consensus.cc:493] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.143036 30103 raft_consensus.cc:2368] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 5. Current term is 6.
I20260709 13:10:50.114890 32012 raft_consensus.cc:493] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:50.113255 32314 raft_consensus.cc:697] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 4 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
W20260709 13:10:50.130276 30732 consensus_meta.cc:287] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent flushing consensus metadata: real 0.687s	user 0.007s	sys 0.003s
I20260709 13:10:50.121721 32002 raft_consensus.cc:2749] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:50.098609 32269 raft_consensus.cc:697] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 3 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:50.151055 32269 consensus_queue.cc:237] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:50.151506 32241 raft_consensus.cc:3060] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:50.152629 30096 raft_consensus.cc:3060] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:50.128069 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 102638us
I20260709 13:10:50.156208 30068 leader_election.cc:304] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:50.109915 32246 raft_consensus.cc:493] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.139171 30730 raft_consensus.cc:2393] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 4: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:10:50.164603 30143 leader_election.cc:400] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821) with higher term. Message: Invalid argument: T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 3. Current term is 4.
I20260709 13:10:50.165534 30143 leader_election.cc:304] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:50.144264 32085 raft_consensus.cc:3060] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:50.162276 30096 raft_consensus.cc:2468] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 6.
I20260709 13:10:50.145928 30703 leader_election.cc:304] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:50.147243 32012 raft_consensus.cc:3060] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:50.176599 30175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54540 (request call id 467) took 1083 ms. Trace:
I20260709 13:10:50.146906 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:50.177022 30175 rpcz_store.cc:276] 0709 13:10:49.092713 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.093515 (+   802us) service_pool.cc:224] Handling call
0709 13:10:49.110046 (+ 16531us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:49.149378 (+ 39332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:49.149407 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:49.194811 (+ 45404us) log.cc:844] Serialized 52 byte log entry
0709 13:10:49.402691 (+207880us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:49.425842 (+ 23151us) log.cc:844] Serialized 14 byte log entry
0709 13:10:49.433426 (+  7584us) log.cc:844] Serialized 14 byte log entry
0709 13:10:49.437223 (+  3797us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.522066 (+ 84843us) spinlock_profiling.cc:243] Waited 18.5 ms on lock 0x7b5400160b54. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:10:49.522112 (+    46us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:49.865721 (+343609us) spinlock_profiling.cc:243] Waited 3.39 ms on lock 0x7b4400022b4c. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eeef3c85 00007f99eeef46a2 00007f99f1c661db 00007f99f1c61aaf 00007f99f1c5586e 00007f99f1c54bb6 00007f99f1c547d8 00007f99f1c5e221 00007f99f1c5e1d9 00007f99f1c5e169
0709 13:10:50.176397 (+310676us) raft_consensus.cc:1685] finished
0709 13:10:50.176417 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:50.176542 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":120862,"prepare.queue_time_us":174587,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":67,"raft.queue_time_us":100937,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":38856,"spinlock_wait_cycles":50389120,"thread_start_us":185079,"threads_started":1,"wal-append.queue_time_us":228790}
I20260709 13:10:50.162588 32246 raft_consensus.cc:3060] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:50.154012 30732 raft_consensus.cc:2468] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 5.
I20260709 13:10:50.162395 32211 leader_election.cc:290] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:50.166515 32284 leader_election.cc:290] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:10:50.190977 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 98415.3us
I20260709 13:10:50.174492 32270 raft_consensus.cc:2804] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:10:50.192260 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 48062.5us
I20260709 13:10:50.195349 30098 raft_consensus.cc:1275] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:10:50.194788 29993 leader_election.cc:304] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:50.166582 32002 consensus_queue.cc:1059] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 13:10:50.185626 32134 raft_consensus.cc:2749] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:50.191572 32247 leader_election.cc:290] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:50.194572 32136 raft_consensus.cc:2749] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:50.194948 32274 raft_consensus.cc:697] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 5 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:50.201118 30097 raft_consensus.cc:2393] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 3: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:10:50.202037 32102 consensus_queue.cc:1059] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:10:49.891321 30729 rpcz_store.cc:276] 0709 13:10:47.900865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:47.948153 (+ 47288us) service_pool.cc:224] Handling call
0709 13:10:48.005334 (+ 57181us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:48.266471 (+261137us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:48.282860 (+ 16389us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:49.078783 (+795923us) spinlock_profiling.cc:243] Waited 1.76 ms on lock 0x7b2c00007878. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f09b3a11 00007f99f09c3372 00007f99f20f5a01 00007f99f20ba43a 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2
0709 13:10:49.079221 (+   438us) log.cc:844] Serialized 26 byte log entry
0709 13:10:49.195720 (+116499us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:49.640261 (+444541us) log.cc:844] Serialized 14 byte log entry
0709 13:10:49.640555 (+   294us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:49.641920 (+  1365us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:49.849224 (+207304us) raft_consensus.cc:1685] finished
0709 13:10:49.853974 (+  4750us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:49.854145 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5847,"prepare.queue_time_us":70690,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":181126,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":28461,"spinlock_wait_cycles":4050304,"thread_start_us":686283,"threads_started":3,"wal-append.queue_time_us":105105}
W20260709 13:10:50.203437 32333 log.cc:927] Time spent T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 13:10:50.199486 32277 raft_consensus.cc:2804] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:50.198482 32317 leader_election.cc:290] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451)
I20260709 13:10:50.211740 32101 consensus_queue.cc:1059] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:10:50.199129 32316 consensus_queue.cc:1059] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 13:10:50.212169 31789 raft_consensus.cc:493] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:50.241966 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:50.204725 32314 consensus_queue.cc:237] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:50.213590 32270 raft_consensus.cc:697] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 3 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:50.219311 32134 raft_consensus.cc:493] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.223402 32277 raft_consensus.cc:493] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.254522 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:50.255793 30175 raft_consensus.cc:2468] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 5.
I20260709 13:10:50.212204 32225 consensus_queue.cc:1048] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 13:10:50.258885 32134 raft_consensus.cc:515] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:50.261324 32134 leader_election.cc:290] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:50.258858 30175 raft_consensus.cc:1275] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:10:50.256246 32315 raft_consensus.cc:515] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:50.266182 32315 leader_election.cc:290] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:50.267395 30175 raft_consensus.cc:1240] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:50.269239 29993 leader_election.cc:304] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:50.272541 32085 raft_consensus.cc:515] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:50.273631 32301 raft_consensus.cc:2804] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:10:50.273904 32339 log.cc:927] Time spent T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:10:50.275017 32301 raft_consensus.cc:493] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.275380 32301 raft_consensus.cc:3060] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:50.286088 31790 consensus_queue.cc:1048] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:50.285964 32274 consensus_queue.cc:237] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:50.287917 31790 consensus_queue.cc:1059] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:50.288921 32020 raft_consensus.cc:3055] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:50.289283 32020 raft_consensus.cc:740] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:50.290050 32020 consensus_queue.cc:260] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:50.293262 32161 raft_consensus.cc:2749] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:50.293265 32085 leader_election.cc:290] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:50.301975 30735 raft_consensus.cc:2468] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 5.
W20260709 13:10:50.302062 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 93666.7us
I20260709 13:10:50.304770 30703 leader_election.cc:304] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:50.256827 32277 raft_consensus.cc:3060] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:50.313126 30175 raft_consensus.cc:1275] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:10:50.253271 31789 raft_consensus.cc:515] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:50.314731 32101 raft_consensus.cc:493] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.315311 32101 raft_consensus.cc:515] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:50.317117 32101 leader_election.cc:290] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:50.319236 32276 raft_consensus.cc:3055] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:50.319603 32276 raft_consensus.cc:740] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:50.320011 31789 leader_election.cc:290] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:50.298205 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:50.314718 32273 raft_consensus.cc:2804] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:50.278949 31729 raft_consensus.cc:515] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:50.342218 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:50.322368 32161 raft_consensus.cc:493] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:50.332270 32290 leader_election.cc:290] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:50.320340 32276 consensus_queue.cc:260] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:50.334052 30095 raft_consensus.cc:2468] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 6.
I20260709 13:10:50.321554 32281 raft_consensus.cc:515] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:50.340423 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:50.338435 32273 raft_consensus.cc:493] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:50.347548 32161 raft_consensus.cc:515] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:50.356798 32154 raft_consensus.cc:3055] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:50.357213 32154 raft_consensus.cc:740] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:50.357955 32161 leader_election.cc:290] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:50.360318 32246 raft_consensus.cc:515] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:50.366529 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:50.351004 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:50.367405 30730 raft_consensus.cc:2468] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 6.
I20260709 13:10:50.369127 30703 leader_election.cc:304] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:50.369772 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:50.362363 32273 raft_consensus.cc:3060] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:50.370389 30095 raft_consensus.cc:2468] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 5.
I20260709 13:10:50.372378 32281 leader_election.cc:290] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:50.358026 32154 consensus_queue.cc:260] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:50.373404 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:50.374183 32246 leader_election.cc:290] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:50.374347 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:50.375233 30095 raft_consensus.cc:2368] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 5. Current term is 6.
I20260709 13:10:50.375581 32276 raft_consensus.cc:3060] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:50.375952 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:50.376420 30143 leader_election.cc:400] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821) with higher term. Message: Invalid argument: T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 5. Current term is 6.
I20260709 13:10:50.376518 30020 raft_consensus.cc:2376] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 5. Re-sending same reply.
I20260709 13:10:50.374788 32246 raft_consensus.cc:2749] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:50.382084 30094 raft_consensus.cc:2393] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 7: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:10:50.384147 32273 raft_consensus.cc:515] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:50.341552 32270 consensus_queue.cc:237] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:50.387272 32273 leader_election.cc:290] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:50.367854 30728 raft_consensus.cc:2468] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 3.
W20260709 13:10:50.377125 30020 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54198 (request call id 1716) took 1143 ms (client timeout 1512 ms). Trace:
I20260709 13:10:50.401739 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:50.414767 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:50.401050 32131 raft_consensus.cc:515] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:50.424744 32323 log.cc:927] Time spent T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.863s	user 0.004s	sys 0.004s
W20260709 13:10:50.398466 30020 rpcz_store.cc:269] 0709 13:10:49.233348 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.278118 (+ 44770us) service_pool.cc:224] Handling call
0709 13:10:49.573501 (+295383us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b5800003698. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eef95b71 00007f99eef95a22 00007f99f7eaec09 00007f99f7008ee0 00007f99f70d20ab 00007f99f70d2131 00007f99f70800a0 00007f99f707f984 00007f99f05fa6d4 00007f99f05fa662
0709 13:10:50.375814 (+802313us) spinlock_profiling.cc:243] Waited 8.29 ms on lock 0x7b5800003698. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eef95e9c 00007f99eef95a5b 00007f99f7eaec09 00007f99f7008ee0 00007f99f70d20ab 00007f99f70d2131 00007f99f70800a0 00007f99f707f984 00007f99f05fa6d4 00007f99f05fa662
0709 13:10:50.377069 (+  1255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":23034368}
I20260709 13:10:50.446568 31729 leader_election.cc:290] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:50.449004 32301 raft_consensus.cc:515] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:50.459671 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:50.461216 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:50.463492 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:50.464047 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:50.465816 30143 leader_election.cc:400] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 election: Vote denied by peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821) with higher term. Message: Invalid argument: T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 5. Current term is 6.
I20260709 13:10:50.466126 32291 raft_consensus.cc:1064] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719: attempting to promote NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a to VOTER
I20260709 13:10:50.467878 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:50.468446 32291 consensus_queue.cc:237] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:50.471310 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:50.434597 30095 raft_consensus.cc:2468] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 3.
I20260709 13:10:50.484608 32131 leader_election.cc:290] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:50.486155 32020 raft_consensus.cc:3060] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:50.487339 32301 leader_election.cc:290] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:50.492614 32258 raft_consensus.cc:3055] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:50.493026 32258 raft_consensus.cc:740] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
W20260709 13:10:50.490736 32356 log.cc:927] Time spent T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 13:10:50.495029 32012 raft_consensus.cc:515] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:50.504516 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:50.505096 30103 raft_consensus.cc:3060] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:50.509159 29993 leader_election.cc:304] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:50.516597 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:50.517226 30177 raft_consensus.cc:3060] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:50.519543 30143 leader_election.cc:304] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:50.520813 30143 leader_election.cc:304] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:50.521938 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:50.523146 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:50.523689 30095 raft_consensus.cc:2468] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 6.
I20260709 13:10:50.524492 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:50.525787 31975 raft_consensus.cc:2804] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:50.526207 31975 raft_consensus.cc:493] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.526526 31975 raft_consensus.cc:3060] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:50.529201 30737 raft_consensus.cc:1240] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:50.529371 31816 consensus_queue.cc:1048] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:50.530676 32012 leader_election.cc:290] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:50.531313 30169 raft_consensus.cc:1275] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:10:50.536298 30143 leader_election.cc:304] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:50.538471 30177 raft_consensus.cc:2468] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 6.
I20260709 13:10:50.525493 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:50.542068 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:50.542356 30143 leader_election.cc:304] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:50.543965 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:50.546104 30173 raft_consensus.cc:2368] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for earlier term 5. Current term is 6.
I20260709 13:10:50.539559 32306 raft_consensus.cc:2804] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:50.548471 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:50.548882 30068 leader_election.cc:400] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Vote denied by peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001) with higher term. Message: Invalid argument: T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for earlier term 5. Current term is 6.
I20260709 13:10:50.549239 30100 raft_consensus.cc:2393] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 3: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:10:50.549558 30103 raft_consensus.cc:2468] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 4.
I20260709 13:10:50.550607 30103 raft_consensus.cc:1240] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 5 LEADER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:50.549196 30068 leader_election.cc:403] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:10:50.552330 30100 raft_consensus.cc:1240] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:50.557205 30103 raft_consensus.cc:1275] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:50.503536 32277 raft_consensus.cc:515] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:50.539722 32299 raft_consensus.cc:2749] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:50.558971 30703 leader_election.cc:304] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:10:50.493916 32258 consensus_queue.cc:260] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:50.545553 32012 raft_consensus.cc:493] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.546159 32222 raft_consensus.cc:2804] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:50.547987 32306 raft_consensus.cc:493] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.566910 29993 leader_election.cc:304] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:50.590948 32306 raft_consensus.cc:3060] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:50.593596 31729 raft_consensus.cc:2804] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:50.594250 31729 raft_consensus.cc:697] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:50.594996 32299 raft_consensus.cc:493] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:50.595134 31729 consensus_queue.cc:237] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:50.595515 32299 raft_consensus.cc:515] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:50.598063 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:50.598636 30172 raft_consensus.cc:3060] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:50.571604 31789 consensus_queue.cc:1048] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:50.560667 32290 consensus_queue.cc:1048] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:10:50.561400 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:50.606150 30169 raft_consensus.cc:3060] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:10:50.606379 30733 raft_consensus.cc:1240] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:10:50.606613 32143 consensus_queue.cc:1059] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:10:50.608261 32322 log.cc:927] Time spent T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 1.063s	user 0.007s	sys 0.004s
I20260709 13:10:50.609059 32241 raft_consensus.cc:3055] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:50.577952 32131 consensus_queue.cc:1059] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:50.609436 32241 raft_consensus.cc:740] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:50.568046 32246 consensus_queue.cc:1059] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 13:10:50.580870 30730 raft_consensus.cc:1240] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:50.582178 30175 raft_consensus.cc:1275] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:10:50.582417 32258 raft_consensus.cc:3060] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:50.564337 32286 raft_consensus.cc:3060] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:50.583052 30170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54540 (request call id 464) took 1519 ms. Trace:
I20260709 13:10:50.587765 32277 leader_election.cc:290] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:50.568931 32222 raft_consensus.cc:493] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:50.557789 32161 raft_consensus.cc:2804] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:50.568636 32273 raft_consensus.cc:2804] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:50.550172 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
W20260709 13:10:50.580140 30069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.597556 32299 leader_election.cc:290] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:50.626168 30172 raft_consensus.cc:2468] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 6.
I20260709 13:10:50.612531 30095 raft_consensus.cc:2393] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 5: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
W20260709 13:10:50.640556 30066 leader_election.cc:336] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Timed out: RequestConsensusVote RPC to 127.28.54.65:34451 timed out after 1.512s (SENT)
I20260709 13:10:50.644634 30066 leader_election.cc:304] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:50.645995 29993 leader_election.cc:304] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:50.647179 31789 consensus_queue.cc:1059] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:50.650234 30102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33990 (request call id 1723) took 1527 ms. Trace:
I20260709 13:10:50.582527 32012 raft_consensus.cc:515] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:50.650619 30102 rpcz_store.cc:276] 0709 13:10:49.122492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.517528 (+395036us) service_pool.cc:224] Handling call
0709 13:10:49.521789 (+  4261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:49.835364 (+313575us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:50.650008 (+814644us) spinlock_profiling.cc:243] Waited 313 ms on lock 0x7b54004015d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:10:50.650179 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":719842048}
I20260709 13:10:50.655333 30142 leader_election.cc:304] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:10:50.656068 30701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.634611 32246 consensus_queue.cc:1243] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer 5ec73dc157ed476ca903a7d596271719 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:10:50.639359 32222 raft_consensus.cc:3060] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:50.658349 30701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.626806 31975 raft_consensus.cc:515] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:50.642272 32161 raft_consensus.cc:493] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:50.667488 30019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52098 (request call id 383) took 1220 ms. Trace:
I20260709 13:10:50.667893 30019 rpcz_store.cc:276] 0709 13:10:49.447071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.530622 (+ 83551us) service_pool.cc:224] Handling call
0709 13:10:49.696596 (+165974us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:49.861167 (+164571us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:50.667268 (+806101us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b5400010750. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20b98ad 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:10:50.667429 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":370692992}
I20260709 13:10:50.668733 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:50.669708 32154 raft_consensus.cc:3060] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:50.669999 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:50.670595 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:50.670971 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:50.655021 32273 raft_consensus.cc:697] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:50.671838 32012 leader_election.cc:290] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:50.672415 32273 consensus_queue.cc:237] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:50.672823 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:50.673974 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:50.665834 32161 raft_consensus.cc:3060] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:50.675007 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:50.675405 32276 raft_consensus.cc:3055] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:50.675778 32276 raft_consensus.cc:740] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:50.674232 32143 raft_consensus.cc:493] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.676512 32143 raft_consensus.cc:515] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:50.677042 30731 raft_consensus.cc:1240] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:50.656068 32236 raft_consensus.cc:2749] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:50.678515 32143 leader_election.cc:290] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:50.676517 32276 consensus_queue.cc:260] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:50.671476 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:50.683419 30099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48558 (request call id 356) took 1659 ms. Trace:
I20260709 13:10:50.683775 30099 rpcz_store.cc:276] 0709 13:10:49.023762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.230848 (+207086us) service_pool.cc:224] Handling call
0709 13:10:50.683245 (+1452397us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b5400265f54. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:10:50.683361 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2701151104}
I20260709 13:10:50.633103 30170 rpcz_store.cc:276] 0709 13:10:49.063703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.064339 (+   636us) service_pool.cc:224] Handling call
0709 13:10:49.081349 (+ 17010us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:49.470246 (+388897us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:49.474536 (+  4290us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:49.579759 (+105223us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:49.588085 (+  8326us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:50.582824 (+994739us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b5400085f54. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:10:50.582869 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:50.582992 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":842870528}
I20260709 13:10:50.659606 32153 raft_consensus.cc:3055] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:50.685371 32153 raft_consensus.cc:740] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:50.686184 32153 consensus_queue.cc:260] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:50.687224 32192 leader_election.cc:290] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:50.684872 30098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33990 (request call id 1727) took 1561 ms. Trace:
I20260709 13:10:50.687738 30098 rpcz_store.cc:276] 0709 13:10:49.123429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.525372 (+401943us) service_pool.cc:224] Handling call
0709 13:10:49.525586 (+   214us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:50.196011 (+670425us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:50.684672 (+488661us) spinlock_profiling.cc:243] Waited 668 ms on lock 0x7b54002e3954. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:10:50.684819 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1535664384}
I20260709 13:10:50.689388 32276 raft_consensus.cc:3060] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:50.690341 31975 leader_election.cc:290] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:50.658073 31816 raft_consensus.cc:2804] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:50.691143 31816 raft_consensus.cc:697] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:50.691330 32225 raft_consensus.cc:3055] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:50.691679 32225 raft_consensus.cc:740] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:50.692094 31816 consensus_queue.cc:237] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:50.692451 32225 consensus_queue.cc:260] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:50.695791 30734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:55634 (request call id 0) took 1623 ms. Trace:
I20260709 13:10:50.699658 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:50.700369 30098 raft_consensus.cc:2393] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 5: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:10:50.658267 32241 consensus_queue.cc:260] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:50.701159 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 724062us
I20260709 13:10:50.671572 30736 raft_consensus.cc:2468] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 6.
I20260709 13:10:50.702306 30142 leader_election.cc:304] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:50.706874 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:50.696152 30734 rpcz_store.cc:276] 0709 13:10:49.071987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.545427 (+473440us) service_pool.cc:224] Handling call
0709 13:10:50.695430 (+1150003us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b5400187ca0. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f2037520 00007f99f20b4652 00007f99f708260a 00007f99f06087d4 00007f99f0608762 00007f99f0608691 00007f99f060860c 00007f99f06078c2 00007f99f03f548c 00007f99f03f48c6
0709 13:10:50.695702 (+   272us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":523074944}
I20260709 13:10:50.709149 32075 raft_consensus.cc:3055] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:50.713542 30175 raft_consensus.cc:2468] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 4.
I20260709 13:10:50.709903 32280 raft_consensus.cc:3060] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:50.721426 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:50.718211 32075 raft_consensus.cc:740] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:50.723595 32075 consensus_queue.cc:260] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:50.710527 32342 raft_consensus.cc:493] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:50.671597 31789 consensus_queue.cc:1059] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 13:10:50.728001 30098 raft_consensus.cc:1240] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:10:50.693559 32225 raft_consensus.cc:3060] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:50.715288 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:50.719657 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:50.731997 30734 raft_consensus.cc:3060] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:50.720063 30142 leader_election.cc:304] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:50.660512 32299 raft_consensus.cc:3060] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:50.711603 32241 raft_consensus.cc:3060] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:50.710837 30168 raft_consensus.cc:1275] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:50.700743 32153 raft_consensus.cc:3060] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:50.734735 30142 leader_election.cc:304] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:50.717811 32269 raft_consensus.cc:493] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:50.726821 32192 raft_consensus.cc:2749] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:50.730342 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:50.724776 30169 raft_consensus.cc:2468] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 7.
I20260709 13:10:50.746580 30142 leader_election.cc:304] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:50.748872 29993 leader_election.cc:304] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:50.735366 32315 raft_consensus.cc:2749] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:50.735538 32075 raft_consensus.cc:3060] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:50.732062 32085 consensus_queue.cc:1048] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 13:10:50.737299 32314 raft_consensus.cc:2749] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:50.729436 32342 raft_consensus.cc:515] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:50.761148 30734 raft_consensus.cc:2468] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 4.
I20260709 13:10:50.744619 30170 raft_consensus.cc:1275] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:50.742475 32283 raft_consensus.cc:493] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.735483 32101 consensus_queue.cc:1059] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
W20260709 13:10:50.793370 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 44562.6us
I20260709 13:10:50.797248 30140 leader_election.cc:304] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:50.798810 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:50.811393 30098 raft_consensus.cc:2468] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 5.
I20260709 13:10:50.800360 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:50.812394 30102 raft_consensus.cc:3060] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:50.802419 30700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.755270 31789 consensus_queue.cc:1243] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer 6f3eb161e2194f6891f12e2cfcaaf73a log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:10:50.762725 31975 raft_consensus.cc:493] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:50.743230 32269 raft_consensus.cc:515] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:50.797855 32315 raft_consensus.cc:3060] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:50.747756 32317 consensus_queue.cc:1059] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.087s
I20260709 13:10:50.908731 32317 raft_consensus.cc:3055] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:50.879401 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:50.801172 32350 raft_consensus.cc:2749] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:50.884194 30102 raft_consensus.cc:2468] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 6.
I20260709 13:10:50.887707 32222 raft_consensus.cc:515] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:50.894019 32131 raft_consensus.cc:493] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.896821 32306 raft_consensus.cc:515] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:50.879179 32364 log.cc:927] Time spent T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260709 13:10:50.880157 31975 raft_consensus.cc:515] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:50.900949 30097 raft_consensus.cc:1275] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:10:50.880766 31789 consensus_queue.cc:1048] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:10:50.906837 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:50.907025 32342 leader_election.cc:290] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:50.834717 32314 raft_consensus.cc:2749] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:50.803110 32341 consensus_queue.cc:1059] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.110s
I20260709 13:10:50.868906 32020 raft_consensus.cc:493] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.915818 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:50.839159 32267 consensus_queue.cc:1048] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.080s
W20260709 13:10:50.922539 30142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 176037us
I20260709 13:10:50.835680 32283 raft_consensus.cc:515] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:50.909158 32317 raft_consensus.cc:740] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
W20260709 13:10:50.921015 32362 log.cc:927] Time spent T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.183s	user 0.003s	sys 0.003s
I20260709 13:10:50.893522 32161 raft_consensus.cc:515] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:50.920682 32347 raft_consensus.cc:493] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.908622 32269 leader_election.cc:290] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:50.942055 30142 leader_election.cc:304] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:50.922823 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:10:50.950587 30068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:50.920533 32131 raft_consensus.cc:515] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:50.957617 30700 leader_election.cc:304] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:10:50.962888 32367 log.cc:927] Time spent T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:10:50.963261 32161 leader_election.cc:290] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:50.964732 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:50.944736 30024 raft_consensus.cc:2468] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 4.
I20260709 13:10:50.929385 30175 raft_consensus.cc:1275] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:50.956282 32347 raft_consensus.cc:515] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:50.970064 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:50.970494 32222 leader_election.cc:290] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:50.971526 32347 leader_election.cc:290] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:50.972287 32299 raft_consensus.cc:2749] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:50.973076 30172 raft_consensus.cc:3060] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:50.975116 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:50.977317 32222 raft_consensus.cc:493] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:50.977864 32222 raft_consensus.cc:515] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:50.980073 30172 raft_consensus.cc:2468] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 4.
I20260709 13:10:50.980631 32222 leader_election.cc:290] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:50.982090 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:50.982759 30733 raft_consensus.cc:2468] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 3.
I20260709 13:10:50.983768 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:50.987061 31975 leader_election.cc:290] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:50.990897 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:50.959802 30020 raft_consensus.cc:2410] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:10:50.943451 32020 raft_consensus.cc:515] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:50.994747 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:50.995393 30098 raft_consensus.cc:3060] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:50.993517 32046 raft_consensus.cc:2749] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:50.992924 32370 raft_consensus.cc:2764] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:10:51.009088 30098 raft_consensus.cc:2468] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 7.
I20260709 13:10:51.001096 32317 consensus_queue.cc:260] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:51.012199 32020 leader_election.cc:290] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:51.017042 30101 raft_consensus.cc:1240] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 13:10:51.015121 30094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33992 (request call id 1534) took 1976 ms. Trace:
I20260709 13:10:51.018085 30094 rpcz_store.cc:276] 0709 13:10:49.038676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.449990 (+411314us) service_pool.cc:224] Handling call
0709 13:10:51.014847 (+1564857us) spinlock_profiling.cc:243] Waited 675 ms on lock 0x7b5400266954. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:10:51.015039 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1552869632}
I20260709 13:10:51.022125 30097 raft_consensus.cc:1240] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:10:51.022541 32068 raft_consensus.cc:3055] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:51.022903 32068 raft_consensus.cc:740] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:51.023696 30730 raft_consensus.cc:1275] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:10:51.025290 32283 leader_election.cc:290] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:50.999567 32286 raft_consensus.cc:2749] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001) with higher term. Message: Invalid argument: T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for earlier term 5. Current term is 6.
I20260709 13:10:51.029026 32315 raft_consensus.cc:2749] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:51.031945 30170 raft_consensus.cc:1275] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:10:51.034606 30143 leader_election.cc:304] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:51.035482 30143 leader_election.cc:304] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:51.035841 30099 raft_consensus.cc:1275] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:10:51.036489 32046 consensus_queue.cc:1059] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:51.037552 32046 raft_consensus.cc:3055] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:51.038774 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:51.039988 32289 raft_consensus.cc:3060] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:51.041222 32306 leader_election.cc:290] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:51.038208 32046 raft_consensus.cc:740] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:51.042191 32238 raft_consensus.cc:493] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:51.042642 32238 raft_consensus.cc:3060] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:51.042780 32046 consensus_queue.cc:260] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:51.023638 32068 consensus_queue.cc:260] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:51.043681 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:51.044039 32046 raft_consensus.cc:3060] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:51.045217 30142 leader_election.cc:304] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:51.046051 32306 raft_consensus.cc:3060] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:51.047730 32102 raft_consensus.cc:3055] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 LEADER]: Stepping down as leader of term 4
W20260709 13:10:51.048161 30701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.048946 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:51.049299 30142 leader_election.cc:304] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:51.046046 32288 leader_election.cc:290] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:51.050825 30142 leader_election.cc:304] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:10:51.051512 32370 raft_consensus.cc:2749] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:10:51.052155 32370 raft_consensus.cc:2804] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:51.052470 32370 raft_consensus.cc:493] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.052772 32370 raft_consensus.cc:3060] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:51.054461 32204 consensus_queue.cc:1048] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:51.057035 32068 raft_consensus.cc:3060] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:51.057379 32131 leader_election.cc:290] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:51.038808 32315 raft_consensus.cc:2804] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:51.062498 32315 raft_consensus.cc:697] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 7 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:51.063577 32306 raft_consensus.cc:2749] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:10:51.064519 32368 log.cc:927] Time spent T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.179s	user 0.001s	sys 0.000s
I20260709 13:10:51.048108 32102 raft_consensus.cc:740] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:51.066613 32102 consensus_queue.cc:260] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:51.067736 32102 raft_consensus.cc:3060] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:51.069679 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:51.073534 30728 raft_consensus.cc:3060] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:51.063470 32315 consensus_queue.cc:237] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:51.086630 30735 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51014 (request call id 720) took 1480 ms (client timeout 1561 ms). Trace:
W20260709 13:10:51.087083 30735 rpcz_store.cc:269] 0709 13:10:49.606574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.629320 (+ 22746us) service_pool.cc:224] Handling call
0709 13:10:51.086443 (+1457123us) spinlock_profiling.cc:243] Waited 609 ms on lock 0x7b54007053d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:10:51.086563 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1401617280}
I20260709 13:10:51.094480 32238 raft_consensus.cc:515] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:51.096531 32238 leader_election.cc:290] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:51.098592 32317 raft_consensus.cc:3060] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:51.104921 30702 leader_election.cc:304] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:10:51.108565 32075 raft_consensus.cc:2804] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:51.254518 32075 raft_consensus.cc:697] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
W20260709 13:10:51.147769 29992 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:51.148727 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 343509us
I20260709 13:10:51.165771 30023 raft_consensus.cc:1275] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:51.165961 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:50.992676 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:51.170760 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:51.170855 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:51.171989 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:51.172147 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:51.174706 30028 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52098 (request call id 382) took 1761 ms. Trace:
I20260709 13:10:51.262634 30028 rpcz_store.cc:276] 0709 13:10:49.413188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.485851 (+ 72663us) service_pool.cc:224] Handling call
0709 13:10:49.486068 (+   217us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:49.990745 (+504677us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.174187 (+1183442us) spinlock_profiling.cc:243] Waited 494 ms on lock 0x7b5400154d54. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:10:51.174506 (+   319us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1135663872}
I20260709 13:10:51.264374 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:51.265517 30028 raft_consensus.cc:2393] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 5: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:10:51.175773 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:51.266872 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:51.267976 30026 raft_consensus.cc:2410] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 13:10:51.268910 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:51.270471 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
W20260709 13:10:51.193132 30068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.195176 30066 leader_election.cc:304] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:51.201186 30101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33990 (request call id 1746) took 1549 ms. Trace:
I20260709 13:10:51.204023 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:51.209784 29994 leader_election.cc:304] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:51.211256 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:51.212177 30168 raft_consensus.cc:1240] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:51.213151 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:51.214334 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:51.215032 30700 leader_election.cc:304] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:10:51.216518 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
W20260709 13:10:51.216919 30703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.212335 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
W20260709 13:10:51.217381 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 113084us
I20260709 13:10:51.217715 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:51.220322 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:51.221608 31975 raft_consensus.cc:493] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.221657 32102 raft_consensus.cc:493] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.277722 32315 raft_consensus.cc:493] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:51.277964 32102 raft_consensus.cc:515] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:51.223510 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:51.225289 30173 raft_consensus.cc:1240] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 4 LEADER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:51.113159 32350 raft_consensus.cc:3055] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:51.291736 32350 raft_consensus.cc:740] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:51.108690 32370 raft_consensus.cc:515] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:51.106220 32378 consensus_queue.cc:1059] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 13:10:51.296124 30021 raft_consensus.cc:2393] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 5: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
W20260709 13:10:51.230631 30069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.225208 30095 raft_consensus.cc:2468] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 6.
I20260709 13:10:51.232621 32236 raft_consensus.cc:493] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:51.298671 29993 leader_election.cc:304] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:51.298872 32236 raft_consensus.cc:515] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:51.299523 30728 raft_consensus.cc:2468] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 7.
I20260709 13:10:51.238505 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:51.247815 29924 catalog_manager.cc:5697] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 2 to 3, leader changed from 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 3 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:10:51.302769 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 108054us
I20260709 13:10:51.303567 29924 catalog_manager.cc:5697] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 2 to 3, leader changed from 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 3 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:51.305028 32291 raft_consensus.cc:493] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.306286 30731 raft_consensus.cc:2393] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 6: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:10:51.305480 29924 catalog_manager.cc:5697] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:51.307145 30068 leader_election.cc:304] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:51.308236 32286 raft_consensus.cc:2749] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:51.307888 29924 catalog_manager.cc:5697] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 2 to 3, leader changed from c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 3 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:51.309052 32273 raft_consensus.cc:3055] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:51.256016 32075 consensus_queue.cc:237] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:51.310413 30068 leader_election.cc:304] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:51.310875 31816 raft_consensus.cc:493] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.310707 29924 catalog_manager.cc:5697] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 1 to 3, leader changed from 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 3 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:10:51.311529 31816 raft_consensus.cc:515] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:51.312795 32102 leader_election.cc:290] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:51.313294 32046 raft_consensus.cc:2804] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:51.271757 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:51.314330 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:51.315250 30737 raft_consensus.cc:2393] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 3: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:10:51.304450 32288 raft_consensus.cc:2749] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:51.315804 30020 raft_consensus.cc:1275] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:51.317210 30020 raft_consensus.cc:1275] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:10:51.318293 32291 raft_consensus.cc:515] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:51.320796 32291 leader_election.cc:290] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:51.321847 32286 raft_consensus.cc:2749] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:10:51.310652 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 96089us
I20260709 13:10:51.313582 29924 catalog_manager.cc:5697] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 2 to 4, leader changed from 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 4 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:51.326983 30068 leader_election.cc:304] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:51.222813 32270 raft_consensus.cc:493] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:51.278524 32315 raft_consensus.cc:515] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:51.327855 32270 raft_consensus.cc:515] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:51.327900 29924 catalog_manager.cc:5697] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 2 to 3, leader changed from c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 3 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:51.329399 32370 leader_election.cc:290] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:51.280565 30022 raft_consensus.cc:2393] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 7: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:51.335625 32289 raft_consensus.cc:2749] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:51.336421 32046 raft_consensus.cc:697] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:51.338219 32046 consensus_queue.cc:237] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:51.340369 32315 leader_election.cc:290] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:51.309531 32273 raft_consensus.cc:740] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:51.280413 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:51.344357 30028 raft_consensus.cc:2468] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 3.
I20260709 13:10:51.346421 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:51.347178 30731 raft_consensus.cc:1240] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:51.348201 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:51.348667 30737 raft_consensus.cc:1275] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:51.272612 30026 raft_consensus.cc:2468] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 4.
I20260709 13:10:51.284860 30175 raft_consensus.cc:2393] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 4: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:10:51.286216 30174 raft_consensus.cc:2393] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 7: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:51.287804 30025 raft_consensus.cc:2468] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 4.
I20260709 13:10:51.288321 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:51.272392 30101 rpcz_store.cc:276] 0709 13:10:49.651292 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:49.925424 (+274132us) service_pool.cc:224] Handling call
0709 13:10:51.016818 (+1091394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:51.017445 (+   627us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:51.200726 (+183281us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400266950. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20b98ad 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:10:51.200952 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2509322496}
W20260709 13:10:51.291632 30701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.355192 30027 raft_consensus.cc:1275] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:10:51.293471 30177 raft_consensus.cc:2393] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 3: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:10:51.307186 31975 raft_consensus.cc:515] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:51.250173 32154 raft_consensus.cc:493] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:51.357015 32154 raft_consensus.cc:515] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:51.330569 32270 leader_election.cc:290] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:51.361007 32270 raft_consensus.cc:2804] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:51.279675 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:51.277184 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:51.326635 30700 leader_election.cc:304] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:51.334918 31816 leader_election.cc:290] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:51.333248 32350 consensus_queue.cc:260] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:51.343086 32273 consensus_queue.cc:260] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:51.368867 32273 raft_consensus.cc:3060] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:51.369210 31975 leader_election.cc:290] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:51.362037 32270 raft_consensus.cc:697] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 5 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:51.374989 30025 raft_consensus.cc:1240] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:51.375643 32270 consensus_queue.cc:237] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:51.370059 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 43614.7us
I20260709 13:10:51.370358 32378 raft_consensus.cc:2749] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:51.383510 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:51.384368 30737 raft_consensus.cc:3060] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:51.301558 32236 leader_election.cc:290] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:51.386329 32350 raft_consensus.cc:3060] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:51.369704 32154 leader_election.cc:290] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:51.389110 29921 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51840 (request call id 326) took 9454 ms. Trace:
I20260709 13:10:51.390777 30729 raft_consensus.cc:1275] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 LEARNER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:10:51.391230 31789 raft_consensus.cc:2804] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:51.391618 31789 raft_consensus.cc:493] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.391942 31789 raft_consensus.cc:3060] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:51.393968 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 95541.2us
I20260709 13:10:51.395975 29993 leader_election.cc:304] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:51.394269 31729 raft_consensus.cc:2804] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:51.398797 31729 raft_consensus.cc:697] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:51.400223 32277 raft_consensus.cc:2804] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:51.399855 31729 consensus_queue.cc:237] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:51.401105 32277 raft_consensus.cc:697] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:51.402367 30729 raft_consensus.cc:1275] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 13:10:51.402925 30728 raft_consensus.cc:1275] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:10:51.402290 32277 consensus_queue.cc:237] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:51.403483 30020 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24644eca754d40189c8264977160368a"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
mode: GRACEFUL
new_leader_uuid: "5ec73dc157ed476ca903a7d596271719"
 from {username='slave'} at 127.0.0.1:47450
I20260709 13:10:51.404317 30020 raft_consensus.cc:606] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Received request to transfer leadership to TS 5ec73dc157ed476ca903a7d596271719
W20260709 13:10:51.405434 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 78609.1us
I20260709 13:10:51.405544 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:51.406502 30735 raft_consensus.cc:1275] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:51.406762 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:51.407328 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:51.407652 30101 raft_consensus.cc:2393] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 4: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:10:51.408231 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:51.409191 30731 raft_consensus.cc:2393] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 4: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:10:51.409592 30101 raft_consensus.cc:1275] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:10:51.410102 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:51.412132 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:51.411979 32378 consensus_queue.cc:1059] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:51.412916 32378 raft_consensus.cc:3055] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:51.413257 32378 raft_consensus.cc:740] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:51.414119 32378 consensus_queue.cc:260] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:51.415463 32378 raft_consensus.cc:3060] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:10:51.428360 30703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.429745 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:51.431598 30028 raft_consensus.cc:2468] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 3.
I20260709 13:10:51.434742 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:51.434221 30025 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
mode: GRACEFUL
new_leader_uuid: "5ec73dc157ed476ca903a7d596271719"
 from {username='slave'} at 127.0.0.1:47450
I20260709 13:10:51.437074 30025 raft_consensus.cc:606] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Received request to transfer leadership to TS 5ec73dc157ed476ca903a7d596271719
I20260709 13:10:51.438445 30700 leader_election.cc:304] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:51.439175 30025 raft_consensus.cc:614] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:51.438433 30177 raft_consensus.cc:1240] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:51.444793 30172 raft_consensus.cc:2468] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 4.
I20260709 13:10:51.449174 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:51.450956 30024 raft_consensus.cc:2468] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 5.
I20260709 13:10:51.452592 30096 raft_consensus.cc:2393] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 4: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:10:51.453580 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:51.462692 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:51.463671 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:51.464299 30172 raft_consensus.cc:2468] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 3.
I20260709 13:10:51.464983 30174 raft_consensus.cc:1240] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:51.457978 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
W20260709 13:10:51.471030 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 261649us
W20260709 13:10:51.476969 30701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.453898 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:51.484815 30737 raft_consensus.cc:2468] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 4.
I20260709 13:10:51.490624 30143 leader_election.cc:304] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:51.506698 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:51.507972 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:51.508121 32246 raft_consensus.cc:2804] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:51.508967 32180 consensus_queue.cc:1048] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:51.509323 32246 raft_consensus.cc:493] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.510524 32180 consensus_queue.cc:1048] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:51.389511 29921 rpcz_store.cc:276] 0709 13:10:41.934574 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.934746 (+   172us) service_pool.cc:224] Handling call
0709 13:10:51.388842 (+9454096us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:48.141840 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:48.432673 (+290833us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:48.432709 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:10:48.432727 (+    18us) tablet.cc:662] Decoding operations
0709 13:10:48.541316 (+108589us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:48.541371 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:48.541397 (+    26us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:10:48.542127 (+   730us) tablet.cc:701] Row locks acquired
0709 13:10:48.542145 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:10:48.542288 (+   143us) write_op.cc:270] Start()
0709 13:10:48.542392 (+   104us) write_op.cc:276] Timestamp: P: 1783602648542245 usec, L: 0
0709 13:10:48.542413 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:10:48.543012 (+   599us) log.cc:844] Serialized 4036 byte log entry
0709 13:10:49.442453 (+899441us) op_driver.cc:464] REPLICATION: finished
0709 13:10:49.496527 (+ 54074us) spinlock_profiling.cc:243] Waited 7.43 ms on lock 0x7b4400022b4c. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eeef3c85 00007f99eeef46a2 00007f99f1c661db 00007f99f1c61aaf 00007f99eefb00ac 00007f99f7e0aab9 00007f99eefcc69b 00007f99eefca93f 00007f99eefccc02 00007f99f5af0ef0
0709 13:10:49.700411 (+203884us) write_op.cc:301] APPLY: starting
0709 13:10:49.741947 (+ 41536us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:49.767486 (+ 25539us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:49.767505 (+    19us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:49.768749 (+  1244us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:49.769001 (+   252us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:10:49.769048 (+    47us) write_op.cc:312] APPLY: finished
0709 13:10:49.769340 (+   292us) log.cc:844] Serialized 77 byte log entry
0709 13:10:49.769512 (+   172us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:49.769628 (+   116us) write_op.cc:454] Released schema lock
0709 13:10:49.769671 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:49.812594 (+ 42923us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:49.812628 (+    34us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5517,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":244175,"apply.run_cpu_time_us":3119,"apply.run_wall_time_us":120758,"num_ops":10,"prepare.queue_time_us":419937,"prepare.run_cpu_time_us":40892,"prepare.run_wall_time_us":549638,"raft.queue_time_us":339378,"raft.run_cpu_time_us":72179,"raft.run_wall_time_us":225142,"replication_time_us":893431,"spinlock_wait_cycles":17091968,"thread_start_us":572728,"threads_started":4,"wal-append.queue_time_us":462422,"wal-append.run_cpu_time_us":35033,"wal-append.run_wall_time_us":1905429}]]}
I20260709 13:10:51.512996 32291 consensus_queue.cc:1048] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:51.509689 32246 raft_consensus.cc:3060] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:51.489820 32236 raft_consensus.cc:493] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:51.486956 30095 raft_consensus.cc:2468] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 4.
I20260709 13:10:51.489352 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:51.524596 32180 consensus_queue.cc:1048] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:10:51.533972 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:51.534601 32289 raft_consensus.cc:2749] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:51.520809 30728 raft_consensus.cc:1240] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:51.559937 30142 leader_election.cc:304] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
W20260709 13:10:51.560693 30142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 54976.2us
I20260709 13:10:51.564921 30702 leader_election.cc:304] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:51.562665 32236 raft_consensus.cc:515] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:51.569814 30732 raft_consensus.cc:1275] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:10:51.570292 32273 raft_consensus.cc:2749] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:51.568698 30025 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
mode: GRACEFUL
new_leader_uuid: "c99569d27a6f4c648eae7119fe3db124"
 from {username='slave'} at 127.0.0.1:47450
I20260709 13:10:51.572093 30025 raft_consensus.cc:606] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Received request to transfer leadership to TS c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:51.572427 30025 raft_consensus.cc:614] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:51.550084 30729 raft_consensus.cc:2468] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 3.
I20260709 13:10:51.574374 29993 leader_election.cc:304] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719
W20260709 13:10:51.583900 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 93605.8us
W20260709 13:10:51.595877 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 71177.4us
I20260709 13:10:51.597702 31975 raft_consensus.cc:2804] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:10:51.612726 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 47965.4us
W20260709 13:10:51.614797 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 100592us
I20260709 13:10:51.604871 32134 raft_consensus.cc:2804] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:51.613618 31975 raft_consensus.cc:493] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.623905 32270 raft_consensus.cc:493] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
W20260709 13:10:51.629539 32392 log.cc:927] Time spent T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260709 13:10:51.622639 32370 consensus_queue.cc:1048] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:10:51.640250 32270 raft_consensus.cc:515] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:51.642372 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 88347.7us
I20260709 13:10:51.629837 31975 raft_consensus.cc:3060] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:51.629151 32134 raft_consensus.cc:697] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 4 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
W20260709 13:10:51.650326 29991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:51.652144 30701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.650799 32238 consensus_queue.cc:1048] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 13:10:51.657451 30735 raft_consensus.cc:2468] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 7.
I20260709 13:10:51.637310 31729 consensus_queue.cc:1048] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 13:10:51.654917 32370 raft_consensus.cc:493] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:51.679459 30729 raft_consensus.cc:1275] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:10:51.679880 30729 pending_rounds.cc:85] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a: Aborting all ops after (but not including) 6
I20260709 13:10:51.680131 30729 pending_rounds.cc:107] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:10:51.680420 30729 raft_consensus.cc:2889] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:51.682346 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:51.683041 30174 raft_consensus.cc:2468] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 3.
I20260709 13:10:51.661705 32289 raft_consensus.cc:493] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.684104 32289 raft_consensus.cc:515] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:51.668574 32291 raft_consensus.cc:493] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.689514 32291 raft_consensus.cc:515] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:51.693356 32291 leader_election.cc:290] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:51.694010 32236 leader_election.cc:290] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:51.670809 32180 raft_consensus.cc:493] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.694991 32180 raft_consensus.cc:515] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:51.668056 32370 raft_consensus.cc:515] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:51.705039 32278 consensus_queue.cc:1048] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:10:51.715205 32277 consensus_queue.cc:1059] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:51.716391 32238 raft_consensus.cc:3055] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:51.716749 32238 raft_consensus.cc:740] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:51.717733 32238 consensus_queue.cc:260] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:51.718848 32238 raft_consensus.cc:3060] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:51.721226 30103 raft_consensus.cc:1275] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:10:51.722250 30140 leader_election.cc:304] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:51.722368 32288 consensus_queue.cc:1048] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:51.722739 30066 leader_election.cc:304] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:51.723201 32291 consensus_queue.cc:1048] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:51.723605 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:51.724200 32286 consensus_queue.cc:1048] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:51.727046 32274 consensus_queue.cc:1048] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:10:51.729581 32281 consensus_queue.cc:1048] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:10:51.725653 32286 raft_consensus.cc:2749] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:51.701710 32134 consensus_queue.cc:237] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:51.734644 30066 leader_election.cc:304] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:51.724251 30101 raft_consensus.cc:2468] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 4.
I20260709 13:10:51.745347 29993 leader_election.cc:304] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:51.736585 32180 leader_election.cc:290] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:51.760054 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:51.761340 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
W20260709 13:10:51.762110 29991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:51.763288 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:51.764436 30068 leader_election.cc:304] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:51.758862 29993 leader_election.cc:304] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
W20260709 13:10:51.765578 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 56028us
I20260709 13:10:51.755437 32278 raft_consensus.cc:3060] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:51.777274 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 55231.5us
I20260709 13:10:51.756693 32289 leader_election.cc:290] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:10:51.799700 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 74002.8us
I20260709 13:10:51.758464 32236 raft_consensus.cc:3060] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:51.831933 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:51.832998 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:51.748930 32154 consensus_queue.cc:1048] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 13:10:51.833768 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:51.833953 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:51.834609 30021 raft_consensus.cc:2468] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 5.
I20260709 13:10:51.835678 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:51.803396 30703 leader_election.cc:304] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:10:51.839115 32270 leader_election.cc:290] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:51.840770 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:51.841197 32046 raft_consensus.cc:2804] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:51.841668 32046 raft_consensus.cc:493] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:51.842060 32046 raft_consensus.cc:3060] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:51.842396 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:51.844681 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:51.805120 32283 consensus_queue.cc:1048] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:10:51.807331 32068 raft_consensus.cc:2804] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:51.853183 32068 raft_consensus.cc:493] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:51.853600 32068 raft_consensus.cc:3060] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:51.808283 30103 raft_consensus.cc:1275] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:10:51.809623 32388 log.cc:927] Time spent T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.101s	user 0.003s	sys 0.000s
I20260709 13:10:51.859760 30140 leader_election.cc:304] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:51.860622 32289 raft_consensus.cc:3060] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:51.861315 30140 leader_election.cc:304] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:51.794387 30702 leader_election.cc:304] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
W20260709 13:10:51.862774 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 80317.6us
I20260709 13:10:51.863251 32075 raft_consensus.cc:2749] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:51.864029 30702 leader_election.cc:304] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:51.782655 32350 raft_consensus.cc:2804] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:51.864972 32350 raft_consensus.cc:697] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:51.865767 32377 raft_consensus.cc:2749] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:51.867338 32289 raft_consensus.cc:2749] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:51.870355 32246 raft_consensus.cc:515] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:51.812372 32281 raft_consensus.cc:493] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.873502 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:51.783921 32378 raft_consensus.cc:493] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:51.874162 30027 raft_consensus.cc:3060] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:51.874571 32378 raft_consensus.cc:515] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:51.876842 32378 leader_election.cc:290] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:51.759011 31789 raft_consensus.cc:515] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:51.877597 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:51.878835 31789 leader_election.cc:290] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:51.824528 30066 leader_election.cc:304] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:51.801394 32180 raft_consensus.cc:2749] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:10:51.880733 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 56343us
I20260709 13:10:51.881809 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:51.882272 30066 leader_election.cc:304] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:51.883380 32288 raft_consensus.cc:2749] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:10:51.883803 32350 consensus_queue.cc:237] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:51.885383 32180 consensus_queue.cc:1048] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:51.888180 30066 leader_election.cc:304] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
W20260709 13:10:51.889077 32393 log.cc:927] Time spent T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260709 13:10:51.884143 32288 consensus_queue.cc:1048] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:51.841409 30024 raft_consensus.cc:2468] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 4.
I20260709 13:10:51.865240 30702 leader_election.cc:304] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:10:51.888864 32283 raft_consensus.cc:2804] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:51.897140 30168 raft_consensus.cc:1275] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 13:10:51.891214 32370 leader_election.cc:290] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:51.895634 32283 raft_consensus.cc:493] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:51.874079 32281 raft_consensus.cc:515] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:51.915946 29994 leader_election.cc:304] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:51.909335 32075 raft_consensus.cc:2804] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:51.907624 32289 raft_consensus.cc:2749] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:51.905658 32180 raft_consensus.cc:2749] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:10:51.931255 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 66180.4us
I20260709 13:10:51.931955 32277 raft_consensus.cc:2804] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:51.915139 32283 raft_consensus.cc:3060] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:51.955070 31975 raft_consensus.cc:515] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:51.955907 32246 leader_election.cc:290] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:51.960345 32370 raft_consensus.cc:493] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:51.966665 29993 leader_election.cc:304] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:51.942106 32075 raft_consensus.cc:697] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:51.971757 30027 raft_consensus.cc:2468] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 4.
W20260709 13:10:51.972903 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 47488.7us
W20260709 13:10:51.982816 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 121600us
I20260709 13:10:51.984144 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:51.986445 30737 raft_consensus.cc:2468] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 3.
I20260709 13:10:51.915447 32238 consensus_queue.cc:1048] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
W20260709 13:10:51.986486 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 61213.6us
I20260709 13:10:51.970129 32277 raft_consensus.cc:493] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:51.985409 30066 leader_election.cc:304] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:51.989984 29993 leader_election.cc:304] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:51.991384 30068 leader_election.cc:304] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:51.998224 30066 leader_election.cc:304] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:51.998773 30700 leader_election.cc:304] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:51.961614 32068 raft_consensus.cc:515] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:52.001452 30172 raft_consensus.cc:1240] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 4 LEADER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:10:52.003998 30068 leader_election.cc:304] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:51.994994 32277 raft_consensus.cc:3060] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:51.978405 32270 consensus_queue.cc:1048] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.027s
I20260709 13:10:51.984383 32273 consensus_queue.cc:1059] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:10:51.998401 32180 raft_consensus.cc:2749] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:52.031545 32134 raft_consensus.cc:493] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:52.038558 32134 raft_consensus.cc:515] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:52.039031 32373 consensus_queue.cc:1048] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:52.034164 32075 consensus_queue.cc:237] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:52.040139 32270 raft_consensus.cc:3060] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:52.004487 32154 raft_consensus.cc:493] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.001317 32291 raft_consensus.cc:2804] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:52.041885 30101 raft_consensus.cc:1275] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:10:52.030212 32274 raft_consensus.cc:2749] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:52.046950 32291 raft_consensus.cc:493] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.039125 31975 leader_election.cc:290] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:10:52.050495 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 51222.6us
I20260709 13:10:52.045867 30140 leader_election.cc:304] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
W20260709 13:10:52.052908 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 60354.9us
I20260709 13:10:52.033062 30729 raft_consensus.cc:1240] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:10:52.055321 32289 raft_consensus.cc:2804] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:52.055923 30140 leader_election.cc:304] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:10:52.056401 32131 raft_consensus.cc:493] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.056751 32341 raft_consensus.cc:2749] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:52.057078 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:52.058553 30101 raft_consensus.cc:1275] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:52.058799 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:52.059990 32276 raft_consensus.cc:2749] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:52.060540 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:52.062043 32317 consensus_queue.cc:1048] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:51.998965 32370 raft_consensus.cc:515] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:10:52.063928 30096 raft_consensus.cc:1275] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:10:52.067027 29991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.053447 30066 leader_election.cc:304] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
W20260709 13:10:52.099838 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 46442.1us
I20260709 13:10:52.100571 30066 leader_election.cc:304] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:52.034574 30168 raft_consensus.cc:1275] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:10:52.093186 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 63597.8us
I20260709 13:10:52.106338 32180 raft_consensus.cc:2804] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:52.106775 32180 raft_consensus.cc:493] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.107101 32180 raft_consensus.cc:3060] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:52.110019 32404 raft_consensus.cc:2749] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:52.110796 32404 raft_consensus.cc:493] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:52.111334 32404 raft_consensus.cc:515] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:52.118594 32288 raft_consensus.cc:493] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:52.119302 32288 raft_consensus.cc:515] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:52.125866 30099 raft_consensus.cc:2468] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 3.
I20260709 13:10:52.124410 30176 raft_consensus.cc:1275] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:10:52.129030 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 130289us
I20260709 13:10:52.067488 32291 raft_consensus.cc:3060] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:52.083384 32289 raft_consensus.cc:493] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:52.135257 30703 leader_election.cc:304] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:52.066342 32403 consensus_queue.cc:1059] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 13:10:52.098506 32377 raft_consensus.cc:2804] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:52.136997 30024 raft_consensus.cc:1240] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:10:52.124969 32278 raft_consensus.cc:2749] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:52.054380 32046 raft_consensus.cc:515] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:52.143353 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:52.142714 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:52.148455 30028 raft_consensus.cc:2393] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 5: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:10:52.067534 32154 raft_consensus.cc:515] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:52.149060 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 159015us
I20260709 13:10:52.150975 32154 leader_election.cc:290] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:52.152113 30022 raft_consensus.cc:1240] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:10:52.136288 32289 raft_consensus.cc:3060] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:52.140604 32236 raft_consensus.cc:2749] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:52.138621 32274 raft_consensus.cc:493] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:52.163206 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 107432us
I20260709 13:10:52.161448 32273 raft_consensus.cc:493] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.128897 32131 raft_consensus.cc:515] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:52.165153 32414 consensus_queue.cc:1048] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:10:52.170245 32414 consensus_queue.cc:1048] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:52.172817 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:52.175453 30143 leader_election.cc:304] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:52.176627 32317 raft_consensus.cc:2749] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:52.187994 30025 raft_consensus.cc:2393] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 4: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:10:52.165333 32161 raft_consensus.cc:2804] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:52.188264 29993 leader_election.cc:304] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:52.171952 32414 raft_consensus.cc:2804] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:52.160230 32315 raft_consensus.cc:493] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:52.188725 32161 raft_consensus.cc:493] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:52.194965 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:52.195314 30024 raft_consensus.cc:1275] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:52.195966 30140 leader_election.cc:304] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:10:52.179761 32403 raft_consensus.cc:3055] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:52.200021 32154 raft_consensus.cc:993] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4: : Instructing follower 5ec73dc157ed476ca903a7d596271719 to start an election
W20260709 13:10:52.198035 32401 log.cc:927] Time spent T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260709 13:10:52.200124 32046 leader_election.cc:290] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:52.165247 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
W20260709 13:10:52.200825 32407 log.cc:927] Time spent T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:10:52.200986 32180 raft_consensus.cc:515] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:52.197132 32134 leader_election.cc:290] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:52.217430 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:52.217548 32281 leader_election.cc:290] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:52.220400 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:52.220649 32317 raft_consensus.cc:2804] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:52.216163 32403 raft_consensus.cc:740] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:52.221325 32370 leader_election.cc:290] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:52.216212 31729 raft_consensus.cc:2749] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:52.166935 32131 leader_election.cc:290] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:52.179852 32412 raft_consensus.cc:493] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:52.231592 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 96348.7us
I20260709 13:10:52.220280 30019 raft_consensus.cc:1275] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:52.203342 32414 raft_consensus.cc:493] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.239822 30102 raft_consensus.cc:3060] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:52.223556 30095 raft_consensus.cc:3060] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:52.197145 32404 leader_election.cc:290] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:52.165154 32273 raft_consensus.cc:515] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:52.216539 32161 raft_consensus.cc:3060] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:52.179258 32274 raft_consensus.cc:515] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:52.234840 32236 consensus_queue.cc:1059] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:10:52.258585 32317 raft_consensus.cc:697] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 5 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:52.258754 32417 raft_consensus.cc:493] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.245035 32377 raft_consensus.cc:697] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
W20260709 13:10:52.262770 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 66959us
I20260709 13:10:52.264477 32020 raft_consensus.cc:1081] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Signalling peer 5ec73dc157ed476ca903a7d596271719 to start an election
I20260709 13:10:52.235764 32315 raft_consensus.cc:515] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:52.272759 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 70453.6us
I20260709 13:10:52.260012 32414 raft_consensus.cc:3060] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:52.274972 30140 leader_election.cc:304] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:10:52.299244 32419 raft_consensus.cc:493] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:52.306282 32377 consensus_queue.cc:237] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:52.355592 32134 raft_consensus.cc:493] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.356241 32134 raft_consensus.cc:515] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:52.358295 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 194908us
I20260709 13:10:52.286680 32370 raft_consensus.cc:2804] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:52.296566 32425 raft_consensus.cc:3055] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:52.282014 32131 consensus_queue.cc:1048] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 13:10:52.326808 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:52.378983 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:52.379575 30024 raft_consensus.cc:3060] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:52.327803 32317 consensus_queue.cc:237] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:10:52.329035 32406 log.cc:927] Time spent T 00000000000000000000000000000000 P 1c91346f9a2a480e908d4e0323634aeb: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 13:10:52.330205 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:52.332046 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:52.333840 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:52.334358 32416 raft_consensus.cc:493] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:52.335294 32403 consensus_queue.cc:260] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:52.338114 32274 leader_election.cc:290] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:52.263744 32412 raft_consensus.cc:515] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:52.282390 32417 raft_consensus.cc:515] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:52.346632 32315 leader_election.cc:290] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:52.346951 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:52.346654 32180 leader_election.cc:290] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:52.348829 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:52.350755 32246 raft_consensus.cc:3055] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:10:52.353216 32273 leader_election.cc:290] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:52.355108 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:52.374980 32281 consensus_queue.cc:1059] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
W20260709 13:10:52.355535 32408 log.cc:927] Time spent T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.299s	user 0.002s	sys 0.000s
I20260709 13:10:52.374915 30102 raft_consensus.cc:2468] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 6.
W20260709 13:10:52.386276 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 183845us
I20260709 13:10:52.402660 32283 raft_consensus.cc:515] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:52.361642 32370 raft_consensus.cc:493] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:52.401170 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:52.332099 32289 raft_consensus.cc:515] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:52.415472 32246 raft_consensus.cc:740] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:52.363368 32425 raft_consensus.cc:740] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:52.375177 32404 consensus_queue.cc:1048] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:10:52.427882 29994 leader_election.cc:304] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:52.438521 32134 leader_election.cc:290] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:52.375456 32419 raft_consensus.cc:515] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:52.440954 32020 consensus_queue.cc:1048] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:10:52.428609 30731 raft_consensus.cc:1240] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:52.416625 30099 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "24644eca754d40189c8264977160368a"
dest_uuid: "5ec73dc157ed476ca903a7d596271719"
 from {username='slave'} at 127.0.0.1:33990
I20260709 13:10:52.463351 30099 raft_consensus.cc:493] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:10:52.463753 30099 raft_consensus.cc:3060] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:52.443045 30028 raft_consensus.cc:2468] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 6.
I20260709 13:10:52.447675 32414 raft_consensus.cc:515] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:52.449450 32270 raft_consensus.cc:2749] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:52.449311 32350 consensus_queue.cc:1048] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:52.416023 32416 raft_consensus.cc:515] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:52.451711 32289 leader_election.cc:290] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451)
I20260709 13:10:52.425709 32403 raft_consensus.cc:3060] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:52.454838 30024 raft_consensus.cc:2468] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 6.
I20260709 13:10:52.465857 30140 leader_election.cc:304] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:52.426496 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:52.434062 32370 raft_consensus.cc:3060] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:52.482120 30066 leader_election.cc:304] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:52.482924 30140 leader_election.cc:304] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:52.484815 32291 raft_consensus.cc:515] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:52.471069 32134 raft_consensus.cc:493] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.477542 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:52.490063 32134 raft_consensus.cc:515] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:52.490845 30099 raft_consensus.cc:515] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:52.492518 30099 leader_election.cc:290] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:52.494141 32281 raft_consensus.cc:2804] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:52.494647 32281 raft_consensus.cc:697] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 6 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:52.495437 32281 consensus_queue.cc:237] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:52.471045 31729 raft_consensus.cc:2804] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:52.511570 30737 raft_consensus.cc:1275] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:52.516777 30094 raft_consensus.cc:1240] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:52.522094 31729 raft_consensus.cc:697] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:52.523039 31729 consensus_queue.cc:237] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:52.523861 32442 raft_consensus.cc:2749] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:52.525308 30732 raft_consensus.cc:1275] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:10:52.523324 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:52.527637 30731 raft_consensus.cc:2468] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 6.
I20260709 13:10:52.511080 32289 raft_consensus.cc:2804] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:52.541530 32291 leader_election.cc:290] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:52.544328 32068 leader_election.cc:290] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:52.518718 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:52.546787 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:52.548132 32289 raft_consensus.cc:493] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:52.572409 30169 raft_consensus.cc:3060] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:52.576951 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:52.569940 30020 raft_consensus.cc:3055] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:52.577966 30020 raft_consensus.cc:740] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:52.578060 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:52.578969 30020 consensus_queue.cc:260] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:52.577999 32420 raft_consensus.cc:493] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.579376 30170 raft_consensus.cc:1275] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:10:52.580690 32420 raft_consensus.cc:515] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:52.589339 30172 raft_consensus.cc:1275] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:52.577884 30736 raft_consensus.cc:2410] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:52.580371 30020 raft_consensus.cc:3060] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:52.513152 32246 consensus_queue.cc:260] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:52.593152 32246 raft_consensus.cc:3060] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:52.599048 32291 raft_consensus.cc:493] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.599704 32291 raft_consensus.cc:515] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:52.600590 32417 leader_election.cc:290] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:52.601490 32283 leader_election.cc:290] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:52.602819 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:52.603194 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:52.604094 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:52.604293 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:52.604629 30168 raft_consensus.cc:3060] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:52.605713 32350 raft_consensus.cc:493] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.606110 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:52.607156 30735 raft_consensus.cc:2393] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 6: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
W20260709 13:10:52.614619 30068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.554008 32277 raft_consensus.cc:515] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:52.601742 32291 leader_election.cc:290] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:52.582291 32289 raft_consensus.cc:3060] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:52.619549 30170 raft_consensus.cc:3060] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:52.649417 30095 raft_consensus.cc:2468] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 6.
I20260709 13:10:52.654462 32419 leader_election.cc:290] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:52.656072 32426 raft_consensus.cc:3055] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:52.656445 32426 raft_consensus.cc:740] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:52.659065 32414 leader_election.cc:290] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:52.661280 30068 leader_election.cc:304] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:52.664773 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:52.671216 30176 raft_consensus.cc:2468] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 6.
I20260709 13:10:52.677143 30068 leader_election.cc:304] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:52.576252 32161 raft_consensus.cc:515] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:52.674873 30020 raft_consensus.cc:2468] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 7.
I20260709 13:10:52.690402 32416 leader_election.cc:290] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:52.551685 32425 consensus_queue.cc:260] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:52.669526 32420 leader_election.cc:290] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:52.670027 32412 leader_election.cc:290] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:52.709555 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:52.679454 32270 raft_consensus.cc:2749] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:52.693140 32403 raft_consensus.cc:3060] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:52.711740 30101 raft_consensus.cc:2468] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 4.
I20260709 13:10:52.643395 32350 raft_consensus.cc:515] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:52.721832 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:52.715370 30169 raft_consensus.cc:2468] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 6.
I20260709 13:10:52.723585 29993 leader_election.cc:304] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:52.723455 30103 raft_consensus.cc:2393] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 6: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:52.722759 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
W20260709 13:10:52.726082 32443 log.cc:927] Time spent T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 13:10:52.726763 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:52.727787 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
W20260709 13:10:52.728333 32448 log.cc:927] Time spent T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 13:10:52.728881 30168 raft_consensus.cc:2468] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 7.
I20260709 13:10:52.729885 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:52.721271 32317 raft_consensus.cc:493] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:52.732652 32317 raft_consensus.cc:515] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:52.734822 32317 leader_election.cc:290] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:52.738137 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:52.738844 30101 raft_consensus.cc:3060] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:52.742622 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:52.744514 30168 raft_consensus.cc:3060] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:52.748477 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:52.752063 30168 raft_consensus.cc:1275] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:10:52.754060 32433 consensus_queue.cc:1048] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:52.754575 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:52.756855 30098 raft_consensus.cc:1275] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:10:52.757212 30098 pending_rounds.cc:85] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719: Aborting all ops after (but not including) 5
I20260709 13:10:52.757418 30098 pending_rounds.cc:107] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:10:52.757630 30098 raft_consensus.cc:2889] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:52.770532 30069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.764168 30703 leader_election.cc:304] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:10:52.740162 32277 leader_election.cc:290] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:52.777235 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:52.784718 30174 raft_consensus.cc:2468] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 4.
I20260709 13:10:52.773366 30703 leader_election.cc:304] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:52.774058 32288 leader_election.cc:290] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:52.777900 30170 raft_consensus.cc:2468] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 4.
I20260709 13:10:52.794212 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:52.725162 31789 consensus_queue.cc:1048] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:10:52.761152 32435 raft_consensus.cc:2804] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:52.813223 30174 raft_consensus.cc:1240] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:52.783393 32350 leader_election.cc:290] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:52.783824 32377 raft_consensus.cc:2804] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:52.761427 32370 raft_consensus.cc:515] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:52.802397 32416 raft_consensus.cc:2749] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:52.821949 32435 raft_consensus.cc:493] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.774814 32154 consensus_queue.cc:1048] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 13:10:52.854367 32420 raft_consensus.cc:493] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.823200 32315 raft_consensus.cc:493] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.816138 32317 raft_consensus.cc:493] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:52.867081 32317 raft_consensus.cc:515] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:52.867293 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
W20260709 13:10:52.867609 32460 log.cc:927] Time spent T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:10:52.821702 32427 raft_consensus.cc:493] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.820324 30169 raft_consensus.cc:2468] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 3.
I20260709 13:10:52.869711 32427 raft_consensus.cc:515] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:52.861158 30175 raft_consensus.cc:2468] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 4.
I20260709 13:10:52.871734 32427 leader_election.cc:290] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:52.869228 32317 leader_election.cc:290] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:52.861243 30174 raft_consensus.cc:1275] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:52.825387 32377 raft_consensus.cc:493] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:52.873632 32377 raft_consensus.cc:3060] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:52.866839 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:52.879045 30734 raft_consensus.cc:3060] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:52.880039 32134 leader_election.cc:290] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:52.866833 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:52.882885 32426 consensus_queue.cc:260] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:52.883874 32426 raft_consensus.cc:3060] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:52.885842 32461 raft_consensus.cc:493] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:52.886348 32461 raft_consensus.cc:515] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:52.888518 32461 leader_election.cc:290] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:52.889504 32427 raft_consensus.cc:493] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.891027 32427 raft_consensus.cc:515] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:52.864324 32276 consensus_queue.cc:1048] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:52.893353 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:52.893971 30025 raft_consensus.cc:3060] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:10:52.896015 32427 leader_election.cc:290] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:52.898880 30734 raft_consensus.cc:2468] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 6.
I20260709 13:10:52.901503 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:52.859843 32435 raft_consensus.cc:3060] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:52.905011 32278 consensus_queue.cc:1059] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:52.825268 32417 raft_consensus.cc:493] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.864456 32131 consensus_queue.cc:1048] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:52.865156 29993 leader_election.cc:304] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:52.906046 32417 raft_consensus.cc:515] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:52.906780 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:52.908015 32358 raft_consensus.cc:2749] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:10:52.889674 30703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.863673 32161 leader_election.cc:290] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:52.866416 32020 raft_consensus.cc:493] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.911038 32020 raft_consensus.cc:515] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:52.911509 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
W20260709 13:10:52.911890 32453 log.cc:927] Time spent T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.201s	user 0.003s	sys 0.000s
I20260709 13:10:52.913170 32020 leader_election.cc:290] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:52.913832 32315 raft_consensus.cc:515] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:52.869288 32458 log.cc:927] Time spent T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:10:52.854892 30068 leader_election.cc:304] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:52.890275 30736 raft_consensus.cc:1275] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:52.891333 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:52.891978 30143 leader_election.cc:304] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:52.892588 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:52.931512 30028 raft_consensus.cc:2393] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 6: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:52.865919 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:52.867233 30176 raft_consensus.cc:1240] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 2. Current term is 3. Ops: []
I20260709 13:10:52.910157 29993 leader_election.cc:304] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:52.901674 30101 raft_consensus.cc:2468] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 4.
I20260709 13:10:52.916363 30733 raft_consensus.cc:1275] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:10:52.917896 32236 raft_consensus.cc:493] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:52.910094 32446 raft_consensus.cc:3055] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:52.918675 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:52.918990 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:52.946821 30735 raft_consensus.cc:2468] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 4.
W20260709 13:10:52.922617 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 67810.7us
I20260709 13:10:52.922818 30700 leader_election.cc:304] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:10:52.949203 30700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:52.929308 30025 raft_consensus.cc:2468] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 4.
I20260709 13:10:52.951846 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:52.954110 30068 leader_election.cc:304] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:52.931806 30143 leader_election.cc:304] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:52.908147 32417 leader_election.cc:290] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:52.824124 30728 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c"
dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
mode: GRACEFUL
new_leader_uuid: "c99569d27a6f4c648eae7119fe3db124"
 from {username='slave'} at 127.0.0.1:55634
I20260709 13:10:52.956454 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:52.933028 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:52.914857 32420 raft_consensus.cc:515] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:52.944485 32154 raft_consensus.cc:2804] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:53.075228 32154 raft_consensus.cc:697] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:53.076103 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:53.076759 32403 raft_consensus.cc:2749] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:52.930335 30729 raft_consensus.cc:2468] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 5.
I20260709 13:10:53.005239 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:53.004755 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:52.962679 30068 leader_election.cc:304] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:52.932732 32283 raft_consensus.cc:2749] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:52.945276 32442 raft_consensus.cc:493] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:52.933311 32134 raft_consensus.cc:2749] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:52.945899 30019 raft_consensus.cc:2468] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 4.
I20260709 13:10:53.049681 30730 raft_consensus.cc:2393] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 7: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:52.963344 32412 raft_consensus.cc:2749] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:52.955466 32236 raft_consensus.cc:515] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:52.946430 32446 raft_consensus.cc:740] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:53.058804 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:53.059484 32377 raft_consensus.cc:515] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:53.059854 32161 raft_consensus.cc:2749] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:53.061806 32435 raft_consensus.cc:515] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:53.062618 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:53.064033 32289 raft_consensus.cc:515] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:53.071705 30700 leader_election.cc:304] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:10:53.072988 30066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.076292 32154 consensus_queue.cc:237] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:53.031215 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 58773.6us
W20260709 13:10:53.083894 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 121277us
I20260709 13:10:53.107646 30068 leader_election.cc:304] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
W20260709 13:10:53.083894 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 223845us
I20260709 13:10:53.085831 30103 raft_consensus.cc:2393] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 3: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:10:53.082005 30728 raft_consensus.cc:606] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 LEADER]: Received request to transfer leadership to TS c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:53.049342 32413 raft_consensus.cc:2955] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:52.957065 32419 raft_consensus.cc:2749] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:53.087016 32404 raft_consensus.cc:2804] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:53.106186 30700 leader_election.cc:304] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:53.110379 30068 leader_election.cc:304] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:53.117396 32412 raft_consensus.cc:2804] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:53.117923 32412 raft_consensus.cc:697] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 4 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:53.118310 32403 consensus_queue.cc:1059] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:53.118830 32412 consensus_queue.cc:237] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:53.118053 30068 leader_election.cc:304] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:53.120733 32291 raft_consensus.cc:2804] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:10:53.111837 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 180098us
I20260709 13:10:53.022908 32317 consensus_queue.cc:1048] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 13:10:53.121230 32291 raft_consensus.cc:493] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:53.123351 32291 raft_consensus.cc:3060] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:53.124423 32317 consensus_queue.cc:1048] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:53.126715 32317 raft_consensus.cc:493] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:53.127225 32317 raft_consensus.cc:515] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:53.129231 32317 leader_election.cc:290] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:53.120680 30068 leader_election.cc:304] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:53.130873 32426 raft_consensus.cc:2804] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:53.130640 32291 raft_consensus.cc:515] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:53.131345 32426 raft_consensus.cc:493] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:53.131743 32426 raft_consensus.cc:3060] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:53.133435 32291 leader_election.cc:290] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:53.139510 30103 raft_consensus.cc:3060] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:53.143607 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:53.144294 30099 raft_consensus.cc:2468] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 4.
I20260709 13:10:53.145522 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:53.146116 30099 raft_consensus.cc:2468] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 5.
I20260709 13:10:53.147266 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:53.150280 30143 leader_election.cc:304] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:53.151677 32317 raft_consensus.cc:2749] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:53.162375 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:53.162925 30735 raft_consensus.cc:3060] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:53.163383 32289 leader_election.cc:290] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:53.169592 30735 raft_consensus.cc:2468] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 4.
I20260709 13:10:53.171470 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:53.114102 32283 raft_consensus.cc:2804] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:53.172650 32283 raft_consensus.cc:493] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:53.173038 32283 raft_consensus.cc:3060] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:53.174806 32435 leader_election.cc:290] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:53.178442 30019 raft_consensus.cc:1275] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:53.179649 32404 raft_consensus.cc:697] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 7 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:53.180622 32404 consensus_queue.cc:237] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:53.181829 32273 raft_consensus.cc:2804] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:53.182359 32273 raft_consensus.cc:697] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:53.183224 32273 consensus_queue.cc:237] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:53.184474 32270 raft_consensus.cc:3055] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:53.184923 32270 raft_consensus.cc:740] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:53.185256 32420 leader_election.cc:290] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:53.185788 32270 consensus_queue.cc:260] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:53.187155 32270 raft_consensus.cc:3060] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:53.191186 32370 leader_election.cc:290] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:53.193745 32236 leader_election.cc:290] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:53.194913 32315 leader_election.cc:290] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:53.196323 32377 leader_election.cc:290] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:53.197010 32446 consensus_queue.cc:260] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:53.198369 32446 raft_consensus.cc:3060] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:53.109236 32378 raft_consensus.cc:2749] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:53.160892 32414 raft_consensus.cc:493] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.203125 32414 raft_consensus.cc:515] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:53.204406 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:53.205088 32414 leader_election.cc:290] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:53.088291 32442 raft_consensus.cc:515] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:53.209928 30733 raft_consensus.cc:1240] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 13:10:53.216428 30170 raft_consensus.cc:1275] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:10:53.153844 32426 raft_consensus.cc:515] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:53.225003 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:53.226188 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:53.228863 30174 raft_consensus.cc:3060] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:53.224467 30142 leader_election.cc:304] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:53.227810 30143 leader_election.cc:304] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:53.234243 30068 leader_election.cc:304] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:53.239490 30702 leader_election.cc:304] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:53.235354 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:53.236071 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:53.236343 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:53.236763 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:53.236974 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:53.237694 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:53.240355 30068 leader_election.cc:304] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:53.203150 32425 raft_consensus.cc:3060] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:53.251888 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:10:53.272897 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 47259.8us
I20260709 13:10:53.273078 30175 raft_consensus.cc:2468] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 5.
I20260709 13:10:53.267022 30103 raft_consensus.cc:1275] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:53.270229 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:53.274444 30702 leader_election.cc:304] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:53.275031 30019 raft_consensus.cc:3060] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:53.269277 30177 raft_consensus.cc:2468] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 5.
I20260709 13:10:53.242871 32315 raft_consensus.cc:2804] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:53.240180 32370 raft_consensus.cc:2749] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:53.292209 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:53.284335 30098 raft_consensus.cc:2368] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 4. Current term is 5.
I20260709 13:10:53.287992 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:53.292969 30735 raft_consensus.cc:2393] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 6: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:10:53.294273 30025 raft_consensus.cc:1240] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 13:10:53.295524 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:53.296118 30023 raft_consensus.cc:3060] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:53.235989 32416 consensus_queue.cc:1048] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 13:10:53.301290 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:53.294764 30702 leader_election.cc:304] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:53.272145 32373 raft_consensus.cc:493] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.268523 32419 raft_consensus.cc:2749] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:53.300676 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:53.278538 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:53.283043 32134 raft_consensus.cc:493] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.283279 32270 raft_consensus.cc:2749] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:10:53.304845 30067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:53.281924 32427 raft_consensus.cc:2749] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:53.291900 32315 raft_consensus.cc:493] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:53.287530 32286 raft_consensus.cc:2749] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:53.303663 30728 raft_consensus.cc:2368] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for earlier term 4. Current term is 5.
I20260709 13:10:53.347877 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:53.285501 30095 raft_consensus.cc:2468] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 5.
I20260709 13:10:53.336216 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:53.312266 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:53.314659 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:53.348138 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:53.352733 30168 raft_consensus.cc:3060] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:53.273729 32471 consensus_queue.cc:1048] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.080s
I20260709 13:10:53.313923 32449 consensus_queue.cc:1048] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:10:53.333381 32131 raft_consensus.cc:2804] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:53.334784 32315 raft_consensus.cc:3060] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:53.314468 32289 raft_consensus.cc:493] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:53.370172 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:53.370899 30027 raft_consensus.cc:2368] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 4. Current term is 5.
I20260709 13:10:53.371548 30168 raft_consensus.cc:2468] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 4.
I20260709 13:10:53.373517 30068 leader_election.cc:304] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:53.373739 30140 leader_election.cc:304] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:53.310563 32373 raft_consensus.cc:515] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:53.377821 30103 raft_consensus.cc:2468] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 4.
I20260709 13:10:53.380424 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:53.381498 30143 leader_election.cc:304] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:53.363516 32131 raft_consensus.cc:493] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:53.386023 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:53.360268 32161 raft_consensus.cc:493] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:53.326033 32134 raft_consensus.cc:515] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:53.389788 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 83727.9us
I20260709 13:10:53.391353 30100 raft_consensus.cc:1275] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:10:53.391351 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:53.396100 30140 leader_election.cc:400] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 election: Vote denied by peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451) with higher term. Message: Invalid argument: T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 4. Current term is 5.
I20260709 13:10:53.396445 30140 leader_election.cc:403] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:10:53.382908 28889 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:10:53.381536 32431 raft_consensus.cc:493] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.382022 32412 raft_consensus.cc:2804] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:53.381201 32420 raft_consensus.cc:2749] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:10:53.391048 32424 log.cc:927] Time spent T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.953s	user 0.000s	sys 0.004s
I20260709 13:10:53.394585 30734 raft_consensus.cc:2955] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:53.401508 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:53.390178 32131 raft_consensus.cc:3060] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:53.403331 30172 raft_consensus.cc:2393] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 4: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:10:53.392704 30175 raft_consensus.cc:2955] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:53.410588 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:53.411240 30094 raft_consensus.cc:2468] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 3.
I20260709 13:10:53.412868 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:53.397110 32161 raft_consensus.cc:515] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:53.414379 32472 log.cc:927] Time spent T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 13:10:53.415591 32161 leader_election.cc:290] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:53.400938 32431 raft_consensus.cc:515] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:53.417910 32431 leader_election.cc:290] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:53.419827 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:53.378088 32289 raft_consensus.cc:515] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:53.426335 30143 leader_election.cc:304] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:53.427352 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
W20260709 13:10:53.427712 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 320475us
I20260709 13:10:53.413466 30732 raft_consensus.cc:2468] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 3.
I20260709 13:10:53.450875 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:53.451550 30103 raft_consensus.cc:3060] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:53.406509 32442 leader_election.cc:290] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:53.434808 32417 raft_consensus.cc:993] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a: : Instructing follower c99569d27a6f4c648eae7119fe3db124 to start an election
I20260709 13:10:53.437141 30027 raft_consensus.cc:2468] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 6.
I20260709 13:10:53.439771 32283 raft_consensus.cc:515] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:53.448031 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:53.461117 30703 leader_election.cc:304] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:10:53.409900 32479 raft_consensus.cc:3060] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:53.466506 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:10:53.468158 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 173478us
I20260709 13:10:53.473667 30703 leader_election.cc:304] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:10:53.476435 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 85089.8us
I20260709 13:10:53.477739 30068 leader_election.cc:400] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 election: Vote denied by peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469) with higher term. Message: Invalid argument: T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for earlier term 4. Current term is 5.
I20260709 13:10:53.459769 30103 raft_consensus.cc:2468] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 5.
W20260709 13:10:53.469746 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 81902us
I20260709 13:10:53.470132 30100 raft_consensus.cc:3060] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:53.478077 30068 leader_election.cc:403] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 13:10:53.404506 32477 raft_consensus.cc:2804] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:53.440639 32426 leader_election.cc:290] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:53.425920 32412 raft_consensus.cc:697] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 4 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:53.487112 32414 consensus_queue.cc:1048] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:53.464542 32278 raft_consensus.cc:2804] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:53.489331 29994 leader_election.cc:304] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:53.493927 32489 consensus_queue.cc:1048] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 13:10:53.485293 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:53.485530 32378 raft_consensus.cc:2749] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:53.503207 32289 leader_election.cc:290] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:53.505861 32134 leader_election.cc:290] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:53.513537 32283 leader_election.cc:290] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:53.470623 32377 raft_consensus.cc:1081] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 LEADER]: Signalling peer c99569d27a6f4c648eae7119fe3db124 to start an election
I20260709 13:10:53.489275 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:53.545419 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:53.551673 30100 raft_consensus.cc:1275] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:53.555989 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:53.486443 32417 raft_consensus.cc:2804] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:53.489248 32477 raft_consensus.cc:493] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:53.534305 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 45052.1us
I20260709 13:10:53.488487 32236 raft_consensus.cc:2749] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469) with higher term. Message: Invalid argument: T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for earlier term 4. Current term is 5.
I20260709 13:10:53.538272 32278 raft_consensus.cc:493] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:53.576836 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 88092.3us
I20260709 13:10:53.612867 32432 raft_consensus.cc:493] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
W20260709 13:10:53.613152 32485 log.cc:927] Time spent T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260709 13:10:53.613746 32161 raft_consensus.cc:493] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:53.613566 32432 raft_consensus.cc:515] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:53.614276 32161 raft_consensus.cc:515] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:53.614717 32410 raft_consensus.cc:2749] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:53.613062 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:53.574721 32417 raft_consensus.cc:493] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:53.574990 32442 raft_consensus.cc:493] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.576964 30733 raft_consensus.cc:3060] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:53.616526 30021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54198 (request call id 1750) took 1486 ms. Trace:
I20260709 13:10:53.622308 30023 raft_consensus.cc:2468] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 4.
I20260709 13:10:53.580703 32278 raft_consensus.cc:3060] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:53.630914 30703 leader_election.cc:304] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:10:53.638278 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:53.645268 30099 raft_consensus.cc:2468] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 4.
I20260709 13:10:53.574893 32477 raft_consensus.cc:3060] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:53.619288 32417 raft_consensus.cc:3060] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:53.667186 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:53.668833 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:53.661274 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:53.694440 30142 leader_election.cc:304] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:53.702517 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:53.736620 30025 raft_consensus.cc:1275] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:10:53.707692 30174 raft_consensus.cc:2468] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 7.
I20260709 13:10:53.760439 30022 raft_consensus.cc:2368] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 3. Current term is 4.
I20260709 13:10:53.761272 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:53.759631 30736 raft_consensus.cc:1275] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:10:53.761402 30142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 67055.6us
W20260709 13:10:53.695930 32467 log.cc:927] Time spent T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.605s	user 0.002s	sys 0.001s
I20260709 13:10:53.657728 32273 raft_consensus.cc:2804] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader election won for term 5
W20260709 13:10:53.680927 32484 log.cc:927] Time spent T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.263s	user 0.002s	sys 0.000s
I20260709 13:10:53.632925 32442 raft_consensus.cc:515] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:53.762174 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
W20260709 13:10:53.781493 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 210057us
I20260709 13:10:53.781720 30174 raft_consensus.cc:3060] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:10:53.780194 30170 raft_consensus.cc:1275] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:53.708024 32416 consensus_queue.cc:1048] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260709 13:10:53.794374 29993 leader_election.cc:304] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:53.755059 32131 raft_consensus.cc:515] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:53.763518 32373 leader_election.cc:290] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:10:53.817905 30019 consensus_meta.cc:287] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4: Time spent flushing consensus metadata: real 0.531s	user 0.006s	sys 0.002s
W20260709 13:10:53.863524 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 76856.2us
I20260709 13:10:53.864558 30019 raft_consensus.cc:2468] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 5.
I20260709 13:10:53.865383 30173 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c"
dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
 from {username='slave'} at 127.0.0.1:54540
I20260709 13:10:53.786329 32246 raft_consensus.cc:493] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.866935 30173 raft_consensus.cc:493] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 13:10:53.788754 32480 log.cc:927] Time spent T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260709 13:10:53.781174 32286 raft_consensus.cc:493] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:53.890355 32286 raft_consensus.cc:515] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:53.633378 30021 rpcz_store.cc:276] 0709 13:10:52.130091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.136397 (+  6306us) service_pool.cc:224] Handling call
0709 13:10:52.170782 (+ 34385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:52.171179 (+   397us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:52.171209 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:52.171722 (+   513us) log.cc:844] Serialized 26 byte log entry
0709 13:10:52.259596 (+ 87874us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:52.261189 (+  1593us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:52.269923 (+  8734us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:52.651044 (+381121us) spinlock_profiling.cc:243] Waited 2.65 ms on lock 0x7b4800080058. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f6fe3aa1 00007f99f6fdab37 00007f99f6fda9ca 00007f99f70d226f 00007f99f70d1f37 00007f99f70e655c 00007f99f70e6508 00007f99f70e6488 00007f99f70e6443 00007f99f70e56ec 00007f99f600fa96
0709 13:10:53.284050 (+633006us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b4400022b4c. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eeef3c85 00007f99eeef46a2 00007f99f1c661db 00007f99f1c61aaf 00007f99f1c5586e 00007f99f1c54bb6 00007f99f1c547d8 00007f99f1c5e221 00007f99f1c5e1d9 00007f99f1c5e169
0709 13:10:53.575401 (+291351us) raft_consensus.cc:1685] finished
0709 13:10:53.577033 (+  1632us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:53.598392 (+ 21359us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20431,"raft.queue_time_us":196,"raft.run_cpu_time_us":3727,"raft.run_wall_time_us":479899,"spinlock_wait_cycles":41972352,"thread_start_us":84691,"threads_started":1,"wal-append.queue_time_us":240914}
I20260709 13:10:53.826917 32449 raft_consensus.cc:493] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:53.892427 32286 leader_election.cc:290] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:10:53.788841 32436 log.cc:927] Time spent T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 13:10:53.892745 32449 raft_consensus.cc:515] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:10:53.893883 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 99594.3us
I20260709 13:10:53.894801 32449 leader_election.cc:290] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:53.895373 32449 raft_consensus.cc:2749] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:53.871786 30174 raft_consensus.cc:1275] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:10:53.893791 29994 leader_election.cc:304] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:53.886461 32417 raft_consensus.cc:515] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:53.895538 31729 consensus_queue.cc:1048] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:10:53.897362 32492 raft_consensus.cc:2804] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:53.897769 32492 raft_consensus.cc:493] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:53.898160 30140 leader_election.cc:304] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:53.898407 32417 leader_election.cc:290] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:10:53.798345 32488 log.cc:927] Time spent T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
W20260709 13:10:53.797729 32482 log.cc:927] Time spent T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.322s	user 0.000s	sys 0.001s
I20260709 13:10:53.899797 32134 raft_consensus.cc:2749] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:53.887249 32442 leader_election.cc:290] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:53.827883 32432 leader_election.cc:290] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:53.865257 30733 raft_consensus.cc:2468] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 7.
I20260709 13:10:53.814217 32161 leader_election.cc:290] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:53.762831 32412 consensus_queue.cc:237] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:53.902714 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:53.903285 30101 raft_consensus.cc:2468] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 5.
I20260709 13:10:53.789963 32273 raft_consensus.cc:697] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:53.904173 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:53.904608 32273 consensus_queue.cc:237] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:53.907177 32432 raft_consensus.cc:493] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:53.907717 32432 raft_consensus.cc:515] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:53.909677 32432 leader_election.cc:290] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:10:53.914476 32446 consensus_meta.cc:287] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124: Time spent flushing consensus metadata: real 0.716s	user 0.004s	sys 0.004s
I20260709 13:10:53.797605 32426 raft_consensus.cc:493] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:53.882386 30173 raft_consensus.cc:3060] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:53.915972 32426 raft_consensus.cc:515] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:53.916898 30103 raft_consensus.cc:2468] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 7.
I20260709 13:10:53.894888 32501 consensus_queue.cc:1048] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:10:53.918035 32426 leader_election.cc:290] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:53.920317 30096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33992 (request call id 1574) took 1198 ms. Trace:
I20260709 13:10:53.899333 30140 leader_election.cc:304] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:53.920673 30096 rpcz_store.cc:276] 0709 13:10:52.721585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.727439 (+  5854us) service_pool.cc:224] Handling call
0709 13:10:52.727775 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:52.734616 (+  6841us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:52.734645 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:52.735091 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 13:10:52.824113 (+ 89022us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:52.824152 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:52.824214 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:53.695121 (+870907us) spinlock_profiling.cc:243] Waited 1.21 ms on lock 0x7b4400022b4c. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eeef3c85 00007f99eeef46a2 00007f99f1c661db 00007f99f1c61aaf 00007f99f1c5586e 00007f99f1c54bb6 00007f99f1c547d8 00007f99f1c5e221 00007f99f1c5e1d9 00007f99f1c5e169
0709 13:10:53.920035 (+224914us) raft_consensus.cc:1685] finished
0709 13:10:53.920053 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:53.920259 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3599,"raft.queue_time_us":7480,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":25807,"spinlock_wait_cycles":2796544,"thread_start_us":84728,"threads_started":1,"wal-append.queue_time_us":225393}
I20260709 13:10:53.916864 30176 raft_consensus.cc:2468] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 5.
I20260709 13:10:53.922577 30140 leader_election.cc:304] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:53.923162 32404 consensus_queue.cc:1048] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:53.923734 32131 leader_election.cc:290] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:53.924850 30735 raft_consensus.cc:2393] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 6: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:10:53.927099 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:53.927664 30175 raft_consensus.cc:3060] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:53.923658 30140 leader_election.cc:304] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:53.932572 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:53.933221 30098 raft_consensus.cc:2468] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 5.
I20260709 13:10:53.898121 32492 raft_consensus.cc:3060] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:53.921202 32315 consensus_meta.cc:287] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124: Time spent flushing consensus metadata: real 0.542s	user 0.006s	sys 0.001s
I20260709 13:10:53.937319 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:53.942940 30022 raft_consensus.cc:2468] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 7.
I20260709 13:10:53.938650 30140 leader_election.cc:304] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:53.944694 29994 leader_election.cc:304] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:53.941159 30173 raft_consensus.cc:515] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:53.947026 30174 raft_consensus.cc:1240] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:53.947609 30140 leader_election.cc:400] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 election: Vote denied by peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451) with higher term. Message: Invalid argument: T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 3. Current term is 4.
I20260709 13:10:53.947907 30140 leader_election.cc:403] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 13:10:53.947156 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:53.950229 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:53.951246 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:53.951972 30019 raft_consensus.cc:2368] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 5. Current term is 6.
I20260709 13:10:53.953112 30025 raft_consensus.cc:2393] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 5: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:53.939780 30024 raft_consensus.cc:2955] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index 2 to 4, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:53.957474 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:53.988139 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:53.937673 32289 raft_consensus.cc:2804] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:53.922032 32487 raft_consensus.cc:493] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:53.943981 32446 raft_consensus.cc:2749] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:53.994451 30173 leader_election.cc:290] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:53.995316 32475 raft_consensus.cc:2749] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451) with higher term. Message: Invalid argument: T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 3. Current term is 4.
I20260709 13:10:53.995527 30094 raft_consensus.cc:1275] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:10:53.995930 32506 raft_consensus.cc:2804] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:53.996335 32506 raft_consensus.cc:493] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:53.949990 32161 raft_consensus.cc:2749] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:53.996647 32506 raft_consensus.cc:3060] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:53.984582 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:53.999853 32289 raft_consensus.cc:697] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 6 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:54.000839 32289 consensus_queue.cc:237] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:53.945374 32442 raft_consensus.cc:2749] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:54.002848 30140 leader_election.cc:304] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:54.004981 30140 leader_election.cc:400] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Vote denied by peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451) with higher term. Message: Invalid argument: T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 5. Current term is 6.
I20260709 13:10:54.005230 30140 leader_election.cc:403] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:10:54.007838 32134 raft_consensus.cc:2804] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:54.008249 32134 raft_consensus.cc:493] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:54.008574 32134 raft_consensus.cc:3060] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:54.010993 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:54.011509 30022 raft_consensus.cc:3060] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:54.013906 32476 raft_consensus.cc:2749] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451) with higher term. Message: Invalid argument: T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 5. Current term is 6.
I20260709 13:10:54.014585 32506 raft_consensus.cc:515] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:53.933820 32246 raft_consensus.cc:515] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:54.020924 29994 leader_election.cc:304] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:54.020149 30022 raft_consensus.cc:2468] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 6.
I20260709 13:10:54.026854 30175 raft_consensus.cc:2468] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 6.
I20260709 13:10:53.946898 32315 raft_consensus.cc:515] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:54.017516 32425 consensus_meta.cc:287] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719: Time spent flushing consensus metadata: real 0.733s	user 0.006s	sys 0.003s
I20260709 13:10:54.039434 30095 raft_consensus.cc:1275] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:10:54.039816 30095 pending_rounds.cc:85] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719: Aborting all ops after (but not including) 5
I20260709 13:10:54.040063 30095 pending_rounds.cc:107] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:10:54.040316 30095 raft_consensus.cc:2889] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:54.028127 30021 raft_consensus.cc:1240] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:54.048255 30171 raft_consensus.cc:1240] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:10:54.046846 30022 raft_consensus.cc:1275] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:54.031522 32433 raft_consensus.cc:2804] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:54.044016 32236 raft_consensus.cc:493] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.056524 32236 raft_consensus.cc:515] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:54.051191 32433 raft_consensus.cc:493] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:54.057541 32433 raft_consensus.cc:3060] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:54.057723 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:54.062166 32315 leader_election.cc:290] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:54.063047 32377 consensus_queue.cc:1048] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:54.063200 32477 raft_consensus.cc:515] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:54.065236 32477 leader_election.cc:290] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:54.006225 32487 raft_consensus.cc:515] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:54.053485 32278 raft_consensus.cc:515] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:54.129788 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:54.150048 30023 raft_consensus.cc:2410] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260709 13:10:54.083494 32479 consensus_meta.cc:287] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124: Time spent flushing consensus metadata: real 0.567s	user 0.008s	sys 0.000s
I20260709 13:10:54.057240 30097 raft_consensus.cc:1240] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 4. Current term is 5. Ops: []
W20260709 13:10:54.151746 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 146871us
I20260709 13:10:54.093309 30169 raft_consensus.cc:2393] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 6: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:10:54.157737 30140 leader_election.cc:304] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:54.142731 32317 raft_consensus.cc:2749] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:54.093397 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:54.148113 32246 leader_election.cc:290] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:54.199111 32278 leader_election.cc:290] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:54.096428 32510 raft_consensus.cc:493] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:54.122022 32492 raft_consensus.cc:515] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:54.185655 32315 consensus_queue.cc:1059] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 13:10:54.185693 32404 raft_consensus.cc:493] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:54.195802 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:54.179018 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:54.178597 32414 raft_consensus.cc:493] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.178684 32479 raft_consensus.cc:2749] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451) with higher term. Message: Invalid argument: T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 4. Current term is 5.
I20260709 13:10:54.186972 32477 raft_consensus.cc:2804] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:54.202863 30021 raft_consensus.cc:1240] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:54.199913 32506 leader_election.cc:290] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:54.211926 30094 raft_consensus.cc:3060] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:54.219249 30020 raft_consensus.cc:1240] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:54.215804 32477 raft_consensus.cc:697] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 6 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:54.208318 32404 raft_consensus.cc:515] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:54.238379 32134 raft_consensus.cc:515] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:54.240525 32134 leader_election.cc:290] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:54.241387 32492 leader_election.cc:290] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:54.243769 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:54.243927 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:54.244350 30026 raft_consensus.cc:3060] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:54.244518 30097 raft_consensus.cc:3060] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:54.212684 32414 raft_consensus.cc:515] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:54.252056 32134 raft_consensus.cc:493] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:54.252410 32414 leader_election.cc:290] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:54.238855 32487 leader_election.cc:290] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:54.255264 32134 raft_consensus.cc:515] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:54.257295 32134 leader_election.cc:290] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:54.207602 32510 raft_consensus.cc:515] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:54.260596 30026 raft_consensus.cc:2468] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 8.
I20260709 13:10:54.261408 32510 leader_election.cc:290] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:54.263612 30140 leader_election.cc:304] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:54.265787 30094 raft_consensus.cc:2468] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 6.
I20260709 13:10:54.267443 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:54.265977 32134 raft_consensus.cc:2804] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:10:54.270143 32134 raft_consensus.cc:697] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 8 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:54.271030 32134 consensus_queue.cc:237] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:54.274084 32477 consensus_queue.cc:237] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:54.283861 30735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51004 (request call id 556) took 1064 ms. Trace:
I20260709 13:10:54.285432 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:54.286223 30019 raft_consensus.cc:2393] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 8: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:10:54.284278 30735 rpcz_store.cc:276] 0709 13:10:53.219028 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.377646 (+158618us) service_pool.cc:224] Handling call
0709 13:10:54.283658 (+906012us) spinlock_profiling.cc:243] Waited 535 ms on lock 0x7b5400748454. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:10:54.283798 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1231389568}
I20260709 13:10:54.330875 29994 leader_election.cc:304] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:54.273574 32433 raft_consensus.cc:515] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:54.343139 32278 raft_consensus.cc:3055] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:54.343566 32278 raft_consensus.cc:740] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:54.344306 32278 consensus_queue.cc:260] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:54.325675 32435 consensus_queue.cc:1048] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 13:10:54.334393 32431 raft_consensus.cc:2804] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:54.354945 32278 raft_consensus.cc:3060] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:54.378156 30702 leader_election.cc:304] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
W20260709 13:10:54.390285 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 495395us
I20260709 13:10:54.394272 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:54.394979 30735 raft_consensus.cc:3055] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:54.395303 30735 raft_consensus.cc:740] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:54.354897 32431 raft_consensus.cc:697] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:54.397871 30736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56954 (request call id 496) took 1277 ms. Trace:
I20260709 13:10:54.402882 30142 leader_election.cc:304] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:54.405337 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:54.403287 30736 rpcz_store.cc:276] 0709 13:10:53.112100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.112204 (+   104us) service_pool.cc:224] Handling call
0709 13:10:53.755398 (+643194us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:53.769745 (+ 14347us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.389040 (+619295us) spinlock_profiling.cc:243] Waited 530 ms on lock 0x7b5400485650. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20b98ad 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:10:54.389149 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1219937024}
I20260709 13:10:54.402197 32134 raft_consensus.cc:493] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:54.411144 30177 raft_consensus.cc:2468] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 5.
I20260709 13:10:54.389382 32510 raft_consensus.cc:2804] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:54.414268 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:54.411871 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:54.386621 32236 leader_election.cc:290] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:54.394707 32477 raft_consensus.cc:493] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:54.414029 29993 leader_election.cc:304] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:10:54.413993 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:54.413467 32134 raft_consensus.cc:515] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:54.387053 32161 raft_consensus.cc:493] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:54.421569 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:54.394357 32461 raft_consensus.cc:493] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.419260 30026 raft_consensus.cc:1275] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:10:54.425652 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:54.427323 29993 leader_election.cc:304] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:54.430023 30702 leader_election.cc:304] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:54.411201 32315 raft_consensus.cc:2749] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:54.430258 32161 raft_consensus.cc:515] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:54.429858 32477 raft_consensus.cc:515] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:54.434072 32161 leader_election.cc:290] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:54.434405 32477 leader_election.cc:290] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:54.411553 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:54.435365 30733 raft_consensus.cc:2393] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 6: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:10:54.417553 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:54.407105 32471 consensus_queue.cc:1059] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:10:54.430290 31729 raft_consensus.cc:2804] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:54.440606 31729 raft_consensus.cc:493] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:54.440966 31729 raft_consensus.cc:3060] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:54.445495 30142 leader_election.cc:304] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:54.446892 32370 raft_consensus.cc:2749] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:54.448977 32461 raft_consensus.cc:515] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:54.450678 32419 raft_consensus.cc:2749] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:54.450806 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:54.451889 32492 raft_consensus.cc:2804] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:10:54.452350 32492 raft_consensus.cc:697] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:54.452937 32417 raft_consensus.cc:493] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:54.409631 32404 leader_election.cc:290] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:54.451026 32461 leader_election.cc:290] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:54.453477 32417 raft_consensus.cc:515] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:54.458122 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:54.428926 32510 raft_consensus.cc:697] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:54.460990 31729 raft_consensus.cc:515] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:54.480562 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:54.483783 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:54.447417 32134 leader_election.cc:290] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:54.497028 32131 raft_consensus.cc:493] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.497617 32131 raft_consensus.cc:515] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:54.499867 32131 leader_election.cc:290] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:54.500190 32417 leader_election.cc:290] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:54.500751 32246 consensus_queue.cc:1059] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:54.482102 32414 raft_consensus.cc:493] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:54.507829 32414 raft_consensus.cc:515] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:54.483000 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:54.510293 30729 raft_consensus.cc:2468] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 5.
I20260709 13:10:54.476347 32404 raft_consensus.cc:493] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.511385 30142 leader_election.cc:304] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:54.511655 32404 raft_consensus.cc:515] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:54.486359 32377 raft_consensus.cc:493] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:54.514186 32377 raft_consensus.cc:515] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:54.516165 32377 leader_election.cc:290] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:54.519181 30170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54540 (request call id 504) took 1288 ms. Trace:
I20260709 13:10:54.519608 30170 rpcz_store.cc:276] 0709 13:10:53.231008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.238498 (+  7490us) service_pool.cc:224] Handling call
0709 13:10:53.736200 (+497702us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:53.788670 (+ 52470us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.518963 (+730293us) spinlock_profiling.cc:243] Waited 411 ms on lock 0x7b5400407ed0. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20b98ad 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:10:54.519102 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":945891712}
I20260709 13:10:54.526310 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
W20260709 13:10:54.529217 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 101964us
I20260709 13:10:54.530898 32476 raft_consensus.cc:2804] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:54.531316 32476 raft_consensus.cc:493] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:54.531661 32476 raft_consensus.cc:3060] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:54.483206 32236 raft_consensus.cc:493] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:54.538914 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:54.542075 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:54.542778 30168 raft_consensus.cc:2393] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 5: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:10:54.543308 30103 raft_consensus.cc:2468] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 5.
I20260709 13:10:54.513644 32404 leader_election.cc:290] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:54.552892 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:54.559796 29994 leader_election.cc:304] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:54.528702 32433 leader_election.cc:290] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:54.575757 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:54.453128 32492 consensus_queue.cc:237] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:54.551038 32315 raft_consensus.cc:493] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:54.551322 32414 leader_election.cc:290] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:54.586197 29994 leader_election.cc:304] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:54.598102 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:54.602993 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:54.603951 30172 raft_consensus.cc:2393] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 5: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:10:54.603112 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:54.552418 32417 consensus_queue.cc:1048] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 13:10:54.528323 32431 consensus_queue.cc:237] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:54.540396 32236 raft_consensus.cc:515] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:54.580677 32536 raft_consensus.cc:2764] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:10:54.598011 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:54.650993 30176 raft_consensus.cc:2410] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:10:54.624257 32068 raft_consensus.cc:2804] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:54.602070 32315 raft_consensus.cc:515] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:54.654353 30734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51004 (request call id 553) took 1436 ms. Trace:
I20260709 13:10:54.655988 30734 rpcz_store.cc:276] 0709 13:10:53.218309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.414060 (+195751us) service_pool.cc:224] Handling call
0709 13:10:53.445292 (+ 31232us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:53.445656 (+   364us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:53.445683 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:53.469975 (+ 24292us) log.cc:844] Serialized 26 byte log entry
0709 13:10:53.577420 (+107445us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:53.577456 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:53.577518 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:53.804198 (+226680us) raft_consensus.cc:1685] finished
0709 13:10:53.804216 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:54.654135 (+849919us) spinlock_profiling.cc:243] Waited 30.9 ms on lock 0x7b54005c1a50. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20b98ad 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:10:54.654298 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":82,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":15973,"spinlock_wait_cycles":71103360,"thread_start_us":63021,"threads_started":1,"wal-append.queue_time_us":288655}
W20260709 13:10:54.659792 32535 log.cc:927] Time spent T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:10:54.669266 30173 raft_consensus.cc:2468] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 7.
I20260709 13:10:54.603933 32510 consensus_queue.cc:237] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:54.675609 30735 consensus_queue.cc:260] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:54.679049 31729 leader_election.cc:290] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:54.687261 30143 leader_election.cc:304] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:54.695281 32289 raft_consensus.cc:2804] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:54.695580 30143 leader_election.cc:400] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 election: Vote denied by peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821) with higher term. Message: Invalid argument: T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 4. Current term is 5.
I20260709 13:10:54.695685 32289 raft_consensus.cc:493] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:54.696240 32289 raft_consensus.cc:3060] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:54.696640 30703 leader_election.cc:304] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:54.697705 32315 leader_election.cc:290] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:54.704046 32414 raft_consensus.cc:2749] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:54.705171 32540 consensus_queue.cc:1059] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:54.668673 32068 raft_consensus.cc:697] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:54.706627 32068 consensus_queue.cc:237] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:54.708046 32289 raft_consensus.cc:515] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:54.709084 30169 raft_consensus.cc:1240] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:10:54.711192 30734 raft_consensus.cc:1275] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:10:54.713001 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 111000us
I20260709 13:10:54.716212 32419 consensus_queue.cc:1059] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:54.717110 30735 raft_consensus.cc:3060] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:54.717217 32419 raft_consensus.cc:3055] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:54.717680 32419 raft_consensus.cc:740] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:54.718533 32419 consensus_queue.cc:260] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:54.719900 32419 raft_consensus.cc:3060] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:54.722157 32544 raft_consensus.cc:493] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:54.722685 32544 raft_consensus.cc:515] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:54.724558 32544 leader_election.cc:290] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:54.724774 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:54.726226 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:54.727778 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:54.728333 30026 raft_consensus.cc:2468] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 7.
I20260709 13:10:54.715380 28889 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:10:54.730255 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:54.732399 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:54.736904 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:54.737916 32134 raft_consensus.cc:493] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:54.743248 30170 raft_consensus.cc:1275] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:54.743664 32134 raft_consensus.cc:515] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:54.744320 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:54.747906 30728 raft_consensus.cc:2393] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 5: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:10:54.758209 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:10:54.750342 30097 consensus_meta.cc:287] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719: Time spent flushing consensus metadata: real 0.505s	user 0.007s	sys 0.004s
I20260709 13:10:54.763792 30026 raft_consensus.cc:1275] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:54.762606 30068 leader_election.cc:304] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:54.765559 30735 raft_consensus.cc:2468] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 6.
I20260709 13:10:54.748800 32412 raft_consensus.cc:493] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:54.749281 32414 raft_consensus.cc:493] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
W20260709 13:10:54.761663 29924 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51818 (request call id 321) took 12826 ms (client timeout 15000 ms). Trace:
I20260709 13:10:54.770012 30068 leader_election.cc:304] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:54.764103 30097 raft_consensus.cc:2468] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 5.
I20260709 13:10:54.761878 32404 consensus_queue.cc:1048] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
W20260709 13:10:54.768942 29924 rpcz_store.cc:269] 0709 13:10:41.935065 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:41.935251 (+   186us) service_pool.cc:224] Handling call
0709 13:10:54.761606 (+12826355us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:51.642610 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:51.696776 (+ 54166us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:51.696825 (+    49us) write_op.cc:435] Acquired schema lock
0709 13:10:51.696843 (+    18us) tablet.cc:662] Decoding operations
0709 13:10:51.697730 (+   887us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:51.697855 (+   125us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:51.697888 (+    33us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:10:51.698636 (+   748us) tablet.cc:701] Row locks acquired
0709 13:10:51.698676 (+    40us) write_op.cc:260] PREPARE: finished
0709 13:10:51.698842 (+   166us) write_op.cc:270] Start()
0709 13:10:51.699000 (+   158us) write_op.cc:276] Timestamp: P: 1783602651698783 usec, L: 0
0709 13:10:51.699033 (+    33us) op_driver.cc:348] REPLICATION: starting
0709 13:10:51.749252 (+ 50219us) log.cc:844] Serialized 2834 byte log entry
0709 13:10:52.581254 (+832002us) op_driver.cc:464] REPLICATION: finished
0709 13:10:52.675068 (+ 93814us) write_op.cc:301] APPLY: starting
0709 13:10:52.689812 (+ 14744us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:52.690042 (+   230us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:52.690169 (+   127us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:52.732949 (+ 42780us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:52.733296 (+   347us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:10:52.733355 (+    59us) write_op.cc:312] APPLY: finished
0709 13:10:52.733681 (+   326us) log.cc:844] Serialized 59 byte log entry
0709 13:10:52.733871 (+   190us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:52.733972 (+   101us) write_op.cc:454] Released schema lock
0709 13:10:52.734043 (+    71us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:52.734459 (+   416us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:52.734491 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":56604,"reported_tablets":21,"child_traces":[["op",{"apply.queue_time_us":58327,"apply.run_cpu_time_us":3315,"apply.run_wall_time_us":94580,"num_ops":7,"prepare.queue_time_us":275075,"prepare.run_cpu_time_us":65795,"prepare.run_wall_time_us":415541,"raft.queue_time_us":128406,"raft.run_cpu_time_us":2193,"raft.run_wall_time_us":40867,"replication_time_us":882060,"spinlock_wait_cycles":68352,"thread_start_us":351918,"threads_started":4,"wal-append.queue_time_us":358570,"wal-append.run_cpu_time_us":8555,"wal-append.run_wall_time_us":1607003}]]}
I20260709 13:10:54.780496 30140 leader_election.cc:304] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
W20260709 13:10:54.775741 32516 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:10:54.783983 32542 consensus_queue.cc:1048] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:54.776037 32541 raft_consensus.cc:2749] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:54.785677 32236 leader_election.cc:290] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:54.779666 32281 raft_consensus.cc:2749] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:54.792122 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:54.792143 30068 leader_election.cc:304] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:54.793077 30735 raft_consensus.cc:3060] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:54.775375 30095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48558 (request call id 412) took 1326 ms. Trace:
I20260709 13:10:54.797946 30068 leader_election.cc:304] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:54.761456 32286 consensus_queue.cc:1048] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:10:54.805588 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:54.763965 32476 raft_consensus.cc:515] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:54.808724 30168 raft_consensus.cc:1240] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:54.780396 32412 raft_consensus.cc:515] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:54.809789 32476 leader_election.cc:290] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:54.803443 32134 leader_election.cc:290] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:54.810524 32412 leader_election.cc:290] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:54.811741 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:54.811977 32289 leader_election.cc:290] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:54.782135 32414 raft_consensus.cc:515] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:54.790900 32420 raft_consensus.cc:2804] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:54.813905 32420 raft_consensus.cc:493] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:54.814419 32414 leader_election.cc:290] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:54.804710 32236 raft_consensus.cc:2804] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:54.814289 32420 raft_consensus.cc:3060] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:54.815800 32286 raft_consensus.cc:2749] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:10:54.817126 30143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.796530 30095 rpcz_store.cc:276] 0709 13:10:53.448745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.462492 (+ 13747us) service_pool.cc:224] Handling call
0709 13:10:53.562241 (+ 99749us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:54.040778 (+478537us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:54.775027 (+734249us) spinlock_profiling.cc:243] Waited 473 ms on lock 0x7b540026acd4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:10:54.775291 (+   264us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1088104192}
I20260709 13:10:54.819145 30068 leader_election.cc:304] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:54.820593 30068 leader_election.cc:304] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:54.815218 32236 raft_consensus.cc:493] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:54.828418 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:54.828966 30099 raft_consensus.cc:3060] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:10:54.829859 30735 raft_consensus.cc:2468] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 6.
I20260709 13:10:54.835439 29993 leader_election.cc:304] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:54.836046 30026 raft_consensus.cc:1275] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:54.838290 32238 raft_consensus.cc:2804] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:54.838816 32238 raft_consensus.cc:697] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:54.839699 32238 consensus_queue.cc:237] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:54.837445 30099 raft_consensus.cc:2468] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 6.
I20260709 13:10:54.848455 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:54.849318 30099 raft_consensus.cc:3060] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:54.821059 32544 raft_consensus.cc:2749] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:54.826618 32413 raft_consensus.cc:3060] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:54.845279 32236 raft_consensus.cc:3060] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:54.860867 30099 raft_consensus.cc:2468] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 6.
I20260709 13:10:54.823926 32412 consensus_queue.cc:1048] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:10:54.874751 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:54.889901 30177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43840 (request call id 1671) took 1428 ms. Trace:
I20260709 13:10:54.890400 30177 rpcz_store.cc:276] 0709 13:10:53.447655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:53.447771 (+   116us) service_pool.cc:224] Handling call
0709 13:10:54.876097 (+1428326us) spinlock_profiling.cc:243] Waited 748 ms on lock 0x7b5400175a54. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:10:54.876190 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1719386496}
I20260709 13:10:54.871950 30097 raft_consensus.cc:1275] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 13:10:55.357661 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 439206us
I20260709 13:10:55.355666 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:55.360392 30169 raft_consensus.cc:1240] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:10:55.240491 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:55.362730 30100 raft_consensus.cc:2468] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 4.
I20260709 13:10:55.242169 30102 raft_consensus.cc:1240] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:55.106946 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:55.186954 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:55.363986 30098 raft_consensus.cc:2468] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 3.
I20260709 13:10:55.234966 30096 raft_consensus.cc:1275] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:10:54.886626 30095 raft_consensus.cc:1240] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:10:55.367947 30734 raft_consensus.cc:1275] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:55.368093 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:55.370682 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:54.923132 30700 leader_election.cc:304] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:55.193198 32420 raft_consensus.cc:515] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:55.373163 30174 raft_consensus.cc:1240] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:55.374622 32420 leader_election.cc:290] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:55.375074 32270 raft_consensus.cc:493] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.375557 32270 raft_consensus.cc:515] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:55.377564 32270 leader_election.cc:290] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:55.377791 32425 raft_consensus.cc:493] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.378311 32425 raft_consensus.cc:515] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:55.380296 32425 leader_election.cc:290] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:55.381011 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
W20260709 13:10:54.924046 32553 log.cc:927] Time spent T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:10:55.390085 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:55.390635 30098 raft_consensus.cc:3060] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:55.390391 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:55.075961 32502 raft_consensus.cc:493] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.382311 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:55.397214 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:55.397969 30101 raft_consensus.cc:2468] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 4.
I20260709 13:10:55.384770 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:55.382802 30068 leader_election.cc:304] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:54.889293 32286 raft_consensus.cc:493] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:55.390637 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
W20260709 13:10:55.381831 30143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:54.903978 32492 consensus_queue.cc:1059] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.491s
I20260709 13:10:55.075222 32413 raft_consensus.cc:2749] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:55.368925 32412 raft_consensus.cc:493] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.092465 32513 raft_consensus.cc:493] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:55.193466 29926 catalog_manager.cc:5697] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:55.135937 32246 raft_consensus.cc:493] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:55.361676 32419 raft_consensus.cc:493] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:55.103156 30733 raft_consensus.cc:1275] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:10:55.024320 32289 raft_consensus.cc:493] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:54.907773 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:55.402953 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:54.896063 32510 raft_consensus.cc:493] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:55.091835 30020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52098 (request call id 426) took 1082 ms. Trace:
I20260709 13:10:55.367862 32378 consensus_queue.cc:1059] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 13:10:55.412566 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:55.413030 30099 raft_consensus.cc:2393] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 6: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:10:55.416530 30143 leader_election.cc:304] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:55.418718 32435 raft_consensus.cc:3055] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:55.386175 32315 raft_consensus.cc:493] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:55.252835 32236 raft_consensus.cc:515] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:54.948020 32557 consensus_queue.cc:1048] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.466s
I20260709 13:10:54.914974 32479 consensus_queue.cc:1048] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.499s
I20260709 13:10:55.396306 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
W20260709 13:10:55.434739 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 71714.6us
I20260709 13:10:55.381317 32414 consensus_queue.cc:1048] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 13:10:55.418135 32270 consensus_queue.cc:1059] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:10:55.438923 32544 raft_consensus.cc:493] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:55.474124 32276 raft_consensus.cc:493] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:55.405843 32281 raft_consensus.cc:2804] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:55.474298 32544 raft_consensus.cc:515] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:55.438108 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:55.476385 32544 leader_election.cc:290] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:55.423429 32513 raft_consensus.cc:515] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:55.435988 32413 raft_consensus.cc:493] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:55.478731 32557 raft_consensus.cc:2749] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:55.479043 32413 raft_consensus.cc:515] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:55.415180 32425 raft_consensus.cc:493] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:55.480572 32425 raft_consensus.cc:515] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:55.417186 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:55.481021 32413 leader_election.cc:290] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:55.423427 32419 raft_consensus.cc:515] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:55.482074 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:55.483070 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:55.483311 32419 leader_election.cc:290] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:55.423893 29926 catalog_manager.cc:5697] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 2 to 3, leader changed from 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) to 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68). New cstate: current_term: 3 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:55.421037 32278 raft_consensus.cc:493] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.471688 32315 raft_consensus.cc:515] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:55.410766 32286 raft_consensus.cc:515] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:55.468730 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:55.485965 30098 raft_consensus.cc:2468] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 4.
I20260709 13:10:55.486090 32315 leader_election.cc:290] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:55.440766 30730 raft_consensus.cc:3060] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:55.487058 32286 leader_election.cc:290] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:55.422402 32412 raft_consensus.cc:515] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:55.488566 32561 log.cc:927] Time spent T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:10:55.484661 29926 catalog_manager.cc:5697] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 3 to 4, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 4 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } }
I20260709 13:10:55.414592 32317 raft_consensus.cc:493] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:55.489861 32317 raft_consensus.cc:515] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:55.489581 29926 catalog_manager.cc:5697] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:55.434275 30020 rpcz_store.cc:276] 0709 13:10:54.009562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.011603 (+  2041us) service_pool.cc:224] Handling call
0709 13:10:54.011872 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:54.232498 (+220626us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:55.075503 (+843005us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b5400355054. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:10:55.091741 (+ 16238us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":467912960}
I20260709 13:10:55.492889 32278 raft_consensus.cc:515] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:55.435247 32289 raft_consensus.cc:515] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:55.476279 32236 leader_election.cc:290] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:55.494906 32278 leader_election.cc:290] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451)
I20260709 13:10:55.495659 30172 raft_consensus.cc:1275] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:10:55.491978 29926 catalog_manager.cc:5697] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } }
I20260709 13:10:55.497939 32501 raft_consensus.cc:493] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.495492 32289 leader_election.cc:290] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:55.498543 32501 raft_consensus.cc:515] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:55.499482 29926 catalog_manager.cc:5697] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 3 to 4, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 4 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } }
I20260709 13:10:55.488618 32425 leader_election.cc:290] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:55.491882 32317 leader_election.cc:290] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:55.502209 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:55.435148 32487 raft_consensus.cc:493] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.504572 30100 raft_consensus.cc:2468] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 3.
I20260709 13:10:55.506321 29926 catalog_manager.cc:5697] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } }
I20260709 13:10:55.507932 29926 catalog_manager.cc:5697] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } }
I20260709 13:10:55.474686 32276 raft_consensus.cc:515] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:55.406121 32502 raft_consensus.cc:515] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:55.510149 29926 catalog_manager.cc:5697] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 1 to 2, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 2 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:10:55.509981 32414 raft_consensus.cc:2749] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:55.464870 30728 raft_consensus.cc:1240] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 13:10:55.515136 32378 raft_consensus.cc:3055] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:55.420816 32246 raft_consensus.cc:515] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:55.496102 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:55.500509 32501 leader_election.cc:290] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:55.516224 32276 leader_election.cc:290] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:55.516383 30730 raft_consensus.cc:2468] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 4.
I20260709 13:10:55.463964 32435 raft_consensus.cc:740] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:55.526278 30730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51004 (request call id 567) took 1130 ms. Trace:
I20260709 13:10:55.532640 30177 raft_consensus.cc:1275] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:55.511457 32516 raft_consensus.cc:493] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.526683 32435 consensus_queue.cc:260] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:55.441218 32510 raft_consensus.cc:515] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:56.011523 32420 raft_consensus.cc:493] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:55.702991 32276 raft_consensus.cc:493] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:55.553674 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:56.016914 32420 raft_consensus.cc:515] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:55.900502 29994 leader_election.cc:304] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:55.788363 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:55.517622 32487 raft_consensus.cc:515] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:55.523022 32378 raft_consensus.cc:740] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:55.564270 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:55.554765 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:56.048924 30175 raft_consensus.cc:2468] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 5.
I20260709 13:10:55.547019 32246 leader_election.cc:290] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:55.567533 30732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51014 (request call id 765) took 1032 ms. Trace:
I20260709 13:10:55.716629 32492 raft_consensus.cc:493] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:55.795347 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:56.052060 30023 raft_consensus.cc:2468] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 5.
I20260709 13:10:55.565029 30096 raft_consensus.cc:2468] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 8.
I20260709 13:10:55.788542 30019 raft_consensus.cc:1275] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:10:56.023101 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:56.014248 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:55.551606 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:56.054291 30026 raft_consensus.cc:2468] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 4.
I20260709 13:10:56.054944 30177 raft_consensus.cc:2393] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 4: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:10:55.702858 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:56.055819 30027 raft_consensus.cc:2410] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:55.573485 29926 catalog_manager.cc:5697] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 2 to 3, leader changed from 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 3 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } }
I20260709 13:10:55.553052 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:56.050241 30732 rpcz_store.cc:276] 0709 13:10:54.534964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.536258 (+  1294us) service_pool.cc:224] Handling call
0709 13:10:55.107876 (+571618us) spinlock_profiling.cc:243] Waited 2.47 ms on lock 0x7b5800004898. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eef95b71 00007f99eef95eee 0000000000375939 00007f99f70091e0 00007f99f70d20c4 00007f99f70d2131 00007f99f7093fc0 00007f99f707e929 00007f99f707e3d2 00007f99f05f5bd4
0709 13:10:55.108053 (+   177us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:55.539920 (+431867us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:55.539956 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:55.540001 (+    45us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:10:55.540049 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:55.567310 (+ 27261us) spinlock_profiling.cc:243] Waited 422 ms on lock 0x7b54006914d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:10:55.567359 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:55.567472 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":975300224}
I20260709 13:10:56.056931 30171 raft_consensus.cc:2468] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 3.
W20260709 13:10:56.031796 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 131382us
I20260709 13:10:56.017560 32412 leader_election.cc:290] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:56.032979 32504 raft_consensus.cc:2804] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:56.029186 32134 raft_consensus.cc:493] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:56.020229 32435 raft_consensus.cc:3060] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:55.542171 32562 log.cc:927] Time spent T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260709 13:10:56.034610 30024 raft_consensus.cc:1240] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:56.035547 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:56.031309 32276 raft_consensus.cc:515] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:55.544799 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:56.037019 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 13:10:56.089375 30173 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.004s	sys 0.008s
W20260709 13:10:56.089784 30173 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.005s	sys 0.009s
I20260709 13:10:55.716423 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:56.043105 32378 consensus_queue.cc:260] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:55.562312 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
W20260709 13:10:56.103878 30142 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.020s	sys 0.033s
I20260709 13:10:55.663405 32507 raft_consensus.cc:3055] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:55.526693 30730 rpcz_store.cc:276] 0709 13:10:54.395429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.397291 (+  1862us) service_pool.cc:224] Handling call
0709 13:10:54.907617 (+510326us) spinlock_profiling.cc:243] Waited 2.67 ms on lock 0x7b5800004898. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eef95b71 00007f99eef95a22 00007f99f7eaec09 00007f99f7008ee0 00007f99f70d20ab 00007f99f70d2131 00007f99f70800a0 00007f99f707f984 00007f99f05fa6d4 00007f99f05fa662
0709 13:10:55.526184 (+618567us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6131072}
I20260709 13:10:56.021323 32516 raft_consensus.cc:515] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:56.047847 32487 leader_election.cc:290] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:56.029067 32502 leader_election.cc:290] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:55.541571 32513 leader_election.cc:290] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:55.868002 32236 raft_consensus.cc:493] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:56.030491 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:56.060858 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:56.062229 32504 raft_consensus.cc:697] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:56.063565 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:56.113703 30023 raft_consensus.cc:2468] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 4.
W20260709 13:10:56.063910 29991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:56.064184 29926 catalog_manager.cc:5697] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 3 to 4, leader changed from 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) to 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68). New cstate: current_term: 4 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:10:55.545552 32425 consensus_queue.cc:1059] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.518s
I20260709 13:10:56.066561 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:56.062940 32286 raft_consensus.cc:493] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
W20260709 13:10:56.089938 29992 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.008s	sys 0.005s
W20260709 13:10:56.090448 30700 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.002s	sys 0.010s
W20260709 13:10:56.125264 29992 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.008s	sys 0.006s
W20260709 13:10:56.125358 30700 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.003s	sys 0.011s
W20260709 13:10:56.126015 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 1.20289e+06us
I20260709 13:10:56.126616 30103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48558 (request call id 417) took 1300 ms. Trace:
W20260709 13:10:56.090240 30736 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.002s	sys 0.012s
W20260709 13:10:56.127323 30736 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.002s	sys 0.012s
W20260709 13:10:56.090148 30703 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.009s	sys 0.004s
W20260709 13:10:56.128307 30703 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.743s	user 0.009s	sys 0.004s
W20260709 13:10:56.090049 30143 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.010s	sys 0.003s
W20260709 13:10:56.129431 30143 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.010s	sys 0.003s
W20260709 13:10:56.129982 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 713458us
I20260709 13:10:56.127012 30103 rpcz_store.cc:276] 0709 13:10:54.826184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.826983 (+   799us) service_pool.cc:224] Handling call
0709 13:10:54.848214 (+ 21231us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:54.850275 (+  2061us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:54.850304 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:54.860792 (+ 10488us) log.cc:844] Serialized 26 byte log entry
0709 13:10:55.156199 (+295407us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:55.156243 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:55.156317 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:56.126410 (+970093us) raft_consensus.cc:1685] finished
0709 13:10:56.126431 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:56.126557 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":70,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":1612,"thread_start_us":272911,"threads_started":1,"wal-append.queue_time_us":618913}
I20260709 13:10:56.106128 32507 raft_consensus.cc:740] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:56.061582 32492 raft_consensus.cc:515] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:56.101822 30066 leader_election.cc:304] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:56.134339 29926 catalog_manager.cc:5697] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 2 to 3, leader changed from 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 3 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } }
I20260709 13:10:55.545512 30729 raft_consensus.cc:1275] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 13:10:56.104355 30142 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.020s	sys 0.033s
W20260709 13:10:56.089834 32281 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.005s	sys 0.008s
I20260709 13:10:56.079903 32412 raft_consensus.cc:493] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:56.068024 32134 raft_consensus.cc:515] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:56.089198 32270 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.010s	sys 0.003s
W20260709 13:10:56.108770 30737 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.008s	sys 0.008s
W20260709 13:10:56.145907 30737 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.008s	sys 0.009s
W20260709 13:10:56.110188 30735 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.005s	sys 0.013s
W20260709 13:10:56.146960 30735 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.005s	sys 0.013s
I20260709 13:10:56.146606 30737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51004 (request call id 569) took 1233 ms. Trace:
I20260709 13:10:56.113063 32236 raft_consensus.cc:515] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:56.148412 30703 leader_election.cc:304] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:56.150230 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
W20260709 13:10:56.137666 32277 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.021s	sys 0.048s
I20260709 13:10:56.150698 30700 leader_election.cc:304] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:56.137295 32502 raft_consensus.cc:493] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:56.115203 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:56.100206 30728 raft_consensus.cc:2468] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 3.
I20260709 13:10:56.108740 32378 raft_consensus.cc:3060] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:56.130647 30143 leader_election.cc:304] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:56.037921 30068 leader_election.cc:304] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:56.139377 29926 catalog_manager.cc:5697] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 3 to 5, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 5 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:10:56.142221 32281 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.005s	sys 0.008s
I20260709 13:10:56.153486 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:10:56.146773 30095 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.016s	sys 0.024s
I20260709 13:10:56.175230 30098 raft_consensus.cc:2410] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:10:56.148566 30737 rpcz_store.cc:276] 0709 13:10:54.913685 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:54.916211 (+  2526us) service_pool.cc:224] Handling call
0709 13:10:54.916491 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:54.916683 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:54.916932 (+   249us) log.cc:844] Serialized 14 byte log entry
0709 13:10:55.568647 (+651715us) spinlock_profiling.cc:243] Waited 4.4 ms on lock 0x7b1800450ac0. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f7e95de1 00007f99f7ea25b1 00007f99eefcd3f3 00007f99eefcf7c1 00007f99eefcf779 00007f99eefcf709 00007f99eefcf6d1 00007f99eefce9cd 000000000038f354 000000000038f199 00007f99eefb083a
0709 13:10:56.146282 (+577635us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:56.146330 (+    48us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:56.146385 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.146444 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:56.146549 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":498,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":109521,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":5416,"spinlock_wait_cycles":10128128,"thread_start_us":1228854,"threads_started":2,"wal-append.queue_time_us":613706}
W20260709 13:10:56.107949 29993 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.015s	sys 0.007s
I20260709 13:10:56.157197 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:56.142838 32432 raft_consensus.cc:3055] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:10:56.145067 32270 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.010s	sys 0.003s
I20260709 13:10:56.174736 32246 raft_consensus.cc:493] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:56.182042 32236 leader_election.cc:290] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:56.146306 32068 raft_consensus.cc:493] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:56.131016 32286 raft_consensus.cc:515] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:56.185679 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:56.144738 30733 raft_consensus.cc:2393] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 5: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:10:56.145803 30021 raft_consensus.cc:1275] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:10:56.206395 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:10:56.269718 29993 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.020s	sys 0.014s
I20260709 13:10:56.193375 30100 raft_consensus.cc:1275] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:10:56.149736 32501 raft_consensus.cc:493] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:56.258800 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:10:56.204516 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 166670us
I20260709 13:10:56.298132 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:56.270013 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:10:56.303987 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 173416us
I20260709 13:10:56.304754 30143 leader_election.cc:304] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:56.305050 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:10:56.175665 32277 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.022s	sys 0.050s
I20260709 13:10:56.306057 30024 raft_consensus.cc:2393] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 4: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
W20260709 13:10:56.307456 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 156830us
I20260709 13:10:56.308139 29993 leader_election.cc:304] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:10:56.306631 30094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33992 (request call id 1603) took 1046 ms. Trace:
W20260709 13:10:56.297840 30095 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.027s	sys 0.038s
W20260709 13:10:56.322760 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 139325us
I20260709 13:10:56.323137 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:56.270990 32432 raft_consensus.cc:740] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
W20260709 13:10:56.323573 30176 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.806s	user 0.010s	sys 0.034s
I20260709 13:10:56.188385 32420 leader_election.cc:290] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:56.330513 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:56.226640 32513 raft_consensus.cc:2749] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:10:56.323369 30169 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.024s	sys 0.020s
I20260709 13:10:56.224900 32276 leader_election.cc:290] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:56.345963 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:56.346733 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:56.201027 32572 raft_consensus.cc:2749] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:56.209647 32570 raft_consensus.cc:493] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
W20260709 13:10:56.348030 30176 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.831s	user 0.010s	sys 0.034s
I20260709 13:10:56.245662 32492 leader_election.cc:290] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:56.222450 32516 leader_election.cc:290] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:10:56.349563 30169 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.024s	sys 0.020s
I20260709 13:10:56.217600 32565 raft_consensus.cc:2804] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:56.218411 30170 raft_consensus.cc:2468] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 5.
I20260709 13:10:56.187436 32281 raft_consensus.cc:697] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 5 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:56.185215 32502 raft_consensus.cc:515] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:56.145946 32412 raft_consensus.cc:515] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:56.377888 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 200050us
W20260709 13:10:56.372856 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 238895us
I20260709 13:10:56.305154 32236 consensus_queue.cc:1048] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260709 13:10:56.380633 30066 leader_election.cc:304] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:56.380125 30703 leader_election.cc:304] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:10:56.301941 32246 raft_consensus.cc:515] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:56.325928 32568 consensus_queue.cc:1048] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 13:10:56.175724 32504 consensus_queue.cc:237] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:56.330124 32501 raft_consensus.cc:515] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:56.183771 32507 consensus_queue.cc:260] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:56.388537 30703 leader_election.cc:304] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:56.309242 32068 raft_consensus.cc:515] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:56.404290 30066 leader_election.cc:304] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:56.380053 32570 raft_consensus.cc:515] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:56.438503 32572 raft_consensus.cc:2804] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:56.389364 32277 raft_consensus.cc:2804] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:56.439989 32572 raft_consensus.cc:493] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:56.394760 32566 raft_consensus.cc:2804] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:56.440402 32572 raft_consensus.cc:3060] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:56.440543 32566 raft_consensus.cc:493] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:56.440953 32566 raft_consensus.cc:3060] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:56.396279 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:56.370906 32420 raft_consensus.cc:2749] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:56.443645 30066 leader_election.cc:304] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:56.398978 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:10:56.389914 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 64218.7us
I20260709 13:10:56.371299 32134 leader_election.cc:290] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:10:56.440310 32581 log.cc:927] Time spent T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 13:10:56.431917 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 107471us
I20260709 13:10:56.449126 30700 leader_election.cc:304] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:56.436002 32597 consensus_queue.cc:1048] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:10:56.452319 32516 consensus_queue.cc:1059] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:56.433768 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:56.434911 32510 leader_election.cc:290] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:56.430425 32513 raft_consensus.cc:493] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:56.412848 32413 raft_consensus.cc:2804] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:56.380963 32565 raft_consensus.cc:697] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:56.449366 32571 raft_consensus.cc:2749] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:56.311305 30094 rpcz_store.cc:276] 0709 13:10:55.260463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.399097 (+138634us) service_pool.cc:224] Handling call
0709 13:10:55.399342 (+   245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:55.399532 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:55.661559 (+262027us) log.cc:844] Serialized 14 byte log entry
0709 13:10:56.306314 (+644755us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:56.306362 (+    48us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:56.306412 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.306475 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:56.306574 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":716427,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":1180,"spinlock_wait_cycles":35008384,"thread_start_us":528972,"threads_started":2,"wal-append.queue_time_us":644053}
W20260709 13:10:56.463496 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 155425us
I20260709 13:10:56.445094 32277 raft_consensus.cc:493] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:56.443843 32577 raft_consensus.cc:493] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:56.469132 30068 leader_election.cc:304] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:56.471405 32594 raft_consensus.cc:493] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:56.446064 32596 raft_consensus.cc:493] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:56.475765 32246 leader_election.cc:290] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:56.476493 32068 leader_election.cc:290] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:56.458513 32507 raft_consensus.cc:3060] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:56.444774 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 56310.9us
I20260709 13:10:56.499579 30176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43840 (request call id 1686) took 1081 ms. Trace:
I20260709 13:10:56.523104 30703 leader_election.cc:304] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:56.450670 32588 raft_consensus.cc:2804] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:10:56.463074 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 158428us
I20260709 13:10:56.458994 32590 raft_consensus.cc:2804] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:10:56.479346 29992 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:56.406286 32432 consensus_queue.cc:260] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:56.529311 30143 leader_election.cc:304] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:56.569001 32573 consensus_queue.cc:1048] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:10:56.573781 30168 raft_consensus.cc:1240] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:56.575202 32544 raft_consensus.cc:3055] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:56.575642 32544 raft_consensus.cc:740] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
W20260709 13:10:56.576428 29991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:56.578428 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:56.582827 30733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56954 (request call id 522) took 1048 ms. Trace:
I20260709 13:10:56.583300 30733 rpcz_store.cc:276] 0709 13:10:55.534473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.564010 (+ 29537us) service_pool.cc:224] Handling call
0709 13:10:56.582613 (+1018603us) spinlock_profiling.cc:243] Waited 69.7 ms on lock 0x7b5400740ed4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:10:56.582761 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":160323456}
I20260709 13:10:56.590618 32270 raft_consensus.cc:2804] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:56.591112 32270 raft_consensus.cc:493] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:56.591499 32270 raft_consensus.cc:3060] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:56.592427 32487 consensus_queue.cc:1048] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:56.599392 32236 raft_consensus.cc:493] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.599921 32236 raft_consensus.cc:515] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:56.469551 32413 raft_consensus.cc:493] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:56.522743 30176 rpcz_store.cc:276] 0709 13:10:55.417944 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.418063 (+   119us) service_pool.cc:224] Handling call
0709 13:10:55.418350 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:55.425310 (+  6960us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:55.425338 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:55.440940 (+ 15602us) log.cc:844] Serialized 26 byte log entry
0709 13:10:56.367140 (+926200us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:10:56.386772 (+ 19632us) log.cc:844] Serialized 14 byte log entry
0709 13:10:56.478023 (+ 91251us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.478169 (+   146us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:56.478354 (+   185us) raft_consensus.cc:1685] finished
0709 13:10:56.478368 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:56.499520 (+ 21152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6616,"prepare.queue_time_us":14490,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":5460,"raft.queue_time_us":178060,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":100,"thread_start_us":940796,"threads_started":2,"wal-append.queue_time_us":790286}
I20260709 13:10:56.604671 32413 raft_consensus.cc:3060] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:56.499130 32277 raft_consensus.cc:3060] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:56.515216 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:56.606366 30028 raft_consensus.cc:2468] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 3.
W20260709 13:10:56.531198 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 86210.3us
I20260709 13:10:56.508008 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:56.597620 30736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56954 (request call id 515) took 1230 ms. Trace:
I20260709 13:10:56.615314 32592 consensus_queue.cc:1048] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:56.438958 32281 consensus_queue.cc:237] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:56.470541 32587 raft_consensus.cc:2749] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:10:56.621872 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 156805us
W20260709 13:10:56.625689 29994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:56.624955 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 155794us
I20260709 13:10:56.499038 32134 raft_consensus.cc:493] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:56.627812 30024 raft_consensus.cc:1275] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:56.628777 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:56.624321 30700 leader_election.cc:304] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:56.522693 32420 raft_consensus.cc:493] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:56.575243 30168 raft_consensus.cc:1275] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 13:10:56.667860 30168 pending_rounds.cc:85] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124: Aborting all ops after (but not including) 3
W20260709 13:10:56.644845 30701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:56.527746 32588 raft_consensus.cc:493] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:56.668416 30168 pending_rounds.cc:107] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 13:10:56.619728 32568 raft_consensus.cc:2749] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:56.667025 30068 leader_election.cc:304] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:56.670951 30168 raft_consensus.cc:2889] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:10:56.640100 30702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:56.672710 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:56.634472 30169 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43840 (request call id 1689) took 1121 ms. Trace:
I20260709 13:10:56.620639 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
W20260709 13:10:56.667150 30700 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.54.65:34451 timed out after 2.140s (SENT) [suppressed 10 similar messages]
I20260709 13:10:56.621949 32605 raft_consensus.cc:493] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.677703 32588 raft_consensus.cc:3060] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:56.680408 32413 raft_consensus.cc:515] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:56.681361 32236 leader_election.cc:290] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:56.471930 32513 raft_consensus.cc:515] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:56.620286 32502 leader_election.cc:290] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:56.681951 32565 consensus_queue.cc:237] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:56.621796 32489 raft_consensus.cc:493] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.530305 32286 leader_election.cc:290] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:56.531665 32590 raft_consensus.cc:493] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:56.696517 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:56.504756 32594 raft_consensus.cc:515] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:56.668913 32587 raft_consensus.cc:493] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.725891 32589 raft_consensus.cc:493] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.726229 32587 raft_consensus.cc:515] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:56.726511 32610 consensus_queue.cc:1048] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:56.612278 30736 rpcz_store.cc:276] 0709 13:10:55.367058 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.367177 (+   119us) service_pool.cc:224] Handling call
0709 13:10:55.367405 (+   228us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:55.483657 (+116252us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:56.127707 (+644050us) log.cc:844] Serialized 14 byte log entry
0709 13:10:56.470108 (+342401us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:56.470155 (+    47us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:56.470208 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.597387 (+127179us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b5400483d54. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:10:56.597433 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:56.597560 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15647,"prepare.queue_time_us":728678,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":60787,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":3552,"spinlock_wait_cycles":266852608,"thread_start_us":970137,"threads_started":2,"wal-append.queue_time_us":492398}
I20260709 13:10:56.696821 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:56.687042 30169 rpcz_store.cc:276] 0709 13:10:55.512844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.513108 (+   264us) service_pool.cc:224] Handling call
0709 13:10:55.513402 (+   294us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:55.519702 (+  6300us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:55.519735 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:55.531580 (+ 11845us) log.cc:844] Serialized 26 byte log entry
0709 13:10:56.620420 (+1088840us) spinlock_profiling.cc:243] Waited 48.1 ms on lock 0x7b54002a3620. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2024090 00007f99f20316b8 00007f99f20ba92b 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c
0709 13:10:56.620478 (+    58us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:56.620529 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.620594 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:56.620630 (+    36us) raft_consensus.cc:1685] finished
0709 13:10:56.620652 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:56.634391 (+ 13739us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9197,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":7839,"spinlock_wait_cycles":110665088,"thread_start_us":810262,"threads_started":1,"wal-append.queue_time_us":704596}
I20260709 13:10:56.671655 32432 raft_consensus.cc:3060] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:56.701613 30095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33992 (request call id 1593) took 1435 ms. Trace:
I20260709 13:10:56.515551 32596 raft_consensus.cc:515] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:56.640417 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:56.743250 30731 raft_consensus.cc:2468] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 7.
I20260709 13:10:56.705636 30730 raft_consensus.cc:2468] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 5.
W20260709 13:10:56.718209 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 188962us
I20260709 13:10:56.685257 32420 raft_consensus.cc:515] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:56.687583 30068 leader_election.cc:304] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:56.720638 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:56.505301 32577 raft_consensus.cc:515] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:56.688699 32595 raft_consensus.cc:493] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.706841 32586 raft_consensus.cc:493] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:56.694263 32597 raft_consensus.cc:2804] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:10:56.715323 32378 consensus_meta.cc:287] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent flushing consensus metadata: real 0.524s	user 0.004s	sys 0.005s
I20260709 13:10:56.668736 32510 raft_consensus.cc:2749] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:56.689181 32603 raft_consensus.cc:493] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:56.672472 32487 consensus_queue.cc:1059] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:10:56.576478 32544 consensus_queue.cc:260] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:56.726418 32589 raft_consensus.cc:515] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:56.744923 29993 leader_election.cc:304] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
W20260709 13:10:56.826622 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 81765us
I20260709 13:10:56.671518 32425 raft_consensus.cc:2749] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:10:56.746663 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 63207us
W20260709 13:10:56.744782 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 218774us
I20260709 13:10:56.718622 32412 leader_election.cc:290] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:56.767009 30143 leader_election.cc:304] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:56.784981 32597 raft_consensus.cc:493] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:56.686127 32134 raft_consensus.cc:515] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:56.719765 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:56.725335 32590 raft_consensus.cc:3060] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:56.773286 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
W20260709 13:10:56.774354 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 86859.3us
I20260709 13:10:56.717016 32605 raft_consensus.cc:515] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:56.774395 32585 raft_consensus.cc:2749] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:56.703378 32277 raft_consensus.cc:515] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:56.782908 30098 raft_consensus.cc:1275] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:10:56.728380 32587 leader_election.cc:290] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:56.785734 30171 raft_consensus.cc:2468] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 5.
I20260709 13:10:56.728506 32619 raft_consensus.cc:2749] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:56.853886 32619 raft_consensus.cc:493] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:56.786396 30142 leader_election.cc:304] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:10:56.854895 30142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 68593.2us
I20260709 13:10:56.854348 30730 raft_consensus.cc:1275] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:10:56.855614 30142 leader_election.cc:304] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:56.856158 32134 leader_election.cc:290] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:56.854343 32619 raft_consensus.cc:515] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:56.856680 32134 consensus_queue.cc:1048] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:56.857267 32134 consensus_queue.cc:1243] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer 6f3eb161e2194f6891f12e2cfcaaf73a log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260709 13:10:56.786552 32586 raft_consensus.cc:515] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:56.858048 32619 leader_election.cc:290] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:56.858726 32619 raft_consensus.cc:2804] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:10:56.859329 32619 raft_consensus.cc:697] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 4 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
W20260709 13:10:56.824273 29992 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:56.800155 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 355458us
I20260709 13:10:56.721589 32489 raft_consensus.cc:515] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:10:56.831220 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 64305.8us
I20260709 13:10:56.871948 30143 leader_election.cc:304] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:56.719173 30173 raft_consensus.cc:2468] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 2.
I20260709 13:10:56.740175 32578 consensus_queue.cc:1048] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:10:56.853197 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:56.860776 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:56.851233 32544 raft_consensus.cc:3060] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:56.787164 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:56.872964 30143 leader_election.cc:304] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:56.847440 32597 raft_consensus.cc:3060] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:56.875092 30068 leader_election.cc:304] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:56.783449 32595 raft_consensus.cc:515] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:56.848068 32276 consensus_queue.cc:1048] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
I20260709 13:10:56.852653 32599 raft_consensus.cc:2749] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:10:56.888701 30067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:56.889220 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:56.854756 30731 raft_consensus.cc:1275] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 13:10:56.902949 32584 log.cc:927] Time spent T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 13:10:56.903633 32286 raft_consensus.cc:493] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
W20260709 13:10:56.903868 32604 log.cc:927] Time spent T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:10:56.902350 32614 raft_consensus.cc:2749] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:56.909053 30102 raft_consensus.cc:1240] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 13:10:56.854826 32277 leader_election.cc:290] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:56.877461 32611 raft_consensus.cc:493] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:56.888710 32412 raft_consensus.cc:2804] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:56.905539 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:56.906466 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:56.911345 30068 leader_election.cc:304] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:56.920125 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:56.920850 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:56.808104 32603 raft_consensus.cc:515] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:56.924453 30102 raft_consensus.cc:1275] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:56.924938 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:56.872515 32510 consensus_queue.cc:1048] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:10:56.879603 30066 leader_election.cc:304] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:56.941176 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:56.941840 30068 leader_election.cc:304] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:10:56.940591 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:56.943291 30098 raft_consensus.cc:2468] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 5.
W20260709 13:10:56.879990 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 212864us
I20260709 13:10:56.902863 32621 raft_consensus.cc:493] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:56.924598 32614 raft_consensus.cc:2749] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:56.930186 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:56.904244 32286 raft_consensus.cc:515] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:56.921825 32570 leader_election.cc:290] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:10:56.964480 30142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 108949us
I20260709 13:10:56.945808 32413 leader_election.cc:290] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:56.885788 32572 raft_consensus.cc:515] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:56.967360 30729 raft_consensus.cc:2468] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 6.
I20260709 13:10:57.040125 30142 leader_election.cc:304] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:10:57.040338 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 167434us
I20260709 13:10:57.041251 30142 leader_election.cc:304] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:56.957994 32585 raft_consensus.cc:2749] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:56.961982 32615 raft_consensus.cc:2804] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 13:10:57.080310 32583 log.cc:927] Time spent T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.643s	user 0.000s	sys 0.007s
I20260709 13:10:56.967402 32134 raft_consensus.cc:2749] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:10:57.063653 32612 log.cc:927] Time spent T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.296s	user 0.001s	sys 0.000s
I20260709 13:10:57.038775 32570 raft_consensus.cc:2804] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:56.982260 32613 raft_consensus.cc:2804] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 13:10:57.132915 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 256622us
I20260709 13:10:57.064013 32513 leader_election.cc:290] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:56.940521 32619 consensus_queue.cc:237] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:56.738767 30095 rpcz_store.cc:276] 0709 13:10:55.258033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.395175 (+137142us) service_pool.cc:224] Handling call
0709 13:10:55.395474 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:55.415527 (+ 20053us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:56.349560 (+934033us) log.cc:844] Serialized 14 byte log entry
0709 13:10:56.621119 (+271559us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:56.622727 (+  1608us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:56.633244 (+ 10517us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.668331 (+ 35087us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:56.693505 (+ 25174us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":711373,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":26,"raft.queue_time_us":66472,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"spinlock_wait_cycles":23325952,"thread_start_us":1006755,"threads_started":2,"wal-append.queue_time_us":312374}
I20260709 13:10:57.086375 32615 raft_consensus.cc:493] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:57.082160 32616 raft_consensus.cc:493] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:57.100653 32570 raft_consensus.cc:493] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:56.953204 32621 raft_consensus.cc:515] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:57.126358 32577 leader_election.cc:290] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:57.133404 32589 leader_election.cc:290] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:57.142025 32613 raft_consensus.cc:493] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
W20260709 13:10:57.192579 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 58946.9us
I20260709 13:10:57.130746 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:57.141321 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:56.941066 32611 raft_consensus.cc:515] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:57.198720 30142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 157533us
I20260709 13:10:57.214301 30142 leader_election.cc:304] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:57.190464 32615 raft_consensus.cc:3060] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:57.140974 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:57.219164 30173 raft_consensus.cc:1240] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:10:57.180646 32585 raft_consensus.cc:493] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
W20260709 13:10:57.200855 30701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:57.194355 32570 raft_consensus.cc:3060] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:57.221369 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:57.189924 32594 leader_election.cc:290] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:10:57.223043 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 343498us
I20260709 13:10:57.229369 30173 raft_consensus.cc:2468] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 3.
I20260709 13:10:57.230278 30737 raft_consensus.cc:2468] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 6.
I20260709 13:10:57.232342 30066 leader_election.cc:304] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:57.210939 32613 raft_consensus.cc:3060] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:57.229954 32603 leader_election.cc:290] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:57.198021 32605 leader_election.cc:290] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:57.187282 32631 consensus_queue.cc:1048] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.093s
I20260709 13:10:57.224383 32596 leader_election.cc:290] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:57.219738 32614 raft_consensus.cc:2804] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:57.223848 32625 raft_consensus.cc:2749] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:57.224221 32489 leader_election.cc:290] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:57.237792 30700 leader_election.cc:304] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
W20260709 13:10:57.255512 32624 log.cc:927] Time spent T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:10:57.195300 32616 raft_consensus.cc:515] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:57.261413 32587 raft_consensus.cc:2749] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:57.262476 32595 leader_election.cc:290] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:57.233736 30066 leader_election.cc:304] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:57.257032 32614 raft_consensus.cc:493] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:57.230561 32629 consensus_queue.cc:1048] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:10:57.267093 32614 raft_consensus.cc:3060] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:57.238514 32594 raft_consensus.cc:2804] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:57.268584 32594 raft_consensus.cc:493] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:57.268909 32594 raft_consensus.cc:3060] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:57.270045 32621 leader_election.cc:290] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:10:57.256189 32626 log.cc:927] Time spent T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 13:10:57.238237 32617 raft_consensus.cc:2749] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:10:57.284245 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 50569.5us
I20260709 13:10:57.287328 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:57.286217 32621 raft_consensus.cc:2749] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 13:10:57.289275 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 347511us
W20260709 13:10:57.291007 32566 consensus_meta.cc:287] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent flushing consensus metadata: real 0.850s	user 0.010s	sys 0.000s
I20260709 13:10:57.291447 32566 raft_consensus.cc:515] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:57.292151 32618 log.cc:927] Time spent T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 13:10:57.294130 30736 raft_consensus.cc:2410] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 13:10:57.293941 32590 raft_consensus.cc:515] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:57.295096 30175 raft_consensus.cc:1240] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:57.296905 32590 leader_election.cc:290] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:57.298139 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:57.298347 30732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51014 (request call id 774) took 1150 ms. Trace:
I20260709 13:10:57.298935 30024 raft_consensus.cc:2393] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 4: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:57.298756 30732 rpcz_store.cc:276] 0709 13:10:56.147840 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.150552 (+  2712us) service_pool.cc:224] Handling call
0709 13:10:56.603133 (+452581us) spinlock_profiling.cc:243] Waited 6.64 ms on lock 0x7b5800004898. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eef95b71 00007f99eef95a22 00007f99f7eaec09 00007f99f7008ee0 00007f99f70d20ab 00007f99f70d2131 00007f99f7093fc0 00007f99f707e929 00007f99f707e3d2 00007f99f05f5bd4
0709 13:10:57.275704 (+672571us) spinlock_profiling.cc:243] Waited 24.1 ms on lock 0x7b5800004898. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eef95e9c 00007f99eef95a5b 00007f99f7eaec09 00007f99f7008ee0 00007f99f70d20ab 00007f99f70d2131 00007f99f7093fc0 00007f99f707e929 00007f99f707e3d2 00007f99f05f5bd4
0709 13:10:57.284033 (+  8329us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:57.297898 (+ 13865us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:57.297927 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:57.298051 (+   124us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:57.298118 (+    67us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.298180 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:57.298293 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70764032}
I20260709 13:10:57.301995 32286 leader_election.cc:290] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:57.303845 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:57.293505 32566 leader_election.cc:290] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:57.307917 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:57.309139 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:57.311543 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:10:57.309427 29992 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:57.314990 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:57.230643 32585 raft_consensus.cc:515] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:57.327440 32585 leader_election.cc:290] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:57.328840 32611 leader_election.cc:290] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:57.331440 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:57.332089 30024 raft_consensus.cc:3060] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:57.334275 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 293275us
I20260709 13:10:57.289907 32572 leader_election.cc:290] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:57.282073 32412 raft_consensus.cc:697] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 5 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:57.341217 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:57.344887 30094 raft_consensus.cc:2468] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 4.
I20260709 13:10:57.343672 30026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 1530) took 1193 ms. Trace:
I20260709 13:10:57.346899 30026 rpcz_store.cc:276] 0709 13:10:56.150114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.150292 (+   178us) service_pool.cc:224] Handling call
0709 13:10:56.186920 (+ 36628us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:56.373733 (+186813us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:56.373782 (+    49us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:56.581192 (+207410us) spinlock_profiling.cc:243] Waited 2.37 ms on lock 0x7b2c00000658. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f09b3a11 00007f99f09c3372 00007f99f20f5a01 00007f99f20ba43a 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2
0709 13:10:56.581616 (+   424us) log.cc:844] Serialized 26 byte log entry
0709 13:10:56.715185 (+133569us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:56.715218 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.715281 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:57.337524 (+622243us) raft_consensus.cc:1685] finished
0709 13:10:57.337545 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:57.343608 (+  6063us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15535,"raft.queue_time_us":45054,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":7928,"spinlock_wait_cycles":5455104,"thread_start_us":304087,"threads_started":2,"wal-append.queue_time_us":375784}
I20260709 13:10:57.349897 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:57.350492 30098 raft_consensus.cc:2468] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 5.
I20260709 13:10:57.349892 30024 raft_consensus.cc:2468] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 5.
I20260709 13:10:57.352270 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:57.353983 30094 raft_consensus.cc:1275] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:10:57.355377 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:57.356808 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:57.358209 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:57.359609 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
W20260709 13:10:57.347656 32432 consensus_meta.cc:287] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719: Time spent flushing consensus metadata: real 0.606s	user 0.006s	sys 0.002s
I20260709 13:10:57.366014 30143 leader_election.cc:304] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:57.361598 29993 leader_election.cc:304] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:57.362522 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:57.363104 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:57.349818 32489 consensus_queue.cc:1048] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 13:10:57.363649 32595 raft_consensus.cc:493] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:57.360878 30094 raft_consensus.cc:2468] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 3.
I20260709 13:10:57.364717 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:57.347970 32619 raft_consensus.cc:493] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.388693 32620 raft_consensus.cc:2804] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:57.394174 32585 raft_consensus.cc:493] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:57.435891 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:57.384374 32502 raft_consensus.cc:2749] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:10:57.468786 32544 consensus_meta.cc:287] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719: Time spent flushing consensus metadata: real 0.585s	user 0.006s	sys 0.000s
I20260709 13:10:57.470163 32412 consensus_queue.cc:237] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:57.475422 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:57.436661 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
W20260709 13:10:57.405932 30067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:57.480156 32544 raft_consensus.cc:493] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.480640 32544 raft_consensus.cc:515] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:57.360824 32589 consensus_queue.cc:1048] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.096s
I20260709 13:10:57.387523 32595 raft_consensus.cc:515] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:57.446089 32620 raft_consensus.cc:493] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:57.448846 32507 consensus_meta.cc:287] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent flushing consensus metadata: real 0.926s	user 0.009s	sys 0.000s
I20260709 13:10:57.437920 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:57.439487 32378 raft_consensus.cc:493] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.428076 32619 raft_consensus.cc:515] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:57.461350 32611 raft_consensus.cc:493] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.481710 32570 raft_consensus.cc:515] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:57.482699 32544 leader_election.cc:290] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:57.483225 30020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52098 (request call id 437) took 1339 ms. Trace:
I20260709 13:10:57.542220 30020 rpcz_store.cc:276] 0709 13:10:56.143964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.149308 (+  5344us) service_pool.cc:224] Handling call
0709 13:10:56.179270 (+ 29962us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:56.451813 (+272543us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:10:56.522255 (+ 70442us) log.cc:844] Serialized 14 byte log entry
0709 13:10:56.693887 (+171632us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:56.706441 (+ 12554us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:56.716622 (+ 10181us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.360571 (+643949us) spinlock_profiling.cc:243] Waited 9.24 ms on lock 0x7b4800080058. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f6fe3aa1 00007f99f6fdab37 00007f99f6fda9ca 00007f99f70d226f 00007f99f70d1f37 00007f99f70e655c 00007f99f70e6508 00007f99f70e6488 00007f99f70e6443 00007f99f70e56ec 00007f99f600fa96
0709 13:10:57.448134 (+ 87563us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b54001a8bd4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:10:57.460363 (+ 12229us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:57.483159 (+ 22796us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46301,"prepare.queue_time_us":20727,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":55286,"raft.run_cpu_time_us":14312,"raft.run_wall_time_us":663300,"spinlock_wait_cycles":644716160,"thread_start_us":155121,"threads_started":2,"wal-append.queue_time_us":221843}
W20260709 13:10:57.484701 32270 consensus_meta.cc:287] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719: Time spent flushing consensus metadata: real 0.818s	user 0.008s	sys 0.001s
I20260709 13:10:57.544808 32270 raft_consensus.cc:515] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:10:57.485483 32588 consensus_meta.cc:287] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent flushing consensus metadata: real 0.769s	user 0.006s	sys 0.004s
I20260709 13:10:57.547677 32588 raft_consensus.cc:515] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:57.486801 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:57.550076 30730 raft_consensus.cc:1240] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:57.499343 30025 raft_consensus.cc:2468] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 6.
I20260709 13:10:57.550971 32270 leader_election.cc:290] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:57.498764 32620 raft_consensus.cc:3060] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:57.552336 32588 leader_election.cc:290] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:57.499925 32566 raft_consensus.cc:493] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.558291 32566 raft_consensus.cc:515] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:57.560316 32566 leader_election.cc:290] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:57.505529 32378 raft_consensus.cc:515] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:57.488204 32595 leader_election.cc:290] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:57.561515 32614 raft_consensus.cc:515] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:57.510849 32585 raft_consensus.cc:515] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:57.567052 30066 leader_election.cc:304] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:57.507380 30171 raft_consensus.cc:2468] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 4.
I20260709 13:10:57.565099 32598 raft_consensus.cc:493] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:57.631891 32615 raft_consensus.cc:515] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:57.632776 32598 raft_consensus.cc:515] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:57.633981 32270 raft_consensus.cc:2804] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:57.634619 32270 raft_consensus.cc:697] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 5 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:10:57.634915 32598 leader_election.cc:290] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:57.635499 32270 consensus_queue.cc:237] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:57.636183 32286 raft_consensus.cc:493] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:57.650230 32639 consensus_queue.cc:1048] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:10:57.486189 32597 consensus_meta.cc:287] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719: Time spent flushing consensus metadata: real 0.595s	user 0.008s	sys 0.000s
I20260709 13:10:57.540849 32570 leader_election.cc:290] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:57.651384 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:57.631798 32614 leader_election.cc:290] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:57.660580 30143 leader_election.cc:304] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:57.507090 32619 leader_election.cc:290] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:57.562898 32378 leader_election.cc:290] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:57.663277 30143 leader_election.cc:304] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:57.668001 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:57.646613 32595 raft_consensus.cc:493] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.646835 32544 raft_consensus.cc:493] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:57.671419 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:57.671687 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:57.676216 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:57.673772 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:57.673969 32621 raft_consensus.cc:493] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.636736 32286 raft_consensus.cc:515] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:57.678407 32621 raft_consensus.cc:515] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:57.681974 30143 leader_election.cc:304] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:57.682933 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:57.683162 30025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52098 (request call id 439) took 1531 ms. Trace:
I20260709 13:10:57.521991 32613 raft_consensus.cc:515] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:57.683516 30025 rpcz_store.cc:276] 0709 13:10:56.151892 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.302298 (+150406us) service_pool.cc:224] Handling call
0709 13:10:57.682987 (+1380689us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54001a8454. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:10:57.683083 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2645107072}
I20260709 13:10:57.684891 30174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43838 (request call id 1872) took 1112 ms. Trace:
I20260709 13:10:57.685304 32613 leader_election.cc:290] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:57.687373 32615 leader_election.cc:290] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:57.537220 32594 raft_consensus.cc:515] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:57.689424 32594 leader_election.cc:290] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:57.662474 32597 raft_consensus.cc:515] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:57.690246 30173 raft_consensus.cc:2393] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 6: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:10:57.668768 32631 raft_consensus.cc:2749] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:57.516396 32611 raft_consensus.cc:515] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:57.670465 32635 raft_consensus.cc:493] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:57.692392 32635 raft_consensus.cc:515] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:57.692858 30101 raft_consensus.cc:1275] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 13:10:57.693573 32611 leader_election.cc:290] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:57.693666 32614 raft_consensus.cc:2749] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:57.694651 32585 leader_election.cc:290] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:57.695770 30020 raft_consensus.cc:1275] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:10:57.669030 32598 raft_consensus.cc:493] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.698087 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:57.680696 32595 raft_consensus.cc:515] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:57.697649 32598 raft_consensus.cc:515] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:57.701416 32598 leader_election.cc:290] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:57.691599 32597 leader_election.cc:290] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:57.681746 32544 raft_consensus.cc:515] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:57.689260 32286 leader_election.cc:290] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:57.716354 32544 leader_election.cc:290] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:57.708782 30103 raft_consensus.cc:2393] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 4: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:10:57.718905 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:57.719800 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:57.697875 32621 leader_election.cc:290] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:57.720901 32635 leader_election.cc:290] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:57.709198 30171 raft_consensus.cc:1275] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:57.709194 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:57.724032 30096 raft_consensus.cc:2410] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:10:57.724229 32621 consensus_queue.cc:1048] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:57.725030 30096 raft_consensus.cc:1240] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:57.685237 30174 rpcz_store.cc:276] 0709 13:10:56.572901 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.580001 (+  7100us) service_pool.cc:224] Handling call
0709 13:10:56.580248 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:56.746047 (+165799us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:56.746077 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:56.746117 (+    40us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:56.783880 (+ 37763us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.684695 (+900815us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b540011f3d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:10:57.684738 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:57.684840 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":380824960}
I20260709 13:10:57.728673 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:57.708277 32595 leader_election.cc:290] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:57.716142 32611 raft_consensus.cc:493] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:57.731107 32611 raft_consensus.cc:515] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:57.732339 32501 leader_election.cc:290] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:57.735809 32611 leader_election.cc:290] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:57.736970 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:57.737877 30096 raft_consensus.cc:1240] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:57.738349 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:57.739707 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:57.697295 32620 raft_consensus.cc:515] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:57.740885 30101 raft_consensus.cc:1275] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:57.741897 30176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43838 (request call id 1875) took 1071 ms. Trace:
I20260709 13:10:57.754366 30176 rpcz_store.cc:276] 0709 13:10:56.670900 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.671042 (+   142us) service_pool.cc:224] Handling call
0709 13:10:56.671316 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:56.774657 (+103341us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:56.774687 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:56.774724 (+    37us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:56.774767 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.741661 (+966894us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b540037c3d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:10:57.741705 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:57.741843 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":237209472}
I20260709 13:10:57.741305 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:57.762954 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:57.763672 30025 raft_consensus.cc:2468] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 5.
I20260709 13:10:57.765790 30700 leader_election.cc:304] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:57.773880 29993 leader_election.cc:304] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:57.775439 29993 leader_election.cc:304] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:57.776467 29993 leader_election.cc:304] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:57.778887 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:57.779418 30169 raft_consensus.cc:2468] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 3.
W20260709 13:10:57.779516 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 97584.5us
I20260709 13:10:57.779886 30169 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43838 (request call id 1883) took 1050 ms. Trace:
W20260709 13:10:57.780588 30701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:57.781680 30176 raft_consensus.cc:1240] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:10:57.782215 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:57.784562 30169 rpcz_store.cc:276] 0709 13:10:56.729401 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.778665 (+1049264us) service_pool.cc:224] Handling call
0709 13:10:57.779836 (+  1171us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:57.783229 30171 raft_consensus.cc:1275] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:10:57.743263 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:57.788529 32598 raft_consensus.cc:2804] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:10:57.792042 32629 raft_consensus.cc:2804] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:57.796644 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:57.816994 30173 raft_consensus.cc:2468] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 4.
I20260709 13:10:57.802096 32506 consensus_queue.cc:1059] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:10:57.802726 32573 consensus_queue.cc:1048] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:57.806819 32238 raft_consensus.cc:493] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:57.807336 32620 leader_election.cc:290] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451)
I20260709 13:10:57.809718 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:57.810330 30170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43838 (request call id 1865) took 1239 ms. Trace:
I20260709 13:10:57.811193 30175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43838 (request call id 1869) took 1239 ms. Trace:
I20260709 13:10:57.787216 32587 raft_consensus.cc:2804] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:57.778751 32592 raft_consensus.cc:2749] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:57.826316 30170 rpcz_store.cc:276] 0709 13:10:56.571007 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.571723 (+   716us) service_pool.cc:224] Handling call
0709 13:10:56.572066 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:56.857988 (+285922us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:56.858025 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:56.858067 (+    42us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:56.858115 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.810103 (+951988us) spinlock_profiling.cc:243] Waited 286 ms on lock 0x7b54002882d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:10:57.810147 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:57.810276 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":657023232}
I20260709 13:10:57.799023 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:57.828739 30172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43838 (request call id 1871) took 1256 ms. Trace:
I20260709 13:10:57.829118 30172 rpcz_store.cc:276] 0709 13:10:56.572627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.579568 (+  6941us) service_pool.cc:224] Handling call
0709 13:10:56.579823 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:56.818775 (+238952us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:56.818807 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:56.818849 (+    42us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:10:56.818893 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.828524 (+1009631us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b54000ea1d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:10:57.828565 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:57.828690 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":524605184}
I20260709 13:10:57.831197 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:57.831862 30731 raft_consensus.cc:3060] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:57.836943 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:57.840397 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:57.816561 32598 raft_consensus.cc:493] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:57.842159 32598 raft_consensus.cc:3060] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:57.843147 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:57.843930 30100 raft_consensus.cc:2393] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 5: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:10:57.792322 32570 raft_consensus.cc:2804] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:57.826511 30175 rpcz_store.cc:276] 0709 13:10:56.572100 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.572203 (+   103us) service_pool.cc:224] Handling call
0709 13:10:56.572485 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:57.295450 (+722965us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.811001 (+515551us) spinlock_profiling.cc:243] Waited 722 ms on lock 0x7b5400287654. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:10:57.811141 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1661440384}
I20260709 13:10:57.818729 29993 leader_election.cc:304] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:57.844445 32570 raft_consensus.cc:493] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:57.844915 32570 raft_consensus.cc:3060] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:57.817503 32629 raft_consensus.cc:493] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:57.845578 32629 raft_consensus.cc:3060] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:57.846612 32573 raft_consensus.cc:2804] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:57.847054 32573 raft_consensus.cc:493] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:57.847394 32573 raft_consensus.cc:3060] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:57.789495 32595 raft_consensus.cc:493] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.820078 30730 raft_consensus.cc:2468] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 5.
I20260709 13:10:57.816994 32635 raft_consensus.cc:493] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:57.849346 32587 raft_consensus.cc:493] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:57.850234 32635 raft_consensus.cc:515] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:57.841656 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:57.861395 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:57.868433 30142 leader_election.cc:304] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:57.849419 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:57.879714 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:57.880582 30097 raft_consensus.cc:2468] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 4.
I20260709 13:10:57.881595 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:57.882431 30097 raft_consensus.cc:2468] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 7.
I20260709 13:10:57.883385 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:57.884181 32586 leader_election.cc:290] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:57.826946 32238 raft_consensus.cc:515] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:57.876341 32620 raft_consensus.cc:2804] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:57.850293 32587 raft_consensus.cc:3060] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:57.890002 32601 log.cc:927] Time spent T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 1.122s	user 0.006s	sys 0.012s
I20260709 13:10:57.897857 32639 raft_consensus.cc:493] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:57.909132 32639 raft_consensus.cc:515] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:57.901093 32620 raft_consensus.cc:493] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:57.910744 32620 raft_consensus.cc:3060] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:57.898025 32566 consensus_queue.cc:1059] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20260709 13:10:57.912233 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:57.912523 32566 raft_consensus.cc:3055] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:57.905499 30095 raft_consensus.cc:2410] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:57.912971 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:57.913628 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:57.913012 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:57.914755 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:57.915895 32238 leader_election.cc:290] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:57.916254 32420 leader_election.cc:290] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:57.914283 30095 raft_consensus.cc:1240] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 4. Current term is 5. Ops: []
W20260709 13:10:57.918455 32593 log.cc:927] Time spent T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 1.451s	user 0.003s	sys 0.009s
I20260709 13:10:57.918509 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:57.919754 30735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56954 (request call id 514) took 2555 ms. Trace:
I20260709 13:10:57.920238 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:57.917779 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:57.921084 32616 leader_election.cc:290] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:57.920537 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:57.921648 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:57.920104 30735 rpcz_store.cc:276] 0709 13:10:55.364684 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.366323 (+  1639us) service_pool.cc:224] Handling call
0709 13:10:55.366596 (+   273us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:56.147292 (+780696us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:56.147323 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:56.147767 (+   444us) log.cc:844] Serialized 26 byte log entry
0709 13:10:56.350565 (+202798us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:56.350605 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:56.351407 (+   802us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:57.917923 (+1566516us) spinlock_profiling.cc:243] Waited 8.12 ms on lock 0x7b4400022b4c. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eeef3c85 00007f99eeef46a2 00007f99f1c661db 00007f99f1c61aaf 00007f99f1c5586e 00007f99f1c54bb6 00007f99f1c547d8 00007f99f1c5e221 00007f99f1c5e1d9 00007f99f1c5e169
0709 13:10:57.919488 (+  1565us) raft_consensus.cc:1685] finished
0709 13:10:57.919506 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:57.919677 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6454,"raft.queue_time_us":60491,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":29576,"spinlock_wait_cycles":18675968,"thread_start_us":908473,"threads_started":2,"wal-append.queue_time_us":226018}
I20260709 13:10:57.923523 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:57.925002 30728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56954 (request call id 525) took 1039 ms. Trace:
I20260709 13:10:57.925251 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:57.926573 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:57.927398 30731 raft_consensus.cc:2468] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 6.
I20260709 13:10:57.928117 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:57.929116 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:57.930363 32635 leader_election.cc:290] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:57.931767 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:57.932775 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:57.934051 30096 raft_consensus.cc:1240] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:57.935624 32277 consensus_queue.cc:1048] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:10:57.936458 32570 raft_consensus.cc:515] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:57.941140 32277 consensus_queue.cc:1059] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:10:57.942361 32589 raft_consensus.cc:3055] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:57.942898 32589 raft_consensus.cc:740] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:57.943356 30737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51014 (request call id 780) took 1082 ms. Trace:
I20260709 13:10:57.943706 32589 consensus_queue.cc:260] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:57.923489 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:57.848645 32595 raft_consensus.cc:515] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:57.945257 30169 raft_consensus.cc:2468] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 5.
I20260709 13:10:57.903663 32586 raft_consensus.cc:493] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:57.946061 32586 raft_consensus.cc:515] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:57.947032 32595 leader_election.cc:290] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:57.893208 30703 leader_election.cc:304] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:57.900319 32578 consensus_queue.cc:1059] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:10:57.945648 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:57.905263 32068 consensus_queue.cc:1059] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 13:10:57.899595 32577 raft_consensus.cc:493] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:57.948318 32578 raft_consensus.cc:3055] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:57.895891 30730 raft_consensus.cc:2468] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 7.
I20260709 13:10:57.948704 32577 raft_consensus.cc:515] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:57.949303 32587 raft_consensus.cc:515] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:57.949816 32068 raft_consensus.cc:3055] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:57.950212 32068 raft_consensus.cc:740] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:57.950917 32068 consensus_queue.cc:260] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:57.951925 32068 raft_consensus.cc:3060] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:57.952232 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:57.952453 30730 raft_consensus.cc:3055] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:57.952806 30730 raft_consensus.cc:740] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:57.952880 32629 raft_consensus.cc:515] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:57.954123 30174 raft_consensus.cc:2393] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 8: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:10:57.947965 32586 leader_election.cc:290] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:57.942314 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:57.953584 30730 consensus_queue.cc:260] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:57.955358 30730 raft_consensus.cc:3060] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:57.956684 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:57.957855 32577 leader_election.cc:290] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:57.958020 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:57.958050 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:57.958746 30177 raft_consensus.cc:2393] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 5: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:10:57.958195 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:57.958894 30172 raft_consensus.cc:1275] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:10:57.959893 30173 raft_consensus.cc:2410] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for term 8 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260709 13:10:57.959944 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 66820.5us
I20260709 13:10:57.960713 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:57.958815 30170 raft_consensus.cc:2468] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 5.
I20260709 13:10:57.960942 30703 leader_election.cc:304] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:57.963003 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:57.961263 32378 raft_consensus.cc:2749] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:57.936628 30736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51014 (request call id 778) took 1083 ms. Trace:
I20260709 13:10:57.972942 30736 rpcz_store.cc:276] 0709 13:10:56.852807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.852978 (+   171us) service_pool.cc:224] Handling call
0709 13:10:57.936454 (+1083476us) spinlock_profiling.cc:243] Waited 420 ms on lock 0x7b5400651b54. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:10:57.936573 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":965943680}
I20260709 13:10:57.954820 30729 pending_rounds.cc:85] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a: Aborting all ops after (but not including) 5
I20260709 13:10:57.943711 30737 rpcz_store.cc:276] 0709 13:10:56.860447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.860567 (+   120us) service_pool.cc:224] Handling call
0709 13:10:57.943200 (+1082633us) spinlock_profiling.cc:243] Waited 356 ms on lock 0x7b54002995d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:10:57.943303 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":818700672}
I20260709 13:10:57.912942 32566 raft_consensus.cc:740] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:57.964859 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:57.965113 30068 leader_election.cc:304] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:57.965694 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:57.956271 32620 raft_consensus.cc:515] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:57.966614 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:57.966709 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:57.960893 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:57.898564 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:57.967723 30142 leader_election.cc:304] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:57.959671 30702 leader_election.cc:304] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:57.894201 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:57.969916 30176 raft_consensus.cc:1240] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:57.970060 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:57.970690 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:57.941442 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:57.973361 30143 leader_election.cc:304] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:57.903018 30097 raft_consensus.cc:2468] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 4.
I20260709 13:10:58.017292 30027 raft_consensus.cc:1240] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:57.981006 30019 raft_consensus.cc:1240] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:58.031843 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:10:58.091230 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 131625us
I20260709 13:10:58.105495 30702 leader_election.cc:304] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:58.105685 30173 raft_consensus.cc:2468] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 5.
I20260709 13:10:58.054316 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:58.091401 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:58.106602 30169 raft_consensus.cc:2468] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 6.
I20260709 13:10:58.106612 30702 leader_election.cc:304] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
W20260709 13:10:58.016196 29993 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.040875 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:10:58.108515 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
W20260709 13:10:57.962630 32655 log.cc:927] Time spent T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:10:58.115108 30174 raft_consensus.cc:2393] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 5: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:10:58.105206 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:10:58.059614 30067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:58.090665 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 125634us
W20260709 13:10:58.122960 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 149662us
I20260709 13:10:58.126802 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:58.128253 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:58.129312 29993 leader_election.cc:304] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:58.133430 29993 leader_election.cc:304] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:10:57.948719 32578 raft_consensus.cc:740] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
W20260709 13:10:58.141654 30142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 173999us
I20260709 13:10:58.091763 30729 pending_rounds.cc:107] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:10:58.020866 32588 raft_consensus.cc:2749] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:58.145074 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:58.145769 30142 leader_election.cc:304] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:58.146328 29993 leader_election.cc:304] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:58.154726 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:58.147593 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:57.954949 32629 leader_election.cc:290] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:58.025152 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:58.143105 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:58.066720 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:58.151492 30068 leader_election.cc:304] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:58.170048 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:58.152675 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:58.171595 30068 leader_election.cc:304] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:58.036778 32589 raft_consensus.cc:3060] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:58.028637 32615 raft_consensus.cc:493] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.015750 32616 raft_consensus.cc:493] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:58.188938 30140 leader_election.cc:304] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:58.170399 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:58.192703 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:58.027165 32609 consensus_queue.cc:1048] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.138s
I20260709 13:10:58.114401 32611 raft_consensus.cc:2804] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:10:58.114670 32617 raft_consensus.cc:2804] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:58.141589 32595 raft_consensus.cc:2749] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:58.038231 32627 consensus_queue.cc:1048] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.115s
I20260709 13:10:58.036139 32492 consensus_queue.cc:1059] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.129s
I20260709 13:10:58.182528 32432 raft_consensus.cc:2804] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:10:58.188896 30068 leader_election.cc:304] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:58.102882 32646 consensus_queue.cc:1059] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.067s
I20260709 13:10:58.151065 32238 raft_consensus.cc:2804] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:58.145859 32630 raft_consensus.cc:2749] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:58.151504 30729 raft_consensus.cc:2889] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:10:58.047509 32573 raft_consensus.cc:515] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:58.174633 30168 raft_consensus.cc:1240] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:10:58.206053 30172 raft_consensus.cc:1240] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:58.170472 32571 raft_consensus.cc:493] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.170159 32504 raft_consensus.cc:2804] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:58.183106 30731 raft_consensus.cc:1275] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:10:58.182895 30730 raft_consensus.cc:1275] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:10:58.212169 32617 raft_consensus.cc:493] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:58.182592 32614 raft_consensus.cc:2804] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:10:58.170305 32134 raft_consensus.cc:493] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
W20260709 13:10:58.221510 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 258555us
I20260709 13:10:58.241430 30703 leader_election.cc:304] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:58.174139 32590 raft_consensus.cc:493] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:58.146624 32610 consensus_queue.cc:1059] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 13:10:58.217454 32568 raft_consensus.cc:2749] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:58.159078 32435 consensus_queue.cc:1059] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.064s
I20260709 13:10:58.203207 32588 raft_consensus.cc:2804] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:58.244539 32588 raft_consensus.cc:493] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:58.244907 32588 raft_consensus.cc:3060] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:58.245939 30019 raft_consensus.cc:1240] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:58.246587 32134 raft_consensus.cc:515] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:58.051927 32570 leader_election.cc:290] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:58.204300 32487 raft_consensus.cc:493] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:57.966334 30728 rpcz_store.cc:276] 0709 13:10:56.885306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.888552 (+  3246us) service_pool.cc:224] Handling call
0709 13:10:57.924338 (+1035786us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b5800004898. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eef95b71 00007f99eef95a22 00007f99f7eaec09 00007f99f7008ee0 00007f99f70d20ab 00007f99f70d2131 00007f99f7093fc0 00007f99f707e929 00007f99f707e3d2 00007f99f05f5bd4
0709 13:10:57.924517 (+   179us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:57.924688 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:57.924719 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:57.924762 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:57.924797 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:57.924851 (+    54us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:57.924942 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":32940416}
I20260709 13:10:58.230132 32595 raft_consensus.cc:2749] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:58.234510 32571 raft_consensus.cc:515] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:58.230466 32238 raft_consensus.cc:493] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:58.203644 32611 raft_consensus.cc:493] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:58.224921 32432 raft_consensus.cc:493] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:58.242590 32246 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 13:10:58.249534 30174 raft_consensus.cc:3060] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:58.249394 32487 raft_consensus.cc:515] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:58.248661 32134 leader_election.cc:290] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:58.199550 32615 raft_consensus.cc:515] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:58.253736 30024 raft_consensus.cc:2468] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 5.
I20260709 13:10:58.249854 32590 raft_consensus.cc:515] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:10:58.239816 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 133271us
I20260709 13:10:58.222576 32658 raft_consensus.cc:2804] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:58.226001 32578 consensus_queue.cc:260] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:58.241223 32617 raft_consensus.cc:3060] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:58.267033 32614 raft_consensus.cc:697] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 6 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:58.260954 32665 consensus_queue.cc:1059] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:58.267570 32570 raft_consensus.cc:3055] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:10:58.203086 32616 raft_consensus.cc:515] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:58.280848 29992 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:58.295809 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 103107us
I20260709 13:10:58.296270 30703 leader_election.cc:304] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:10:58.299330 30142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 116862us
I20260709 13:10:58.202345 32566 consensus_queue.cc:260] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:58.312422 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 123528us
I20260709 13:10:58.298290 32238 raft_consensus.cc:3060] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:58.267594 32568 raft_consensus.cc:2749] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:58.299353 32611 raft_consensus.cc:3060] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:58.310597 32432 raft_consensus.cc:3060] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:58.346249 32571 leader_election.cc:290] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:58.347740 32615 leader_election.cc:290] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:58.334733 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:58.350404 30730 raft_consensus.cc:3060] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:58.356503 32573 leader_election.cc:290] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:58.358796 32286 raft_consensus.cc:2749] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:10:58.361392 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 164438us
W20260709 13:10:58.367403 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 178578us
I20260709 13:10:58.368141 30068 leader_election.cc:304] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:58.335084 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:58.330124 32570 raft_consensus.cc:740] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:10:58.326015 30174 raft_consensus.cc:2468] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 6.
I20260709 13:10:58.326810 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:58.391719 30737 raft_consensus.cc:2410] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:10:58.327755 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:58.327334 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:58.340639 32620 leader_election.cc:290] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:58.316854 32504 raft_consensus.cc:493] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:58.332566 30026 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
mode: GRACEFUL
new_leader_uuid: "c99569d27a6f4c648eae7119fe3db124"
 from {username='slave'} at 127.0.0.1:47450
I20260709 13:10:58.404352 30026 raft_consensus.cc:606] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Received request to transfer leadership to TS c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:58.404709 30026 raft_consensus.cc:614] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:58.336187 30140 leader_election.cc:304] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:10:58.406816 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 70694.2us
I20260709 13:10:58.407589 30140 leader_election.cc:304] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:58.325644 32658 raft_consensus.cc:493] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:58.333240 30142 leader_election.cc:304] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:58.392812 30735 raft_consensus.cc:2468] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 5.
W20260709 13:10:58.370361 32598 consensus_meta.cc:287] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4: Time spent flushing consensus metadata: real 0.528s	user 0.011s	sys 0.001s
I20260709 13:10:58.402647 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:58.403285 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:58.370963 32665 raft_consensus.cc:2749] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:58.330402 32666 consensus_queue.cc:1048] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:10:58.387068 32621 raft_consensus.cc:2749] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:58.409377 30140 leader_election.cc:304] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:10:58.410392 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 114187us
W20260709 13:10:58.405274 32659 log.cc:927] Time spent T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 13:10:58.476464 32568 raft_consensus.cc:493] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:58.477085 32568 raft_consensus.cc:515] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:58.441730 32620 raft_consensus.cc:2749] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:10:58.479647 30142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 146473us
I20260709 13:10:58.480382 30142 leader_election.cc:304] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:58.408581 32134 raft_consensus.cc:2749] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:58.406153 32504 raft_consensus.cc:3060] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:58.452577 30737 raft_consensus.cc:2393] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 4: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:10:58.406500 32572 raft_consensus.cc:2749] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:10:58.480826 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 71533.1us
I20260709 13:10:58.660145 30140 leader_election.cc:304] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:58.661742 30140 leader_election.cc:304] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:58.401131 32276 raft_consensus.cc:3055] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:58.479909 30703 leader_election.cc:304] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:10:58.506084 32620 raft_consensus.cc:2749] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:58.655304 32670 raft_consensus.cc:493] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
W20260709 13:10:58.595288 30142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 114984us
I20260709 13:10:58.443919 32658 raft_consensus.cc:3060] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:58.624024 30170 raft_consensus.cc:1240] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 5. Current term is 6. Ops: []
W20260709 13:10:58.653883 30067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.488412 32669 raft_consensus.cc:2749] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:58.668026 30140 leader_election.cc:304] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:58.490795 30171 raft_consensus.cc:1275] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:10:58.678124 30142 leader_election.cc:304] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:58.409148 32614 consensus_queue.cc:237] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:58.621404 32420 raft_consensus.cc:2749] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:58.449606 32598 raft_consensus.cc:515] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:58.681154 30026 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
mode: GRACEFUL
new_leader_uuid: "5ec73dc157ed476ca903a7d596271719"
 from {username='slave'} at 127.0.0.1:47450
W20260709 13:10:58.682061 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 202204us
I20260709 13:10:58.688014 30026 raft_consensus.cc:606] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Received request to transfer leadership to TS 5ec73dc157ed476ca903a7d596271719
I20260709 13:10:58.682536 30173 raft_consensus.cc:1240] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:58.683461 30140 leader_election.cc:304] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:10:58.684650 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 316563us
I20260709 13:10:58.689031 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:58.689452 30068 leader_election.cc:304] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:58.687420 30702 leader_election.cc:304] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:58.690809 30068 leader_election.cc:304] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:58.691916 30068 leader_election.cc:304] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:58.669193 32619 raft_consensus.cc:2749] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:58.696214 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:58.666302 32276 raft_consensus.cc:740] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:58.670403 32134 raft_consensus.cc:2749] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:58.676577 32631 raft_consensus.cc:493] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:58.697844 30068 leader_election.cc:304] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:58.487983 32570 consensus_queue.cc:260] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:58.706703 30068 leader_election.cc:304] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:58.685703 32610 raft_consensus.cc:2749] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:58.734802 30068 leader_election.cc:304] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:58.697515 32286 raft_consensus.cc:2749] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:10:58.694846 32621 raft_consensus.cc:2749] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:58.689723 32635 raft_consensus.cc:2749] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:58.694208 32585 raft_consensus.cc:2749] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:58.753059 32276 consensus_queue.cc:260] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:58.733994 32572 raft_consensus.cc:2749] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:58.754063 32276 raft_consensus.cc:3060] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:58.743362 32412 raft_consensus.cc:2749] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:58.749173 32669 raft_consensus.cc:493] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:58.751255 32685 raft_consensus.cc:2749] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:58.757614 32669 raft_consensus.cc:515] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:58.758316 32588 consensus_meta.cc:287] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent flushing consensus metadata: real 0.513s	user 0.007s	sys 0.001s
I20260709 13:10:58.745715 30068 leader_election.cc:304] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:10:58.748338 30142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.758726 32588 raft_consensus.cc:515] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:58.758468 32685 consensus_queue.cc:1048] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:10:58.759773 30736 raft_consensus.cc:2368] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 5. Current term is 6.
I20260709 13:10:58.759819 32669 leader_election.cc:290] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:58.708025 32590 leader_election.cc:290] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:58.760058 30142 leader_election.cc:304] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:58.749306 32270 raft_consensus.cc:2804] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:58.760701 32270 raft_consensus.cc:493] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:58.760866 32590 raft_consensus.cc:2749] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:58.766491 32590 raft_consensus.cc:493] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:58.767009 32590 raft_consensus.cc:515] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:58.768980 32590 leader_election.cc:290] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:58.761539 32598 leader_election.cc:290] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:58.772994 30730 raft_consensus.cc:2468] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 5.
I20260709 13:10:58.696470 32665 raft_consensus.cc:2804] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:58.699740 32615 raft_consensus.cc:493] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:58.746942 32594 raft_consensus.cc:2749] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:58.743780 32277 raft_consensus.cc:493] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:58.684170 32670 raft_consensus.cc:515] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:58.708554 30025 raft_consensus.cc:1240] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 2. Current term is 3. Ops: []
W20260709 13:10:58.786293 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 85308.3us
I20260709 13:10:58.697247 32595 consensus_queue.cc:1048] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260709 13:10:58.790771 30702 leader_election.cc:304] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
W20260709 13:10:58.791419 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 92639.5us
I20260709 13:10:58.785806 32489 raft_consensus.cc:3055] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:58.794278 32489 raft_consensus.cc:740] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
W20260709 13:10:58.794656 32679 log.cc:927] Time spent T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:10:58.795073 32489 consensus_queue.cc:260] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:58.796145 32489 raft_consensus.cc:3060] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:58.796790 30026 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
mode: GRACEFUL
new_leader_uuid: "c99569d27a6f4c648eae7119fe3db124"
 from {username='slave'} at 127.0.0.1:47450
I20260709 13:10:58.797416 30026 raft_consensus.cc:606] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Received request to transfer leadership to TS c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:58.797701 30026 raft_consensus.cc:614] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:10:58.792865 30703 leader_election.cc:304] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:58.798890 30702 leader_election.cc:304] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:58.806913 32432 raft_consensus.cc:515] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:58.807307 32571 raft_consensus.cc:3060] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:10:58.808980 32432 leader_election.cc:290] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:58.809669 32670 leader_election.cc:290] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:58.795099 32277 raft_consensus.cc:515] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:58.811851 32277 leader_election.cc:290] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:10:58.806739 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 61089.2us
W20260709 13:10:58.814229 32672 log.cc:927] Time spent T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.357s	user 0.000s	sys 0.001s
I20260709 13:10:58.815634 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:58.816143 32378 raft_consensus.cc:3055] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:10:58.816399 30094 raft_consensus.cc:2393] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 6: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:10:58.782545 32665 raft_consensus.cc:493] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:58.817543 32665 raft_consensus.cc:3060] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:58.787058 32616 leader_election.cc:290] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:10:58.818619 32675 log.cc:927] Time spent T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
I20260709 13:10:58.819104 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
W20260709 13:10:58.820000 29991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.733830 32631 raft_consensus.cc:515] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:58.821843 32631 leader_election.cc:290] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:58.818480 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:10:58.822050 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:58.822216 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:58.822607 30103 raft_consensus.cc:2393] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 5: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:10:58.771855 32617 raft_consensus.cc:515] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:58.823051 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:58.824429 32617 leader_election.cc:290] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:58.796833 32615 raft_consensus.cc:515] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:58.825814 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:58.826537 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:58.826956 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:10:58.827303 30098 raft_consensus.cc:2410] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:10:58.828296 30142 leader_election.cc:400] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 election: Vote denied by peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469) with higher term. Message: Invalid argument: T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 5. Current term is 6.
I20260709 13:10:58.828647 30142 leader_election.cc:403] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:10:58.784268 32270 raft_consensus.cc:3060] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:58.848606 30100 raft_consensus.cc:1240] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:59.148839 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:58.864705 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
W20260709 13:10:59.147105 30142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 318915us
W20260709 13:10:59.146879 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 463466us
I20260709 13:10:59.154707 30140 leader_election.cc:304] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:59.156373 30140 leader_election.cc:304] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:10:58.870890 29992 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:59.158689 29992 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.876417 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:59.160166 30026 raft_consensus.cc:2468] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 8.
I20260709 13:10:59.161224 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:10:58.925500 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 97319us
W20260709 13:10:59.162570 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 333926us
W20260709 13:10:59.164228 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 371440us
I20260709 13:10:59.168985 30140 leader_election.cc:304] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:10:59.173843 30142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:58.791873 32570 raft_consensus.cc:3060] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:10:59.165582 30703 leader_election.cc:304] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: c99569d27a6f4c648eae7119fe3db124
W20260709 13:10:59.315092 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 146163us
W20260709 13:10:59.315692 29991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.385527 30140 leader_election.cc:304] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:10:59.384505 30702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.398458 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:59.469580 30736 raft_consensus.cc:2410] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:10:58.827509 32378 raft_consensus.cc:740] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:10:59.066968 32588 leader_election.cc:290] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:59.314572 32631 raft_consensus.cc:2749] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:59.165937 32617 raft_consensus.cc:493] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.559157 32617 raft_consensus.cc:515] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:59.560284 32662 log.cc:927] Time spent T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 1.231s	user 0.000s	sys 0.019s
W20260709 13:10:59.308943 32614 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.018s	sys 0.019s
W20260709 13:10:59.561170 32614 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.018s	sys 0.020s
W20260709 13:10:59.561581 30024 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52098 (request call id 468) took 1369 ms (client timeout 1716 ms). Trace:
I20260709 13:10:59.561744 30169 raft_consensus.cc:1240] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 6 LEADER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:59.562651 30734 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51004 (request call id 583) took 1900 ms. Trace:
I20260709 13:10:58.924947 32616 raft_consensus.cc:2749] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:10:59.383320 32571 consensus_meta.cc:287] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719: Time spent flushing consensus metadata: real 0.575s	user 0.008s	sys 0.001s
W20260709 13:10:59.336483 32586 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.026s	sys 0.095s
W20260709 13:10:59.535102 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 369569us
W20260709 13:10:59.572638 29994 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.000s	sys 0.023s
I20260709 13:10:59.573244 30703 leader_election.cc:304] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:59.574560 30703 leader_election.cc:304] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:10:59.566876 30097 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.088s	user 0.086s	sys 0.112s
I20260709 13:10:59.540045 32246 raft_consensus.cc:493] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:59.541110 30025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52098 (request call id 469) took 1208 ms. Trace:
I20260709 13:10:59.578356 30025 rpcz_store.cc:276] 0709 13:10:58.332309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.332724 (+   415us) service_pool.cc:224] Handling call
0709 13:10:58.332976 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:58.790532 (+457556us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:59.540850 (+750318us) spinlock_profiling.cc:243] Waited 375 ms on lock 0x7b5400073ad4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:10:59.541052 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":863376640}
I20260709 13:10:59.579358 30703 leader_election.cc:304] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:59.315758 32621 raft_consensus.cc:493] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:59.383848 32595 raft_consensus.cc:493] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.166095 32615 leader_election.cc:290] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:59.542692 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:59.543572 30172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43840 (request call id 1709) took 1571 ms. Trace:
I20260709 13:10:59.550418 30095 raft_consensus.cc:1240] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:10:59.550799 32432 raft_consensus.cc:493] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:59.553177 32577 raft_consensus.cc:493] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
W20260709 13:10:59.553556 32489 consensus_meta.cc:287] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent flushing consensus metadata: real 0.757s	user 0.006s	sys 0.000s
I20260709 13:10:59.315593 32412 raft_consensus.cc:493] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
W20260709 13:10:59.555191 32238 consensus_meta.cc:287] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent flushing consensus metadata: real 1.190s	user 0.009s	sys 0.000s
I20260709 13:10:59.533869 32579 raft_consensus.cc:493] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:59.555811 30020 raft_consensus.cc:1275] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 13:10:59.556583 32665 consensus_meta.cc:287] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent flushing consensus metadata: real 0.739s	user 0.005s	sys 0.002s
I20260709 13:10:59.394181 32680 raft_consensus.cc:2749] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:10:59.557518 32631 raft_consensus.cc:2749] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:59.387082 32620 raft_consensus.cc:2749] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:10:59.550333 32681 raft_consensus.cc:2804] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:59.649950 32681 raft_consensus.cc:493] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:59.650358 32681 raft_consensus.cc:3060] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:59.650066 32270 raft_consensus.cc:515] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:59.652133 32270 leader_election.cc:290] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:10:59.137104 32611 consensus_meta.cc:287] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent flushing consensus metadata: real 0.775s	user 0.006s	sys 0.001s
I20260709 13:10:59.654170 32611 raft_consensus.cc:515] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:59.656792 32611 leader_election.cc:290] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:59.550446 30019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54198 (request call id 1820) took 1428 ms. Trace:
I20260709 13:10:59.657948 30735 raft_consensus.cc:1240] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 3. Current term is 4. Ops: []
I20260709 13:10:59.564008 30170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43838 (request call id 1903) took 1592 ms. Trace:
I20260709 13:10:59.658991 30170 rpcz_store.cc:276] 0709 13:10:57.972064 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.240810 (+268746us) service_pool.cc:224] Handling call
0709 13:10:58.623834 (+383024us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:58.681215 (+ 57381us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:59.563802 (+882587us) spinlock_profiling.cc:243] Waited 379 ms on lock 0x7b54003dc2d0. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20b98ad 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:10:59.563940 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":872754944}
I20260709 13:10:59.563006 30734 rpcz_store.cc:276] 0709 13:10:57.662251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.877456 (+215205us) service_pool.cc:224] Handling call
0709 13:10:57.877835 (+   379us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:57.896868 (+ 19033us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:57.896901 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:57.897391 (+   490us) log.cc:844] Serialized 26 byte log entry
0709 13:10:58.202894 (+305503us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:58.202929 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:58.202990 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:59.559788 (+1356798us) spinlock_profiling.cc:243] Waited 2.89 ms on lock 0x7b4400022b4c. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eeef3c85 00007f99eeef46a2 00007f99f1c661db 00007f99f1c61aaf 00007f99f1c5586e 00007f99f1c54bb6 00007f99f1c547d8 00007f99f1c5e221 00007f99f1c5e1d9 00007f99f1c5e169
0709 13:10:59.562378 (+  2590us) raft_consensus.cc:1685] finished
0709 13:10:59.562398 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:59.562601 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18596,"raft.queue_time_us":20901,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":4006,"spinlock_wait_cycles":6645120,"thread_start_us":242613,"threads_started":1,"wal-append.queue_time_us":394292}
I20260709 13:10:58.869683 32670 raft_consensus.cc:2804] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:10:59.660297 32670 raft_consensus.cc:493] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:10:59.561985 30024 rpcz_store.cc:269] 0709 13:10:58.192359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.192494 (+   135us) service_pool.cc:224] Handling call
0709 13:10:59.561403 (+1368909us) spinlock_profiling.cc:243] Waited 38.5 ms on lock 0x7b5400154d54. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:10:59.561529 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":88605952}
W20260709 13:10:59.568154 30023 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.743s	user 0.082s	sys 0.156s
I20260709 13:10:59.660699 32670 raft_consensus.cc:3060] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:10:59.573567 29994 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.000s	sys 0.024s
W20260709 13:10:59.661087 30023 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.836s	user 0.083s	sys 0.156s
I20260709 13:10:59.494836 30733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51014 (request call id 791) took 1617 ms. Trace:
I20260709 13:10:59.053296 32668 raft_consensus.cc:3060] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:59.138139 32506 raft_consensus.cc:3055] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:10:59.674049 32506 raft_consensus.cc:740] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:59.674922 32506 consensus_queue.cc:260] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:59.585879 30094 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.069s	sys 0.063s
I20260709 13:10:59.587921 30172 rpcz_store.cc:276] 0709 13:10:57.972382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:59.542793 (+1570411us) service_pool.cc:224] Handling call
0709 13:10:59.543090 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:59.543280 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:59.543304 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:59.543343 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:10:59.543375 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:59.543422 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:59.543513 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 13:10:59.571094 32589 consensus_meta.cc:287] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4: Time spent flushing consensus metadata: real 1.387s	user 0.010s	sys 0.000s
I20260709 13:10:59.676862 32589 consensus_queue.cc:1059] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:59.550339 32378 consensus_queue.cc:260] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:10:59.576294 32586 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.873s	user 0.037s	sys 0.132s
I20260709 13:10:59.573271 32690 raft_consensus.cc:493] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:10:59.587740 30097 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.099s	user 0.086s	sys 0.112s
I20260709 13:10:58.925218 32504 raft_consensus.cc:515] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:59.575634 32571 raft_consensus.cc:2749] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:10:59.595093 32432 raft_consensus.cc:515] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:59.598349 32238 raft_consensus.cc:515] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:59.618135 32678 raft_consensus.cc:493] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:59.621356 32487 leader_election.cc:290] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:59.629839 32692 raft_consensus.cc:2804] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:10:59.590891 32588 raft_consensus.cc:2749] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:59.638021 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:59.692468 30736 raft_consensus.cc:3060] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:59.591002 32691 raft_consensus.cc:2749] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:59.592443 32246 raft_consensus.cc:515] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:59.593731 32595 raft_consensus.cc:515] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:59.592954 32621 raft_consensus.cc:515] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:59.701645 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:59.702666 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:59.702299 30172 raft_consensus.cc:2468] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 6.
I20260709 13:10:59.702095 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:59.705468 30170 raft_consensus.cc:2468] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 7.
I20260709 13:10:59.690332 32692 raft_consensus.cc:493] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:10:59.383876 32688 raft_consensus.cc:2749] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:59.662317 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:59.596452 32577 raft_consensus.cc:515] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:59.660683 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:59.594427 32616 raft_consensus.cc:493] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:59.666010 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:59.717314 30020 raft_consensus.cc:2468] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 4.
I20260709 13:10:59.657372 30019 rpcz_store.cc:276] 0709 13:10:58.122410 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.122532 (+   122us) service_pool.cc:224] Handling call
0709 13:10:58.122796 (+   264us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:58.246323 (+123527us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:59.550237 (+1303914us) spinlock_profiling.cc:243] Waited 123 ms on lock 0x7b54000753d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:10:59.550392 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":282801024}
W20260709 13:10:59.678251 30094 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.069s	sys 0.064s
I20260709 13:10:59.598764 32412 raft_consensus.cc:515] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:59.631177 32665 raft_consensus.cc:515] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:59.677665 32589 raft_consensus.cc:3055] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:10:59.611809 32579 raft_consensus.cc:515] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:10:59.685845 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 300387us
I20260709 13:10:59.678997 32489 raft_consensus.cc:493] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:10:59.681268 32639 leader_election.cc:290] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:59.696959 30026 raft_consensus.cc:1240] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:59.645673 32617 leader_election.cc:290] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:59.707612 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:59.708985 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:59.707687 30702 leader_election.cc:304] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:59.694947 32378 raft_consensus.cc:3060] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:59.735440 32621 leader_election.cc:290] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:59.736840 30143 leader_election.cc:304] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:59.737272 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:59.737875 30024 raft_consensus.cc:2468] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 5.
I20260709 13:10:59.738651 32700 raft_consensus.cc:2749] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:10:59.736920 32246 leader_election.cc:290] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:59.742502 32568 leader_election.cc:290] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:59.744556 32668 raft_consensus.cc:2749] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469) with higher term. Message: Invalid argument: T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 5. Current term is 6.
I20260709 13:10:59.744840 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:59.745438 30730 raft_consensus.cc:2468] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 5.
I20260709 13:10:59.746500 32579 leader_election.cc:290] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:59.746985 30169 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43840 (request call id 1720) took 1593 ms. Trace:
I20260709 13:10:59.725011 32616 raft_consensus.cc:515] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:59.749388 32616 leader_election.cc:290] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:59.750718 32665 leader_election.cc:290] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:59.751094 30737 raft_consensus.cc:1240] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 4. Current term is 5. Ops: []
I20260709 13:10:59.751942 32630 raft_consensus.cc:3055] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:59.752288 32630 raft_consensus.cc:740] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:59.753369 32700 raft_consensus.cc:493] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:59.753872 32700 raft_consensus.cc:515] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:59.755951 32700 leader_election.cc:290] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:59.684612 32690 raft_consensus.cc:515] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:59.756419 32578 raft_consensus.cc:3060] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:10:59.720223 29992 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.700989 32571 raft_consensus.cc:493] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:59.758144 32571 raft_consensus.cc:515] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:59.759491 30735 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56954 (request call id 536) took 1427 ms. Trace:
I20260709 13:10:59.760211 32571 leader_election.cc:290] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:59.761445 32577 leader_election.cc:290] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:59.724365 30140 leader_election.cc:304] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:10:58.801252 32658 raft_consensus.cc:515] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:59.706458 32615 raft_consensus.cc:493] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:59.689958 32678 raft_consensus.cc:515] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:59.711721 32631 raft_consensus.cc:493] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:59.709940 30097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33990 (request call id 1893) took 1515 ms. Trace:
I20260709 13:10:59.712834 32692 raft_consensus.cc:3060] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:10:59.761749 32695 log.cc:927] Time spent T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260709 13:10:59.774531 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:10:59.775213 32664 log.cc:927] Time spent T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 1.463s	user 0.008s	sys 0.021s
I20260709 13:10:59.775646 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:59.776306 30175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43838 (request call id 1898) took 1805 ms. Trace:
I20260709 13:10:59.763568 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:59.776999 32577 raft_consensus.cc:2749] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:10:59.765790 32432 leader_election.cc:290] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:59.766878 30729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51004 (request call id 580) took 2389 ms. Trace:
I20260709 13:10:59.732421 30702 leader_election.cc:304] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:59.732890 32670 raft_consensus.cc:515] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:59.765014 32617 raft_consensus.cc:493] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:10:59.779124 32617 raft_consensus.cc:515] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:59.779294 32600 consensus_queue.cc:1059] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:10:59.769114 32690 leader_election.cc:290] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:59.780352 32600 raft_consensus.cc:3055] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:10:59.759845 30735 rpcz_store.cc:276] 0709 13:10:58.332405 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.475860 (+143455us) service_pool.cc:224] Handling call
0709 13:10:58.607545 (+131685us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:59.658330 (+1050785us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:59.759275 (+100945us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400841a54. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:10:59.759426 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2415286144}
I20260709 13:10:59.776691 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:59.706586 32270 raft_consensus.cc:493] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:10:59.778411 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:59.782740 30024 raft_consensus.cc:2393] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 3: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:10:59.778281 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:59.747323 30169 rpcz_store.cc:276] 0709 13:10:58.153396 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.699239 (+545843us) service_pool.cc:224] Handling call
0709 13:10:58.744546 (+ 45307us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:59.568336 (+823790us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:59.746762 (+178426us) spinlock_profiling.cc:243] Waited 817 ms on lock 0x7b540012f554. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:10:59.746920 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1878997760}
I20260709 13:10:59.753018 32630 consensus_queue.cc:260] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:59.776651 30175 rpcz_store.cc:276] 0709 13:10:57.970735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.971171 (+   436us) service_pool.cc:224] Handling call
0709 13:10:58.022342 (+ 51171us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:58.024076 (+  1734us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:58.024105 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:58.024588 (+   483us) log.cc:844] Serialized 26 byte log entry
0709 13:10:58.201365 (+176777us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:58.201405 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:58.201472 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:59.774707 (+1573235us) spinlock_profiling.cc:243] Waited 1.61 ms on lock 0x7b4400022b4c. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eeef3c85 00007f99eeef46a2 00007f99f1c661db 00007f99f1c61aaf 00007f99f1c5586e 00007f99f1c54bb6 00007f99f1c547d8 00007f99f1c5e221 00007f99f1c5e1d9 00007f99f1c5e169
0709 13:10:59.776052 (+  1345us) raft_consensus.cc:1685] finished
0709 13:10:59.776071 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:59.776255 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":36831,"raft.queue_time_us":126,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":19468,"spinlock_wait_cycles":3696000,"thread_start_us":176442,"threads_started":1,"wal-append.queue_time_us":217229}
I20260709 13:10:59.784185 30170 raft_consensus.cc:1240] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260709 13:10:59.765125 32681 raft_consensus.cc:515] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:59.794493 32681 leader_election.cc:290] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:59.800969 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:59.803156 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:59.803741 30169 raft_consensus.cc:2468] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 5.
I20260709 13:10:59.804482 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:59.805399 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:59.806806 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:59.778499 30729 rpcz_store.cc:276] 0709 13:10:57.377008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.379471 (+  2463us) service_pool.cc:224] Handling call
0709 13:10:57.954580 (+575109us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:58.236828 (+282248us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:58.236863 (+    35us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:58.237477 (+   614us) log.cc:844] Serialized 52 byte log entry
0709 13:10:58.331268 (+ 93791us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:58.334684 (+  3416us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:58.336020 (+  1336us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:58.815616 (+479596us) raft_consensus.cc:1685] finished
0709 13:10:58.815634 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:59.766647 (+951013us) spinlock_profiling.cc:243] Waited 283 ms on lock 0x7b54002995d0. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20b98ad 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:10:59.766819 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25093,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"spinlock_wait_cycles":651586944,"thread_start_us":90428,"threads_started":1,"wal-append.queue_time_us":152959}
W20260709 13:10:59.808908 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 76555.2us
I20260709 13:10:59.769745 32615 raft_consensus.cc:515] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:59.810096 32412 leader_election.cc:290] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:59.809957 32270 raft_consensus.cc:515] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:59.811365 32588 raft_consensus.cc:2804] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:10:59.811594 32615 leader_election.cc:290] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:59.777383 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:59.812496 32238 leader_election.cc:290] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:59.812829 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:59.813871 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:59.806142 32573 consensus_queue.cc:1059] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.030s
I20260709 13:10:59.814780 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:59.815234 30170 raft_consensus.cc:1240] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:10:59.815760 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:10:59.741648 32694 log.cc:927] Time spent T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
I20260709 13:10:59.749236 32595 leader_election.cc:290] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:59.721465 32589 raft_consensus.cc:740] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:59.812381 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:59.821517 30730 raft_consensus.cc:2468] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 6.
I20260709 13:10:59.819512 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:59.807013 30169 raft_consensus.cc:3060] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:10:59.822579 30174 raft_consensus.cc:2468] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 6.
I20260709 13:10:59.825429 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:59.824751 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:59.824002 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:59.828156 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:59.828717 30025 raft_consensus.cc:2468] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 6.
I20260709 13:10:59.829440 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:59.830009 30025 raft_consensus.cc:2468] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 8.
I20260709 13:10:59.812000 32270 leader_election.cc:290] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:59.835188 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:59.832947 30025 raft_consensus.cc:1240] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:59.814074 32670 leader_election.cc:290] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:59.808844 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
W20260709 13:10:59.831885 30700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.780711 32600 raft_consensus.cc:740] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:10:59.771224 32678 leader_election.cc:290] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:59.817617 32691 raft_consensus.cc:2804] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:10:59.819855 29993 connection.cc:256] RPC call timeout handler was delayed by -1.5380587510001078s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18580000000000002s for a response
I20260709 13:10:59.770958 32658 leader_election.cc:290] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:10:59.772029 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:59.771461 32631 raft_consensus.cc:515] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:10:59.845899 29993 connection.cc:256] RPC call timeout handler was delayed by -1.3094587510000792s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21120000000000003s for a response
I20260709 13:10:59.820029 32588 raft_consensus.cc:493] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:59.841977 30023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 1561) took 1022 ms. Trace:
I20260709 13:10:59.731017 32489 raft_consensus.cc:515] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:59.831552 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:59.847560 32600 consensus_queue.cc:260] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:10:59.867699 30169 raft_consensus.cc:2468] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 3.
I20260709 13:10:59.847892 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:59.848338 32690 raft_consensus.cc:493] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:59.850943 32692 raft_consensus.cc:515] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:59.852005 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:59.852842 32587 leader_election.cc:290] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:59.855324 30026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54198 (request call id 1825) took 1034 ms. Trace:
I20260709 13:10:59.860420 30700 leader_election.cc:304] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:10:59.840960 32691 raft_consensus.cc:493] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:59.838743 32617 leader_election.cc:290] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:10:59.832854 32246 raft_consensus.cc:493] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:59.843199 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:59.877259 30173 raft_consensus.cc:3060] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:59.863044 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:59.877442 30026 rpcz_store.cc:276] 0709 13:10:58.820986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:59.471212 (+650226us) service_pool.cc:224] Handling call
0709 13:10:59.471538 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:59.727112 (+255574us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:59.855072 (+127960us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b5400108e54. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:10:59.855242 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":517982976}
I20260709 13:10:59.844296 32504 leader_election.cc:290] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:10:59.880205 29991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.879105 30170 raft_consensus.cc:2393] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 8: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:10:59.918010 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:10:59.868636 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:59.919225 30730 raft_consensus.cc:2468] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 4.
I20260709 13:10:59.917106 30175 raft_consensus.cc:2468] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 8.
I20260709 13:10:59.921132 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:59.664764 30733 rpcz_store.cc:276] 0709 13:10:57.877324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.955272 (+ 77948us) service_pool.cc:224] Handling call
0709 13:10:57.955578 (+   306us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:10:57.961590 (+  6012us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:57.961630 (+    40us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:10:57.962273 (+   643us) log.cc:844] Serialized 52 byte log entry
0709 13:10:58.335851 (+373578us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:58.697016 (+361165us) log.cc:844] Serialized 14 byte log entry
0709 13:10:59.379252 (+682236us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:59.392907 (+ 13655us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:59.489413 (+ 96506us) raft_consensus.cc:1685] finished
0709 13:10:59.489446 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:59.494764 (+  5318us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35726,"prepare.queue_time_us":452222,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"raft.queue_time_us":128453,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":33953,"thread_start_us":1020780,"threads_started":3,"wal-append.queue_time_us":449602}
W20260709 13:10:59.899622 30702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.916801 30024 raft_consensus.cc:2468] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 6.
I20260709 13:10:59.890129 30736 raft_consensus.cc:2468] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 7.
W20260709 13:10:59.877563 29993 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:10:59.926503 29993 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:10:59.922282 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:59.928256 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:10:59.879745 30700 leader_election.cc:304] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:59.875383 30023 rpcz_store.cc:276] 0709 13:10:58.819749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.823979 (+  4230us) service_pool.cc:224] Handling call
0709 13:10:58.824218 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:58.824398 (+   180us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:10:59.661495 (+837097us) log.cc:844] Serialized 14 byte log entry
0709 13:10:59.841455 (+179960us) log.cc:844] Serialized 14 byte log entry
0709 13:10:59.841669 (+   214us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:59.841711 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:59.841769 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:59.841831 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:59.841927 (+    96us) inbound_call.cc:177] Queueing success response
0709 13:10:59.849945 (+  8018us) spinlock_profiling.cc:243] Waited 1.85 ms on lock 0x7b180044c0e0. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f7e95de1 00007f99f7ea25b1 00007f99eefcd3f3 00007f99eefcf7c1 00007f99eefcf779 00007f99eefcf709 00007f99eefcf6d1 00007f99eefce9cd 000000000038f354 000000000038f199 00007f99eefb083a
Metrics: {"mutex_wait_us":4496,"prepare.queue_time_us":825456,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":60,"raft.queue_time_us":64,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":3429,"spinlock_wait_cycles":4260608,"thread_start_us":1016247,"threads_started":2}
I20260709 13:10:59.930364 30020 raft_consensus.cc:2468] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 4.
I20260709 13:10:59.930675 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:59.932734 30169 raft_consensus.cc:2393] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 5: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
W20260709 13:10:59.933388 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 53726.3us
I20260709 13:10:59.934670 30700 leader_election.cc:304] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:59.936184 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:10:59.940109 30730 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da"
dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
mode: GRACEFUL
new_leader_uuid: "5ec73dc157ed476ca903a7d596271719"
 from {username='slave'} at 127.0.0.1:55634
I20260709 13:10:59.940716 30733 raft_consensus.cc:1240] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 5. Current term is 6. Ops: []
I20260709 13:10:59.939723 29993 leader_election.cc:304] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:10:59.874899 32588 raft_consensus.cc:3060] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:10:59.942741 30700 leader_election.cc:304] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:59.908293 32678 raft_consensus.cc:2804] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:10:59.947921 29993 leader_election.cc:304] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:10:59.947021 30098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33990 (request call id 1895) took 1111 ms. Trace:
I20260709 13:10:59.948650 30733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56954 (request call id 539) took 1249 ms. Trace:
I20260709 13:10:59.961678 30733 rpcz_store.cc:276] 0709 13:10:58.699181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:59.939108 (+1239927us) service_pool.cc:224] Handling call
0709 13:10:59.939365 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:59.948472 (+  9107us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:59.948611 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:59.962692 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:59.963336 30733 raft_consensus.cc:2393] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 6: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:10:59.964000 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:10:59.965055 30733 raft_consensus.cc:2368] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for earlier term 5. Current term is 6.
I20260709 13:10:59.956782 30098 rpcz_store.cc:276] 0709 13:10:58.835324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.835463 (+   139us) service_pool.cc:224] Handling call
0709 13:10:59.946297 (+1110834us) spinlock_profiling.cc:243] Waited 19.7 ms on lock 0x7b5800073598. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eef95e9c 00007f99eef95a5b 00007f99f7eaec09 00007f99f7008ee0 00007f99f70d20ab 00007f99f70d2131 00007f99f7093fc0 00007f99f707e929 00007f99f707e3d2 00007f99f05f5bd4
0709 13:10:59.946485 (+   188us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:59.946677 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:59.946704 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:10:59.946747 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:10:59.946785 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:59.946846 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:59.946959 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45274368}
I20260709 13:10:59.967723 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:59.955644 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
W20260709 13:10:59.943851 30731 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56954 (request call id 529) took 1621 ms (client timeout 1953 ms). Trace:
I20260709 13:10:59.971053 32631 leader_election.cc:290] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:10:59.858698 32589 consensus_queue.cc:260] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:59.897549 32690 raft_consensus.cc:515] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:59.933061 32246 raft_consensus.cc:515] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:10:59.955756 32238 raft_consensus.cc:2749] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:10:59.867982 30021 raft_consensus.cc:2468] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 6.
I20260709 13:10:59.771582 30097 rpcz_store.cc:276] 0709 13:10:58.194483 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.201092 (+  6609us) service_pool.cc:224] Handling call
0709 13:10:58.232585 (+ 31493us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:58.392517 (+159932us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:58.401171 (+  8654us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:58.478458 (+ 77287us) log.cc:844] Serialized 26 byte log entry
0709 13:10:59.686316 (+1207858us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:10:59.689618 (+  3302us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:59.694789 (+  5171us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:10:59.697333 (+  2544us) raft_consensus.cc:1685] finished
0709 13:10:59.699384 (+  2051us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:10:59.706905 (+  7521us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":129222,"raft.queue_time_us":140858,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":16999,"thread_start_us":1204205,"threads_started":1,"wal-append.queue_time_us":1169117}
I20260709 13:10:59.919224 32691 raft_consensus.cc:3060] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:10:59.977412 30736 raft_consensus.cc:1275] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:11:00.036935 30736 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56954 (request call id 540) took 1337 ms. Trace:
I20260709 13:11:00.037328 30736 rpcz_store.cc:276] 0709 13:10:58.699808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:59.939183 (+1239375us) service_pool.cc:224] Handling call
0709 13:10:59.977093 (+ 37910us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:00.036660 (+ 59567us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:00.036874 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:10:59.978127 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:00.038298 30169 raft_consensus.cc:3060] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:59.983191 32706 raft_consensus.cc:493] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:59.983790 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:10:59.985836 32667 consensus_queue.cc:1048] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:10:59.876178 32670 consensus_queue.cc:1059] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.100s
I20260709 13:10:59.931424 32699 raft_consensus.cc:493] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:10:59.939563 32587 raft_consensus.cc:2749] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:10:59.999212 29993 leader_election.cc:304] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:00.001963 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:00.002247 30170 raft_consensus.cc:3060] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:10:59.955389 32616 raft_consensus.cc:2749] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:10:59.965688 32663 raft_consensus.cc:2749] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:10:59.988785 32501 raft_consensus.cc:2804] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:00.016340 30173 raft_consensus.cc:2468] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 6.
W20260709 13:11:00.009948 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 91897.4us
I20260709 13:11:00.055923 30096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33990 (request call id 1900) took 1212 ms. Trace:
I20260709 13:11:00.056988 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:10:59.995415 32678 raft_consensus.cc:697] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:00.055377 30702 leader_election.cc:304] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:10:59.999212 32270 raft_consensus.cc:493] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:00.008178 32378 raft_consensus.cc:493] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:00.007642 32680 raft_consensus.cc:493] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
W20260709 13:11:00.022511 32657 log.cc:927] Time spent T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 1.818s	user 0.003s	sys 0.037s
W20260709 13:11:00.048897 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 49769.2us
I20260709 13:11:00.070971 29993 leader_election.cc:304] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:00.049873 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:00.072121 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:00.072582 30735 raft_consensus.cc:3060] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:00.075098 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:00.056326 30096 rpcz_store.cc:276] 0709 13:10:58.843390 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.843514 (+   124us) service_pool.cc:224] Handling call
0709 13:11:00.055270 (+1211756us) spinlock_profiling.cc:243] Waited 31.1 ms on lock 0x7b5800073598. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eef95b71 00007f99eef95a22 00007f99f7eaec09 00007f99f7008ee0 00007f99f70d20ab 00007f99f70d2131 00007f99f7093fc0 00007f99f707e929 00007f99f707e3d2 00007f99f05f5bd4
0709 13:11:00.055444 (+   174us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:00.055604 (+   160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:00.055631 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:00.055674 (+    43us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:00.055705 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:00.055760 (+    55us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:00.055865 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":71551360}
I20260709 13:11:00.012113 32609 raft_consensus.cc:493] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:10:59.965363 32617 raft_consensus.cc:493] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:00.063297 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:00.064406 30176 raft_consensus.cc:2368] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for earlier term 5. Current term is 6.
I20260709 13:11:00.081187 30170 raft_consensus.cc:2468] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 6.
I20260709 13:11:00.081509 30733 raft_consensus.cc:2468] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 5.
I20260709 13:11:00.045745 32706 raft_consensus.cc:515] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:00.082583 30142 leader_election.cc:304] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:00.082649 30733 raft_consensus.cc:1240] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:11:00.057622 32238 raft_consensus.cc:2804] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:00.042380 32589 raft_consensus.cc:3060] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:00.090618 30735 raft_consensus.cc:2468] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 8.
I20260709 13:11:00.070662 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:00.062343 32631 raft_consensus.cc:493] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:00.069545 32568 raft_consensus.cc:2804] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:00.054507 32501 raft_consensus.cc:493] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:00.088493 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:11:00.065426 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 63681.4us
I20260709 13:11:00.090334 30733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51004 (request call id 601) took 1261 ms. Trace:
W20260709 13:11:00.008754 30731 rpcz_store.cc:269] 0709 13:10:58.319152 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.320726 (+  1574us) service_pool.cc:224] Handling call
0709 13:10:59.847787 (+1527061us) spinlock_profiling.cc:243] Waited 1.27 ms on lock 0x7b5800004898. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eef95b71 00007f99eef95eee 0000000000375939 00007f99f70091e0 00007f99f70d20c4 00007f99f70d2131 00007f99f70800a0 00007f99f707f984 00007f99f05fa6d4 00007f99f05fa662
0709 13:10:59.940866 (+ 93079us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2915200}
I20260709 13:11:00.069561 30169 raft_consensus.cc:2468] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 6.
I20260709 13:11:00.096853 30733 rpcz_store.cc:276] 0709 13:10:58.829151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.082178 (+1253027us) service_pool.cc:224] Handling call
0709 13:11:00.082445 (+   267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:00.090079 (+  7634us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:00.090280 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:00.091617 30168 raft_consensus.cc:2393] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 5: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:11:00.092633 30142 leader_election.cc:304] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:00.094604 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:00.078449 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:00.100498 30176 raft_consensus.cc:2393] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 6: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:11:00.080457 32578 raft_consensus.cc:2749] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:00.078186 32378 raft_consensus.cc:515] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:00.101066 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:00.103055 30170 raft_consensus.cc:2468] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 4.
I20260709 13:11:00.090735 32238 raft_consensus.cc:493] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:00.102022 32568 raft_consensus.cc:697] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:00.120607 32568 consensus_queue.cc:237] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:00.121897 32378 leader_election.cc:290] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:00.087296 32609 raft_consensus.cc:515] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:00.123987 32609 leader_election.cc:290] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:00.119851 32238 raft_consensus.cc:3060] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:00.057993 32699 raft_consensus.cc:515] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:00.126430 30700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.093374 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:00.123924 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:00.090821 32658 raft_consensus.cc:2804] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:00.098143 32501 raft_consensus.cc:3060] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:00.141855 30067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.141418 32588 raft_consensus.cc:515] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:00.143523 32706 leader_election.cc:290] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:00.103641 32702 consensus_queue.cc:1059] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 13:11:00.074126 32270 raft_consensus.cc:515] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:00.145226 32690 leader_election.cc:290] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:00.145448 32702 raft_consensus.cc:3055] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:00.145830 32702 raft_consensus.cc:740] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:00.133651 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:00.147482 30733 raft_consensus.cc:1240] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 7. Current term is 8. Ops: []
W20260709 13:11:00.150097 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 51221.2us
I20260709 13:11:00.085728 32617 raft_consensus.cc:515] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:00.152228 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 75120.6us
I20260709 13:11:00.157024 29993 leader_election.cc:304] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:00.144984 32588 leader_election.cc:290] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:00.147842 32658 raft_consensus.cc:493] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.080772 32680 raft_consensus.cc:515] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:00.168135 30736 raft_consensus.cc:1240] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:00.165881 29993 leader_election.cc:304] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:00.146626 32270 leader_election.cc:290] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:00.102350 32700 raft_consensus.cc:2804] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:00.126088 32492 consensus_queue.cc:1059] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:11:00.098960 32631 raft_consensus.cc:515] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:00.169736 32658 raft_consensus.cc:3060] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:00.213551 30700 leader_election.cc:304] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:00.214521 32588 raft_consensus.cc:2804] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:00.214877 32588 raft_consensus.cc:493] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:00.215221 32588 raft_consensus.cc:3060] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:00.216403 30703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.218164 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:00.218439 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:00.218727 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:00.220095 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:00.221025 32631 leader_election.cc:290] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:00.221531 32714 log.cc:927] Time spent T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 13:11:00.221688 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:00.216881 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:00.222309 30025 raft_consensus.cc:2468] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 6.
I20260709 13:11:00.222751 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:00.223106 32691 raft_consensus.cc:515] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:00.224509 30027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52098 (request call id 457) took 2934 ms. Trace:
I20260709 13:11:00.224236 32238 raft_consensus.cc:515] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:00.225332 32704 log.cc:927] Time spent T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.189s	user 0.000s	sys 0.003s
I20260709 13:11:00.169543 32716 raft_consensus.cc:2804] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:00.175678 32492 raft_consensus.cc:2804] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:00.176079 30731 raft_consensus.cc:1240] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 6. Current term is 7. Ops: [6.6-6.6]
I20260709 13:11:00.179266 32699 leader_election.cc:290] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:11:00.228108 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 149706us
I20260709 13:11:00.224877 30027 rpcz_store.cc:276] 0709 13:10:57.290291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.290436 (+   145us) service_pool.cc:224] Handling call
0709 13:10:57.292322 (+  1886us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:58.017133 (+724811us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b540048db20. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f2031dc0 00007f99f20bc1c0 00007f99f20bd231 00007f99f20b9d8f 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c
0709 13:10:58.122084 (+104951us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:00.224236 (+2102152us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b540048db20. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f2031dc0 00007f99f20bda02 00007f99f20b9dd6 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2
0709 13:11:00.224428 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":281198720}
I20260709 13:11:00.228897 30140 leader_election.cc:304] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:00.230871 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:00.180178 32501 raft_consensus.cc:515] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:00.180805 32692 leader_election.cc:290] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:00.141927 32678 consensus_queue.cc:237] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:00.183949 32680 leader_election.cc:290] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:00.186519 30730 raft_consensus.cc:606] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEADER]: Received request to transfer leadership to TS 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:00.236658 30730 raft_consensus.cc:1240] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:00.237025 30140 leader_election.cc:304] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:00.187829 32595 raft_consensus.cc:493] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:00.230106 30700 leader_election.cc:304] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:00.188853 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:00.190457 32665 raft_consensus.cc:3055] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:00.170967 30068 leader_election.cc:304] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:00.169275 29993 leader_election.cc:304] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:00.223655 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:00.188158 32630 raft_consensus.cc:3060] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:00.248682 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:00.266206 30094 raft_consensus.cc:2393] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 5: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:00.255786 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:00.259491 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:00.260262 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:00.260964 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:00.262892 30140 leader_election.cc:304] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:00.272367 30140 leader_election.cc:304] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:11:00.318959 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 149743us
I20260709 13:11:00.319607 30066 leader_election.cc:304] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
W20260709 13:11:00.277179 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 106279us
W20260709 13:11:00.318629 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 45496.2us
I20260709 13:11:00.327443 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:00.328141 30025 raft_consensus.cc:2468] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 8.
I20260709 13:11:00.225160 32691 leader_election.cc:290] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:00.262624 32716 raft_consensus.cc:697] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:00.146615 32702 consensus_queue.cc:260] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:00.236377 32700 raft_consensus.cc:697] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 8 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:00.241256 32492 raft_consensus.cc:697] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:00.264577 32577 raft_consensus.cc:2749] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 13:11:00.358240 30732 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56954 (request call id 531) took 2038 ms (client timeout 2064 ms). Trace:
I20260709 13:11:00.358872 32577 raft_consensus.cc:2749] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:00.359587 32577 raft_consensus.cc:2749] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:00.356920 32700 consensus_queue.cc:237] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:00.276131 32639 raft_consensus.cc:2749] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:00.263669 32665 raft_consensus.cc:740] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
W20260709 13:11:00.373718 30700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.276592 32680 raft_consensus.cc:2804] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:00.326129 32270 raft_consensus.cc:2804] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:00.342980 32507 raft_consensus.cc:2804] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:00.319356 32631 consensus_queue.cc:1059] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.059s
I20260709 13:11:00.326995 32706 consensus_queue.cc:1048] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.053s
I20260709 13:11:00.270622 32595 raft_consensus.cc:515] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:00.380709 32680 raft_consensus.cc:493] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:00.392352 32680 raft_consensus.cc:3060] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:00.399855 32680 raft_consensus.cc:515] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:00.402513 32680 leader_election.cc:290] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:11:00.358837 30732 rpcz_store.cc:269] 0709 13:10:58.319681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.320792 (+  1111us) service_pool.cc:224] Handling call
0709 13:11:00.188665 (+1867873us) spinlock_profiling.cc:243] Waited 2 ms on lock 0x7b5800004898. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eef95b71 00007f99eef95a22 00007f99f7eaec09 00007f99f7008ee0 00007f99f70d20ab 00007f99f70d2131 00007f99f70800a0 00007f99f707f984 00007f99f05fa6d4 00007f99f05fa662
0709 13:11:00.358167 (+169502us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4608256}
I20260709 13:11:00.385839 32507 raft_consensus.cc:697] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:00.388645 32615 raft_consensus.cc:2804] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:00.387167 32270 raft_consensus.cc:697] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 6 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:00.358333 32492 consensus_queue.cc:237] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:00.430105 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 157813us
I20260709 13:11:00.428354 32615 raft_consensus.cc:493] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:00.433169 30140 leader_election.cc:304] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:11:00.436492 30142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 195667us
I20260709 13:11:00.432072 32719 raft_consensus.cc:493] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.417614 32658 raft_consensus.cc:515] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:00.434502 32615 raft_consensus.cc:3060] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:00.436477 32588 raft_consensus.cc:515] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:00.426911 32665 consensus_queue.cc:260] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:00.434122 32507 consensus_queue.cc:237] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:00.436041 32716 consensus_queue.cc:237] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:00.446909 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 127374us
I20260709 13:11:00.457175 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:00.547385 30100 raft_consensus.cc:2393] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 5: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
W20260709 13:11:00.528647 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 200514us
I20260709 13:11:00.446803 30140 leader_election.cc:304] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
W20260709 13:11:00.549844 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 108336us
I20260709 13:11:00.444614 32701 raft_consensus.cc:493] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:00.482344 32706 raft_consensus.cc:493] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
W20260709 13:11:00.535140 32723 log.cc:927] Time spent T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:11:00.535909 32595 leader_election.cc:290] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:00.552680 32700 raft_consensus.cc:2804] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:00.535193 32246 leader_election.cc:290] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:00.553072 32739 consensus_queue.cc:1048] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:11:00.553133 32700 raft_consensus.cc:493] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.535207 32658 leader_election.cc:290] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:11:00.536353 32676 log.cc:927] Time spent T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 2.083s	user 0.005s	sys 0.023s
I20260709 13:11:00.553992 32700 raft_consensus.cc:3060] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:00.555698 30177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43840 (request call id 1700) took 2585 ms. Trace:
I20260709 13:11:00.556027 30177 rpcz_store.cc:276] 0709 13:10:57.970650 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:57.970762 (+   112us) service_pool.cc:224] Handling call
0709 13:10:57.971020 (+   258us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:10:57.972851 (+  1831us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:10:57.972879 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:10:58.029552 (+ 56673us) spinlock_profiling.cc:243] Waited 1.13 ms on lock 0x7b2c000233e8. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f09b3a11 00007f99f09c3372 00007f99f20f5a01 00007f99f20ba43a 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2
0709 13:10:58.029933 (+   381us) log.cc:844] Serialized 26 byte log entry
0709 13:10:58.213987 (+184054us) spinlock_profiling.cc:243] Waited 36.7 ms on lock 0x7b1800328d80. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f7e95de1 00007f99f7ea25b1 00007f99eefafe07 00007f99f7e0aab9 00007f99eefcc69b 00007f99eefca93f 00007f99eefccc02 00007f99f1c5420b 00007f99f1c59d23 00007f99f1c5a0d1 00007f99f2075a0f
0709 13:10:58.329982 (+115995us) raft_consensus.cc:1645] Marking committed up to 2
0709 13:10:58.330028 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:10:58.330105 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:00.509079 (+2178974us) spinlock_profiling.cc:243] Waited 4.49 ms on lock 0x7b4400022b4c. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eeef3c85 00007f99eeef46a2 00007f99f1c661db 00007f99f1c61aaf 00007f99f1c5586e 00007f99f1c54bb6 00007f99f1c547d8 00007f99f1c5e221 00007f99f1c5e1d9 00007f99f1c5e169
0709 13:11:00.555481 (+ 46402us) raft_consensus.cc:1685] finished
0709 13:11:00.555501 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:00.555622 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1494,"raft.queue_time_us":3307,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":7261,"spinlock_wait_cycles":97332096,"thread_start_us":115822,"threads_started":1,"wal-append.queue_time_us":343308}
I20260709 13:11:00.506920 32238 leader_election.cc:290] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:00.540645 32600 raft_consensus.cc:3060] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:00.541525 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:00.440192 32577 raft_consensus.cc:2749] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:00.489825 30172 raft_consensus.cc:1240] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 8 LEADER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:00.548663 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
W20260709 13:11:00.477931 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 154574us
I20260709 13:11:00.538914 32617 leader_election.cc:290] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:00.470018 30729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:56954 (request call id 542) took 1769 ms. Trace:
I20260709 13:11:00.564190 30734 raft_consensus.cc:3060] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:00.564687 30066 leader_election.cc:304] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
W20260709 13:11:00.611119 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 46483.2us
W20260709 13:11:00.612370 30103 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33990 (request call id 1896) took 1741 ms (client timeout 2009 ms). Trace:
W20260709 13:11:00.612818 30103 rpcz_store.cc:269] 0709 13:10:58.837321 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:59.146567 (+309246us) service_pool.cc:224] Handling call
0709 13:11:00.548503 (+1401936us) spinlock_profiling.cc:243] Waited 25.6 ms on lock 0x7b5800073598. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eef95b71 00007f99eef95a22 00007f99f7eaec09 00007f99f7008ee0 00007f99f70d20ab 00007f99f70d2131 00007f99f70800a0 00007f99f707f984 00007f99f05fa6d4 00007f99f05fa662
0709 13:11:00.578461 (+ 29958us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":58990848}
I20260709 13:11:00.611044 30737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51004 (request call id 595) took 1918 ms. Trace:
I20260709 13:11:00.613960 30737 rpcz_store.cc:276] 0709 13:10:58.692334 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.692755 (+   421us) service_pool.cc:224] Handling call
0709 13:10:58.693006 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:10:59.765078 (+1072072us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:00.610768 (+845690us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54005c1a54. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:11:00.610979 (+   211us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2432913152}
I20260709 13:11:00.581588 29993 leader_election.cc:304] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:00.620615 30734 raft_consensus.cc:2468] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 7.
I20260709 13:11:00.505919 32270 consensus_queue.cc:237] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:00.448293 32719 raft_consensus.cc:515] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:00.584158 32588 leader_election.cc:290] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:00.636785 29992 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:00.637271 29992 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.625053 32358 raft_consensus.cc:2749] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:00.622498 32739 raft_consensus.cc:2804] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:00.586629 32700 raft_consensus.cc:515] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:00.571715 32706 raft_consensus.cc:515] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:00.639793 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 58287us
I20260709 13:11:00.640424 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
W20260709 13:11:00.641571 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 90715.6us
I20260709 13:11:00.651242 30140 leader_election.cc:304] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:00.616870 32617 consensus_queue.cc:1059] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:11:00.588375 32615 raft_consensus.cc:515] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:00.628279 32697 raft_consensus.cc:493] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:00.616602 32733 consensus_queue.cc:1059] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 13:11:00.655212 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:00.659231 30140 leader_election.cc:304] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:00.626423 32729 consensus_queue.cc:1059] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:11:00.577684 32701 raft_consensus.cc:515] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:00.663221 32276 consensus_queue.cc:1059] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:00.663686 32706 leader_election.cc:290] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:00.665465 32668 raft_consensus.cc:2749] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:00.643285 32739 raft_consensus.cc:493] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:00.670038 32739 raft_consensus.cc:3060] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:00.676421 32739 raft_consensus.cc:515] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:00.668020 30019 raft_consensus.cc:2468] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 6.
I20260709 13:11:00.665570 32743 raft_consensus.cc:2764] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 13:11:00.679175 32739 leader_election.cc:290] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:00.679656 32739 raft_consensus.cc:493] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.680064 32739 raft_consensus.cc:515] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:00.683177 32276 raft_consensus.cc:3055] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:00.683542 32276 raft_consensus.cc:740] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:00.684284 32276 consensus_queue.cc:260] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:00.685369 32276 raft_consensus.cc:3060] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:00.686477 32506 raft_consensus.cc:3060] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:00.691301 32489 leader_election.cc:290] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:00.692483 32631 raft_consensus.cc:493] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:00.693013 32631 raft_consensus.cc:515] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:00.666893 32566 raft_consensus.cc:3060] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:00.697465 32579 raft_consensus.cc:993] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4: : Instructing follower 5ec73dc157ed476ca903a7d596271719 to start an election
I20260709 13:11:00.698962 32739 leader_election.cc:290] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:00.699529 32739 raft_consensus.cc:3055] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:00.699896 32739 raft_consensus.cc:740] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:00.700731 32739 consensus_queue.cc:260] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:00.701855 32739 raft_consensus.cc:3060] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:00.704026 30019 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
mode: GRACEFUL
new_leader_uuid: "5ec73dc157ed476ca903a7d596271719"
 from {username='slave'} at 127.0.0.1:47450
I20260709 13:11:00.705722 32719 leader_election.cc:290] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:00.706445 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:00.706871 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:00.707420 30733 raft_consensus.cc:2376] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 6. Re-sending same reply.
I20260709 13:11:00.708542 30700 leader_election.cc:304] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:00.708906 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:00.710319 30730 raft_consensus.cc:1240] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:00.693638 30025 raft_consensus.cc:2468] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 4.
I20260709 13:11:00.713064 30700 leader_election.cc:304] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
W20260709 13:11:00.713682 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 92313.4us
W20260709 13:11:00.715742 30702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.708362 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:00.578029 30729 rpcz_store.cc:276] 0709 13:10:58.700279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.078843 (+1378564us) service_pool.cc:224] Handling call
0709 13:11:00.100204 (+ 21361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:00.132851 (+ 32647us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:11:00.227975 (+ 95124us) log.cc:844] Serialized 14 byte log entry
0709 13:11:00.445768 (+217793us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:00.469620 (+ 23852us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:00.469702 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:00.469810 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:00.469954 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":202713,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":1094,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":8833,"thread_start_us":196433,"threads_started":2,"wal-append.queue_time_us":313218}
W20260709 13:11:00.707310 32735 log.cc:927] Time spent T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 13:11:00.727710 30734 raft_consensus.cc:1240] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 7. Current term is 8. Ops: []
W20260709 13:11:00.728403 30142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 113000us
I20260709 13:11:00.729125 29993 leader_election.cc:304] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:00.726734 30028 raft_consensus.cc:2468] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 4.
I20260709 13:11:00.729938 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:00.730567 30734 raft_consensus.cc:2468] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 4.
I20260709 13:11:00.727105 30066 leader_election.cc:304] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:00.732784 30066 leader_election.cc:304] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:00.734663 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:00.735350 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:00.737079 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:00.737641 30177 raft_consensus.cc:2468] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 4.
I20260709 13:11:00.738570 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:00.739306 30702 leader_election.cc:304] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:00.739909 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:00.740243 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:00.740914 30170 raft_consensus.cc:2368] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 6. Current term is 7.
I20260709 13:11:00.741108 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:00.741616 30177 raft_consensus.cc:3060] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:00.738124 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:00.742738 30023 raft_consensus.cc:2468] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 5.
W20260709 13:11:00.770751 30703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:00.771761 30170 raft_consensus.cc:1240] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:00.776656 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:00.781517 30066 leader_election.cc:304] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:00.782411 30737 raft_consensus.cc:2393] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 6: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:11:00.782438 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:00.783316 30170 raft_consensus.cc:2368] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 6. Current term is 7.
I20260709 13:11:00.782922 30020 raft_consensus.cc:2468] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 5.
I20260709 13:11:00.728089 32685 raft_consensus.cc:2764] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 13:11:00.787914 30066 leader_election.cc:304] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
W20260709 13:11:00.789409 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 217156us
I20260709 13:11:00.791419 30068 leader_election.cc:400] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Vote denied by peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001) with higher term. Message: Invalid argument: T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for earlier term 5. Current term is 6.
I20260709 13:11:00.787225 30177 raft_consensus.cc:2468] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 8.
I20260709 13:11:00.793213 30068 leader_election.cc:403] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:11:00.662176 32697 raft_consensus.cc:515] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:00.770277 32699 raft_consensus.cc:2804] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:00.795970 29994 leader_election.cc:304] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
W20260709 13:11:00.798836 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 136092us
I20260709 13:11:00.802464 30175 raft_consensus.cc:1240] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:00.798338 30142 leader_election.cc:304] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:00.775197 32678 raft_consensus.cc:2804] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:00.775352 32670 raft_consensus.cc:2804] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:00.808887 30702 leader_election.cc:304] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:00.810391 30702 leader_election.cc:400] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Vote denied by peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001) with higher term. Message: Invalid argument: T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 6. Current term is 7.
I20260709 13:11:00.811337 30702 leader_election.cc:304] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:00.813715 30019 raft_consensus.cc:606] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Received request to transfer leadership to TS 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:00.814095 30019 raft_consensus.cc:614] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:00.815882 30702 leader_election.cc:400] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 election: Vote denied by peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001) with higher term. Message: Invalid argument: T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 6. Current term is 7.
I20260709 13:11:00.727692 32736 consensus_queue.cc:1059] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.079s
I20260709 13:11:00.794561 32630 raft_consensus.cc:1081] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Signalling peer 5ec73dc157ed476ca903a7d596271719 to start an election
I20260709 13:11:00.817484 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:00.807845 32573 raft_consensus.cc:2804] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:00.787127 32746 raft_consensus.cc:2804] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:00.833421 30169 raft_consensus.cc:2468] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 5.
I20260709 13:11:00.797796 32699 raft_consensus.cc:493] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:00.816887 30702 leader_election.cc:304] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:00.818281 32685 raft_consensus.cc:2804] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:00.812628 32731 raft_consensus.cc:2804] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:00.813014 30021 raft_consensus.cc:2468] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 8.
I20260709 13:11:00.829953 32358 raft_consensus.cc:2749] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:00.839493 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:00.830706 32617 consensus_queue.cc:1243] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer c99569d27a6f4c648eae7119fe3db124 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:11:00.822151 32692 raft_consensus.cc:2749] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:00.835335 32746 raft_consensus.cc:493] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.836840 32699 raft_consensus.cc:3060] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:00.851155 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:00.837157 32685 raft_consensus.cc:493] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:00.836699 32573 raft_consensus.cc:697] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:00.854205 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:00.862569 30020 raft_consensus.cc:3060] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:00.855399 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:00.856593 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:00.863430 30022 raft_consensus.cc:3060] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:00.863058 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 75221.8us
I20260709 13:11:00.870505 32573 consensus_queue.cc:237] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:00.871006 32701 leader_election.cc:290] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:11:00.860330 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 131259us
I20260709 13:11:00.842922 32731 raft_consensus.cc:697] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 7 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:00.872541 29993 leader_election.cc:304] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:00.877573 30020 raft_consensus.cc:2468] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 7.
I20260709 13:11:00.908563 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:00.908768 29993 leader_election.cc:304] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:00.846418 32609 raft_consensus.cc:2804] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:00.872128 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:00.909830 30140 leader_election.cc:304] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:00.910362 30737 raft_consensus.cc:2393] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 4: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:11:00.850397 32746 raft_consensus.cc:3060] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:00.853519 32617 raft_consensus.cc:2804] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:00.911509 29993 leader_election.cc:304] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:00.862663 32685 raft_consensus.cc:3060] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:00.917627 30022 raft_consensus.cc:2468] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 9.
I20260709 13:11:00.912425 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:00.923321 32609 raft_consensus.cc:697] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:00.923827 32600 raft_consensus.cc:2804] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:00.925014 32358 raft_consensus.cc:493] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:00.941644 32600 raft_consensus.cc:493] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.942090 32600 raft_consensus.cc:3060] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:00.941780 32358 raft_consensus.cc:515] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:00.925298 29993 leader_election.cc:304] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:00.945742 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:00.946450 30728 raft_consensus.cc:2410] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:11:00.928815 32763 raft_consensus.cc:2804] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:00.947166 32763 raft_consensus.cc:697] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 5 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:00.918358 32617 raft_consensus.cc:493] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:00.910979 32615 leader_election.cc:290] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:00.948232 32617 raft_consensus.cc:3060] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:00.948057 32763 consensus_queue.cc:237] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:00.943878 32358 leader_election.cc:290] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:00.943953 32697 leader_election.cc:290] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:00.923432 32747 raft_consensus.cc:3055] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:00.951545 32747 raft_consensus.cc:740] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:00.952649 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:00.953277 30175 raft_consensus.cc:2468] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 4.
I20260709 13:11:00.948271 32717 raft_consensus.cc:2804] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:00.954761 32747 consensus_queue.cc:260] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:00.955978 32747 raft_consensus.cc:3060] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:00.956714 32717 raft_consensus.cc:697] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:00.912631 32506 raft_consensus.cc:2749] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:00.957995 32588 raft_consensus.cc:493] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.958488 32588 raft_consensus.cc:515] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:00.957636 32717 consensus_queue.cc:237] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:00.910766 32700 leader_election.cc:290] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:00.910821 32276 raft_consensus.cc:2749] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:00.912583 32658 raft_consensus.cc:493] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.929320 32729 raft_consensus.cc:3060] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:00.932716 32736 raft_consensus.cc:3060] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:00.962531 29993 leader_election.cc:304] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
W20260709 13:11:00.969606 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 178292us
I20260709 13:11:00.970415 30068 leader_election.cc:304] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:00.918565 32579 consensus_queue.cc:1059] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:11:00.972955 30068 leader_election.cc:304] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:00.929320 32755 consensus_queue.cc:1059] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260709 13:11:00.968369 32670 raft_consensus.cc:697] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
W20260709 13:11:00.978793 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 141358us
I20260709 13:11:00.971383 32358 raft_consensus.cc:2804] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:00.968807 32752 raft_consensus.cc:493] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:00.968926 32615 raft_consensus.cc:493] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:00.972685 32739 raft_consensus.cc:2749] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:00.994204 30175 raft_consensus.cc:1275] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:00.991086 30068 leader_election.cc:304] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:00.996698 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:00.967661 32658 raft_consensus.cc:515] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:01.045991 32658 leader_election.cc:290] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:01.046123 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:00.998765 32358 raft_consensus.cc:493] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:01.047384 32358 raft_consensus.cc:3060] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:01.048674 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 47815.1us
I20260709 13:11:00.999925 32615 raft_consensus.cc:515] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:01.049167 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:01.036070 32617 raft_consensus.cc:515] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:01.037781 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:01.037894 30099 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8"
dest_uuid: "5ec73dc157ed476ca903a7d596271719"
 from {username='slave'} at 127.0.0.1:33990
I20260709 13:11:01.038797 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:01.039815 32670 consensus_queue.cc:237] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:01.041004 32579 raft_consensus.cc:3055] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:01.042513 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
W20260709 13:11:01.044287 30069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.063004 32699 raft_consensus.cc:515] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:01.065109 32699 leader_election.cc:290] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:01.050184 30023 raft_consensus.cc:2468] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 5.
I20260709 13:11:01.050217 30099 raft_consensus.cc:493] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:01.050642 30096 raft_consensus.cc:2468] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 4.
I20260709 13:11:01.060503 32658 raft_consensus.cc:493] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:01.066149 32760 consensus_queue.cc:1048] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:01.067099 30099 raft_consensus.cc:3060] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:01.059864 30094 raft_consensus.cc:2393] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 6: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:01.068550 32579 raft_consensus.cc:740] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:01.069377 32579 consensus_queue.cc:260] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:01.070730 32579 raft_consensus.cc:3060] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:01.072852 30701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.075906 30099 raft_consensus.cc:515] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:01.076843 32658 raft_consensus.cc:515] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:01.076216 29994 leader_election.cc:304] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:01.079011 29994 leader_election.cc:304] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:01.080272 30700 leader_election.cc:304] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:01.084347 30103 raft_consensus.cc:2468] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 4.
I20260709 13:11:00.975572 32678 raft_consensus.cc:697] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
W20260709 13:11:01.086877 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 95871.1us
I20260709 13:11:01.089843 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:01.090410 30068 leader_election.cc:304] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:01.092584 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:01.093708 30028 raft_consensus.cc:2468] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 5.
I20260709 13:11:01.085269 32592 raft_consensus.cc:2804] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:01.044305 32631 leader_election.cc:290] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:01.097301 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
W20260709 13:11:01.088765 30142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.098030 30025 raft_consensus.cc:3055] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:00.991397 32762 raft_consensus.cc:2804] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:01.107263 32600 raft_consensus.cc:515] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:01.095008 32592 raft_consensus.cc:493] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:01.111294 30177 raft_consensus.cc:1275] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:01.111649 32592 raft_consensus.cc:3060] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:01.099330 30729 raft_consensus.cc:1240] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:01.111840 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:01.112731 32630 consensus_queue.cc:1048] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:01.108189 32501 leader_election.cc:290] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:01.107755 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:01.117465 32358 raft_consensus.cc:515] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:01.121032 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:01.121608 30168 raft_consensus.cc:3060] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:01.126948 32615 leader_election.cc:290] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:01.127527 32701 consensus_queue.cc:1059] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:01.128535 30734 raft_consensus.cc:1240] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:01.127537 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:01.131075 32600 leader_election.cc:290] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:01.131963 32685 raft_consensus.cc:515] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:01.132386 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:01.133076 30734 raft_consensus.cc:3060] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:01.100394 32589 raft_consensus.cc:3055] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:01.097698 32588 leader_election.cc:290] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:01.104753 30728 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56954 (request call id 528) took 2785 ms (client timeout 3187 ms). Trace:
I20260709 13:11:01.134186 32589 raft_consensus.cc:740] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
W20260709 13:11:01.134371 30728 rpcz_store.cc:269] 0709 13:10:58.318837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:58.320824 (+  1987us) service_pool.cc:224] Handling call
0709 13:11:01.104542 (+2783718us) spinlock_profiling.cc:243] Waited 2.58 s on lock 0x7b54005307d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:11:01.104668 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5925922560}
I20260709 13:11:01.135442 32589 consensus_queue.cc:260] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:01.136654 32589 raft_consensus.cc:3060] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:01.141892 32358 leader_election.cc:290] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:00.991276 32609 consensus_queue.cc:237] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:01.142212 32678 consensus_queue.cc:237] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:01.092631 32716 raft_consensus.cc:493] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:01.098456 30025 raft_consensus.cc:740] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:01.143576 32716 raft_consensus.cc:515] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:01.144227 30025 consensus_queue.cc:260] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:01.145290 30025 raft_consensus.cc:3060] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:01.087788 30099 leader_election.cc:290] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:01.147732 28889 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:11:01.092423 32760 raft_consensus.cc:2804] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:01.111042 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:01.132329 32668 consensus_queue.cc:1059] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:01.156595 29993 leader_election.cc:304] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:00.999863 32752 raft_consensus.cc:515] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:01.134310 30069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.150173 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:01.110596 32658 leader_election.cc:290] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:01.106890 32617 leader_election.cc:290] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:01.120574 32746 raft_consensus.cc:515] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:01.135360 30168 raft_consensus.cc:2468] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 5.
I20260709 13:11:01.159116 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:01.172855 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:01.095292 32699 raft_consensus.cc:2749] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:01.175288 29993 leader_election.cc:304] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:01.129114 32736 raft_consensus.cc:2749] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001) with higher term. Message: Invalid argument: T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for earlier term 5. Current term is 6.
I20260709 13:11:01.160429 30023 raft_consensus.cc:2468] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 6.
I20260709 13:11:01.163182 30094 raft_consensus.cc:3055] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:01.165285 30170 raft_consensus.cc:2468] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 3.
I20260709 13:11:01.178251 30094 raft_consensus.cc:740] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
W20260709 13:11:01.178650 29992 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.176903 30098 raft_consensus.cc:1275] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:01.179638 30025 raft_consensus.cc:2468] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 7.
I20260709 13:11:01.168228 30734 raft_consensus.cc:2468] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 5.
I20260709 13:11:01.094764 32068 raft_consensus.cc:3060] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:01.152552 32760 raft_consensus.cc:493] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:01.108134 32762 raft_consensus.cc:493] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:01.150952 32766 raft_consensus.cc:2749] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:01.209714 30102 raft_consensus.cc:1217] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Deduplicated request from leader. Original: 3.5->[4.6-4.6]   Dedup: 4.6->[]
I20260709 13:11:01.211061 32729 raft_consensus.cc:2749] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:01.214002 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:00.992057 32731 consensus_queue.cc:237] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:01.297215 30734 raft_consensus.cc:1275] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:01.302259 30102 raft_consensus.cc:1240] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:11:01.295039 30025 raft_consensus.cc:1275] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:01.177070 32631 raft_consensus.cc:493] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.172659 32358 raft_consensus.cc:2749] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:01.277419 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:01.306253 32760 raft_consensus.cc:3060] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:01.303742 32639 raft_consensus.cc:3055] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:01.312902 32685 leader_election.cc:290] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:01.313164 32639 raft_consensus.cc:740] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:01.314114 32639 consensus_queue.cc:260] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:01.310268 32658 consensus_queue.cc:1048] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:11:01.315989 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:01.316500 30099 raft_consensus.cc:3060] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:01.319635 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:01.320691 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:01.223172 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:01.310902 32631 raft_consensus.cc:515] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:01.324327 32665 raft_consensus.cc:3060] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:01.325440 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:01.329294 30021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52098 (request call id 479) took 1111 ms. Trace:
I20260709 13:11:01.329645 30021 rpcz_store.cc:276] 0709 13:11:00.218095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.218209 (+   114us) service_pool.cc:224] Handling call
0709 13:11:01.329151 (+1110942us) spinlock_profiling.cc:243] Waited 588 ms on lock 0x7b540013ddd4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:11:01.329244 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1353275136}
I20260709 13:11:01.330597 32752 leader_election.cc:290] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:01.336699 32716 leader_election.cc:290] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:01.337622 30066 leader_election.cc:304] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:01.339260 30066 leader_election.cc:304] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:01.339463 30140 leader_election.cc:304] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:01.340354 30140 leader_election.cc:304] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:01.341104 32752 raft_consensus.cc:2804] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:01.341534 32752 raft_consensus.cc:493] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:01.341902 32752 raft_consensus.cc:3060] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:01.342945 32658 raft_consensus.cc:3060] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:01.341118 30140 leader_election.cc:304] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
W20260709 13:11:01.301772 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 117058us
I20260709 13:11:01.350342 30096 raft_consensus.cc:2468] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 6.
I20260709 13:11:01.351209 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:01.289294 30068 leader_election.cc:304] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
W20260709 13:11:01.352099 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 62915.9us
I20260709 13:11:01.352777 30068 leader_election.cc:304] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:01.304669 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:01.353716 30102 raft_consensus.cc:2410] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:11:01.354452 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:01.355378 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:01.207316 32719 raft_consensus.cc:2804] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:01.215734 30101 raft_consensus.cc:1275] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:01.356535 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:01.358577 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:01.359088 30066 leader_election.cc:304] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:01.359972 30068 leader_election.cc:304] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:01.238760 32743 raft_consensus.cc:3055] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:01.264079 32589 raft_consensus.cc:493] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.358103 32700 raft_consensus.cc:2804] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:01.315292 32639 raft_consensus.cc:3060] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:01.362577 30099 raft_consensus.cc:2468] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 5.
I20260709 13:11:01.294793 32746 leader_election.cc:290] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:01.303833 32762 raft_consensus.cc:3060] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:01.367523 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:01.378873 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:01.379379 30102 raft_consensus.cc:3060] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:01.379693 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:01.380419 30097 raft_consensus.cc:2393] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 4: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:01.381121 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:01.382457 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:01.382956 32592 raft_consensus.cc:515] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:01.384399 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:01.384927 32592 leader_election.cc:290] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:01.364920 32699 raft_consensus.cc:2804] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:01.385773 30102 raft_consensus.cc:2468] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 5.
I20260709 13:11:01.385986 32699 raft_consensus.cc:697] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 6 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:01.386134 32631 leader_election.cc:290] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:01.386783 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:01.386843 32699 consensus_queue.cc:237] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:01.387486 30102 raft_consensus.cc:2468] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 6.
I20260709 13:11:01.388449 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:01.367846 32617 consensus_queue.cc:1059] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:11:01.384959 30170 raft_consensus.cc:3060] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:01.367714 32701 raft_consensus.cc:2804] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:01.390796 32701 raft_consensus.cc:493] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:01.391131 32701 raft_consensus.cc:3060] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:01.369434 30068 leader_election.cc:304] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:01.369987 32595 consensus_queue.cc:1048] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:11:01.383134 30702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.370851 32747 raft_consensus.cc:2804] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:01.369940 32589 raft_consensus.cc:515] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:01.371354 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:01.372180 30175 raft_consensus.cc:1240] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:01.372376 32706 consensus_queue.cc:1059] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:01.400532 30170 raft_consensus.cc:2468] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 5.
I20260709 13:11:01.363344 32763 raft_consensus.cc:2749] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:01.373456 32702 raft_consensus.cc:3060] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:01.367439 32757 raft_consensus.cc:493] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:01.375662 32760 raft_consensus.cc:515] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:01.360086 32766 raft_consensus.cc:2749] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:01.367583 32615 raft_consensus.cc:2804] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:01.389529 32617 raft_consensus.cc:3055] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:01.395937 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:01.398814 32747 raft_consensus.cc:697] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 7 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:01.395929 32746 raft_consensus.cc:3060] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:01.363634 32743 raft_consensus.cc:740] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:01.449326 32743 consensus_queue.cc:260] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:01.450501 32743 raft_consensus.cc:3060] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:01.368853 32719 raft_consensus.cc:697] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:01.398231 32700 raft_consensus.cc:697] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 9 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
W20260709 13:11:01.446821   302 log.cc:927] Time spent T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 13:11:01.412520 32577 raft_consensus.cc:493] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.438338 32617 raft_consensus.cc:740] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:01.451443 32615 raft_consensus.cc:697] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 7 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:01.463681 32719 consensus_queue.cc:237] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:01.464294 32760 leader_election.cc:290] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:01.439985 32757 raft_consensus.cc:515] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:01.470302 32762 raft_consensus.cc:515] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:01.471807 32762 leader_election.cc:290] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:01.466645 32747 consensus_queue.cc:237] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:01.370559 30027 raft_consensus.cc:1240] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:01.504870 30094 consensus_queue.cc:260] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:01.395562 30068 leader_election.cc:400] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Vote denied by peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469) with higher term. Message: Invalid argument: T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for earlier term 5. Current term is 6.
I20260709 13:11:01.425439 30100 raft_consensus.cc:1240] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 4. Current term is 5. Ops: []
W20260709 13:11:01.510329 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 114723us
I20260709 13:11:01.512648 30097 raft_consensus.cc:1240] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:01.368527 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:01.514668 30102 raft_consensus.cc:1240] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:11:01.513496 30100 raft_consensus.cc:1275] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:01.383119 30101 raft_consensus.cc:2393] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 4: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:01.517835 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:01.518886 30100 raft_consensus.cc:3060] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:01.519907 30101 raft_consensus.cc:1240] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:01.366951 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:01.522557 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:01.523659 30027 raft_consensus.cc:2393] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 9: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:11:01.526225 30027 raft_consensus.cc:1240] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:01.532151 30068 leader_election.cc:304] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:01.533885 28889 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:01.528103 29924 catalog_manager.cc:5697] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 reported cstate change: config changed from index 2 to 4, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:01.507946 30094 raft_consensus.cc:3060] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:01.540163 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:01.547526 30027 raft_consensus.cc:2468] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 4.
I20260709 13:11:01.537724 30068 leader_election.cc:304] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:11:01.550635 30140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:01.551827 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 46061.2us
W20260709 13:11:01.555225 30142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.413712 30702 leader_election.cc:304] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
W20260709 13:11:01.627446 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 67721.6us
W20260709 13:11:01.428870 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 255150us
I20260709 13:11:01.628412 29994 leader_election.cc:304] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:01.629220 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:01.631914 32678 raft_consensus.cc:2804] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:01.632517 32678 raft_consensus.cc:697] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:01.564800 32270 raft_consensus.cc:2749] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:01.457679 32577 raft_consensus.cc:515] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:01.642086 32755 raft_consensus.cc:2804] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:01.642786 32755 raft_consensus.cc:697] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:01.643210 32577 leader_election.cc:290] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:01.571062 32617 consensus_queue.cc:260] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:01.644241 32755 consensus_queue.cc:237] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:01.645391 32617 raft_consensus.cc:3060] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:01.648138 32504 raft_consensus.cc:493] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:01.572059 32615 consensus_queue.cc:237] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:01.649926 32678 consensus_queue.cc:237] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:01.573225 32631 consensus_queue.cc:1059] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:01.656167 32631 raft_consensus.cc:3055] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:01.656549 32631 raft_consensus.cc:740] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:01.579126 32589 leader_election.cc:290] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:01.464475 32701 raft_consensus.cc:515] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:01.659188 32579 consensus_queue.cc:1059] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:01.593695 32639 raft_consensus.cc:493] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.599028 30176 raft_consensus.cc:2410] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:11:01.466035 32700 consensus_queue.cc:237] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:01.603221 32706 raft_consensus.cc:2749] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:01.605290 32068 raft_consensus.cc:2749] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:01.611774 32746 raft_consensus.cc:2749] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:01.615064 32752 raft_consensus.cc:515] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:01.615653 32757 leader_election.cc:290] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:01.617112 30021 raft_consensus.cc:1240] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:01.622080   318 consensus_queue.cc:1048] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:11:01.624269 30700 leader_election.cc:304] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:01.568948 32595 raft_consensus.cc:493] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:01.648850 32504 raft_consensus.cc:515] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:01.627382 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 213628us
I20260709 13:11:01.667584 30142 leader_election.cc:304] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:01.745004 30728 raft_consensus.cc:1275] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 13:11:01.745638 30069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.745963 32639 raft_consensus.cc:515] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:01.661525 32718 raft_consensus.cc:3055] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:01.747466 32752 leader_election.cc:290] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:01.662999 32701 leader_election.cc:290] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:01.774377 30095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33990 (request call id 1912) took 1522 ms. Trace:
I20260709 13:11:01.776502 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:01.777293 30019 raft_consensus.cc:3060] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:01.778307 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
W20260709 13:11:01.779376 30142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 112015us
I20260709 13:11:01.782142 32731 raft_consensus.cc:2749] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:01.769148 30177 raft_consensus.cc:1275] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:01.771092 32678 consensus_queue.cc:1059] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:01.772784 32755 raft_consensus.cc:493] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.799059 32760 raft_consensus.cc:3055] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:01.799541 32760 raft_consensus.cc:740] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:01.798555 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:01.797499 30168 raft_consensus.cc:1275] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 13:11:01.799410 32755 raft_consensus.cc:515] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:01.816136 32595 raft_consensus.cc:515] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:01.819162 32504 leader_election.cc:290] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:01.820235 30028 raft_consensus.cc:2468] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 4.
I20260709 13:11:01.821019 30027 raft_consensus.cc:3060] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:01.821597 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:01.821807 32755 leader_election.cc:290] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:01.822220 30170 raft_consensus.cc:2468] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 4.
I20260709 13:11:01.764955 32718 raft_consensus.cc:740] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:01.734265 32631 consensus_queue.cc:260] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:01.836351 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:01.822613 32717 consensus_queue.cc:1048] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 13:11:01.840431 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:01.840903 30027 raft_consensus.cc:2468] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 7.
I20260709 13:11:01.847594 32685 raft_consensus.cc:2804] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:01.848032 32685 raft_consensus.cc:493] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
W20260709 13:11:01.850955 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 227124us
I20260709 13:11:01.852897 32639 leader_election.cc:290] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:01.853515 30703 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.54.66:43821 timed out after 1.502s (SENT) [suppressed 11 similar messages]
I20260709 13:11:01.855863 32666 raft_consensus.cc:493] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.856463 32666 raft_consensus.cc:515] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:01.857822 32678 raft_consensus.cc:493] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.858464 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:01.866005 30169 raft_consensus.cc:2468] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 6.
W20260709 13:11:01.872938 32750 log.cc:927] Time spent T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:11:01.873564 30066 leader_election.cc:304] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:01.873715 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
W20260709 13:11:01.874379 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 45015.5us
I20260709 13:11:01.875332 30172 raft_consensus.cc:1275] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:01.883926 32595 leader_election.cc:290] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:01.886173 32746 raft_consensus.cc:2804] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:01.886641 32746 raft_consensus.cc:493] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:01.886979 32746 raft_consensus.cc:3060] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:01.888546 32719 consensus_queue.cc:1048] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 13:11:01.890365 32733 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 13:11:01.890672 32718 consensus_queue.cc:260] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:01.875344 30066 leader_election.cc:304] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
W20260709 13:11:01.909135 30066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.910614   318 raft_consensus.cc:2804] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:01.911253   318 raft_consensus.cc:697] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 4 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:01.912189   318 consensus_queue.cc:237] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:01.874629 30730 raft_consensus.cc:2393] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 4: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:11:01.850750 32685 raft_consensus.cc:3060] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:01.858476 32678 raft_consensus.cc:515] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:01.904989 29993 leader_election.cc:304] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:01.922772 32504 raft_consensus.cc:2804] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:01.923269 32504 raft_consensus.cc:493] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:01.923579 32504 raft_consensus.cc:3060] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:01.922662 29993 leader_election.cc:304] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:01.917939 32609 raft_consensus.cc:493] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
W20260709 13:11:01.913741 32658 consensus_meta.cc:287] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124: Time spent flushing consensus metadata: real 0.570s	user 0.013s	sys 0.003s
I20260709 13:11:01.932647 32609 raft_consensus.cc:515] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:01.933118   322 log.cc:927] Time spent T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 13:11:01.938418 32678 leader_election.cc:290] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:01.938732 32758 log.cc:927] Time spent T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:11:01.939262 30100 raft_consensus.cc:2468] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 5.
W20260709 13:11:01.939632 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 254087us
I20260709 13:11:01.941351 30098 raft_consensus.cc:2468] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 6.
I20260709 13:11:01.912909 32753 raft_consensus.cc:493] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:01.947229 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:11:01.964042 30143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:01.971153 32595 raft_consensus.cc:493] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:01.970434 32658 raft_consensus.cc:2749] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:01.964769 32753 raft_consensus.cc:515] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:04.164263 32753 leader_election.cc:290] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:02.041857 30066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:03.027756 29957 debug-util.cc:398] Leaking SignalData structure 0x7b0800034d60 after lost signal to thread 28892
W20260709 13:11:03.751849 32746 consensus_meta.cc:287] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719: Time spent flushing consensus metadata: real 1.864s	user 0.004s	sys 0.025s
I20260709 13:11:04.165258 32746 raft_consensus.cc:515] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:04.166543 30066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.167186 32746 leader_election.cc:290] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:11:03.792027   327 log.cc:927] Time spent T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 1.956s	user 0.008s	sys 0.017s
W20260709 13:11:03.816946 30027 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52098 (request call id 494) took 2190 ms (client timeout 1773 ms). Trace:
I20260709 13:11:03.561426 32690 raft_consensus.cc:493] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:01.560209 29924 catalog_manager.cc:5697] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 4 to 7, leader changed from 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 7 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:11:03.931511 30168 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.012s	user 0.015s	sys 0.036s
W20260709 13:11:03.841619 32685 consensus_meta.cc:287] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent flushing consensus metadata: real 1.904s	user 0.004s	sys 0.017s
I20260709 13:11:04.169930 32617 raft_consensus.cc:493] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:01.774870 30095 rpcz_store.cc:276] 0709 13:11:00.251374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.263786 (+ 12412us) service_pool.cc:224] Handling call
0709 13:11:01.378493 (+1114707us) spinlock_profiling.cc:243] Waited 3.03 ms on lock 0x7b5800073598. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eef95b71 00007f99eef95a22 00007f99f7eaec09 00007f99f7008ee0 00007f99f70d20ab 00007f99f70d2131 00007f99f7093fc0 00007f99f707e929 00007f99f707e3d2 00007f99f05f5bd4
0709 13:11:01.378663 (+   170us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:01.378849 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:01.509020 (+130171us) log.cc:844] Serialized 14 byte log entry
0709 13:11:01.558818 (+ 49798us) log.cc:844] Serialized 14 byte log entry
0709 13:11:01.731816 (+172998us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:01.731898 (+    82us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:01.750456 (+ 18558us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:01.773988 (+ 23532us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:01.774179 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":110767,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":77,"raft.queue_time_us":97646,"raft.run_cpu_time_us":312,"raft.run_wall_time_us":313,"spinlock_wait_cycles":6968576,"thread_start_us":348514,"threads_started":4,"wal-append.queue_time_us":37907}
I20260709 13:11:03.967012 32609 leader_election.cc:290] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:03.981305 30103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33992 (request call id 1642) took 2888 ms. Trace:
I20260709 13:11:04.171903 30103 rpcz_store.cc:276] 0709 13:11:01.092372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.094357 (+  1985us) service_pool.cc:224] Handling call
0709 13:11:01.096374 (+  2017us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:01.321997 (+225623us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:11:01.522345 (+200348us) log.cc:844] Serialized 14 byte log entry
0709 13:11:01.588978 (+ 66633us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:01.589060 (+    82us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:01.589131 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:03.980928 (+2391797us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b5400266954. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:11:03.980972 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:03.981126 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":104172,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":14400,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":103,"spinlock_wait_cycles":518422272,"thread_start_us":265914,"threads_started":2,"wal-append.queue_time_us":64697,"wal-append.run_cpu_time_us":20784,"wal-append.run_wall_time_us":2089664}
I20260709 13:11:04.173882 32733 consensus_queue.cc:1059] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:03.993614 32763 raft_consensus.cc:493] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:04.175127 32733 consensus_queue.cc:1243] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer b2cea0098c1040f69755ea4d3dab7fc4 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:11:04.174913 32763 raft_consensus.cc:515] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:04.175643 32733 raft_consensus.cc:3055] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:04.177057 32763 leader_election.cc:290] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:03.995198 32412 raft_consensus.cc:493] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:04.177817 32412 raft_consensus.cc:515] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:04.179955 32412 leader_election.cc:290] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:04.002174 32595 raft_consensus.cc:515] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:04.185570 30023 raft_consensus.cc:1275] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:11:04.005687 30143 connection.cc:256] RPC call timeout handler was delayed by -1.7125027069999987s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25730000000000003s for a response
W20260709 13:11:04.186218 30143 connection.cc:256] RPC call timeout handler was delayed by -1.6925895189999665s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1968s for a response
I20260709 13:11:04.006147 32577 raft_consensus.cc:493] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.186684 32719 raft_consensus.cc:493] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:04.186934 32501 raft_consensus.cc:493] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.025043   318 raft_consensus.cc:493] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:04.187292 32690 raft_consensus.cc:515] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:04.187531 32501 raft_consensus.cc:515] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:04.188302 29991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.188050   318 raft_consensus.cc:515] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:04.189441 32690 leader_election.cc:290] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:04.029458 30702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.032128 32246 raft_consensus.cc:493] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:01.984128 32760 consensus_queue.cc:260] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:04.045262 32504 consensus_meta.cc:287] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4: Time spent flushing consensus metadata: real 2.121s	user 0.016s	sys 0.014s
I20260709 13:11:04.047746 32736 raft_consensus.cc:493] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:02.823158 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:04.065670 30733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51014 (request call id 829) took 2088 ms. Trace:
W20260709 13:11:04.066243 30068 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.508s	user 0.013s	sys 0.021s
I20260709 13:11:04.081655   341 raft_consensus.cc:493] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:04.084631 32666 leader_election.cc:290] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:04.088757 32699 raft_consensus.cc:493] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:04.091308   342 raft_consensus.cc:493] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.092860 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:04.094135 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:04.095415 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:04.096452 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:04.099247 30174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43838 (request call id 1965) took 2171 ms. Trace:
I20260709 13:11:04.106302 32678 raft_consensus.cc:493] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.112776 32566 raft_consensus.cc:493] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.119020 32631 raft_consensus.cc:3060] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:04.123234 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 2.20047e+06us
I20260709 13:11:04.124740   321 raft_consensus.cc:2804] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:11:04.127107 30098 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48558 (request call id 448) took 2917 ms (client timeout 1592 ms). Trace:
I20260709 13:11:04.130901 32739 raft_consensus.cc:493] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.134528 32766 raft_consensus.cc:493] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:04.135592   340 raft_consensus.cc:493] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:04.140892 30094 raft_consensus.cc:1240] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:11:04.141831   345 raft_consensus.cc:493] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:04.143360 32762 raft_consensus.cc:493] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
W20260709 13:11:04.146929 30176 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54540 (request call id 561) took 3413 ms (client timeout 1501 ms). Trace:
I20260709 13:11:04.159966   347 raft_consensus.cc:493] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.161185 32658 raft_consensus.cc:493] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
W20260709 13:11:04.169044 30027 rpcz_store.cc:269] 0709 13:11:01.626398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.628840 (+  2442us) service_pool.cc:224] Handling call
0709 13:11:03.816671 (+2187831us) spinlock_profiling.cc:243] Waited 182 ms on lock 0x7b5400107f54. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:11:03.816816 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":419310464}
W20260709 13:11:03.987754 30019 consensus_meta.cc:287] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent flushing consensus metadata: real 2.210s	user 0.022s	sys 0.006s
I20260709 13:11:04.183183 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:04.183300 32668 raft_consensus.cc:493] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:04.183761 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:04.184190 30021 raft_consensus.cc:1240] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 4. Current term is 5. Ops: []
W20260709 13:11:04.189881 30168 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.270s	user 0.016s	sys 0.036s
I20260709 13:11:04.190164   318 leader_election.cc:290] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:04.026633 30728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51014 (request call id 822) took 2875 ms. Trace:
W20260709 13:11:04.186712 30143 connection.cc:256] RPC call timeout handler was delayed by -1.3839717880000535s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1938s for a response
I20260709 13:11:04.190894 32592 raft_consensus.cc:493] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:04.181114 29957 debug-util.cc:398] Leaking SignalData structure 0x7b0800034580 after lost signal to thread 29960
I20260709 13:11:04.186599 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:11:04.195776 30142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.195012 30733 rpcz_store.cc:276] 0709 13:11:01.976829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.978826 (+  1997us) service_pool.cc:224] Handling call
0709 13:11:04.065072 (+2086246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:04.065301 (+   229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:04.065326 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:04.065365 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:04.065417 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.065466 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:04.065596 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:04.175981 32733 raft_consensus.cc:740] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:04.170077 32685 raft_consensus.cc:515] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:04.199468 32504 raft_consensus.cc:515] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:04.201745 32726 raft_consensus.cc:493] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:04.168365 32746 raft_consensus.cc:493] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:04.191282 32577 raft_consensus.cc:515] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:04.202018 32670 consensus_queue.cc:1059] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.377s
I20260709 13:11:04.574048 32739 raft_consensus.cc:515] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:04.200523 32246 raft_consensus.cc:515] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:04.577101 32739 leader_election.cc:290] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:04.185600 32573 raft_consensus.cc:493] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.191015 30729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51004 (request call id 622) took 2847 ms. Trace:
W20260709 13:11:04.580842 30143 connection.cc:256] RPC call timeout handler was delayed by -1.2271099680000361s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2073s for a response
W20260709 13:11:04.502002 30068 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.944s	user 0.013s	sys 0.022s
I20260709 13:11:04.581650 30019 raft_consensus.cc:2468] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 6.
W20260709 13:11:04.558939 30140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:04.457090 30069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.582259 30168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43838 (request call id 1961) took 2666 ms. Trace:
I20260709 13:11:04.348987 30025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 1589) took 2533 ms. Trace:
W20260709 13:11:04.579594 30098 rpcz_store.cc:269] 0709 13:11:01.210027 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.310716 (+100689us) service_pool.cc:224] Handling call
0709 13:11:04.126828 (+2816112us) spinlock_profiling.cc:243] Waited 306 ms on lock 0x7b5400021cd4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:11:04.127003 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":703732096}
I20260709 13:11:04.583585 30102 raft_consensus.cc:2393] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 5: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
W20260709 13:11:04.586225 29957 debug-util.cc:398] Leaking SignalData structure 0x7b080033e580 after lost signal to thread 30052
I20260709 13:11:04.581144 30101 raft_consensus.cc:2468] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 8.
I20260709 13:11:04.189612 32501 leader_election.cc:290] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:04.195003 32589 raft_consensus.cc:493] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:04.588644 30019 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54206 (request call id 1591) took 2838 ms (client timeout 1877 ms). Trace:
W20260709 13:11:04.583823 29994 connection.cc:256] RPC call timeout handler was delayed by -1.0488284420000582s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17800000000000002s for a response
W20260709 13:11:04.589694 29957 debug-util.cc:398] Leaking SignalData structure 0x7b0800193d40 after lost signal to thread 30053
I20260709 13:11:04.257423 32595 leader_election.cc:290] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451)
I20260709 13:11:04.594220 32697 raft_consensus.cc:493] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.630301 30022 raft_consensus.cc:2393] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 5: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:11:04.594383   348 raft_consensus.cc:493] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:04.594820 32717 raft_consensus.cc:493] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:04.348529 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:04.577553 30174 rpcz_store.cc:276] 0709 13:11:01.927551 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.953183 (+ 25632us) service_pool.cc:224] Handling call
0709 13:11:01.970472 (+ 17289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:04.084358 (+2113886us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:04.084386 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:04.084889 (+   503us) log.cc:844] Serialized 26 byte log entry
0709 13:11:04.098829 (+ 13940us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:04.098864 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.098920 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:04.098959 (+    39us) raft_consensus.cc:1685] finished
0709 13:11:04.098971 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:04.099078 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":32447,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":154,"thread_start_us":46261,"threads_started":2,"wal-append.queue_time_us":11528}
W20260709 13:11:04.581915 30176 rpcz_store.cc:269] 0709 13:11:00.733148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:00.735063 (+  1915us) service_pool.cc:224] Handling call
0709 13:11:04.146678 (+3411615us) spinlock_profiling.cc:243] Waited 859 ms on lock 0x7b5400286254. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:11:04.146838 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1976256768}
I20260709 13:11:04.595492 30737 raft_consensus.cc:1275] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:04.589165 30025 rpcz_store.cc:276] 0709 13:11:01.667157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.667296 (+   139us) service_pool.cc:224] Handling call
0709 13:11:01.667635 (+   339us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:01.820707 (+153072us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:01.820733 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:01.820771 (+    38us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:01.820803 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.197657 (+2376854us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b54000758d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:11:04.197689 (+    32us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:04.200852 (+  3163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":351516416}
I20260709 13:11:04.595695 30020 raft_consensus.cc:2468] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 6.
W20260709 13:11:04.644940 29957 debug-util.cc:398] Leaking SignalData structure 0x7b0800391600 after lost signal to thread 30127
W20260709 13:11:04.646034 29957 debug-util.cc:398] Leaking SignalData structure 0x7b0800261560 after lost signal to thread 30128
W20260709 13:11:04.645624 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 409798us
W20260709 13:11:04.647188 29957 debug-util.cc:398] Leaking SignalData structure 0x7b080038c640 after lost signal to thread 30201
I20260709 13:11:04.573621 32670 consensus_queue.cc:1243] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Peer b2cea0098c1040f69755ea4d3dab7fc4 log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:11:04.627921 32733 consensus_queue.cc:260] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:04.558357 32667 raft_consensus.cc:493] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.619626 32678 raft_consensus.cc:515] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:04.631932 32573 raft_consensus.cc:515] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:04.595049 32598 raft_consensus.cc:493] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.633447 32697 raft_consensus.cc:515] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:04.633985 32504 leader_election.cc:290] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:04.634122 29924 catalog_manager.cc:5697] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 1 to 5, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68). New cstate: current_term: 5 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
W20260709 13:11:04.635222 30022 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54206 (request call id 1593) took 2718 ms (client timeout 2125 ms). Trace:
I20260709 13:11:04.597183 32746 raft_consensus.cc:515] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:04.195833 32617 raft_consensus.cc:515] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:04.632097 32489 raft_consensus.cc:493] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:04.637645   346 raft_consensus.cc:493] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.638068   340 raft_consensus.cc:515] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:04.640321 32718 raft_consensus.cc:3060] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:04.684676 32678 leader_election.cc:290] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:04.685969 32760 raft_consensus.cc:3060] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:04.686388 32697 leader_election.cc:290] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:04.687734 32577 leader_election.cc:290] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:04.688248 32577 raft_consensus.cc:493] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:04.688737 32577 raft_consensus.cc:515] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:04.672181 32598 raft_consensus.cc:515] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:04.691066 32746 leader_election.cc:290] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:11:04.691277 29991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.691726 32598 leader_election.cc:290] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:04.693967 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:04.694447 30102 raft_consensus.cc:1275] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:11:04.694684 30094 raft_consensus.cc:2393] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 5: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
W20260709 13:11:04.695199 30702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.694885   346 raft_consensus.cc:515] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:04.696923   346 leader_election.cc:290] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:04.697372   346 raft_consensus.cc:493] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.698480 32733 raft_consensus.cc:3060] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:04.699280   340 leader_election.cc:290] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:04.700325 30732 raft_consensus.cc:1275] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 13:11:04.700666 30732 pending_rounds.cc:85] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a: Aborting all ops after (but not including) 6
I20260709 13:11:04.700863 30732 pending_rounds.cc:107] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 13:11:04.701114 30732 raft_consensus.cc:2889] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:04.671283   348 raft_consensus.cc:515] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:04.702461 30732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51014 (request call id 827) took 2845 ms. Trace:
I20260709 13:11:04.703084   348 leader_election.cc:290] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:04.700346   340 raft_consensus.cc:493] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:04.653187 32566 raft_consensus.cc:515] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:04.703835   340 raft_consensus.cc:515] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:04.705163 32566 leader_election.cc:290] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:04.705729   340 leader_election.cc:290] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:04.650820   347 raft_consensus.cc:515] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:04.706486 32685 leader_election.cc:290] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:04.702782 30732 rpcz_store.cc:276] 0709 13:11:01.857009 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.876222 (+ 19213us) service_pool.cc:224] Handling call
0709 13:11:01.876613 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:04.701682 (+2825069us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.702248 (+   566us) spinlock_profiling.cc:243] Waited 2.82 s on lock 0x7b54004b23d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:11:04.702411 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6492940672}
I20260709 13:11:04.707700   347 leader_election.cc:290] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:04.656000 32690 consensus_queue.cc:1059] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.052s
I20260709 13:11:04.708880 32690 raft_consensus.cc:493] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:04.709281 32666 raft_consensus.cc:493] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:04.647498 29957 debug-util.cc:398] Leaking SignalData structure 0x7b080005d360 after lost signal to thread 30202
W20260709 13:11:04.647804 30066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.647624 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:11:04.713084 29957 debug-util.cc:398] Leaking SignalData structure 0x7b08001c03a0 after lost signal to thread 30761
W20260709 13:11:04.642647 30019 rpcz_store.cc:269] 0709 13:11:01.750683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.776035 (+ 25352us) service_pool.cc:224] Handling call
0709 13:11:04.588581 (+2812546us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:04.348388 32600 raft_consensus.cc:493] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.655591 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:04.348585 32691 raft_consensus.cc:493] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.558708 32579 raft_consensus.cc:493] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:04.201671 32736 raft_consensus.cc:515] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:04.657116 30022 rpcz_store.cc:269] 0709 13:11:01.917083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.917260 (+   177us) service_pool.cc:224] Handling call
0709 13:11:04.635041 (+2717781us) spinlock_profiling.cc:243] Waited 834 ms on lock 0x7b54004164d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:11:04.635157 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1917320448}
I20260709 13:11:04.348733 32665 consensus_queue.cc:1048] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.446s
W20260709 13:11:04.635819 29926 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51828 (request call id 308) took 16611 ms (client timeout 15000 ms). Trace:
I20260709 13:11:04.589020 30168 rpcz_store.cc:276] 0709 13:11:01.916251 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.917700 (+  1449us) service_pool.cc:224] Handling call
0709 13:11:01.918058 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:01.918448 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:01.918475 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:01.919067 (+   592us) log.cc:844] Serialized 26 byte log entry
0709 13:11:04.578807 (+2659740us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:04.578844 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.578904 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:04.578937 (+    33us) raft_consensus.cc:1685] finished
0709 13:11:04.578947 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:04.582197 (+  3250us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1264,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":103,"thread_start_us":2659333,"threads_started":1,"wal-append.queue_time_us":113854,"wal-append.run_cpu_time_us":2474,"wal-append.run_wall_time_us":1002529}
I20260709 13:11:04.632400 32699 raft_consensus.cc:515] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:04.586453 30728 rpcz_store.cc:276] 0709 13:11:01.151127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.152255 (+  1128us) service_pool.cc:224] Handling call
0709 13:11:01.192138 (+ 39883us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:01.763996 (+571858us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:04.026238 (+2262242us) spinlock_profiling.cc:243] Waited 549 ms on lock 0x7b54004849d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:11:04.026538 (+   300us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1262334336}
I20260709 13:11:04.672890 29924 catalog_manager.cc:5697] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } }
W20260709 13:11:04.677862 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 3.1402e+06us
I20260709 13:11:04.678313 32717 raft_consensus.cc:515] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:04.678881 32617 leader_election.cc:290] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:04.679731   349 raft_consensus.cc:493] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.679342 32667 raft_consensus.cc:515] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:04.257632 32719 raft_consensus.cc:515] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:04.643592 32589 raft_consensus.cc:515] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:04.682660 32573 leader_election.cc:290] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:04.580011   321 raft_consensus.cc:493] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:04.648808 32726 raft_consensus.cc:515] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:04.649137 32246 leader_election.cc:290] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:11:04.708482 30703 connection.cc:256] RPC call timeout handler was delayed by -2.6825791569999637s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.194s for a response
I20260709 13:11:04.717556 30700 leader_election.cc:304] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:04.728634 30733 raft_consensus.cc:2468] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 7.
I20260709 13:11:04.708389 32609 raft_consensus.cc:493] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.626243 32762 raft_consensus.cc:515] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:04.718467   346 raft_consensus.cc:515] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:04.737569 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 77129us
I20260709 13:11:04.330420   341 raft_consensus.cc:515] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:04.648504 32658 raft_consensus.cc:515] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:04.631201 32668 raft_consensus.cc:515] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:04.589509 32766 raft_consensus.cc:515] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:04.597479   342 raft_consensus.cc:515] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:04.729931 32685 raft_consensus.cc:3055] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:04.631263   345 raft_consensus.cc:515] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:04.709331 32690 raft_consensus.cc:515] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:04.715126 29957 debug-util.cc:398] Leaking SignalData structure 0x7b080024c880 after lost signal to thread 30762
W20260709 13:11:04.767825 29957 debug-util.cc:398] Leaking SignalData structure 0x7b08003bd5c0 after lost signal to thread 32588
W20260709 13:11:04.768563 29957 debug-util.cc:398] Leaking SignalData structure 0x7b0800315860 after lost signal to thread 32729
I20260709 13:11:04.761653   351 raft_consensus.cc:493] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:04.769330 29957 debug-util.cc:398] Leaking SignalData structure 0x7b08003f7200 after lost signal to thread 310
W20260709 13:11:04.769624 29957 debug-util.cc:398] Leaking SignalData structure 0x7b08003e6cc0 after lost signal to thread 312
I20260709 13:11:04.769232   351 raft_consensus.cc:515] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:04.770145 32762 leader_election.cc:290] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:04.751338 32609 raft_consensus.cc:515] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:04.736410   347 raft_consensus.cc:493] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:04.620087 32592 raft_consensus.cc:515] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:04.771967   347 raft_consensus.cc:515] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:04.772634   348 raft_consensus.cc:493] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.773093   348 raft_consensus.cc:515] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:04.750555 30028 raft_consensus.cc:2410] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for term 6 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 13:11:04.774052   347 leader_election.cc:290] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:04.774377 32595 raft_consensus.cc:493] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.742750 32579 raft_consensus.cc:515] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:04.775056   348 leader_election.cc:290] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:04.775296   340 raft_consensus.cc:493] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.775589   348 raft_consensus.cc:493] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:04.775944   340 raft_consensus.cc:515] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:04.776423 32579 leader_election.cc:290] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:04.777361 32668 leader_election.cc:290] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:04.768639   345 leader_election.cc:290] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:04.742734 32666 raft_consensus.cc:515] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:04.779681 32766 leader_election.cc:290] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:04.751855 32760 raft_consensus.cc:2804] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:04.780417 32760 raft_consensus.cc:493] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:04.775197   347 raft_consensus.cc:493] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:04.781421   347 raft_consensus.cc:515] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:04.745158   321 raft_consensus.cc:3060] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:04.783334 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:04.777917 32668 raft_consensus.cc:493] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:04.743749 32600 raft_consensus.cc:515] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:04.784384   348 raft_consensus.cc:515] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:04.761511 30027 raft_consensus.cc:2468] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 8.
I20260709 13:11:04.763939 32719 leader_election.cc:290] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:04.785460 32668 raft_consensus.cc:515] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:04.786000 32600 leader_election.cc:290] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:04.752668 29924 catalog_manager.cc:5697] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 4 to 6, leader changed from c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 6 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } }
I20260709 13:11:04.765642   342 leader_election.cc:290] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:04.787645   348 leader_election.cc:290] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:04.787452 29924 catalog_manager.cc:5697] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
W20260709 13:11:04.733098 29926 rpcz_store.cc:269] 0709 13:10:48.022312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:48.022473 (+   161us) service_pool.cc:224] Handling call
0709 13:11:04.633553 (+16611080us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:10:56.823298 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:10:56.920232 (+ 96934us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:10:56.920270 (+    38us) write_op.cc:435] Acquired schema lock
0709 13:10:56.920290 (+    20us) tablet.cc:662] Decoding operations
0709 13:10:56.925321 (+  5031us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:10:56.925381 (+    60us) write_op.cc:641] Partition lock acquired for write op
0709 13:10:56.925408 (+    27us) tablet.cc:685] Acquiring locks for 13 operations
0709 13:10:57.256562 (+331154us) tablet.cc:701] Row locks acquired
0709 13:10:57.256579 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:10:57.256718 (+   139us) write_op.cc:270] Start()
0709 13:10:57.256829 (+   111us) write_op.cc:276] Timestamp: P: 1783602657256676 usec, L: 0
0709 13:10:57.256844 (+    15us) op_driver.cc:348] REPLICATION: starting
0709 13:10:57.270138 (+ 13294us) log.cc:844] Serialized 5191 byte log entry
0709 13:10:57.683197 (+413059us) op_driver.cc:464] REPLICATION: finished
0709 13:10:58.175499 (+492302us) write_op.cc:301] APPLY: starting
0709 13:10:58.185865 (+ 10366us) tablet.cc:1367] starting BulkCheckPresence
0709 13:10:58.243083 (+ 57218us) tablet.cc:1370] finished BulkCheckPresence
0709 13:10:58.299562 (+ 56479us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:10:58.477007 (+177445us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:10:58.477358 (+   351us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=13
0709 13:10:58.477410 (+    52us) write_op.cc:312] APPLY: finished
0709 13:10:58.477732 (+   322us) log.cc:844] Serialized 95 byte log entry
0709 13:10:58.519540 (+ 41808us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:58.657067 (+137527us) write_op.cc:454] Released schema lock
0709 13:10:58.667394 (+ 10327us) write_op.cc:341] FINISH: Updating metrics
0709 13:10:58.707949 (+ 40555us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:10:58.743652 (+ 35703us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":114676,"reported_tablets":36,"child_traces":[["op",{"apply.queue_time_us":457726,"apply.run_cpu_time_us":5272,"apply.run_wall_time_us":536453,"num_ops":13,"prepare.queue_time_us":394213,"prepare.run_cpu_time_us":18630,"prepare.run_wall_time_us":518959,"raft.queue_time_us":237805,"raft.run_cpu_time_us":139226,"raft.run_wall_time_us":307084,"replication_time_us":426174,"thread_start_us":726781,"threads_started":4,"wal-append.queue_time_us":172552,"wal-append.run_cpu_time_us":20376,"wal-append.run_wall_time_us":2248206}]]}
I20260709 13:11:04.766999 32685 raft_consensus.cc:740] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:04.771260   351 leader_election.cc:290] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:04.780838 32760 raft_consensus.cc:3060] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:04.792515 32589 leader_election.cc:290] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:04.792289 32685 consensus_queue.cc:260] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:04.774984 32595 raft_consensus.cc:515] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:04.793301 32685 raft_consensus.cc:3060] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:04.768775 32690 leader_election.cc:290] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:04.773947 32592 leader_election.cc:290] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:04.767104 32658 leader_election.cc:290] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:04.787554 32736 leader_election.cc:290] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:04.780685 32666 leader_election.cc:290] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:04.777964   340 leader_election.cc:290] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:04.799118 32699 leader_election.cc:290] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:04.798918 32760 raft_consensus.cc:515] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:04.800721 32717 leader_election.cc:290] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:04.801014 32760 leader_election.cc:290] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:04.752156 32631 raft_consensus.cc:493] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:04.802227 32631 raft_consensus.cc:515] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:04.802606 32667 leader_election.cc:290] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:04.803591 32577 leader_election.cc:290] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:04.804082 32631 leader_election.cc:290] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:04.805207 30098 raft_consensus.cc:1275] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:04.805912 32595 leader_election.cc:290] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:04.807026   347 leader_election.cc:290] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:04.735882 32753 raft_consensus.cc:493] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.762034 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:04.807957 32753 raft_consensus.cc:515] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:04.807960 30022 raft_consensus.cc:2376] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 7. Re-sending same reply.
I20260709 13:11:04.810384 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:04.811106 30021 raft_consensus.cc:1240] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 13:11:04.811224 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:04.808619 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:04.812242 30027 raft_consensus.cc:2410] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260709 13:11:04.813081 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:11:04.813620 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 52638.5us
I20260709 13:11:04.813768 30022 raft_consensus.cc:2468] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 7.
I20260709 13:11:04.734856 32691 raft_consensus.cc:515] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:04.815306 30027 raft_consensus.cc:1275] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:04.815929 32691 leader_election.cc:290] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:04.816428 30024 raft_consensus.cc:1275] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:04.816805 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:04.817297 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:04.817354 30026 raft_consensus.cc:2468] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 8.
I20260709 13:11:04.817862 30700 leader_election.cc:304] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:04.818084 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:04.818559 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:04.818706 30700 leader_election.cc:304] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:04.819137 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:04.816336 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:04.819869 30025 raft_consensus.cc:2393] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 5: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:11:04.732613 32489 raft_consensus.cc:515] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:04.820410 30024 raft_consensus.cc:2468] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 3.
I20260709 13:11:04.819814 30023 raft_consensus.cc:2393] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 7: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:04.820696 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:04.821487 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:04.825366 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:04.834571 30737 raft_consensus.cc:2468] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 6.
I20260709 13:11:04.829349 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:04.824441 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:04.784126 30733 raft_consensus.cc:2393] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 8: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:11:04.824996 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
W20260709 13:11:04.744258 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 148508us
I20260709 13:11:04.821704 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:04.837462 30025 raft_consensus.cc:2393] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 5: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:11:04.791049   341 leader_election.cc:290] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:11:04.791353 30066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.759897   349 raft_consensus.cc:515] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:04.761608 30701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:04.824602 30020 raft_consensus.cc:1275] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
W20260709 13:11:04.752038 30703 connection.cc:256] RPC call timeout handler was delayed by -2.6195791569999756s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20099999999999998s for a response
I20260709 13:11:04.807371   346 leader_election.cc:290] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:04.910753 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:04.588339 30729 rpcz_store.cc:276] 0709 13:11:01.343706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:01.344135 (+   429us) service_pool.cc:224] Handling call
0709 13:11:01.344536 (+   401us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:01.344927 (+   391us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:01.344964 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:01.345475 (+   511us) log.cc:844] Serialized 26 byte log entry
0709 13:11:01.773464 (+427989us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:01.773590 (+   126us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:01.773742 (+   152us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:03.791311 (+2017569us) spinlock_profiling.cc:243] Waited 32.5 ms on lock 0x7b4400022b4c. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eeef3c85 00007f99eeef46a2 00007f99f1c661db 00007f99f1c61aaf 00007f99f1c5586e 00007f99f1c54bb6 00007f99f1c547d8 00007f99f1c5e221 00007f99f1c5e1d9 00007f99f1c5e169
0709 13:11:04.190621 (+399310us) raft_consensus.cc:1685] finished
0709 13:11:04.190646 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:04.190867 (+   221us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":9566,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":6645,"spinlock_wait_cycles":74813696,"thread_start_us":394903,"threads_started":1,"wal-append.queue_time_us":490550}
I20260709 13:11:04.911113 30176 raft_consensus.cc:1275] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:04.820364 32665 raft_consensus.cc:2804] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:04.911602 30174 raft_consensus.cc:2468] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 7.
I20260709 13:11:04.835276 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:04.912513 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:04.912760 30023 raft_consensus.cc:2393] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 7: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:11:04.913337 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:04.913698 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:04.913960 30176 raft_consensus.cc:2468] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 4.
I20260709 13:11:04.914280 30169 raft_consensus.cc:2468] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 6.
I20260709 13:11:04.914897 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:04.915246 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:04.915519 30175 raft_consensus.cc:2468] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 6.
I20260709 13:11:04.915663 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:04.915872 30173 raft_consensus.cc:2468] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 4.
I20260709 13:11:04.916286 30174 raft_consensus.cc:3060] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:04.916811 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:04.917387 30169 raft_consensus.cc:2468] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 3.
I20260709 13:11:04.912985 30700 leader_election.cc:304] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:04.918064 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:04.918357 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:04.918920 30732 raft_consensus.cc:2468] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 5.
I20260709 13:11:04.919121 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:04.919727 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:04.920223   341 raft_consensus.cc:2804] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:04.920660   341 raft_consensus.cc:493] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.921044   341 raft_consensus.cc:3060] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:04.921146 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:04.835666 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:04.837687 30019 raft_consensus.cc:2468] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 8.
I20260709 13:11:04.856297 30168 raft_consensus.cc:1275] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:11:04.922066 30176 raft_consensus.cc:2468] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 8.
W20260709 13:11:04.922554 30703 connection.cc:256] RPC call timeout handler was delayed by -2.5547791569999845s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2082s for a response
I20260709 13:11:04.838618 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:11:04.924304 30703 connection.cc:256] RPC call timeout handler was delayed by -2.0472109360000559s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22340000000000002s for a response
W20260709 13:11:04.924649 30703 connection.cc:256] RPC call timeout handler was delayed by -1.8401791569999659s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2876s for a response
W20260709 13:11:04.924930 30703 connection.cc:256] RPC call timeout handler was delayed by -1.5801484559999608s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1592s for a response
I20260709 13:11:04.858538 32753 leader_election.cc:290] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:11:04.922605 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 139101us
I20260709 13:11:04.923017 30700 leader_election.cc:304] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:04.822068 32489 leader_election.cc:290] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:11:04.925812 30143 leader_election.cc:336] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Timed out: RequestConsensusVote RPC to 127.28.54.66:43821 timed out after 1.681s (SENT)
I20260709 13:11:04.840088 32609 leader_election.cc:290] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:04.833037 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:11:04.925246 30703 connection.cc:256] RPC call timeout handler was delayed by -1.5228115439999783s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22480000000000003s for a response
W20260709 13:11:04.927049 30703 connection.cc:256] RPC call timeout handler was delayed by -1.4172484560000385s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1773s for a response
I20260709 13:11:04.814069 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:11:04.927358 30703 connection.cc:256] RPC call timeout handler was delayed by -1.1031484559999853s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2122s for a response
I20260709 13:11:04.927752 30028 raft_consensus.cc:2468] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 7.
I20260709 13:11:04.929347 30700 leader_election.cc:304] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:04.926791 32609 raft_consensus.cc:2804] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:04.930133 32666 raft_consensus.cc:2804] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:04.923578 30021 raft_consensus.cc:3060] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:04.910617 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:04.838229 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:04.926847 30023 raft_consensus.cc:1275] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:04.930835 32666 raft_consensus.cc:493] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:04.931473 32666 raft_consensus.cc:3060] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:04.913307 30020 raft_consensus.cc:2410] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for term 7 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 13:11:04.926229 30143 leader_election.cc:304] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:11:04.930848 30703 leader_election.cc:336] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Timed out: RequestConsensusVote RPC to 127.28.54.66:43821 timed out after 1.592s (SENT)
I20260709 13:11:04.934417 32753 raft_consensus.cc:2749] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:04.930513 32609 raft_consensus.cc:697] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:04.936327 32760 raft_consensus.cc:493] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:04.856240   321 raft_consensus.cc:515] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:04.921527 32668 leader_election.cc:290] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:04.936949 32760 raft_consensus.cc:515] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:04.937387 32609 consensus_queue.cc:237] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:04.826105 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
W20260709 13:11:04.940321 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 119692us
I20260709 13:11:04.841601 29924 catalog_manager.cc:5697] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 3 to 8, leader changed from 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 8 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:04.944105   352 raft_consensus.cc:493] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:04.944610 29993 connection.cc:256] RPC call timeout handler was delayed by -1.7323542610000686s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17800000000000002s for a response
W20260709 13:11:04.945109 30143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.002749 30021 raft_consensus.cc:2468] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 7.
I20260709 13:11:04.939203   321 leader_election.cc:290] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:04.946359 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:05.005263 29924 catalog_manager.cc:5697] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 4 to 6, leader changed from c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 6 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } }
I20260709 13:11:05.006654 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:04.911926 32665 raft_consensus.cc:493] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:05.006783 29924 catalog_manager.cc:5697] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 3 to 7, leader changed from 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 7 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:04.851902 32755 raft_consensus.cc:493] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.007957 32755 raft_consensus.cc:515] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:05.008512 32665 raft_consensus.cc:3060] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:04.841444 32726 leader_election.cc:290] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:04.951007 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:05.008184 29924 catalog_manager.cc:5697] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 3 to 5, leader changed from c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 5 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
W20260709 13:11:04.951315 30701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.012001 32755 leader_election.cc:290] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:04.951939 30730 raft_consensus.cc:2393] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 5: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:11:05.013038 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:04.832819 32691 raft_consensus.cc:2804] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:04.957147 30174 raft_consensus.cc:2468] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 5.
I20260709 13:11:04.966130 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:04.969858 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:04.975543 30735 raft_consensus.cc:1275] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:04.977308 30737 raft_consensus.cc:1240] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 LEADER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:04.978804 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:04.979641 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:04.981009 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:05.015535 30736 raft_consensus.cc:2468] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 4.
I20260709 13:11:05.016147 30731 raft_consensus.cc:2410] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 13:11:05.016453 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:05.016966 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:05.017584 30731 raft_consensus.cc:2468] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 8.
I20260709 13:11:05.016986 30736 raft_consensus.cc:2468] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 6.
I20260709 13:11:05.018189 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:05.018631 30024 raft_consensus.cc:2468] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 3.
I20260709 13:11:05.018949 30176 raft_consensus.cc:2410] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:11:04.952905 32760 leader_election.cc:290] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:04.985059 30703 leader_election.cc:304] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:05.019897 32760 raft_consensus.cc:2749] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:05.020156 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:05.020641 32760 consensus_queue.cc:1059] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:05.021348 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:05.022028 30735 raft_consensus.cc:2468] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 5.
I20260709 13:11:05.022126 32760 consensus_queue.cc:1059] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:05.022410   339 consensus_queue.cc:1048] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:05.022205   342 raft_consensus.cc:3055] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:05.023234   342 raft_consensus.cc:740] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:05.014081 32691 raft_consensus.cc:697] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:05.024473 32678 raft_consensus.cc:3055] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:05.013568 30730 raft_consensus.cc:2468] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 6.
I20260709 13:11:04.985837 32685 consensus_queue.cc:1048] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:04.991472 30170 raft_consensus.cc:2468] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 6.
I20260709 13:11:05.002815 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:11:05.003328 29993 connection.cc:256] RPC call timeout handler was delayed by -1.5444209990000672s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2158s for a response
I20260709 13:11:04.945915 30728 raft_consensus.cc:2376] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 5. Re-sending same reply.
I20260709 13:11:05.023478 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:05.004024 30027 raft_consensus.cc:1240] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:05.004292 30700 leader_election.cc:304] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:05.004830   352 raft_consensus.cc:515] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:04.949003   341 raft_consensus.cc:515] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:05.011549 29924 catalog_manager.cc:5697] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:04.952633 30019 raft_consensus.cc:1275] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:11:05.018795 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:05.036571 32733 raft_consensus.cc:493] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.037158 32733 raft_consensus.cc:515] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:05.037806 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:05.038369 30027 raft_consensus.cc:3060] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:05.024050   342 consensus_queue.cc:260] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:05.031551 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
W20260709 13:11:05.025924 29993 connection.cc:256] RPC call timeout handler was delayed by -1.0115095670000755s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2231s for a response
I20260709 13:11:05.040529 32766 raft_consensus.cc:493] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.018596 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:05.037338   339 consensus_queue.cc:1059] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:11:05.041183 32766 raft_consensus.cc:515] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:05.022792 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:05.029510 30168 raft_consensus.cc:2393] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 4: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:11:04.987723   349 leader_election.cc:290] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:05.030287 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:05.041824   339 raft_consensus.cc:3055] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:05.042622   339 raft_consensus.cc:740] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:05.032069 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:05.043210 32766 leader_election.cc:290] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:05.024955 32678 raft_consensus.cc:740] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:05.036466 30729 raft_consensus.cc:1240] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:05.032675 32690 raft_consensus.cc:2804] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:05.044086 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:05.034162 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:05.043416   339 consensus_queue.cc:260] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:05.044582 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:05.043211 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:05.040948 29993 leader_election.cc:304] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:05.034353   341 leader_election.cc:290] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:05.037096 30731 raft_consensus.cc:2468] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 6.
I20260709 13:11:05.041976   352 leader_election.cc:290] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:05.040606   342 raft_consensus.cc:3060] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:05.039817 32733 leader_election.cc:290] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:05.046890 30728 raft_consensus.cc:1275] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:11:05.031654 32691 consensus_queue.cc:237] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:05.044628 32678 consensus_queue.cc:260] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:05.048343 32678 raft_consensus.cc:3060] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:04.938977 32666 raft_consensus.cc:515] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:05.044638 32690 raft_consensus.cc:697] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:05.044658 30735 raft_consensus.cc:2468] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 6.
I20260709 13:11:05.045047 30737 raft_consensus.cc:2468] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 5.
W20260709 13:11:05.050347 30068 connection.cc:256] RPC call timeout handler was delayed by -3.3486560069999314s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260709 13:11:05.045814 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:05.040980 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:05.053206 30732 raft_consensus.cc:2468] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 4.
I20260709 13:11:05.050586 29994 leader_election.cc:304] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:05.066857 32666 leader_election.cc:290] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:05.049254 32665 raft_consensus.cc:515] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:05.068701 32665 leader_election.cc:290] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:05.068786 29993 leader_election.cc:304] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:05.068985 32726 raft_consensus.cc:3060] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:05.069416 30734 raft_consensus.cc:2368] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 7. Current term is 8.
I20260709 13:11:05.070359 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:05.068817 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:05.072533 30027 raft_consensus.cc:2468] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 8.
I20260709 13:11:05.074154 30700 leader_election.cc:304] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:05.046334 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:05.074957 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.077874 30103 raft_consensus.cc:2393] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 9: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:05.078356 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:05.075220 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.078871 30019 raft_consensus.cc:3060] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:05.079234 30100 raft_consensus.cc:2468] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 6.
I20260709 13:11:05.072599 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:05.080158 30168 raft_consensus.cc:2410] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:11:05.081069 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:05.081499 30024 raft_consensus.cc:3060] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:05.079183 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.080459 29924 catalog_manager.cc:5697] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 1 to 6, leader changed from c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 6 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } }
I20260709 13:11:05.084086 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:05.084467 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.084648 30174 raft_consensus.cc:2468] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 6.
I20260709 13:11:05.085140 30100 raft_consensus.cc:2393] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 5: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:05.086737 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:05.087604 30170 raft_consensus.cc:2410] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:11:05.049683 32690 consensus_queue.cc:237] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:05.093114 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:05.084214 29993 leader_election.cc:304] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:05.095295 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.098541 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.099156 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.098960 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.098450 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.100934 30174 raft_consensus.cc:1240] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
W20260709 13:11:05.101955 30700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.104590 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:05.107446 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.108238 30094 raft_consensus.cc:2410] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:11:05.107693 29924 catalog_manager.cc:5697] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 2 to 7. New cstate: current_term: 7 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:05.108594 30019 raft_consensus.cc:2468] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 8.
I20260709 13:11:05.100061 30066 leader_election.cc:304] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:05.111346 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.112011 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.112495 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:05.113046 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.083655 32717 raft_consensus.cc:2804] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:05.085706 32665 raft_consensus.cc:2804] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:05.118598 30027 raft_consensus.cc:1240] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:05.115561 32736 raft_consensus.cc:2804] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:05.123545 32736 raft_consensus.cc:493] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:05.123842 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.123999 32736 raft_consensus.cc:3060] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:05.124424 30094 raft_consensus.cc:2468] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 6.
I20260709 13:11:05.125224 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.126334 30023 raft_consensus.cc:1275] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:11:05.082749 32592 consensus_queue.cc:1048] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 13:11:05.115872 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:05.126739 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:05.083015 32667 consensus_queue.cc:1048] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 13:11:05.127300 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:05.089980 32719 consensus_queue.cc:1048] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:11:05.128921 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:05.129537 30025 raft_consensus.cc:2468] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 7.
I20260709 13:11:05.130052 32598 consensus_queue.cc:1048] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:05.083784   352 raft_consensus.cc:2804] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:05.117703 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.130528 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:05.130882   352 raft_consensus.cc:493] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:05.131270   352 raft_consensus.cc:3060] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:05.117847 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.118197 30100 raft_consensus.cc:2468] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 5.
I20260709 13:11:05.132740 32665 raft_consensus.cc:697] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:05.133487 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.133653 32665 consensus_queue.cc:237] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:05.119239 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:05.126281 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.109524 30700 leader_election.cc:304] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:05.120230 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:05.116334 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.119621 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:05.128392 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:05.133986 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.137207 30028 raft_consensus.cc:2393] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 7: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:11:05.137286 29924 catalog_manager.cc:5697] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 2 to 6, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 6 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:05.117498 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:05.139199 30021 raft_consensus.cc:2468] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 4.
I20260709 13:11:05.119097 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:11:05.123046 30069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.140844 30024 raft_consensus.cc:2468] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 9.
I20260709 13:11:05.137327 30094 raft_consensus.cc:2468] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 5.
I20260709 13:11:05.140163 30176 raft_consensus.cc:2468] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 5.
I20260709 13:11:05.090907 30729 raft_consensus.cc:2468] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 5.
W20260709 13:11:05.143574 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 59430us
I20260709 13:11:05.144520 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.145313 30022 raft_consensus.cc:2368] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 7. Current term is 8.
I20260709 13:11:05.127266 30096 raft_consensus.cc:2376] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 5. Re-sending same reply.
I20260709 13:11:05.146530 29993 leader_election.cc:304] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:05.144620 30700 leader_election.cc:304] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:05.145669 30099 raft_consensus.cc:2393] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 5: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:05.147760 32719 raft_consensus.cc:2804] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:05.147908 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:05.148253 32719 raft_consensus.cc:493] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.148638 32719 raft_consensus.cc:3060] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:05.150177 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:05.149178 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
W20260709 13:11:05.165115 30700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.175158 30174 raft_consensus.cc:2368] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for earlier term 5. Current term is 6.
I20260709 13:11:05.107100   339 raft_consensus.cc:3060] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:05.174604 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:05.177271 30027 raft_consensus.cc:2410] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:11:05.118775 32717 raft_consensus.cc:493] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.176522 30025 raft_consensus.cc:2376] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 6. Re-sending same reply.
I20260709 13:11:05.149803 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:05.179490 29994 leader_election.cc:304] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:05.098604 32589 consensus_queue.cc:1048] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.051s
I20260709 13:11:05.187320 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.110885 32716 consensus_queue.cc:1048] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:05.178344 32667 raft_consensus.cc:2804] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:05.107101 32766 consensus_queue.cc:1048] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:11:05.179806   341 raft_consensus.cc:2804] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:05.116662 32699 consensus_queue.cc:1048] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.064s
I20260709 13:11:05.203706 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.204275 30102 raft_consensus.cc:2468] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 5.
I20260709 13:11:05.149255 32685 raft_consensus.cc:2804] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:05.199038 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.195465 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.201062 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:05.205811 30174 raft_consensus.cc:2468] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 5.
I20260709 13:11:05.201481 30094 raft_consensus.cc:2468] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 5.
I20260709 13:11:05.186928 32717 raft_consensus.cc:3060] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:05.194073 32579 raft_consensus.cc:493] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.209255 29924 catalog_manager.cc:5697] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 2 to 5, leader changed from c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 5 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } }
I20260709 13:11:05.202104 29994 leader_election.cc:304] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:05.216224 30094 raft_consensus.cc:1275] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:11:05.216571 30094 pending_rounds.cc:85] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719: Aborting all ops after (but not including) 4
I20260709 13:11:05.216796 30094 pending_rounds.cc:107] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:11:05.217481 30094 raft_consensus.cc:2889] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:05.216876 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
W20260709 13:11:05.216746 30066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.197557 32667 raft_consensus.cc:493] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:05.226711 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.229507 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:05.230681 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:05.231266 30172 raft_consensus.cc:2468] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 6.
I20260709 13:11:05.234442 30176 raft_consensus.cc:1275] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:05.235304 32358 raft_consensus.cc:2804] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:05.235715 32358 raft_consensus.cc:493] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.236022 32358 raft_consensus.cc:3060] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:05.217195 29924 catalog_manager.cc:5697] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 2 to 3, leader changed from 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 3 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:05.192751 32762 consensus_queue.cc:1048] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 13:11:05.244529 32489 raft_consensus.cc:2804] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:05.244931 32489 raft_consensus.cc:493] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.245241 32489 raft_consensus.cc:3060] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:05.210204   341 raft_consensus.cc:697] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:05.247263 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.248270 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.216413 32685 raft_consensus.cc:697] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:05.203815 32733 consensus_queue.cc:1048] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.035s
I20260709 13:11:05.250052 30094 raft_consensus.cc:2468] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 2.
I20260709 13:11:05.259769 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:05.260531 30174 raft_consensus.cc:2393] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 8: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:11:05.262426 30174 raft_consensus.cc:1275] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:05.238133 32667 raft_consensus.cc:3060] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:05.256223 29924 catalog_manager.cc:5697] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 1 to 3, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 3 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } }
I20260709 13:11:05.268666 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:05.272255 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.273639 30176 raft_consensus.cc:1240] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:05.276290 32736 raft_consensus.cc:515] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:05.279359 32358 raft_consensus.cc:515] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:05.225265 32617 consensus_queue.cc:1059] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:11:05.283104 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.282133 29924 catalog_manager.cc:5697] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 4 to 5, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 5 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:05.287424 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.223281 32579 raft_consensus.cc:515] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:05.288477 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.290405 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.290961 30097 raft_consensus.cc:2468] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 6.
I20260709 13:11:05.289849 30103 raft_consensus.cc:2468] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 6.
I20260709 13:11:05.299502 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.300784 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
W20260709 13:11:05.301023 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 98331.9us
I20260709 13:11:05.301399 30096 raft_consensus.cc:2468] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 6.
I20260709 13:11:05.302887 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.306243 30102 raft_consensus.cc:2393] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 7: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:05.302899 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.307518 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
W20260709 13:11:05.308228 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 106185us
I20260709 13:11:05.305332 30172 raft_consensus.cc:1275] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:05.309967 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.311331 30176 raft_consensus.cc:1240] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:05.313287 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:05.311340 29993 leader_election.cc:304] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:05.314599 29993 leader_election.cc:304] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:05.316417 29994 leader_election.cc:304] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:05.303481 32726 raft_consensus.cc:2749] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:05.320528 30099 raft_consensus.cc:2393] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 5: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:05.319056 32718 raft_consensus.cc:2804] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:05.319195 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.323649 30094 raft_consensus.cc:2468] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 7.
I20260709 13:11:05.316520 29924 catalog_manager.cc:5697] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 2 to 4, leader changed from 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 4 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:05.321357 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.319092 32358 leader_election.cc:290] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:05.326508 30102 raft_consensus.cc:2468] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 4.
I20260709 13:11:05.325286 30101 raft_consensus.cc:2393] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 6: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:05.355618 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:05.356429 30174 raft_consensus.cc:2393] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 6: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:11:05.366993 30098 raft_consensus.cc:2468] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 4.
I20260709 13:11:05.369251 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.369529 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.370765 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.371490 30101 raft_consensus.cc:2393] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 5: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:05.373852 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.375619 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.377815 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.379652 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:05.380381 30101 raft_consensus.cc:2393] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 9: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:05.382434 30095 pending_rounds.cc:85] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719: Aborting all ops after (but not including) 7
I20260709 13:11:05.382750 30095 pending_rounds.cc:107] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719: Aborting uncommitted NO_OP operation due to leader change: 5.8
I20260709 13:11:05.382972 30095 raft_consensus.cc:2889] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:05.384833 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:05.385450 30103 raft_consensus.cc:3060] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:05.385474 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:05.386139 30102 raft_consensus.cc:2376] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 6. Re-sending same reply.
I20260709 13:11:05.386199 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:05.389212 30102 raft_consensus.cc:1240] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:05.390236 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.391067 30099 raft_consensus.cc:2410] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:11:05.391126 30101 raft_consensus.cc:1275] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:05.390250 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
W20260709 13:11:05.392283 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 77782.8us
I20260709 13:11:05.392992 29993 leader_election.cc:304] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
W20260709 13:11:05.395356 30066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.396250 30103 raft_consensus.cc:2468] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 7.
I20260709 13:11:05.324738 32718 raft_consensus.cc:493] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:05.397977 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 81897.1us
I20260709 13:11:05.398545 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:05.401192 29993 leader_election.cc:304] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:05.402096 29994 leader_election.cc:304] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:05.404995 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:05.405544 30174 raft_consensus.cc:3060] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:05.401765 32358 raft_consensus.cc:2749] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:05.407508 30170 raft_consensus.cc:1217] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 6 LEADER]: Deduplicated request from leader. Original: 4.7->[5.8-5.8]   Dedup: 5.8->[]
I20260709 13:11:05.407974 30170 raft_consensus.cc:1240] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 6 LEADER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 13:11:05.409281 30171 raft_consensus.cc:1275] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:05.410075 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:05.410192 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:05.410619 30168 raft_consensus.cc:3060] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:05.411492 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:05.412159 30171 raft_consensus.cc:2393] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 5: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:11:05.413167 30171 raft_consensus.cc:1275] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 13:11:05.414073 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:05.415158 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:05.415853 30173 raft_consensus.cc:2393] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 5: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:11:05.416775 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:05.417026 32489 raft_consensus.cc:515] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:05.398010 32726 raft_consensus.cc:2804] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:05.426012 32726 raft_consensus.cc:493] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.426352 32726 raft_consensus.cc:3060] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:05.426942 32489 leader_election.cc:290] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:05.417675 30177 raft_consensus.cc:1240] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:05.419302 32579 leader_election.cc:290] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:05.419844 32746 raft_consensus.cc:3055] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:05.428267 32746 raft_consensus.cc:740] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:05.429183 32746 consensus_queue.cc:260] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:05.397644   321 raft_consensus.cc:2804] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:05.430114   321 raft_consensus.cc:493] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.430423 32746 raft_consensus.cc:3060] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:05.400592 32718 raft_consensus.cc:3060] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:05.325210 32685 consensus_queue.cc:237] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:05.430460   321 raft_consensus.cc:3060] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:05.325709   370 consensus_queue.cc:1048] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 13:11:05.438153 32736 leader_election.cc:290] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:05.403355   341 consensus_queue.cc:237] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:05.443264 30103 raft_consensus.cc:3055] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:05.443631 30103 raft_consensus.cc:740] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
W20260709 13:11:05.447497 30701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.424212 32719 raft_consensus.cc:515] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:05.425114 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:05.449577 30172 raft_consensus.cc:2468] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 7.
I20260709 13:11:05.453657 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:05.454857 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:05.455437 30171 raft_consensus.cc:2468] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 4.
I20260709 13:11:05.457854 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.460345 30168 raft_consensus.cc:2468] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 6.
I20260709 13:11:05.462244 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:05.462677 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:11:05.462831 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 61714.7us
I20260709 13:11:05.463498 29993 leader_election.cc:304] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:05.463399 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:05.464047 30170 raft_consensus.cc:2393] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 4: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:11:05.462303 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:11:05.476981 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 74962.7us
I20260709 13:11:05.479530 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.480213 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:05.480719 30175 raft_consensus.cc:2468] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 4.
I20260709 13:11:05.483489 30026 raft_consensus.cc:1275] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:05.485594 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:05.487252 30170 raft_consensus.cc:1275] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:05.488544 29993 leader_election.cc:304] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:05.489670 29993 leader_election.cc:304] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:05.495257 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:05.498764 29993 leader_election.cc:304] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:05.477444 32589 raft_consensus.cc:2804] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:05.501324 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:05.508026 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:05.479506   370 raft_consensus.cc:2749] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:05.479831 32600 raft_consensus.cc:2804] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:05.509850 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:05.513996 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:05.515671 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.522931 30170 raft_consensus.cc:3060] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:11:05.523622 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:05.508401 30103 consensus_queue.cc:260] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:05.502167 30101 raft_consensus.cc:2376] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 5. Re-sending same reply.
I20260709 13:11:05.524171 30102 raft_consensus.cc:3060] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:05.517155 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:05.524792 30100 raft_consensus.cc:3060] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:05.531402 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
W20260709 13:11:05.531662 30069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.531999 30098 raft_consensus.cc:2376] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 6. Re-sending same reply.
I20260709 13:11:05.533828 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:05.534538 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:05.535704 30171 raft_consensus.cc:2468] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 6.
I20260709 13:11:05.536113 30103 raft_consensus.cc:3060] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:05.540939 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:05.534366 30096 raft_consensus.cc:3060] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:05.542040 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:05.501988 32489 raft_consensus.cc:2804] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:05.508728 32573 raft_consensus.cc:2804] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:05.571537 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:05.570847 30174 raft_consensus.cc:2468] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 7.
I20260709 13:11:05.544332 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:05.544492 30142 leader_election.cc:304] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:05.563928 29993 leader_election.cc:304] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:05.577585 30142 leader_election.cc:304] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:05.577785 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
W20260709 13:11:05.579888 30069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.576574 30172 raft_consensus.cc:2468] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 6.
I20260709 13:11:05.581770 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:05.582388 30142 leader_election.cc:304] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:05.582341 30176 raft_consensus.cc:3060] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:05.586725   358 raft_consensus.cc:2804] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:05.587190   358 raft_consensus.cc:493] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.587556   358 raft_consensus.cc:3060] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:05.589897 32658 raft_consensus.cc:2804] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:05.590281 32658 raft_consensus.cc:493] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.590605 32658 raft_consensus.cc:3060] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:05.575747 32573 raft_consensus.cc:493] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.591987 32573 raft_consensus.cc:3060] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:05.583473 30142 leader_election.cc:304] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:05.494530 32501 consensus_queue.cc:1048] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.054s
W20260709 13:11:05.576131   360 log.cc:927] Time spent T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:11:05.530228   369 raft_consensus.cc:2804] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:05.674927 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:05.522311 32600 raft_consensus.cc:493] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
W20260709 13:11:05.676183 30066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.673683 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:05.678100 30171 raft_consensus.cc:3060] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:11:05.677011 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.678915 30098 raft_consensus.cc:2468] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 7.
I20260709 13:11:05.564888 32589 raft_consensus.cc:697] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
W20260709 13:11:05.587201   371 log.cc:927] Time spent T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 13:11:05.528185 32609 consensus_queue.cc:1048] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.140s
I20260709 13:11:05.586079 32489 raft_consensus.cc:493] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:05.591948   370 raft_consensus.cc:2804] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:11:05.674530   362 log.cc:927] Time spent T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:11:05.630720 32668 raft_consensus.cc:2804] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:05.673213 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:05.724301 32589 consensus_queue.cc:237] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:05.725265 32668 raft_consensus.cc:493] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:05.725356 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:05.735203 30098 raft_consensus.cc:3060] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:05.681306 32600 raft_consensus.cc:3060] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:05.700839 32489 raft_consensus.cc:3060] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:05.749289   376 log.cc:927] Time spent T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 13:11:05.750277   375 log.cc:927] Time spent T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.242s	user 0.000s	sys 0.001s
I20260709 13:11:05.750152 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.709600   370 raft_consensus.cc:493] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:05.759830 30096 raft_consensus.cc:2468] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 5.
W20260709 13:11:05.762657 30067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.718981   369 raft_consensus.cc:697] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:05.700081 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:05.734637 32753 raft_consensus.cc:2804] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:05.737954 32668 raft_consensus.cc:3060] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:05.808991 30142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 225568us
I20260709 13:11:05.817386 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.822434 30142 leader_election.cc:304] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
W20260709 13:11:05.778254   352 consensus_meta.cc:287] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent flushing consensus metadata: real 0.647s	user 0.011s	sys 0.000s
I20260709 13:11:05.778059   353 raft_consensus.cc:493] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:05.813647 30098 raft_consensus.cc:2468] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 8.
I20260709 13:11:05.792673 30100 raft_consensus.cc:2468] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 7.
W20260709 13:11:05.827256 30066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.833488 30142 leader_election.cc:304] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
W20260709 13:11:05.837829 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 258709us
I20260709 13:11:05.843655 30027 raft_consensus.cc:1275] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:05.814615 32753 raft_consensus.cc:493] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:05.778581   370 raft_consensus.cc:3060] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:05.849193 30700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.847020 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
W20260709 13:11:05.853024   339 consensus_meta.cc:287] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent flushing consensus metadata: real 0.669s	user 0.004s	sys 0.014s
I20260709 13:11:05.831808   346 consensus_queue.cc:1059] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:11:05.854117 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.865698 30730 raft_consensus.cc:2468] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 7.
I20260709 13:11:05.835548 32719 leader_election.cc:290] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:05.851622 30026 raft_consensus.cc:1275] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:05.851652 32753 raft_consensus.cc:3060] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:05.865795 30100 raft_consensus.cc:2368] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 4. Current term is 5.
I20260709 13:11:05.854314 30103 raft_consensus.cc:1275] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:05.836524   352 raft_consensus.cc:515] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:05.870896 30735 raft_consensus.cc:1240] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 LEADER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 8. Current term is 9. Ops: []
W20260709 13:11:05.850217 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 273204us
I20260709 13:11:05.852741   349 raft_consensus.cc:2804] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:11:05.870836 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 45521.7us
I20260709 13:11:05.851161 32726 raft_consensus.cc:515] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:05.871055 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 288015us
I20260709 13:11:05.867882 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.873868 30702 leader_election.cc:304] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:05.843236   353 raft_consensus.cc:515] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:05.882383 30066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:05.883179 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:05.862926 32658 raft_consensus.cc:515] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:05.868888 32760 consensus_queue.cc:1048] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:11:05.940511   352 leader_election.cc:290] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:05.953058   353 leader_election.cc:290] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:11:05.963408 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 82914.6us
I20260709 13:11:05.957134   358 raft_consensus.cc:515] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:05.957850 30171 raft_consensus.cc:2468] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 6.
W20260709 13:11:05.958261 32746 consensus_meta.cc:287] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719: Time spent flushing consensus metadata: real 0.527s	user 0.005s	sys 0.010s
I20260709 13:11:05.867462 32718 raft_consensus.cc:515] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:05.917114 32667 consensus_meta.cc:287] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent flushing consensus metadata: real 0.632s	user 0.000s	sys 0.028s
I20260709 13:11:05.936851 30019 raft_consensus.cc:1240] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:11:05.994298 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.912042 30028 raft_consensus.cc:2393] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 9: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:11:05.872430   349 raft_consensus.cc:493] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:05.923298 30094 raft_consensus.cc:2468] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 4.
I20260709 13:11:05.938110 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:06.002856 30103 raft_consensus.cc:2376] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 7. Re-sending same reply.
W20260709 13:11:05.888068 30701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:05.985070 30142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 153182us
I20260709 13:11:05.915163 29994 leader_election.cc:304] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:05.956676   370 raft_consensus.cc:515] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:05.990537 30024 raft_consensus.cc:1240] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:05.943059 32726 leader_election.cc:290] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:05.957474 32600 raft_consensus.cc:515] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:05.910892   341 raft_consensus.cc:2749] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:11:06.002697 32717 consensus_meta.cc:287] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4: Time spent flushing consensus metadata: real 0.777s	user 0.012s	sys 0.001s
I20260709 13:11:06.018627 30142 leader_election.cc:400] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469) with higher term. Message: Invalid argument: T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 7. Current term is 8.
I20260709 13:11:05.983767   389 raft_consensus.cc:2804] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:06.006428   349 raft_consensus.cc:3060] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:06.008087 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 93016us
I20260709 13:11:06.008590 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:05.992957 30702 leader_election.cc:304] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:06.013993 30025 raft_consensus.cc:1240] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:11:06.014954   393 consensus_queue.cc:1048] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:11:06.015265   399 log.cc:927] Time spent T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.074s	user 0.000s	sys 0.010s
I20260709 13:11:06.029815 29994 leader_election.cc:304] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:06.018970 30142 leader_election.cc:403] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:05.884366 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:06.005543 32667 raft_consensus.cc:515] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:06.054114 30170 consensus_meta.cc:287] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124: Time spent flushing consensus metadata: real 0.512s	user 0.008s	sys 0.008s
I20260709 13:11:06.055245 32668 raft_consensus.cc:515] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:06.055826 32667 leader_election.cc:290] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:06.024952 30020 raft_consensus.cc:1240] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:06.059523 30176 raft_consensus.cc:2468] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 7.
I20260709 13:11:06.013607   352 raft_consensus.cc:2804] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:11:06.065822 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 501957us
I20260709 13:11:06.027354 30702 leader_election.cc:304] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:06.001684   386 consensus_queue.cc:1048] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 13:11:05.874065   369 consensus_queue.cc:237] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:06.035759   394 log.cc:927] Time spent T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260709 13:11:06.040272   388 raft_consensus.cc:3055] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:11:06.054307   391 log.cc:927] Time spent T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.111s	user 0.002s	sys 0.000s
I20260709 13:11:05.994541 32685 consensus_queue.cc:1048] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:11:06.045838   339 raft_consensus.cc:2804] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:06.046990 32600 leader_election.cc:290] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:05.994731 32678 consensus_queue.cc:1048] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 13:11:06.022128   389 raft_consensus.cc:493] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.007750   398 consensus_queue.cc:1059] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:11:06.050256 30734 raft_consensus.cc:1240] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 LEADER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:06.052245 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:06.052474 32573 raft_consensus.cc:515] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:06.045707 32718 leader_election.cc:290] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:06.023092 32717 raft_consensus.cc:515] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:06.079334   389 raft_consensus.cc:3060] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:06.071658   388 raft_consensus.cc:740] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
W20260709 13:11:06.049611   321 consensus_meta.cc:287] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent flushing consensus metadata: real 0.615s	user 0.012s	sys 0.006s
I20260709 13:11:06.068953 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:06.067058 30702 leader_election.cc:304] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:06.041641 32658 leader_election.cc:290] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:06.055181 30170 raft_consensus.cc:2468] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 8.
W20260709 13:11:06.070637 30102 consensus_meta.cc:287] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719: Time spent flushing consensus metadata: real 0.545s	user 0.015s	sys 0.012s
I20260709 13:11:06.072189 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:06.074456 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:06.097330 30102 raft_consensus.cc:2468] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 6.
I20260709 13:11:06.094242 32760 consensus_queue.cc:1048] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:11:06.098533 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:06.099546 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:06.100011 30175 raft_consensus.cc:3060] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:06.065678   352 raft_consensus.cc:493] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.097265 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:06.100657   408 consensus_queue.cc:1059] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 13:11:06.103948 32573 leader_election.cc:290] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:06.104825 32668 leader_election.cc:290] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:06.076319 32762 consensus_queue.cc:1059] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 13:11:06.105405 32766 consensus_queue.cc:1059] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:06.052928 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:06.106509 30733 raft_consensus.cc:3060] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:06.089255 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:06.071204 32691 raft_consensus.cc:2749] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:06.111776 30175 raft_consensus.cc:2468] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 8.
I20260709 13:11:06.091378 29993 leader_election.cc:304] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:06.073720   339 raft_consensus.cc:493] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:06.094965 30174 raft_consensus.cc:2393] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 8: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:11:06.095683 30024 raft_consensus.cc:1275] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:11:06.096478 30702 leader_election.cc:304] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:06.078554   384 raft_consensus.cc:2804] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:06.123154 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:06.081961   398 raft_consensus.cc:3055] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:06.101296 30094 raft_consensus.cc:2468] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 5.
I20260709 13:11:06.101631 30171 raft_consensus.cc:3060] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:06.118690 29993 leader_election.cc:304] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:06.105988   385 raft_consensus.cc:2804] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:06.118788 30021 raft_consensus.cc:2393] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 7: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
W20260709 13:11:06.079157 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 206416us
I20260709 13:11:06.119671 30023 raft_consensus.cc:1240] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:11:06.126919 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:06.128971 30140 leader_election.cc:304] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:06.129448 30096 raft_consensus.cc:2368] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 4. Current term is 5.
I20260709 13:11:06.130621 30140 leader_election.cc:304] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:06.131876 30140 leader_election.cc:400] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Vote denied by peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451) with higher term. Message: Invalid argument: T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 7. Current term is 8.
I20260709 13:11:06.134055 30140 leader_election.cc:304] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:06.134989   402 raft_consensus.cc:2804] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:06.135531   402 raft_consensus.cc:697] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 6 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:06.135557   346 consensus_queue.cc:1059] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:06.137048 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:06.141124 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:06.106276 32762 raft_consensus.cc:3055] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:06.142596   384 raft_consensus.cc:697] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:06.139163 32658 consensus_queue.cc:1048] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 13:11:06.148305   384 consensus_queue.cc:237] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:06.149446   388 consensus_queue.cc:260] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:06.150580   388 raft_consensus.cc:3060] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:06.097443   321 raft_consensus.cc:515] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:06.143059 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:06.143597 32668 raft_consensus.cc:2749] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:06.145113 32717 leader_election.cc:290] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:06.158010 29993 leader_election.cc:304] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:06.127118   398 raft_consensus.cc:740] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:06.123363   339 raft_consensus.cc:3060] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:06.127170 32678 raft_consensus.cc:2749] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:06.125046 32579 raft_consensus.cc:2749] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:06.145725   404 raft_consensus.cc:2749] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469) with higher term. Message: Invalid argument: T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 7. Current term is 8.
I20260709 13:11:06.146559   370 leader_election.cc:290] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:06.109651   352 raft_consensus.cc:3060] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:06.153563 30140 leader_election.cc:304] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:06.156250 30024 raft_consensus.cc:2393] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 8: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:11:06.162046 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:06.163244   321 leader_election.cc:290] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:06.169565 30171 raft_consensus.cc:2468] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 5.
I20260709 13:11:06.096158 32489 raft_consensus.cc:515] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:06.126868   385 raft_consensus.cc:493] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.137598   408 consensus_queue.cc:1243] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer 6f3eb161e2194f6891f12e2cfcaaf73a log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:11:06.233511 30730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51004 (request call id 641) took 1202 ms. Trace:
I20260709 13:11:06.233939 30730 rpcz_store.cc:276] 0709 13:11:05.030929 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.033937 (+  3008us) service_pool.cc:224] Handling call
0709 13:11:06.233341 (+1199404us) spinlock_profiling.cc:243] Waited 820 ms on lock 0x7b54005334d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:11:06.233433 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1885967616}
I20260709 13:11:06.236537 30026 raft_consensus.cc:1240] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:06.223474   353 raft_consensus.cc:2764] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:11:06.238700 32666 raft_consensus.cc:493] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.239192 32666 raft_consensus.cc:515] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:06.136700   402 consensus_queue.cc:237] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:06.241241 32666 leader_election.cc:290] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:06.243628 32489 leader_election.cc:290] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:06.173107 32504 raft_consensus.cc:2804] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 13:11:06.179158   392 log.cc:927] Time spent T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.230s	user 0.002s	sys 0.000s
I20260709 13:11:06.244974 32504 raft_consensus.cc:697] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
W20260709 13:11:06.180156   405 log.cc:927] Time spent T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:11:06.185293 29993 leader_election.cc:304] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
W20260709 13:11:06.245923 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 60697.2us
I20260709 13:11:06.246771 32489 raft_consensus.cc:2804] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:06.247074 29993 leader_election.cc:304] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:06.151249 32762 raft_consensus.cc:740] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:06.189777 30733 raft_consensus.cc:2468] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 6.
I20260709 13:11:06.189868 30096 raft_consensus.cc:2376] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 7. Re-sending same reply.
I20260709 13:11:06.193817 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
W20260709 13:11:06.204648 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 51167.8us
W20260709 13:11:06.206684 30066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.254407 30737 raft_consensus.cc:3060] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:06.254730 30066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.140884   386 consensus_queue.cc:1048] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:11:06.244138 30028 raft_consensus.cc:1240] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:06.238663 30026 raft_consensus.cc:1275] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:06.236470 30142 leader_election.cc:304] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:06.255548 30171 raft_consensus.cc:1275] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:06.172711 30173 raft_consensus.cc:1275] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:06.249673 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:06.257884 30027 raft_consensus.cc:2468] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 4.
I20260709 13:11:06.190181   358 leader_election.cc:290] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:06.237357   339 raft_consensus.cc:515] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:06.247679   385 raft_consensus.cc:3060] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:06.268241 30142 leader_election.cc:304] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:06.247960 32489 raft_consensus.cc:697] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:06.258612 32719 raft_consensus.cc:2804] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:06.284602 29993 leader_election.cc:304] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:06.258788 32658 raft_consensus.cc:2749] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:06.295606 30729 raft_consensus.cc:3060] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:06.271188   353 raft_consensus.cc:2804] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:06.309160 32762 consensus_queue.cc:260] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:06.309993 32678 raft_consensus.cc:493] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:06.310201 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:06.310839 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:06.311570 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:06.285863 32690 consensus_queue.cc:1048] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:11:06.282069 32668 consensus_queue.cc:1059] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 13:11:06.245924 32504 consensus_queue.cc:237] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:06.625882 30177 raft_consensus.cc:1275] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
W20260709 13:11:06.676457   389 consensus_meta.cc:287] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124: Time spent flushing consensus metadata: real 0.568s	user 0.005s	sys 0.004s
W20260709 13:11:06.703799 30069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.328948 30700 leader_election.cc:304] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:06.484669 30737 raft_consensus.cc:2468] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 9.
I20260709 13:11:06.313058   353 raft_consensus.cc:493] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:06.705209   386 raft_consensus.cc:2804] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:06.580433 32766 consensus_queue.cc:1059] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.125s
I20260709 13:11:06.705678   353 raft_consensus.cc:3060] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:06.705909   386 raft_consensus.cc:493] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:06.294829 32501 raft_consensus.cc:2749] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:06.706310   386 raft_consensus.cc:3060] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:06.654160   409 log.cc:927] Time spent T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.390s	user 0.001s	sys 0.000s
W20260709 13:11:06.398792 30142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 130616us
I20260709 13:11:06.709654 30732 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51014 (request call id 843) took 1184 ms. Trace:
I20260709 13:11:06.405738 30170 raft_consensus.cc:3055] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:06.710148 30732 rpcz_store.cc:276] 0709 13:11:05.525452 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.525642 (+   190us) service_pool.cc:224] Handling call
0709 13:11:05.571370 (+ 45728us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:05.575792 (+  4422us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:05.575818 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:05.587386 (+ 11568us) log.cc:844] Serialized 26 byte log entry
0709 13:11:06.059742 (+472356us) spinlock_profiling.cc:243] Waited 6.23 ms on lock 0x7b1800443260. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f7e95de1 00007f99f7ea25b1 00007f99eefafe07 00007f99f7e0aab9 00007f99eefcc69b 00007f99eefca93f 00007f99eefccc02 00007f99f1c5420b 00007f99f1c59d23 00007f99f1c5a0d1 00007f99f2075a0f
0709 13:11:06.094554 (+ 34812us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:06.094597 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:06.094659 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:06.709380 (+614721us) raft_consensus.cc:1685] finished
0709 13:11:06.709400 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:06.709597 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4091,"raft.queue_time_us":10999,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"spinlock_wait_cycles":14338944,"thread_start_us":34353,"threads_started":1,"wal-append.queue_time_us":587774}
I20260709 13:11:06.712468 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
W20260709 13:11:06.712692 30701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.712942 30732 raft_consensus.cc:3060] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:06.713362 32760 raft_consensus.cc:493] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.713887 32760 raft_consensus.cc:515] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:06.715932 32760 leader_election.cc:290] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:06.719127 32762 raft_consensus.cc:3060] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:06.720752 30732 raft_consensus.cc:2468] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 8.
I20260709 13:11:06.721138   386 raft_consensus.cc:515] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:06.323477 30019 raft_consensus.cc:1275] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:06.724555   386 leader_election.cc:290] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:06.725426 30730 raft_consensus.cc:2393] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 6: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
W20260709 13:11:06.431515 30703 leader_election.cc:336] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Timed out: RequestConsensusVote RPC to 127.28.54.66:43821 timed out after 1.501s (SENT)
I20260709 13:11:06.402427 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
W20260709 13:11:06.726222 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 284680us
I20260709 13:11:06.726593 30177 pending_rounds.cc:85] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124: Aborting all ops after (but not including) 8
I20260709 13:11:06.756361 30703 leader_election.cc:304] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:06.756664 30177 pending_rounds.cc:107] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 13:11:06.439431 30729 raft_consensus.cc:2468] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 8.
W20260709 13:11:06.756873 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 427989us
W20260709 13:11:06.516885 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 250134us
I20260709 13:11:06.315016 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
W20260709 13:11:06.757503 30069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.756973 30177 raft_consensus.cc:2889] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:06.323859   349 raft_consensus.cc:515] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:06.758026 30069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:06.623283   410 log.cc:927] Time spent T 00000000000000000000000000000000 P 1c91346f9a2a480e908d4e0323634aeb: Append to log took a long time: real 0.171s	user 0.000s	sys 0.001s
I20260709 13:11:06.304066 32719 raft_consensus.cc:697] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
W20260709 13:11:06.740975   411 log.cc:927] Time spent T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 13:11:06.337056 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:06.286093   358 raft_consensus.cc:2804] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:06.704577 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
W20260709 13:11:06.384339 30067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.794987 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:06.711310 30170 raft_consensus.cc:740] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
W20260709 13:11:06.761147 30143 leader_election.cc:336] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Timed out: RequestConsensusVote RPC to 127.28.54.66:43821 timed out after 1.514s (SENT)
I20260709 13:11:06.760532 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
W20260709 13:11:06.789533 30066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.796018 30143 leader_election.cc:304] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:06.790553 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
W20260709 13:11:06.482954 32753 consensus_meta.cc:287] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124: Time spent flushing consensus metadata: real 0.604s	user 0.007s	sys 0.001s
I20260709 13:11:06.794057 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:06.810056 30021 raft_consensus.cc:2368] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 7. Current term is 8.
I20260709 13:11:06.399398 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:06.728418   339 leader_election.cc:290] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:06.704140   389 raft_consensus.cc:515] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:06.789381 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
W20260709 13:11:06.797605 30142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 87365.4us
I20260709 13:11:06.805714 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:06.806773 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:06.818581 30028 raft_consensus.cc:3060] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Advancing to term 6
I20260709 13:11:06.806954 30176 raft_consensus.cc:1240] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:06.812312 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:06.808594 30170 consensus_queue.cc:260] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:06.580602   398 consensus_queue.cc:260] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:06.791076 32760 raft_consensus.cc:493] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.825186 30142 leader_election.cc:304] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:06.825986 30170 raft_consensus.cc:3060] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:06.831733 30028 raft_consensus.cc:2468] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 6.
I20260709 13:11:06.373641 32666 consensus_queue.cc:1048] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.436s
I20260709 13:11:06.828317 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:06.826719 30096 raft_consensus.cc:2393] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 9: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:06.833420 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:11:06.837257 30142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.760875 32678 raft_consensus.cc:515] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:06.811867   358 raft_consensus.cc:697] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 6 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
W20260709 13:11:06.848259 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 87144.7us
I20260709 13:11:06.823555   423 raft_consensus.cc:493] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:06.850188 30140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.527536 32489 consensus_queue.cc:237] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:06.851415 30143 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.54.66:43821 timed out after 1.524s (SENT) [suppressed 36 similar messages]
I20260709 13:11:06.852231 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:06.872380   423 raft_consensus.cc:515] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:06.818392 32753 raft_consensus.cc:515] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:06.833328 32760 raft_consensus.cc:515] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:06.887703   423 leader_election.cc:290] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:06.889014   358 consensus_queue.cc:237] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:06.840479 32668 raft_consensus.cc:2749] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:06.925498   353 raft_consensus.cc:515] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:06.928349   353 leader_election.cc:290] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:06.843880   393 raft_consensus.cc:2804] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:06.890688 32678 leader_election.cc:290] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:11:06.891484 30143 leader_election.cc:336] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Timed out: RequestConsensusVote RPC to 127.28.54.66:43821 timed out after 1.873s (SENT)
I20260709 13:11:06.936812 30143 leader_election.cc:304] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:06.849578   339 consensus_queue.cc:1059] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260709 13:11:06.878902 32719 consensus_queue.cc:237] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:06.896346   352 consensus_meta.cc:287] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4: Time spent flushing consensus metadata: real 0.673s	user 0.009s	sys 0.000s
I20260709 13:11:06.897306 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:06.897480   389 leader_election.cc:290] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:06.899060 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:06.899418 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:06.900403 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:06.902784   349 leader_election.cc:290] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:06.905527 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:06.915952 30102 raft_consensus.cc:2468] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 4.
I20260709 13:11:06.914144 32762 raft_consensus.cc:493] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
W20260709 13:11:06.917098   385 consensus_meta.cc:287] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent flushing consensus metadata: real 0.613s	user 0.008s	sys 0.000s
I20260709 13:11:06.952988 30169 raft_consensus.cc:2368] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 7. Current term is 8.
I20260709 13:11:06.917236 32666 raft_consensus.cc:2749] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:06.918352 32766 raft_consensus.cc:493] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.918867 32760 leader_election.cc:290] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:06.919404 30068 leader_election.cc:304] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
W20260709 13:11:06.923875 30128 heartbeater.cc:646] Failed to heartbeat to 127.28.54.126:45283 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.28.54.126:45283 timed out after 15.000s (SENT)
I20260709 13:11:06.889463 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:11:06.929030 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 497524us
W20260709 13:11:06.956516 30703 leader_election.cc:336] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Timed out: RequestConsensusVote RPC to 127.28.54.66:43821 timed out after 1.502s (SENT)
I20260709 13:11:06.956898 30703 leader_election.cc:304] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:06.957115 32766 raft_consensus.cc:515] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:06.959159 32766 leader_election.cc:290] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:11:06.960047 30703 leader_election.cc:336] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Timed out: RequestConsensusVote RPC to 127.28.54.66:43821 timed out after 1.611s (SENT)
I20260709 13:11:06.936892 30168 raft_consensus.cc:1240] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 6. Current term is 7. Ops: []
W20260709 13:11:06.936437 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 146534us
I20260709 13:11:06.928695 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
W20260709 13:11:06.944293 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 52832us
I20260709 13:11:06.936056 32716 raft_consensus.cc:493] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:06.943862 32668 raft_consensus.cc:2749] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:06.962863 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:06.963917 30172 raft_consensus.cc:2468] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 4.
W20260709 13:11:06.953783 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 117636us
W20260709 13:11:06.936143 30066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:06.960453 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:06.960880 29993 leader_election.cc:304] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:06.962585 30143 leader_election.cc:304] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:06.946549   393 raft_consensus.cc:697] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 9 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:06.992467 29993 leader_election.cc:304] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:06.953073   339 raft_consensus.cc:3055] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:06.994311 30700 leader_election.cc:400] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 election: Vote denied by peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451) with higher term. Message: Invalid argument: T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 7. Current term is 8.
I20260709 13:11:06.995661 30700 leader_election.cc:403] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 13:11:06.954017 30731 raft_consensus.cc:3060] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:06.996068 30142 leader_election.cc:304] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:06.951570   352 raft_consensus.cc:515] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:07.002072 32760 consensus_queue.cc:1048] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:11:06.998169   349 raft_consensus.cc:2749] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:07.002173 32666 consensus_queue.cc:1048] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:11:07.015085   393 consensus_queue.cc:237] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:07.017204 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:06.993122   435 raft_consensus.cc:2749] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:07.020850 29993 leader_election.cc:304] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
W20260709 13:11:07.022362 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 59850.1us
I20260709 13:11:06.994367 32766 raft_consensus.cc:2749] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:07.037648 29993 leader_election.cc:304] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:06.995455   339 raft_consensus.cc:740] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
W20260709 13:11:07.038362   414 log.cc:927] Time spent T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.520s	user 0.008s	sys 0.014s
I20260709 13:11:07.038448 32358 raft_consensus.cc:2749] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:07.038735   339 consensus_queue.cc:260] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:07.039966   339 raft_consensus.cc:3060] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:06.994227 32697 raft_consensus.cc:2804] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:06.955897 32762 raft_consensus.cc:515] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:07.016642   388 raft_consensus.cc:2804] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:07.027010 30143 leader_election.cc:304] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:11:06.828776   402 consensus_queue.cc:1175] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" responder_term: 9 status { last_received { term: 9 index: 10 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 8. Current term is 9. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:11:07.060197 32668 raft_consensus.cc:2749] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:11:07.027842 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 108529us
I20260709 13:11:06.994226 32716 raft_consensus.cc:515] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:07.066272 30068 leader_election.cc:304] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:07.066609 32716 leader_election.cc:290] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:07.067390 30068 leader_election.cc:304] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:07.068150   433 raft_consensus.cc:2804] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:07.068543   433 raft_consensus.cc:493] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:06.956758   385 raft_consensus.cc:515] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:07.034849 30025 raft_consensus.cc:1240] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:11:07.068871 30068 leader_election.cc:304] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:07.069301   433 raft_consensus.cc:3060] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:07.069913 32766 raft_consensus.cc:2749] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 7 LEADER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:07.070627 32766 raft_consensus.cc:2764] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:11:07.020934 32489 raft_consensus.cc:2749] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:07.036556 32504 raft_consensus.cc:2749] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:07.041569 32358 raft_consensus.cc:493] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:07.057962 30143 leader_election.cc:304] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:07.059540 32762 leader_election.cc:290] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:07.035773   352 leader_election.cc:290] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:07.074491 30068 leader_election.cc:400] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Vote denied by peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001) with higher term. Message: Invalid argument: T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for earlier term 5. Current term is 6.
I20260709 13:11:07.079675 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:07.081071   385 leader_election.cc:290] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:07.081485 32666 raft_consensus.cc:2749] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451) with higher term. Message: Invalid argument: T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 7. Current term is 8.
I20260709 13:11:07.102874 30730 raft_consensus.cc:2468] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 7.
I20260709 13:11:07.106603 30021 raft_consensus.cc:1240] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:07.106717 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:07.107235 30024 raft_consensus.cc:1240] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 LEADER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:11:07.115234 30027 raft_consensus.cc:1240] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 4. Current term is 5. Ops: []
W20260709 13:11:07.110970 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 92241.9us
I20260709 13:11:07.021328   420 raft_consensus.cc:493] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:07.039987   422 raft_consensus.cc:3055] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:11:07.110071 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 52189.2us
I20260709 13:11:07.117596 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:07.117293 30142 leader_election.cc:304] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:07.119721 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:07.120477 30020 raft_consensus.cc:1240] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 5. Current term is 7. Ops: []
I20260709 13:11:07.121626 30143 leader_election.cc:304] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:07.109421 32358 raft_consensus.cc:515] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:07.082998 32668 raft_consensus.cc:493] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:07.109635   349 raft_consensus.cc:493] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:07.114925   353 raft_consensus.cc:2764] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:11:07.114459   388 raft_consensus.cc:697] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 8 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
W20260709 13:11:07.138017 30066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:07.141887 32573 raft_consensus.cc:2804] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:07.120884 30731 raft_consensus.cc:2468] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 6.
I20260709 13:11:07.146518 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:07.148092 30142 leader_election.cc:304] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:07.152532   413 raft_consensus.cc:2804] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:07.153009   413 raft_consensus.cc:697] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 6 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
W20260709 13:11:07.158061 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 164144us
I20260709 13:11:07.162470 30702 leader_election.cc:400] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 election: Vote denied by peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001) with higher term. Message: Invalid argument: T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 7. Current term is 8.
I20260709 13:11:07.163338 30702 leader_election.cc:304] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:07.121292   422 raft_consensus.cc:740] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:07.182520 30168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43838 (request call id 1999) took 1090 ms. Trace:
W20260709 13:11:07.188439 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 118801us
I20260709 13:11:07.191299 32665 raft_consensus.cc:2804] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:07.191727 32665 raft_consensus.cc:493] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.192054 32665 raft_consensus.cc:3060] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:07.192997 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:07.193539 30171 raft_consensus.cc:3060] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:07.112582   432 consensus_queue.cc:1059] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 13:11:07.127722   346 raft_consensus.cc:2804] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:11:07.195679 30701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:07.194752 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 75854.9us
I20260709 13:11:07.194707 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:07.212478   413 consensus_queue.cc:237] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:07.212893 30168 rpcz_store.cc:276] 0709 13:11:06.067795 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.067919 (+   124us) service_pool.cc:224] Handling call
0709 13:11:06.068190 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:06.961479 (+893289us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:07.158147 (+196668us) spinlock_profiling.cc:243] Waited 868 ms on lock 0x7b5400160b54. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:11:07.158333 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1997424896}
I20260709 13:11:07.202790 30068 leader_election.cc:304] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
W20260709 13:11:07.214418 30142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 66406.7us
I20260709 13:11:07.214241 30026 raft_consensus.cc:3060] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:07.216629 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:07.160130   349 raft_consensus.cc:515] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:07.221903 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 260201us
I20260709 13:11:07.220356   388 consensus_queue.cc:237] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:07.126995   419 raft_consensus.cc:2749] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:07.263892 30168 raft_consensus.cc:3060] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:07.266140 30703 leader_election.cc:304] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:07.128834 32668 raft_consensus.cc:515] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:07.266933 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 64240.8us
I20260709 13:11:07.273449 30703 leader_election.cc:304] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:07.284068 30068 leader_election.cc:304] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
W20260709 13:11:07.284332 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 69803.9us
I20260709 13:11:07.269050 30171 raft_consensus.cc:2468] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 7.
I20260709 13:11:07.123066   420 raft_consensus.cc:515] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:07.158424 32658 consensus_queue.cc:1048] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.113s
I20260709 13:11:07.286479 30171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43838 (request call id 2009) took 1025 ms. Trace:
I20260709 13:11:07.271364   346 raft_consensus.cc:697] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 7 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:07.289346   423 consensus_queue.cc:1048] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:07.291041   422 consensus_queue.cc:260] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:07.292390   422 raft_consensus.cc:3060] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:07.294991 32358 leader_election.cc:290] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:07.295336   436 raft_consensus.cc:2749] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:07.296239 30169 raft_consensus.cc:1275] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:11:07.287017   440 consensus_queue.cc:1048] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.015s
I20260709 13:11:07.302656 29994 leader_election.cc:304] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
W20260709 13:11:07.276742   407 log.cc:927] Time spent T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.082s	user 0.004s	sys 0.000s
I20260709 13:11:07.307273 30026 raft_consensus.cc:2468] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 5.
I20260709 13:11:07.308189 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:07.282660   385 raft_consensus.cc:2749] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:07.287427 30068 leader_election.cc:304] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:07.287873 30171 rpcz_store.cc:276] 0709 13:11:06.261446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:07.192748 (+931302us) service_pool.cc:224] Handling call
0709 13:11:07.286426 (+ 93678us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:07.269933   430 raft_consensus.cc:2749] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:07.326805   367 consensus_queue.cc:1048] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:07.317231 32489 raft_consensus.cc:2749] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:07.284446   433 raft_consensus.cc:515] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:07.331923 32358 consensus_queue.cc:1059] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:07.332533   433 leader_election.cc:290] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:07.332741 32358 raft_consensus.cc:3055] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:07.333137 32358 raft_consensus.cc:740] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:07.333624 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:07.334214 30171 raft_consensus.cc:2468] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 8.
I20260709 13:11:07.336128 29993 leader_election.cc:304] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:07.337138 29993 leader_election.cc:304] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:07.215641 32762 consensus_queue.cc:1048] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.073s
I20260709 13:11:07.283558 32697 raft_consensus.cc:697] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:07.289045   432 raft_consensus.cc:2749] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:07.345810 30171 raft_consensus.cc:1275] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:07.291083   420 leader_election.cc:290] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:07.343667 32717 raft_consensus.cc:2804] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:07.350159 32489 consensus_queue.cc:1048] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:07.352285 30025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52098 (request call id 529) took 1246 ms. Trace:
I20260709 13:11:07.352666 30025 rpcz_store.cc:276] 0709 13:11:06.105671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.125426 (+ 19755us) service_pool.cc:224] Handling call
0709 13:11:06.141860 (+ 16434us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:07.069162 (+927302us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:07.352042 (+282880us) spinlock_profiling.cc:243] Waited 893 ms on lock 0x7b5400107f54. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:11:07.352210 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2053184384}
I20260709 13:11:07.350244 32717 raft_consensus.cc:697] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:07.355358 30168 raft_consensus.cc:2468] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 5.
I20260709 13:11:07.346619 32358 consensus_queue.cc:260] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:07.356107 30170 raft_consensus.cc:1275] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:11:07.358127 30170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54540 (request call id 608) took 1193 ms. Trace:
I20260709 13:11:07.358510 30170 rpcz_store.cc:276] 0709 13:11:06.164778 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.167152 (+  2374us) service_pool.cc:224] Handling call
0709 13:11:06.167391 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:06.405639 (+238248us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b54002a8120. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f2031dc0 00007f99f20bc1c0 00007f99f20bd231 00007f99f20b9d8f 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c
0709 13:11:07.355878 (+950239us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b54002a8120. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f2031dc0 00007f99f20bcd87 00007f99f20bd470 00007f99f20b9d8f 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c
0709 13:11:07.357873 (+  1995us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:07.358075 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":531354624}
W20260709 13:11:07.371104 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 97725.9us
I20260709 13:11:07.372280 30703 leader_election.cc:304] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
W20260709 13:11:07.368744 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 243934us
I20260709 13:11:07.347422   433 raft_consensus.cc:2749] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:11:07.369541   401 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:11:07.377743 30022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54198 (request call id 1882) took 1870 ms. Trace:
W20260709 13:11:07.381071 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 93787.5us
I20260709 13:11:07.345952   422 consensus_queue.cc:1059] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:11:07.378597 30022 rpcz_store.cc:276] 0709 13:11:05.507454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:05.507552 (+    98us) service_pool.cc:224] Handling call
0709 13:11:05.528965 (+ 21413us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:05.572005 (+ 43040us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:11:05.631081 (+ 59076us) log.cc:844] Serialized 14 byte log entry
0709 13:11:05.762315 (+131234us) spinlock_profiling.cc:243] Waited 47.8 ms on lock 0x7b4800080058. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f6fe3aa1 00007f99f6fdab37 00007f99f6fda9ca 00007f99f70d226f 00007f99f70d1f37 00007f99f70e655c 00007f99f70e6508 00007f99f70e6488 00007f99f70e6443 00007f99f70e56ec 00007f99f600fa96
0709 13:11:06.047122 (+284807us) spinlock_profiling.cc:243] Waited 4.69 ms on lock 0x7b1800445ea0. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f7e95de1 00007f99f7ea25b1 00007f99eefcd3f3 00007f99eefcf7c1 00007f99eefcf779 00007f99eefcf709 00007f99eefcf6d1 00007f99eefce9cd 000000000038f354 000000000038f199 00007f99eefb083a
0709 13:11:06.074405 (+ 27283us) log.cc:844] Serialized 14 byte log entry
0709 13:11:06.074617 (+   212us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:06.407794 (+333177us) spinlock_profiling.cc:243] Waited 932 us on lock 0x7b1800445ea0. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f7e95de1 00007f99f7ea25b1 00007f99eefcd3f3 00007f99eefcf7c1 00007f99eefcf779 00007f99eefcf709 00007f99eefcf6d1 00007f99eefce9cd 000000000038f354 000000000038f199 00007f99eefb083a
0709 13:11:06.529990 (+122196us) spinlock_profiling.cc:243] Waited 1.78 ms on lock 0x7b1800445ea0. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f7e95de1 00007f99f7ea25b1 00007f99eef9b2a6 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f09b3a11 00007f99f09c3372 00007f99f20f5a01 00007f99f20ba43a
0709 13:11:07.130655 (+600665us) spinlock_profiling.cc:243] Waited 1.37 ms on lock 0x7b2c00000658. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f09b3a11 00007f99f09c3372 00007f99f20f5a01 00007f99f20ba43a 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2
0709 13:11:07.140454 (+  9799us) log.cc:844] Serialized 26 byte log entry
0709 13:11:07.140613 (+   159us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:07.140648 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:07.140714 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:07.377538 (+236824us) raft_consensus.cc:1685] finished
0709 13:11:07.377556 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:07.377685 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83422,"prepare.queue_time_us":108411,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":584,"raft.queue_time_us":74117,"raft.run_cpu_time_us":2157,"raft.run_wall_time_us":190427,"spinlock_wait_cycles":130181632,"thread_start_us":301576,"threads_started":1,"wal-append.queue_time_us":368500}
I20260709 13:11:07.371946 32358 raft_consensus.cc:3060] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:07.383186 30143 leader_election.cc:304] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:07.389132 30143 leader_election.cc:304] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:07.355299 32717 consensus_queue.cc:237] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:07.394536 30143 leader_election.cc:304] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:07.394814 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:07.397166 30143 leader_election.cc:304] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:07.398404 30703 leader_election.cc:304] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:07.398507 30143 leader_election.cc:304] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:07.386725   422 consensus_queue.cc:1243] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer b2cea0098c1040f69755ea4d3dab7fc4 log is divergent from this leader: its last log entry 8.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:11:07.382054   460 consensus_queue.cc:1059] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:11:07.383134   432 consensus_queue.cc:1059] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 13:11:07.374867   346 consensus_queue.cc:237] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:07.400842 30143 leader_election.cc:304] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:07.420848   454 raft_consensus.cc:2804] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:07.421288   454 raft_consensus.cc:493] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:07.421626   454 raft_consensus.cc:3060] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:07.406864 30068 leader_election.cc:304] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:07.423894 30143 leader_election.cc:304] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:07.418566 30703 leader_election.cc:304] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:07.431689 32678 raft_consensus.cc:2764] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
I20260709 13:11:07.398116   389 raft_consensus.cc:2804] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:11:07.398717   419 raft_consensus.cc:3060] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:07.444802   402 raft_consensus.cc:2804] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:07.411376   450 raft_consensus.cc:2749] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:07.411785   461 raft_consensus.cc:2749] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:07.420565 32760 raft_consensus.cc:2749] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:07.455694 32766 raft_consensus.cc:3055] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:07.456691   433 raft_consensus.cc:2764] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader election decision vote started in defunct term 6: won
I20260709 13:11:07.445742 30703 leader_election.cc:304] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:07.412654 32668 leader_election.cc:290] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:07.459849 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 59304.8us
I20260709 13:11:07.406039   353 raft_consensus.cc:2804] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:07.453415 32762 raft_consensus.cc:3055] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:07.459724   402 raft_consensus.cc:493] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:07.476292 30068 leader_election.cc:304] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:07.479240 30020 raft_consensus.cc:1240] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 LEADER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:11:07.482079 30703 leader_election.cc:304] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:07.442696   389 raft_consensus.cc:493] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:07.482625 30068 leader_election.cc:304] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:07.412240 32665 raft_consensus.cc:515] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:07.397317 32697 consensus_queue.cc:237] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:07.501159 30068 leader_election.cc:304] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:07.473649 32766 raft_consensus.cc:740] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:07.477797 32762 raft_consensus.cc:740] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:07.479071   353 raft_consensus.cc:493] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:07.486125   461 raft_consensus.cc:2749] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:07.481698   402 raft_consensus.cc:3060] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:07.485941   432 raft_consensus.cc:2804] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:07.527612 30700 leader_election.cc:304] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:07.486065   460 consensus_queue.cc:1048] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.043s
I20260709 13:11:07.532975   454 raft_consensus.cc:515] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:07.493863   430 raft_consensus.cc:2749] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:07.486995   389 raft_consensus.cc:3060] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:07.499920   358 raft_consensus.cc:2749] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:07.522982 32690 raft_consensus.cc:2764] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 13:11:07.558466 30700 leader_election.cc:304] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:07.560729 32753 leader_election.cc:290] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:07.558068   432 raft_consensus.cc:493] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:07.523916   433 raft_consensus.cc:2749] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:07.567340 30028 raft_consensus.cc:1240] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
W20260709 13:11:07.589677 30069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:07.565384 32760 raft_consensus.cc:2804] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:07.579077 32665 leader_election.cc:290] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:07.579900 30730 raft_consensus.cc:1240] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 LEADER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:07.585389 29994 leader_election.cc:304] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
W20260709 13:11:07.586333 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 104313us
I20260709 13:11:07.582118 30068 leader_election.cc:304] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:07.556864   423 raft_consensus.cc:493] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:07.590687 30069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:07.591202 30700 leader_election.cc:304] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
W20260709 13:11:07.589571 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 165752us
I20260709 13:11:07.528156   353 raft_consensus.cc:3060] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:07.593093 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:07.593979 32762 consensus_queue.cc:260] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:07.595836   454 leader_election.cc:290] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:07.588323 32666 consensus_queue.cc:1048] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260709 13:11:07.629123 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:07.629719 30096 raft_consensus.cc:3060] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:07.590019   432 raft_consensus.cc:3060] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:07.631745 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:07.591763   449 raft_consensus.cc:2804] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:07.647114   462 consensus_queue.cc:1059] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.217s
I20260709 13:11:07.648754 32573 raft_consensus.cc:493] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:07.649197 32573 raft_consensus.cc:3060] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:07.626802   352 raft_consensus.cc:2749] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:07.651191 32746 raft_consensus.cc:3055] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:07.651551 32746 raft_consensus.cc:740] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:07.652190 32746 consensus_queue.cc:260] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:07.653075 32746 raft_consensus.cc:3060] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:07.654848   419 raft_consensus.cc:2749] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:07.657021 32766 consensus_queue.cc:260] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:07.621618 30095 raft_consensus.cc:1275] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:11:07.622110 30097 raft_consensus.cc:1275] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 13:11:07.621840 30094 raft_consensus.cc:1275] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:07.621271   461 raft_consensus.cc:2749] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:11:07.641522 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 50393.8us
I20260709 13:11:07.644392 30143 leader_election.cc:304] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:07.628265 30731 raft_consensus.cc:3060] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:07.658164   385 raft_consensus.cc:2804] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:07.621272 30703 leader_election.cc:400] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Vote denied by peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821) with higher term. Message: Invalid argument: T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 4. Current term is 5.
W20260709 13:11:07.667313 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 55170.5us
I20260709 13:11:07.612025 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:07.622228 29994 leader_election.cc:304] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
W20260709 13:11:07.664852   464 log.cc:927] Time spent T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
W20260709 13:11:07.665266 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 138185us
I20260709 13:11:07.665907 32762 raft_consensus.cc:3060] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:07.625494   423 raft_consensus.cc:515] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:07.673776 30731 raft_consensus.cc:2468] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 7.
W20260709 13:11:07.674220 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 52082.5us
I20260709 13:11:07.674829 30168 raft_consensus.cc:1275] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:07.701004 29994 leader_election.cc:304] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:07.701908   385 raft_consensus.cc:697] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:07.673857 30171 raft_consensus.cc:3060] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Advancing to term 6
W20260709 13:11:07.692513 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 48186us
I20260709 13:11:07.674871 30096 raft_consensus.cc:2468] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 8.
I20260709 13:11:07.696985 30703 leader_election.cc:304] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:07.699821 30142 leader_election.cc:304] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:07.695130 32766 raft_consensus.cc:3060] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:07.721794   402 raft_consensus.cc:515] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:07.694941 32504 raft_consensus.cc:2749] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:07.704528 30143 leader_election.cc:304] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:07.705082 30068 leader_election.cc:304] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:07.705370 32589 consensus_queue.cc:1048] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:07.661033   476 raft_consensus.cc:2804] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:07.674397 32760 raft_consensus.cc:697] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:07.714469   419 raft_consensus.cc:2804] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 13:11:07.751271 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 46812.9us
I20260709 13:11:07.696148   349 leader_election.cc:290] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:07.719862   432 raft_consensus.cc:515] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:07.730104 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:07.724215 30172 raft_consensus.cc:1240] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:07.718940   423 leader_election.cc:290] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:07.753695 30143 leader_election.cc:304] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:07.755376 30143 leader_election.cc:304] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:07.701880   339 consensus_queue.cc:1059] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260709 13:11:07.759231 30171 raft_consensus.cc:2468] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 6.
I20260709 13:11:07.761771 30176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43838 (request call id 1998) took 1694 ms. Trace:
I20260709 13:11:07.762189 30176 rpcz_store.cc:276] 0709 13:11:06.066973 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.067108 (+   135us) service_pool.cc:224] Handling call
0709 13:11:06.076719 (+  9611us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:06.826306 (+749587us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:07.761480 (+935174us) spinlock_profiling.cc:243] Waited 730 ms on lock 0x7b54002b4154. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:11:07.761693 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1679024000}
I20260709 13:11:07.723986   402 leader_election.cc:290] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:07.738955   369 raft_consensus.cc:2804] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:07.702843 32666 consensus_queue.cc:1048] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.051s
I20260709 13:11:07.763401 30702 leader_election.cc:304] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:07.740017   476 raft_consensus.cc:493] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
W20260709 13:11:07.831218 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 75902.9us
W20260709 13:11:07.838683 30066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:07.769942 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 73017.6us
I20260709 13:11:07.755995   413 raft_consensus.cc:2749] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:07.761317   408 raft_consensus.cc:2749] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:07.764745   457 raft_consensus.cc:2749] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:08.059581 32665 raft_consensus.cc:2804] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:07.765738   423 raft_consensus.cc:2749] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:08.060782 30703 leader_election.cc:304] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:11:07.836647   451 log.cc:927] Time spent T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.073s	user 0.004s	sys 0.000s
I20260709 13:11:07.761307 32358 raft_consensus.cc:493] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:07.795050   419 raft_consensus.cc:697] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 7 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:07.764423   454 raft_consensus.cc:2749] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:07.926559 30143 leader_election.cc:304] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:07.708174   385 consensus_queue.cc:237] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:07.968394 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 268840us
I20260709 13:11:07.959661 32760 consensus_queue.cc:237] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:07.766513   346 raft_consensus.cc:2749] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:08.065253   353 raft_consensus.cc:515] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:08.118187   353 leader_election.cc:290] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:07.858187   476 raft_consensus.cc:3060] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:08.118744   358 raft_consensus.cc:2749] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:08.066354   389 raft_consensus.cc:515] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:08.068840   420 raft_consensus.cc:3055] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:11:08.058444 30069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:08.125783 30069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.062023 32573 raft_consensus.cc:515] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:08.071700   432 leader_election.cc:290] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:11:08.075675   477 log.cc:927] Time spent T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.141s	user 0.000s	sys 0.005s
I20260709 13:11:08.081807   461 raft_consensus.cc:3055] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:11:08.058796   481 log.cc:927] Time spent T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.228s	user 0.010s	sys 0.000s
I20260709 13:11:08.109061 32665 raft_consensus.cc:697] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:08.113730 32504 consensus_queue.cc:1059] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
W20260709 13:11:08.115275 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 283252us
W20260709 13:11:08.163161 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 397609us
I20260709 13:11:08.163658 30143 leader_election.cc:304] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:08.114908   408 raft_consensus.cc:493] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.115037 30068 leader_election.cc:304] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:08.116328 30023 raft_consensus.cc:1240] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:08.116004 30019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52098 (request call id 535) took 1358 ms. Trace:
W20260709 13:11:08.128696 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 67983.3us
I20260709 13:11:08.109015   457 raft_consensus.cc:2749] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:08.169229   419 consensus_queue.cc:237] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:08.101413 32697 consensus_queue.cc:1048] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 13:11:08.130357   339 raft_consensus.cc:493] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:08.171147   339 raft_consensus.cc:515] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:08.173264   339 leader_election.cc:290] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:08.154381 32665 consensus_queue.cc:237] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:08.134388   461 raft_consensus.cc:740] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:08.107301 32358 raft_consensus.cc:515] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:08.157472 32573 leader_election.cc:290] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:08.160512   432 raft_consensus.cc:493] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:08.161602 30069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.164722   346 raft_consensus.cc:2749] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:08.107021   349 consensus_queue.cc:1059] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 13:11:08.124264   420 raft_consensus.cc:740] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:08.166106 30019 rpcz_store.cc:276] 0709 13:11:06.758016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.758216 (+   200us) service_pool.cc:224] Handling call
0709 13:11:06.789049 (+ 30833us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:06.791586 (+  2537us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:06.791644 (+    58us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:07.723391 (+931747us) spinlock_profiling.cc:243] Waited 4.61 ms on lock 0x7b2c00000658. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f09b3a11 00007f99f09c3372 00007f99f20f5a01 00007f99f20ba43a 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2
0709 13:11:07.723745 (+   354us) log.cc:844] Serialized 26 byte log entry
0709 13:11:07.968259 (+244514us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:07.968295 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:07.968368 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:08.115696 (+147328us) raft_consensus.cc:1685] finished
0709 13:11:08.115717 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:08.115942 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15252,"raft.queue_time_us":2126,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":11125,"spinlock_wait_cycles":10613120,"thread_start_us":244216,"threads_started":1,"wal-append.queue_time_us":357697}
I20260709 13:11:08.169700 30703 leader_election.cc:400] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 election: Vote denied by peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821) with higher term. Message: Invalid argument: T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 4. Current term is 5.
I20260709 13:11:08.181525 30731 raft_consensus.cc:1275] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:11:08.179282 29994 leader_election.cc:304] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:08.185424 30728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51014 (request call id 850) took 1874 ms. Trace:
I20260709 13:11:08.185806 30728 rpcz_store.cc:276] 0709 13:11:06.310745 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.311255 (+   510us) service_pool.cc:224] Handling call
0709 13:11:06.311544 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:06.886400 (+574856us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:06.886437 (+    37us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:06.886496 (+    59us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:06.886543 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:08.185221 (+1298678us) spinlock_profiling.cc:243] Waited 567 ms on lock 0x7b5400740254. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:11:08.185265 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:08.185374 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1303232384}
W20260709 13:11:08.188463 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 82524.4us
W20260709 13:11:08.201484 30069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.246976 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:08.179270 32501 raft_consensus.cc:3055] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:11:08.275048 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 108199us
I20260709 13:11:08.185245 32762 raft_consensus.cc:2749] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:11:08.276371 30143 leader_election.cc:304] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:11:08.276836 30066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.179677 32697 consensus_queue.cc:1048] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:11:08.178471   408 raft_consensus.cc:515] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:08.279214 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 168660us
I20260709 13:11:08.184098 32504 consensus_queue.cc:1048] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.093s
I20260709 13:11:08.282255 30068 leader_election.cc:304] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:11:08.282647 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 113079us
I20260709 13:11:08.226747 32489 raft_consensus.cc:2804] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:08.184391   432 raft_consensus.cc:515] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:08.275941 32501 raft_consensus.cc:740] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
W20260709 13:11:08.296983 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 106844us
I20260709 13:11:08.297233 30068 leader_election.cc:304] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:08.284487 32666 raft_consensus.cc:493] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:08.288110 32685 raft_consensus.cc:493] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:08.289362 32766 raft_consensus.cc:2804] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:08.292716   393 raft_consensus.cc:2749] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:08.305433 30143 leader_election.cc:304] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:08.307745 30729 raft_consensus.cc:1275] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 13:11:08.311035 30729 pending_rounds.cc:85] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a: Aborting all ops after (but not including) 5
I20260709 13:11:08.311288 30729 pending_rounds.cc:107] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 13:11:08.311501 30729 raft_consensus.cc:2889] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:08.320190   423 raft_consensus.cc:2749] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:08.320622 30728 raft_consensus.cc:1240] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:08.322048 32358 leader_election.cc:290] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:08.309100 32666 raft_consensus.cc:515] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:08.325863   492 raft_consensus.cc:2749] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:08.326327 32666 leader_election.cc:290] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:08.327086 30068 leader_election.cc:304] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:08.327801   423 raft_consensus.cc:2749] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:08.329099 30068 leader_election.cc:304] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:08.329782   423 raft_consensus.cc:2749] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:08.310277 32766 raft_consensus.cc:493] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:08.331089 32766 raft_consensus.cc:3060] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:08.331157   476 raft_consensus.cc:515] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:08.333164   476 leader_election.cc:290] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:08.318082 32685 raft_consensus.cc:515] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:08.335618 32685 leader_election.cc:290] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:08.295996   420 consensus_queue.cc:260] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:08.279095   461 consensus_queue.cc:260] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:08.336663   420 raft_consensus.cc:3060] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:11:08.336867   461 raft_consensus.cc:3060] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:08.339491 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:08.296223 32489 raft_consensus.cc:697] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:08.342567 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:08.343263 30170 raft_consensus.cc:3060] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:08.360545 30733 raft_consensus.cc:1275] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:08.354403 30068 leader_election.cc:304] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:08.357703 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:08.360209 30170 raft_consensus.cc:2468] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 7.
W20260709 13:11:08.370165 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 50274.8us
I20260709 13:11:08.335549   432 leader_election.cc:290] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:08.371570 30177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54540 (request call id 607) took 2207 ms. Trace:
I20260709 13:11:08.375145 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:08.372817 29993 leader_election.cc:304] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:08.372723 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:08.245184   369 raft_consensus.cc:697] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:08.327946   408 leader_election.cc:290] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:08.373819 30068 leader_election.cc:304] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:08.374462 30177 rpcz_store.cc:276] 0709 13:11:06.164480 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.165251 (+   771us) service_pool.cc:224] Handling call
0709 13:11:06.165533 (+   282us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:06.764912 (+599379us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:08.365348 (+1600436us) spinlock_profiling.cc:243] Waited 460 ms on lock 0x7b54004079d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:11:08.371509 (+  6161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1057735936}
I20260709 13:11:08.383035 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:11:08.386919 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 89285.5us
I20260709 13:11:08.390661   432 raft_consensus.cc:2749] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 13:11:08.394467 30068 leader_election.cc:304] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:08.396199 30102 raft_consensus.cc:1240] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:08.396427 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:08.396780 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:08.396991 30101 raft_consensus.cc:3060] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:08.397293 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:08.397328 30100 raft_consensus.cc:3060] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:08.397851 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:08.398885 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:08.397887 30095 raft_consensus.cc:2468] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 5.
I20260709 13:11:08.400053 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:08.400409 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:08.400592 30099 raft_consensus.cc:3060] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:08.400916 30095 raft_consensus.cc:3060] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:08.399497 30102 raft_consensus.cc:2468] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 3.
I20260709 13:11:08.404881 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:08.406479 30733 raft_consensus.cc:1275] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:11:08.404954 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:08.407442 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:08.407516 30102 raft_consensus.cc:2468] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 9.
I20260709 13:11:08.408454 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:08.408969 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:08.408984 30102 raft_consensus.cc:3060] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:08.409327 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
W20260709 13:11:08.381635   488 log.cc:927] Time spent T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 13:11:08.373445   476 raft_consensus.cc:2749] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:08.411233 30171 raft_consensus.cc:1240] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:11:08.413079 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:08.413617 30171 raft_consensus.cc:2468] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 7.
I20260709 13:11:08.414368 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:08.414418 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:08.411506 30097 raft_consensus.cc:2393] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 7: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:08.417315 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:08.417929 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:08.419198 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:08.419346 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:08.419929 30168 raft_consensus.cc:2393] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 5: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:11:08.420393 30068 leader_election.cc:304] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:08.421538 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:08.422013 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:08.422649 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:08.423077 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:08.423606 30096 raft_consensus.cc:2468] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 5.
I20260709 13:11:08.424384 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:08.424770 30176 raft_consensus.cc:1240] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 6. Current term is 7. Ops: [5.5-6.6]
I20260709 13:11:08.424966 30096 raft_consensus.cc:2393] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 5: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:08.410480   423 raft_consensus.cc:2749] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:08.344095 32501 consensus_queue.cc:260] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:08.425784 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:08.446650   369 consensus_queue.cc:237] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:08.447404 30176 raft_consensus.cc:1240] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 2. Current term is 3. Ops: []
I20260709 13:11:08.447921 32766 raft_consensus.cc:515] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:08.449415 30176 raft_consensus.cc:1240] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:08.426769   495 consensus_queue.cc:1048] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:11:08.449903 32489 consensus_queue.cc:237] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:08.452610 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:08.427891 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:08.461635 30097 raft_consensus.cc:2393] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 7: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
W20260709 13:11:08.400328   489 log.cc:927] Time spent T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 13:11:08.379398   492 raft_consensus.cc:493] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:08.462473 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:08.463097 30097 raft_consensus.cc:3060] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:08.463299 30735 raft_consensus.cc:1275] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:08.389869   497 raft_consensus.cc:2804] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:08.464238   497 raft_consensus.cc:697] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:08.465090   497 consensus_queue.cc:237] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:08.431536 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:08.466284 30171 raft_consensus.cc:2393] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 7: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:11:08.466907   398 raft_consensus.cc:3060] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:08.431700 30095 raft_consensus.cc:2468] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 7.
I20260709 13:11:08.467865 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:08.468046 30176 raft_consensus.cc:1240] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 6 LEADER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 13:11:08.468705   494 log.cc:927] Time spent T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260709 13:11:08.468860 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:08.469431 30095 raft_consensus.cc:2468] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 5.
I20260709 13:11:08.469856   492 raft_consensus.cc:515] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:08.460126 30729 raft_consensus.cc:2410] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260709 13:11:08.430531 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:08.472416   404 raft_consensus.cc:3055] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:08.472754   404 raft_consensus.cc:740] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:08.431986   462 raft_consensus.cc:2749] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:11:08.473835 32697 consensus_queue.cc:1175] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" responder_term: 6 status { last_received { term: 6 index: 7 } last_committed_idx: 7 last_received_current_leader { term: 6 index: 7 } }
I20260709 13:11:08.474148 30736 raft_consensus.cc:2410] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:11:08.470165 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:08.475032 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:08.475371 30095 raft_consensus.cc:1240] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:08.475543 30103 raft_consensus.cc:3060] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:08.476182 30172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54540 (request call id 626) took 1092 ms. Trace:
I20260709 13:11:08.476511 30172 rpcz_store.cc:276] 0709 13:11:07.384123 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:07.451745 (+ 67622us) service_pool.cc:224] Handling call
0709 13:11:07.452053 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:07.752921 (+300868us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:08.475986 (+723065us) spinlock_profiling.cc:243] Waited 272 ms on lock 0x7b5400407ed4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:11:08.476130 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":625523584}
I20260709 13:11:08.477186 30021 raft_consensus.cc:2468] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 7.
I20260709 13:11:08.478139 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:08.455379 32666 consensus_queue.cc:1059] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:08.479197 30021 raft_consensus.cc:1240] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 LEADER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:08.479390 32666 raft_consensus.cc:3055] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:11:08.479773 32666 raft_consensus.cc:740] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:08.480504 32666 consensus_queue.cc:260] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:08.481647 30095 raft_consensus.cc:1240] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:08.481933 32666 raft_consensus.cc:3060] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:11:08.474933 30099 raft_consensus.cc:2468] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 7.
I20260709 13:11:08.482810 30095 raft_consensus.cc:1240] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:08.489215 30103 raft_consensus.cc:2468] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 3.
I20260709 13:11:08.490096 30101 raft_consensus.cc:2468] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 6.
I20260709 13:11:08.491195 30101 raft_consensus.cc:1240] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:08.492054 30102 raft_consensus.cc:2468] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 7.
I20260709 13:11:08.433249 29993 leader_election.cc:304] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:08.519665 30101 raft_consensus.cc:1240] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 6. Current term is 7. Ops: [6.7-6.7]
W20260709 13:11:08.520069 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 86892.8us
I20260709 13:11:08.433933 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:08.520778 30097 raft_consensus.cc:2468] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 6.
I20260709 13:11:08.521243 30094 raft_consensus.cc:3060] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:08.434003 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:08.438740 29994 leader_election.cc:304] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:08.438512 30177 raft_consensus.cc:1240] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:08.425746 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:08.522462 30096 raft_consensus.cc:3060] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:08.426174 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:08.523518 30728 raft_consensus.cc:2468] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 5.
I20260709 13:11:08.461858 32766 leader_election.cc:290] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:08.434092 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
W20260709 13:11:08.524403 30069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.433739 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:08.527225 30171 raft_consensus.cc:1275] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:11:08.435830 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:08.432521 30068 leader_election.cc:304] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
W20260709 13:11:08.443172 30140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.528127 30026 raft_consensus.cc:2468] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 7.
W20260709 13:11:08.528440 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 95990.9us
I20260709 13:11:08.439569 30100 raft_consensus.cc:2468] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 9.
I20260709 13:11:08.529138 30068 leader_election.cc:304] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:08.433416 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:08.436491 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:08.530311 30024 raft_consensus.cc:2393] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 5: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:11:08.472309 32501 raft_consensus.cc:3060] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:08.514007 30736 raft_consensus.cc:1275] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:08.435667   408 consensus_queue.cc:1048] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.081s
I20260709 13:11:08.431330 30020 raft_consensus.cc:1240] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:08.485205 32678 consensus_queue.cc:1059] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:11:08.433137 32358 consensus_queue.cc:1048] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.098s
I20260709 13:11:08.510854   449 raft_consensus.cc:493] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:08.581203   449 raft_consensus.cc:3060] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:08.581672   457 raft_consensus.cc:3055] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:08.582099   457 raft_consensus.cc:740] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:08.582921   457 consensus_queue.cc:260] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:08.584221   457 raft_consensus.cc:3060] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:08.585840 30101 raft_consensus.cc:1275] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:11:08.586194 30101 pending_rounds.cc:85] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719: Aborting all ops after (but not including) 3
I20260709 13:11:08.586406 30101 pending_rounds.cc:107] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719: Aborting uncommitted NO_OP operation due to leader change: 4.4
W20260709 13:11:08.586575   506 log.cc:927] Time spent T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:11:08.586624 30101 raft_consensus.cc:2889] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:08.582858   389 leader_election.cc:290] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:08.588605 30098 raft_consensus.cc:1240] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 6. Current term is 7. Ops: []
W20260709 13:11:08.589655 30067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.546597   492 leader_election.cc:290] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:08.547670 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:08.552417 30174 raft_consensus.cc:1275] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:08.433710   346 consensus_queue.cc:1059] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.119s
I20260709 13:11:08.434027   439 consensus_queue.cc:1048] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.119s
W20260709 13:11:08.553650 30143 leader_election.cc:336] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Timed out: RequestConsensusVote RPC to 127.28.54.66:43821 timed out after 1.688s (SENT)
I20260709 13:11:08.608204 30143 leader_election.cc:304] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:08.555565   367 consensus_queue.cc:1048] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:11:08.556434 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 117761us
I20260709 13:11:08.556806   490 raft_consensus.cc:2804] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:08.556118 30096 raft_consensus.cc:2468] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 6.
W20260709 13:11:08.568732 30066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.572085   402 raft_consensus.cc:3055] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:08.603127 30100 raft_consensus.cc:1275] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260709 13:11:08.666337 30100 pending_rounds.cc:85] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719: Aborting all ops after (but not including) 4
I20260709 13:11:08.666639 30100 pending_rounds.cc:107] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260709 13:11:08.666847 30100 raft_consensus.cc:2889] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:08.603776 30728 raft_consensus.cc:2468] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 9.
I20260709 13:11:08.509205 32753 consensus_queue.cc:1048] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260709 13:11:08.616312 30025 raft_consensus.cc:1240] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:08.617403 30140 leader_election.cc:304] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:11:08.618945 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 65328.2us
I20260709 13:11:08.616503 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:08.585944 32579 raft_consensus.cc:2749] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:11:08.680701 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 63370.4us
I20260709 13:11:08.669402 30142 leader_election.cc:304] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:08.675231 30066 leader_election.cc:304] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:08.675818 30024 raft_consensus.cc:2393] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 9: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:11:08.602948   423 raft_consensus.cc:2749] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:08.517202   385 consensus_queue.cc:1059] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.094s
I20260709 13:11:08.687937 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
W20260709 13:11:08.690623 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 63528.7us
I20260709 13:11:08.604421   349 raft_consensus.cc:493] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.604174   432 raft_consensus.cc:2749] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:08.664935   490 raft_consensus.cc:493] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:08.666373   353 raft_consensus.cc:2749] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:08.675817   402 raft_consensus.cc:740] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:08.691920   398 raft_consensus.cc:2749] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:08.687844 32658 raft_consensus.cc:2804] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:08.691303   462 raft_consensus.cc:2804] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:08.608848   493 consensus_queue.cc:1048] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.091s
I20260709 13:11:08.714541 30094 raft_consensus.cc:2468] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 6.
I20260709 13:11:08.698094   461 raft_consensus.cc:3055] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:08.685567   476 consensus_queue.cc:1059] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 13:11:08.702795   490 raft_consensus.cc:3060] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:08.691179   492 consensus_queue.cc:1059] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260709 13:11:08.715910   462 raft_consensus.cc:493] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:08.717895   385 raft_consensus.cc:493] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.715221 32658 raft_consensus.cc:493] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:08.703502   384 consensus_queue.cc:1059] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 13:11:08.696518   349 raft_consensus.cc:515] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:08.726056   461 raft_consensus.cc:740] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:08.737226   476 consensus_queue.cc:1243] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer b2cea0098c1040f69755ea4d3dab7fc4 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:11:08.736727   462 raft_consensus.cc:3060] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:08.733366 30728 raft_consensus.cc:1275] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:08.761361 30168 raft_consensus.cc:1240] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:11:08.739048 32658 raft_consensus.cc:3060] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:08.741890   385 raft_consensus.cc:515] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:08.762702 30175 raft_consensus.cc:1275] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:11:08.765947   449 raft_consensus.cc:515] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:08.773471   432 raft_consensus.cc:3055] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:08.780440 30174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54540 (request call id 609) took 2615 ms. Trace:
I20260709 13:11:08.783179 30174 rpcz_store.cc:276] 0709 13:11:06.165050 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.166371 (+  1321us) service_pool.cc:224] Handling call
0709 13:11:06.166619 (+   248us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:08.604244 (+2437625us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:08.780245 (+176001us) spinlock_profiling.cc:243] Waited 2.39 s on lock 0x7b540011eed4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:11:08.780392 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5486149888}
W20260709 13:11:08.786947 30702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:08.786182 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 256848us
I20260709 13:11:08.788897 30068 leader_election.cc:304] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:08.789556   476 raft_consensus.cc:2749] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:08.786118   501 consensus_queue.cc:1059] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.106s
I20260709 13:11:08.792661   501 raft_consensus.cc:3055] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:08.792996   501 raft_consensus.cc:740] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:08.793725   501 consensus_queue.cc:260] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:08.795064   501 raft_consensus.cc:3060] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:08.794064 30068 leader_election.cc:304] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:08.797906   476 raft_consensus.cc:2749] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:11:08.798319   443 log.cc:927] Time spent T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 1.516s	user 0.024s	sys 0.031s
I20260709 13:11:08.800386 30173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43838 (request call id 2014) took 2537 ms. Trace:
I20260709 13:11:08.800746 30173 rpcz_store.cc:276] 0709 13:11:06.263107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:06.961816 (+698709us) service_pool.cc:224] Handling call
0709 13:11:06.962080 (+   264us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:06.996519 (+ 34439us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:06.996548 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:07.003000 (+  6452us) log.cc:844] Serialized 52 byte log entry
0709 13:11:07.118124 (+115124us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:07.139882 (+ 21758us) log.cc:844] Serialized 14 byte log entry
0709 13:11:07.154602 (+ 14720us) log.cc:844] Serialized 14 byte log entry
0709 13:11:07.154774 (+   172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:07.154840 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:08.732963 (+1578123us) spinlock_profiling.cc:243] Waited 2.26 ms on lock 0x7b4400022b4c. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eeef3c85 00007f99eeef46a2 00007f99f1c661db 00007f99f1c61aaf 00007f99f1c5586e 00007f99f1c54bb6 00007f99f1c547d8 00007f99f1c5e221 00007f99f1c5e1d9 00007f99f1c5e169
0709 13:11:08.800182 (+ 67219us) raft_consensus.cc:1685] finished
0709 13:11:08.800205 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:08.800331 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":18224,"prepare.queue_time_us":50743,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":61,"raft.queue_time_us":73700,"raft.run_cpu_time_us":327,"raft.run_wall_time_us":51246,"spinlock_wait_cycles":5215232,"thread_start_us":89579,"threads_started":1,"wal-append.queue_time_us":184032}
I20260709 13:11:08.787322   461 consensus_queue.cc:260] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:08.789654   385 leader_election.cc:290] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:08.806767 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:08.801625   462 raft_consensus.cc:515] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:08.798290 30068 leader_election.cc:304] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:08.811578   476 raft_consensus.cc:2749] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:08.812769 30068 leader_election.cc:304] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:08.783115   432 raft_consensus.cc:740] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:08.813907   432 consensus_queue.cc:260] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:08.814282   449 leader_election.cc:290] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:08.787770   453 consensus_queue.cc:1059] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.122s
I20260709 13:11:08.814203   462 leader_election.cc:290] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:08.815882   453 raft_consensus.cc:3055] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:08.816241   453 raft_consensus.cc:740] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:08.817076   453 consensus_queue.cc:260] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:08.815069   432 raft_consensus.cc:3060] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:08.824746 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 133446us
I20260709 13:11:08.822868 30068 leader_election.cc:304] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:08.827927 30173 raft_consensus.cc:1275] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 13:11:08.835153 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 141315us
I20260709 13:11:08.843039 30019 raft_consensus.cc:2468] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 7.
I20260709 13:11:08.851680 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:08.855365 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:08.862248   501 consensus_queue.cc:1048] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:08.864773   497 consensus_queue.cc:1048] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:08.824019   462 raft_consensus.cc:2749] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:08.851276   476 raft_consensus.cc:2749] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:11:08.872459 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 197429us
W20260709 13:11:08.873370 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 250884us
I20260709 13:11:08.859069   449 raft_consensus.cc:493] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:08.859244 32501 raft_consensus.cc:493] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.866235   453 raft_consensus.cc:3060] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:08.884254 30068 leader_election.cc:304] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:08.884646 30098 raft_consensus.cc:1275] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 4. (term mismatch)
I20260709 13:11:08.885030 30098 pending_rounds.cc:85] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719: Aborting all ops after (but not including) 3
I20260709 13:11:08.885249 30098 pending_rounds.cc:107] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:11:08.885459 30098 raft_consensus.cc:2889] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:08.888702 30024 raft_consensus.cc:1240] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:08.889647 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:08.890203 30025 raft_consensus.cc:3060] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:08.898537 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:08.899199 30176 raft_consensus.cc:3060] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:08.902815 30703 leader_election.cc:304] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:08.904417   449 raft_consensus.cc:515] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:08.911801   449 leader_election.cc:290] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:08.912281 32666 consensus_queue.cc:1059] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:08.913161 30176 raft_consensus.cc:2468] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 8.
I20260709 13:11:08.913848   339 raft_consensus.cc:3060] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:08.901371 32501 raft_consensus.cc:515] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:08.915705 32501 leader_election.cc:290] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:08.905874 30068 leader_election.cc:304] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:08.918195 30068 leader_election.cc:304] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:08.919269 30068 leader_election.cc:304] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:08.920087 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:08.921033   515 raft_consensus.cc:2749] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:11:08.922008 30701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.926168   454 consensus_queue.cc:1048] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:08.927598 30068 leader_election.cc:304] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:11:08.927842   508 log.cc:927] Time spent T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.191s	user 0.002s	sys 0.000s
I20260709 13:11:08.921917 30143 leader_election.cc:304] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:08.929948 30143 leader_election.cc:304] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:08.931160 30143 leader_election.cc:304] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
W20260709 13:11:08.990969 30140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:08.997573 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:09.014497 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:08.909226 32766 raft_consensus.cc:2749] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:08.928388   423 raft_consensus.cc:493] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:08.942080   515 raft_consensus.cc:2804] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:08.986289   495 raft_consensus.cc:2804] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:08.986773   474 raft_consensus.cc:2749] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:08.909447   476 consensus_queue.cc:1059] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.114s
I20260709 13:11:08.992643 32665 raft_consensus.cc:493] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.037925 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:08.906175   490 raft_consensus.cc:515] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:08.992599 32719 raft_consensus.cc:493] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:09.039924 30094 raft_consensus.cc:2468] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 6.
I20260709 13:11:09.045557 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
W20260709 13:11:09.054155 30702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:09.035354   495 raft_consensus.cc:493] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:09.046674 30095 raft_consensus.cc:2468] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 4.
I20260709 13:11:09.097819 30025 raft_consensus.cc:2468] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 8.
I20260709 13:11:09.068193 30176 raft_consensus.cc:1275] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:09.081677 30020 raft_consensus.cc:1240] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:09.040853   493 raft_consensus.cc:2804] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:09.092730   490 leader_election.cc:290] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:09.028857 32358 consensus_queue.cc:1048] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260709 13:11:09.040686 32766 raft_consensus.cc:2749] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:09.035411   423 raft_consensus.cc:515] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:09.096396   439 raft_consensus.cc:493] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:09.108955   495 raft_consensus.cc:3060] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:09.064459   474 consensus_queue.cc:1059] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260709 13:11:09.042397 32665 raft_consensus.cc:515] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:09.043215 32658 raft_consensus.cc:515] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:09.064152 32719 raft_consensus.cc:515] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:09.173471 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 136732us
I20260709 13:11:09.176537 30140 leader_election.cc:304] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:09.139940   493 raft_consensus.cc:697] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 7 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:09.168783   420 raft_consensus.cc:2749] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:11:09.185549 30067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:09.178298 29994 leader_election.cc:304] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
W20260709 13:11:09.182555   525 log.cc:927] Time spent T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:11:09.206368 32719 leader_election.cc:290] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:09.207955 32665 leader_election.cc:290] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:09.210904   419 raft_consensus.cc:2804] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:09.211150 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:09.212214   453 raft_consensus.cc:2804] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:09.212621   453 raft_consensus.cc:493] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.212992   453 raft_consensus.cc:3060] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:09.170512   439 raft_consensus.cc:515] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:09.217646   419 raft_consensus.cc:697] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 7 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:09.218564   419 consensus_queue.cc:237] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:09.219859   453 raft_consensus.cc:515] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:09.222332 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 44108.1us
I20260709 13:11:09.222980 29994 leader_election.cc:304] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:09.224038   501 raft_consensus.cc:2804] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:09.224380   501 raft_consensus.cc:493] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:09.224718   501 raft_consensus.cc:3060] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:09.230877 32658 leader_election.cc:290] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:09.231428 32658 raft_consensus.cc:493] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:09.231292   501 raft_consensus.cc:515] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:09.233275   501 leader_election.cc:290] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:09.234951 30066 leader_election.cc:304] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:09.235788 32762 raft_consensus.cc:2804] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:09.236276 32762 raft_consensus.cc:697] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 8 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
W20260709 13:11:09.199033   445 log.cc:927] Time spent T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 1.852s	user 0.000s	sys 0.021s
I20260709 13:11:09.237084 32762 consensus_queue.cc:237] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:09.239452   339 raft_consensus.cc:2749] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:09.242204   493 consensus_queue.cc:237] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:09.252203   439 leader_election.cc:290] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:09.233500   476 raft_consensus.cc:3055] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:09.253845   476 raft_consensus.cc:740] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:09.254702   476 consensus_queue.cc:260] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:09.255911   476 raft_consensus.cc:3060] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:09.256400   501 raft_consensus.cc:493] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.233373   423 leader_election.cc:290] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:09.269513 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:09.271446 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:09.271966 30094 raft_consensus.cc:3060] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:09.272580 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:09.273113 30096 raft_consensus.cc:3060] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:09.273138 30025 raft_consensus.cc:1275] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:09.276991 30098 raft_consensus.cc:1275] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:11:09.278923 30022 raft_consensus.cc:1240] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:09.279564 30024 raft_consensus.cc:1275] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:09.294499 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:09.296418 30096 raft_consensus.cc:2468] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 5.
I20260709 13:11:09.296797 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:09.297359 30103 raft_consensus.cc:3060] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:09.231941 32658 raft_consensus.cc:515] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:09.309690 30094 raft_consensus.cc:2468] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 7.
I20260709 13:11:09.256979   501 raft_consensus.cc:515] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:09.293605 32753 consensus_queue.cc:1048] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 13:11:09.293655 32697 consensus_queue.cc:1048] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 13:11:09.331046 30019 raft_consensus.cc:2393] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 9: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:11:09.331305 29993 leader_election.cc:304] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:09.336215 30103 raft_consensus.cc:2468] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 10.
W20260709 13:11:09.334048 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 402938us
I20260709 13:11:09.338587 30143 leader_election.cc:304] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
W20260709 13:11:09.333202 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 405684us
I20260709 13:11:09.345037   492 raft_consensus.cc:2804] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:09.345573   492 raft_consensus.cc:697] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 7 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:09.346767   492 consensus_queue.cc:237] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:09.264997   402 consensus_queue.cc:260] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:09.353595 30103 raft_consensus.cc:1240] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:09.356307 30102 raft_consensus.cc:1275] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:09.358412 30143 leader_election.cc:304] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:09.389400 30143 leader_election.cc:304] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:09.368494 30095 raft_consensus.cc:1240] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:09.369624 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:09.311867   393 consensus_queue.cc:1059] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
W20260709 13:11:09.371351 30068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:09.312618   408 consensus_queue.cc:1048] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 13:11:09.319878   453 leader_election.cc:290] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:11:09.391420 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 60182.5us
I20260709 13:11:09.370098 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:09.415343 30099 raft_consensus.cc:2468] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 6.
W20260709 13:11:09.390478 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 55622.5us
I20260709 13:11:09.393921 30094 raft_consensus.cc:1275] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:11:09.395521 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:09.416757 30169 raft_consensus.cc:2468] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 3.
I20260709 13:11:09.430002 30099 raft_consensus.cc:1275] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:11:09.431237 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:09.432114 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:09.432636 30102 raft_consensus.cc:2376] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 9. Re-sending same reply.
I20260709 13:11:09.433223 30100 raft_consensus.cc:1275] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:09.433215 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:09.434017 30096 raft_consensus.cc:2368] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 6. Current term is 7.
I20260709 13:11:09.439782   501 leader_election.cc:290] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:09.441391 30103 raft_consensus.cc:1275] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:09.392639   401 raft_consensus.cc:2804] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:11:09.393008   507 raft_consensus.cc:2749] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:09.453167   495 raft_consensus.cc:515] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:09.470721 30094 raft_consensus.cc:1240] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:11:09.471586 29994 leader_election.cc:304] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:09.471921 30095 raft_consensus.cc:1275] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:09.460706 30703 leader_election.cc:304] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:09.476613 30703 leader_election.cc:304] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
W20260709 13:11:09.471698   445 log.cc:927] Time spent T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 13:11:09.500245 30703 leader_election.cc:400] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Vote denied by peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821) with higher term. Message: Invalid argument: T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 6. Current term is 7.
W20260709 13:11:09.477630   518 log.cc:927] Time spent T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 13:11:09.477777 32678 consensus_queue.cc:1048] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
W20260709 13:11:09.541568 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 70080.3us
I20260709 13:11:09.480919   393 raft_consensus.cc:2804] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:09.542308 29994 leader_election.cc:304] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:09.502347   457 raft_consensus.cc:2804] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:09.476997   367 consensus_queue.cc:1048] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 13:11:09.477288 32665 consensus_queue.cc:1059] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 13:11:09.479879   538 raft_consensus.cc:2749] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:09.499485 32753 raft_consensus.cc:493] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:09.480161   389 consensus_queue.cc:1059] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 13:11:09.549268   490 raft_consensus.cc:2804] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:09.538983   420 raft_consensus.cc:493] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.502229 32760 consensus_queue.cc:1048] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260709 13:11:09.561488 29994 leader_election.cc:304] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:09.549384   545 raft_consensus.cc:493] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:09.549666 32766 raft_consensus.cc:493] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.502549   537 consensus_queue.cc:1059] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 13:11:09.550909   457 raft_consensus.cc:493] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:09.551069   432 raft_consensus.cc:493] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
W20260709 13:11:09.586689 30142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 357980us
I20260709 13:11:09.560292   507 raft_consensus.cc:2804] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:09.591809   389 consensus_queue.cc:1243] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer 5ec73dc157ed476ca903a7d596271719 log is divergent from this leader: its last log entry 5.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:11:09.548776 32762 raft_consensus.cc:493] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.602895 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:09.553195   393 raft_consensus.cc:697] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 7 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:09.604851 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:11:09.652426 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 215042us
I20260709 13:11:09.568591   515 raft_consensus.cc:493] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:09.568086   490 raft_consensus.cc:697] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:09.568800 32358 raft_consensus.cc:2804] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:09.585999   547 raft_consensus.cc:493] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:09.706964 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 104373us
I20260709 13:11:09.592752   457 raft_consensus.cc:3060] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:09.568147   420 raft_consensus.cc:515] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:09.651765   507 raft_consensus.cc:697] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
W20260709 13:11:09.714418 30702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:09.675462   515 raft_consensus.cc:3060] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:09.592258 32766 raft_consensus.cc:515] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:09.653134 32760 consensus_queue.cc:1048] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 13:11:09.601118   432 raft_consensus.cc:515] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:09.674700   536 raft_consensus.cc:493] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:09.653090 32665 consensus_queue.cc:1048] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:11:09.573926 32753 raft_consensus.cc:515] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:09.735931 30026 raft_consensus.cc:1275] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:11:09.600800   408 consensus_queue.cc:1048] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.111s
I20260709 13:11:09.656708 32762 raft_consensus.cc:515] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:09.702348   401 raft_consensus.cc:697] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 3 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:09.577286   545 raft_consensus.cc:515] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:09.716547 32358 raft_consensus.cc:697] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:09.615947   543 consensus_queue.cc:1048] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.103s
I20260709 13:11:09.758425 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:09.760581 32766 leader_election.cc:290] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:09.760878   404 consensus_queue.cc:260] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:09.710884   538 consensus_queue.cc:1048] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 13:11:09.746289   536 raft_consensus.cc:515] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:09.765187 32717 raft_consensus.cc:3055] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:09.767817 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:09.771267 30728 raft_consensus.cc:2468] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 9.
I20260709 13:11:09.748724   492 raft_consensus.cc:493] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:09.793916 30023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 1621) took 2686 ms. Trace:
I20260709 13:11:09.755219 32678 raft_consensus.cc:493] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
W20260709 13:11:09.803540 30068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:09.714001   547 raft_consensus.cc:515] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:09.768074   495 leader_election.cc:290] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:09.807490 30023 rpcz_store.cc:276] 0709 13:11:07.107176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:07.107545 (+   369us) service_pool.cc:224] Handling call
0709 13:11:08.116151 (+1008606us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:08.177936 (+ 61785us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:09.793704 (+1615768us) spinlock_profiling.cc:243] Waited 996 ms on lock 0x7b54001e0850. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20b98ad 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:11:09.793859 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2291050752}
W20260709 13:11:09.778360   549 log.cc:927] Time spent T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.186s	user 0.000s	sys 0.001s
I20260709 13:11:09.778563 32717 raft_consensus.cc:740] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:09.814406   492 raft_consensus.cc:515] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:09.836417   492 leader_election.cc:290] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:09.836838   535 raft_consensus.cc:493] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:09.818105 32678 raft_consensus.cc:515] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:09.838280   545 leader_election.cc:290] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:09.839576   562 raft_consensus.cc:493] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.780072   490 consensus_queue.cc:237] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:09.840061   562 raft_consensus.cc:515] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:09.843927   536 leader_election.cc:290] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:09.766510   393 consensus_queue.cc:237] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:09.839488   561 raft_consensus.cc:493] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:09.846509   561 raft_consensus.cc:515] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:09.849349   547 leader_election.cc:290] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:09.855850 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:09.868242 30142 leader_election.cc:304] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:09.851948   561 leader_election.cc:290] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:09.760461   507 consensus_queue.cc:237] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:09.854538   398 raft_consensus.cc:3055] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:09.853214   404 raft_consensus.cc:3060] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:09.866259   543 raft_consensus.cc:493] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:09.837371   535 raft_consensus.cc:515] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:09.895020 30728 raft_consensus.cc:1275] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:09.870836   432 leader_election.cc:290] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:09.906373 30171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43838 (request call id 2046) took 1472 ms. Trace:
I20260709 13:11:09.906663   543 raft_consensus.cc:515] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:09.910295   550 log.cc:927] Time spent T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.111s	user 0.000s	sys 0.002s
I20260709 13:11:09.911330   543 leader_election.cc:290] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:09.906893   536 raft_consensus.cc:493] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:09.912110   536 raft_consensus.cc:515] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:09.913321   476 consensus_meta.cc:287] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719: Time spent flushing consensus metadata: real 0.657s	user 0.009s	sys 0.000s
I20260709 13:11:09.909111 30171 rpcz_store.cc:276] 0709 13:11:08.434044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:08.467132 (+ 33088us) service_pool.cc:224] Handling call
0709 13:11:08.526909 (+ 59777us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:08.527615 (+   706us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:09.906168 (+1378553us) spinlock_profiling.cc:243] Waited 59.5 ms on lock 0x7b54003dbdd0. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20b98ad 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:11:09.906315 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":136864128}
I20260709 13:11:09.875247   454 raft_consensus.cc:493] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:09.870609   495 raft_consensus.cc:493] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:09.885566   398 raft_consensus.cc:740] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:09.892546   547 raft_consensus.cc:2804] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:09.892041   562 leader_election.cc:290] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:09.922523   495 raft_consensus.cc:515] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:09.915215   554 log.cc:927] Time spent T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.156s	user 0.000s	sys 0.003s
I20260709 13:11:09.905838 32717 consensus_queue.cc:260] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:09.931056   457 raft_consensus.cc:515] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:09.931687   557 log.cc:927] Time spent T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 13:11:09.929487   398 consensus_queue.cc:260] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:09.933534 30020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 1630) took 1318 ms. Trace:
I20260709 13:11:09.933734   398 raft_consensus.cc:3060] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:09.920889   454 raft_consensus.cc:515] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:09.935963   454 leader_election.cc:290] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:11:09.938357 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 153895us
I20260709 13:11:09.940877 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:09.941428 30094 raft_consensus.cc:2468] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 3.
I20260709 13:11:09.942961 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:09.937558 30020 rpcz_store.cc:276] 0709 13:11:08.615535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:08.616227 (+   692us) service_pool.cc:224] Handling call
0709 13:11:08.685427 (+ 69200us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:09.126338 (+440911us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:09.933326 (+806988us) spinlock_profiling.cc:243] Waited 383 ms on lock 0x7b54004169d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:11:09.933480 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":881587968}
I20260709 13:11:09.946283 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:09.948578 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:09.949887 30100 raft_consensus.cc:1240] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:11:09.952916 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
W20260709 13:11:09.953300 30067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:09.953513 30094 raft_consensus.cc:2468] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 4.
I20260709 13:11:09.960220 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:09.965080 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:09.868402 32358 consensus_queue.cc:237] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:09.927368   420 leader_election.cc:290] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:09.964107   492 raft_consensus.cc:493] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
W20260709 13:11:09.972973 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 380140us
W20260709 13:11:09.972626 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 317872us
I20260709 13:11:09.855204   401 consensus_queue.cc:237] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:09.980561 30731 raft_consensus.cc:1240] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:09.928048   547 raft_consensus.cc:697] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 9 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:09.979310 30143 leader_election.cc:304] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:09.971746 32717 raft_consensus.cc:3060] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:09.988189   573 consensus_queue.cc:1048] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 13:11:09.988965   495 leader_election.cc:290] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:09.989492   495 raft_consensus.cc:2804] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:09.943496   543 consensus_queue.cc:1048] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 13:11:09.992511   515 raft_consensus.cc:515] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:09.993328   536 leader_election.cc:290] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:09.994387   535 leader_election.cc:290] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:09.994125   547 consensus_queue.cc:237] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:09.984313 32762 leader_election.cc:290] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:09.981609 32753 leader_election.cc:290] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:09.972244   454 consensus_queue.cc:1048] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:11:09.981905   492 raft_consensus.cc:515] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:10.008822 30168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43840 (request call id 1775) took 1596 ms. Trace:
I20260709 13:11:09.984938   553 consensus_queue.cc:1059] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 13:11:10.011147 30168 rpcz_store.cc:276] 0709 13:11:08.412231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:08.428205 (+ 15974us) service_pool.cc:224] Handling call
0709 13:11:08.761132 (+332927us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:08.775692 (+ 14560us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:10.008613 (+1232921us) spinlock_profiling.cc:243] Waited 333 ms on lock 0x7b54000ea1d0. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20b98ad 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:11:10.008760 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":765027712}
I20260709 13:11:10.014248   568 raft_consensus.cc:493] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:10.014906   568 raft_consensus.cc:515] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:10.017089   568 leader_election.cc:290] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:09.987182   349 leader_election.cc:290] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:10.001389   495 raft_consensus.cc:493] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:10.039491 30024 raft_consensus.cc:1240] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:10.040805 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:10.042897 30024 raft_consensus.cc:2393] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 7: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:11:10.044106 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:10.030309   352 raft_consensus.cc:493] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:10.049029 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:10.053719   532 raft_consensus.cc:493] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.037544   495 raft_consensus.cc:3060] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:10.063383   492 leader_election.cc:290] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:10.065274 30700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:10.065999   563 raft_consensus.cc:493] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:10.066609   537 raft_consensus.cc:493] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:10.077833 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:10.038743   490 raft_consensus.cc:493] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.073062 30026 raft_consensus.cc:1275] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:11:10.080973 30703 leader_election.cc:304] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:11:10.082623   385 raft_consensus.cc:2804] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:10.082989   385 raft_consensus.cc:493] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.083829   385 raft_consensus.cc:3060] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:10.090699 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:10.093608 30728 raft_consensus.cc:1275] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:11:10.094023 30728 pending_rounds.cc:85] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a: Aborting all ops after (but not including) 6
I20260709 13:11:10.094277 30728 pending_rounds.cc:107] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:11:10.094492 30728 raft_consensus.cc:2889] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:10.093981 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:10.096254 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:10.096776 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:10.078480 30024 raft_consensus.cc:2468] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 8.
I20260709 13:11:10.097919 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:10.098515 30736 raft_consensus.cc:2468] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 9.
I20260709 13:11:10.078200 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:10.091348 30735 raft_consensus.cc:2468] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 3.
I20260709 13:11:10.119760 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:10.104631 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:10.088683   490 raft_consensus.cc:515] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:10.136801 30142 leader_election.cc:304] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:10.138648   538 raft_consensus.cc:493] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.140945 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:11:10.139745   570 log.cc:927] Time spent T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 13:11:10.139184   538 raft_consensus.cc:515] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:10.100978   516 raft_consensus.cc:493] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.139642   568 raft_consensus.cc:2804] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:10.131173   398 raft_consensus.cc:493] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.074654   352 raft_consensus.cc:515] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:10.131217 32501 raft_consensus.cc:493] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.152712   568 raft_consensus.cc:493] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:10.076656   532 raft_consensus.cc:515] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:10.164279   532 leader_election.cc:290] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:10.165150 30026 raft_consensus.cc:2393] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 5: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:11:10.166837 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:10.167819 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:10.146009   561 raft_consensus.cc:493] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:10.088766   537 raft_consensus.cc:515] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:10.168773   568 raft_consensus.cc:3060] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:10.217272 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:10.177017   457 leader_election.cc:290] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:10.219674 30024 raft_consensus.cc:1240] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 LEADER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:10.170081   398 raft_consensus.cc:515] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:10.221283 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 86910.6us
I20260709 13:11:10.079352   563 raft_consensus.cc:515] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:10.225823 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:11:10.229776 30142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:10.227213 30700 leader_election.cc:304] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:10.213867   419 raft_consensus.cc:493] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:10.175179   561 raft_consensus.cc:515] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:10.216966   538 leader_election.cc:290] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:10.216598   454 raft_consensus.cc:493] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.171132 32501 raft_consensus.cc:515] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:10.233896   454 raft_consensus.cc:515] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:10.221172   515 leader_election.cc:290] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:10.236153   561 leader_election.cc:290] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:10.230926   349 raft_consensus.cc:493] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
W20260709 13:11:10.247998   590 log.cc:927] Time spent T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 13:11:10.226850 30023 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "48d3196b43924d35bf72234ad500783e"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
mode: GRACEFUL
new_leader_uuid: "5ec73dc157ed476ca903a7d596271719"
 from {username='slave'} at 127.0.0.1:47450
I20260709 13:11:10.249811 30023 raft_consensus.cc:606] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Received request to transfer leadership to TS 5ec73dc157ed476ca903a7d596271719
W20260709 13:11:10.251101   583 log.cc:927] Time spent T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260709 13:11:10.252867   540 raft_consensus.cc:3055] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:10.253270   540 raft_consensus.cc:740] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:10.236219   454 leader_election.cc:290] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:10.257079 30700 leader_election.cc:304] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:10.267247 30700 leader_election.cc:304] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:10.245916   457 raft_consensus.cc:2749] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:10.156538   516 raft_consensus.cc:515] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:10.274286   457 raft_consensus.cc:2749] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:10.275833   352 leader_election.cc:290] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:10.286625 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:10.287315 30019 raft_consensus.cc:2393] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 7: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:11:10.275995 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:10.277065   398 leader_election.cc:290] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:10.256170   349 raft_consensus.cc:515] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:10.278012 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:10.247464   490 leader_election.cc:290] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:10.280948 30027 raft_consensus.cc:1240] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:10.247426   537 leader_election.cc:290] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:10.242105 32665 consensus_queue.cc:1059] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 13:11:10.294751 30700 leader_election.cc:304] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
W20260709 13:11:10.300117   581 log.cc:927] Time spent T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260709 13:11:10.236400   419 raft_consensus.cc:515] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:10.300777 30019 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
mode: GRACEFUL
new_leader_uuid: "5ec73dc157ed476ca903a7d596271719"
 from {username='slave'} at 127.0.0.1:47450
I20260709 13:11:10.301337 30019 raft_consensus.cc:606] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Received request to transfer leadership to TS 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:10.302482 30022 raft_consensus.cc:2468] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 6.
I20260709 13:11:10.303283   457 raft_consensus.cc:3060] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:10.305996 32665 consensus_queue.cc:1243] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer b2cea0098c1040f69755ea4d3dab7fc4 log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:11:10.277611 32658 leader_election.cc:290] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:10.260737   561 consensus_queue.cc:1048] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260709 13:11:10.287850 32762 raft_consensus.cc:493] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:10.302428   419 leader_election.cc:290] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:10.323843   349 leader_election.cc:290] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:10.294059   515 consensus_queue.cc:1048] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 13:11:10.295418   385 raft_consensus.cc:515] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:10.341696 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:10.327891 32762 raft_consensus.cc:515] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:10.339757   563 leader_election.cc:290] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:10.339771   516 leader_election.cc:290] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:10.361315 32501 leader_election.cc:290] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:10.368114   599 raft_consensus.cc:493] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
W20260709 13:11:10.373697 29993 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:10.366941   563 raft_consensus.cc:493] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:10.374775   453 raft_consensus.cc:493] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.360189   540 consensus_queue.cc:260] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:10.379822   540 raft_consensus.cc:3060] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:10.379539   453 raft_consensus.cc:515] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:10.375448 32589 raft_consensus.cc:493] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.379570   559 raft_consensus.cc:493] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:10.382156   559 raft_consensus.cc:515] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:10.382767   453 leader_election.cc:290] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:10.375476   490 raft_consensus.cc:493] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:10.383675   490 raft_consensus.cc:515] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:10.386457 30170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54540 (request call id 639) took 1664 ms. Trace:
I20260709 13:11:10.386703   490 leader_election.cc:290] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:10.381045 32762 leader_election.cc:290] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:10.380736 32589 raft_consensus.cc:515] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:10.389981 32589 leader_election.cc:290] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:10.397903   492 consensus_queue.cc:1059] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:10.380224   385 leader_election.cc:290] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:10.398855   349 raft_consensus.cc:3055] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:10.399246   349 raft_consensus.cc:740] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
W20260709 13:11:10.403699 30140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:10.375770   563 raft_consensus.cc:515] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:10.399255   440 raft_consensus.cc:3055] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:10.386829 30170 rpcz_store.cc:276] 0709 13:11:08.722514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:08.722678 (+   164us) service_pool.cc:224] Handling call
0709 13:11:08.722968 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:08.728905 (+  5937us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:08.728934 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:08.729365 (+   431us) log.cc:844] Serialized 26 byte log entry
0709 13:11:08.867194 (+137829us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:08.900132 (+ 32938us) log.cc:844] Serialized 14 byte log entry
0709 13:11:08.920340 (+ 20208us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:10.386131 (+1465791us) spinlock_profiling.cc:243] Waited 3.82 ms on lock 0x7b54004079d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:11:10.386173 (+    42us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:10.386212 (+    39us) raft_consensus.cc:1685] finished
0709 13:11:10.386293 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:10.386407 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21731,"prepare.queue_time_us":37602,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":23410,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":3605,"spinlock_wait_cycles":8795392,"thread_start_us":124137,"threads_started":1,"wal-append.queue_time_us":185144,"wal-append.run_cpu_time_us":1675,"wal-append.run_wall_time_us":1001707}
I20260709 13:11:10.406198   440 raft_consensus.cc:740] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:10.376457   599 raft_consensus.cc:515] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:10.416321   401 raft_consensus.cc:493] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.407686   423 raft_consensus.cc:493] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:10.417843 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:10.415571   419 raft_consensus.cc:493] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.405428   349 consensus_queue.cc:260] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:10.418938 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:10.419324 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:10.419415   349 raft_consensus.cc:3060] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:10.418906   419 raft_consensus.cc:515] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:10.422155   419 leader_election.cc:290] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:10.423126 30176 raft_consensus.cc:1275] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:11:10.425519 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:10.418779   539 raft_consensus.cc:3055] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:10.416786   401 raft_consensus.cc:515] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:10.413493 32762 raft_consensus.cc:493] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.440099   457 raft_consensus.cc:2749] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:10.431821 32678 leader_election.cc:290] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:10.449714   599 leader_election.cc:290] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:10.441715   563 leader_election.cc:290] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:10.442507 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:10.451172 30022 raft_consensus.cc:2468] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 5.
I20260709 13:11:10.408773   606 consensus_queue.cc:1048] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 13:11:10.444882   423 raft_consensus.cc:515] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:10.445995   461 raft_consensus.cc:3060] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:10.417351   339 raft_consensus.cc:493] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:10.446261 32762 raft_consensus.cc:515] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:10.454609 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:10.464354 30143 leader_election.cc:304] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:10.464723 30022 raft_consensus.cc:2393] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 6: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:11:10.416692   440 consensus_queue.cc:260] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:10.416956   559 leader_election.cc:290] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:10.456969 32766 raft_consensus.cc:493] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:10.457932 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:10.461052 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:10.410514   568 raft_consensus.cc:515] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:10.462137 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:10.463356   453 raft_consensus.cc:993] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4: : Instructing follower 5ec73dc157ed476ca903a7d596271719 to start an election
I20260709 13:11:10.476116   577 raft_consensus.cc:493] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:10.478305 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:10.478469 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:10.479238 30177 raft_consensus.cc:2410] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:11:10.471767 30068 leader_election.cc:304] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:10.469555 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:10.481137 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:10.481691 30170 raft_consensus.cc:2468] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 5.
I20260709 13:11:10.471835 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:10.473203   542 raft_consensus.cc:493] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.470503   515 raft_consensus.cc:493] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:10.448565   539 raft_consensus.cc:740] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:10.485553 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:10.486378 30028 raft_consensus.cc:2468] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 7.
I20260709 13:11:10.485431 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:10.488014 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:10.485852 30068 leader_election.cc:304] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:10.486992 30176 raft_consensus.cc:2468] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 6.
I20260709 13:11:10.477492   388 raft_consensus.cc:2749] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:10.493157 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:10.496331 30173 raft_consensus.cc:3060] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:10.497186 30177 raft_consensus.cc:1240] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:10.483814   440 raft_consensus.cc:3060] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:10.497125 30170 raft_consensus.cc:2468] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 9.
I20260709 13:11:10.501850 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:10.498411 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:10.496239 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:10.483661   476 raft_consensus.cc:2804] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:10.503423 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:10.504102 30170 raft_consensus.cc:2468] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 9.
I20260709 13:11:10.469053   339 raft_consensus.cc:515] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:10.505100 30170 raft_consensus.cc:1240] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:10.476681   577 raft_consensus.cc:515] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:10.507555 30176 raft_consensus.cc:1275] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:10.508646   577 leader_election.cc:290] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:10.509093   577 raft_consensus.cc:2804] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:10.509363   577 raft_consensus.cc:493] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:10.509636   577 raft_consensus.cc:3060] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:10.475359 32766 raft_consensus.cc:515] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:10.490077   462 consensus_queue.cc:1048] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 13:11:10.514844   576 raft_consensus.cc:1081] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Signalling peer 5ec73dc157ed476ca903a7d596271719 to start an election
I20260709 13:11:10.488106   515 raft_consensus.cc:515] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:10.506019   476 raft_consensus.cc:493] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:10.528155 29993 leader_election.cc:304] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:10.530324 29993 leader_election.cc:304] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:10.543970 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:11:10.539877 30700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:10.563905 30700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:10.533349 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:10.544497 30068 leader_election.cc:304] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:10.517480   495 raft_consensus.cc:515] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:10.514101   542 raft_consensus.cc:515] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:10.630798 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:10.634156   462 raft_consensus.cc:493] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.393918   462 raft_consensus.cc:515] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:10.764459   536 raft_consensus.cc:493] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:11.396250   462 leader_election.cc:290] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:10.566520 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:10.531214 32762 leader_election.cc:290] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:11.405876 30170 raft_consensus.cc:2468] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 7.
I20260709 13:11:10.724488   398 raft_consensus.cc:493] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:10.929533   432 raft_consensus.cc:493] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:11.406806   398 raft_consensus.cc:515] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:11.409089   398 leader_election.cc:290] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:10.702105   389 raft_consensus.cc:493] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:11.411454   389 raft_consensus.cc:515] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:11.414381 30097 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.014s	sys 0.022s
W20260709 13:11:11.414738 30097 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.014s	sys 0.022s
I20260709 13:11:10.539777 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:11.395970 30025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52098 (request call id 567) took 1028 ms. Trace:
I20260709 13:11:10.921581   367 raft_consensus.cc:493] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:10.807246 30141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:10.532836   453 raft_consensus.cc:2804] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:11.415890   453 raft_consensus.cc:493] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:11.416285   453 raft_consensus.cc:3060] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:11.417276   542 leader_election.cc:290] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:10.542160 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:11.418373 30094 raft_consensus.cc:2468] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 7.
I20260709 13:11:11.419216 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:11.419798 30094 raft_consensus.cc:2468] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 9.
I20260709 13:11:10.603230   541 consensus_queue.cc:1059] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.818s
I20260709 13:11:10.533303   476 raft_consensus.cc:3060] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:11.377647   577 consensus_meta.cc:287] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719: Time spent flushing consensus metadata: real 0.868s	user 0.003s	sys 0.004s
I20260709 13:11:10.565934 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:11.422384   577 raft_consensus.cc:515] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:11.422797 30096 raft_consensus.cc:2468] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 5.
I20260709 13:11:11.423719 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:11.424275 30096 raft_consensus.cc:2468] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 6.
I20260709 13:11:10.645925 30066 leader_election.cc:304] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:10.528919   576 consensus_queue.cc:1059] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.870s
I20260709 13:11:11.424623   577 leader_election.cc:290] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:10.532603   539 consensus_queue.cc:260] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:11.415339 30025 rpcz_store.cc:276] 0709 13:11:10.367198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:10.370016 (+  2818us) service_pool.cc:224] Handling call
0709 13:11:10.370315 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:10.370820 (+   505us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:10.370847 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:10.371672 (+   825us) log.cc:844] Serialized 26 byte log entry
0709 13:11:10.432330 (+ 60658us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:10.432396 (+    66us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:10.432456 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:11.395620 (+963164us) raft_consensus.cc:1685] finished
0709 13:11:11.395640 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:11.395909 (+   269us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":78,"raft.queue_time_us":73,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":1630,"thread_start_us":27824,"threads_started":1,"wal-append.queue_time_us":127669}
I20260709 13:11:10.828848 32753 raft_consensus.cc:3055] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:10.607185   423 leader_election.cc:290] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:10.832995 30173 raft_consensus.cc:1275] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:11:11.406908   432 raft_consensus.cc:515] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:11.427901 32753 raft_consensus.cc:740] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
W20260709 13:11:11.428675 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 782961us
I20260709 13:11:10.565263 30103 raft_consensus.cc:1240] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:10.563601   556 raft_consensus.cc:2804] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:11.430034   556 raft_consensus.cc:493] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.430390   556 raft_consensus.cc:3060] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:11.430693 30066 leader_election.cc:304] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:11.431928 30066 leader_election.cc:304] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:11.427861   539 raft_consensus.cc:3060] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:11.433459 30700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:11.433976 30700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:11.434329 30700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.114066   339 leader_election.cc:290] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:11.426671 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:10.806479   402 raft_consensus.cc:3060] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:11.435801 30096 raft_consensus.cc:2468] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 7.
W20260709 13:11:11.370217   440 consensus_meta.cc:287] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent flushing consensus metadata: real 0.859s	user 0.008s	sys 0.000s
I20260709 13:11:10.613436 30098 raft_consensus.cc:1275] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:11.436702 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:10.607789 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:11.437981 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:11.438201 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:11.438563   462 raft_consensus.cc:2749] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:11.036295 30020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52098 (request call id 548) took 1002 ms. Trace:
I20260709 13:11:11.439195 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:11.439353   423 raft_consensus.cc:2749] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:11.439815 30099 raft_consensus.cc:2468] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 9.
I20260709 13:11:11.440188 32501 raft_consensus.cc:493] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:11.398469 30175 raft_consensus.cc:2393] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 5: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:11:11.397722   568 leader_election.cc:290] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:10.609023   515 leader_election.cc:290] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:11.441267   515 raft_consensus.cc:493] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:11.398734   610 raft_consensus.cc:2804] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:11.439224   462 raft_consensus.cc:493] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:11.442055   610 raft_consensus.cc:493] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:11.398552 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 854084us
I20260709 13:11:11.442404   462 raft_consensus.cc:515] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:11.443837   476 raft_consensus.cc:515] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:11.444712   462 leader_election.cc:290] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:10.657591   385 raft_consensus.cc:493] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.446007   385 raft_consensus.cc:515] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:11.395418   536 raft_consensus.cc:515] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:11.405108 30702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.415503 30100 raft_consensus.cc:2393] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 7: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:11.401714   352 raft_consensus.cc:493] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.447188   453 raft_consensus.cc:515] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:11.447289   556 raft_consensus.cc:515] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:11.399600   495 leader_election.cc:290] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:11.447798   352 raft_consensus.cc:515] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:11.448410   536 leader_election.cc:290] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:11.448876   476 leader_election.cc:290] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:11.440068   423 raft_consensus.cc:2749] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:10.809423 32766 leader_election.cc:290] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:11.439456 30020 rpcz_store.cc:276] 0709 13:11:10.034279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:10.034391 (+   112us) service_pool.cc:224] Handling call
0709 13:11:10.045847 (+ 11456us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:10.205701 (+159854us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:10.205729 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:10.205786 (+    57us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:10.205818 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:11.036068 (+830250us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b5400353c54. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:11:11.036112 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:11.036233 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":300569984}
I20260709 13:11:11.445505   440 raft_consensus.cc:493] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:11.441633 30066 leader_election.cc:304] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:11.415740   367 raft_consensus.cc:515] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:11.442466   610 raft_consensus.cc:3060] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:11.438573 30096 raft_consensus.cc:2468] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 6.
I20260709 13:11:11.497335   393 raft_consensus.cc:493] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:11.503276   393 raft_consensus.cc:515] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:11.453348 30099 raft_consensus.cc:1275] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:11.505249   393 leader_election.cc:290] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:10.638178   401 leader_election.cc:290] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:11.441773   515 raft_consensus.cc:515] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:11.453145 30024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52098 (request call id 556) took 1315 ms. Trace:
I20260709 13:11:11.400444 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:11.509575 30095 raft_consensus.cc:2393] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 6: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
W20260709 13:11:11.457978 30143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.420562 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:11.512557 30094 raft_consensus.cc:2368] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 4. Current term is 5.
I20260709 13:11:11.429047 32753 consensus_queue.cc:260] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:11.511814 30143 leader_election.cc:304] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
W20260709 13:11:11.497032 30733 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.843s	user 0.006s	sys 0.036s
I20260709 13:11:11.499158 30103 raft_consensus.cc:1240] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 5. Current term is 6. Ops: []
W20260709 13:11:11.517092 30733 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.863s	user 0.006s	sys 0.036s
W20260709 13:11:11.060400   578 log.cc:927] Time spent T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.857s	user 0.000s	sys 0.005s
I20260709 13:11:11.413554   389 leader_election.cc:290] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:11:11.519584 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 78018.2us
I20260709 13:11:11.519529 30094 raft_consensus.cc:1240] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:11.505126 30096 raft_consensus.cc:1275] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:11:11.453565 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:11.429693   432 leader_election.cc:290] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:11.523291   432 raft_consensus.cc:2804] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:11.523653   432 raft_consensus.cc:493] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.523967   432 raft_consensus.cc:3060] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:11.497499   339 raft_consensus.cc:493] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:11.525080   339 raft_consensus.cc:515] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:11.521118 30174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43838 (request call id 2077) took 1026 ms. Trace:
I20260709 13:11:11.529953 30174 rpcz_store.cc:276] 0709 13:11:10.495070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:10.495357 (+   287us) service_pool.cc:224] Handling call
0709 13:11:11.037975 (+542618us) spinlock_profiling.cc:243] Waited 1.16 ms on lock 0x7b5800003c98. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eef95b71 00007f99eef95a22 00007f99f7eaec09 00007f99f7008ee0 00007f99f70d20ab 00007f99f70d2131 00007f99f70800a0 00007f99f707f984 00007f99f05fa6d4 00007f99f05fa662
0709 13:11:11.521056 (+483081us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2659200}
I20260709 13:11:11.531200   339 leader_election.cc:290] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:11.531893   432 raft_consensus.cc:515] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:11.509207 30024 rpcz_store.cc:276] 0709 13:11:10.137933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:10.138077 (+   144us) service_pool.cc:224] Handling call
0709 13:11:10.138344 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:10.222203 (+ 83859us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:11.027314 (+805111us) spinlock_profiling.cc:243] Waited 80.3 ms on lock 0x7b54000f46d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:11:11.453088 (+425774us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":184697088}
I20260709 13:11:11.520722 30096 pending_rounds.cc:85] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719: Aborting all ops after (but not including) 6
I20260709 13:11:11.506407 32762 raft_consensus.cc:493] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.533854   432 leader_election.cc:290] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:11.534500   432 raft_consensus.cc:493] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:11.534853   339 raft_consensus.cc:493] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:11.534988   432 raft_consensus.cc:515] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:11.535363   339 raft_consensus.cc:515] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:11.534883 30103 raft_consensus.cc:1275] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:11.524053   367 leader_election.cc:290] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:11.536871   432 leader_election.cc:290] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:11.525960 30022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54198 (request call id 1916) took 1066 ms. Trace:
I20260709 13:11:11.537340 30022 rpcz_store.cc:276] 0709 13:11:10.459689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:10.491990 (+ 32301us) service_pool.cc:224] Handling call
0709 13:11:10.492265 (+   275us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:10.495826 (+  3561us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:10.495855 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:10.496265 (+   410us) log.cc:844] Serialized 26 byte log entry
0709 13:11:10.602177 (+105912us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:10.602219 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:10.602294 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:11.525738 (+923444us) raft_consensus.cc:1685] finished
0709 13:11:11.525779 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:11.525905 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5491,"raft.queue_time_us":3885,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":8435,"thread_start_us":74558,"threads_started":1,"wal-append.queue_time_us":1010444}
I20260709 13:11:11.526358   352 leader_election.cc:290] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:11.495492   536 raft_consensus.cc:493] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:11.540283   536 raft_consensus.cc:515] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:11.456092   556 leader_election.cc:290] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:11.506692   577 raft_consensus.cc:493] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:11.507721 32766 raft_consensus.cc:493] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:11.496656 32501 raft_consensus.cc:515] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:11.514828   401 raft_consensus.cc:493] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:11.517728 30733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51004 (request call id 686) took 1351 ms. Trace:
I20260709 13:11:11.508333   423 raft_consensus.cc:493] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.533923 30096 pending_rounds.cc:107] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:11:11.552981 30096 raft_consensus.cc:2889] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:10.565979   535 consensus_queue.cc:1048] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.943s
I20260709 13:11:11.506517   398 raft_consensus.cc:493] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.516460 30143 leader_election.cc:304] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:11.619131   398 raft_consensus.cc:515] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:11.542330   565 raft_consensus.cc:2804] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:11.552368 30733 rpcz_store.cc:276] 0709 13:11:10.166218 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:10.166389 (+   171us) service_pool.cc:224] Handling call
0709 13:11:10.166750 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:10.166972 (+   222us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:11:10.189167 (+ 22195us) log.cc:844] Serialized 14 byte log entry
0709 13:11:10.653824 (+464657us) spinlock_profiling.cc:243] Waited 7.36 ms on lock 0x7b1800451d80. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f7e95de1 00007f99f7ea25b1 00007f99eefafe07 00007f99f7e0aab9 00007f99eefcc69b 00007f99eefca93f 00007f99eefca455 00007f99f20b2060 00007f99f20c4716 00007f99f20d5287 00007f99f20d5208
0709 13:11:11.517417 (+863593us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:11.517463 (+    46us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:11.517509 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:11.517582 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:11.517679 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5317,"prepare.queue_time_us":37952,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":24844,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"spinlock_wait_cycles":16927488,"thread_start_us":863475,"threads_started":1}
I20260709 13:11:11.542256   536 leader_election.cc:290] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:11:11.621310 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 104908us
I20260709 13:11:11.502177   440 raft_consensus.cc:515] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:11.542326   393 raft_consensus.cc:2804] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:11.542398   476 raft_consensus.cc:493] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:11.534008   568 consensus_queue.cc:1059] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 9.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.093s
I20260709 13:11:11.684775 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:11:11.687290 30177 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.015s	sys 0.044s
W20260709 13:11:11.689875 30177 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.015s	sys 0.044s
W20260709 13:11:11.694111 30140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.695451 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:11.697131 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:11.697860 30174 raft_consensus.cc:2393] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 4: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:11:11.698740 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:11.699347 30173 raft_consensus.cc:2468] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 6.
I20260709 13:11:11.700538 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:11.701882 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:11.687467 30143 leader_election.cc:304] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
W20260709 13:11:11.819833 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 180998us
I20260709 13:11:11.635417   389 raft_consensus.cc:2804] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:11.550321 32762 raft_consensus.cc:515] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:11.844120 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:11:11.855973 30703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:11.554070   577 raft_consensus.cc:515] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:11.553851 32766 raft_consensus.cc:515] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:11.855523 30176 raft_consensus.cc:2468] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 6.
I20260709 13:11:11.862223 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:11.864282 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:11.864877 30096 raft_consensus.cc:3060] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:11.620466   423 raft_consensus.cc:515] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:11.684954   339 leader_election.cc:290] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:11.868176 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:11.689006   588 raft_consensus.cc:493] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:11.868851 30025 raft_consensus.cc:1240] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:11:11.869043 30169 raft_consensus.cc:2468] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 5.
I20260709 13:11:11.869213 30102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48558 (request call id 518) took 2280 ms. Trace:
I20260709 13:11:11.872773 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:11.869645 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:11.869868 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:11.877172 30735 raft_consensus.cc:2468] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 5.
I20260709 13:11:11.855520   389 raft_consensus.cc:493] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:11.871819 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:11.872335 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:11.872856 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:11.626775   401 raft_consensus.cc:515] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:11.831841 32501 leader_election.cc:290] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:11.877960 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:11.878024 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:11.878379 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:11.882563 30026 raft_consensus.cc:2410] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:11:11.709343   393 raft_consensus.cc:493] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:11.875787 30102 rpcz_store.cc:276] 0709 13:11:09.588961 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.589128 (+   167us) service_pool.cc:224] Handling call
0709 13:11:09.589405 (+   277us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:09.664923 (+ 75518us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:09.664955 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:09.672717 (+  7762us) log.cc:844] Serialized 26 byte log entry
0709 13:11:10.032959 (+360242us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:10.032996 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:10.033082 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:11.060055 (+1026973us) spinlock_profiling.cc:243] Waited 8.27 ms on lock 0x7b24002a5258. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eee539c4 00007f99eee51acb 00007f99ef00cdc9 00007f99ef00ca55 00007f99ef00c09d 00007f99f1c3e10e 00007f99f1c5588c 00007f99f1c54bb6 00007f99f1c547d8 00007f99f1c5e221
0709 13:11:11.863118 (+803063us) raft_consensus.cc:1685] finished
0709 13:11:11.863138 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:11.869154 (+  6016us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":75062,"raft.queue_time_us":83277,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":32906,"spinlock_wait_cycles":19015936,"thread_start_us":310533,"threads_started":1,"wal-append.queue_time_us":443095}
I20260709 13:11:11.882802 30068 leader_election.cc:304] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:11.883050 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:11.883584 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:11.883890 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:11.884253 30102 raft_consensus.cc:2393] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 6: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:11.884711 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:11.885134 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:11.874154 30733 raft_consensus.cc:2468] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 4.
I20260709 13:11:11.876197 30731 raft_consensus.cc:2468] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 5.
I20260709 13:11:11.885211 30103 raft_consensus.cc:2468] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 5.
I20260709 13:11:11.879766 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:11.886843 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:11.889626 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
W20260709 13:11:11.857276   547 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.917s	user 0.034s	sys 0.052s
I20260709 13:11:11.891718 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:11.896713 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:11.893029 30700 leader_election.cc:304] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:11.732116   476 raft_consensus.cc:515] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:11.868278   536 raft_consensus.cc:493] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:11.909571 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:11.910844 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:11.890218 30102 raft_consensus.cc:2468] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 6.
I20260709 13:11:11.894919 30068 leader_election.cc:304] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:11.894457 30095 raft_consensus.cc:1240] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:11.908488 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:11.912926 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:11.913043 30068 leader_election.cc:304] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:11.913448 30103 raft_consensus.cc:3060] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:11.875490   492 raft_consensus.cc:493] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:11.911453 30730 raft_consensus.cc:2468] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 7.
I20260709 13:11:11.919377 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:11.922453 30102 raft_consensus.cc:2468] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 3.
W20260709 13:11:11.896211   547 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.965s	user 0.035s	sys 0.052s
I20260709 13:11:11.918095 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:11.874991   402 raft_consensus.cc:493] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:11.923223 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:11.929436 30102 raft_consensus.cc:3060] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:11.887877   453 leader_election.cc:290] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:11.890720   393 raft_consensus.cc:3060] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:11.889860   389 raft_consensus.cc:3060] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:11.934226 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:11.907368   432 raft_consensus.cc:2749] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:11.947467 30028 raft_consensus.cc:2468] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 7.
I20260709 13:11:11.936576 30177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43840 (request call id 1793) took 1392 ms. Trace:
I20260709 13:11:11.892239   339 raft_consensus.cc:493] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:11.948540 30103 raft_consensus.cc:2468] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 5.
I20260709 13:11:11.906855   625 raft_consensus.cc:493] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:11.992571 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:11.971004 30096 raft_consensus.cc:2410] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:11:11.951232 30177 rpcz_store.cc:276] 0709 13:11:10.544275 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:10.544709 (+   434us) service_pool.cc:224] Handling call
0709 13:11:10.545007 (+   298us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:10.545346 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:10.545373 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:10.565571 (+ 20198us) log.cc:844] Serialized 26 byte log entry
0709 13:11:11.021424 (+455853us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b1800360ac0. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f7e95de1 00007f99f7ea25b1 00007f99eefafe07 00007f99f7e0aab9 00007f99eefcc69b 00007f99eefca93f 00007f99eefccc02 00007f99f1c5420b 00007f99f1c59d23 00007f99f1c5a0d1 00007f99f2075a0f
0709 13:11:11.690299 (+668875us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:11.690340 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:11.690403 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:11.936294 (+245891us) raft_consensus.cc:1685] finished
0709 13:11:11.936313 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:11.936520 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":17323,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":63807,"spinlock_wait_cycles":2622208,"thread_start_us":668703,"threads_started":1,"wal-append.queue_time_us":1303657}
I20260709 13:11:11.986209 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:11.999887 30103 raft_consensus.cc:2468] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 8.
I20260709 13:11:11.919795   622 raft_consensus.cc:2804] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:11.881682   588 raft_consensus.cc:515] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:11.918249   536 raft_consensus.cc:515] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:11.997056   432 raft_consensus.cc:2804] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:11.928215   492 raft_consensus.cc:515] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:12.008225 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:12.009641 30103 raft_consensus.cc:1240] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 13:11:11.979775   627 raft_consensus.cc:493] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:11.991782   542 raft_consensus.cc:2804] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:11.950351   402 raft_consensus.cc:515] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:11.987607 30102 raft_consensus.cc:2468] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 4.
I20260709 13:11:12.002189   515 leader_election.cc:290] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:11:11.976914 32358 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.031s	sys 0.000s
I20260709 13:11:12.265794 30103 raft_consensus.cc:1240] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:11:11.990161   339 raft_consensus.cc:515] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:12.010628   622 raft_consensus.cc:493] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:12.206279   432 raft_consensus.cc:493] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:12.286526   398 leader_election.cc:290] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:12.298185   622 raft_consensus.cc:3060] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:12.291905 32358 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.853s	user 0.032s	sys 0.000s
I20260709 13:11:12.287386   627 raft_consensus.cc:515] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:12.283736   542 raft_consensus.cc:493] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:12.299919   617 log.cc:927] Time spent T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.307s	user 0.000s	sys 0.000s
W20260709 13:11:12.290210   384 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.850s	user 0.031s	sys 0.063s
W20260709 13:11:12.299309   615 log.cc:927] Time spent T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.304s	user 0.000s	sys 0.000s
I20260709 13:11:12.294821   623 raft_consensus.cc:493] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.291585   440 leader_election.cc:290] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:11.995790   625 raft_consensus.cc:515] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:12.305594   432 raft_consensus.cc:3060] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:12.378746   542 raft_consensus.cc:3060] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:12.446929   629 log.cc:927] Time spent T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 13:11:12.428635   577 leader_election.cc:290] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:12.451637   588 leader_election.cc:290] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:12.452980   536 leader_election.cc:290] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:12.454660   627 leader_election.cc:290] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:12.455219   627 raft_consensus.cc:2749] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:11:12.456828   539 consensus_meta.cc:287] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent flushing consensus metadata: real 1.024s	user 0.005s	sys 0.005s
I20260709 13:11:12.463771   625 leader_election.cc:290] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:12.441291   623 raft_consensus.cc:515] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:12.466965   623 leader_election.cc:290] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:11:12.485790   613 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.003s	sys 0.000s
W20260709 13:11:12.486254   613 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.004s	sys 0.000s
W20260709 13:11:12.494578   610 consensus_meta.cc:287] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719: Time spent flushing consensus metadata: real 0.984s	user 0.005s	sys 0.004s
I20260709 13:11:12.495186   610 raft_consensus.cc:515] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:12.497313   610 leader_election.cc:290] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:12.206775 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:12.553587 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:12.554819 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:12.555258 30021 raft_consensus.cc:2468] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 8.
I20260709 13:11:12.555459 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:12.555990 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:12.557510 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:12.559235 30027 raft_consensus.cc:2393] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 10: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:11:12.559859 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:12.561335 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:12.562105 30023 raft_consensus.cc:2468] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 8.
I20260709 13:11:12.290858 30102 raft_consensus.cc:1275] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:12.300575 30103 raft_consensus.cc:1240] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:12.621009 30096 raft_consensus.cc:2393] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 7: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
W20260709 13:11:12.431218   384 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.988s	user 0.031s	sys 0.066s
I20260709 13:11:12.623004 32766 leader_election.cc:290] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:11:12.578059 30702 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.130s	user 0.029s	sys 0.064s
I20260709 13:11:12.579293 30731 raft_consensus.cc:1275] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 13:11:12.603271 30068 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.004s	sys 0.006s
I20260709 13:11:12.608093   542 raft_consensus.cc:515] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:12.609968   622 raft_consensus.cc:515] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:12.614846 30101 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.975s	user 0.000s	sys 0.009s
I20260709 13:11:12.618942 30099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33992 (request call id 1735) took 2075 ms. Trace:
W20260709 13:11:12.630522 30068 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.004s	sys 0.006s
W20260709 13:11:12.633018 30702 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.186s	user 0.029s	sys 0.065s
W20260709 13:11:12.634766 30101 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.998s	user 0.001s	sys 0.009s
W20260709 13:11:12.638077 30175 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43840 (request call id 1785) took 2205 ms (client timeout 1878 ms). Trace:
W20260709 13:11:12.638579 30175 rpcz_store.cc:269] 0709 13:11:10.417809 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:10.418282 (+   473us) service_pool.cc:224] Handling call
0709 13:11:12.623309 (+2205027us) spinlock_profiling.cc:243] Waited 979 ms on lock 0x7b5400174654. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:11:12.623570 (+   261us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2250552192}
I20260709 13:11:12.639587   401 leader_election.cc:290] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:12.442720   440 raft_consensus.cc:493] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:12.641129   440 raft_consensus.cc:515] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:12.644349   440 leader_election.cc:290] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:12.645287   402 leader_election.cc:290] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:12.646587 32358 raft_consensus.cc:493] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:12.647428 32358 raft_consensus.cc:515] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:12.650035 30069 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.116s	user 0.000s	sys 0.012s
W20260709 13:11:12.650419 30069 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.130s	user 0.000s	sys 0.012s
W20260709 13:11:12.653937 30094 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.093s	user 0.010s	sys 0.001s
W20260709 13:11:12.654330 30094 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.111s	user 0.010s	sys 0.002s
W20260709 13:11:12.632015 30066 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.109s	user 0.011s	sys 0.004s
W20260709 13:11:12.670149 30066 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.148s	user 0.012s	sys 0.004s
W20260709 13:11:12.672847 30171 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.052s	user 0.008s	sys 0.008s
W20260709 13:11:12.673312 30171 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.053s	user 0.008s	sys 0.008s
I20260709 13:11:12.628160 30099 rpcz_store.cc:276] 0709 13:11:10.542989 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:11.441280 (+898291us) service_pool.cc:224] Handling call
0709 13:11:11.453077 (+ 11797us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:11.505489 (+ 52412us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:12.618444 (+1112955us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b5400266450. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20b98ad 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:11:12.618719 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":26553728}
I20260709 13:11:12.679796 30102 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043"
dest_uuid: "5ec73dc157ed476ca903a7d596271719"
 from {username='slave'} at 127.0.0.1:33990
I20260709 13:11:12.680579 30102 raft_consensus.cc:493] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:12.681030 30102 raft_consensus.cc:3060] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:12.686156   339 leader_election.cc:290] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:12.690371 30172 raft_consensus.cc:1240] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:12.692559 30172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43838 (request call id 2075) took 2198 ms. Trace:
I20260709 13:11:12.693178   385 leader_election.cc:290] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:12.698328 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:12.696012 30101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33992 (request call id 1724) took 2166 ms. Trace:
I20260709 13:11:12.692962 30172 rpcz_store.cc:276] 0709 13:11:10.494253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:10.494415 (+   162us) service_pool.cc:224] Handling call
0709 13:11:12.670322 (+2175907us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:12.690928 (+ 20606us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:12.692185 (+  1257us) spinlock_profiling.cc:243] Waited 2.13 s on lock 0x7b5400174650. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20b98ad 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:11:12.692439 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4896993152}
I20260709 13:11:12.740980 32358 leader_election.cc:290] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:12.738588 30101 rpcz_store.cc:276] 0709 13:11:10.532036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:10.532142 (+   106us) service_pool.cc:224] Handling call
0709 13:11:10.532462 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:10.532761 (+   299us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:10.532788 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:11.392079 (+859291us) log.cc:844] Serialized 26 byte log entry
0709 13:11:11.552427 (+160348us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:12.695000 (+1142573us) log.cc:844] Serialized 14 byte log entry
0709 13:11:12.695478 (+   478us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:12.695614 (+   136us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:12.695700 (+    86us) raft_consensus.cc:1685] finished
0709 13:11:12.695714 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:12.695905 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":389865,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":61746,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":46240,"thread_start_us":1160634,"threads_started":2,"wal-append.queue_time_us":517069}
I20260709 13:11:12.745311 30101 raft_consensus.cc:1240] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 4. Current term is 5. Ops: []
W20260709 13:11:12.745885 30143 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.849s	user 0.004s	sys 0.009s
W20260709 13:11:12.746315 30143 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.925s	user 0.004s	sys 0.010s
W20260709 13:11:12.746635 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 925667us
W20260709 13:11:12.749639 30143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.755103 32753 raft_consensus.cc:3060] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:12.755311 30702 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.54.67:45001 timed out after 1.753s (SENT) [suppressed 7 similar messages]
W20260709 13:11:12.728809 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 1.20636e+06us
I20260709 13:11:12.758955 30066 leader_election.cc:304] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:12.760008   635 raft_consensus.cc:2749] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:12.761370   568 raft_consensus.cc:493] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:12.762204   568 raft_consensus.cc:515] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:12.765511   542 leader_election.cc:290] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:12.766253 30143 leader_election.cc:400] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Vote denied by peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821) with higher term. Message: Invalid argument: T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 4. Current term is 5.
I20260709 13:11:12.745832 32762 leader_election.cc:290] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:12.767169 30143 leader_election.cc:403] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:12.694056 32766 raft_consensus.cc:493] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
W20260709 13:11:12.766547 30737 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.811s	user 0.006s	sys 0.008s
I20260709 13:11:12.767645 30099 raft_consensus.cc:3060] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:12.768622   614 log.cc:927] Time spent T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 1.353s	user 0.013s	sys 0.039s
W20260709 13:11:12.768802   393 consensus_meta.cc:287] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124: Time spent flushing consensus metadata: real 0.790s	user 0.015s	sys 0.000s
I20260709 13:11:12.769127   402 raft_consensus.cc:493] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:12.770368   492 leader_election.cc:290] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:12.693989   423 leader_election.cc:290] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:11:12.784646   389 consensus_meta.cc:287] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124: Time spent flushing consensus metadata: real 0.804s	user 0.011s	sys 0.002s
I20260709 13:11:12.785593   568 leader_election.cc:290] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:12.732803   622 leader_election.cc:290] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:12.801496 30737 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.938s	user 0.007s	sys 0.008s
I20260709 13:11:12.686082   476 leader_election.cc:290] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:11:12.810074 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 54824.4us
I20260709 13:11:12.797181   542 raft_consensus.cc:493] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.825911 32766 raft_consensus.cc:515] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:12.826186   542 raft_consensus.cc:515] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:12.828150 32766 leader_election.cc:290] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:12.828341   542 leader_election.cc:290] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:12.809147   393 raft_consensus.cc:515] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:12.801292   402 raft_consensus.cc:515] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:12.817490 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:12.818361 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:12.822113 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:12.831406 30027 raft_consensus.cc:2393] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 10: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:11:12.823416 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:12.824124 30097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33992 (request call id 1727) took 2284 ms. Trace:
I20260709 13:11:12.834419 30101 raft_consensus.cc:1275] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:11:12.815747 30703 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.007s	sys 0.007s
I20260709 13:11:12.812719   389 raft_consensus.cc:515] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:12.836267 30140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:12.837996   389 leader_election.cc:290] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:12.838925 30140 leader_election.cc:304] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:12.839325 30173 raft_consensus.cc:2393] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 10: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:11:12.813019 32753 raft_consensus.cc:493] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:12.835640 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:12.840024 32753 raft_consensus.cc:515] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:12.842301 30020 raft_consensus.cc:2468] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 7.
W20260709 13:11:12.843077 30700 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.836s	user 0.000s	sys 0.009s
W20260709 13:11:12.843438 30700 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.941s	user 0.000s	sys 0.010s
W20260709 13:11:12.844480 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 951458us
I20260709 13:11:12.845739   644 consensus_queue.cc:1059] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:12.846284 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:12.846803 30171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43838 (request call id 2083) took 2282 ms. Trace:
I20260709 13:11:12.846904   644 raft_consensus.cc:3055] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:12.847334   644 raft_consensus.cc:740] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:12.847256 30171 rpcz_store.cc:276] 0709 13:11:10.564494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:10.640023 (+ 75529us) service_pool.cc:224] Handling call
0709 13:11:11.393339 (+753316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:11.393916 (+   577us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:11.393944 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:11.394369 (+   425us) log.cc:844] Serialized 26 byte log entry
0709 13:11:11.551482 (+157113us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:12.673746 (+1122264us) log.cc:844] Serialized 14 byte log entry
0709 13:11:12.787871 (+114125us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:12.799535 (+ 11664us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:12.809688 (+ 10153us) raft_consensus.cc:1685] finished
0709 13:11:12.809705 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:12.846748 (+ 37043us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1273034,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":59,"raft.queue_time_us":4291,"raft.run_cpu_time_us":377,"raft.run_wall_time_us":5572,"thread_start_us":1209946,"threads_started":2,"wal-append.queue_time_us":542665}
I20260709 13:11:12.848675   644 consensus_queue.cc:260] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:12.851635   644 raft_consensus.cc:3060] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:12.853482   565 raft_consensus.cc:493] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
W20260709 13:11:12.853964 30100 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.269s	user 0.011s	sys 0.000s
I20260709 13:11:12.854101   565 raft_consensus.cc:3060] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:12.854394 30100 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.325s	user 0.011s	sys 0.000s
I20260709 13:11:12.855412   393 leader_election.cc:290] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:12.856268   393 raft_consensus.cc:3060] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:12.857282   532 raft_consensus.cc:493] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.854108 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:12.857630 30700 leader_election.cc:304] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
W20260709 13:11:12.862177 30703 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.937s	user 0.007s	sys 0.008s
I20260709 13:11:12.866251 30099 raft_consensus.cc:2468] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 10.
I20260709 13:11:12.853528   402 leader_election.cc:290] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:12.873935 30098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33992 (request call id 1728) took 2333 ms. Trace:
I20260709 13:11:12.874776 30140 leader_election.cc:304] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:12.875416   423 raft_consensus.cc:493] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:12.876350 32753 leader_election.cc:290] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:12.876120   423 raft_consensus.cc:515] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:12.877277 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:12.877803   389 raft_consensus.cc:2749] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:12.878670 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:12.879005   385 raft_consensus.cc:493] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.879702 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:12.881222 30095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48558 (request call id 525) took 1016 ms. Trace:
I20260709 13:11:12.882122 30736 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad"
dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
mode: GRACEFUL
new_leader_uuid: "5ec73dc157ed476ca903a7d596271719"
 from {username='slave'} at 127.0.0.1:55634
I20260709 13:11:12.878000   627 raft_consensus.cc:493] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:12.882858 30736 raft_consensus.cc:606] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Received request to transfer leadership to TS 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:12.883275 30736 raft_consensus.cc:614] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:12.882989   627 raft_consensus.cc:515] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:12.883930   432 raft_consensus.cc:515] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:12.885289   627 leader_election.cc:290] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:12.886060 30173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43840 (request call id 1798) took 1185 ms. Trace:
I20260709 13:11:12.886471 30173 rpcz_store.cc:276] 0709 13:11:11.700229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:11.700328 (+    99us) service_pool.cc:224] Handling call
0709 13:11:12.885854 (+1185526us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b5400175554. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:11:12.885994 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2616663808}
I20260709 13:11:12.881646 30095 rpcz_store.cc:276] 0709 13:11:11.864500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:11.866089 (+  1589us) service_pool.cc:224] Handling call
0709 13:11:11.866341 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:11.916800 (+ 50459us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:12.880747 (+963947us) spinlock_profiling.cc:243] Waited 27.9 ms on lock 0x7b54001d56d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:11:12.881009 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64255232}
I20260709 13:11:12.886983 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
W20260709 13:11:12.868242 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 102346us
W20260709 13:11:12.886418 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 961042us
I20260709 13:11:12.892462   532 raft_consensus.cc:515] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:12.892892   423 leader_election.cc:290] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:12.874415 30098 rpcz_store.cc:276] 0709 13:11:10.540671 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:10.541142 (+   471us) service_pool.cc:224] Handling call
0709 13:11:10.606161 (+ 65019us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:11.437337 (+831176us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:12.862871 (+1425534us) spinlock_profiling.cc:243] Waited 6.9 ms on lock 0x7b54001f7554. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:11:12.873703 (+ 10832us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15870848}
I20260709 13:11:12.895045   532 leader_election.cc:290] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:12.895475 30703 leader_election.cc:304] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:12.896955   627 raft_consensus.cc:2749] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:12.895058 30098 raft_consensus.cc:1240] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:12.832021 30097 rpcz_store.cc:276] 0709 13:11:10.539689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:10.539946 (+   257us) service_pool.cc:224] Handling call
0709 13:11:10.540267 (+   321us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:10.564036 (+ 23769us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:10.564066 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:10.631644 (+ 67578us) log.cc:844] Serialized 52 byte log entry
0709 13:11:10.921389 (+289745us) spinlock_profiling.cc:243] Waited 7.54 ms on lock 0x7b48001a0358. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f6fe3aa1 00007f99f6fdab37 00007f99f6fda9ca 00007f99f70d226f 00007f99f70d1f37 00007f99f70e655c 00007f99f70e6508 00007f99f70e6488 00007f99f70e6443 00007f99f70e56ec 00007f99f600fa96
0709 13:11:11.415084 (+493695us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:11.636805 (+221721us) log.cc:844] Serialized 14 byte log entry
0709 13:11:11.690207 (+ 53402us) log.cc:844] Serialized 14 byte log entry
0709 13:11:11.733331 (+ 43124us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:11.733402 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:12.767695 (+1034293us) spinlock_profiling.cc:243] Waited 37.8 ms on lock 0x7b4400022b4c. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eeef3c85 00007f99eeef46a2 00007f99f1c661db 00007f99f1c61aaf 00007f99f1c5586e 00007f99f1c54bb6 00007f99f1c547d8 00007f99f1c5e221 00007f99f1c5e1d9 00007f99f1c5e169
0709 13:11:12.823757 (+ 56062us) raft_consensus.cc:1685] finished
0709 13:11:12.823777 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:12.823974 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":74108,"prepare.queue_time_us":710728,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":5410,"raft.queue_time_us":121017,"raft.run_cpu_time_us":2502,"raft.run_wall_time_us":449489,"spinlock_wait_cycles":104368768,"thread_start_us":875640,"threads_started":2,"wal-append.queue_time_us":708681}
I20260709 13:11:12.899849 30700 leader_election.cc:304] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:12.900310 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:12.900480 30097 raft_consensus.cc:1275] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:12.900934 30026 raft_consensus.cc:3060] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:12.902243   627 raft_consensus.cc:2804] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:12.902680   627 raft_consensus.cc:493] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:12.903096   627 raft_consensus.cc:3060] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:12.903970   440 raft_consensus.cc:2804] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:12.904362   440 raft_consensus.cc:493] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:12.904690   440 raft_consensus.cc:3060] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:12.881515 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:12.908190 30730 raft_consensus.cc:2410] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for term 8 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:11:12.909021 30143 leader_election.cc:304] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:12.877974 30731 raft_consensus.cc:2468] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 6.
I20260709 13:11:12.910995   402 raft_consensus.cc:2804] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:12.911466   402 raft_consensus.cc:493] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:12.911896   402 raft_consensus.cc:3060] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:12.914520 32753 raft_consensus.cc:2749] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:12.910374 30143 leader_election.cc:304] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:12.915692 30143 leader_election.cc:304] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:12.915879 32753 raft_consensus.cc:2804] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:12.916316 32753 raft_consensus.cc:493] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:12.916503 30094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33990 (request call id 2079) took 1510 ms. Trace:
I20260709 13:11:12.879644   385 raft_consensus.cc:515] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:12.918519 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:12.919814 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:12.920956 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:12.916438   389 raft_consensus.cc:2804] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:12.921736   389 raft_consensus.cc:697] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 5 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:12.916855 30094 rpcz_store.cc:276] 0709 13:11:11.405728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:11.523172 (+117444us) service_pool.cc:224] Handling call
0709 13:11:11.523448 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:11.542609 (+ 19161us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:12.654821 (+1112212us) log.cc:844] Serialized 14 byte log entry
0709 13:11:12.867982 (+213161us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:12.878538 (+ 10556us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:12.878617 (+    79us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:12.916295 (+ 37678us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b54002148d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:11:12.916337 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:12.916455 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50670,"prepare.queue_time_us":378176,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":57,"raft.queue_time_us":62541,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":118,"spinlock_wait_cycles":43609728,"thread_start_us":1266536,"threads_started":2,"wal-append.queue_time_us":237547}
I20260709 13:11:12.922881   389 consensus_queue.cc:237] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:12.923628 30173 raft_consensus.cc:1275] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:12.926316 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:12.927078 30176 raft_consensus.cc:2393] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 10: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:11:12.917254 30735 raft_consensus.cc:2468] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 8.
I20260709 13:11:12.928299 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:12.928650 30102 raft_consensus.cc:515] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:12.929059 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 54467.9us
I20260709 13:11:12.930686 30140 leader_election.cc:304] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:12.934468   432 leader_election.cc:290] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:12.934700 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:11:12.935590   541 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.392s	user 0.014s	sys 0.022s
I20260709 13:11:12.935854 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:12.940614 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:12.941709 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:12.950206 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:11:12.951088   541 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.530s	user 0.014s	sys 0.023s
I20260709 13:11:12.951653 30170 raft_consensus.cc:2468] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 8.
I20260709 13:11:12.919772   385 leader_election.cc:290] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:12.953986 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:12.954980 32753 raft_consensus.cc:3060] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:12.953557 30026 raft_consensus.cc:2468] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 8.
I20260709 13:11:12.958492 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:12.960851 29994 leader_election.cc:304] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
W20260709 13:11:12.963876 30169 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54540 (request call id 648) took 3360 ms (client timeout 1753 ms). Trace:
I20260709 13:11:12.899820 30703 leader_election.cc:304] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:11:12.970813 30169 rpcz_store.cc:269] 0709 13:11:09.603145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:09.604619 (+  1474us) service_pool.cc:224] Handling call
0709 13:11:12.963483 (+3358864us) spinlock_profiling.cc:243] Waited 2.2 s on lock 0x7b5400286754. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:11:12.963676 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5059963264}
I20260709 13:11:12.954746   367 raft_consensus.cc:3055] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:12.965987   622 raft_consensus.cc:2749] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:12.968396 29921 catalog_manager.cc:5697] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: term changed from 4 to 5, leader changed from c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 5 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:12.975720 29921 catalog_manager.cc:5697] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:12.976784   393 raft_consensus.cc:2749] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821) with higher term. Message: Invalid argument: T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 4. Current term is 5.
I20260709 13:11:12.972702   367 raft_consensus.cc:740] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:12.978770   367 consensus_queue.cc:260] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:12.980248   367 raft_consensus.cc:3060] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:12.980623 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:12.981287 30176 raft_consensus.cc:3060] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:12.982664 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:12.983430 30169 raft_consensus.cc:2468] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 8.
I20260709 13:11:12.984457   385 raft_consensus.cc:2749] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:11:12.984709 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 85317.1us
I20260709 13:11:12.986560 30703 leader_election.cc:304] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:12.986686 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:12.987401   385 raft_consensus.cc:2804] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:12.987497 30729 raft_consensus.cc:2468] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 6.
I20260709 13:11:12.987881   385 raft_consensus.cc:493] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:12.988418   385 raft_consensus.cc:3060] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:12.988744 30703 leader_election.cc:304] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:12.990597 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:12.942762 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:12.986037 29921 catalog_manager.cc:5697] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:12.966202 30102 leader_election.cc:290] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:13.009994 30729 raft_consensus.cc:2468] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 7.
W20260709 13:11:13.008194 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 72796us
I20260709 13:11:13.013861 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:13.006338   627 raft_consensus.cc:515] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:13.026405 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 141453us
I20260709 13:11:13.026676 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:13.027550 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:13.028925 30175 raft_consensus.cc:2468] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 8.
I20260709 13:11:13.015578   432 raft_consensus.cc:493] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:13.030609 30100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33990 (request call id 2065) took 1628 ms. Trace:
I20260709 13:11:13.031019 30100 rpcz_store.cc:276] 0709 13:11:11.402114 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:11.454672 (+ 52558us) service_pool.cc:224] Handling call
0709 13:11:11.454960 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:11.507818 (+ 52858us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:11.507845 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:11.508259 (+   414us) log.cc:844] Serialized 26 byte log entry
0709 13:11:12.854945 (+1346686us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:12.855001 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:13.030221 (+175220us) spinlock_profiling.cc:243] Waited 2.08 ms on lock 0x7b5400265a54. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:11:13.030266 (+    45us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:13.030317 (+    51us) raft_consensus.cc:1685] finished
0709 13:11:13.030333 (+    16us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:13.030547 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50437,"raft.queue_time_us":56141,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":19465,"spinlock_wait_cycles":4777216,"thread_start_us":1325792,"threads_started":1,"wal-append.queue_time_us":1324326}
I20260709 13:11:13.033931   495 consensus_queue.cc:1059] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.009s
I20260709 13:11:13.029013 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:13.034873   495 raft_consensus.cc:3055] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:13.035254   495 raft_consensus.cc:740] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:13.036231   495 consensus_queue.cc:260] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:13.037036   627 leader_election.cc:290] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:13.037427   495 raft_consensus.cc:3060] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:13.038129 29924 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51840 (request call id 327) took 17593 ms (client timeout 15000 ms). Trace:
I20260709 13:11:13.039606   565 raft_consensus.cc:515] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:13.038489 29924 rpcz_store.cc:269] 0709 13:10:55.371958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:55.372152 (+   194us) service_pool.cc:224] Handling call
0709 13:11:12.965529 (+17593377us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:05.740571 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:05.741239 (+   668us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:05.741291 (+    52us) write_op.cc:435] Acquired schema lock
0709 13:11:05.741310 (+    19us) tablet.cc:662] Decoding operations
0709 13:11:05.749375 (+  8065us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:05.749455 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:05.749482 (+    27us) tablet.cc:685] Acquiring locks for 19 operations
0709 13:11:06.062254 (+312772us) tablet.cc:701] Row locks acquired
0709 13:11:06.062295 (+    41us) write_op.cc:260] PREPARE: finished
0709 13:11:06.062461 (+   166us) write_op.cc:270] Start()
0709 13:11:06.062594 (+   133us) write_op.cc:276] Timestamp: P: 1783602666062403 usec, L: 0
0709 13:11:06.062620 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:11:06.063308 (+   688us) log.cc:844] Serialized 7477 byte log entry
0709 13:11:07.186769 (+1123461us) op_driver.cc:464] REPLICATION: finished
0709 13:11:07.335093 (+148324us) write_op.cc:301] APPLY: starting
0709 13:11:07.335191 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:07.335544 (+   353us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:07.335662 (+   118us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:07.645963 (+310301us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:07.646350 (+   387us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=19
0709 13:11:07.646393 (+    43us) write_op.cc:312] APPLY: finished
0709 13:11:07.646891 (+   498us) log.cc:844] Serialized 132 byte log entry
0709 13:11:07.647105 (+   214us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:07.647281 (+   176us) write_op.cc:454] Released schema lock
0709 13:11:07.647357 (+    76us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:07.647756 (+   399us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:07.647787 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1448187,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":148067,"apply.run_cpu_time_us":8638,"apply.run_wall_time_us":312651,"num_ops":19,"prepare.queue_time_us":267640,"prepare.run_cpu_time_us":24516,"prepare.run_wall_time_us":449860,"raft.queue_time_us":313655,"raft.run_cpu_time_us":23017,"raft.run_wall_time_us":102777,"replication_time_us":1123988,"thread_start_us":542429,"threads_started":4,"wal-append.queue_time_us":233442,"wal-append.run_cpu_time_us":60080,"wal-append.run_wall_time_us":2358041}]]}
W20260709 13:11:13.049996 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 89446.8us
W20260709 13:11:13.030946 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 100423us
I20260709 13:11:13.054989 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:13.056143 30024 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 1638) took 1201 ms. Trace:
I20260709 13:11:13.056499 30024 rpcz_store.cc:276] 0709 13:11:11.855125 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:11.856273 (+  1148us) service_pool.cc:224] Handling call
0709 13:11:11.856545 (+   272us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:11.867720 (+ 11175us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:11.867749 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:12.785819 (+918070us) spinlock_profiling.cc:243] Waited 2.26 ms on lock 0x7b2c00000658. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f09b3a11 00007f99f09c3372 00007f99f20f5a01 00007f99f20ba43a 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2
0709 13:11:12.786482 (+   663us) log.cc:844] Serialized 26 byte log entry
0709 13:11:13.011075 (+224593us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:13.014558 (+  3483us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:13.027456 (+ 12898us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:13.055742 (+ 28286us) raft_consensus.cc:1685] finished
0709 13:11:13.055760 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:13.055967 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":37401,"raft.queue_time_us":36274,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":9630,"spinlock_wait_cycles":5194496,"thread_start_us":221102,"threads_started":1,"wal-append.queue_time_us":242445}
I20260709 13:11:13.067407 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:13.030429   432 raft_consensus.cc:515] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:13.070609 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 46667.1us
I20260709 13:11:13.073482 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:13.052943 32762 raft_consensus.cc:493] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:13.073364 30737 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51014 (request call id 884) took 1207 ms. Trace:
I20260709 13:11:13.073048 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:13.078665   453 raft_consensus.cc:2804] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:13.079105   453 raft_consensus.cc:493] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.079435   453 raft_consensus.cc:3060] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:13.079756 30140 leader_election.cc:304] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:13.082252 30170 raft_consensus.cc:2410] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:11:13.082542 30703 leader_election.cc:304] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:11:13.083923 30736 raft_consensus.cc:1240] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 3. Current term is 4. Ops: []
W20260709 13:11:13.078598 30702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.089007 30735 raft_consensus.cc:1275] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:13.091217 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:13.092250 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:13.092767 30734 raft_consensus.cc:2468] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 9.
I20260709 13:11:13.084149 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:13.093140   453 raft_consensus.cc:515] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:13.094748 30732 raft_consensus.cc:3060] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:13.095252   453 leader_election.cc:290] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:13.101868 30732 raft_consensus.cc:2468] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 4.
I20260709 13:11:13.102432 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:13.103435 30170 raft_consensus.cc:1240] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 7 LEADER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:13.113615 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:13.114761 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:13.115751 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:13.116205   402 raft_consensus.cc:515] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:13.106489   339 raft_consensus.cc:2804] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:13.109162   440 raft_consensus.cc:515] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:13.110082 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:13.120589 30736 raft_consensus.cc:2468] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 5.
I20260709 13:11:13.110692 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:13.111065 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
W20260709 13:11:13.111472 29993 connection.cc:256] RPC call timeout handler was delayed by -1.5287832840000419s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15580000000000002s for a response
I20260709 13:11:13.106696 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:13.101904 29994 leader_election.cc:304] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:13.108911 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:13.088862 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:13.106226 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
W20260709 13:11:13.117748 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 43894.2us
W20260709 13:11:13.121830 29993 connection.cc:256] RPC call timeout handler was delayed by -1.1435832839999875s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1986s for a response
I20260709 13:11:13.126449 30176 raft_consensus.cc:2468] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 10.
I20260709 13:11:13.124871 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:13.106367 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:13.070219   423 raft_consensus.cc:493] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:13.130637 30170 raft_consensus.cc:1240] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:13.132979   413 consensus_queue.cc:1048] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:13.134048 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:13.134754 30022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 1637) took 1291 ms. Trace:
I20260709 13:11:13.137245   640 raft_consensus.cc:2804] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:13.134552   622 raft_consensus.cc:2749] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:11:13.127301   576 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.544s	user 0.004s	sys 0.024s
I20260709 13:11:13.075811 30737 rpcz_store.cc:276] 0709 13:11:11.863177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:11.863278 (+   101us) service_pool.cc:224] Handling call
0709 13:11:11.863525 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:11.863729 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 13:11:12.825139 (+961410us) log.cc:844] Serialized 14 byte log entry
0709 13:11:13.012862 (+187723us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:13.022241 (+  9379us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:13.052522 (+ 30281us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:13.066538 (+ 14016us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:13.070726 (+  4188us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":661797,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":68,"raft.queue_time_us":159,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":44315,"thread_start_us":1115607,"threads_started":2,"wal-append.queue_time_us":201159}
I20260709 13:11:13.143177 30173 raft_consensus.cc:2410] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:11:13.139643   339 raft_consensus.cc:493] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:13.148861   613 raft_consensus.cc:493] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.149724   440 leader_election.cc:290] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:13.152227 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 82941.7us
W20260709 13:11:13.146941   576 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.720s	user 0.004s	sys 0.024s
I20260709 13:11:13.157886 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:13.145705   565 leader_election.cc:290] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:13.153548   339 raft_consensus.cc:3060] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:13.120368   389 consensus_queue.cc:1048] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 13:11:13.167886 30177 raft_consensus.cc:1240] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:13.152845   640 raft_consensus.cc:697] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:13.183115 30169 raft_consensus.cc:2468] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 3.
I20260709 13:11:13.183663   640 consensus_queue.cc:237] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:13.184893   402 leader_election.cc:290] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:13.180335 29994 leader_election.cc:304] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:13.185832 32753 raft_consensus.cc:515] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:13.186913 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:13.187592 30023 raft_consensus.cc:2368] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 6. Current term is 7.
I20260709 13:11:13.187822 32753 leader_election.cc:290] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:13.188647 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:13.188578 29993 leader_election.cc:304] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:13.189456 30027 raft_consensus.cc:3060] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:13.190233 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:13.190538 32573 raft_consensus.cc:2749] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:13.190974   490 raft_consensus.cc:2749] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:13.170644 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:13.143157 30022 rpcz_store.cc:276] 0709 13:11:11.843542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:11.843685 (+   143us) service_pool.cc:224] Handling call
0709 13:11:11.844001 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:11.867798 (+ 23797us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:11.867829 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:12.858027 (+990198us) spinlock_profiling.cc:243] Waited 2.29 ms on lock 0x7b2c00000658. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f09b3a11 00007f99f09c3372 00007f99f20f5a01 00007f99f20ba43a 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2
0709 13:11:12.899561 (+ 41534us) log.cc:844] Serialized 26 byte log entry
0709 13:11:13.052298 (+152737us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:13.052328 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:13.067762 (+ 15434us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:13.134261 (+ 66499us) raft_consensus.cc:1685] finished
0709 13:11:13.134279 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:13.134505 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15154,"raft.queue_time_us":31773,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":8265,"spinlock_wait_cycles":5264768,"thread_start_us":152287,"threads_started":1,"wal-append.queue_time_us":227269}
I20260709 13:11:13.191324 29993 leader_election.cc:304] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:13.176455 32766 raft_consensus.cc:493] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.192077 32766 raft_consensus.cc:515] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:13.192948   490 raft_consensus.cc:2804] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:13.193331   490 raft_consensus.cc:493] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:13.127007 32762 raft_consensus.cc:515] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:13.194191 32766 leader_election.cc:290] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:13.179147   625 raft_consensus.cc:493] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.194927   625 raft_consensus.cc:515] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:13.182242   352 raft_consensus.cc:3055] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:13.160157   613 raft_consensus.cc:515] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:13.195520 32762 leader_election.cc:290] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:13.164331   423 raft_consensus.cc:515] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:13.188761   576 consensus_queue.cc:1048] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 13:11:13.188508 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:13.193687   490 raft_consensus.cc:3060] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:13.190249 29994 leader_election.cc:304] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:13.197131   352 raft_consensus.cc:740] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:13.203069   423 leader_election.cc:290] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:13.182510   432 leader_election.cc:290] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:13.203971   625 leader_election.cc:290] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:13.206545   352 consensus_queue.cc:260] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:13.207201   613 leader_election.cc:290] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:13.208472 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:13.208920 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:13.209064 30170 raft_consensus.cc:2468] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 5.
I20260709 13:11:13.170439   656 raft_consensus.cc:2804] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:13.209959 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:13.210036 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:11:13.202107 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 122532us
I20260709 13:11:13.208169 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:13.211066 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:13.214818 30140 leader_election.cc:304] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:13.217059 30027 raft_consensus.cc:2468] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 6.
I20260709 13:11:13.215516   402 raft_consensus.cc:2749] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:13.213235 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:13.219166 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:13.210728   385 raft_consensus.cc:515] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:13.208223   352 raft_consensus.cc:3060] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Advancing to term 4
W20260709 13:11:13.218498 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 49078.9us
I20260709 13:11:13.222504   453 raft_consensus.cc:2804] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:13.210409   656 raft_consensus.cc:493] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.226702 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:13.232622 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:13.232578 30140 leader_election.cc:304] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:13.235030 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
W20260709 13:11:13.235320 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 66908.5us
I20260709 13:11:13.235698 30700 leader_election.cc:400] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 election: Vote denied by peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451) with higher term. Message: Invalid argument: T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 6. Current term is 7.
I20260709 13:11:13.227528   453 raft_consensus.cc:493] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.228621   656 raft_consensus.cc:3060] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:13.211277 32753 consensus_queue.cc:1048] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.020s
I20260709 13:11:13.237512 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:13.236049 30700 leader_election.cc:403] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:11:13.236039 30737 raft_consensus.cc:2468] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 7.
I20260709 13:11:13.240399 30733 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da"
dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
mode: GRACEFUL
new_leader_uuid: "5ec73dc157ed476ca903a7d596271719"
 from {username='slave'} at 127.0.0.1:55634
I20260709 13:11:13.242115   620 consensus_queue.cc:1059] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:13.243589   449 consensus_queue.cc:1048] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:11:13.245219 30141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.246025 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:13.247735   413 raft_consensus.cc:2804] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:13.248436 30140 leader_election.cc:304] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:13.271510   413 raft_consensus.cc:493] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:13.272047   413 raft_consensus.cc:3060] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:13.272581 30140 leader_election.cc:304] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:13.257619 30175 raft_consensus.cc:2410] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 13:11:13.274133   495 raft_consensus.cc:3060] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:13.259260 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:13.275454 30728 raft_consensus.cc:2468] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 7.
I20260709 13:11:13.276417 32753 raft_consensus.cc:2804] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:13.276816 32753 raft_consensus.cc:493] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:13.277176 32753 raft_consensus.cc:3060] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:13.260190 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:13.278261 30736 raft_consensus.cc:2410] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 13:11:13.267390 30022 raft_consensus.cc:2468] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 7.
I20260709 13:11:13.261140 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:13.262077 32573 consensus_queue.cc:1059] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:13.262764   541 consensus_queue.cc:1048] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:13.264156   652 consensus_queue.cc:1059] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:13.245927 30024 raft_consensus.cc:1240] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:13.266175 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:13.232466   432 raft_consensus.cc:493] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.269797 30735 raft_consensus.cc:2468] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 9.
I20260709 13:11:13.271025   644 raft_consensus.cc:3060] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:13.273631 30140 leader_election.cc:304] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:13.306135   641 raft_consensus.cc:3060] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:13.308499 30140 leader_election.cc:304] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:13.310009 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:13.310878   644 raft_consensus.cc:2749] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451) with higher term. Message: Invalid argument: T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 6. Current term is 7.
W20260709 13:11:13.290838 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 51498.8us
I20260709 13:11:13.236392   423 raft_consensus.cc:493] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:13.239446   453 raft_consensus.cc:3060] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:13.294077 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:13.297323   432 raft_consensus.cc:515] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:13.303479   495 raft_consensus.cc:2749] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:13.312287 30737 raft_consensus.cc:1275] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:11:13.312448 30700 leader_election.cc:304] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:13.314869 30737 pending_rounds.cc:85] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a: Aborting all ops after (but not including) 6
I20260709 13:11:13.332700   432 leader_election.cc:290] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:13.334250 32719 raft_consensus.cc:3055] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:13.334795 32719 raft_consensus.cc:740] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:13.335784 32719 consensus_queue.cc:260] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:13.337141 32719 raft_consensus.cc:3060] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:13.338045   423 raft_consensus.cc:515] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:13.338821 29993 leader_election.cc:304] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:13.340114 29993 leader_election.cc:304] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:13.340438   423 leader_election.cc:290] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:13.341208 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:13.342556   367 raft_consensus.cc:2749] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:13.343282   367 raft_consensus.cc:2804] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:13.343603   367 raft_consensus.cc:493] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.343914   367 raft_consensus.cc:3060] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:13.344287   490 raft_consensus.cc:515] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:13.346349   634 consensus_queue.cc:1048] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:13.346684 29994 leader_election.cc:304] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:13.348032 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:13.348789 30176 raft_consensus.cc:2393] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 6: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:11:13.353523 30171 raft_consensus.cc:2468] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 5.
I20260709 13:11:13.356768 30068 leader_election.cc:304] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:13.325810 30737 pending_rounds.cc:107] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:11:13.357769 30737 raft_consensus.cc:2889] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:13.358860 30700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.314254   492 raft_consensus.cc:2804] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:13.346374   490 leader_election.cc:290] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:13.362623   492 raft_consensus.cc:493] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:13.367755   492 raft_consensus.cc:3060] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:13.368224   413 raft_consensus.cc:515] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:13.369289 29993 leader_election.cc:304] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:13.369804   413 leader_election.cc:290] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:13.370270 32579 raft_consensus.cc:3055] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:13.370682 32579 raft_consensus.cc:740] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:13.371497 32579 consensus_queue.cc:260] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:13.372623 32579 raft_consensus.cc:3060] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:13.373828   620 raft_consensus.cc:2804] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:13.376993   490 raft_consensus.cc:493] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:13.377568   490 raft_consensus.cc:515] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:13.324337   385 leader_election.cc:290] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:13.378997   620 raft_consensus.cc:697] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:13.379947   620 consensus_queue.cc:237] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:13.382376 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:13.382897   369 raft_consensus.cc:2749] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:13.382992 30176 raft_consensus.cc:2468] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 8.
I20260709 13:11:13.384806   423 raft_consensus.cc:2749] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:11:13.384955 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 53075.6us
I20260709 13:11:13.391271   369 consensus_queue.cc:1048] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:13.392166   652 consensus_queue.cc:1059] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:13.393134   652 raft_consensus.cc:3055] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:13.393494   652 raft_consensus.cc:740] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:13.412287   652 consensus_queue.cc:260] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:13.413566   652 raft_consensus.cc:3060] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:13.397835 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:13.400869 30100 raft_consensus.cc:1240] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:13.402496   606 consensus_queue.cc:1048] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:13.422984 30068 leader_election.cc:304] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:13.424252 30068 leader_election.cc:304] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:11:13.424469   423 raft_consensus.cc:2804] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:13.424947   423 raft_consensus.cc:493] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:13.425293   423 raft_consensus.cc:3060] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:13.426775   339 raft_consensus.cc:515] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:13.428922   339 leader_election.cc:290] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:13.403239 29993 leader_election.cc:304] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
W20260709 13:11:13.496026 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 92841.4us
I20260709 13:11:13.496575 30142 leader_election.cc:304] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:13.497260   535 raft_consensus.cc:2804] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:13.497666   535 raft_consensus.cc:493] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.497994   535 raft_consensus.cc:3060] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:13.405471   367 raft_consensus.cc:515] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:13.500171   367 leader_election.cc:290] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:13.500727   622 raft_consensus.cc:2749] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:13.411185   385 raft_consensus.cc:493] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:13.501545   385 raft_consensus.cc:515] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:13.503577   385 leader_election.cc:290] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:13.430722   449 raft_consensus.cc:3055] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:13.504123   449 raft_consensus.cc:740] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:13.504906   449 consensus_queue.cc:260] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:13.506157   449 raft_consensus.cc:3060] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:13.432384 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:13.435303   423 raft_consensus.cc:515] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:13.508399   423 leader_election.cc:290] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:13.510459 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:11:13.511976 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 87827.3us
I20260709 13:11:13.512715 30068 leader_election.cc:304] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:13.513532   432 raft_consensus.cc:2804] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:13.513957   432 raft_consensus.cc:493] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:13.514304   432 raft_consensus.cc:3060] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:13.439481   492 raft_consensus.cc:515] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:13.440974 30700 leader_election.cc:304] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:13.442039 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:13.518510   385 raft_consensus.cc:2804] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:13.519068   385 raft_consensus.cc:493] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:13.518421 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 77510.4us
I20260709 13:11:13.519405   385 raft_consensus.cc:3060] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:13.520301   440 consensus_queue.cc:1059] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:13.443421   641 raft_consensus.cc:2749] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:13.521845   539 raft_consensus.cc:3055] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:13.517975   423 raft_consensus.cc:2804] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:13.522217   539 raft_consensus.cc:740] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:13.522435   423 raft_consensus.cc:493] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:13.522872   423 raft_consensus.cc:3060] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:13.523104   539 consensus_queue.cc:260] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:13.524143 30068 leader_election.cc:304] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:11:13.524355   539 raft_consensus.cc:3060] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:13.524927 32762 raft_consensus.cc:2804] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:13.525309 32762 raft_consensus.cc:493] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.525637 32762 raft_consensus.cc:3060] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:13.526283 32766 raft_consensus.cc:493] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:13.526487   385 raft_consensus.cc:515] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:13.526952 32766 raft_consensus.cc:515] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:13.527498 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:13.528957 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:13.529068 32766 leader_election.cc:290] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:13.529481 30174 raft_consensus.cc:3060] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:13.402909 30702 leader_election.cc:304] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:13.530503   668 raft_consensus.cc:2749] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:11:13.531544 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 128732us
I20260709 13:11:13.528434   385 leader_election.cc:290] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:13.534577 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:13.470748 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:13.471283 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:13.535722 30175 raft_consensus.cc:3060] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:13.472198 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:13.472501 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:13.472894 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:13.536851 30172 raft_consensus.cc:2468] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 7.
I20260709 13:11:13.473239 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:13.473965 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:13.481575 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:13.538806 30100 raft_consensus.cc:2393] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 8: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:13.488668 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:13.539898 30102 raft_consensus.cc:3060] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:13.540518 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:13.540710 30176 raft_consensus.cc:2468] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 3.
I20260709 13:11:13.490460 30066 leader_election.cc:304] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
W20260709 13:11:13.542613 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 52214.3us
I20260709 13:11:13.543563 30702 leader_election.cc:304] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:13.542502 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:13.544818   440 raft_consensus.cc:2804] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:13.545209   440 raft_consensus.cc:493] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:13.545571   440 raft_consensus.cc:3060] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:13.546262 30175 raft_consensus.cc:2410] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:11:13.354315   644 raft_consensus.cc:2804] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:13.496652 29993 leader_election.cc:304] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
W20260709 13:11:13.550218 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 53651.2us
I20260709 13:11:13.400933   490 leader_election.cc:290] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:13.550426 30702 leader_election.cc:304] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:11:13.534736 30143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.550762   367 raft_consensus.cc:2804] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:13.551353   367 raft_consensus.cc:493] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.551728   367 raft_consensus.cc:3060] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:13.552070   668 consensus_queue.cc:1059] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:13.553213   668 raft_consensus.cc:2804] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:13.553479 32573 consensus_queue.cc:1048] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:13.553535   668 raft_consensus.cc:493] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:13.554395   668 raft_consensus.cc:3060] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:13.553776   385 raft_consensus.cc:3055] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:13.555405   385 raft_consensus.cc:740] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:13.555349   490 consensus_queue.cc:1048] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:13.556336   385 consensus_queue.cc:260] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:13.444456   670 log.cc:927] Time spent T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:11:13.558553 30702 leader_election.cc:304] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:13.558800   385 raft_consensus.cc:3060] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:13.559613   667 raft_consensus.cc:2749] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:13.561144 30702 leader_election.cc:304] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:13.447530 32753 raft_consensus.cc:515] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:13.562623 29993 leader_election.cc:304] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:13.563448 32573 raft_consensus.cc:2804] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:13.563812 32573 raft_consensus.cc:493] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:13.564680 32573 raft_consensus.cc:3060] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:13.565971 29993 leader_election.cc:304] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:13.566761   490 raft_consensus.cc:2804] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:13.567122   490 raft_consensus.cc:493] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:13.567461   490 raft_consensus.cc:3060] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:13.568369   668 raft_consensus.cc:515] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:13.570338 29993 leader_election.cc:304] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:13.571153 32579 raft_consensus.cc:2804] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Leader election won for term 10
W20260709 13:11:13.571811 30142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 75374.2us
I20260709 13:11:13.571956 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:13.572765 30022 raft_consensus.cc:2368] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 5. Current term is 6.
I20260709 13:11:13.574522 30700 leader_election.cc:400] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 election: Vote denied by peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451) with higher term. Message: Invalid argument: T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 5. Current term is 6.
I20260709 13:11:13.574966 30700 leader_election.cc:403] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:11:13.575553   622 consensus_queue.cc:1048] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:13.579005   440 raft_consensus.cc:515] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:13.594000   453 raft_consensus.cc:515] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:13.585994   432 raft_consensus.cc:515] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:13.587272 30102 raft_consensus.cc:2468] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 7.
I20260709 13:11:13.595227 30021 raft_consensus.cc:2368] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 6. Current term is 7.
I20260709 13:11:13.563838 32753 leader_election.cc:290] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:13.589944   492 leader_election.cc:290] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:13.590529   667 raft_consensus.cc:2749] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:13.597065   432 leader_election.cc:290] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:13.597728   432 raft_consensus.cc:2804] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:13.591858   339 raft_consensus.cc:3060] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:13.598403   453 leader_election.cc:290] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:13.599303   656 raft_consensus.cc:515] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:13.601519   656 leader_election.cc:290] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:13.593005 30702 leader_election.cc:304] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:13.591089   644 raft_consensus.cc:697] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:13.605713   644 consensus_queue.cc:237] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:13.589162 32762 raft_consensus.cc:515] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:13.608048 32762 leader_election.cc:290] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:13.610044   667 raft_consensus.cc:2749] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:13.611761 30702 leader_election.cc:304] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:13.612696   432 raft_consensus.cc:697] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 8 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:13.615356   432 consensus_queue.cc:237] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:13.619333   367 raft_consensus.cc:515] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:13.620769   667 raft_consensus.cc:2749] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:13.616336   535 raft_consensus.cc:515] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:13.617178   668 leader_election.cc:290] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:13.618083   440 leader_election.cc:290] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:13.628257 30024 raft_consensus.cc:2393] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 8: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:11:13.636236 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:13.636876 30176 raft_consensus.cc:3060] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:13.636986 30733 raft_consensus.cc:606] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 LEADER]: Received request to transfer leadership to TS 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:13.632819 30700 leader_election.cc:400] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 election: Vote denied by peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451) with higher term. Message: Invalid argument: T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 6. Current term is 7.
I20260709 13:11:13.639802 30700 leader_election.cc:403] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:11:13.636588 30102 raft_consensus.cc:1240] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 3. Current term is 4. Ops: []
W20260709 13:11:13.641280 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 69775.1us
I20260709 13:11:13.643702 30100 raft_consensus.cc:1275] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:11:13.549542 30174 raft_consensus.cc:2468] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 8.
I20260709 13:11:13.635262   339 raft_consensus.cc:2749] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451) with higher term. Message: Invalid argument: T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 5. Current term is 6.
I20260709 13:11:13.654330 30142 leader_election.cc:304] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:13.659876 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:13.660645 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:13.661167 30729 raft_consensus.cc:3060] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:13.662866 30171 raft_consensus.cc:1240] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:13.664098 30169 raft_consensus.cc:1240] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:13.665046 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:13.665810 30735 raft_consensus.cc:2393] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 9: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:11:13.593362   423 raft_consensus.cc:515] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:13.673542 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:13.651854 32579 raft_consensus.cc:697] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:13.679351 30024 raft_consensus.cc:1240] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:13.670059 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:13.680742 30097 raft_consensus.cc:1240] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 13:11:13.662377   613 raft_consensus.cc:3060] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:13.685068 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:13.689395 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:13.690544 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:13.690725 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:13.691608 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:13.693921 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:13.694291 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:13.696151 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:13.693907 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:13.667462 32753 raft_consensus.cc:2804] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:13.710471 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:13.711611 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:13.714028 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:13.714083 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:13.714489 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:13.715247 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:13.682976   367 leader_election.cc:290] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:13.720381 30019 raft_consensus.cc:1240] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:13.718537 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:13.718856 30021 raft_consensus.cc:2393] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 8: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:13.719393 30023 raft_consensus.cc:2393] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 6: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:11:13.720098 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:13.726780 30176 raft_consensus.cc:2468] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 8.
I20260709 13:11:13.731056 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:13.731653 30175 raft_consensus.cc:3060] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:13.734287 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:13.736070 30176 raft_consensus.cc:1240] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:13.736549 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:13.738747 30173 raft_consensus.cc:1240] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:13.738889 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:13.740356 30022 raft_consensus.cc:3055] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:13.740716 30022 raft_consensus.cc:740] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:13.743115 30175 raft_consensus.cc:2468] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 6.
I20260709 13:11:13.743896 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
W20260709 13:11:13.744805 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 218239us
I20260709 13:11:13.720359 32753 raft_consensus.cc:697] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 4 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:13.746042 30176 raft_consensus.cc:1240] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:13.750123 30175 raft_consensus.cc:1240] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 7. Current term is 8. Ops: [5.5-7.7]
I20260709 13:11:13.751767 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:13.755173 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:13.760878 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:13.766470 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:13.764120 30022 consensus_queue.cc:260] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:13.769345 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:13.770141 30175 raft_consensus.cc:2368] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 5. Current term is 6.
I20260709 13:11:13.770816 30068 leader_election.cc:304] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:11:13.782346 30068 leader_election.cc:304] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:13.782810 30022 raft_consensus.cc:3060] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:13.784124 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:13.792843 30175 raft_consensus.cc:1275] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 13:11:13.793262 30175 pending_rounds.cc:85] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124: Aborting all ops after (but not including) 5
I20260709 13:11:13.793468 30175 pending_rounds.cc:107] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 13:11:13.793677 30175 raft_consensus.cc:2889] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:13.794809 30701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:13.796716 30730 raft_consensus.cc:1275] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:13.797885 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:13.798985 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:13.800230 30730 raft_consensus.cc:1240] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:13.801991 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:13.806324 32762 raft_consensus.cc:2804] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:13.806738 32762 raft_consensus.cc:493] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:13.807085 32762 raft_consensus.cc:3060] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:13.809955 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 55306.5us
I20260709 13:11:13.753021 32579 consensus_queue.cc:237] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:13.811497 30702 leader_election.cc:304] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:13.812278   440 consensus_queue.cc:1059] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:13.812902 30702 leader_election.cc:304] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:13.813342   440 raft_consensus.cc:2749] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:13.813730 32753 consensus_queue.cc:237] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:13.834766 30735 raft_consensus.cc:1240] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:13.835345 32573 raft_consensus.cc:515] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:13.837960 30702 leader_election.cc:304] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:13.840842 30737 raft_consensus.cc:2468] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 7.
I20260709 13:11:13.821607 30025 raft_consensus.cc:2468] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 7.
W20260709 13:11:13.843819 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 61105.4us
I20260709 13:11:13.844229 30729 raft_consensus.cc:2468] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 10.
I20260709 13:11:13.844554 30068 leader_election.cc:304] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:11:13.846159 30022 raft_consensus.cc:2468] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 4.
I20260709 13:11:13.845583   339 raft_consensus.cc:2749] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:13.848547   413 consensus_queue.cc:1059] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:13.849295   413 raft_consensus.cc:3055] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:13.849601   413 raft_consensus.cc:740] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:13.850637 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:13.850443   413 consensus_queue.cc:260] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:13.851229   402 consensus_queue.cc:1059] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:13.851609   413 raft_consensus.cc:3060] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:13.852118 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:13.852039   402 raft_consensus.cc:3055] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:13.853888   402 raft_consensus.cc:740] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:13.855047   423 leader_election.cc:290] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:13.854691   402 consensus_queue.cc:260] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:13.845786   627 consensus_queue.cc:1059] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 13:11:13.855717   535 leader_election.cc:290] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:13.856182   539 raft_consensus.cc:2749] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:13.848461 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:13.859376 30702 leader_election.cc:400] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 election: Vote denied by peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001) with higher term. Message: Invalid argument: T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 5. Current term is 6.
I20260709 13:11:13.860010   453 consensus_queue.cc:1059] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:13.855870   402 raft_consensus.cc:3060] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:13.860971   453 consensus_queue.cc:1059] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:13.864326 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:13.864981 30174 raft_consensus.cc:2393] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 4: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:11:13.865949   668 consensus_queue.cc:1048] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:13.867228 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:13.868300 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:13.869364 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:13.845501   440 raft_consensus.cc:3055] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:13.870042 30734 raft_consensus.cc:3060] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:13.870162   440 raft_consensus.cc:740] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:13.871088   440 consensus_queue.cc:260] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:13.871482 30140 leader_election.cc:304] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:13.856704 29993 leader_election.cc:304] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:13.825340   490 raft_consensus.cc:515] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:13.882936 30024 raft_consensus.cc:1240] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:13.873420 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:13.884052 30735 raft_consensus.cc:3060] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:13.884721 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:13.885376 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:13.885948 30022 raft_consensus.cc:2468] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 4.
I20260709 13:11:13.886006 30068 leader_election.cc:304] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:13.886992 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:13.891369 30728 raft_consensus.cc:1240] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:13.861697   453 raft_consensus.cc:3055] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:13.872210   440 raft_consensus.cc:3060] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:13.898989   423 raft_consensus.cc:2804] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:13.907678 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:13.930920 29994 leader_election.cc:304] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:13.857800   393 consensus_queue.cc:1048] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260709 13:11:13.932312 29994 leader_election.cc:304] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:13.933831 29993 leader_election.cc:304] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:13.899684   576 consensus_queue.cc:1059] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.060s
I20260709 13:11:13.906405   453 raft_consensus.cc:740] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
W20260709 13:11:13.973151 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 88325.8us
W20260709 13:11:13.985654 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 53414us
I20260709 13:11:13.929476   423 raft_consensus.cc:493] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:13.899641 32762 raft_consensus.cc:515] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:13.983722 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:13.997428 30733 raft_consensus.cc:2393] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 8: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
W20260709 13:11:13.998795 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 65057.7us
I20260709 13:11:14.000453 29993 leader_election.cc:304] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:13.960389   620 raft_consensus.cc:2749] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:14.003273 32501 raft_consensus.cc:3055] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:14.003746 32501 raft_consensus.cc:740] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:14.004037   535 raft_consensus.cc:3060] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:14.004642 32501 consensus_queue.cc:260] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:14.005831   497 raft_consensus.cc:2804] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:14.006330   497 raft_consensus.cc:697] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
W20260709 13:11:14.004069   675 log.cc:927] Time spent T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:11:14.007146   497 consensus_queue.cc:237] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:13.928506   369 consensus_queue.cc:1059] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.064s
I20260709 13:11:13.996886 30066 leader_election.cc:304] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:14.018865   516 consensus_queue.cc:1048] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:14.020073 30026 raft_consensus.cc:1275] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:14.020390   516 consensus_queue.cc:1059] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:13.993261   648 raft_consensus.cc:2804] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:13.996666   423 raft_consensus.cc:3060] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:14.033030   676 raft_consensus.cc:2804] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:14.048792 30735 raft_consensus.cc:2468] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 8.
I20260709 13:11:14.010476   367 raft_consensus.cc:3055] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:14.016340 32501 raft_consensus.cc:3060] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:14.069650 30734 raft_consensus.cc:2468] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 10.
I20260709 13:11:14.047662   541 raft_consensus.cc:2804] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:14.066941   367 raft_consensus.cc:740] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
W20260709 13:11:14.102718 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 231285us
I20260709 13:11:14.103404 30140 leader_election.cc:304] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:11:14.106745 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 220808us
I20260709 13:11:14.107594 30068 leader_election.cc:304] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:14.081879   490 leader_election.cc:290] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:14.069868   620 consensus_queue.cc:1059] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 13:11:14.124115 30096 raft_consensus.cc:1240] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:14.083411   541 raft_consensus.cc:697] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:14.120661 30140 leader_election.cc:304] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:14.123286 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
W20260709 13:11:14.141213 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 166677us
I20260709 13:11:14.139745 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:14.144148 30066 leader_election.cc:304] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:14.149631 30100 raft_consensus.cc:3060] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:14.123937   613 raft_consensus.cc:2749] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451) with higher term. Message: Invalid argument: T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 6. Current term is 7.
I20260709 13:11:14.140918   402 raft_consensus.cc:2749] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:14.098541   432 consensus_queue.cc:1059] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260709 13:11:14.077085   453 consensus_queue.cc:260] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:14.127357 32573 leader_election.cc:290] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:14.172279 30140 leader_election.cc:304] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:11:14.176705 30702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:14.177649 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 70138.7us
I20260709 13:11:14.150352   687 raft_consensus.cc:2749] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:14.188064 30140 leader_election.cc:304] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:14.190220 30068 leader_election.cc:304] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:14.178529   449 raft_consensus.cc:3055] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:14.197392 30737 raft_consensus.cc:2468] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 7.
I20260709 13:11:14.183441 32753 raft_consensus.cc:2749] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:14.195205   413 raft_consensus.cc:2749] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:14.201869   449 raft_consensus.cc:740] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:14.217213   453 raft_consensus.cc:3060] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:14.247926 30098 raft_consensus.cc:1275] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:11:14.217813   402 raft_consensus.cc:2764] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 13:11:14.223791 32766 raft_consensus.cc:2749] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:14.227525 32762 leader_election.cc:290] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 10 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:14.229039   681 raft_consensus.cc:493] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:14.270509 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 85166.6us
W20260709 13:11:14.253888   606 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.006s	sys 0.017s
W20260709 13:11:14.278658 29994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:14.256501 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 112418us
I20260709 13:11:14.282760 32766 raft_consensus.cc:2749] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:14.256283   541 consensus_queue.cc:237] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:14.309680 30173 raft_consensus.cc:1240] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:14.288028 30094 raft_consensus.cc:1240] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:14.288201   490 raft_consensus.cc:3055] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:14.289868   681 raft_consensus.cc:515] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:14.293005   673 consensus_queue.cc:1048] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.068s
I20260709 13:11:14.296245 32762 raft_consensus.cc:2804] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:14.296844   449 consensus_queue.cc:260] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:14.297340   683 log.cc:927] Time spent T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
W20260709 13:11:14.297979   690 log.cc:927] Time spent T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
I20260709 13:11:14.272071   704 raft_consensus.cc:2749] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:14.303753 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:14.312345 30734 raft_consensus.cc:1275] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:11:14.226981   367 consensus_queue.cc:260] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:14.310881 30066 leader_election.cc:304] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:14.307540 30068 leader_election.cc:304] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:14.376180 30097 raft_consensus.cc:3060] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:14.326705 29993 leader_election.cc:304] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:14.337370 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
W20260709 13:11:14.306888   606 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.006s	sys 0.018s
W20260709 13:11:14.359102 30701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.314486   490 raft_consensus.cc:740] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:14.401952 30095 raft_consensus.cc:1240] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 13:11:14.408391 30731 raft_consensus.cc:1275] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 13:11:14.408596 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 101142us
I20260709 13:11:14.368706   440 consensus_queue.cc:1059] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 13:11:14.380895 32762 raft_consensus.cc:697] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 4 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
W20260709 13:11:14.393716 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 67139us
I20260709 13:11:14.379652   648 raft_consensus.cc:697] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
W20260709 13:11:14.419441 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 108612us
I20260709 13:11:14.422468   613 consensus_queue.cc:1059] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 13:11:14.424976   697 raft_consensus.cc:493] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:14.428123   697 raft_consensus.cc:515] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:14.430060   697 leader_election.cc:290] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:14.430460   720 raft_consensus.cc:2804] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:14.430866   720 raft_consensus.cc:493] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:14.431195   720 raft_consensus.cc:3060] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:14.433867   694 raft_consensus.cc:3055] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:14.434299   685 consensus_queue.cc:1059] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:11:14.434973 30068 leader_election.cc:304] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:14.435312   685 raft_consensus.cc:3055] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:14.435724   685 raft_consensus.cc:740] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:14.436565   685 consensus_queue.cc:260] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:14.436995 30068 leader_election.cc:304] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:14.408406   704 raft_consensus.cc:2749] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:14.424407 29993 leader_election.cc:304] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:14.417424   423 raft_consensus.cc:515] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:14.469197 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 44878.2us
I20260709 13:11:14.472966 30100 raft_consensus.cc:2468] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 8.
I20260709 13:11:14.433724   606 raft_consensus.cc:2749] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:14.437875   535 raft_consensus.cc:2749] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:14.434252   694 raft_consensus.cc:740] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:14.462299   685 raft_consensus.cc:3060] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:14.486410   694 consensus_queue.cc:260] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:14.440980 32766 raft_consensus.cc:2804] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:14.475711 32579 raft_consensus.cc:2804] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:14.437986   673 consensus_queue.cc:1048] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.058s
I20260709 13:11:14.490562 30737 raft_consensus.cc:1240] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:14.483266   676 raft_consensus.cc:493] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:14.494668 30024 raft_consensus.cc:1240] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:14.473628   697 raft_consensus.cc:2749] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:14.488008 30068 leader_election.cc:304] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:14.477293 29993 leader_election.cc:304] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:14.490223 32766 raft_consensus.cc:493] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:14.498863 32766 raft_consensus.cc:3060] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:14.496819   694 raft_consensus.cc:3060] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:14.502059 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 211293us
W20260709 13:11:14.505291 30143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.496618   676 raft_consensus.cc:3060] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:14.491536   709 raft_consensus.cc:2804] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:14.509517   708 raft_consensus.cc:3060] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:14.509866 30068 leader_election.cc:304] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:14.510735   423 leader_election.cc:290] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:14.511032   697 raft_consensus.cc:2804] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:14.511394   697 raft_consensus.cc:493] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:14.511750   697 raft_consensus.cc:3060] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:14.511686   641 consensus_queue.cc:1059] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:14.512571   641 raft_consensus.cc:3055] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:14.512912   641 raft_consensus.cc:740] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:14.513665   641 consensus_queue.cc:260] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:14.514519 30068 leader_election.cc:304] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:14.520174   697 raft_consensus.cc:515] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:14.520620 30097 raft_consensus.cc:2468] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 7.
I20260709 13:11:14.522434   715 raft_consensus.cc:2749] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:14.524188 30068 leader_election.cc:304] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:14.525005   715 raft_consensus.cc:2749] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:14.526136 30068 leader_election.cc:304] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:14.525858   648 consensus_queue.cc:237] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:14.528136 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 145059us
I20260709 13:11:14.514600   641 raft_consensus.cc:3060] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:14.509670   681 leader_election.cc:290] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:14.542563   717 raft_consensus.cc:2804] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:14.528676 32579 raft_consensus.cc:697] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:14.537910   709 raft_consensus.cc:697] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 5 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:14.553776   423 raft_consensus.cc:2749] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:14.506281 32762 consensus_queue.cc:237] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:14.574813 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 48754.6us
I20260709 13:11:14.572983   708 raft_consensus.cc:2749] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:14.575796 32766 raft_consensus.cc:515] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:14.571797   717 raft_consensus.cc:697] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:14.592132 32766 leader_election.cc:290] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:14.591815   717 consensus_queue.cc:237] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:14.578642   720 raft_consensus.cc:515] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:14.594121   720 leader_election.cc:290] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:14.581174   709 consensus_queue.cc:237] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:14.582280 32579 consensus_queue.cc:237] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:14.588351   676 raft_consensus.cc:515] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:14.597177   676 leader_election.cc:290] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:14.585928   698 raft_consensus.cc:493] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:14.598094   698 raft_consensus.cc:515] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:14.599336   725 consensus_queue.cc:1059] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:14.600142   698 leader_election.cc:290] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:14.600293   725 raft_consensus.cc:3055] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:14.600685   725 raft_consensus.cc:740] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:14.597107 30068 leader_election.cc:304] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
W20260709 13:11:14.585857 29991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.619150 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:14.619439 30068 leader_election.cc:304] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:14.620326   676 raft_consensus.cc:2749] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:14.620796 30068 leader_election.cc:304] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:14.621652   676 raft_consensus.cc:2804] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:14.622033   676 raft_consensus.cc:493] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:14.622401   676 raft_consensus.cc:3060] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:14.622606 30068 leader_election.cc:304] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:14.623413   720 raft_consensus.cc:2804] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:14.623896   720 raft_consensus.cc:697] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 8 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:14.624696   720 consensus_queue.cc:237] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:14.618122   694 raft_consensus.cc:2749] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:14.626907 30731 raft_consensus.cc:2368] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 9. Current term is 10.
I20260709 13:11:14.627116 30068 leader_election.cc:304] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:14.601374   697 leader_election.cc:290] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:14.587111   541 consensus_queue.cc:1048] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.053s
I20260709 13:11:14.633495   725 consensus_queue.cc:260] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:14.639523   725 raft_consensus.cc:3060] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:14.640407   668 raft_consensus.cc:3055] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:14.640823   668 raft_consensus.cc:740] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:14.642207   640 raft_consensus.cc:493] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:14.642711   640 raft_consensus.cc:515] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:14.644878   640 leader_election.cc:290] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:14.644691   490 consensus_queue.cc:260] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:14.653139 30142 leader_election.cc:400] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469) with higher term. Message: Invalid argument: T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 9. Current term is 10.
I20260709 13:11:14.653513 30142 leader_election.cc:403] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:14.654256   687 raft_consensus.cc:3060] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:11:14.658476   676 raft_consensus.cc:515] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:14.660702   676 leader_election.cc:290] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:14.669672 30025 raft_consensus.cc:1275] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:14.670006 30102 raft_consensus.cc:1240] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:14.674642 30020 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
mode: GRACEFUL
new_leader_uuid: "5ec73dc157ed476ca903a7d596271719"
 from {username='slave'} at 127.0.0.1:47450
I20260709 13:11:14.675241 30020 raft_consensus.cc:606] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Received request to transfer leadership to TS 5ec73dc157ed476ca903a7d596271719
W20260709 13:11:14.676254   701 log.cc:927] Time spent T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.267s	user 0.002s	sys 0.000s
I20260709 13:11:14.677879   613 consensus_queue.cc:1048] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:14.672113   697 raft_consensus.cc:2804] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:14.678915   697 raft_consensus.cc:697] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 8 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:14.679347 28889 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:11:14.681147 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:14.679818   697 consensus_queue.cc:237] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:14.645746   490 raft_consensus.cc:3060] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:14.692371 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 75373.7us
I20260709 13:11:14.692890 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:14.697139 30096 raft_consensus.cc:1240] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:14.697535 30097 raft_consensus.cc:1240] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:14.714214 30020 raft_consensus.cc:1240] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 LEADER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:11:14.715945 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:14.716941 30027 raft_consensus.cc:1275] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:11:14.717891 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:14.718811 30026 raft_consensus.cc:1275] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 13:11:14.722213 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:14.722764 30175 raft_consensus.cc:3060] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:14.723160 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:14.729995 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:14.718111 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:14.730654 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:14.730782 30173 raft_consensus.cc:1275] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:11:14.731081 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:14.730654 30027 raft_consensus.cc:2393] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 7: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:11:14.732501 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:14.733147 30097 raft_consensus.cc:2468] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 5.
I20260709 13:11:14.703087 29993 leader_election.cc:304] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:14.735599 30174 raft_consensus.cc:2393] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 9: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:11:14.737412 30021 raft_consensus.cc:1240] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:14.740549 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:14.641655   668 consensus_queue.cc:260] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:14.742770 30168 raft_consensus.cc:1240] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:14.744246 30169 raft_consensus.cc:1275] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 13:11:14.750367 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:14.753510   713 raft_consensus.cc:2804] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:14.729817   369 consensus_queue.cc:1048] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.013s
I20260709 13:11:14.756162 30175 raft_consensus.cc:2468] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 9.
I20260709 13:11:14.758149 30101 raft_consensus.cc:1240] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:14.746151   673 consensus_queue.cc:1048] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:11:14.760748   720 raft_consensus.cc:493] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.764403   720 raft_consensus.cc:515] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:14.738055 32762 consensus_queue.cc:1048] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:11:14.766517   720 leader_election.cc:290] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:14.762893 32766 consensus_queue.cc:1059] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:14.768060 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:14.769565 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:14.777640 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:14.779551 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:14.782960   613 raft_consensus.cc:493] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.783455   613 raft_consensus.cc:515] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:14.784758 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:14.787400 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:14.787519 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:14.790122 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:14.792939 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:14.793219 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:14.793473 30735 raft_consensus.cc:2468] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 3.
I20260709 13:11:14.794598 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:14.796399 30098 raft_consensus.cc:2468] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 6.
I20260709 13:11:14.796504 30176 raft_consensus.cc:2393] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 8: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:11:14.798581 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:14.798982 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:14.801959 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:14.802685 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:14.802698 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:14.805351 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:14.805465 30175 raft_consensus.cc:1240] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:14.805989 30729 raft_consensus.cc:3060] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:14.807482 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:14.808043 30175 raft_consensus.cc:1275] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:11:14.810300 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:14.811559 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:14.812314 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:14.812538 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:14.813055 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:14.813633 30098 raft_consensus.cc:2468] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 5.
I20260709 13:11:14.812247 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:14.813843 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:14.815882 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:14.816388 30176 raft_consensus.cc:2393] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 4: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:11:14.817122 30729 raft_consensus.cc:2468] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 8.
I20260709 13:11:14.817258 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:14.802026 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:14.819658 30731 raft_consensus.cc:1240] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 LEADER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:14.819625 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:14.820389 30177 raft_consensus.cc:3060] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:14.820428 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:14.814829 29993 leader_election.cc:304] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:14.768599   713 raft_consensus.cc:697] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:14.817831 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:14.822641 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:14.818254 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 11 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:14.817425 30025 raft_consensus.cc:2468] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 4.
I20260709 13:11:14.826874 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:14.819865 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:14.796541 32762 raft_consensus.cc:3055] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:14.824818 30143 leader_election.cc:304] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:14.825222   725 raft_consensus.cc:2749] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:14.828111 30097 raft_consensus.cc:1240] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 13:11:14.832852 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:14.834465 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:14.831743 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:14.814232 32501 raft_consensus.cc:493] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.837270 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:14.837324 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:14.835052 30021 raft_consensus.cc:2468] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 6.
W20260709 13:11:14.846156 30066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.847569 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:14.848695 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:14.839049   641 raft_consensus.cc:2749] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:14.852371 30101 raft_consensus.cc:1275] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:14.853119 30143 leader_election.cc:304] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:14.854049 30736 raft_consensus.cc:1240] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:14.855154 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:14.849838 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:14.850350 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:14.851229 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:14.830013 32762 raft_consensus.cc:740] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:14.862854 29993 leader_election.cc:304] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:14.863582 30097 raft_consensus.cc:2393] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 10: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:14.864624 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:14.856416 30096 raft_consensus.cc:2393] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 6: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:14.857398   613 leader_election.cc:290] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:14.850171   713 consensus_queue.cc:237] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:14.841733   676 raft_consensus.cc:493] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.858318   703 consensus_queue.cc:1059] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:14.886969 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:14.887400   703 raft_consensus.cc:3055] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:14.832144 32753 consensus_queue.cc:1059] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:11:14.887913   703 raft_consensus.cc:740] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:14.888651 32753 raft_consensus.cc:3055] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:14.859671 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:14.842111   687 raft_consensus.cc:2749] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469) with higher term. Message: Invalid argument: T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 9. Current term is 10.
I20260709 13:11:14.846503 32501 raft_consensus.cc:515] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:14.856096 30730 raft_consensus.cc:2393] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 7: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:11:14.869206 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:14.872309   535 consensus_queue.cc:1048] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:14.875923 32762 consensus_queue.cc:260] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:14.876744 30177 raft_consensus.cc:2468] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 8.
I20260709 13:11:14.877017 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:14.878911 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:14.882431 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:14.888379   676 raft_consensus.cc:515] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:14.887558 30169 raft_consensus.cc:2468] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 6.
I20260709 13:11:14.877684   673 raft_consensus.cc:2749] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:14.859805   711 consensus_queue.cc:1048] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 13:11:14.893095 30735 raft_consensus.cc:2468] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 5.
I20260709 13:11:14.898142 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:14.901044 30101 raft_consensus.cc:2393] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 8: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:14.902247 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:14.906128 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:14.907410 30097 raft_consensus.cc:2393] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 6: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
W20260709 13:11:14.906345 30703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.886091   606 raft_consensus.cc:2804] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:14.885558   641 raft_consensus.cc:493] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.889056 32753 raft_consensus.cc:740] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:14.911682 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:14.921639 30103 raft_consensus.cc:2368] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 6. Current term is 7.
I20260709 13:11:14.922686 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:14.923280 30103 raft_consensus.cc:2468] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 6.
I20260709 13:11:14.924093 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:14.925105 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:14.913806 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:14.906858   369 raft_consensus.cc:493] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:14.911755 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:14.926371 30101 raft_consensus.cc:2393] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 8: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:14.926152   369 raft_consensus.cc:515] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:14.918594 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:14.926548 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:14.927459 30094 raft_consensus.cc:2368] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 6. Current term is 7.
I20260709 13:11:14.926268 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:14.928310   369 leader_election.cc:290] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:14.928539 30094 raft_consensus.cc:1240] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:14.928906 30103 raft_consensus.cc:1275] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 13:11:14.929795 30094 raft_consensus.cc:1275] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:14.929870 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:14.930505 30169 raft_consensus.cc:2468] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 6.
I20260709 13:11:14.930990 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:14.933921 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:14.938071 29993 leader_election.cc:304] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
W20260709 13:11:14.938552 30067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.931236   641 raft_consensus.cc:515] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:14.943994 30143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.940958   641 leader_election.cc:290] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:14.954361 29993 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:14.933563 32762 raft_consensus.cc:3060] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:14.964991 30098 raft_consensus.cc:2468] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 6.
I20260709 13:11:14.936133   606 raft_consensus.cc:697] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:14.960314   656 raft_consensus.cc:2804] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:14.941296   369 consensus_queue.cc:1059] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260709 13:11:14.960440   711 consensus_queue.cc:1059] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.047s
I20260709 13:11:15.006106   656 raft_consensus.cc:493] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:15.029527   738 log.cc:927] Time spent T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 13:11:15.025257   656 raft_consensus.cc:3060] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:15.043247 30702 leader_election.cc:304] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:15.044492   641 raft_consensus.cc:493] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:15.055510 32579 raft_consensus.cc:3055] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:15.057861   449 raft_consensus.cc:3060] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:15.059257 32753 consensus_queue.cc:260] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:15.066286 30143 leader_election.cc:304] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:15.069379 30703 leader_election.cc:304] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:15.073432 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:15.073911 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:15.075330 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:15.076534 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:15.078066 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:15.092701 30098 raft_consensus.cc:2468] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 4.
I20260709 13:11:15.080197 30171 raft_consensus.cc:1275] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:11:15.093394 30171 pending_rounds.cc:85] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124: Aborting all ops after (but not including) 8
I20260709 13:11:15.093627 30171 pending_rounds.cc:107] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:11:15.093880 30171 raft_consensus.cc:2889] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:15.092381 30019 raft_consensus.cc:2468] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 4.
I20260709 13:11:15.096158 30703 leader_election.cc:304] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:15.091781 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:15.097468 30094 raft_consensus.cc:2376] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 6. Re-sending same reply.
I20260709 13:11:15.081121 30068 leader_election.cc:304] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:15.102259   743 raft_consensus.cc:2749] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:11:15.179921 30701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:15.184379 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 88294.5us
I20260709 13:11:15.185185 30703 leader_election.cc:304] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:15.089810   640 raft_consensus.cc:2804] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:15.087301 32579 raft_consensus.cc:740] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:15.195576 30066 leader_election.cc:304] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:15.196337   676 leader_election.cc:290] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:15.083462   606 consensus_queue.cc:237] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:15.197659 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 116591us
I20260709 13:11:15.102891   695 raft_consensus.cc:2749] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:15.199226 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:15.207221 30100 raft_consensus.cc:2468] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 6.
I20260709 13:11:15.199779   720 raft_consensus.cc:2749] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:15.189798   640 raft_consensus.cc:493] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:15.088460   641 raft_consensus.cc:515] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:15.193115 32501 leader_election.cc:290] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:15.223014 30140 leader_election.cc:304] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:15.204340   627 raft_consensus.cc:2749] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:15.218554   676 raft_consensus.cc:2804] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:11:15.231267 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:15.223827   640 raft_consensus.cc:3060] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:15.234619   695 raft_consensus.cc:493] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.230119   743 raft_consensus.cc:2749] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:15.231441   698 raft_consensus.cc:2804] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:15.223595   697 consensus_queue.cc:1048] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.016s
I20260709 13:11:15.241801   695 raft_consensus.cc:515] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:15.246515 30100 raft_consensus.cc:1240] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:15.238207   676 raft_consensus.cc:697] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 4 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:15.244711   698 raft_consensus.cc:493] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:15.247968   697 consensus_queue.cc:1243] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer c99569d27a6f4c648eae7119fe3db124 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 13:11:15.347245 30101 raft_consensus.cc:1240] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 6. Current term is 7. Ops: []
W20260709 13:11:15.348284 30142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 255076us
I20260709 13:11:15.337157   698 raft_consensus.cc:3060] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:15.269731   656 raft_consensus.cc:515] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:15.364811 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 298602us
I20260709 13:11:15.365582 30143 leader_election.cc:304] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:11:15.362429 30702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.338092   449 raft_consensus.cc:493] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
W20260709 13:11:15.372152 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 176636us
W20260709 13:11:15.374181 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 189053us
I20260709 13:11:15.374637 30066 leader_election.cc:304] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:15.374990 30703 leader_election.cc:304] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:11:15.375154 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 168413us
I20260709 13:11:15.270361   676 consensus_queue.cc:237] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:15.377231 30068 leader_election.cc:304] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:15.354651   402 raft_consensus.cc:493] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.381387 30068 leader_election.cc:304] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
W20260709 13:11:15.382572 30066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.383644 30703 leader_election.cc:400] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 election: Vote denied by peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821) with higher term. Message: Invalid argument: T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 6. Current term is 7.
I20260709 13:11:15.363425   339 raft_consensus.cc:493] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:15.384913 30143 leader_election.cc:304] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:15.386827 30068 leader_election.cc:304] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:15.391002 30028 raft_consensus.cc:3060] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:15.376648   687 raft_consensus.cc:2749] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:15.384040   720 raft_consensus.cc:2804] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:11:15.388257   748 log.cc:927] Time spent T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 13:11:15.397289 30703 leader_election.cc:304] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:15.385928   627 raft_consensus.cc:3060] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:15.404960 30703 leader_election.cc:304] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:15.400561 30143 leader_election.cc:304] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:15.384114   715 raft_consensus.cc:3060] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:15.402226 30023 raft_consensus.cc:1275] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:15.406239 30703 leader_election.cc:304] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:15.382530   685 consensus_queue.cc:1059] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 13:11:15.414165 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:15.415545 30022 raft_consensus.cc:2468] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 7.
W20260709 13:11:15.414572   758 log.cc:927] Time spent T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 13:11:15.391932   339 raft_consensus.cc:515] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:15.398171   641 leader_election.cc:290] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:15.418124   339 leader_election.cc:290] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:15.384246   402 raft_consensus.cc:515] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:15.418598   440 raft_consensus.cc:2749] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:15.408560   762 raft_consensus.cc:2749] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:15.420318   402 leader_election.cc:290] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:15.423669 30143 leader_election.cc:304] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:15.430001   761 consensus_queue.cc:1059] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:15.430879   613 raft_consensus.cc:3060] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:15.431309 30703 leader_election.cc:304] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:15.384188   449 raft_consensus.cc:515] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:15.434603   743 raft_consensus.cc:2749] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:15.435774   449 leader_election.cc:290] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:15.435775 30703 leader_election.cc:400] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 election: Vote denied by peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821) with higher term. Message: Invalid argument: T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 6. Current term is 7.
I20260709 13:11:15.438077   641 raft_consensus.cc:2749] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:15.439560 30703 leader_election.cc:304] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:15.388479   714 consensus_queue.cc:1059] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:11:15.441677   743 raft_consensus.cc:2749] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:11:15.442133   703 consensus_queue.cc:260] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:15.443397   703 raft_consensus.cc:3060] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:15.403015   720 raft_consensus.cc:493] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:15.444625   720 raft_consensus.cc:3060] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:15.447242 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:15.447892 30173 raft_consensus.cc:2468] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 5.
I20260709 13:11:15.448813 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:15.449524 30174 raft_consensus.cc:2393] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 9: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:11:15.403652   495 raft_consensus.cc:2749] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:15.431250   761 raft_consensus.cc:3055] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 7 LEADER]: Stepping down as leader of term 7
W20260709 13:11:15.478175 30703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:15.478509 29993 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.472783 30143 leader_election.cc:304] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:15.483845   772 raft_consensus.cc:2749] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:15.484418   765 raft_consensus.cc:493] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:15.484596   772 consensus_queue.cc:1048] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:15.484963   765 raft_consensus.cc:515] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:15.485953 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 99183.9us
I20260709 13:11:15.486708 30068 leader_election.cc:304] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:15.487562 30068 leader_election.cc:304] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:15.487775   676 raft_consensus.cc:2749] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:15.488564   676 raft_consensus.cc:2749] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:15.489159 30068 leader_election.cc:304] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:15.490545 30068 leader_election.cc:304] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
W20260709 13:11:15.491873 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 81277.8us
I20260709 13:11:15.471719   402 raft_consensus.cc:2749] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:15.495591 30730 raft_consensus.cc:1275] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:15.497045   668 raft_consensus.cc:3060] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:15.493332   492 consensus_queue.cc:1048] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 13:11:15.500062   613 raft_consensus.cc:2749] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:15.501942   656 leader_election.cc:290] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:15.480674   761 raft_consensus.cc:740] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:15.507540 30731 raft_consensus.cc:1275] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:11:15.482096   620 raft_consensus.cc:493] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.503579 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:15.494900 30068 leader_election.cc:304] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:15.520179 30734 raft_consensus.cc:2468] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 9.
I20260709 13:11:15.522492 30068 leader_election.cc:304] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:15.523880 29993 leader_election.cc:304] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:15.493455   763 raft_consensus.cc:2749] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:15.503199   695 leader_election.cc:290] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:15.514779 32762 raft_consensus.cc:2749] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:15.502391   765 leader_election.cc:290] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:15.489866   440 consensus_queue.cc:1048] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 13:11:15.541296 30068 leader_election.cc:304] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:15.482543   743 consensus_queue.cc:1048] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 13:11:15.507908   676 raft_consensus.cc:2749] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:15.535564   652 raft_consensus.cc:2804] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:15.540429   770 raft_consensus.cc:2749] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:15.506203   760 raft_consensus.cc:2749] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:15.557893 30068 leader_election.cc:304] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:15.561903 30068 leader_election.cc:304] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:15.540316   774 raft_consensus.cc:2804] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:15.564083 30068 leader_election.cc:304] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:15.566599 30068 leader_election.cc:304] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:15.530820   449 consensus_queue.cc:1048] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 13:11:15.524019   620 raft_consensus.cc:515] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:15.571372 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:15.559909   765 raft_consensus.cc:2749] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:15.587791 29993 leader_election.cc:304] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:15.584685 30173 raft_consensus.cc:3060] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:15.558916   652 raft_consensus.cc:493] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:15.564859   676 raft_consensus.cc:2804] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:15.581773   763 raft_consensus.cc:2749] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:15.568185   770 raft_consensus.cc:2749] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:15.580464   774 raft_consensus.cc:697] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 8 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:15.594785   676 raft_consensus.cc:493] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:15.595379 30169 raft_consensus.cc:1275] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:11:15.606105 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 112564us
I20260709 13:11:15.603488   627 raft_consensus.cc:2749] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:15.614285   606 raft_consensus.cc:2804] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:15.596540   652 raft_consensus.cc:3060] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:15.541345   761 consensus_queue.cc:260] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:15.620725 30028 raft_consensus.cc:1275] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:11:15.621459 30143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.611687   676 raft_consensus.cc:3060] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:15.591285   656 consensus_queue.cc:1048] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 13:11:15.631587   761 raft_consensus.cc:3060] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:15.632009   747 log.cc:927] Time spent T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.544s	user 0.007s	sys 0.000s
I20260709 13:11:15.635031   774 consensus_queue.cc:237] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:15.618018   606 raft_consensus.cc:493] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:15.641463   715 raft_consensus.cc:2749] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:15.654834 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:15.655392 30103 raft_consensus.cc:3060] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:15.656553   698 raft_consensus.cc:515] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:15.627593   760 raft_consensus.cc:493] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:15.657408   760 raft_consensus.cc:515] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:15.651834 30140 leader_election.cc:304] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
W20260709 13:11:15.660856 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 94322.9us
I20260709 13:11:15.661244 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:15.662875 30068 leader_election.cc:304] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:15.631592   773 raft_consensus.cc:2749] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:15.661866 30028 raft_consensus.cc:2468] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 9.
I20260709 13:11:15.668289 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:15.668898 30025 raft_consensus.cc:2468] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 9.
I20260709 13:11:15.669392 30140 leader_election.cc:304] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:15.671917 30068 leader_election.cc:304] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:15.675565 30097 raft_consensus.cc:1240] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:15.675595 30066 leader_election.cc:304] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:15.676100 30095 raft_consensus.cc:1240] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:15.682803   640 raft_consensus.cc:515] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:15.686254   687 raft_consensus.cc:2804] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:15.686650   687 raft_consensus.cc:493] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:15.687058   687 raft_consensus.cc:3060] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:15.690968 30098 raft_consensus.cc:1240] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:15.653061   606 raft_consensus.cc:3060] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:15.693075 30068 leader_election.cc:304] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:15.693269 30173 raft_consensus.cc:2468] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 7.
I20260709 13:11:15.693847 30103 raft_consensus.cc:2468] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 7.
I20260709 13:11:15.691887   770 raft_consensus.cc:2749] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:15.695097   777 raft_consensus.cc:2804] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:15.695550   780 consensus_queue.cc:1059] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:15.696278   781 consensus_queue.cc:1048] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 13:11:15.696597   780 raft_consensus.cc:3055] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:15.696938   780 raft_consensus.cc:740] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:15.697636   724 consensus_queue.cc:1048] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.087s
I20260709 13:11:15.698931   778 raft_consensus.cc:493] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.699409   778 raft_consensus.cc:515] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:15.676359   715 raft_consensus.cc:2749] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:15.705323   760 leader_election.cc:290] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:15.705731   780 consensus_queue.cc:260] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:15.708089   780 raft_consensus.cc:3060] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:15.710398 30099 raft_consensus.cc:1275] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:15.713018   698 leader_election.cc:290] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:15.714387 30068 leader_election.cc:304] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:15.701521   778 leader_election.cc:290] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:15.686569   640 leader_election.cc:290] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:11:15.717371 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 113278us
I20260709 13:11:15.695485   777 raft_consensus.cc:493] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:15.717612 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:15.718778 30098 raft_consensus.cc:2468] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 5.
I20260709 13:11:15.720431 30068 leader_election.cc:304] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:15.685658   620 leader_election.cc:290] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:15.715587   773 raft_consensus.cc:2749] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:15.731033 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:15.731602 30098 raft_consensus.cc:2468] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 8.
I20260709 13:11:15.733137 30143 leader_election.cc:304] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:15.728081 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:15.734217 30174 raft_consensus.cc:2468] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 6.
I20260709 13:11:15.734849 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:15.727240 30103 raft_consensus.cc:1240] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:15.727249 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:15.736020 30097 raft_consensus.cc:2376] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 6. Re-sending same reply.
I20260709 13:11:15.737178 30171 raft_consensus.cc:1275] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:11:15.739084 30174 raft_consensus.cc:1275] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:11:15.741746 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:11:15.744570 30068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:15.743914 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:15.721441   711 raft_consensus.cc:493] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.750291 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:15.750924 30176 raft_consensus.cc:2468] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 8.
I20260709 13:11:15.751003 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:15.747280 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:15.745046 30171 pending_rounds.cc:85] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124: Aborting all ops after (but not including) 3
I20260709 13:11:15.723721   770 raft_consensus.cc:2749] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:15.721992   777 raft_consensus.cc:3060] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:15.750276 30733 raft_consensus.cc:2393] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 9: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:11:15.752043 30171 pending_rounds.cc:107] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124: Aborting uncommitted NO_OP operation due to leader change: 6.4
I20260709 13:11:15.752410 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:15.750025 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:15.753929   771 raft_consensus.cc:2804] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:15.754432 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:15.754911 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:15.767500 30022 raft_consensus.cc:3060] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:15.756111   781 consensus_queue.cc:1048] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:15.725294   715 raft_consensus.cc:2749] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:15.757454 32579 consensus_queue.cc:260] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:15.763882 30171 raft_consensus.cc:2889] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:15.764075 30098 raft_consensus.cc:3060] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:15.812130 30100 raft_consensus.cc:2393] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 10: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:15.739853   695 raft_consensus.cc:493] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.717971   720 raft_consensus.cc:515] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:15.818150 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 65924.7us
I20260709 13:11:15.821638 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:15.822827 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:15.823149 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:15.827910 30100 raft_consensus.cc:1240] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 6. Current term is 7. Ops: []
W20260709 13:11:15.811117   749 log.cc:927] Time spent T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:11:15.835708 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:15.811522   620 raft_consensus.cc:493] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.765429   771 raft_consensus.cc:493] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:15.836301 30099 raft_consensus.cc:2468] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 7.
W20260709 13:11:15.837051 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 91099.7us
W20260709 13:11:15.830849   748 log.cc:927] Time spent T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 13:11:15.748669   652 raft_consensus.cc:515] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:15.841816 30022 raft_consensus.cc:2468] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 5.
I20260709 13:11:15.830478   770 consensus_queue.cc:1048] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
W20260709 13:11:15.856542 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 103689us
I20260709 13:11:15.859961 30068 leader_election.cc:304] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:15.861143 30098 raft_consensus.cc:2468] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 7.
I20260709 13:11:15.865291 30099 raft_consensus.cc:1275] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:15.871793 30028 raft_consensus.cc:1240] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:15.848352   771 raft_consensus.cc:3060] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:15.825093   695 raft_consensus.cc:515] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:15.858188   777 raft_consensus.cc:515] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:15.765100   711 raft_consensus.cc:515] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:15.878962   720 leader_election.cc:290] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:15.881246   711 leader_election.cc:290] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:15.884927 32719 raft_consensus.cc:3055] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:15.885310 32719 raft_consensus.cc:740] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:15.886080 32719 consensus_queue.cc:260] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:15.887040 32719 raft_consensus.cc:3060] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:15.891320   627 raft_consensus.cc:493] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:15.891819   627 raft_consensus.cc:515] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:15.898130 30101 raft_consensus.cc:2393] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 9: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:15.897163 30703 leader_election.cc:304] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:15.911060 30703 leader_election.cc:304] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:15.914314 30703 leader_election.cc:304] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:15.915776 30098 raft_consensus.cc:1275] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:11:15.917155   640 raft_consensus.cc:2749] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:15.848661   620 raft_consensus.cc:515] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:15.917199 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:15.893738   627 leader_election.cc:290] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:15.950682 30095 raft_consensus.cc:2468] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 4.
I20260709 13:11:15.947682 30732 raft_consensus.cc:3060] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:15.909866   668 raft_consensus.cc:493] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.951687   668 raft_consensus.cc:515] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:15.917289   743 raft_consensus.cc:2749] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:11:15.962445 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 48203.3us
I20260709 13:11:15.963280 30703 leader_election.cc:304] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:11:15.926671 32753 raft_consensus.cc:3060] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:15.972232 30729 raft_consensus.cc:1275] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:15.956959   367 raft_consensus.cc:3060] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:15.979245   777 leader_election.cc:290] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:15.912220   687 raft_consensus.cc:515] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:15.967921   640 raft_consensus.cc:2804] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:15.961774   652 leader_election.cc:290] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:15.961979   627 raft_consensus.cc:3060] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:15.998641 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:15.974265   668 leader_election.cc:290] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:15.999511 30098 raft_consensus.cc:2468] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 8.
I20260709 13:11:15.993297   713 raft_consensus.cc:493] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:15.999898   640 raft_consensus.cc:697] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:16.000804   714 consensus_queue.cc:1048] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.004s
I20260709 13:11:16.007063   687 leader_election.cc:290] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:11:16.008713 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 275625us
I20260709 13:11:16.025143 30703 leader_election.cc:304] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:11:16.010689 29993 leader_election.cc:304] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
W20260709 13:11:16.012732 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 156302us
I20260709 13:11:16.013541 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:16.002807   676 raft_consensus.cc:515] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:16.018476 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:16.018169   640 consensus_queue.cc:237] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:16.031771 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:16.032306 30174 raft_consensus.cc:3060] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:16.018939   786 log.cc:927] Time spent T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 13:11:16.019366   785 log.cc:927] Time spent T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:11:16.011395   780 raft_consensus.cc:493] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.020016   714 consensus_queue.cc:1059] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:16.016616   761 raft_consensus.cc:2749] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:16.020632   576 consensus_queue.cc:1048] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:16.038970 29993 leader_election.cc:304] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:16.033859 30168 raft_consensus.cc:1275] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:11:16.035336 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:16.022070   777 raft_consensus.cc:493] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.040704 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:16.045148 30169 raft_consensus.cc:2468] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 8.
I20260709 13:11:16.004820   713 raft_consensus.cc:515] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:16.020931   695 leader_election.cc:290] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:16.044325 30095 raft_consensus.cc:3060] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:16.049201 30174 raft_consensus.cc:2468] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 6.
I20260709 13:11:16.053045 29993 leader_election.cc:304] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:16.046299 30143 leader_election.cc:304] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:16.055588 30732 raft_consensus.cc:2468] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 7.
I20260709 13:11:16.033700   516 raft_consensus.cc:2804] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:16.062276 30143 leader_election.cc:304] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:16.063894   761 raft_consensus.cc:2804] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:16.045313   613 raft_consensus.cc:2804] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:16.065438 30737 raft_consensus.cc:1275] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:16.029863   652 consensus_queue.cc:1059] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:11:16.060439 30140 leader_election.cc:304] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:16.051345   771 raft_consensus.cc:515] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:16.054848   541 raft_consensus.cc:2804] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:16.061069   497 raft_consensus.cc:2804] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:16.060536   703 raft_consensus.cc:493] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:16.071519   613 raft_consensus.cc:493] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:16.052830   780 raft_consensus.cc:515] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:16.071986   516 raft_consensus.cc:697] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:16.053575   777 raft_consensus.cc:515] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:16.100256   541 raft_consensus.cc:493] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:16.126387   613 raft_consensus.cc:3060] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:16.131664 30173 raft_consensus.cc:1275] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:11:16.107021   687 raft_consensus.cc:2804] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:16.120332   497 raft_consensus.cc:493] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:16.122756   715 raft_consensus.cc:2749] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:16.151765   806 raft_consensus.cc:493] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:16.152381   806 raft_consensus.cc:515] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:16.154618   806 leader_election.cc:290] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:16.134244   620 leader_election.cc:290] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:16.135037   541 raft_consensus.cc:3060] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:16.136127 32719 consensus_queue.cc:1048] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
W20260709 13:11:16.165094   796 log.cc:927] Time spent T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:11:16.140894   497 raft_consensus.cc:3060] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:16.157712   761 raft_consensus.cc:697] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 6 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
W20260709 13:11:16.170251   794 log.cc:927] Time spent T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:11:16.171751   761 consensus_queue.cc:237] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:16.173962   676 leader_election.cc:290] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:16.169544 30173 raft_consensus.cc:1275] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 13:11:16.180331   795 log.cc:927] Time spent T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 13:11:16.180703   576 raft_consensus.cc:493] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:16.181444   576 raft_consensus.cc:515] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:16.182524   713 leader_election.cc:290] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:16.183884   771 leader_election.cc:290] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:16.184077   576 leader_election.cc:290] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:16.146045   687 raft_consensus.cc:697] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 5 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:16.127426   703 raft_consensus.cc:515] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:16.209661 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:16.174010   695 raft_consensus.cc:2749] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:16.138808   606 raft_consensus.cc:515] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:16.218346 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 98328.5us
I20260709 13:11:16.147495   787 consensus_queue.cc:1048] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 2, Time since last communication: 0.074s
I20260709 13:11:16.222355 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:16.276147 30737 raft_consensus.cc:2468] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 6.
I20260709 13:11:16.281874 29993 leader_election.cc:304] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:16.282979 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:16.207365   676 consensus_queue.cc:1048] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.069s
I20260709 13:11:16.289047 30728 raft_consensus.cc:1275] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 13:11:16.290786   759 log.cc:927] Time spent T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
W20260709 13:11:16.295480 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 273231us
W20260709 13:11:16.309998 29991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.310799   807 raft_consensus.cc:2804] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:16.311245   807 raft_consensus.cc:493] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:16.311551   807 raft_consensus.cc:3060] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:16.289021   687 consensus_queue.cc:237] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:16.316583   780 leader_election.cc:290] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:16.322881   606 leader_election.cc:290] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:16.211619   516 consensus_queue.cc:237] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:16.325484 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:16.326193 30733 raft_consensus.cc:2393] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 9: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:11:16.330528 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:16.319108 30068 leader_election.cc:304] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:11:16.286293   652 raft_consensus.cc:493] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.321666   777 leader_election.cc:290] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:16.329244   490 consensus_queue.cc:1048] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:11:16.334940 32753 raft_consensus.cc:493] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.390398 30095 raft_consensus.cc:2468] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 8.
I20260709 13:11:16.391690   805 raft_consensus.cc:493] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.398804 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:11:16.399447   792 log.cc:927] Time spent T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:11:16.399885 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:16.338680   780 raft_consensus.cc:2804] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:16.403045 30737 raft_consensus.cc:2468] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 9.
I20260709 13:11:16.405691 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:16.358876   634 consensus_queue.cc:1048] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 13:11:16.360206   627 raft_consensus.cc:2749] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:16.378249   703 leader_election.cc:290] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:16.337742   576 consensus_queue.cc:1048] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.075s
I20260709 13:11:16.412514 30019 raft_consensus.cc:2468] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 9.
I20260709 13:11:16.371688   713 consensus_queue.cc:1059] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 13:11:16.358892   640 raft_consensus.cc:493] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
W20260709 13:11:16.417913 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 76307.9us
I20260709 13:11:16.371876   652 raft_consensus.cc:515] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:16.436961   627 raft_consensus.cc:493] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.437377   613 raft_consensus.cc:515] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:16.438649   369 raft_consensus.cc:3055] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 LEADER]: Stepping down as leader of term 8
W20260709 13:11:16.439407 30142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.456655 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:16.457456 30732 raft_consensus.cc:2393] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 4: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:11:16.457521 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:16.458695 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:16.459259 30732 raft_consensus.cc:2468] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 9.
I20260709 13:11:16.460068 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:16.424042   780 raft_consensus.cc:697] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 7 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:16.463239 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:16.463449 30735 raft_consensus.cc:1240] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:11:16.412984 32753 raft_consensus.cc:515] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:16.465845 30019 raft_consensus.cc:3060] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:16.475100 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:16.475490 30021 raft_consensus.cc:1240] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:16.476117   789 raft_consensus.cc:493] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:16.476522   782 raft_consensus.cc:493] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:16.476787   495 raft_consensus.cc:493] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
W20260709 13:11:16.477332   808 log.cc:927] Time spent T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 13:11:16.456342   801 raft_consensus.cc:493] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:16.528061 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:16.529529 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:16.529956 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:16.530159 30730 raft_consensus.cc:2468] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 9.
I20260709 13:11:16.531071 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
W20260709 13:11:16.531419 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 467354us
I20260709 13:11:16.531953   652 leader_election.cc:290] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:16.528817   801 raft_consensus.cc:515] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:16.534931 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:16.535490 30176 raft_consensus.cc:2468] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 9.
I20260709 13:11:16.535959   801 leader_election.cc:290] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:16.538411 30169 raft_consensus.cc:1240] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:16.538712 30094 raft_consensus.cc:1240] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:16.539407 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:16.540961 30019 raft_consensus.cc:2468] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 7.
I20260709 13:11:16.541354 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:16.533483 30143 leader_election.cc:304] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:16.543460 30142 leader_election.cc:304] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:16.544128 30068 leader_election.cc:304] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:16.482446 30027 raft_consensus.cc:2468] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 9.
I20260709 13:11:16.444912   369 raft_consensus.cc:740] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:16.548522   369 consensus_queue.cc:260] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:16.555007 30729 raft_consensus.cc:1275] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:16.549944 30143 leader_election.cc:304] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:16.486007 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:16.422909   497 raft_consensus.cc:515] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:16.415613   805 raft_consensus.cc:515] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:16.494326 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:16.423776   816 consensus_queue.cc:1048] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 13:11:16.482059 30066 leader_election.cc:304] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:16.480633   541 raft_consensus.cc:515] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:16.442466   640 raft_consensus.cc:515] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:16.450017   627 raft_consensus.cc:515] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:16.498597 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:16.569090 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:16.501832   495 raft_consensus.cc:515] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:16.489746   789 raft_consensus.cc:515] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:16.512110   367 consensus_meta.cc:287] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent flushing consensus metadata: real 0.517s	user 0.006s	sys 0.002s
I20260709 13:11:16.515149 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:16.496438   782 raft_consensus.cc:515] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:16.518004 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:16.554621   761 raft_consensus.cc:2804] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:16.540750   668 raft_consensus.cc:493] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:16.564389 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:16.582279 30019 raft_consensus.cc:3060] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:16.582494 30143 leader_election.cc:304] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:16.582751 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
W20260709 13:11:16.564678 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 82714.7us
I20260709 13:11:16.593335 30066 leader_election.cc:304] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:16.567246 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:16.565503 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:16.553498   801 raft_consensus.cc:2804] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:16.573863 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:16.516816 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:16.598670 30103 raft_consensus.cc:2468] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 7.
I20260709 13:11:16.599509 30737 raft_consensus.cc:2468] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 8.
I20260709 13:11:16.573465 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:16.566570   676 raft_consensus.cc:2804] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:11:16.564827 29991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:16.570883   369 raft_consensus.cc:3060] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:16.594375 30027 raft_consensus.cc:3060] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:16.598141 30025 raft_consensus.cc:1275] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 13:11:16.609356 30025 pending_rounds.cc:85] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4: Aborting all ops after (but not including) 6
I20260709 13:11:16.609614 30025 pending_rounds.cc:107] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260709 13:11:16.609874 30025 raft_consensus.cc:2889] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:16.574204   673 raft_consensus.cc:2804] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:16.573489 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:16.618882 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:16.601313 30023 raft_consensus.cc:2468] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 8.
I20260709 13:11:16.568341   773 raft_consensus.cc:2749] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:16.600317 30024 raft_consensus.cc:2468] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 9.
I20260709 13:11:16.604293 30177 raft_consensus.cc:2468] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 5.
I20260709 13:11:16.560252 30732 raft_consensus.cc:3060] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:16.576669   761 raft_consensus.cc:493] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:16.611052 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:16.598778 30169 raft_consensus.cc:2393] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 9: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:11:16.613785 30142 leader_election.cc:304] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:16.617089 30027 raft_consensus.cc:2468] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 8.
I20260709 13:11:16.548483   780 consensus_queue.cc:237] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:16.622653 29994 leader_election.cc:304] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:16.604848 30143 leader_election.cc:304] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:16.598213   801 raft_consensus.cc:493] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:16.612021   772 raft_consensus.cc:2804] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:16.605906   676 raft_consensus.cc:493] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:16.605360   777 raft_consensus.cc:493] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:16.643828 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 316041us
I20260709 13:11:16.645958 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:16.603238   697 consensus_queue.cc:1059] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 13:11:16.619037   809 raft_consensus.cc:2749] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:11:16.643108 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 84809.1us
I20260709 13:11:16.620245   711 raft_consensus.cc:493] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.630903 30019 raft_consensus.cc:2468] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 10.
I20260709 13:11:16.634277   761 raft_consensus.cc:3060] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:16.653985 30732 raft_consensus.cc:2468] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 10.
I20260709 13:11:16.602278   668 raft_consensus.cc:515] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:16.659688 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 54934.7us
I20260709 13:11:16.664186 30142 leader_election.cc:304] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:16.664628 29993 leader_election.cc:304] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:16.664381 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:16.639060   801 raft_consensus.cc:3060] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:16.627141   770 consensus_queue.cc:1059] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 13:11:16.641101   725 raft_consensus.cc:2749] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:16.668962 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:16.672358 30096 raft_consensus.cc:2468] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 10.
I20260709 13:11:16.644299   676 raft_consensus.cc:3060] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:16.673422 30143 leader_election.cc:304] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:16.628181   721 consensus_queue.cc:1059] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 13:11:16.647459   613 leader_election.cc:290] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:16.649667   673 raft_consensus.cc:697] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 8 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:16.654623   772 raft_consensus.cc:697] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 9 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:16.663781   711 raft_consensus.cc:515] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:16.668928   687 raft_consensus.cc:2749] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:16.727732 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:16.732788 30096 raft_consensus.cc:3060] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:11:16.681993   806 raft_consensus.cc:2804] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:16.731280 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:16.736655 30170 raft_consensus.cc:2410] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:11:16.680343   818 raft_consensus.cc:2804] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:16.686443   770 consensus_queue.cc:1243] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer b2cea0098c1040f69755ea4d3dab7fc4 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:11:16.652851   777 raft_consensus.cc:515] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:16.667539   811 raft_consensus.cc:2749] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:16.676462   823 raft_consensus.cc:2804] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:16.676216   771 consensus_queue.cc:1048] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.057s
I20260709 13:11:16.691475 32753 leader_election.cc:290] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:11:16.736474   795 log.cc:927] Time spent T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:11:16.736235   806 raft_consensus.cc:493] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:16.807724   823 raft_consensus.cc:697] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 10 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
W20260709 13:11:16.810279   830 log.cc:927] Time spent T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:11:16.810555   817 raft_consensus.cc:493] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:16.810936   823 consensus_queue.cc:237] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:16.811081   817 raft_consensus.cc:515] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:16.823469   782 leader_election.cc:290] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:16.824047   541 leader_election.cc:290] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:16.824432   817 leader_election.cc:290] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:11:16.816342   821 log.cc:927] Time spent T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 13:11:16.819572   818 raft_consensus.cc:697] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:16.825874   818 consensus_queue.cc:237] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:16.826839   668 leader_election.cc:290] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:16.827716   831 raft_consensus.cc:493] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:16.828198   831 raft_consensus.cc:515] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:16.833681   807 consensus_meta.cc:287] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent flushing consensus metadata: real 0.522s	user 0.009s	sys 0.000s
I20260709 13:11:16.834178   807 raft_consensus.cc:515] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:16.822238   789 leader_election.cc:290] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:16.837821   627 leader_election.cc:290] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:16.848398 30096 raft_consensus.cc:2468] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 7.
I20260709 13:11:16.855350 29994 leader_election.cc:304] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:16.861720   771 consensus_queue.cc:1059] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:16.861797   807 leader_election.cc:290] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:16.814918   806 raft_consensus.cc:3060] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:17.182454 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:17.182049 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:16.899283   673 consensus_queue.cc:237] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:16.902573   772 consensus_queue.cc:237] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:16.863102   807 raft_consensus.cc:2804] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:16.884174   805 leader_election.cc:290] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:17.201136   777 leader_election.cc:290] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:17.199609 32579 raft_consensus.cc:3060] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:17.124429 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 141721us
W20260709 13:11:17.142931 32766 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.004s	sys 0.013s
W20260709 13:11:17.211458 32766 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.004s	sys 0.015s
I20260709 13:11:16.897251 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:17.212347 30099 raft_consensus.cc:2393] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 7: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:16.922055 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:17.213798 30700 leader_election.cc:304] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:17.214521   627 raft_consensus.cc:2804] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:17.214903   627 raft_consensus.cc:493] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:17.215236   627 raft_consensus.cc:3060] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:17.222334 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:17.227470 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:17.236068 30140 leader_election.cc:304] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:17.245517   831 leader_election.cc:290] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:17.247262 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:17.248003 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:17.248617 30027 raft_consensus.cc:2468] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 8.
I20260709 13:11:17.247383 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:17.251500 30700 leader_election.cc:304] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:17.256083 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:17.257869 30700 leader_election.cc:304] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:17.209193   763 raft_consensus.cc:493] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:17.235283   622 raft_consensus.cc:493] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.272150   495 leader_election.cc:290] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:17.272679   807 raft_consensus.cc:697] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:17.256809   811 raft_consensus.cc:2804] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:11:17.274875   837 log.cc:927] Time spent T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.242s	user 0.000s	sys 0.000s
W20260709 13:11:17.275143   833 log.cc:927] Time spent T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
W20260709 13:11:17.279539   801 consensus_meta.cc:287] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124: Time spent flushing consensus metadata: real 0.598s	user 0.004s	sys 0.004s
I20260709 13:11:17.279379   352 raft_consensus.cc:3055] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:11:17.277519   697 raft_consensus.cc:3055] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:17.296084   711 leader_election.cc:290] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:17.256896   492 raft_consensus.cc:493] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:17.273913   714 raft_consensus.cc:3055] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Stepping down as leader of term 5
W20260709 13:11:17.298810   761 consensus_meta.cc:287] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124: Time spent flushing consensus metadata: real 0.598s	user 0.004s	sys 0.004s
I20260709 13:11:17.324659   838 raft_consensus.cc:2804] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:17.266395   789 raft_consensus.cc:493] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.335685   743 raft_consensus.cc:493] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
W20260709 13:11:17.357951   832 log.cc:927] Time spent T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 13:11:17.350629   831 raft_consensus.cc:493] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:17.338092   352 raft_consensus.cc:740] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
W20260709 13:11:17.356604   676 consensus_meta.cc:287] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719: Time spent flushing consensus metadata: real 0.674s	user 0.004s	sys 0.004s
I20260709 13:11:17.320518   811 raft_consensus.cc:493] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:17.312837   622 raft_consensus.cc:515] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:17.317890   840 raft_consensus.cc:2749] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:17.352368   697 raft_consensus.cc:740] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:17.350489   801 raft_consensus.cc:515] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:17.354558   714 raft_consensus.cc:740] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:17.365656   771 raft_consensus.cc:493] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:17.357689   838 raft_consensus.cc:493] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:17.359346   825 log.cc:927] Time spent T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260709 13:11:17.301975   763 raft_consensus.cc:515] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:17.367738   789 raft_consensus.cc:515] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:17.358240   492 raft_consensus.cc:515] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:17.358491   761 raft_consensus.cc:515] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:17.402819   714 consensus_queue.cc:260] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:17.411158   622 leader_election.cc:290] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:11:17.413152   369 consensus_meta.cc:287] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent flushing consensus metadata: real 0.795s	user 0.008s	sys 0.000s
I20260709 13:11:17.416373 30068 leader_election.cc:304] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
W20260709 13:11:17.339284 30101 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:48558 (request call id 567) took 1602 ms (client timeout 1700 ms). Trace:
I20260709 13:11:17.394637   838 raft_consensus.cc:3060] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:17.380733   811 raft_consensus.cc:3060] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:17.374075   743 raft_consensus.cc:515] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:17.425259 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:17.380409   676 raft_consensus.cc:515] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:17.420286   640 leader_election.cc:290] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:11:17.429095 30101 rpcz_store.cc:269] 0709 13:11:15.731308 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.732297 (+   989us) service_pool.cc:224] Handling call
0709 13:11:17.306842 (+1574545us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54002148d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:11:17.333568 (+ 26726us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":335790336}
I20260709 13:11:17.381904 32762 raft_consensus.cc:493] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:17.378207   831 raft_consensus.cc:515] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:17.421953   772 raft_consensus.cc:493] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:17.444970   772 raft_consensus.cc:515] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:17.435101 30019 raft_consensus.cc:1240] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 13:11:17.448120   772 leader_election.cc:290] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:17.440781 32762 raft_consensus.cc:515] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:17.450225   844 log.cc:927] Time spent T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
W20260709 13:11:17.451083   846 log.cc:927] Time spent T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260709 13:11:17.451797 32762 leader_election.cc:290] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:17.452319 32762 raft_consensus.cc:493] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.453492 30094 raft_consensus.cc:1240] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:11:17.454504   676 leader_election.cc:290] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 10 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:17.455114   853 raft_consensus.cc:493] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:17.455664   853 raft_consensus.cc:515] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:17.394912   771 raft_consensus.cc:515] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:17.444438 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:17.423218   627 raft_consensus.cc:515] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:17.455394 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:17.449716 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:17.443140   831 leader_election.cc:290] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:17.432443   714 raft_consensus.cc:3060] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:17.378142   807 consensus_queue.cc:237] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:17.466709 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:17.470078 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:17.470705 30168 raft_consensus.cc:3060] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:17.471827 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:17.482016 30172 raft_consensus.cc:1275] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:11:17.457691   853 leader_election.cc:290] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:17.458930 32766 raft_consensus.cc:2749] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:17.452850   743 leader_election.cc:290] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:17.488715 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:17.452739 32762 raft_consensus.cc:515] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:17.494551 29993 leader_election.cc:304] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:17.585579   721 consensus_queue.cc:1059] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:17.586601   620 consensus_queue.cc:1048] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:11:17.587548 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 93064.9us
I20260709 13:11:17.588037   778 raft_consensus.cc:2804] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:17.589102   743 raft_consensus.cc:493] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:17.432196   352 consensus_queue.cc:260] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:17.428350   697 consensus_queue.cc:260] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:17.600018 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 181837us
I20260709 13:11:17.487254   824 raft_consensus.cc:493] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.489702   831 raft_consensus.cc:493] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.603953   853 raft_consensus.cc:493] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.605042   772 raft_consensus.cc:493] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:17.608448   849 log.cc:927] Time spent T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.173s	user 0.000s	sys 0.000s
I20260709 13:11:17.645948 30102 raft_consensus.cc:1275] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:17.617715 29993 leader_election.cc:304] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:17.617735 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:17.642843 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:11:17.638716   709 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.775s	user 0.009s	sys 0.017s
W20260709 13:11:17.772125 30068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:17.680601 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:17.688603 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:17.772415 30168 raft_consensus.cc:2468] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 7.
I20260709 13:11:17.771420 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:17.774653 30019 raft_consensus.cc:2468] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 4.
I20260709 13:11:17.647449 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:17.730219 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
W20260709 13:11:17.774241 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 156590us
I20260709 13:11:17.651942 30094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33990 (request call id 2174) took 1011 ms. Trace:
I20260709 13:11:17.778715 30094 rpcz_store.cc:276] 0709 13:11:16.640398 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.640566 (+   168us) service_pool.cc:224] Handling call
0709 13:11:16.640830 (+   264us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:17.454230 (+813400us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.651706 (+197476us) spinlock_profiling.cc:243] Waited 812 ms on lock 0x7b54004015d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:11:17.651884 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1868412288}
I20260709 13:11:17.636437   778 raft_consensus.cc:493] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:17.795048 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:17.792603 30102 raft_consensus.cc:2393] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 4: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:17.794442 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:17.805953 30099 raft_consensus.cc:3060] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:17.792695 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
W20260709 13:11:17.728945 32579 consensus_meta.cc:287] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4: Time spent flushing consensus metadata: real 0.519s	user 0.009s	sys 0.000s
W20260709 13:11:17.719871   852 log.cc:927] Time spent T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.120s	user 0.000s	sys 0.001s
W20260709 13:11:17.773954   709 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.910s	user 0.009s	sys 0.017s
I20260709 13:11:17.808389 29993 leader_election.cc:304] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:17.729547 32766 raft_consensus.cc:493] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.814814 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:17.819229 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:17.819626 30731 raft_consensus.cc:3060] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:11:17.641944   743 raft_consensus.cc:515] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:17.730134   721 raft_consensus.cc:2804] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:17.818405 30703 leader_election.cc:304] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:17.793521   761 leader_election.cc:290] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:17.650933   492 leader_election.cc:290] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:17.834136 30096 raft_consensus.cc:1275] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 13:11:17.649533   497 leader_election.cc:290] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:17.725994   789 leader_election.cc:290] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:17.825089 30100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33990 (request call id 2171) took 1237 ms. Trace:
I20260709 13:11:17.852265 30021 raft_consensus.cc:2468] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 9.
I20260709 13:11:17.650166   801 leader_election.cc:290] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:17.809283   778 raft_consensus.cc:3060] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:17.720009   853 raft_consensus.cc:515] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:17.775759   763 leader_election.cc:290] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:17.820762   724 raft_consensus.cc:493] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.649922   831 raft_consensus.cc:515] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:17.864946 30100 rpcz_store.cc:276] 0709 13:11:16.587339 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.589677 (+  2338us) service_pool.cc:224] Handling call
0709 13:11:16.590049 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:16.590382 (+   333us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:16.590411 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:17.595937 (+1005526us) spinlock_profiling.cc:243] Waited 8.07 ms on lock 0x7b2c000249e8. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f09b3a11 00007f99f09c3372 00007f99f20f5a01 00007f99f20ba43a 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2
0709 13:11:17.596333 (+   396us) log.cc:844] Serialized 26 byte log entry
0709 13:11:17.641373 (+ 45040us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:17.641407 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.641469 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:17.813986 (+172517us) raft_consensus.cc:1685] finished
0709 13:11:17.814003 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:17.825007 (+ 11004us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11485,"raft.queue_time_us":371,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":7122,"spinlock_wait_cycles":18555264,"thread_start_us":44718,"threads_started":1,"wal-append.queue_time_us":52233}
I20260709 13:11:17.865279 29993 leader_election.cc:304] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:17.849289 30099 raft_consensus.cc:2468] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 8.
I20260709 13:11:17.892350 30700 leader_election.cc:304] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:17.646582   824 raft_consensus.cc:515] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:17.761348   772 raft_consensus.cc:515] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:17.893299   771 leader_election.cc:290] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:17.828915 32579 raft_consensus.cc:2749] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:17.852034   613 raft_consensus.cc:2749] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:17.823243   668 consensus_queue.cc:1048] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
W20260709 13:11:17.903775 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 124894us
I20260709 13:11:17.909215   497 raft_consensus.cc:2749] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:17.855422   721 raft_consensus.cc:697] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:17.834874   860 raft_consensus.cc:493] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.843878   840 raft_consensus.cc:493] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:17.872135 32762 leader_election.cc:290] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:17.912370 30101 raft_consensus.cc:3060] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:17.825702 32766 raft_consensus.cc:515] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:17.896030   789 raft_consensus.cc:493] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.921196 30103 raft_consensus.cc:1240] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:17.904357   627 leader_election.cc:290] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:17.915787   841 raft_consensus.cc:2804] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:17.930963 32766 leader_election.cc:290] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:17.921638   860 raft_consensus.cc:515] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:17.933578   860 leader_election.cc:290] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:17.927105   789 raft_consensus.cc:515] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:17.935592   864 raft_consensus.cc:493] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:17.936084   864 raft_consensus.cc:515] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:17.938079   864 leader_election.cc:290] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:17.938942   789 leader_election.cc:290] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:17.905076   724 raft_consensus.cc:515] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:17.946527 30737 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51004 (request call id 740) took 1415 ms (client timeout 1792 ms). Trace:
W20260709 13:11:17.947482 30737 rpcz_store.cc:269] 0709 13:11:16.527191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.527335 (+   144us) service_pool.cc:224] Handling call
0709 13:11:17.942225 (+1414890us) spinlock_profiling.cc:243] Waited 70.8 ms on lock 0x7b54004b23d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:11:17.942330 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":162800512}
I20260709 13:11:17.960717 30177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54540 (request call id 700) took 1468 ms. Trace:
I20260709 13:11:17.961108 30177 rpcz_store.cc:276] 0709 13:11:16.492563 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.498365 (+  5802us) service_pool.cc:224] Handling call
0709 13:11:17.960539 (+1462174us) spinlock_profiling.cc:243] Waited 34.7 ms on lock 0x7b5400315954. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:11:17.960651 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":79849216}
I20260709 13:11:17.963770 30733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51004 (request call id 734) took 1507 ms. Trace:
I20260709 13:11:17.964134 30733 rpcz_store.cc:276] 0709 13:11:16.455985 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.456111 (+   126us) service_pool.cc:224] Handling call
0709 13:11:16.461537 (+  5426us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:16.583394 (+121857us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:16.583422 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:16.583464 (+    42us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:16.583496 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.963571 (+1380075us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b540054f954. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:11:17.963614 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:17.963720 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":279797504}
I20260709 13:11:17.944833   841 raft_consensus.cc:697] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:17.985148 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:17.988101 30175 raft_consensus.cc:3060] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:17.928683   771 consensus_queue.cc:1059] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.044s
I20260709 13:11:17.991394 30736 raft_consensus.cc:1240] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 13:11:18.050202 29994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:18.050843   820 raft_consensus.cc:493] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:18.051405   820 raft_consensus.cc:515] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:18.054354   772 leader_election.cc:290] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:18.055210   389 raft_consensus.cc:493] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.055672   389 raft_consensus.cc:515] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:17.939882   811 raft_consensus.cc:515] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:17.942855   838 raft_consensus.cc:515] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:17.973680   853 leader_election.cc:290] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:18.089150   497 raft_consensus.cc:493] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
W20260709 13:11:18.089401 29921 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39956 (request call id 229) took 25990 ms (client timeout 15000 ms). Trace:
I20260709 13:11:18.089712   497 raft_consensus.cc:515] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:18.090986 28889 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:18.091735   497 leader_election.cc:290] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:18.092384   787 raft_consensus.cc:493] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:18.092643   850 raft_consensus.cc:493] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:18.093449 30171 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43838 (request call id 2167) took 1542 ms. Trace:
I20260709 13:11:18.093835 30171 rpcz_store.cc:276] 0709 13:11:16.551380 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.620185 (+ 68805us) service_pool.cc:224] Handling call
0709 13:11:17.962108 (+1341923us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:17.962276 (+   168us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:17.962299 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:17.962335 (+    36us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:17.962362 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:17.962398 (+    36us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:18.093301 (+130903us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b5400315950. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20b98ad 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:11:18.093398 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3085579136}
I20260709 13:11:18.096088   787 raft_consensus.cc:515] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:18.098058   787 leader_election.cc:290] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:18.098269   711 raft_consensus.cc:493] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:18.098640   497 raft_consensus.cc:3055] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:18.099014   497 raft_consensus.cc:740] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:18.098768   711 raft_consensus.cc:515] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:18.099850   497 consensus_queue.cc:260] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:18.100793   497 raft_consensus.cc:3060] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:18.100812   711 leader_election.cc:290] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:18.103789 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:18.104380 30733 raft_consensus.cc:2468] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 9.
I20260709 13:11:18.104709 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:18.105401 30730 raft_consensus.cc:2393] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 4: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:11:18.106514 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:18.107061   853 raft_consensus.cc:493] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:18.107720   853 raft_consensus.cc:515] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:18.110146   697 raft_consensus.cc:3060] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:18.110524   787 raft_consensus.cc:493] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:18.111024   787 raft_consensus.cc:515] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:18.113054   787 leader_election.cc:290] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:18.113502   787 raft_consensus.cc:493] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.113945   787 raft_consensus.cc:515] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:18.117223 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:18.107671   817 raft_consensus.cc:493] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.110230   853 leader_election.cc:290] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:18.118271   817 raft_consensus.cc:515] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:18.092208   709 raft_consensus.cc:493] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.119174   709 raft_consensus.cc:515] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:18.120347   817 leader_election.cc:290] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:18.121186   709 leader_election.cc:290] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:18.071210   773 raft_consensus.cc:3055] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:18.092959 30702 leader_election.cc:304] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:18.122138   773 raft_consensus.cc:740] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:18.122375   787 leader_election.cc:290] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:18.123152   773 consensus_queue.cc:260] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:18.124406   773 raft_consensus.cc:3060] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:18.128037 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:18.130401 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:18.130988 30021 raft_consensus.cc:3060] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:18.070628 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:17.977934   516 consensus_queue.cc:1048] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.095s
I20260709 13:11:18.075431   811 leader_election.cc:290] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:18.133803 30095 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33992 (request call id 1780) took 1568 ms. Trace:
I20260709 13:11:18.076318 30169 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43838 (request call id 2168) took 1524 ms. Trace:
I20260709 13:11:18.076175   841 consensus_queue.cc:237] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:18.135078   352 raft_consensus.cc:3060] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:18.077030 30025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54198 (request call id 1968) took 2220 ms. Trace:
I20260709 13:11:18.137553 30025 rpcz_store.cc:276] 0709 13:11:15.856148 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:15.856282 (+   134us) service_pool.cc:224] Handling call
0709 13:11:15.856537 (+   255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:16.619524 (+762987us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:18.076799 (+1457275us) spinlock_profiling.cc:243] Waited 725 ms on lock 0x7b5400290254. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:11:18.076953 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1668478848}
I20260709 13:11:18.138288 30101 raft_consensus.cc:2468] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 9.
I20260709 13:11:18.078382   838 leader_election.cc:290] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:17.986819   721 consensus_queue.cc:237] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:18.139380 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:18.139906 30734 raft_consensus.cc:3060] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:18.141800 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:18.145320 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:18.145838 30736 raft_consensus.cc:2468] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 7.
I20260709 13:11:18.146543 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:18.147631 30736 raft_consensus.cc:1240] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 LEADER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:18.148582   724 leader_election.cc:290] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:18.147864 30169 rpcz_store.cc:276] 0709 13:11:16.551641 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.641404 (+ 89763us) service_pool.cc:224] Handling call
0709 13:11:16.657252 (+ 15848us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:17.162807 (+505555us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:17.162838 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:17.173651 (+ 10813us) log.cc:844] Serialized 26 byte log entry
0709 13:11:17.303114 (+129463us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:17.303152 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:18.075922 (+772770us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54002896d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:11:18.075971 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:18.076014 (+    43us) raft_consensus.cc:1685] finished
0709 13:11:18.076027 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:18.076244 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29923,"raft.queue_time_us":394879,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":161,"spinlock_wait_cycles":346259200,"thread_start_us":129074,"threads_started":1,"wal-append.queue_time_us":219607}
I20260709 13:11:18.149504 30736 raft_consensus.cc:1275] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:11:18.093153   850 raft_consensus.cc:515] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:18.105259 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:18.166811 30733 raft_consensus.cc:2468] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 10.
I20260709 13:11:18.107106 30732 raft_consensus.cc:2468] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 6.
I20260709 13:11:18.117879 30730 raft_consensus.cc:2468] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 8.
I20260709 13:11:18.130841 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:18.078590   779 raft_consensus.cc:493] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.151192 30021 raft_consensus.cc:2468] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 9.
I20260709 13:11:18.185063 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:18.151880 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:17.924934   840 raft_consensus.cc:515] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:18.152235 30734 raft_consensus.cc:2468] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 10.
I20260709 13:11:18.154780 30175 raft_consensus.cc:2468] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 9.
I20260709 13:11:18.193683 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:18.124239   613 raft_consensus.cc:2804] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:11:18.141805 29921 rpcz_store.cc:269] 0709 13:10:52.154439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:52.169827 (+ 15388us) service_pool.cc:224] Handling call
0709 13:11:18.089326 (+25919499us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:13.168318 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:13.168971 (+   653us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:13.169024 (+    53us) write_op.cc:435] Acquired schema lock
0709 13:11:13.169048 (+    24us) tablet.cc:662] Decoding operations
0709 13:11:13.169676 (+   628us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:13.169795 (+   119us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:13.169830 (+    35us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:11:13.196084 (+ 26254us) tablet.cc:701] Row locks acquired
0709 13:11:13.196132 (+    48us) write_op.cc:260] PREPARE: finished
0709 13:11:13.196305 (+   173us) write_op.cc:270] Start()
0709 13:11:13.196456 (+   151us) write_op.cc:276] Timestamp: P: 1783602673196242 usec, L: 0
0709 13:11:13.196482 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:11:13.214233 (+ 17751us) log.cc:844] Serialized 1293 byte log entry
0709 13:11:13.636076 (+421843us) op_driver.cc:464] REPLICATION: finished
0709 13:11:14.124914 (+488838us) write_op.cc:301] APPLY: starting
0709 13:11:14.160477 (+ 35563us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:14.183115 (+ 22638us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:14.217442 (+ 34327us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:14.412418 (+194976us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:14.476189 (+ 63771us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:11:14.478204 (+  2015us) write_op.cc:312] APPLY: finished
0709 13:11:14.479608 (+  1404us) log.cc:844] Serialized 35 byte log entry
0709 13:11:14.479802 (+   194us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:14.479914 (+   112us) write_op.cc:454] Released schema lock
0709 13:11:14.479976 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:14.480422 (+   446us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:14.480449 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1925432,"reported_tablets":27,"spinlock_wait_cycles":45184,"child_traces":[["op",{"apply.queue_time_us":448174,"apply.run_cpu_time_us":4949,"apply.run_wall_time_us":382177,"num_ops":3,"prepare.queue_time_us":121599,"prepare.run_cpu_time_us":11697,"prepare.run_wall_time_us":117757,"raft.queue_time_us":330495,"raft.run_cpu_time_us":20998,"raft.run_wall_time_us":286005,"replication_time_us":439435,"thread_start_us":693230,"threads_started":4,"wal-append.queue_time_us":64839,"wal-append.run_cpu_time_us":245682,"wal-append.run_wall_time_us":2206424}]]}
I20260709 13:11:18.134157 30095 rpcz_store.cc:276] 0709 13:11:16.565301 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:16.566958 (+  1657us) service_pool.cc:224] Handling call
0709 13:11:18.070531 (+1503573us) spinlock_profiling.cc:243] Waited 2.87 ms on lock 0x7b5800073598. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eef95b71 00007f99eef95eee 0000000000375939 00007f99f70091e0 00007f99f70d20c4 00007f99f70d2131 00007f99f70800a0 00007f99f707f984 00007f99f05fa6d4 00007f99f05fa662
0709 13:11:18.133725 (+ 63194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6608256}
I20260709 13:11:18.159778   838 raft_consensus.cc:493] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:18.062428 30731 raft_consensus.cc:2468] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 8.
I20260709 13:11:18.204154 30737 raft_consensus.cc:2468] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 5.
I20260709 13:11:18.203812 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:18.204842 30732 raft_consensus.cc:1275] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:18.203760 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:18.206588 30736 raft_consensus.cc:2393] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 9: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:11:18.207050 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:18.207191 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:18.208195 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:18.208572 30734 raft_consensus.cc:2468] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 6.
I20260709 13:11:18.209682 30730 raft_consensus.cc:2410] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:11:18.121696   709 raft_consensus.cc:493] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.082991   743 leader_election.cc:290] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:18.164731 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:18.207662 30172 raft_consensus.cc:2468] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 7.
W20260709 13:11:18.152774 29991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:18.210691 30025 raft_consensus.cc:2468] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 9.
I20260709 13:11:18.171347 30171 raft_consensus.cc:3055] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:18.173508 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:18.184547 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:18.185789 30169 raft_consensus.cc:2393] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 9: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:11:18.186458 30700 leader_election.cc:304] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:18.213560 30700 leader_election.cc:304] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
W20260709 13:11:18.073076   806 consensus_meta.cc:287] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124: Time spent flushing consensus metadata: real 1.200s	user 0.009s	sys 0.000s
I20260709 13:11:18.192049 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:18.194303 30735 raft_consensus.cc:2468] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 10.
I20260709 13:11:18.209604 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:18.161677   824 leader_election.cc:290] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:18.211510 30171 raft_consensus.cc:740] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:18.222229 30175 raft_consensus.cc:2468] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 4.
I20260709 13:11:18.057621   389 leader_election.cc:290] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:18.152281   778 raft_consensus.cc:515] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:18.177644 30068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:18.191493   817 raft_consensus.cc:493] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:18.196326   698 raft_consensus.cc:493] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:18.253044 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:18.229024 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:18.247184 30102 raft_consensus.cc:1240] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:18.247797 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:18.206738   613 raft_consensus.cc:493] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:18.241798   772 raft_consensus.cc:493] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:18.251389 30172 raft_consensus.cc:1240] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 5 LEADER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:18.242290   627 raft_consensus.cc:2804] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:18.251995   850 leader_election.cc:290] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:18.203770   440 raft_consensus.cc:493] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:18.222411   640 raft_consensus.cc:2804] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:18.253862 30097 raft_consensus.cc:2468] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 7.
I20260709 13:11:18.323557 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:18.216150   811 raft_consensus.cc:493] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:18.326817 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:18.328006 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:18.328665 30734 raft_consensus.cc:2468] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 7.
I20260709 13:11:18.329564 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:18.262094 30737 raft_consensus.cc:2468] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 5.
I20260709 13:11:18.261288 30728 raft_consensus.cc:1275] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:11:18.263291 30099 raft_consensus.cc:2468] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 4.
I20260709 13:11:18.256186 29993 leader_election.cc:304] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:18.244207 30171 consensus_queue.cc:260] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:18.338017 30171 raft_consensus.cc:3060] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:18.310940 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:18.313952 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:18.217458   823 raft_consensus.cc:493] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:18.315979 30143 leader_election.cc:304] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:18.311197 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:18.339118 30096 raft_consensus.cc:2468] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 8.
I20260709 13:11:18.222585   673 raft_consensus.cc:493] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:18.252959   492 raft_consensus.cc:493] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.361809 30094 raft_consensus.cc:2393] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 9: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:18.275244   389 raft_consensus.cc:493] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.369942 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:18.370689 30101 raft_consensus.cc:2393] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 6: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:18.371469 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
W20260709 13:11:18.364939 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 47424.8us
I20260709 13:11:18.308238   613 raft_consensus.cc:3060] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:18.366745 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 110624us
W20260709 13:11:18.389916 30142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 77510.2us
I20260709 13:11:18.210024   838 raft_consensus.cc:515] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:18.390455 30142 leader_election.cc:304] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:18.375120 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:18.385875 30171 raft_consensus.cc:1275] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 13:11:18.196528   779 raft_consensus.cc:515] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:18.391173 30171 pending_rounds.cc:85] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124: Aborting all ops after (but not including) 7
I20260709 13:11:18.394258 30171 pending_rounds.cc:107] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 13:11:18.241447   806 raft_consensus.cc:515] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:18.394537 30171 raft_consensus.cc:2889] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:18.326249   640 raft_consensus.cc:493] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.403049 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:18.355332   627 raft_consensus.cc:697] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:18.221372   709 raft_consensus.cc:515] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:18.407496 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:18.310035   698 raft_consensus.cc:515] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:18.407903 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:18.309863   817 raft_consensus.cc:515] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:18.417936 29994 leader_election.cc:304] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:18.322152   772 raft_consensus.cc:515] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:18.431893 29994 leader_election.cc:304] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
W20260709 13:11:18.412894 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 44442.4us
I20260709 13:11:18.423127 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:18.382232 32579 raft_consensus.cc:493] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.403297   640 raft_consensus.cc:3060] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:18.366115   823 raft_consensus.cc:515] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:18.408095   743 raft_consensus.cc:493] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.406527   622 raft_consensus.cc:2749] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:18.407414   634 raft_consensus.cc:493] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:18.393615   516 raft_consensus.cc:2804] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:18.455996   823 leader_election.cc:290] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:18.448124   714 consensus_meta.cc:287] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent flushing consensus metadata: real 0.976s	user 0.009s	sys 0.000s
I20260709 13:11:18.355755   440 raft_consensus.cc:515] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:18.382737   492 raft_consensus.cc:515] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:18.365386   811 raft_consensus.cc:515] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:18.426550 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:18.486495 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:18.486649 29994 leader_election.cc:304] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:18.487079 30176 raft_consensus.cc:2468] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 7.
I20260709 13:11:18.487470 30174 raft_consensus.cc:2468] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 6.
I20260709 13:11:18.487973 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:18.487027 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:18.488525 30176 raft_consensus.cc:2468] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 8.
I20260709 13:11:18.488796 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:18.489305 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:18.490054   717 consensus_queue.cc:1048] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:18.492453   817 leader_election.cc:290] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:18.471498   840 leader_election.cc:290] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:18.493518 32719 consensus_queue.cc:1059] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:18.494159   652 raft_consensus.cc:2804] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:18.494743   823 raft_consensus.cc:493] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:18.495411   823 raft_consensus.cc:515] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:18.494627 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:18.494678   652 raft_consensus.cc:697] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:18.497133 30168 raft_consensus.cc:2468] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 5.
I20260709 13:11:18.427078   711 raft_consensus.cc:2749] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:18.497648   652 consensus_queue.cc:237] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:18.498214 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:18.498807 30168 raft_consensus.cc:2468] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 4.
I20260709 13:11:18.499430 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:18.499593 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:18.453097 32579 raft_consensus.cc:515] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:18.433312 30173 raft_consensus.cc:2468] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 10.
I20260709 13:11:18.507434 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:18.456090   709 leader_election.cc:290] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:18.384429   389 raft_consensus.cc:515] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:18.430728   878 raft_consensus.cc:2804] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:18.448532 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:18.515197 30171 raft_consensus.cc:2468] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 6.
I20260709 13:11:18.515630 30101 raft_consensus.cc:1275] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:18.481792   831 leader_election.cc:290] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:18.482714   772 leader_election.cc:290] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:18.484385   838 leader_election.cc:290] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:18.494807   843 raft_consensus.cc:3055] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:18.496587 30094 raft_consensus.cc:1240] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 3. Current term is 4. Ops: []
I20260709 13:11:18.499703   698 leader_election.cc:290] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:18.539155 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:18.540340 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:18.489341 30174 raft_consensus.cc:2468] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 6.
W20260709 13:11:18.485587 29993 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:18.450609 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 47647.5us
I20260709 13:11:18.544931 30068 leader_election.cc:304] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:18.501606 30027 raft_consensus.cc:2468] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 6.
I20260709 13:11:18.451371 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:18.502799 30066 leader_election.cc:304] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:18.546033 30068 leader_election.cc:304] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
W20260709 13:11:18.546512 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 43784.6us
I20260709 13:11:18.503753 30176 raft_consensus.cc:2410] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260709 13:11:18.499989 30098 raft_consensus.cc:2468] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 7.
I20260709 13:11:18.457348   820 leader_election.cc:290] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:18.507985 30025 raft_consensus.cc:3060] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:18.375090   673 raft_consensus.cc:515] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:18.415302 30141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:18.509728 30026 raft_consensus.cc:1275] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:11:18.510849 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:18.511782 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:18.516875 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:18.536844 30170 raft_consensus.cc:1240] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:11:18.535802 30019 raft_consensus.cc:1275] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:18.536084 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:18.550767 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:18.478282   685 raft_consensus.cc:2749] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:18.551959 29993 leader_election.cc:304] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:18.556133 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:18.554064 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:18.494626   761 raft_consensus.cc:493] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:18.564728 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:18.567139 30068 leader_election.cc:304] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:18.554067 30023 raft_consensus.cc:2393] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 9: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
W20260709 13:11:18.566398 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 250488us
I20260709 13:11:18.570634 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:18.577787 30168 raft_consensus.cc:2393] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 9: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:11:18.579929 29993 leader_election.cc:304] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:18.520884   516 raft_consensus.cc:697] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:18.584874 30068 leader_election.cc:304] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:18.537736   843 raft_consensus.cc:740] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:18.550870   853 raft_consensus.cc:2749] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:18.463745   743 raft_consensus.cc:515] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:18.588317 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:18.604099 30019 raft_consensus.cc:2468] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 9.
I20260709 13:11:18.475221   634 raft_consensus.cc:515] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:18.588933 30175 raft_consensus.cc:2468] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 3.
I20260709 13:11:18.591729 30068 leader_election.cc:304] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:18.592959 30026 raft_consensus.cc:1240] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260709 13:11:18.521539   878 raft_consensus.cc:493] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.599750 30023 raft_consensus.cc:1275] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:11:18.553514   709 raft_consensus.cc:2804] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:18.584103 30025 raft_consensus.cc:2468] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 10.
I20260709 13:11:18.569967   771 raft_consensus.cc:2749] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:18.605849 30068 leader_election.cc:304] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:18.578883 32573 raft_consensus.cc:2804] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:18.606921   490 raft_consensus.cc:2749] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:18.592155   850 raft_consensus.cc:2804] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:18.612038   634 leader_election.cc:290] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:18.565379   627 consensus_queue.cc:237] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:18.613072 30020 raft_consensus.cc:2468] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 9.
I20260709 13:11:18.590554   717 consensus_queue.cc:1048] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 13:11:18.614701   698 raft_consensus.cc:493] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:18.663631   698 raft_consensus.cc:515] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:18.615265 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:18.600098   865 raft_consensus.cc:2804] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:18.666548   865 raft_consensus.cc:493] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.666930   865 raft_consensus.cc:3060] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:18.667219   673 leader_election.cc:290] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:18.667685   850 raft_consensus.cc:493] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.668073   850 raft_consensus.cc:3060] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:18.625226 29993 leader_election.cc:304] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:18.589834   761 raft_consensus.cc:515] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:18.610351   863 raft_consensus.cc:2804] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:18.673123   863 raft_consensus.cc:493] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:18.673527   863 raft_consensus.cc:3060] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:18.649920 32573 raft_consensus.cc:493] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:18.675414 32573 raft_consensus.cc:3060] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:18.678118   806 leader_election.cc:290] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:18.679144   440 leader_election.cc:290] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:18.682056   863 raft_consensus.cc:515] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:18.642577   843 consensus_queue.cc:260] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:18.607492   778 leader_election.cc:290] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:18.584543   866 consensus_queue.cc:1048] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.074s
W20260709 13:11:18.649361 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 43595.5us
I20260709 13:11:18.661047 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:18.666038   779 leader_election.cc:290] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:18.683032   717 raft_consensus.cc:2804] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:11:18.683439 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 58288.8us
I20260709 13:11:18.661294   772 raft_consensus.cc:2749] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:18.686517 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:18.569396 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:18.694010 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
W20260709 13:11:19.167389 30141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:19.411414 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:18.687899 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:18.687553 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
W20260709 13:11:18.771170 29991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:18.877619 30702 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.54.67:45001 timed out after 1.898s (SENT) [suppressed 26 similar messages]
I20260709 13:11:19.414544 30731 raft_consensus.cc:2468] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 4.
W20260709 13:11:19.374964 30100 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.779s	user 0.000s	sys 0.017s
W20260709 13:11:19.416802 30100 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.000s	sys 0.017s
W20260709 13:11:19.114478 30168 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.009s	sys 0.021s
I20260709 13:11:18.687203 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:19.417500 30733 raft_consensus.cc:2468] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 7.
I20260709 13:11:19.418990 30170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43840 (request call id 1856) took 1173 ms. Trace:
I20260709 13:11:19.415380 30140 leader_election.cc:304] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:18.644865   878 raft_consensus.cc:3060] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:19.434676 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:19.435232   892 raft_consensus.cc:2804] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:19.435798   892 raft_consensus.cc:697] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 10 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:19.436307 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:18.644666   709 raft_consensus.cc:493] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.436935   709 raft_consensus.cc:3060] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:18.690076 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:19.417522 30068 leader_election.cc:304] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: c99569d27a6f4c648eae7119fe3db124
W20260709 13:11:19.417260 30168 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.810s	user 0.010s	sys 0.029s
I20260709 13:11:19.420163 30066 leader_election.cc:304] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
W20260709 13:11:19.415911 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 538312us
I20260709 13:11:19.440703 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:19.438978 30168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43838 (request call id 2193) took 1061 ms. Trace:
I20260709 13:11:19.441696 30025 raft_consensus.cc:2410] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for term 9 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 13:11:19.434834 30170 rpcz_store.cc:276] 0709 13:11:18.245496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.402445 (+156949us) service_pool.cc:224] Handling call
0709 13:11:18.402748 (+   303us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:18.564022 (+161274us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.418748 (+854726us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b5400406fd4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:11:19.418932 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":307395328}
I20260709 13:11:19.436892 30176 raft_consensus.cc:2468] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 8.
I20260709 13:11:19.446319 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:19.446966 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:19.445601 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:11:18.977134   783 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.034s	sys 0.130s
W20260709 13:11:19.384841   850 consensus_meta.cc:287] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719: Time spent flushing consensus metadata: real 0.716s	user 0.008s	sys 0.000s
W20260709 13:11:19.258391   697 consensus_meta.cc:287] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719: Time spent flushing consensus metadata: real 1.148s	user 0.009s	sys 0.001s
I20260709 13:11:19.454516 30025 raft_consensus.cc:1275] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 13:11:19.174853   773 consensus_meta.cc:287] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719: Time spent flushing consensus metadata: real 1.050s	user 0.002s	sys 0.008s
I20260709 13:11:19.441584 30168 rpcz_store.cc:276] 0709 13:11:18.377306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.590896 (+213590us) service_pool.cc:224] Handling call
0709 13:11:18.591162 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:18.591337 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 13:11:18.607182 (+ 15845us) log.cc:844] Serialized 14 byte log entry
0709 13:11:19.438631 (+831449us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:19.438687 (+    56us) raft_consensus.cc:1645] Marking committed up to 10
0709 13:11:19.438723 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.438804 (+    81us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:19.438930 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":22610,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":7134,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":72,"thread_start_us":831160,"threads_started":1}
I20260709 13:11:19.382133   440 raft_consensus.cc:493] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.140576   761 leader_election.cc:290] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:11:18.682250   352 consensus_meta.cc:287] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4: Time spent flushing consensus metadata: real 0.547s	user 0.009s	sys 0.000s
W20260709 13:11:19.382570   652 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.025s	sys 0.009s
I20260709 13:11:19.230106 29922 catalog_manager.cc:5697] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:19.464689 30168 raft_consensus.cc:1275] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:19.464792 30103 raft_consensus.cc:1275] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 4. (term mismatch)
I20260709 13:11:19.465448 30103 pending_rounds.cc:85] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719: Aborting all ops after (but not including) 3
W20260709 13:11:19.450623   783 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.047s	user 0.042s	sys 0.155s
I20260709 13:11:19.465662 30103 pending_rounds.cc:107] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719: Aborting uncommitted NO_OP operation due to leader change: 4.4
I20260709 13:11:19.466154 30103 raft_consensus.cc:2889] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:19.061432   715 raft_consensus.cc:493] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.065150   853 raft_consensus.cc:493] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:19.186003   613 consensus_meta.cc:287] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent flushing consensus metadata: real 0.777s	user 0.009s	sys 0.000s
I20260709 13:11:18.689877   622 raft_consensus.cc:493] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:19.418216   717 raft_consensus.cc:493] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.455170   772 raft_consensus.cc:493] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:19.459664 30028 raft_consensus.cc:1240] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:19.459472   771 raft_consensus.cc:493] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:19.468027   652 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.026s	sys 0.010s
I20260709 13:11:19.470237 30024 raft_consensus.cc:2468] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 4.
I20260709 13:11:18.694495   806 consensus_queue.cc:1048] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.766s
I20260709 13:11:18.695156   880 consensus_queue.cc:1048] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.769s
I20260709 13:11:19.459429 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:19.489715 30023 raft_consensus.cc:2468] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 10.
I20260709 13:11:19.411322 32579 leader_election.cc:290] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:19.447571   492 leader_election.cc:290] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:19.468881   787 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.005s	sys 0.009s
W20260709 13:11:19.479519 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 482246us
I20260709 13:11:19.457903   850 raft_consensus.cc:515] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:19.137136   865 raft_consensus.cc:515] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:18.788414   516 consensus_queue.cc:237] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:19.444926   714 consensus_queue.cc:1175] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c99569d27a6f4c648eae7119fe3db124" responder_term: 9 status { last_received { term: 9 index: 6 } last_committed_idx: 5 last_received_current_leader { term: 9 index: 6 } }
I20260709 13:11:19.475445   717 raft_consensus.cc:3060] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:19.475616   773 raft_consensus.cc:2804] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:19.473927   697 raft_consensus.cc:493] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:19.506212 29922 catalog_manager.cc:5697] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 4 to 5, leader changed from 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 5 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:19.465533   440 raft_consensus.cc:515] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:19.436627   892 consensus_queue.cc:237] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:19.474020   613 raft_consensus.cc:515] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:19.504354 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 86923.7us
I20260709 13:11:19.501804   389 leader_election.cc:290] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:19.498296   787 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.836s	user 0.005s	sys 0.009s
I20260709 13:11:19.486660   890 raft_consensus.cc:493] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:19.474316   853 raft_consensus.cc:515] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:19.473991   891 raft_consensus.cc:493] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:19.503894   779 raft_consensus.cc:493] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.478412   622 raft_consensus.cc:515] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:19.486343   772 raft_consensus.cc:515] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:19.473572   715 raft_consensus.cc:515] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:19.486191   771 raft_consensus.cc:515] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:19.514707 30068 leader_election.cc:304] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:11:19.507707   773 raft_consensus.cc:493] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:19.507057   898 raft_consensus.cc:2804] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:11:19.514057 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 93973.2us
I20260709 13:11:19.519613 30730 raft_consensus.cc:1240] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:19.512532   866 raft_consensus.cc:493] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:19.527434 30172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43838 (request call id 2190) took 1152 ms. Trace:
I20260709 13:11:19.511588   697 raft_consensus.cc:515] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:19.523000   898 raft_consensus.cc:493] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.523514   773 raft_consensus.cc:3060] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:19.529978 30172 rpcz_store.cc:276] 0709 13:11:18.376573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.489110 (+112537us) service_pool.cc:224] Handling call
0709 13:11:18.489399 (+   289us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:18.558833 (+ 69434us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:18.558863 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:18.587184 (+ 28321us) log.cc:844] Serialized 26 byte log entry
0709 13:11:18.615096 (+ 27912us) spinlock_profiling.cc:243] Waited 3.82 ms on lock 0x7b180039e7a0. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f7e95de1 00007f99f7ea25b1 00007f99eefafe07 00007f99f7e0aab9 00007f99eefcc69b 00007f99eefca93f 00007f99eefccc02 00007f99f1c5420b 00007f99f1c59d23 00007f99f1c5a0d1 00007f99f2075a0f
0709 13:11:19.095145 (+480049us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:19.095188 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.527151 (+431963us) spinlock_profiling.cc:243] Waited 69.1 ms on lock 0x7b5400224054. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:11:19.527205 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:19.527247 (+    42us) raft_consensus.cc:1685] finished
0709 13:11:19.527260 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:19.527379 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22206,"raft.queue_time_us":428,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":19086,"spinlock_wait_cycles":167612032,"thread_start_us":479827,"threads_started":1,"wal-append.queue_time_us":849649}
I20260709 13:11:19.534111 29922 catalog_manager.cc:5697] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 3 to 7, leader changed from c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 7 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:19.521054   891 raft_consensus.cc:515] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:19.518350   787 consensus_queue.cc:1048] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:11:19.516172   779 raft_consensus.cc:515] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:19.546746   743 leader_election.cc:290] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:19.547079   440 leader_election.cc:290] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:19.547617   440 raft_consensus.cc:493] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:19.516681   890 raft_consensus.cc:515] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:19.536389   898 raft_consensus.cc:3060] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:19.559900   823 leader_election.cc:290] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:19.563616   896 log.cc:927] Time spent T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 13:11:19.550329 29922 catalog_manager.cc:5697] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:19.545910   863 leader_election.cc:290] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:19.550100   440 raft_consensus.cc:515] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:19.534754   900 consensus_queue.cc:1048] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:11:19.526746   866 raft_consensus.cc:515] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:19.559949   715 leader_election.cc:290] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:19.591756   772 leader_election.cc:290] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:19.577026   850 leader_election.cc:290] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:19.594744   622 leader_election.cc:290] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:11:19.597244 32573 consensus_meta.cc:287] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent flushing consensus metadata: real 0.921s	user 0.002s	sys 0.006s
I20260709 13:11:19.597429   613 leader_election.cc:290] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:19.593947   779 leader_election.cc:290] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:19.589064 29922 catalog_manager.cc:5697] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 4 to 6, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 6 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } }
I20260709 13:11:19.581962   865 leader_election.cc:290] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 10 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:19.603938 30103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33992 (request call id 1788) took 1358 ms. Trace:
W20260709 13:11:19.600889   889 log.cc:927] Time spent T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260709 13:11:19.598593   899 raft_consensus.cc:2804] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:19.609421 30103 rpcz_store.cc:276] 0709 13:11:18.245558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.245793 (+   235us) service_pool.cc:224] Handling call
0709 13:11:18.246042 (+   249us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:19.466546 (+1220504us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.603719 (+137173us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54003b4054. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:11:19.603874 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2801493376}
I20260709 13:11:19.600620   853 leader_election.cc:290] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:19.607860   576 raft_consensus.cc:493] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.599673   863 consensus_queue.cc:1048] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
W20260709 13:11:19.658246 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 157966us
W20260709 13:11:19.659602 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 136003us
I20260709 13:11:19.621796   899 raft_consensus.cc:493] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.670373   899 raft_consensus.cc:3060] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:19.671197   866 leader_election.cc:290] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:19.662827 30020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54206 (request call id 1710) took 1151 ms. Trace:
I20260709 13:11:19.673098 29922 catalog_manager.cc:5697] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 5 to 6, leader changed from c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 6 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:19.667615 29993 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:19.672194 30020 rpcz_store.cc:276] 0709 13:11:18.511463 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.511573 (+   110us) service_pool.cc:224] Handling call
0709 13:11:19.662621 (+1151048us) spinlock_profiling.cc:243] Waited 60 ms on lock 0x7b5400154854. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:11:19.662744 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":138097024}
I20260709 13:11:19.602478   709 raft_consensus.cc:515] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:19.608520 32573 raft_consensus.cc:515] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:19.680286   890 leader_election.cc:290] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:19.672848   576 raft_consensus.cc:515] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:19.684044   440 leader_election.cc:290] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:19.684991   576 leader_election.cc:290] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:19.685281   440 raft_consensus.cc:493] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.688071 30169 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43838 (request call id 2192) took 1311 ms. Trace:
I20260709 13:11:19.691485 30169 rpcz_store.cc:276] 0709 13:11:18.377070 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.597684 (+220614us) service_pool.cc:224] Handling call
0709 13:11:18.623939 (+ 26255us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:18.735543 (+111604us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:18.735577 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:18.735620 (+    43us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:18.735656 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.687849 (+952193us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b5400286754. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:11:19.687895 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:19.688012 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":256115584}
I20260709 13:11:19.690796 30100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33990 (request call id 2197) took 1184 ms. Trace:
I20260709 13:11:19.693427 30100 rpcz_store.cc:276] 0709 13:11:18.506317 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.506548 (+   231us) service_pool.cc:224] Handling call
0709 13:11:18.506824 (+   276us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:18.517719 (+ 10895us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:18.517749 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:18.518194 (+   445us) log.cc:844] Serialized 26 byte log entry
0709 13:11:19.425713 (+907519us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:19.425778 (+    65us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.425848 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:19.690585 (+264737us) raft_consensus.cc:1685] finished
0709 13:11:19.690612 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:19.690739 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1193,"raft.queue_time_us":7081,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":18376,"thread_start_us":821260,"threads_started":1,"wal-append.queue_time_us":904630}
I20260709 13:11:19.685786   440 raft_consensus.cc:515] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:19.698103   899 raft_consensus.cc:515] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:19.700485   717 raft_consensus.cc:515] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:19.714689 30022 raft_consensus.cc:2393] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 8: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:11:19.703299 30700 leader_election.cc:304] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:19.703801   840 consensus_queue.cc:1048] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:19.716454   717 leader_election.cc:290] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:19.716681   840 raft_consensus.cc:2804] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:19.716914 32573 leader_election.cc:290] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:19.717505   613 raft_consensus.cc:493] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:19.705122 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:19.718616 30023 raft_consensus.cc:2410] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:11:19.705958   697 leader_election.cc:290] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:19.706702   779 raft_consensus.cc:493] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:19.719625   779 raft_consensus.cc:515] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:19.721257 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:19.707507 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:19.708173 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:19.721787   840 raft_consensus.cc:493] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.722200   840 raft_consensus.cc:3060] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:19.708869 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:19.709828   891 leader_election.cc:290] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:19.710858 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:19.713073 30172 raft_consensus.cc:1275] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:11:19.690339   640 consensus_meta.cc:287] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent flushing consensus metadata: real 1.232s	user 0.005s	sys 0.006s
I20260709 13:11:19.724890   640 raft_consensus.cc:515] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:19.726836   640 leader_election.cc:290] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:19.721611   779 leader_election.cc:290] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:19.715368   440 leader_election.cc:290] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:19.715431   899 leader_election.cc:290] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:11:19.730480 30142 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.339s	user 0.031s	sys 0.062s
W20260709 13:11:19.730801 30142 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.339s	user 0.031s	sys 0.062s
W20260709 13:11:19.731279 30142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 1.34079e+06us
I20260709 13:11:19.732106 30142 leader_election.cc:304] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:19.741643 30175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43840 (request call id 1862) took 1338 ms. Trace:
I20260709 13:11:19.742050 30175 rpcz_store.cc:276] 0709 13:11:18.402964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.414323 (+ 11359us) service_pool.cc:224] Handling call
0709 13:11:19.741502 (+1327179us) spinlock_profiling.cc:243] Waited 42.7 ms on lock 0x7b54002b3c54. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:11:19.741593 (+    91us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":98205568}
I20260709 13:11:19.718063   613 raft_consensus.cc:515] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:19.741103   898 raft_consensus.cc:515] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:19.751644 30069 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.009s	sys 0.020s
W20260709 13:11:19.752040 30069 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.009s	sys 0.020s
I20260709 13:11:19.735329 29993 leader_election.cc:304] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:19.709350   878 raft_consensus.cc:515] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:19.750103 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:19.754940 30023 raft_consensus.cc:3060] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:19.754863 30700 leader_election.cc:304] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:19.756196 30142 leader_election.cc:304] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:11:19.745529 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 296674us
I20260709 13:11:19.756004 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:19.759162 30142 leader_election.cc:304] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
W20260709 13:11:19.759265 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 232007us
I20260709 13:11:19.761214 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:19.761372 30142 leader_election.cc:304] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:19.761772 30099 raft_consensus.cc:3060] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:19.762581 30142 leader_election.cc:304] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:19.760978 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:19.763595 30102 raft_consensus.cc:2468] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 10.
I20260709 13:11:19.764412 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:19.765341 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:19.766054 30102 raft_consensus.cc:2368] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 4. Current term is 5.
I20260709 13:11:19.761004 29994 leader_election.cc:304] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:19.768033 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:19.768100 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:19.769332 30095 raft_consensus.cc:1275] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:11:19.769640 30103 raft_consensus.cc:2393] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 10: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:19.744123   890 raft_consensus.cc:2749] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:19.777984 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:19.780544 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:19.779975 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:19.778151 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:19.777590 30728 raft_consensus.cc:1240] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:11:19.781160 30737 raft_consensus.cc:2468] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 10.
I20260709 13:11:19.780982 30168 raft_consensus.cc:2468] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 7.
I20260709 13:11:19.783336 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:19.783540 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:19.781308 30101 raft_consensus.cc:2468] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 5.
I20260709 13:11:19.783831 30168 raft_consensus.cc:3060] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:19.776638 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:19.786433 30729 raft_consensus.cc:3060] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:11:19.779793 30176 raft_consensus.cc:1240] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:19.778915 30142 leader_election.cc:304] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:19.781394 30733 raft_consensus.cc:3060] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:19.798065   890 raft_consensus.cc:2749] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:19.805298 30702 leader_election.cc:304] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:19.808137 30729 raft_consensus.cc:2468] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 8.
I20260709 13:11:19.772570 30102 raft_consensus.cc:2468] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 8.
I20260709 13:11:19.812186 30733 raft_consensus.cc:2468] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 5.
I20260709 13:11:19.818013 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:19.818701 30096 raft_consensus.cc:2368] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 9. Current term is 10.
W20260709 13:11:19.819072 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 58132.9us
I20260709 13:11:19.819108 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:19.820348 30729 raft_consensus.cc:3060] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:19.818061 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:19.822697 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:19.823238 30175 raft_consensus.cc:3060] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Advancing to term 10
W20260709 13:11:19.824805 30027 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52098 (request call id 617) took 1695 ms (client timeout 2196 ms). Trace:
W20260709 13:11:19.825201 30027 rpcz_store.cc:269] 0709 13:11:18.129697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.130591 (+   894us) service_pool.cc:224] Handling call
0709 13:11:19.824660 (+1694069us) spinlock_profiling.cc:243] Waited 333 ms on lock 0x7b54001a8bd4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:11:19.824752 (+    92us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":766237568}
I20260709 13:11:19.826308 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:19.827193 30700 leader_election.cc:304] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:19.755597   899 raft_consensus.cc:493] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:19.759712   516 raft_consensus.cc:2804] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:19.844355 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:19.813737 30168 raft_consensus.cc:2468] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 5.
I20260709 13:11:19.769258   823 raft_consensus.cc:2804] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:19.836944 30729 raft_consensus.cc:2468] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 11.
I20260709 13:11:19.839543 30099 raft_consensus.cc:2468] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 11.
I20260709 13:11:19.842579 30175 raft_consensus.cc:2468] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 10.
I20260709 13:11:19.769238   440 raft_consensus.cc:3060] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:19.848415 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:19.850106 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:19.852317 30731 raft_consensus.cc:2468] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 8.
I20260709 13:11:19.852631 30175 raft_consensus.cc:2468] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 6.
I20260709 13:11:19.819490   622 raft_consensus.cc:2804] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:19.857918   622 raft_consensus.cc:493] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.858260   622 raft_consensus.cc:3060] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:19.769285   909 raft_consensus.cc:493] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:19.852385   779 raft_consensus.cc:2749] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:19.819698   877 raft_consensus.cc:2804] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:19.865970 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:19.846402 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:19.851408   899 raft_consensus.cc:515] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:19.857355   891 raft_consensus.cc:493] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:19.819250   892 raft_consensus.cc:2804] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:19.863405 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:19.868829 30100 raft_consensus.cc:2468] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 8.
I20260709 13:11:19.866765 29922 catalog_manager.cc:5697] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 2 to 6, leader changed from 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 6 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:19.866881 30099 raft_consensus.cc:2468] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 6.
I20260709 13:11:19.871533 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:19.855764 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:19.872795 30175 raft_consensus.cc:2468] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 5.
I20260709 13:11:19.873651 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:19.819382 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:19.875684 30733 raft_consensus.cc:2468] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 6.
I20260709 13:11:19.876008 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:19.877066 30068 leader_election.cc:304] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:19.812467   923 consensus_queue.cc:1048] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:19.849306   516 raft_consensus.cc:493] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.779223   905 consensus_queue.cc:1048] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 13:11:19.886345 30068 leader_election.cc:304] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:19.886705 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:19.891773 30174 raft_consensus.cc:2393] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 11: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:11:19.888891   863 raft_consensus.cc:2804] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:19.892557   863 raft_consensus.cc:493] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:19.892692   806 raft_consensus.cc:493] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:19.892970   863 raft_consensus.cc:3060] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:19.893272   806 raft_consensus.cc:515] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:19.889081   516 raft_consensus.cc:3060] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:19.895318   806 leader_election.cc:290] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:19.896799 30142 leader_election.cc:304] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
W20260709 13:11:19.897492 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 47275.8us
I20260709 13:11:19.898690 29994 leader_election.cc:304] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:19.899937   927 raft_consensus.cc:2804] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:19.900384   927 raft_consensus.cc:493] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:19.900738   927 raft_consensus.cc:3060] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:19.888147 30102 raft_consensus.cc:1240] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:19.852805   919 raft_consensus.cc:493] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:19.817335   922 raft_consensus.cc:2764] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:11:19.911245 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:19.912493 30068 leader_election.cc:304] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:19.853003   823 raft_consensus.cc:493] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:19.922837   823 raft_consensus.cc:3060] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:11:19.923410 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 96303.7us
I20260709 13:11:19.851697   911 raft_consensus.cc:493] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:19.915625 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:19.926299 30096 raft_consensus.cc:2468] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 7.
I20260709 13:11:19.926167   911 raft_consensus.cc:515] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:19.916489 30142 leader_election.cc:304] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:19.922348   866 raft_consensus.cc:2804] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:19.922485 30068 leader_election.cc:304] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:19.929206 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:19.861976   909 raft_consensus.cc:515] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:19.928798 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:19.886251   892 raft_consensus.cc:493] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.934785 30731 raft_consensus.cc:2468] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 5.
I20260709 13:11:19.927943 30142 leader_election.cc:304] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:19.916308 29922 catalog_manager.cc:5697] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 5 to 6, leader changed from 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 6 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:19.936105 30068 leader_election.cc:304] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:19.936775 30702 leader_election.cc:304] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:19.932097 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:19.865559   877 raft_consensus.cc:493] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:19.940774 30068 leader_election.cc:304] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:19.939881 29994 leader_election.cc:304] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:19.886009   697 raft_consensus.cc:493] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:19.934340 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:19.943275 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:19.910729   898 leader_election.cc:290] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 10 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:19.885530   914 raft_consensus.cc:493] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:19.888067   801 raft_consensus.cc:493] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
W20260709 13:11:19.945142 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 124623us
I20260709 13:11:19.937071 29922 catalog_manager.cc:5697] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 2 to 4, leader changed from 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) to 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68). New cstate: current_term: 4 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:19.919126   900 raft_consensus.cc:2749] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:19.949903 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:19.938606   892 raft_consensus.cc:3060] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:19.947852 30068 leader_election.cc:304] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:19.945426   877 raft_consensus.cc:3060] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:19.929503 32573 raft_consensus.cc:493] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:19.935587   866 raft_consensus.cc:493] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.960327 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:19.919278   806 raft_consensus.cc:2804] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:19.953982 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:19.944851   389 raft_consensus.cc:2804] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:19.888684   891 raft_consensus.cc:515] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:19.961385 30068 leader_election.cc:304] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:19.962186 29922 catalog_manager.cc:5697] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 4 to 6, leader changed from 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 6 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:19.951607   906 raft_consensus.cc:2804] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:11:19.986418 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 49729.3us
I20260709 13:11:19.953673   901 raft_consensus.cc:2749] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:19.943233   910 raft_consensus.cc:2804] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:19.962473 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:19.976616 30068 leader_election.cc:304] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:19.978009 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:19.958425   853 raft_consensus.cc:2804] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:19.989404 30702 leader_election.cc:304] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:19.960090   898 raft_consensus.cc:493] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:19.930002   919 raft_consensus.cc:515] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:19.985563   389 raft_consensus.cc:493] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:19.966965   850 raft_consensus.cc:2804] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:19.992975   652 raft_consensus.cc:2804] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:19.966708   904 raft_consensus.cc:493] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:19.994227 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:19.952929   697 raft_consensus.cc:515] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:19.997911   772 raft_consensus.cc:2804] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 13:11:19.998196   907 log.cc:927] Time spent T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.339s	user 0.000s	sys 0.003s
I20260709 13:11:20.000765   911 leader_election.cc:290] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:19.978642   866 raft_consensus.cc:3060] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:19.977324 32573 raft_consensus.cc:515] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:19.951901   902 consensus_queue.cc:1048] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 13:11:20.024282   809 raft_consensus.cc:2804] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:19.962150   613 leader_election.cc:290] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:19.992347   773 raft_consensus.cc:515] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:19.993422   909 leader_election.cc:290] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:19.975795   743 raft_consensus.cc:2749] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:20.014379   389 raft_consensus.cc:3060] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:19.994925 30024 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52098 (request call id 612) took 2550 ms (client timeout 1552 ms). Trace:
I20260709 13:11:19.990583 30068 leader_election.cc:304] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:19.957577   914 raft_consensus.cc:515] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:20.064213 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 73695.5us
I20260709 13:11:19.989476   900 raft_consensus.cc:2804] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:20.019528 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:11:20.063966 30024 rpcz_store.cc:269] 0709 13:11:17.444092 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:17.444229 (+   137us) service_pool.cc:224] Handling call
0709 13:11:19.994750 (+2550521us) spinlock_profiling.cc:243] Waited 2.01 s on lock 0x7b54001a90d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:11:19.994839 (+    89us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4622179584}
I20260709 13:11:20.014146   652 raft_consensus.cc:493] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:20.021301   899 leader_election.cc:290] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:20.022330 30100 raft_consensus.cc:2410] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260709 13:11:20.022456 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:19.986418   906 raft_consensus.cc:493] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:19.959388   801 raft_consensus.cc:515] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:20.021235   924 log.cc:927] Time spent T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 13:11:20.003777   853 raft_consensus.cc:493] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:20.036109 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:20.030450 30026 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54198 (request call id 1994) took 1389 ms. Trace:
W20260709 13:11:20.041927 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 52583.6us
I20260709 13:11:19.964959   709 leader_election.cc:290] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:19.991263   910 raft_consensus.cc:493] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:20.070562 30068 leader_election.cc:304] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:20.010484   806 raft_consensus.cc:697] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 11 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:20.051189 30143 leader_election.cc:304] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:20.069746 30026 rpcz_store.cc:276] 0709 13:11:18.640765 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.654042 (+ 13277us) service_pool.cc:224] Handling call
0709 13:11:19.409985 (+755943us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:19.410206 (+   221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:19.410229 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:19.410777 (+   548us) log.cc:844] Serialized 26 byte log entry
0709 13:11:19.658814 (+248037us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:19.658848 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:19.658912 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:19.997662 (+338750us) spinlock_profiling.cc:243] Waited 6.59 ms on lock 0x7b4400022b4c. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eeef3c85 00007f99eeef46a2 00007f99f1c661db 00007f99f1c61aaf 00007f99f1c5586e 00007f99f1c54bb6 00007f99f1c547d8 00007f99f1c5e221 00007f99f1c5e1d9 00007f99f1c5e169
0709 13:11:20.030169 (+ 32507us) raft_consensus.cc:1685] finished
0709 13:11:20.030189 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:20.030395 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":15149440,"thread_start_us":198512,"threads_started":1,"wal-append.queue_time_us":210614}
W20260709 13:11:20.067814 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 151910us
I20260709 13:11:20.070978 30702 leader_election.cc:304] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
W20260709 13:11:20.073936 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 122219us
I20260709 13:11:20.074088 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:20.027696   772 raft_consensus.cc:493] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:20.033603 32573 leader_election.cc:290] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:20.027731   925 raft_consensus.cc:2749] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:20.014567   898 raft_consensus.cc:515] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:20.028065   850 raft_consensus.cc:697] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 5 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:20.079918 30140 leader_election.cc:304] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:20.077155 30066 leader_election.cc:304] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:20.086360 30066 leader_election.cc:304] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:20.087399 30066 leader_election.cc:304] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:20.087764 30023 raft_consensus.cc:2468] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 10.
I20260709 13:11:20.084228 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:20.082264 30702 leader_election.cc:304] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:20.067217   652 raft_consensus.cc:3060] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:20.090608   943 raft_consensus.cc:2749] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:20.091324   943 raft_consensus.cc:2749] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:20.091945   943 consensus_queue.cc:1059] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:20.069152   865 raft_consensus.cc:2804] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:20.095664 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:20.095865 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:20.096871 30175 raft_consensus.cc:2393] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 9: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:11:20.071426   853 raft_consensus.cc:3060] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:20.070293   906 raft_consensus.cc:3060] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:20.075749   890 raft_consensus.cc:2764] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 13:11:20.101634 30700 leader_election.cc:304] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:20.074105   900 raft_consensus.cc:697] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 10 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:20.080727   772 raft_consensus.cc:3060] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:20.028230   904 raft_consensus.cc:515] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:20.205488   880 raft_consensus.cc:2764] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:11:20.089095   743 raft_consensus.cc:2749] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:20.217507 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:20.083601   899 raft_consensus.cc:2804] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:20.210990 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:20.074347   910 raft_consensus.cc:3060] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:20.211558 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 129348us
W20260709 13:11:20.211711 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 110155us
W20260709 13:11:20.212165 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 132325us
I20260709 13:11:20.099804   865 raft_consensus.cc:493] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:20.211097   843 raft_consensus.cc:3060] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:20.071657   840 raft_consensus.cc:515] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:20.238991 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:20.239642 30023 raft_consensus.cc:2468] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 4.
I20260709 13:11:20.219678 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:11:20.218322 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 127195us
I20260709 13:11:20.234169 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:20.241130 30068 leader_election.cc:304] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:20.241649 30103 raft_consensus.cc:1275] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
W20260709 13:11:20.236119 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 163104us
I20260709 13:11:20.094841   715 raft_consensus.cc:2749] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:20.216187   613 raft_consensus.cc:2749] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:20.234871 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:20.099324   863 raft_consensus.cc:515] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:20.255137 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:20.255385 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:20.221294   911 raft_consensus.cc:3055] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:20.257881   911 raft_consensus.cc:740] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:20.258683   911 consensus_queue.cc:260] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:20.259543   823 raft_consensus.cc:515] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:20.203924   516 raft_consensus.cc:515] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:20.242695 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:20.215855   622 raft_consensus.cc:515] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:20.262461 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:20.211247 32573 raft_consensus.cc:493] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:20.245532 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:20.302783 30095 raft_consensus.cc:2393] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 5: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:20.247294 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:20.236179 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:20.304374 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:20.210420   934 raft_consensus.cc:493] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.239080   922 raft_consensus.cc:493] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:20.246953   709 raft_consensus.cc:2764] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:11:20.217658   909 raft_consensus.cc:2804] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:20.257333   773 leader_election.cc:290] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:20.242797 30143 leader_election.cc:304] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:20.291465 30023 raft_consensus.cc:2468] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 8.
I20260709 13:11:20.308976   697 leader_election.cc:290] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:20.291586 30026 raft_consensus.cc:2393] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 10: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:11:20.295616 30024 raft_consensus.cc:2468] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 4.
I20260709 13:11:20.251870 30068 leader_election.cc:304] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:11:20.294984 30099 raft_consensus.cc:1275] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260709 13:11:20.326521 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 74709.1us
I20260709 13:11:20.327195 30068 leader_election.cc:304] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:20.221586   899 raft_consensus.cc:493] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:20.298722 30737 raft_consensus.cc:1240] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:20.239985   865 raft_consensus.cc:3060] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:20.237387   576 raft_consensus.cc:493] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:20.309535 30168 raft_consensus.cc:2393] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 8: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:11:20.252161 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:20.215598   811 leader_election.cc:290] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:20.316118 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:20.259639   911 raft_consensus.cc:3060] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:20.320569 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:11:20.329322 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 86595.4us
I20260709 13:11:20.362567   930 raft_consensus.cc:493] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:20.363111   930 raft_consensus.cc:515] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:20.262382   880 consensus_queue.cc:1048] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.065s
I20260709 13:11:20.330607 30068 leader_election.cc:304] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:11:20.331830   899 raft_consensus.cc:3060] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:20.317566   516 leader_election.cc:290] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:20.312393 32573 raft_consensus.cc:515] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:20.239289   806 consensus_queue.cc:237] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:20.350565 30021 raft_consensus.cc:1240] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:20.363343   576 raft_consensus.cc:515] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:20.353012   714 raft_consensus.cc:493] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.361261   942 raft_consensus.cc:2804] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:20.327968   909 raft_consensus.cc:697] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
W20260709 13:11:20.358834   937 log.cc:927] Time spent T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 13:11:20.332469   773 raft_consensus.cc:2749] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:20.383836   715 raft_consensus.cc:2804] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:20.298040   850 consensus_queue.cc:237] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:20.330377   709 raft_consensus.cc:2804] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:11:20.379736 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 292386us
I20260709 13:11:20.316460   934 raft_consensus.cc:515] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:20.353947   389 raft_consensus.cc:515] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:20.351639   698 leader_election.cc:290] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451)
I20260709 13:11:20.333868   891 leader_election.cc:290] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:20.401674   942 raft_consensus.cc:493] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:20.352852   943 raft_consensus.cc:493] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:20.365139   673 raft_consensus.cc:493] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.394843   622 leader_election.cc:290] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:20.414037   715 raft_consensus.cc:493] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
W20260709 13:11:20.408346   440 consensus_meta.cc:287] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent flushing consensus metadata: real 0.551s	user 0.007s	sys 0.002s
I20260709 13:11:20.359890   914 leader_election.cc:290] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:20.317584   922 raft_consensus.cc:515] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:20.404479 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
W20260709 13:11:20.448932 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 46035.9us
I20260709 13:11:20.455629 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:20.406946   714 raft_consensus.cc:515] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:20.318743   900 consensus_queue.cc:237] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:20.419806   840 leader_election.cc:290] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 11 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:20.458384 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:20.458983 30021 raft_consensus.cc:2468] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 6.
I20260709 13:11:20.418892   898 leader_election.cc:290] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:20.410171   823 leader_election.cc:290] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:20.459515 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:20.449079   942 raft_consensus.cc:3060] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:20.421587   709 raft_consensus.cc:697] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 8 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:20.453723   715 raft_consensus.cc:3060] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:20.423565   801 leader_election.cc:290] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:20.466600 30021 raft_consensus.cc:3060] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:20.457125   440 raft_consensus.cc:2749] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 13:11:20.462291   941 log.cc:927] Time spent T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:11:20.485656 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:20.486394 30026 raft_consensus.cc:3060] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:20.487171 30020 raft_consensus.cc:1240] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260709 13:11:20.488263 30735 raft_consensus.cc:2468] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 4.
I20260709 13:11:20.490693   713 consensus_queue.cc:1048] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:20.453580   673 raft_consensus.cc:515] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:20.422552   772 raft_consensus.cc:515] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:20.451740   943 raft_consensus.cc:515] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:20.465615   809 raft_consensus.cc:493] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:20.498314   652 raft_consensus.cc:515] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:20.501454 30024 raft_consensus.cc:1240] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:20.456789   949 consensus_queue.cc:1059] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 13:11:20.469977   863 leader_election.cc:290] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 11 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:20.500653   809 raft_consensus.cc:3060] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:20.515362   898 raft_consensus.cc:3055] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:20.515766   898 raft_consensus.cc:740] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:20.516510   898 consensus_queue.cc:260] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:20.506443   673 leader_election.cc:290] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:20.507802   927 consensus_meta.cc:287] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent flushing consensus metadata: real 0.607s	user 0.010s	sys 0.000s
I20260709 13:11:20.517805   898 raft_consensus.cc:3060] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:20.519335 32573 leader_election.cc:290] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:20.508432   772 leader_election.cc:290] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:20.510136   709 consensus_queue.cc:237] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:20.513154   922 leader_election.cc:290] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:20.514391   576 leader_election.cc:290] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:20.474737   909 consensus_queue.cc:237] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:20.523398   866 raft_consensus.cc:515] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:20.525112 30101 raft_consensus.cc:2393] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 8: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:20.534864 30026 raft_consensus.cc:2468] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 5.
I20260709 13:11:20.500278   652 leader_election.cc:290] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:20.794567 30022 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54198 (request call id 1989) took 2275 ms. Trace:
W20260709 13:11:20.806439 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 190891us
I20260709 13:11:20.806649 30022 rpcz_store.cc:276] 0709 13:11:18.518800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.569189 (+ 50389us) service_pool.cc:224] Handling call
0709 13:11:20.794341 (+2225152us) spinlock_profiling.cc:243] Waited 297 ms on lock 0x7b5400354154. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:11:20.794499 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":682481920}
I20260709 13:11:20.808282 30021 raft_consensus.cc:2468] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 7.
I20260709 13:11:20.725095 30171 raft_consensus.cc:1275] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 13:11:20.588603 30019 raft_consensus.cc:2468] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 10.
I20260709 13:11:20.730221 30730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51014 (request call id 959) took 2469 ms. Trace:
W20260709 13:11:20.510089   877 consensus_meta.cc:287] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124: Time spent flushing consensus metadata: real 0.533s	user 0.007s	sys 0.001s
I20260709 13:11:20.809840 30730 rpcz_store.cc:276] 0709 13:11:18.260885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:18.268886 (+  8001us) service_pool.cc:224] Handling call
0709 13:11:18.269138 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:19.522266 (+1253128us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.730000 (+1207734us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b5400740254. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:11:20.730149 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2875404544}
W20260709 13:11:20.539063   892 consensus_meta.cc:287] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124: Time spent flushing consensus metadata: real 0.558s	user 0.007s	sys 0.000s
I20260709 13:11:20.686446   771 leader_election.cc:290] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:20.737921   919 leader_election.cc:290] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:20.623668 30702 leader_election.cc:304] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:20.526923   947 raft_consensus.cc:493] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.813336   947 raft_consensus.cc:515] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:20.815644   947 leader_election.cc:290] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:20.612380 30176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43838 (request call id 2194) took 1568 ms. Trace:
W20260709 13:11:20.816962 30069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:20.816798 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:20.817426 30737 raft_consensus.cc:3060] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:20.817656 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:20.818403 30735 raft_consensus.cc:2393] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 8: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:20.625043   714 leader_election.cc:290] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:20.819171 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:20.711104   910 raft_consensus.cc:515] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:20.684068   853 raft_consensus.cc:515] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:20.810575   877 raft_consensus.cc:515] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:20.822556 30102 raft_consensus.cc:1240] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:20.823660   883 consensus_queue.cc:1059] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:20.811964   892 raft_consensus.cc:515] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:20.737367   715 raft_consensus.cc:515] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:20.825958 30169 raft_consensus.cc:2393] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 9: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:11:20.826545 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:20.826799 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:20.827399   892 leader_election.cc:290] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:20.732508   943 leader_election.cc:290] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:20.825191   673 raft_consensus.cc:3055] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:20.828078   673 raft_consensus.cc:740] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:20.828166 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:20.828852 30177 raft_consensus.cc:2468] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 3.
I20260709 13:11:20.829914 30737 raft_consensus.cc:2468] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 11.
I20260709 13:11:20.830982 30174 raft_consensus.cc:1240] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:20.838209 30170 raft_consensus.cc:1240] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:20.823953   877 leader_election.cc:290] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:11:20.833261 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 209670us
I20260709 13:11:20.834124 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:20.530745   927 raft_consensus.cc:515] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:20.816411 30176 rpcz_store.cc:276] 0709 13:11:19.044382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.460622 (+416240us) service_pool.cc:224] Handling call
0709 13:11:19.460876 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:19.790025 (+329149us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:20.612119 (+822094us) spinlock_profiling.cc:243] Waited 319 ms on lock 0x7b5400224a54. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:11:20.612314 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":733034240}
I20260709 13:11:20.821063   910 leader_election.cc:290] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:11:20.850436 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 393002us
I20260709 13:11:20.855417 30171 raft_consensus.cc:3060] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:11:20.808599 30703 leader_election.cc:304] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
W20260709 13:11:20.857589 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 49048.3us
I20260709 13:11:20.861675 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
W20260709 13:11:20.800357   906 consensus_meta.cc:287] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent flushing consensus metadata: real 0.588s	user 0.003s	sys 0.002s
I20260709 13:11:20.864444 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:20.864485 30142 leader_election.cc:304] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:20.866415 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:20.867615 30171 raft_consensus.cc:2468] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 8.
I20260709 13:11:20.870196 30066 leader_election.cc:304] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:20.871199 30175 raft_consensus.cc:2393] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 10: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:20.871966 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:20.872399 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:20.624133   840 raft_consensus.cc:493] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.809381 32579 raft_consensus.cc:493] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.872982 30100 raft_consensus.cc:2468] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 5.
I20260709 13:11:20.883464 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:20.884310 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:20.884444 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:20.885586 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:20.885000 30733 raft_consensus.cc:2393] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 11: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:11:20.886574 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:20.864895 30140 leader_election.cc:304] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:20.838837   919 raft_consensus.cc:2749] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:20.530212   930 leader_election.cc:290] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:20.875885 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:20.876457 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:20.877080 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:20.901270 30094 raft_consensus.cc:2468] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 6.
I20260709 13:11:20.877918 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:20.695235   866 leader_election.cc:290] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:20.902189 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:20.528991   865 raft_consensus.cc:515] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:20.878401 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:20.882740 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:20.906704 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:20.878067 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:20.824225   853 leader_election.cc:290] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:20.798460   899 raft_consensus.cc:515] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:20.888227 30728 raft_consensus.cc:3060] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:20.803627   911 raft_consensus.cc:493] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.889614 30140 leader_election.cc:304] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:20.884450 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:20.883348 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:20.885593 30101 raft_consensus.cc:1275] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:20.612392   809 raft_consensus.cc:515] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:20.891390 32579 raft_consensus.cc:515] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:20.894928 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:20.895038 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:20.895124 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:20.536892   934 leader_election.cc:290] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:20.897379 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:20.931090 30095 raft_consensus.cc:2410] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for term 7 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 13:11:20.859368   627 raft_consensus.cc:2749] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:20.916261   389 leader_election.cc:290] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:20.791358   904 leader_election.cc:290] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:20.877334 30066 leader_election.cc:304] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:20.904069 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:20.902053   877 raft_consensus.cc:2804] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:11:20.905226 30094 raft_consensus.cc:2368] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 7. Current term is 8.
I20260709 13:11:21.001268 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:21.001778   865 leader_election.cc:290] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:21.002396 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:21.003053 30094 raft_consensus.cc:2468] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 9.
I20260709 13:11:21.003857 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:21.004789 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:20.913475   940 consensus_queue.cc:1048] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.062s
I20260709 13:11:20.908038 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
W20260709 13:11:21.004954 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 466802us
I20260709 13:11:21.007031 30099 raft_consensus.cc:3060] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:20.961876   905 raft_consensus.cc:493] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:20.911231 29994 leader_election.cc:304] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:20.912513 30737 raft_consensus.cc:2393] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 6: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:11:20.803450   942 raft_consensus.cc:515] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:20.914963 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:20.917938 30098 raft_consensus.cc:1240] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:20.914448 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:20.919342 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:20.895697   806 raft_consensus.cc:2804] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:20.917860 30020 raft_consensus.cc:2393] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 8: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:11:20.894399   910 raft_consensus.cc:2804] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:20.962878 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:20.870189   783 consensus_queue.cc:1048] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.046s
I20260709 13:11:20.961325 30100 raft_consensus.cc:2393] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 7: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
W20260709 13:11:20.963351 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 73806.6us
I20260709 13:11:20.965503 30096 raft_consensus.cc:1240] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:20.901782   943 raft_consensus.cc:493] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.967864 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:20.968863 30734 raft_consensus.cc:1240] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:20.972823 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:20.967295 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:20.900511 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:20.919255   709 raft_consensus.cc:493] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:20.874478   906 raft_consensus.cc:515] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:20.904626 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:20.896359   840 raft_consensus.cc:515] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:20.999405 30024 raft_consensus.cc:2468] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 9.
I20260709 13:11:20.887720 30103 raft_consensus.cc:1240] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 5. Current term is 6. Ops: []
W20260709 13:11:20.999387 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 122337us
I20260709 13:11:20.971201   492 raft_consensus.cc:2804] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:20.967657   930 raft_consensus.cc:493] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:20.969661   715 leader_election.cc:290] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:20.928301   911 raft_consensus.cc:515] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:20.908766   673 consensus_queue.cc:260] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:21.011713 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 100680us
I20260709 13:11:21.069924 30099 raft_consensus.cc:2468] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 9.
W20260709 13:11:21.031488 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 127836us
I20260709 13:11:21.223132 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:21.166247 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:21.223735 30731 raft_consensus.cc:3060] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:21.136894 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 126390us
I20260709 13:11:21.223937 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:21.097066 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:21.270931 30094 raft_consensus.cc:2393] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 10: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:21.272199 30168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43840 (request call id 1883) took 1497 ms. Trace:
W20260709 13:11:21.223281 30069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.249642 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
W20260709 13:11:21.271413 30141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.272457 29993 leader_election.cc:304] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:21.225240 29994 leader_election.cc:304] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:21.222992 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:21.270027 30730 raft_consensus.cc:1275] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:11:21.273102 30168 rpcz_store.cc:276] 0709 13:11:19.774842 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.846153 (+ 71311us) service_pool.cc:224] Handling call
0709 13:11:21.272042 (+1425889us) spinlock_profiling.cc:243] Waited 443 ms on lock 0x7b540012f554. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:11:21.272150 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1017817856}
I20260709 13:11:21.247223 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:21.272374 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
W20260709 13:11:21.059379   907 log.cc:927] Time spent T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:11:21.276438 30094 raft_consensus.cc:2468] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 7.
I20260709 13:11:21.275390 30100 raft_consensus.cc:2393] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 8: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:21.274433 30099 raft_consensus.cc:3060] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:21.277727 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 52575us
I20260709 13:11:21.277935 29993 leader_election.cc:304] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:21.293430 30733 raft_consensus.cc:1275] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:21.271070 30023 raft_consensus.cc:1240] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:11:21.009140   877 raft_consensus.cc:493] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:21.279599 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:21.280146 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:21.280701 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:21.279202   492 raft_consensus.cc:493] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:21.281919 30066 leader_election.cc:304] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:21.012313 30729 raft_consensus.cc:2468] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 9.
I20260709 13:11:21.166332   910 raft_consensus.cc:493] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:21.283375   960 raft_consensus.cc:2749] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:21.284205   878 leader_election.cc:290] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:21.285386 30731 raft_consensus.cc:2468] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 9.
I20260709 13:11:21.010299   900 raft_consensus.cc:2804] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:21.285929   369 raft_consensus.cc:2804] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:21.286221 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
W20260709 13:11:21.381218 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 67010.7us
W20260709 13:11:21.326900 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 469974us
I20260709 13:11:21.242901   806 raft_consensus.cc:697] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 11 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:21.293248 29994 leader_election.cc:304] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:21.382786 30702 leader_election.cc:304] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:21.294549 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:21.049324   903 raft_consensus.cc:2804] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:11:21.290714   965 log.cc:927] Time spent T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:11:21.238309   783 consensus_queue.cc:1243] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer 5ec73dc157ed476ca903a7d596271719 log is divergent from this leader: its last log entry 5.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 13:11:21.398847 30702 leader_election.cc:304] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:21.399117 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:21.312628   942 leader_election.cc:290] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:21.400411   928 raft_consensus.cc:2749] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:21.404597   928 raft_consensus.cc:2749] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:21.404973   911 leader_election.cc:290] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:21.406239   906 leader_election.cc:290] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:21.304854   652 consensus_queue.cc:1059] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.102s
I20260709 13:11:21.407480   652 raft_consensus.cc:3055] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:21.407799   652 raft_consensus.cc:740] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:21.408578   652 consensus_queue.cc:260] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:21.378072   673 raft_consensus.cc:3060] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:21.309393   880 consensus_queue.cc:1048] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.104s
I20260709 13:11:21.227641   943 raft_consensus.cc:515] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:21.313545   899 leader_election.cc:290] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:21.415226 30103 raft_consensus.cc:2468] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 7.
I20260709 13:11:21.415551   809 leader_election.cc:290] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:11:21.310374   958 log.cc:927] Time spent T 00000000000000000000000000000000 P 1c91346f9a2a480e908d4e0323634aeb: Append to log took a long time: real 0.334s	user 0.000s	sys 0.001s
I20260709 13:11:21.416144   940 consensus_queue.cc:1048] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:11:21.416647 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:21.240000   709 raft_consensus.cc:515] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:21.417711 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:21.418406 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:21.419361 30098 raft_consensus.cc:2468] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 8.
I20260709 13:11:21.420289   709 leader_election.cc:290] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:21.420678 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:21.421420 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:21.379911   930 raft_consensus.cc:515] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:21.428220 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:21.311609 30728 raft_consensus.cc:2468] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 7.
W20260709 13:11:21.290350   961 log.cc:927] Time spent T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.280s	user 0.000s	sys 0.000s
I20260709 13:11:21.385012 30066 leader_election.cc:304] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:11:21.441255 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 56312.6us
I20260709 13:11:21.442022 30066 leader_election.cc:304] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
W20260709 13:11:21.391716 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 98518.2us
I20260709 13:11:21.445433 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:21.394767 30099 raft_consensus.cc:2468] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 9.
I20260709 13:11:21.314028   492 raft_consensus.cc:3060] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:21.380645   369 raft_consensus.cc:493] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:21.449508   369 raft_consensus.cc:3060] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:21.451604   840 leader_election.cc:290] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:11:21.304442   964 log.cc:927] Time spent T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.333s	user 0.000s	sys 0.001s
I20260709 13:11:21.303452   877 raft_consensus.cc:3060] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:11:21.271438   801 consensus_queue.cc:1059] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.114s
I20260709 13:11:21.452991   715 raft_consensus.cc:2749] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:21.302325   948 raft_consensus.cc:2764] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:11:21.017306   905 raft_consensus.cc:515] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:21.381844   910 raft_consensus.cc:3060] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:21.454962 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:21.409668   652 raft_consensus.cc:3060] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:21.475658 32579 leader_election.cc:290] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:21.477059 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:21.457193 30169 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54540 (request call id 712) took 1564 ms. Trace:
I20260709 13:11:21.458144 30097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33990 (request call id 2206) took 1383 ms. Trace:
I20260709 13:11:21.459851 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:21.461580 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:21.478014 30097 rpcz_store.cc:276] 0709 13:11:20.075081 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:20.075224 (+   143us) service_pool.cc:224] Handling call
0709 13:11:20.077578 (+  2354us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:20.080479 (+  2901us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:20.080504 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:20.080531 (+    27us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:20.080554 (+    23us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:21.457919 (+1377365us) spinlock_profiling.cc:243] Waited 2.73 ms on lock 0x7b540026acd4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:11:21.457968 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:21.458089 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6285696}
I20260709 13:11:21.462170 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:21.482298 30143 leader_election.cc:304] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:21.483515 30143 leader_election.cc:400] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821) with higher term. Message: Invalid argument: T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 7. Current term is 8.
I20260709 13:11:21.483798 30143 leader_election.cc:403] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:21.484406 30169 rpcz_store.cc:276] 0709 13:11:19.893010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:20.096732 (+203722us) service_pool.cc:224] Handling call
0709 13:11:21.456985 (+1360253us) spinlock_profiling.cc:243] Waited 604 ms on lock 0x7b5400407ed4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:11:21.457121 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1389166336}
I20260709 13:11:21.396519   898 raft_consensus.cc:2804] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:21.502925 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:21.467459 30023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54206 (request call id 1719) took 1246 ms. Trace:
I20260709 13:11:21.503933 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:21.467407   927 leader_election.cc:290] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:21.467880   771 raft_consensus.cc:493] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.468585 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:21.503875 30023 rpcz_store.cc:276] 0709 13:11:20.220681 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:20.322132 (+101451us) service_pool.cc:224] Handling call
0709 13:11:20.322452 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:21.294064 (+971612us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:21.467227 (+173163us) spinlock_profiling.cc:243] Waited 926 ms on lock 0x7b5400002154. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:11:21.467404 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2130319104}
I20260709 13:11:21.514130 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:21.469485 30703 leader_election.cc:304] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: c99569d27a6f4c648eae7119fe3db124
W20260709 13:11:21.515658 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 46249.4us
I20260709 13:11:21.398090   959 consensus_queue.cc:1048] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.168s
I20260709 13:11:21.470111 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:21.458189   911 raft_consensus.cc:2749] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:21.473425 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:21.528347 30731 raft_consensus.cc:1275] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:21.474687 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:21.474881 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:21.416219   943 leader_election.cc:290] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:21.477792 30730 raft_consensus.cc:2393] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 9: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:11:21.462085 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:21.499522 30068 leader_election.cc:304] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:21.530901 30068 leader_election.cc:304] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:21.398515   903 raft_consensus.cc:493] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:21.398437   714 raft_consensus.cc:2804] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:21.500741 30143 leader_election.cc:304] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:21.537838 30143 leader_election.cc:304] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:21.538558 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:21.538729 30143 leader_election.cc:304] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:21.539179 30733 raft_consensus.cc:2468] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 8.
I20260709 13:11:21.539880 30143 leader_election.cc:304] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:21.383503   900 raft_consensus.cc:493] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:21.516330 30703 leader_election.cc:304] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:11:21.543242 30703 leader_election.cc:304] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:21.514873 30095 raft_consensus.cc:2468] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 10.
I20260709 13:11:21.545336 30095 raft_consensus.cc:1240] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:21.470685 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:21.446497   942 consensus_queue.cc:1059] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.073s
I20260709 13:11:21.546923 30095 raft_consensus.cc:1240] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 8. Current term is 9. Ops: [6.4-8.5]
I20260709 13:11:21.547618 29994 leader_election.cc:304] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
W20260709 13:11:21.606570 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 75740.9us
I20260709 13:11:21.605892   967 raft_consensus.cc:493] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.525714   928 raft_consensus.cc:2804] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:21.605505   948 raft_consensus.cc:2804] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:21.605611   922 consensus_queue.cc:1059] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 13:11:21.608505   948 raft_consensus.cc:493] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:21.607098   943 raft_consensus.cc:2749] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:21.548871   779 raft_consensus.cc:493] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:21.608798   922 raft_consensus.cc:3055] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:21.610018   922 raft_consensus.cc:740] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:21.607872   967 raft_consensus.cc:515] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:21.552831 30095 raft_consensus.cc:1275] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:11:21.503082   962 raft_consensus.cc:2749] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821) with higher term. Message: Invalid argument: T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 7. Current term is 8.
I20260709 13:11:21.501238   823 raft_consensus.cc:2749] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:21.612054 30068 leader_election.cc:304] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:21.463407   960 consensus_queue.cc:1059] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.086s
I20260709 13:11:21.609308   492 raft_consensus.cc:515] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:21.614840 30728 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56954 (request call id 643) took 1704 ms (client timeout 2265 ms). Trace:
I20260709 13:11:21.518299   898 raft_consensus.cc:697] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 5 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:21.618746 30143 leader_election.cc:304] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:21.552026 30731 raft_consensus.cc:1275] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:21.608990   928 raft_consensus.cc:493] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:21.629771 30068 leader_election.cc:304] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:11:21.608863   948 raft_consensus.cc:3060] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:21.551985   840 raft_consensus.cc:2764] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:11:21.571671 30703 leader_election.cc:304] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: c99569d27a6f4c648eae7119fe3db124
W20260709 13:11:21.639763 30728 rpcz_store.cc:269] 0709 13:11:19.910368 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:19.911017 (+   649us) service_pool.cc:224] Handling call
0709 13:11:21.614666 (+1703649us) spinlock_profiling.cc:243] Waited 966 ms on lock 0x7b54005203d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:11:21.614784 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2221784320}
I20260709 13:11:21.537017   806 consensus_queue.cc:237] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:21.649652 30095 pending_rounds.cc:85] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719: Aborting all ops after (but not including) 2
I20260709 13:11:21.552946   880 raft_consensus.cc:2749] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:21.536839   853 raft_consensus.cc:2749] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:21.551134   903 raft_consensus.cc:3060] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:21.549340   622 raft_consensus.cc:2749] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:21.537076   771 raft_consensus.cc:515] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:21.552660   809 raft_consensus.cc:2804] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:21.548301   900 raft_consensus.cc:3060] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:21.552182   927 raft_consensus.cc:2749] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:21.666435   898 consensus_queue.cc:237] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:21.671656   930 leader_election.cc:290] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:21.640642   715 consensus_queue.cc:1048] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
W20260709 13:11:21.677597 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 106024us
I20260709 13:11:21.727541 30703 leader_election.cc:304] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:21.679848 30095 pending_rounds.cc:107] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260709 13:11:21.728554 30095 raft_consensus.cc:2889] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:21.620922   892 raft_consensus.cc:2749] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:21.621328   714 raft_consensus.cc:697] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:21.641151   943 raft_consensus.cc:2749] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:21.682466   909 raft_consensus.cc:2804] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:21.758008   909 raft_consensus.cc:493] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:21.758466   909 raft_consensus.cc:3060] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:21.761308 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:21.609439   779 raft_consensus.cc:515] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:21.679057 30068 leader_election.cc:304] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
W20260709 13:11:21.762161 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 83188.8us
I20260709 13:11:21.762595 30103 raft_consensus.cc:1240] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:21.673363   928 raft_consensus.cc:3060] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:21.763224   779 leader_election.cc:290] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:21.654819   905 leader_election.cc:290] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:21.767890 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:21.768554 30023 raft_consensus.cc:2468] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 10.
I20260709 13:11:21.677667   899 raft_consensus.cc:2804] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:21.605660   940 consensus_queue.cc:1059] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.089s
I20260709 13:11:21.721788 30096 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33990 (request call id 2212) took 1511 ms. Trace:
W20260709 13:11:21.745375 30170 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.044s	sys 0.102s
W20260709 13:11:21.783108 30170 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.044s	sys 0.102s
I20260709 13:11:21.746313 30703 leader_election.cc:304] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:21.714994   809 raft_consensus.cc:493] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:21.654857   962 consensus_queue.cc:1059] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 13:11:21.684321   865 consensus_queue.cc:1048] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260709 13:11:21.779067 30019 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54206 (request call id 1721) took 1557 ms. Trace:
I20260709 13:11:21.779765 30102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33990 (request call id 2211) took 1680 ms. Trace:
I20260709 13:11:21.781347 30020 raft_consensus.cc:1275] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 13:11:21.782617 30021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54198 (request call id 2009) took 1400 ms. Trace:
I20260709 13:11:21.782495 30096 rpcz_store.cc:276] 0709 13:11:20.210849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:20.211153 (+   304us) service_pool.cc:224] Handling call
0709 13:11:20.223890 (+ 12737us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:21.222287 (+998397us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:21.721521 (+499234us) spinlock_profiling.cc:243] Waited 726 ms on lock 0x7b5400101dd4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:11:21.721703 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1669718400}
W20260709 13:11:21.790108 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 489757us
I20260709 13:11:21.745613   927 raft_consensus.cc:2749] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:21.813109 30019 rpcz_store.cc:276] 0709 13:11:20.221132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:20.315845 (+ 94713us) service_pool.cc:224] Handling call
0709 13:11:21.778916 (+1463071us) spinlock_profiling.cc:243] Waited 224 ms on lock 0x7b540020fb54. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:11:21.779010 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":514091392}
I20260709 13:11:21.765726   840 raft_consensus.cc:493] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:21.815286 30021 rpcz_store.cc:276] 0709 13:11:20.381887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:20.459370 (+ 77483us) service_pool.cc:224] Handling call
0709 13:11:21.782464 (+1323094us) spinlock_profiling.cc:243] Waited 5.66 ms on lock 0x7b54001a8bd4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:11:21.782566 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13023488}
I20260709 13:11:21.820263   936 consensus_queue.cc:1059] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:21.826051   714 consensus_queue.cc:237] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:21.827318   940 consensus_queue.cc:1059] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:21.808732   809 raft_consensus.cc:3060] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:21.829465   905 consensus_queue.cc:1059] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:21.789207   698 raft_consensus.cc:2749] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:21.835059   906 raft_consensus.cc:3055] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:21.836373   771 leader_election.cc:290] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:21.838192   910 raft_consensus.cc:515] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:21.673911   922 consensus_queue.cc:260] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:21.813884 30102 rpcz_store.cc:276] 0709 13:11:20.099733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:20.101169 (+  1436us) service_pool.cc:224] Handling call
0709 13:11:20.101407 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:20.822902 (+721495us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:21.779536 (+956634us) spinlock_profiling.cc:243] Waited 721 ms on lock 0x7b54003b4a54. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:11:21.779702 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1658130176}
I20260709 13:11:21.842371 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:21.790555   787 raft_consensus.cc:2804] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:21.782305   899 raft_consensus.cc:493] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:21.850215 30142 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.001s	sys 0.045s
I20260709 13:11:21.850451   934 raft_consensus.cc:2749] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:11:21.878042 30142 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.001s	sys 0.046s
I20260709 13:11:21.868773 30176 raft_consensus.cc:2410] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260709 13:11:21.878508 30142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 571946us
I20260709 13:11:21.870234   713 raft_consensus.cc:3055] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:21.851078   840 raft_consensus.cc:515] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:21.850145   492 leader_election.cc:290] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451)
I20260709 13:11:21.881043   899 raft_consensus.cc:3060] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:21.883551 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:21.851745   906 raft_consensus.cc:740] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:21.886293 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:21.889359 30096 raft_consensus.cc:2468] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 9.
I20260709 13:11:21.892601 29994 leader_election.cc:304] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:21.893903 30096 raft_consensus.cc:1240] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:21.908593 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:21.911886 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:21.912811 30168 raft_consensus.cc:2393] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 9: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:11:21.922919 30142 leader_election.cc:304] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:21.945308 30169 raft_consensus.cc:1275] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 8. (term mismatch)
I20260709 13:11:21.945714 30169 pending_rounds.cc:85] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124: Aborting all ops after (but not including) 7
I20260709 13:11:21.945958 30169 pending_rounds.cc:107] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 13:11:21.946174 30169 raft_consensus.cc:2889] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:21.946731 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:21.881552   713 raft_consensus.cc:740] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:21.906513   922 raft_consensus.cc:3060] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:21.954224 30140 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.024s	sys 0.023s
W20260709 13:11:21.954661 30140 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.024s	sys 0.023s
I20260709 13:11:21.950124   783 consensus_queue.cc:1059] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:21.885576   787 raft_consensus.cc:697] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 7 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:21.957695 30702 leader_election.cc:304] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:21.950806   823 consensus_queue.cc:1048] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:21.920471   892 raft_consensus.cc:493] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:21.959883 30098 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.010s	sys 0.036s
I20260709 13:11:21.939890   936 raft_consensus.cc:2804] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:11:21.965245 30098 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.010s	sys 0.036s
W20260709 13:11:21.965889 30100 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.011s	sys 0.015s
W20260709 13:11:21.966856 30100 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.011s	sys 0.015s
W20260709 13:11:21.954968 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 680374us
I20260709 13:11:21.970377 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:21.944769   492 raft_consensus.cc:2804] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:21.939947   930 consensus_queue.cc:1059] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:11:21.975183 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:21.976317 30027 raft_consensus.cc:1275] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:11:21.976756 30023 raft_consensus.cc:1275] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260709 13:11:21.981732 30702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:21.983777 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:21.985033 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:21.985168 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:21.985692 30022 raft_consensus.cc:2468] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 10.
I20260709 13:11:21.984450 30066 leader_election.cc:304] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:21.987692 30019 raft_consensus.cc:2368] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 7. Current term is 8.
I20260709 13:11:21.990264 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:21.990824 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:21.991791 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:21.992731 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:21.994917 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:21.996695 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:21.960691   934 raft_consensus.cc:2749] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:22.005260 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:22.019556 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:22.020164 30168 raft_consensus.cc:3060] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:22.018522 30066 leader_election.cc:304] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:21.970880   936 raft_consensus.cc:493] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:22.023103 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:22.028119 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:22.030049 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:22.034911 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:22.035485 30173 raft_consensus.cc:2468] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 4.
I20260709 13:11:21.991560   943 raft_consensus.cc:2804] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:22.005301   713 consensus_queue.cc:260] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:21.960759   948 raft_consensus.cc:515] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:22.047140   977 raft_consensus.cc:3055] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:22.027302   865 raft_consensus.cc:2749] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:22.047119 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:22.093724 30173 raft_consensus.cc:2468] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 6.
I20260709 13:11:22.050329   903 raft_consensus.cc:515] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:22.035228   853 consensus_queue.cc:1048] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 13:11:21.994578   492 raft_consensus.cc:697] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 9 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:22.061136 32579 raft_consensus.cc:3055] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:22.063283   880 raft_consensus.cc:3055] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:22.005652   783 raft_consensus.cc:493] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.068465   899 raft_consensus.cc:515] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:22.073990   967 leader_election.cc:290] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:22.080802 30168 raft_consensus.cc:2468] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 11.
I20260709 13:11:22.090204 30176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54540 (request call id 732) took 1214 ms. Trace:
W20260709 13:11:22.099562 30097 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.009s	sys 0.009s
W20260709 13:11:22.106357 30141 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.784s	user 0.007s	sys 0.048s
I20260709 13:11:22.032200   936 raft_consensus.cc:3060] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:21.972855   892 raft_consensus.cc:515] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:22.107934 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:22.111691 30025 raft_consensus.cc:2468] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 11.
W20260709 13:11:22.074422   958 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.005s	sys 0.039s
I20260709 13:11:22.123737 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:22.074826   779 raft_consensus.cc:3055] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:21.965662   906 consensus_queue.cc:260] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:22.045986   943 raft_consensus.cc:493] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:22.089419   977 raft_consensus.cc:740] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
W20260709 13:11:22.192145 30143 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.551s	user 0.021s	sys 0.020s
I20260709 13:11:22.105551   352 raft_consensus.cc:493] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.182000 30103 raft_consensus.cc:1240] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
W20260709 13:11:22.181494 30097 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.701s	user 0.012s	sys 0.012s
I20260709 13:11:22.182423 30176 rpcz_store.cc:276] 0709 13:11:20.875274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:20.877872 (+  2598us) service_pool.cc:224] Handling call
0709 13:11:22.090006 (+1212134us) spinlock_profiling.cc:243] Waited 961 ms on lock 0x7b540028a0d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:11:22.090140 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2209855232}
I20260709 13:11:22.105650   801 raft_consensus.cc:3055] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:22.183122 30175 raft_consensus.cc:2393] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 8: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:11:22.130842 30102 raft_consensus.cc:1240] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 5. Current term is 6. Ops: []
W20260709 13:11:22.204813 30143 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.022s	sys 0.020s
I20260709 13:11:22.189872 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
W20260709 13:11:22.181119 30141 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.859s	user 0.007s	sys 0.053s
W20260709 13:11:22.231060 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 612369us
I20260709 13:11:22.232072 30143 leader_election.cc:304] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:22.202251 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
W20260709 13:11:22.179776   958 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.005s	sys 0.039s
I20260709 13:11:22.231559 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:22.232963 30173 raft_consensus.cc:3060] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:22.207628 30171 raft_consensus.cc:1240] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:22.119908 32579 raft_consensus.cc:740] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:22.238570 30171 raft_consensus.cc:1275] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 13:11:22.179500   942 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.003s	sys 0.020s
I20260709 13:11:22.188077   779 raft_consensus.cc:740] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:22.124797   880 raft_consensus.cc:740] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:22.263234 30171 raft_consensus.cc:1275] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 13:11:22.102063   909 raft_consensus.cc:515] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:22.191150   943 raft_consensus.cc:3060] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:22.280153 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
W20260709 13:11:22.201570   925 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.009s	sys 0.025s
I20260709 13:11:22.267745 30702 leader_election.cc:304] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
W20260709 13:11:22.263514   942 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.003s	sys 0.020s
I20260709 13:11:22.243708 30143 leader_election.cc:304] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:22.182997   927 consensus_queue.cc:1048] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 13:11:22.292732 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:22.127416   783 raft_consensus.cc:515] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:22.187891   940 raft_consensus.cc:3055] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:22.270200 30731 raft_consensus.cc:1275] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:11:22.231500   910 leader_election.cc:290] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:22.282123 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:22.312289 30175 raft_consensus.cc:2410] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 13:11:22.234366   352 raft_consensus.cc:515] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:22.106434   787 consensus_queue.cc:237] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:22.242919   878 raft_consensus.cc:2749] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 13:11:22.291687 30703 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.008s	sys 0.020s
W20260709 13:11:22.320461 30703 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.008s	sys 0.020s
W20260709 13:11:22.320984 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 574719us
I20260709 13:11:22.321652 30703 leader_election.cc:304] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:22.295501   389 raft_consensus.cc:2804] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:11:22.291941 30095 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.003s	sys 0.025s
W20260709 13:11:22.325693 30095 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.003s	sys 0.025s
I20260709 13:11:22.243402   840 leader_election.cc:290] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:11:22.305437 30700 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.005s	sys 0.024s
I20260709 13:11:22.277231   906 raft_consensus.cc:3060] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:22.188869   900 raft_consensus.cc:515] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:22.282294   925 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.009s	sys 0.027s
I20260709 13:11:22.308670 30734 raft_consensus.cc:1240] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:22.308929 30173 raft_consensus.cc:2468] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 7.
W20260709 13:11:22.328877   928 consensus_meta.cc:287] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent flushing consensus metadata: real 0.566s	user 0.008s	sys 0.000s
I20260709 13:11:22.338348 30140 leader_election.cc:304] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
W20260709 13:11:22.281348 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 460370us
I20260709 13:11:22.236604   801 raft_consensus.cc:740] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:22.294567   940 raft_consensus.cc:740] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:22.305591   934 raft_consensus.cc:2749] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:22.339274   928 raft_consensus.cc:515] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:22.340574 30736 raft_consensus.cc:1240] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:22.340113   801 consensus_queue.cc:260] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:22.322645 30703 leader_election.cc:304] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
W20260709 13:11:22.328532 30700 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.005s	sys 0.024s
I20260709 13:11:22.327749   389 raft_consensus.cc:493] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:22.361240 30098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33990 (request call id 2229) took 1448 ms. Trace:
I20260709 13:11:22.361665 30098 rpcz_store.cc:276] 0709 13:11:20.912816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.421515 (+508699us) service_pool.cc:224] Handling call
0709 13:11:21.421810 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:21.422095 (+   285us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:21.422121 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:21.422540 (+   419us) log.cc:844] Serialized 26 byte log entry
0709 13:11:21.965669 (+543129us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:21.965707 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:21.965803 (+    96us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:22.361026 (+395223us) raft_consensus.cc:1685] finished
0709 13:11:22.361046 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:22.361182 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11013,"raft.queue_time_us":2932,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":14257,"thread_start_us":542766,"threads_started":1,"wal-append.queue_time_us":911160}
I20260709 13:11:22.331437 30100 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33990 (request call id 2228) took 1426 ms. Trace:
W20260709 13:11:22.363557 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 386735us
I20260709 13:11:22.365340 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:22.365885 30731 raft_consensus.cc:3060] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Advancing to term 5
W20260709 13:11:22.337301   978 log.cc:927] Time spent T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.301s	user 0.000s	sys 0.001s
I20260709 13:11:22.344897 30703 leader_election.cc:304] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:22.345158   880 consensus_queue.cc:260] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:22.369864   698 consensus_queue.cc:1048] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260709 13:11:22.341459   928 leader_election.cc:290] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:22.344609   948 leader_election.cc:290] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 11 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:11:22.378157   990 log.cc:927] Time spent T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 13:11:22.378259   899 leader_election.cc:290] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:22.378619   352 leader_election.cc:290] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:11:22.379274   369 consensus_meta.cc:287] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4: Time spent flushing consensus metadata: real 0.929s	user 0.007s	sys 0.003s
I20260709 13:11:22.379809   900 leader_election.cc:290] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:22.379635   369 raft_consensus.cc:515] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:22.380487 30097 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33990 (request call id 2232) took 1106 ms. Trace:
I20260709 13:11:22.380831 30097 rpcz_store.cc:276] 0709 13:11:21.273637 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.479161 (+205524us) service_pool.cc:224] Handling call
0709 13:11:21.479410 (+   249us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:21.479730 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:21.479757 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:21.480183 (+   426us) log.cc:844] Serialized 26 byte log entry
0709 13:11:22.230286 (+750103us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:22.230323 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:22.230381 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:22.380299 (+149918us) raft_consensus.cc:1685] finished
0709 13:11:22.380317 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:22.380434 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1611,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":13447,"thread_start_us":749743,"threads_started":1,"wal-append.queue_time_us":788664}
I20260709 13:11:22.382444   909 leader_election.cc:290] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:11:22.382946   809 consensus_meta.cc:287] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124: Time spent flushing consensus metadata: real 0.527s	user 0.007s	sys 0.000s
I20260709 13:11:22.336927   980 consensus_queue.cc:1048] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 13:11:22.383790   892 leader_election.cc:290] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:22.323751 32579 consensus_queue.cc:260] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:22.320371   779 consensus_queue.cc:260] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:22.384801   979 raft_consensus.cc:493] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:22.385076   779 raft_consensus.cc:3060] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:22.385283   991 raft_consensus.cc:493] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:22.385845   991 raft_consensus.cc:515] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:22.387862   991 leader_election.cc:290] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:22.370688   982 raft_consensus.cc:493] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:22.389164   982 raft_consensus.cc:515] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:22.305354   977 consensus_queue.cc:260] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:22.391165   982 leader_election.cc:290] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:22.367377   389 raft_consensus.cc:3060] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:22.374715   903 leader_election.cc:290] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:22.394469   947 raft_consensus.cc:493] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:22.394980   947 raft_consensus.cc:515] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:22.333928   840 raft_consensus.cc:2749] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:22.396812   947 leader_election.cc:290] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:22.346792   801 raft_consensus.cc:3060] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:22.347824 30700 leader_election.cc:304] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:22.397539   809 raft_consensus.cc:515] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:22.399519   809 leader_election.cc:290] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:22.400779 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:22.401367 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:22.403079 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:22.349555   806 raft_consensus.cc:2804] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 13:11:22.350625   981 log.cc:927] Time spent T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260709 13:11:22.408495 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 63671.1us
W20260709 13:11:22.358243   987 log.cc:927] Time spent T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:11:22.278482   492 consensus_queue.cc:237] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:22.363220 30100 rpcz_store.cc:276] 0709 13:11:20.905359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.306560 (+401201us) service_pool.cc:224] Handling call
0709 13:11:21.306799 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:21.306971 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:11:21.968758 (+661787us) log.cc:844] Serialized 14 byte log entry
0709 13:11:22.330248 (+361490us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:22.330327 (+    79us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:22.330990 (+   663us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:22.331126 (+   136us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:22.331326 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":985016,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":33,"raft.queue_time_us":82,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":2959,"thread_start_us":933564,"threads_started":2}
I20260709 13:11:22.310316 30099 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:48558 (request call id 605) took 1072 ms. Trace:
W20260709 13:11:22.412381 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 93538.8us
I20260709 13:11:22.412027 30731 raft_consensus.cc:2468] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 5.
I20260709 13:11:22.382898   783 leader_election.cc:290] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:22.346873   996 raft_consensus.cc:2804] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:22.343544   878 consensus_queue.cc:1059] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 13:11:22.349123 30140 leader_election.cc:400] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Vote denied by peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451) with higher term. Message: Invalid argument: T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 7. Current term is 8.
W20260709 13:11:22.417683 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 68701us
I20260709 13:11:22.418371 30140 leader_election.cc:304] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:22.402464 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
W20260709 13:11:22.402820 30172 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54540 (request call id 730) took 1528 ms (client timeout 2004 ms). Trace:
I20260709 13:11:22.419076 30729 raft_consensus.cc:2468] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 10.
I20260709 13:11:22.405263 30732 raft_consensus.cc:2468] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 10.
W20260709 13:11:22.419466 30172 rpcz_store.cc:269] 0709 13:11:20.874728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:20.876881 (+  2153us) service_pool.cc:224] Handling call
0709 13:11:22.402616 (+1525735us) spinlock_profiling.cc:243] Waited 1.44 s on lock 0x7b540037c3d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:11:22.402736 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3317280000}
W20260709 13:11:22.424062 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 76300.6us
I20260709 13:11:22.406638   806 raft_consensus.cc:493] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:22.426008   806 raft_consensus.cc:3060] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:22.427858   998 consensus_queue.cc:1048] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:22.430717   640 raft_consensus.cc:493] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:22.431213   640 raft_consensus.cc:515] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:22.432490 30094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33992 (request call id 1813) took 1533 ms. Trace:
I20260709 13:11:22.432834 30094 rpcz_store.cc:276] 0709 13:11:20.899139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.302796 (+403657us) service_pool.cc:224] Handling call
0709 13:11:21.303055 (+   259us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:21.316561 (+ 13506us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:21.316603 (+    42us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:21.381201 (+ 64598us) log.cc:844] Serialized 26 byte log entry
0709 13:11:21.878131 (+496930us) raft_consensus.cc:1645] Marking committed up to 3
0709 13:11:21.878168 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:21.878229 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:22.432304 (+554075us) raft_consensus.cc:1685] finished
0709 13:11:22.432324 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:22.432438 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4233,"raft.queue_time_us":4324,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":13416,"thread_start_us":496642,"threads_started":1,"wal-append.queue_time_us":810108}
I20260709 13:11:22.434892   878 consensus_queue.cc:1048] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:11:22.330740 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 294207us
W20260709 13:11:22.406019 30142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.438649 30066 leader_election.cc:304] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:22.419097 30068 leader_election.cc:304] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:11:22.442096 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:22.442431 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:22.441672 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:22.444643 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:22.446025 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:22.446661 30731 raft_consensus.cc:3060] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:22.445963 30702 leader_election.cc:304] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:22.407059 29993 leader_election.cc:304] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:22.381528   369 leader_election.cc:290] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:22.353214   622 raft_consensus.cc:3055] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:22.447933   622 raft_consensus.cc:740] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:22.408548   979 raft_consensus.cc:515] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:22.448100   899 raft_consensus.cc:2804] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:22.409168 30703 leader_election.cc:304] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:22.421322   900 raft_consensus.cc:493] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:22.448830   865 raft_consensus.cc:2804] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:22.449141   947 raft_consensus.cc:493] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:22.420917   996 raft_consensus.cc:493] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:22.412717 30099 rpcz_store.cc:276] 0709 13:11:21.237564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.446449 (+208885us) service_pool.cc:224] Handling call
0709 13:11:21.446792 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:21.446964 (+   172us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:11:21.998227 (+551263us) log.cc:844] Serialized 14 byte log entry
0709 13:11:22.309998 (+311771us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:22.310049 (+    51us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:22.310095 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:22.310154 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:22.310264 (+   110us) inbound_call.cc:177] Queueing success response
0709 13:11:22.396411 (+ 86147us) spinlock_profiling.cc:243] Waited 2.06 ms on lock 0x7b18004469e0. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f7e95de1 00007f99f7ea25b1 00007f99eefcd522 00007f99eefcf7c1 00007f99eefcf779 00007f99eefcf709 00007f99eefcf6d1 00007f99eefce9cd 000000000038f354 000000000038f199 00007f99eefb083a
Metrics: {"prepare.queue_time_us":860080,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":31,"raft.queue_time_us":350,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":3237,"spinlock_wait_cycles":4740992,"thread_start_us":796335,"threads_started":2}
I20260709 13:11:22.420194   934 raft_consensus.cc:3060] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:22.448856   900 raft_consensus.cc:515] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:22.466780 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:22.461546 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:22.480717   865 raft_consensus.cc:697] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 5 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:22.481748   865 consensus_queue.cc:237] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:22.450192   996 raft_consensus.cc:3060] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:22.450383   823 raft_consensus.cc:493] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:22.486640   823 raft_consensus.cc:515] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:22.443122   982 raft_consensus.cc:3055] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:22.448791   878 consensus_queue.cc:1059] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 13:11:22.437288   698 consensus_queue.cc:1059] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.102s
I20260709 13:11:22.489322   840 raft_consensus.cc:2749] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:22.522852   878 raft_consensus.cc:3055] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:22.489140   947 raft_consensus.cc:515] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:22.523247   878 raft_consensus.cc:740] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:22.524278   878 consensus_queue.cc:260] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:22.526728   940 consensus_queue.cc:260] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:22.527863   940 raft_consensus.cc:3060] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:22.529333 29992 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.503036   998 raft_consensus.cc:493] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
W20260709 13:11:22.530182 29992 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:22.536383 29994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:22.552016 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 133712us
W20260709 13:11:22.552527 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 106650us
I20260709 13:11:22.553052 30140 leader_election.cc:304] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:22.553963 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
W20260709 13:11:22.554842 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 147905us
W20260709 13:11:22.552343 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 143247us
I20260709 13:11:22.448546   899 raft_consensus.cc:493] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:22.557976 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:22.558527 30025 raft_consensus.cc:3060] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:22.560648 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:22.560994 30023 raft_consensus.cc:1275] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:22.555650 29993 leader_election.cc:304] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:22.565366 30025 raft_consensus.cc:2468] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 5.
I20260709 13:11:22.571357 30731 raft_consensus.cc:2468] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 9.
I20260709 13:11:22.573336 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:22.573925 29993 leader_election.cc:304] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:22.574028 30140 leader_election.cc:304] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:22.575176 30140 leader_election.cc:304] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:22.576031 30143 leader_election.cc:304] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:22.577816 30023 raft_consensus.cc:1240] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:22.578424   883 raft_consensus.cc:2749] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:22.469707   980 raft_consensus.cc:2749] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:22.582530 30172 raft_consensus.cc:1240] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:22.583076   883 raft_consensus.cc:2749] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:22.596692 30176 raft_consensus.cc:1240] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 9. Current term is 10. Ops: [9.5-9.5]
I20260709 13:11:22.596271 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:22.598664 30101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33992 (request call id 1818) took 1216 ms. Trace:
I20260709 13:11:22.599050 30101 rpcz_store.cc:276] 0709 13:11:21.381839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.427984 (+ 46145us) service_pool.cc:224] Handling call
0709 13:11:22.598483 (+1170499us) spinlock_profiling.cc:243] Waited 981 ms on lock 0x7b5400265554. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:11:22.598605 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2257411456}
I20260709 13:11:22.583495   947 leader_election.cc:290] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:22.580958   878 raft_consensus.cc:3060] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:22.572974  1005 raft_consensus.cc:2764] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:11:22.585574  1004 consensus_queue.cc:1048] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:22.587117   979 leader_election.cc:290] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:22.530179   998 raft_consensus.cc:515] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:22.588392 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:22.469537   942 raft_consensus.cc:493] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.589054 30094 raft_consensus.cc:2393] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 7: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:22.589443 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:22.421161   880 raft_consensus.cc:3060] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:22.591236 30171 raft_consensus.cc:1240] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:22.588707 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:22.503141   925 raft_consensus.cc:493] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.489682   369 raft_consensus.cc:2804] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:11:22.604780 29991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.604653 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:22.605242 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:22.650692 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:22.503091   982 raft_consensus.cc:740] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:22.607076 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:11:22.610559 29993 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.611430 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 10 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:22.612583 30024 raft_consensus.cc:2393] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 7: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:11:22.615975 30068 leader_election.cc:304] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:22.616465 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:22.656347 30026 raft_consensus.cc:1240] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 6. Current term is 7. Ops: []
W20260709 13:11:22.661845 29993 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:22.662806 29993 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.572504   899 raft_consensus.cc:3060] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:22.588533   967 raft_consensus.cc:2749] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:22.581471   892 raft_consensus.cc:2749] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:22.588805   698 raft_consensus.cc:2749] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:22.633919 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:22.692036 30066 leader_election.cc:304] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:22.640152 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:22.650765 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:22.614579 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:22.666448 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:22.666919 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:22.667366 30174 raft_consensus.cc:1240] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:22.667337 30171 raft_consensus.cc:1240] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:22.696290 30098 raft_consensus.cc:2393] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 7: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:22.696466 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:22.684543   369 raft_consensus.cc:697] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:22.697515 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:22.622370   823 leader_election.cc:290] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:22.635558 29992 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.698451   640 leader_election.cc:290] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:22.650089   622 consensus_queue.cc:260] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:22.700412 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:22.701359 30169 raft_consensus.cc:2468] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 8.
I20260709 13:11:22.621829   714 consensus_queue.cc:1059] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.063s
I20260709 13:11:22.695390 30100 raft_consensus.cc:3060] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:22.702816   995 raft_consensus.cc:493] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
W20260709 13:11:22.693782   981 log.cc:927] Time spent T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 13:11:22.657531   979 raft_consensus.cc:493] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:22.705888 30175 raft_consensus.cc:2468] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 7.
I20260709 13:11:22.703154   948 raft_consensus.cc:3055] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:22.685352   977 raft_consensus.cc:3060] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:22.704087   979 raft_consensus.cc:515] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:22.717718 30100 raft_consensus.cc:2468] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 11.
W20260709 13:11:22.712347 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 133798us
I20260709 13:11:22.713979 30068 leader_election.cc:304] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:22.685022   853 raft_consensus.cc:2804] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:11:22.694674   936 consensus_meta.cc:287] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4: Time spent flushing consensus metadata: real 0.502s	user 0.013s	sys 0.002s
I20260709 13:11:22.721196 30736 raft_consensus.cc:1275] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:11:22.722738 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:22.722965 30143 leader_election.cc:304] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:22.725150 30068 leader_election.cc:304] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:22.732367 30169 raft_consensus.cc:2468] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 10.
I20260709 13:11:22.705935   903 raft_consensus.cc:2749] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:22.651314   942 raft_consensus.cc:515] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:22.709043   948 raft_consensus.cc:740] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:22.738452 30068 leader_election.cc:304] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:22.739367 30143 leader_election.cc:304] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:22.708498   922 raft_consensus.cc:493] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:22.654045   925 raft_consensus.cc:515] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:22.713280   910 raft_consensus.cc:2749] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:22.714722   900 leader_election.cc:290] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:22.751582 30142 leader_election.cc:304] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:22.753983 30169 raft_consensus.cc:1275] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:22.755897 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:22.755882 30174 raft_consensus.cc:1240] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:22.760423 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:22.760993 30169 raft_consensus.cc:3060] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:22.774679 30142 leader_election.cc:304] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:22.733728  1004 raft_consensus.cc:2749] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:22.737128   823 raft_consensus.cc:2749] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:22.737329   853 raft_consensus.cc:697] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 9 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:22.740083   787 raft_consensus.cc:2749] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:11:22.750169   877 consensus_meta.cc:287] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124: Time spent flushing consensus metadata: real 1.249s	user 0.007s	sys 0.012s
I20260709 13:11:22.750705   898 raft_consensus.cc:2749] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:22.703329   995 raft_consensus.cc:515] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:22.773424   698 raft_consensus.cc:3060] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:22.738910   936 raft_consensus.cc:515] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:22.797237   713 raft_consensus.cc:3060] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:22.759631   709 consensus_queue.cc:1059] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:11:22.761875   922 raft_consensus.cc:515] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:22.738070   982 consensus_queue.cc:260] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:22.791675   492 consensus_queue.cc:1059] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:11:22.800158  1021 raft_consensus.cc:2804] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:22.816670   942 leader_election.cc:290] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:22.814284  1020 consensus_queue.cc:1175] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "5ec73dc157ed476ca903a7d596271719" responder_term: 5 status { last_received { term: 5 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 5 index: 4 } }
W20260709 13:11:22.818126  1008 log.cc:927] Time spent T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:11:22.801388   877 raft_consensus.cc:515] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:22.820017   877 leader_election.cc:290] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:22.824167   925 leader_election.cc:290] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:22.826385   998 leader_election.cc:290] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:22.827374   979 leader_election.cc:290] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:22.828461   996 raft_consensus.cc:515] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:22.829186   995 leader_election.cc:290] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:22.815267   853 consensus_queue.cc:237] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:22.832285  1012 log.cc:927] Time spent T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.107s	user 0.000s	sys 0.001s
W20260709 13:11:22.817469  1006 log.cc:927] Time spent T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 13:11:22.834131   936 leader_election.cc:290] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:22.804904   948 consensus_queue.cc:260] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:22.835021   922 leader_election.cc:290] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:22.839414   996 leader_election.cc:290] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:22.843003   943 consensus_meta.cc:287] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719: Time spent flushing consensus metadata: real 0.536s	user 0.008s	sys 0.000s
I20260709 13:11:22.843385   943 raft_consensus.cc:515] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:22.844746   943 leader_election.cc:290] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:22.813913  1021 raft_consensus.cc:493] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:22.845451  1021 raft_consensus.cc:3060] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:22.846827   948 raft_consensus.cc:3060] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:22.848019   934 raft_consensus.cc:2749] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:22.850950  1021 raft_consensus.cc:515] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:22.852458  1021 leader_election.cc:290] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:11:22.886967 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 184765us
I20260709 13:11:22.887379 30025 raft_consensus.cc:2468] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 6.
W20260709 13:11:22.888664 29993 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:22.889348 29993 connection.cc:256] RPC call timeout handler was delayed by -1.2117959590000282s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1844s for a response
W20260709 13:11:22.889878 29993 connection.cc:256] RPC call timeout handler was delayed by -1.1198658260000229s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17700000000000002s for a response
I20260709 13:11:22.892218 29994 leader_election.cc:304] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:22.895105 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:22.893522 29993 leader_election.cc:304] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:22.896327 30028 raft_consensus.cc:2468] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 8.
I20260709 13:11:22.892141 30021 raft_consensus.cc:2410] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
W20260709 13:11:22.900595 29991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.904259 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
W20260709 13:11:22.904613 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 157893us
I20260709 13:11:22.906400 30068 leader_election.cc:304] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:22.908612 30068 leader_election.cc:304] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:22.911495 30068 leader_election.cc:304] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:22.914141 29993 leader_election.cc:304] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
W20260709 13:11:22.919098 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 160217us
W20260709 13:11:22.919886 30142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 145194us
I20260709 13:11:22.927186 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:22.927687 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:22.929486 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:22.930186 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
W20260709 13:11:22.930440 30143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.930229 30024 raft_consensus.cc:2468] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 10.
W20260709 13:11:22.935160 29994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:22.797636 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:22.941221 30174 raft_consensus.cc:2468] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 4.
I20260709 13:11:22.941586 30028 raft_consensus.cc:2468] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 9.
I20260709 13:11:22.942840 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:22.943063 30177 raft_consensus.cc:3060] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:22.943975 30174 raft_consensus.cc:2393] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 8: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:11:22.944949 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:22.946415  1034 raft_consensus.cc:2804] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:22.947422  1034 raft_consensus.cc:697] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:22.950050  1034 consensus_queue.cc:237] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:22.948501  1032 raft_consensus.cc:3060] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:22.955773 29993 leader_election.cc:304] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:22.959959 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:22.960834 30024 raft_consensus.cc:2468] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 6.
I20260709 13:11:22.962221 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:22.963582 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:22.964270 30702 leader_election.cc:304] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:22.964792 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:22.967068 30700 leader_election.cc:304] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:22.951717 30170 raft_consensus.cc:2468] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 8.
I20260709 13:11:22.971463 30177 raft_consensus.cc:2468] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 5.
I20260709 13:11:22.971860 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:22.792620   369 consensus_queue.cc:237] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:22.969309 30169 raft_consensus.cc:2468] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 8.
I20260709 13:11:22.814538   389 raft_consensus.cc:515] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:22.979393   389 leader_election.cc:290] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:22.980443   922 raft_consensus.cc:2804] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:22.981014   922 raft_consensus.cc:493] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:22.982002   998 raft_consensus.cc:2804] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:22.982168   809 raft_consensus.cc:493] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:22.982612   998 raft_consensus.cc:493] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:22.983232   998 raft_consensus.cc:3060] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:22.970523 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:22.981511   922 raft_consensus.cc:3060] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:22.970594 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:22.991492 30734 raft_consensus.cc:3060] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:22.992699   809 raft_consensus.cc:515] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:22.982466   877 consensus_queue.cc:1059] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 13:11:22.994076 30735 raft_consensus.cc:2468] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 11.
I20260709 13:11:22.997370 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:22.998450 30172 raft_consensus.cc:2393] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 7: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:11:22.998842 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:22.999791 30173 raft_consensus.cc:2468] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 6.
I20260709 13:11:23.001070 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:23.001842 30730 raft_consensus.cc:2468] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 7.
I20260709 13:11:23.002007 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:23.002440 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:22.998860 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:23.002871 30737 raft_consensus.cc:2393] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 5: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:23.003610 30174 raft_consensus.cc:2393] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 10: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:11:23.003952 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:23.005116   809 leader_election.cc:290] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:23.005946   823 raft_consensus.cc:2804] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:23.006428   823 raft_consensus.cc:493] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:23.006810   823 raft_consensus.cc:3060] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:23.007302 30021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54206 (request call id 1726) took 1037 ms. Trace:
I20260709 13:11:23.007735 30021 rpcz_store.cc:276] 0709 13:11:21.969980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.970128 (+   148us) service_pool.cc:224] Handling call
0709 13:11:23.007055 (+1036927us) spinlock_profiling.cc:243] Waited 919 ms on lock 0x7b540013ddd4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:11:23.007228 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2114826496}
I20260709 13:11:23.008117  1023 raft_consensus.cc:493] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.006986 30734 raft_consensus.cc:2468] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 11.
I20260709 13:11:23.008919  1023 raft_consensus.cc:515] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:23.010114   878 consensus_queue.cc:1048] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:23.009234 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:23.027287 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:23.029747   906 raft_consensus.cc:2749] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:23.031100 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:23.034173   900 raft_consensus.cc:2749] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:23.036105   900 raft_consensus.cc:2749] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:11:23.042708 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 128618us
I20260709 13:11:23.045288   853 consensus_queue.cc:1059] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:23.045796 30068 leader_election.cc:304] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:23.046540   853 consensus_queue.cc:1048] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:23.047884 30028 raft_consensus.cc:1275] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:23.048852 30171 raft_consensus.cc:2468] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 8.
I20260709 13:11:23.050096   865 raft_consensus.cc:2749] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:23.050437   877 raft_consensus.cc:3055] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:23.050868   877 raft_consensus.cc:740] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:23.043808 29993 leader_election.cc:304] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719
W20260709 13:11:23.054272 30142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 56284.5us
I20260709 13:11:23.055408   715 consensus_queue.cc:1048] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:23.055814  1023 leader_election.cc:290] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:23.041064   709 raft_consensus.cc:493] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:22.841560   806 raft_consensus.cc:515] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:23.065325   698 raft_consensus.cc:2749] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:23.074952 30172 raft_consensus.cc:1240] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:23.065907   787 consensus_queue.cc:1048] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:11:23.077437   898 raft_consensus.cc:3055] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:23.077884   898 raft_consensus.cc:740] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:23.078001  1004 raft_consensus.cc:2804] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:23.078487  1004 raft_consensus.cc:493] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:23.078884  1004 raft_consensus.cc:3060] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:23.079145   898 consensus_queue.cc:260] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:23.081431   898 raft_consensus.cc:3060] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:23.071272   877 consensus_queue.cc:260] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:23.070402 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:23.081915   940 raft_consensus.cc:2749] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:23.082588   709 raft_consensus.cc:515] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:23.083788  1032 raft_consensus.cc:2749] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:23.069538   622 raft_consensus.cc:3060] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:23.090261 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:23.093924 30142 leader_election.cc:304] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
W20260709 13:11:23.107230 29991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.108320 30028 raft_consensus.cc:1275] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:11:23.108711 30021 raft_consensus.cc:1275] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:11:23.115435   906 raft_consensus.cc:2804] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:23.124768 30142 leader_election.cc:304] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:23.126116 30168 raft_consensus.cc:2468] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 10.
I20260709 13:11:23.126062 30702 leader_election.cc:304] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:23.128197 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:23.128756 30702 leader_election.cc:304] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:23.130146 30731 raft_consensus.cc:1275] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:23.125401   980 raft_consensus.cc:2804] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:23.084551   853 raft_consensus.cc:3055] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:23.139043   878 raft_consensus.cc:2804] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:23.115898   906 raft_consensus.cc:493] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.138939   996 raft_consensus.cc:3060] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:23.140998 29992 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.095346   823 raft_consensus.cc:515] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:23.137382   980 raft_consensus.cc:493] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:23.145875 29992 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.139544  1023 raft_consensus.cc:3060] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:23.142963   906 raft_consensus.cc:3060] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:23.139231   806 leader_election.cc:290] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:23.140589   853 raft_consensus.cc:740] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
W20260709 13:11:23.151515 30728 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.015s	sys 0.020s
W20260709 13:11:23.151932 30728 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.016s	sys 0.020s
I20260709 13:11:23.152810   927 raft_consensus.cc:2804] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:23.146260   980 raft_consensus.cc:3060] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:23.156139 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:23.152866 30728 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51004 (request call id 790) took 1105 ms. Trace:
I20260709 13:11:23.165283 30023 raft_consensus.cc:1240] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 5. Current term is 6. Ops: [5.4-5.4]
I20260709 13:11:23.165376 30177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43840 (request call id 1889) took 1172 ms. Trace:
I20260709 13:11:23.167706 30177 rpcz_store.cc:276] 0709 13:11:21.992528 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:21.992730 (+   202us) service_pool.cc:224] Handling call
0709 13:11:23.165132 (+1172402us) spinlock_profiling.cc:243] Waited 919 ms on lock 0x7b54002b3c54. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:11:23.165306 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2113591680}
I20260709 13:11:23.143006   389 consensus_queue.cc:1048] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 13:11:23.153919   878 raft_consensus.cc:697] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 11 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:23.175027   878 consensus_queue.cc:237] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:23.178016 30099 raft_consensus.cc:1275] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 13:11:23.178233   801 raft_consensus.cc:3055] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:11:23.178601  1019 log.cc:927] Time spent T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.372s	user 0.002s	sys 0.002s
I20260709 13:11:23.179250 30100 raft_consensus.cc:1240] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 6. Current term is 7. Ops: []
W20260709 13:11:23.179859 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 51192.9us
I20260709 13:11:23.178627   801 raft_consensus.cc:740] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:23.186564   801 consensus_queue.cc:260] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:23.188205   801 raft_consensus.cc:3060] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:23.190236 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 144638us
I20260709 13:11:23.190735 30140 leader_election.cc:304] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:23.191008 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:23.194500 30095 raft_consensus.cc:3060] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:23.197824   389 raft_consensus.cc:2749] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:23.157233 30728 rpcz_store.cc:276] 0709 13:11:22.047692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:22.047840 (+   148us) service_pool.cc:224] Handling call
0709 13:11:22.048845 (+  1005us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:22.338754 (+289909us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:22.338787 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:22.341813 (+  3026us) log.cc:844] Serialized 26 byte log entry
0709 13:11:23.152377 (+810564us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:23.152435 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:23.152540 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:23.152597 (+    57us) raft_consensus.cc:1685] finished
0709 13:11:23.152611 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:23.152785 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":187349,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":22127,"thread_start_us":996977,"threads_started":2,"wal-append.queue_time_us":675462}
I20260709 13:11:23.198249   928 consensus_queue.cc:1059] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 13:11:23.206385 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 191518us
I20260709 13:11:23.199803 30066 leader_election.cc:304] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:23.151432   853 consensus_queue.cc:260] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:23.222615   823 leader_election.cc:290] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:23.223374 32579 raft_consensus.cc:3060] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:23.228231  1004 raft_consensus.cc:515] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:23.229864   899 raft_consensus.cc:515] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:23.231330 30101 raft_consensus.cc:2393] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 11: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
W20260709 13:11:23.234799 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 44206.2us
I20260709 13:11:23.252842   787 raft_consensus.cc:2804] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:23.253602   787 raft_consensus.cc:697] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 9 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:23.254142   967 consensus_queue.cc:1059] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:23.254796   787 consensus_queue.cc:237] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:23.255700   967 raft_consensus.cc:3055] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:23.256188 30068 leader_election.cc:304] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:23.257160 30140 leader_election.cc:304] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:23.263041 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:23.251688   715 consensus_queue.cc:1048] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 13:11:23.254909   709 leader_election.cc:290] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:23.269126   906 raft_consensus.cc:515] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:23.261515   389 raft_consensus.cc:2764] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:11:23.275127  1032 consensus_queue.cc:1048] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:23.275741 30099 raft_consensus.cc:1240] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:23.276194 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:23.276757 30096 raft_consensus.cc:1240] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:23.276973 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
W20260709 13:11:23.306623 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 94860us
I20260709 13:11:23.256214   967 raft_consensus.cc:740] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:23.312316   865 raft_consensus.cc:2804] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:23.320839   943 consensus_queue.cc:1048] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
W20260709 13:11:23.327368  1042 log.cc:927] Time spent T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 13:11:23.262872   922 raft_consensus.cc:515] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:23.314343   899 leader_election.cc:290] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 11 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:23.356945 30728 raft_consensus.cc:2393] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 11: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
W20260709 13:11:23.357645 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 79304.8us
I20260709 13:11:23.360394 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:23.358093 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:23.359405 30702 leader_election.cc:304] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:23.357710 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:23.364037 30100 raft_consensus.cc:3060] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:23.351215   998 raft_consensus.cc:515] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:23.369969   948 raft_consensus.cc:493] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:23.370662   948 raft_consensus.cc:515] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:23.371543 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:23.372218   985 raft_consensus.cc:493] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:23.373114 30099 raft_consensus.cc:2393] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 8: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:23.372848   985 raft_consensus.cc:515] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:23.373311   948 leader_election.cc:290] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:23.375088 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:23.375610   985 leader_election.cc:290] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:23.370090 30140 leader_election.cc:304] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:23.383069 30140 leader_election.cc:304] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:23.385671 29993 leader_election.cc:304] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:23.386492 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:23.388046   922 leader_election.cc:290] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 11 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:23.389364  1023 raft_consensus.cc:2749] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:23.390730  1026 raft_consensus.cc:2749] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:23.391237   809 raft_consensus.cc:2749] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:23.392269   967 consensus_queue.cc:260] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:23.393555   967 raft_consensus.cc:3060] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:23.384900 30140 leader_election.cc:304] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
W20260709 13:11:23.398298 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 77771.7us
I20260709 13:11:23.401356   779 raft_consensus.cc:493] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:23.363411   865 raft_consensus.cc:697] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 8 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:23.412544 30099 raft_consensus.cc:1240] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:23.367744  1004 leader_election.cc:290] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:23.417013   779 raft_consensus.cc:515] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:23.417902   922 raft_consensus.cc:2804] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:23.428359   389 raft_consensus.cc:493] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:23.428695 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:23.429316 30020 raft_consensus.cc:2468] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 5.
I20260709 13:11:23.429104   389 raft_consensus.cc:515] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:23.431331   389 leader_election.cc:290] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:23.433322 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:23.433624 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:23.436329 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:23.391396  1026 consensus_queue.cc:1048] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 13:11:23.418942  1023 consensus_queue.cc:1059] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 13:11:23.445703 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:23.444375 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:23.447942 30099 raft_consensus.cc:2468] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 5.
I20260709 13:11:23.450553   850 raft_consensus.cc:493] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.451159   850 raft_consensus.cc:515] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:23.451543   779 leader_election.cc:290] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:23.454850   998 leader_election.cc:290] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:23.455436 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:23.447110 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:23.458313 30168 raft_consensus.cc:2393] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 11: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:11:23.459913   996 raft_consensus.cc:2749] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:23.462077 30101 raft_consensus.cc:2468] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 10.
I20260709 13:11:23.463953   980 raft_consensus.cc:515] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:23.440826   922 raft_consensus.cc:697] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:23.470911 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:23.472545 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:23.475808 30027 raft_consensus.cc:3060] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:23.472690   906 leader_election.cc:290] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:23.472803   865 consensus_queue.cc:237] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:23.473423  1023 raft_consensus.cc:3055] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:23.473830 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:23.479377 30095 raft_consensus.cc:2468] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 10.
I20260709 13:11:23.447115   959 raft_consensus.cc:2804] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:23.468183   878 raft_consensus.cc:2804] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 13:11:23.480794 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 95269.5us
I20260709 13:11:23.482800   878 raft_consensus.cc:493] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:23.482921 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:23.483243   927 raft_consensus.cc:493] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:23.482944 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:23.483719   927 raft_consensus.cc:3060] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:23.483945 30024 raft_consensus.cc:3060] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:23.483258   878 raft_consensus.cc:3060] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:23.486248 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:23.486860 29993 leader_election.cc:304] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:23.487620 30099 raft_consensus.cc:1240] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 10. Current term is 11. Ops: []
W20260709 13:11:23.494460  1052 log.cc:927] Time spent T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:11:23.494626 30700 leader_election.cc:304] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:23.496148 29993 leader_election.cc:304] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:23.496807   905 raft_consensus.cc:2749] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:23.497596   905 raft_consensus.cc:2749] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:23.497491 29993 leader_election.cc:304] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:23.498651 30168 raft_consensus.cc:3060] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:23.500663   779 raft_consensus.cc:3060] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:23.503564 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:23.504400 29994 leader_election.cc:304] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:23.504985 30022 raft_consensus.cc:2468] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 6.
I20260709 13:11:23.505632  1026 raft_consensus.cc:493] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.506347 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:23.506915 30169 raft_consensus.cc:3060] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:11:23.507296 30172 raft_consensus.cc:1240] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:23.508288 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:23.481561   959 raft_consensus.cc:493] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:23.509053   959 raft_consensus.cc:3060] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:23.510321 30173 raft_consensus.cc:1240] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:23.511082 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:23.511718 30734 raft_consensus.cc:3060] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:23.513303 30143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.514264   922 consensus_queue.cc:237] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:23.506174  1026 raft_consensus.cc:515] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:23.515460 30169 raft_consensus.cc:2468] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 10.
I20260709 13:11:23.511421 30173 raft_consensus.cc:3060] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:23.516933  1026 leader_election.cc:290] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:23.508055 30174 raft_consensus.cc:1240] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 11 LEADER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:23.504683   878 raft_consensus.cc:515] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:23.521932 30142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.522308 30100 raft_consensus.cc:2468] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 8.
I20260709 13:11:23.504781 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:23.523242 30737 raft_consensus.cc:2468] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 10.
I20260709 13:11:23.535346   878 leader_election.cc:290] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:23.536774 30177 raft_consensus.cc:1275] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 5. (term mismatch)
I20260709 13:11:23.537135 30177 pending_rounds.cc:85] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124: Aborting all ops after (but not including) 4
I20260709 13:11:23.537407 30177 pending_rounds.cc:107] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124: Aborting uncommitted NO_OP operation due to leader change: 8.5
I20260709 13:11:23.537601   853 raft_consensus.cc:3060] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:23.538012 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:23.538642 30169 raft_consensus.cc:2376] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 7. Re-sending same reply.
W20260709 13:11:23.541234 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 62279us
W20260709 13:11:23.542289 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 47769.5us
I20260709 13:11:23.543650   998 raft_consensus.cc:2749] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:23.481993  1023 raft_consensus.cc:740] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:23.546540  1023 consensus_queue.cc:260] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:23.547776  1023 raft_consensus.cc:3060] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:23.537689 30177 raft_consensus.cc:2889] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:23.548911 30170 raft_consensus.cc:2376] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 11. Re-sending same reply.
I20260709 13:11:23.562099 30173 raft_consensus.cc:1275] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 13:11:23.564366 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 60062.7us
I20260709 13:11:23.516577   927 raft_consensus.cc:515] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:23.565272 29994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.566062 30175 raft_consensus.cc:1275] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:11:23.569355 30024 raft_consensus.cc:2468] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 12.
I20260709 13:11:23.570363   905 raft_consensus.cc:2804] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:23.570909 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:23.575096 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:23.593602 30026 raft_consensus.cc:2468] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 8.
W20260709 13:11:23.594101 30069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.577644 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:23.586756 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:23.595674 30734 raft_consensus.cc:2468] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 10.
I20260709 13:11:23.595794 30095 raft_consensus.cc:2393] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 6: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:23.596424 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:23.596755 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:23.597121 30097 raft_consensus.cc:2393] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 10: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:23.597852 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:23.599424 30095 raft_consensus.cc:2393] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 6: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:23.593097 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:23.584889 30168 raft_consensus.cc:2468] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 7.
I20260709 13:11:23.603267 30027 raft_consensus.cc:2468] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 7.
I20260709 13:11:23.561305   980 leader_election.cc:290] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 12 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:23.608399 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:23.597997 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:23.610541 30734 raft_consensus.cc:1240] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:23.610442 30700 leader_election.cc:304] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:23.614044 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:23.612190 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:23.643311 30175 raft_consensus.cc:1240] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:23.645267 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:23.646296 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:23.597436   779 raft_consensus.cc:2749] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:23.656571 30101 raft_consensus.cc:2368] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 10. Current term is 11.
I20260709 13:11:23.598153   928 raft_consensus.cc:493] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:23.661743 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:23.672385 30021 raft_consensus.cc:1240] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:23.677805 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:23.687091 30101 raft_consensus.cc:1275] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:11:23.658536   905 raft_consensus.cc:697] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
W20260709 13:11:23.698773 30067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.697966 30068 leader_election.cc:304] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:23.706715 30736 raft_consensus.cc:1275] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:11:23.693313   998 raft_consensus.cc:2804] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:23.722409 30100 raft_consensus.cc:1275] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:23.723956  1057 raft_consensus.cc:493] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:23.724516  1057 raft_consensus.cc:515] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:23.725943 29992 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.676555   928 raft_consensus.cc:515] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:23.726855  1049 consensus_queue.cc:1059] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.119s
I20260709 13:11:23.727905  1049 raft_consensus.cc:3055] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:23.728235  1049 raft_consensus.cc:740] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:23.728323   928 leader_election.cc:290] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:11:23.729838 30141 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:23.731221  1061 log.cc:927] Time spent T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 13:11:23.731775 29993 leader_election.cc:304] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:23.733803  1055 consensus_queue.cc:1059] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.123s
I20260709 13:11:23.735406 30737 raft_consensus.cc:2468] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 7.
I20260709 13:11:23.735661 30068 leader_election.cc:304] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:23.736964 30068 leader_election.cc:304] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:23.737630 32579 raft_consensus.cc:2749] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:23.726665 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:23.738330 32579 consensus_queue.cc:1059] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:23.738760 30732 raft_consensus.cc:2393] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 8: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:11:23.739533 30068 leader_election.cc:304] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:23.740684  1035 raft_consensus.cc:2749] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:23.741539  1035 raft_consensus.cc:2749] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:23.739691   352 consensus_queue.cc:1048] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 13:11:23.742659 30026 raft_consensus.cc:2468] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 6.
I20260709 13:11:23.740983 30068 leader_election.cc:304] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:23.743975 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:23.744552   985 raft_consensus.cc:2804] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:23.745115   985 raft_consensus.cc:697] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 11 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:23.734257   998 raft_consensus.cc:697] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:23.725883   997 consensus_queue.cc:1059] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.028s
I20260709 13:11:23.745913   715 consensus_queue.cc:1048] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 13:11:23.739657   927 leader_election.cc:290] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 11 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:23.746796   997 raft_consensus.cc:3055] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:23.755995   997 raft_consensus.cc:740] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:23.744722 30023 raft_consensus.cc:2393] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 8: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:11:23.758786   905 consensus_queue.cc:237] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:23.759508 30097 raft_consensus.cc:1275] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:11:23.761080 32579 raft_consensus.cc:3055] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:23.761459 32579 raft_consensus.cc:740] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:23.761955 30729 raft_consensus.cc:1275] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:23.762130 30068 leader_election.cc:304] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:23.762264 32579 consensus_queue.cc:260] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:23.763636 30702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:23.764410   787 raft_consensus.cc:2749] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:23.764734 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:23.745817 30143 leader_election.cc:304] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:23.746795   998 consensus_queue.cc:237] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:23.766156 30068 leader_election.cc:304] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:23.766390 30143 leader_election.cc:304] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:23.767161   980 raft_consensus.cc:2749] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:23.767635   898 consensus_queue.cc:1048] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:23.767895   980 raft_consensus.cc:2749] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 13:11:23.765321   787 consensus_queue.cc:1048] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:23.769802  1005 raft_consensus.cc:3055] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:23.742141  1035 raft_consensus.cc:2804] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:23.767400   943 raft_consensus.cc:2749] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:23.770459 30143 leader_election.cc:304] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:23.770933 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
W20260709 13:11:23.725625  1048 log.cc:927] Time spent T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.223s	user 0.002s	sys 0.000s
I20260709 13:11:23.729197  1049 consensus_queue.cc:260] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:23.765025   985 consensus_queue.cc:237] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:23.771643  1021 raft_consensus.cc:2749] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:23.757161   997 consensus_queue.cc:260] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:23.775328 29991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:23.772992   840 consensus_queue.cc:1175] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "c99569d27a6f4c648eae7119fe3db124" responder_term: 4 status { last_received { term: 4 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 4 index: 6 } }
I20260709 13:11:23.771773 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:23.766403 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:23.781261 29993 leader_election.cc:304] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:23.778000  1035 raft_consensus.cc:697] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 7 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:23.783056  1035 consensus_queue.cc:237] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:23.764585   910 raft_consensus.cc:2749] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:23.793936 30140 leader_election.cc:304] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:23.794847 30140 leader_election.cc:304] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:23.796267 30068 leader_election.cc:304] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:23.805311 30140 leader_election.cc:304] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:23.805156 30700 leader_election.cc:304] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:23.823715 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:23.828800 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:23.830809 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:23.831854   979 raft_consensus.cc:2804] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:23.833278  1021 raft_consensus.cc:493] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.775215   850 leader_election.cc:290] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:23.770165  1005 raft_consensus.cc:740] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:23.838029 30143 leader_election.cc:400] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 election: Vote denied by peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821) with higher term. Message: Invalid argument: T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 10. Current term is 11.
I20260709 13:11:23.834419 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:23.838388 30143 leader_election.cc:403] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 13:11:23.837528 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 56712.5us
I20260709 13:11:23.838896 30730 raft_consensus.cc:2410] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:11:23.728328  1057 leader_election.cc:290] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:23.833770  1021 raft_consensus.cc:515] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:23.825870   809 raft_consensus.cc:2804] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:23.847342 30102 raft_consensus.cc:2393] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 6: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:23.847770   928 raft_consensus.cc:2804] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:23.847977  1005 consensus_queue.cc:260] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:23.850047  1032 raft_consensus.cc:2749] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 13:11:23.851739 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 118016us
I20260709 13:11:23.854802   980 raft_consensus.cc:493] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:23.855438   909 raft_consensus.cc:493] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:23.858045 30068 leader_election.cc:304] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:23.826097   806 raft_consensus.cc:2804] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:23.827811   910 raft_consensus.cc:2749] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 13:11:23.869374 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 88051.8us
I20260709 13:11:23.821244   967 consensus_queue.cc:1048] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:11:23.888271 30143 leader_election.cc:304] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:23.861985   979 raft_consensus.cc:697] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 6 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:23.884653 32579 raft_consensus.cc:3060] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:23.864907   928 raft_consensus.cc:493] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:23.885511   801 raft_consensus.cc:2749] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821) with higher term. Message: Invalid argument: T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 10. Current term is 11.
I20260709 13:11:23.885907   806 raft_consensus.cc:493] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:23.881425   809 raft_consensus.cc:697] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 12 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:23.889554   865 raft_consensus.cc:2749] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:23.891755   997 raft_consensus.cc:3060] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:23.906302 30143 leader_election.cc:304] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:23.897845   928 raft_consensus.cc:3060] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:23.897898   806 raft_consensus.cc:3060] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:23.894199   909 raft_consensus.cc:515] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:23.901083   996 raft_consensus.cc:493] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:23.918988 29993 leader_election.cc:304] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:23.896816   980 raft_consensus.cc:515] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:23.924335   801 raft_consensus.cc:2749] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:23.905920   959 raft_consensus.cc:515] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:23.972429 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 53514.3us
W20260709 13:11:23.973168  1065 log.cc:927] Time spent T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 13:11:23.974016   823 consensus_queue.cc:1048] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:23.975147  1021 leader_election.cc:290] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:23.981413 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 97724.5us
I20260709 13:11:23.968436   967 raft_consensus.cc:2749] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:23.990438 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:23.929066   996 raft_consensus.cc:515] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:24.002604 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 307331us
I20260709 13:11:23.967099   809 consensus_queue.cc:237] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:23.994055  1020 raft_consensus.cc:2749] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:23.977937   979 consensus_queue.cc:237] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:24.020623  1005 raft_consensus.cc:3060] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:24.023846 30171 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43840 (request call id 1911) took 1268 ms (client timeout 1605 ms). Trace:
W20260709 13:11:24.024228 30171 rpcz_store.cc:269] 0709 13:11:22.755555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:22.755661 (+   106us) service_pool.cc:224] Handling call
0709 13:11:24.023630 (+1267969us) spinlock_profiling.cc:243] Waited 189 ms on lock 0x7b540011f8d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:11:24.023766 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":435386752}
W20260709 13:11:24.035157  1072 log.cc:927] Time spent T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 13:11:23.067884 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:24.049077 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:24.049942 30022 raft_consensus.cc:2410] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 13:11:24.051218 30023 raft_consensus.cc:1275] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:11:24.051606 30023 pending_rounds.cc:85] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4: Aborting all ops after (but not including) 8
I20260709 13:11:24.051834 30023 pending_rounds.cc:107] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:11:24.052057 30023 raft_consensus.cc:2889] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:24.053320 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:24.054385 30019 raft_consensus.cc:1240] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 7. Current term is 8. Ops: []
W20260709 13:11:24.057950 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 48134.6us
W20260709 13:11:24.059492 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 88990.7us
I20260709 13:11:24.060451 30703 leader_election.cc:304] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:24.069880 29993 leader_election.cc:304] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:24.079998 30019 raft_consensus.cc:1240] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:24.081225 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 10 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:24.057336   910 raft_consensus.cc:493] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
W20260709 13:11:24.158058 30143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:24.163942 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 160637us
I20260709 13:11:24.171921 30023 raft_consensus.cc:1275] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260709 13:11:24.172916 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 109559us
I20260709 13:11:24.191332   909 leader_election.cc:290] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:24.085888   352 raft_consensus.cc:2804] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:24.197902   492 raft_consensus.cc:493] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.198395   492 raft_consensus.cc:515] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:24.185876   389 raft_consensus.cc:493] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:24.199790   389 raft_consensus.cc:515] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:24.200348   492 leader_election.cc:290] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:24.193248  1020 raft_consensus.cc:493] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.202155  1020 raft_consensus.cc:515] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:24.204142   910 raft_consensus.cc:515] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:24.201681   389 leader_election.cc:290] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:24.206820  1075 raft_consensus.cc:2749] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:24.209174   982 raft_consensus.cc:3060] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:24.174361   900 raft_consensus.cc:493] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.210250   900 raft_consensus.cc:515] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:24.212059  1062 log.cc:927] Time spent T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 13:11:24.226150 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:24.252768 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:24.254268 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:24.212947   928 raft_consensus.cc:515] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:24.260567 30066 leader_election.cc:304] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:24.265055 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:24.196353   352 raft_consensus.cc:493] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:24.261330 30703 leader_election.cc:304] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:24.204142  1020 leader_election.cc:290] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:24.274029  1079 raft_consensus.cc:2749] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 13:11:24.275157 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 77737.8us
I20260709 13:11:24.276124   910 leader_election.cc:290] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:24.276903   903 consensus_queue.cc:1059] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:24.277475   967 consensus_queue.cc:1059] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:24.261873 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:24.265722 30023 raft_consensus.cc:2468] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 6.
I20260709 13:11:24.279992 30025 raft_consensus.cc:2393] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 6: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
W20260709 13:11:24.270104 30068 leader_election.cc:336] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Timed out: RequestConsensusVote RPC to 127.28.54.67:45001 timed out after 1.605s (SENT)
I20260709 13:11:24.271332 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:24.271881   959 leader_election.cc:290] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:24.273008 30703 leader_election.cc:304] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:24.251956   980 leader_election.cc:290] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:24.292865 30068 leader_election.cc:304] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:24.253407   389 raft_consensus.cc:493] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:24.296756   928 leader_election.cc:290] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:24.297327   934 raft_consensus.cc:2749] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:24.292445   779 consensus_queue.cc:1059] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 13:11:24.302762 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:24.304597 30736 raft_consensus.cc:1275] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:11:24.305160 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:24.322234 30731 raft_consensus.cc:3060] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:24.307021 30094 raft_consensus.cc:1240] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:24.314105 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:24.323449 30094 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33990 (request call id 2261) took 1147 ms. Trace:
I20260709 13:11:24.323796 30098 raft_consensus.cc:2468] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 9.
I20260709 13:11:24.323765 30094 rpcz_store.cc:276] 0709 13:11:23.175673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:23.204689 (+ 29016us) service_pool.cc:224] Handling call
0709 13:11:24.306563 (+1101874us) spinlock_profiling.cc:243] Waited 8.33 ms on lock 0x7b5800073598. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eef95b71 00007f99eef95a22 00007f99f7eaec09 00007f99f7008ee0 00007f99f70d20ab 00007f99f70d2131 00007f99f7093fc0 00007f99f707e929 00007f99f707e3d2 00007f99f05f5bd4
0709 13:11:24.306752 (+   189us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:24.323197 (+ 16445us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:24.323374 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19156224}
I20260709 13:11:24.325181   779 consensus_queue.cc:1243] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer c99569d27a6f4c648eae7119fe3db124 log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:11:24.325953   779 raft_consensus.cc:3055] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 LEADER]: Stepping down as leader of term 10
W20260709 13:11:24.326072 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 53179us
I20260709 13:11:24.309091   806 raft_consensus.cc:515] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:24.310127   996 leader_election.cc:290] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:24.310052   787 raft_consensus.cc:2749] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:24.316054 30066 leader_election.cc:304] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:24.278750   352 raft_consensus.cc:3060] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:24.328378 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 58312.7us
I20260709 13:11:24.341998   865 raft_consensus.cc:2749] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:24.342854   943 consensus_queue.cc:1059] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:11:24.328735  1087 log.cc:927] Time spent T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:11:24.346591 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:24.346942 30143 leader_election.cc:304] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:24.343626 30142 leader_election.cc:304] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:24.350467 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:24.351828 30177 raft_consensus.cc:2368] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 8. Current term is 9.
I20260709 13:11:24.355139 30175 raft_consensus.cc:1275] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:11:24.331594   853 raft_consensus.cc:493] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.328667   911 raft_consensus.cc:2749] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:24.314107   910 consensus_queue.cc:1048] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:11:24.327526   779 raft_consensus.cc:740] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:24.326798   850 consensus_queue.cc:1059] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 13:11:24.326427   389 raft_consensus.cc:515] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:24.380333 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:24.376516   492 raft_consensus.cc:2749] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:24.379400   698 raft_consensus.cc:2749] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:24.358043   709 consensus_queue.cc:1048] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.076s
W20260709 13:11:24.448390 30702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:24.450264 30702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.374706   853 raft_consensus.cc:515] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:24.455564 30142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 79590us
W20260709 13:11:24.460279 30702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.461541 30728 raft_consensus.cc:1240] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 9. Current term is 10. Ops: []
W20260709 13:11:24.463368 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 185844us
I20260709 13:11:24.487516 30703 leader_election.cc:304] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:24.500674 30175 raft_consensus.cc:1240] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:24.501725 30702 leader_election.cc:400] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Vote denied by peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001) with higher term. Message: Invalid argument: T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 8. Current term is 9.
I20260709 13:11:24.502079 30702 leader_election.cc:403] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:11:24.505263 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 157876us
I20260709 13:11:24.506518 30171 raft_consensus.cc:1275] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:24.507426 30177 raft_consensus.cc:1275] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:24.498854   903 raft_consensus.cc:493] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.510051 30702 leader_election.cc:304] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:24.486163  1086 consensus_queue.cc:1059] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.141s
I20260709 13:11:24.514678 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:24.481736 32579 consensus_queue.cc:1048] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 13:11:24.531773 30175 raft_consensus.cc:1275] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:11:24.527212 30703 leader_election.cc:304] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:24.527806 30170 raft_consensus.cc:1275] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:11:24.467401   779 consensus_queue.cc:260] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:24.519330  1005 raft_consensus.cc:3060] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:11:24.517836  1079 raft_consensus.cc:2804] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:24.500280   698 consensus_queue.cc:1048] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 13:11:24.493713   997 consensus_queue.cc:1048] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 13:11:24.498894   934 consensus_queue.cc:1059] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 13:11:24.535493   806 leader_election.cc:290] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:24.536410   909 raft_consensus.cc:2804] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:24.531764   967 raft_consensus.cc:493] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
W20260709 13:11:24.571038  1093 log.cc:927] Time spent T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 13:11:24.582052 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:24.534658   942 raft_consensus.cc:493] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.578151  1079 raft_consensus.cc:697] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:24.538169   787 consensus_queue.cc:1059] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 13:11:24.588129 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:24.567904   943 consensus_queue.cc:1048] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 13:11:24.536327   903 raft_consensus.cc:515] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:24.576413   909 raft_consensus.cc:493] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.594288 30098 raft_consensus.cc:2393] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 6: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:24.589275   806 raft_consensus.cc:493] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.592237  1077 raft_consensus.cc:2749] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:24.588029 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:24.588654 30102 raft_consensus.cc:1275] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:24.583909   934 consensus_queue.cc:1243] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer 5ec73dc157ed476ca903a7d596271719 log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:11:24.583994   779 raft_consensus.cc:3060] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:24.601620   909 raft_consensus.cc:3060] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:24.603911   698 raft_consensus.cc:493] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:24.586721   967 raft_consensus.cc:515] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:24.592789  1088 log.cc:927] Time spent T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260709 13:11:24.595170   389 leader_election.cc:290] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:24.608453   801 raft_consensus.cc:493] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.601845   942 raft_consensus.cc:515] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:24.653309  1090 log.cc:927] Time spent T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:11:24.666942   389 raft_consensus.cc:3055] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:24.642210   698 raft_consensus.cc:515] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:24.703224   389 raft_consensus.cc:740] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:24.704107   389 consensus_queue.cc:260] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:24.704918   698 leader_election.cc:290] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:11:24.647837  1091 log.cc:927] Time spent T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.164s	user 0.000s	sys 0.001s
I20260709 13:11:24.668540   900 leader_election.cc:290] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:24.627629   806 raft_consensus.cc:515] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:24.693805   928 raft_consensus.cc:493] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.707508   928 raft_consensus.cc:515] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:24.708448   806 leader_election.cc:290] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:11:24.666296  1094 log.cc:927] Time spent T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
W20260709 13:11:24.682615  1102 log.cc:927] Time spent T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260709 13:11:24.690385 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:24.673975  1079 consensus_queue.cc:237] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:24.684738 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:24.690743 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:24.657634   801 raft_consensus.cc:515] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:24.661981 30168 raft_consensus.cc:2468] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 6.
I20260709 13:11:24.687043 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:24.670663  1100 raft_consensus.cc:493] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.684320 30734 raft_consensus.cc:1275] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:24.692042   996 raft_consensus.cc:3055] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:24.713285 30737 raft_consensus.cc:2468] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 6.
I20260709 13:11:24.713559   980 raft_consensus.cc:493] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.720430   980 raft_consensus.cc:515] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:24.664896  1099 raft_consensus.cc:493] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.668279  1098 raft_consensus.cc:493] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.721626  1099 raft_consensus.cc:515] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:24.721997  1098 raft_consensus.cc:515] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:24.723611  1099 leader_election.cc:290] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:24.724030  1098 leader_election.cc:290] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:24.705312   389 raft_consensus.cc:3060] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:11:24.725201  1068 log.cc:927] Time spent T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.941s	user 0.003s	sys 0.002s
I20260709 13:11:24.649608   903 leader_election.cc:290] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:24.725466  1100 raft_consensus.cc:515] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:24.646500   934 raft_consensus.cc:493] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:24.726639   934 raft_consensus.cc:515] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:24.727525  1100 leader_election.cc:290] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:24.696197  1075 consensus_queue.cc:1059] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:11:24.675027   853 leader_election.cc:290] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:24.728677   934 leader_election.cc:290] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:24.729101  1077 raft_consensus.cc:493] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:24.662436  1089 log.cc:927] Time spent T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260709 13:11:24.731467   996 raft_consensus.cc:740] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:24.732348   996 consensus_queue.cc:260] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:24.663550   967 leader_election.cc:290] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:24.688094  1049 raft_consensus.cc:3060] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:24.729595  1077 raft_consensus.cc:515] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:24.739648   801 leader_election.cc:290] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:24.740209  1092 log.cc:927] Time spent T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.253s	user 0.002s	sys 0.000s
I20260709 13:11:24.741670   900 raft_consensus.cc:493] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.742174   900 raft_consensus.cc:515] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:24.743991   900 leader_election.cc:290] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:24.746588 30172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43840 (request call id 1925) took 1188 ms. Trace:
I20260709 13:11:24.747406 30731 raft_consensus.cc:2468] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 12.
I20260709 13:11:24.747793  1032 raft_consensus.cc:3055] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:24.748150  1032 raft_consensus.cc:740] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:24.711485 30728 raft_consensus.cc:2468] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 7.
I20260709 13:11:24.705281   942 leader_election.cc:290] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451)
I20260709 13:11:24.751276   910 raft_consensus.cc:493] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.752396   948 raft_consensus.cc:3055] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:24.752759   948 raft_consensus.cc:740] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:24.753484   948 consensus_queue.cc:260] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:24.754442   948 raft_consensus.cc:3060] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:24.756860 30068 leader_election.cc:304] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:11:24.757670 30068 leader_election.cc:304] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:11:24.758788   787 consensus_queue.cc:1048] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:24.760015   787 raft_consensus.cc:2804] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:24.760336   787 raft_consensus.cc:493] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.760653   787 raft_consensus.cc:3060] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:24.768278 30022 raft_consensus.cc:2468] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 6.
I20260709 13:11:24.751752   910 raft_consensus.cc:515] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:24.770939 30170 raft_consensus.cc:1275] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:24.771162   900 raft_consensus.cc:2804] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:24.747001 30172 rpcz_store.cc:276] 0709 13:11:23.558203 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:23.558338 (+   135us) service_pool.cc:224] Handling call
0709 13:11:23.569897 (+ 11559us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:23.579838 (+  9941us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:23.579872 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:23.580465 (+   593us) log.cc:844] Serialized 26 byte log entry
0709 13:11:23.650841 (+ 70376us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:23.650936 (+    95us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:23.651016 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:24.639619 (+988603us) spinlock_profiling.cc:243] Waited 7.27 ms on lock 0x7b4400022b4c. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eeef3c85 00007f99eeef46a2 00007f99f1c661db 00007f99f1c61aaf 00007f99f1c5586e 00007f99f1c54bb6 00007f99f1c547d8 00007f99f1c5e221 00007f99f1c5e1d9 00007f99f1c5e169
0709 13:11:24.746293 (+106674us) raft_consensus.cc:1685] finished
0709 13:11:24.746317 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:24.746511 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":103,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":78,"spinlock_wait_cycles":16711936,"thread_start_us":69917,"threads_started":1,"wal-append.queue_time_us":203275}
I20260709 13:11:24.766335 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:24.774533 30024 raft_consensus.cc:1240] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 13:11:24.781618 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:24.733594   996 raft_consensus.cc:3060] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:11:24.771930  1067 log.cc:927] Time spent T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.988s	user 0.002s	sys 0.006s
I20260709 13:11:24.786507 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:24.787180 30025 raft_consensus.cc:2468] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 7.
I20260709 13:11:24.788379 30021 raft_consensus.cc:1275] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:24.790361 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:24.791343 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:24.709715   928 leader_election.cc:290] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:24.791925 30174 raft_consensus.cc:2468] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 8.
I20260709 13:11:24.801746 30068 leader_election.cc:304] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:24.775597  1005 raft_consensus.cc:2749] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001) with higher term. Message: Invalid argument: T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 8. Current term is 9.
I20260709 13:11:24.821122 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:24.823900 30021 raft_consensus.cc:1275] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:11:24.782778   900 raft_consensus.cc:493] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.785945   840 consensus_queue.cc:1048] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.043s
I20260709 13:11:24.835842 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:24.827090 29993 leader_election.cc:304] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:24.837805 29993 leader_election.cc:304] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:24.836480 30021 raft_consensus.cc:2468] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 11.
I20260709 13:11:24.829325  1075 raft_consensus.cc:493] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.841706 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:24.842061 30729 raft_consensus.cc:1240] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:24.843992 29993 leader_election.cc:304] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719
W20260709 13:11:24.846117 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 500327us
I20260709 13:11:24.847360 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:24.786131   927 consensus_queue.cc:1048] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 13:11:24.854714 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:24.854745   997 raft_consensus.cc:2804] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:24.855660  1114 raft_consensus.cc:493] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:24.855938 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:24.856293 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:24.856474 30729 raft_consensus.cc:2468] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 10.
I20260709 13:11:24.857544 30729 raft_consensus.cc:1275] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:11:24.748925  1032 consensus_queue.cc:260] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:24.797822   909 raft_consensus.cc:515] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:24.829736   709 raft_consensus.cc:2804] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:24.862363  1098 raft_consensus.cc:2749] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:24.867254 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:24.867902 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:24.835004   900 raft_consensus.cc:3060] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:24.875590 30732 raft_consensus.cc:2468] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 5.
I20260709 13:11:24.879014 30143 leader_election.cc:304] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:24.880244 32579 raft_consensus.cc:493] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:24.881168 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:24.885607 30703 leader_election.cc:304] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:24.877434   997 raft_consensus.cc:697] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:24.922607   997 consensus_queue.cc:237] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:24.880004   709 raft_consensus.cc:493] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.925812   709 raft_consensus.cc:3060] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:24.851928  1075 raft_consensus.cc:515] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:24.926939   909 leader_election.cc:290] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 11 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:24.880108 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:24.927798  1075 leader_election.cc:290] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:24.869161   905 raft_consensus.cc:2804] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:24.928578 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:24.928731  1113 consensus_queue.cc:1048] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:24.929180 30176 raft_consensus.cc:2468] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 9.
I20260709 13:11:24.887019   903 consensus_queue.cc:1059] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:11:24.930080 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:24.868279  1114 raft_consensus.cc:515] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:24.930526 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:24.931620 32579 raft_consensus.cc:515] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:24.932472  1114 leader_election.cc:290] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:24.887549 30174 raft_consensus.cc:2468] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 10.
I20260709 13:11:24.934846 30068 leader_election.cc:304] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:24.930589 30176 raft_consensus.cc:2468] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 11.
W20260709 13:11:24.935699 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 56750.8us
W20260709 13:11:24.936888 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 48474.4us
I20260709 13:11:24.825057  1106 consensus_queue.cc:1048] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.056s
I20260709 13:11:24.861905   910 leader_election.cc:290] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:11:24.939062 30142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 50657.2us
I20260709 13:11:24.933565 32579 leader_election.cc:290] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:11:24.935153 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 49632.3us
I20260709 13:11:24.949829 30734 raft_consensus.cc:2468] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 9.
I20260709 13:11:24.952224 30176 raft_consensus.cc:1240] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:24.953886 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:24.954190 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:24.886962  1032 raft_consensus.cc:3060] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:24.928485   905 raft_consensus.cc:493] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:24.954639 30729 raft_consensus.cc:2468] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 7.
I20260709 13:11:24.964659 30176 raft_consensus.cc:2393] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 9: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:11:24.937564   927 raft_consensus.cc:493] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:24.967494 30020 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.005s	sys 0.030s
I20260709 13:11:24.968009 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
W20260709 13:11:24.973325 30020 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.005s	sys 0.031s
I20260709 13:11:24.973511 30024 raft_consensus.cc:3060] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:24.963616  1117 raft_consensus.cc:2804] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:24.974793  1117 raft_consensus.cc:493] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.975093  1117 raft_consensus.cc:3060] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:24.977417   352 consensus_meta.cc:287] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4: Time spent flushing consensus metadata: real 0.630s	user 0.009s	sys 0.000s
I20260709 13:11:24.977898   989 raft_consensus.cc:2804] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:24.977847   352 raft_consensus.cc:515] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:24.978825  1116 raft_consensus.cc:2749] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:11:24.980746  1109 log.cc:927] Time spent T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:11:24.966964  1114 raft_consensus.cc:493] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:24.967599 30143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:24.986706 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:24.978385   989 raft_consensus.cc:493] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:24.987741 30027 raft_consensus.cc:1240] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:24.877864 30021 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0be979412dd54241bd212ddbb7611046"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
mode: GRACEFUL
new_leader_uuid: "5ec73dc157ed476ca903a7d596271719"
 from {username='slave'} at 127.0.0.1:47450
W20260709 13:11:24.964900 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 273395us
I20260709 13:11:24.989554 30021 raft_consensus.cc:606] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Received request to transfer leadership to TS 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:24.989907 30021 raft_consensus.cc:614] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:24.991353 30700 leader_election.cc:304] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:25.004222   806 raft_consensus.cc:493] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:25.004865   806 raft_consensus.cc:515] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:25.006964   806 leader_election.cc:290] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:25.010164   806 raft_consensus.cc:493] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:25.010669   806 raft_consensus.cc:515] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:25.013638   806 leader_election.cc:290] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:25.014631 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:25.015311 30176 raft_consensus.cc:2468] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 8.
I20260709 13:11:25.020766 30024 raft_consensus.cc:2468] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 9.
I20260709 13:11:24.955252  1021 raft_consensus.cc:493] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:25.027166 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:11:25.064531 29992 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:25.065213 30024 raft_consensus.cc:1275] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:25.066322 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:25.067045 30730 raft_consensus.cc:1240] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:25.028818 30700 leader_election.cc:304] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:24.967334   905 raft_consensus.cc:3060] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:25.068536 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:25.030329 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:25.071044 30025 raft_consensus.cc:2468] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 11.
I20260709 13:11:25.030783 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:25.089354 30730 raft_consensus.cc:1240] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 LEADER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:24.951639  1099 consensus_queue.cc:1048] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260709 13:11:24.994153   989 raft_consensus.cc:3060] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:24.994421   352 leader_election.cc:290] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:24.950735   801 consensus_queue.cc:1048] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.073s
I20260709 13:11:25.098034  1111 raft_consensus.cc:493] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.967363   959 consensus_queue.cc:1048] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.102s
I20260709 13:11:25.069252   996 raft_consensus.cc:2749] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:25.109861 30175 raft_consensus.cc:1240] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:25.066881 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:25.114346 30176 raft_consensus.cc:2468] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 7.
W20260709 13:11:25.118376 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 89643.5us
I20260709 13:11:25.118551  1111 raft_consensus.cc:515] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:24.990823  1114 raft_consensus.cc:515] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:25.120455  1049 raft_consensus.cc:493] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:25.120980  1049 raft_consensus.cc:515] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:25.121915   982 raft_consensus.cc:493] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.122372   982 raft_consensus.cc:515] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:25.124310   982 leader_election.cc:290] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:25.103642   942 raft_consensus.cc:493] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:24.990243   927 raft_consensus.cc:515] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:25.114857  1079 raft_consensus.cc:2804] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:25.126680   900 raft_consensus.cc:515] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:25.089498  1021 raft_consensus.cc:515] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:25.150007 30702 leader_election.cc:304] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
W20260709 13:11:25.150815 30140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:25.151767 29993 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:25.155537 29993 leader_election.cc:304] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:25.157891   352 raft_consensus.cc:2804] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:25.165812   352 raft_consensus.cc:493] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:25.166167   352 raft_consensus.cc:3060] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:25.171386  1049 leader_election.cc:290] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:25.172370  1079 raft_consensus.cc:697] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:25.173374  1079 consensus_queue.cc:237] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:25.174374 30733 raft_consensus.cc:1240] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:25.174748 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:25.175879 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:25.176681 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:25.176823 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:25.177178 30028 raft_consensus.cc:1275] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:11:25.177531 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:25.178112 30024 raft_consensus.cc:2468] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 11.
I20260709 13:11:25.158547  1117 raft_consensus.cc:515] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:25.184333  1114 leader_election.cc:290] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:25.183187   787 raft_consensus.cc:515] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:25.184631   352 raft_consensus.cc:515] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:25.183562 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:25.185544 30025 raft_consensus.cc:2468] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 8.
I20260709 13:11:25.187901 29993 leader_election.cc:304] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:25.192081 29994 leader_election.cc:304] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:25.158392   996 raft_consensus.cc:2804] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:25.204298   787 leader_election.cc:290] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:25.209892 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:25.209860 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:25.137936   942 raft_consensus.cc:515] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:25.199589   959 raft_consensus.cc:2804] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:25.228793   959 raft_consensus.cc:493] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:25.162487  1097 consensus_queue.cc:1059] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 13:11:25.217274   996 raft_consensus.cc:493] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:25.206984  1117 leader_election.cc:290] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 10 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:25.208789   927 leader_election.cc:290] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:25.246304  1021 leader_election.cc:290] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:25.243196 30177 raft_consensus.cc:2468] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 7.
I20260709 13:11:25.194028   948 consensus_queue.cc:1059] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.034s
I20260709 13:11:25.199822   709 raft_consensus.cc:515] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:25.229158   959 raft_consensus.cc:3060] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:25.248781 29994 leader_election.cc:304] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:25.220283  1133 raft_consensus.cc:2749] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260709 13:11:25.250185 29991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:25.253043   980 leader_election.cc:290] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:25.258494   900 leader_election.cc:290] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:25.259994   942 leader_election.cc:290] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:25.260874   967 raft_consensus.cc:3055] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:25.244535   996 raft_consensus.cc:3060] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:25.261803 30732 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56954 (request call id 675) took 1501 ms (client timeout 1514 ms). Trace:
I20260709 13:11:25.267673  1049 raft_consensus.cc:493] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:25.267859   928 raft_consensus.cc:493] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:25.270869 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:25.384016 30728 raft_consensus.cc:2393] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 5: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:25.276211 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
W20260709 13:11:25.339648 30732 rpcz_store.cc:269] 0709 13:11:23.760095 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:23.770703 (+ 10608us) service_pool.cc:224] Handling call
0709 13:11:25.261565 (+1490862us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400188154. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:11:25.261711 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2503014784}
I20260709 13:11:25.410722 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:25.336850   948 consensus_queue.cc:1243] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer 6f3eb161e2194f6891f12e2cfcaaf73a log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:11:25.418109 30728 raft_consensus.cc:2468] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 7.
I20260709 13:11:25.337735   967 raft_consensus.cc:740] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:25.412369   928 raft_consensus.cc:515] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:25.439303   779 raft_consensus.cc:2749] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:25.464869   989 raft_consensus.cc:515] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:25.466583   709 leader_election.cc:290] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:25.435370  1100 consensus_queue.cc:1059] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
W20260709 13:11:25.470131  1112 log.cc:927] Time spent T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.612s	user 0.003s	sys 0.000s
I20260709 13:11:25.472450 30168 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43840 (request call id 1934) took 1125 ms. Trace:
W20260709 13:11:25.478356  1032 consensus_meta.cc:287] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4: Time spent flushing consensus metadata: real 0.511s	user 0.007s	sys 0.001s
I20260709 13:11:25.479578   352 leader_election.cc:290] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 11 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:25.494580 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:25.651813 30728 raft_consensus.cc:3060] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:25.268719   905 raft_consensus.cc:515] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:25.646903 30168 rpcz_store.cc:276] 0709 13:11:24.346649 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.346843 (+   194us) service_pool.cc:224] Handling call
0709 13:11:25.472283 (+1125440us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b54000e88d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:11:25.472391 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":538613120}
I20260709 13:11:25.410020  1049 raft_consensus.cc:515] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:25.664274 30022 raft_consensus.cc:3060] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:25.668479  1049 leader_election.cc:290] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:25.674808 30022 raft_consensus.cc:2468] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 11.
I20260709 13:11:25.660094   779 raft_consensus.cc:493] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:25.685179 29993 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:25.678812   709 raft_consensus.cc:493] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:25.693063 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 444317us
I20260709 13:11:25.671591   967 consensus_queue.cc:260] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:25.683071   779 raft_consensus.cc:515] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:25.705891 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:25.705255   787 raft_consensus.cc:493] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:25.712828 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:25.713447 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:25.713855 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:25.725829 30026 raft_consensus.cc:2468] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 6.
I20260709 13:11:25.714928 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:25.726754 30028 raft_consensus.cc:3060] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:25.715279 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:25.692252   903 raft_consensus.cc:493] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:25.723055 30097 raft_consensus.cc:2468] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 9.
I20260709 13:11:25.723263 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:25.725112 30025 raft_consensus.cc:2468] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 8.
I20260709 13:11:25.737262 30102 raft_consensus.cc:2368] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 9. Current term is 10.
I20260709 13:11:25.738168 30028 raft_consensus.cc:2468] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 7.
I20260709 13:11:25.738521 30020 raft_consensus.cc:2393] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 6: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:11:25.740021 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:25.740440 30025 raft_consensus.cc:3060] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:25.691612   709 raft_consensus.cc:515] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:25.701423  1114 consensus_queue.cc:1059] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 13:11:25.748523 30728 raft_consensus.cc:2468] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 11.
I20260709 13:11:25.730330   903 raft_consensus.cc:515] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:25.749580 29993 leader_election.cc:304] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:25.705358   850 consensus_queue.cc:1048] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 13:11:25.743692 30028 raft_consensus.cc:1240] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:25.752727  1113 raft_consensus.cc:493] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.753309  1113 raft_consensus.cc:515] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:25.755563  1113 leader_election.cc:290] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:25.762657   997 raft_consensus.cc:2804] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:25.763165   997 raft_consensus.cc:697] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:25.763950   997 consensus_queue.cc:237] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:25.765041   959 raft_consensus.cc:515] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:25.783741   709 leader_election.cc:290] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:25.785874   903 leader_election.cc:290] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:25.786280   989 leader_election.cc:290] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:25.793185   779 leader_election.cc:290] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:25.795846 30700 leader_election.cc:304] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:25.796257 30025 raft_consensus.cc:2468] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 8.
I20260709 13:11:25.798098   905 leader_election.cc:290] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:25.798599   927 consensus_queue.cc:1048] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:25.798848   928 leader_election.cc:290] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:25.799476   928 raft_consensus.cc:2804] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:25.799829   928 raft_consensus.cc:493] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:25.800251   928 raft_consensus.cc:3060] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:25.807430 29991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:25.799497  1099 raft_consensus.cc:3055] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:25.808180  1099 raft_consensus.cc:740] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:25.808933  1099 consensus_queue.cc:260] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:25.810356  1099 raft_consensus.cc:3060] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:25.776083  1114 raft_consensus.cc:493] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:25.812743  1114 raft_consensus.cc:515] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:25.813109 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:25.813714 30730 raft_consensus.cc:2468] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 11.
I20260709 13:11:25.814680  1114 leader_election.cc:290] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:25.814954 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:25.815768 30728 raft_consensus.cc:2368] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 10. Current term is 11.
I20260709 13:11:25.817595  1099 raft_consensus.cc:493] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.819082 29993 leader_election.cc:304] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:25.826826 30024 raft_consensus.cc:1240] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 11. Current term is 12. Ops: []
W20260709 13:11:25.831569 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 115140us
I20260709 13:11:25.740348   787 raft_consensus.cc:515] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:25.834780 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 130073us
I20260709 13:11:25.837095  1144 raft_consensus.cc:493] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:25.837366 29993 leader_election.cc:400] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 election: Vote denied by peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469) with higher term. Message: Invalid argument: T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 10. Current term is 11.
I20260709 13:11:25.837738  1144 raft_consensus.cc:515] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:25.839871  1144 leader_election.cc:290] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:11:25.843080 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 47307.6us
I20260709 13:11:25.837707 29993 leader_election.cc:403] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:11:25.843928 29994 leader_election.cc:304] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:25.846841   959 leader_election.cc:290] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 12 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:25.847580   903 raft_consensus.cc:2804] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:25.826591  1114 raft_consensus.cc:493] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.855647 29994 leader_election.cc:400] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821) with higher term. Message: Invalid argument: T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 9. Current term is 10.
I20260709 13:11:25.856297 29994 leader_election.cc:403] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:25.839805  1077 leader_election.cc:290] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:25.860005 30729 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51014 (request call id 992) took 1010 ms. Trace:
I20260709 13:11:25.848347   903 raft_consensus.cc:493] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:25.862488  1056 raft_consensus.cc:493] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:25.865869  1056 raft_consensus.cc:515] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:25.858230  1114 raft_consensus.cc:515] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:25.867722  1056 leader_election.cc:290] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:25.859314  1144 raft_consensus.cc:493] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:25.868503  1114 leader_election.cc:290] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:25.863837  1111 leader_election.cc:290] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:25.827885  1099 raft_consensus.cc:515] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:25.861618 30729 rpcz_store.cc:276] 0709 13:11:24.849494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:25.014279 (+164785us) service_pool.cc:224] Handling call
0709 13:11:25.088960 (+ 74681us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:25.147687 (+ 58727us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:25.147714 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:25.147751 (+    37us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:25.147781 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:25.859803 (+712022us) spinlock_profiling.cc:243] Waited 58.5 ms on lock 0x7b54006fe854. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:11:25.859844 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:25.859953 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":134650240}
I20260709 13:11:25.870263   787 leader_election.cc:290] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:25.871104   903 raft_consensus.cc:3060] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:25.868294  1144 raft_consensus.cc:515] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:25.859030   910 raft_consensus.cc:493] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:25.871802   910 raft_consensus.cc:515] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:25.872835  1144 leader_election.cc:290] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:25.870908  1099 leader_election.cc:290] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:25.856869   997 raft_consensus.cc:2804] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:25.855000   905 raft_consensus.cc:493] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.869127   928 raft_consensus.cc:515] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:25.874256   997 raft_consensus.cc:493] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:25.895709   997 raft_consensus.cc:3060] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:25.857657   959 raft_consensus.cc:2749] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469) with higher term. Message: Invalid argument: T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 10. Current term is 11.
I20260709 13:11:25.909214  1099 raft_consensus.cc:493] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:25.909991 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 56069.8us
I20260709 13:11:25.910516  1100 raft_consensus.cc:3060] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:11:25.928963 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:25.930073 30066 leader_election.cc:304] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:25.930519 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:25.931190 30094 raft_consensus.cc:2393] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 10: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:25.931599 30066 leader_election.cc:304] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:25.911242   928 leader_election.cc:290] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 12 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:25.911911 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:25.873708   910 leader_election.cc:290] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:25.932530 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:25.932919   910 raft_consensus.cc:2804] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:25.933400 30102 raft_consensus.cc:3055] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:25.935153 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:25.935716 30028 raft_consensus.cc:2468] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 8.
I20260709 13:11:25.936604 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:25.937112 30028 raft_consensus.cc:2468] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 8.
I20260709 13:11:25.937891   787 raft_consensus.cc:2804] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:25.862946   996 raft_consensus.cc:515] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:25.933550  1144 consensus_queue.cc:1059] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:11:25.933421   910 raft_consensus.cc:697] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 7 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:25.938223 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:25.940833 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:25.940850 30102 raft_consensus.cc:740] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:25.940634 30096 raft_consensus.cc:2468] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 11.
I20260709 13:11:25.932927 30066 leader_election.cc:304] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:25.944931 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:25.938287   787 raft_consensus.cc:493] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:25.929389  1099 raft_consensus.cc:515] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:25.949519   910 consensus_queue.cc:237] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:25.947551 30102 consensus_queue.cc:260] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:25.951150  1099 leader_election.cc:290] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:25.951268  1056 raft_consensus.cc:2804] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:25.951810  1056 raft_consensus.cc:697] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 8 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:25.952654  1056 consensus_queue.cc:237] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:25.954272 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:25.955200 30102 raft_consensus.cc:3060] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:25.943317   996 leader_election.cc:290] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:25.913056   905 raft_consensus.cc:515] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:25.948814   997 raft_consensus.cc:515] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:25.957446   905 leader_election.cc:290] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:25.957561   997 leader_election.cc:290] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 11 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:25.959241 29993 leader_election.cc:304] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:25.946756 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:25.960448 29993 leader_election.cc:304] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:25.962561 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:25.963088 30096 raft_consensus.cc:3060] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:11:25.944767 30066 leader_election.cc:304] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:25.966740 30066 leader_election.cc:304] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:25.971946  1049 raft_consensus.cc:493] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:25.972554  1049 raft_consensus.cc:515] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:25.974336 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:25.976955 30098 raft_consensus.cc:2410] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 for term 7 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 13:11:25.966040   787 raft_consensus.cc:3060] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:25.969552  1114 raft_consensus.cc:2804] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:25.990600  1114 raft_consensus.cc:493] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:25.991010  1114 raft_consensus.cc:3060] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:25.995819  1049 leader_election.cc:290] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:25.996352  1049 raft_consensus.cc:493] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:25.996789  1049 raft_consensus.cc:515] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:25.975167  1106 raft_consensus.cc:2804] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:26.002491  1106 raft_consensus.cc:493] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:26.002904  1106 raft_consensus.cc:3060] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:26.069276  1049 leader_election.cc:290] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:26.017623  1151 raft_consensus.cc:493] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:26.078385  1151 raft_consensus.cc:515] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:26.080510  1151 leader_election.cc:290] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:26.091531  1106 raft_consensus.cc:515] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:26.099514  1106 leader_election.cc:290] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:26.101980   903 raft_consensus.cc:515] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:26.029866  1100 raft_consensus.cc:2749] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821) with higher term. Message: Invalid argument: T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 9. Current term is 10.
I20260709 13:11:26.094803   787 raft_consensus.cc:515] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:26.196794   787 leader_election.cc:290] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:26.199888  1114 raft_consensus.cc:515] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:26.283733   903 leader_election.cc:290] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 12 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:26.285980  1114 leader_election.cc:290] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:11:26.342531 30066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.355515   898 raft_consensus.cc:3055] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:26.355957   898 raft_consensus.cc:740] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:26.356813   898 consensus_queue.cc:260] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:26.357836   898 raft_consensus.cc:3060] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:26.382907 30102 raft_consensus.cc:1275] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 13:11:26.383262 30102 pending_rounds.cc:85] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719: Aborting all ops after (but not including) 9
I20260709 13:11:26.383453 30102 pending_rounds.cc:107] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719: Aborting uncommitted NO_OP operation due to leader change: 9.10
I20260709 13:11:26.383659 30102 raft_consensus.cc:2889] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:26.383762   877 raft_consensus.cc:3060] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:26.384366   911 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:11:26.390993   878 raft_consensus.cc:493] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.391506   878 raft_consensus.cc:515] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:26.419457   905 raft_consensus.cc:493] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.420073   905 raft_consensus.cc:515] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:26.421947   905 leader_election.cc:290] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:26.446843 30172 raft_consensus.cc:2468] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 6.
I20260709 13:11:26.447958 30172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43840 (request call id 1942) took 1510 ms. Trace:
I20260709 13:11:26.448212 30172 rpcz_store.cc:276] 0709 13:11:24.937267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:25.026890 (+ 89623us) service_pool.cc:224] Handling call
0709 13:11:26.447820 (+1420930us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b5400174654. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:11:26.447913 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3172444544}
I20260709 13:11:26.452548  1035 raft_consensus.cc:493] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:26.452870 30069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.454013   853 raft_consensus.cc:493] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:26.454495   853 raft_consensus.cc:515] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:26.455994   853 leader_election.cc:290] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:26.456774  1035 raft_consensus.cc:515] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:26.458820  1035 leader_election.cc:290] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:11:26.466781 29993 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.469141 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:26.473984   905 raft_consensus.cc:493] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:26.474607   905 raft_consensus.cc:515] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:26.475636 30028 raft_consensus.cc:2468] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 8.
I20260709 13:11:26.476461 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:26.476729   905 leader_election.cc:290] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:26.476986 30028 raft_consensus.cc:2468] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 6.
I20260709 13:11:26.477873 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:26.478427 30028 raft_consensus.cc:2468] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 9.
I20260709 13:11:26.480787 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:26.481266 30028 raft_consensus.cc:3060] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:26.484710 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:26.485325 30024 raft_consensus.cc:3060] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:26.487835 30066 leader_election.cc:304] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:26.489192 30028 raft_consensus.cc:2468] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 7.
I20260709 13:11:26.489459 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:26.487776  1160 consensus_queue.cc:1048] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 13:11:26.490116 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
W20260709 13:11:26.490818 30736 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:51004 (request call id 821) took 1623 ms (client timeout 1635 ms). Trace:
I20260709 13:11:26.491119  1160 raft_consensus.cc:493] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.491580  1160 raft_consensus.cc:515] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:26.492215 30024 raft_consensus.cc:2468] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 9.
W20260709 13:11:26.493191 29993 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.493537  1160 leader_election.cc:290] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:11:26.491148 30736 rpcz_store.cc:269] 0709 13:11:24.867749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:26.489900 (+1622151us) service_pool.cc:224] Handling call
0709 13:11:26.490764 (+   864us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:26.495167 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:26.495721 30098 raft_consensus.cc:3060] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:26.496289 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:26.496837 30094 raft_consensus.cc:2468] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 5.
I20260709 13:11:26.494025  1160 raft_consensus.cc:493] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:26.497731  1160 raft_consensus.cc:515] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:26.499490  1160 leader_election.cc:290] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:26.500982 29994 leader_election.cc:304] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:26.501904  1160 raft_consensus.cc:2804] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:26.502259  1160 raft_consensus.cc:493] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:26.502568  1160 raft_consensus.cc:3060] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:26.507390  1160 raft_consensus.cc:515] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:26.508786  1160 leader_election.cc:290] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:26.509549 30066 leader_election.cc:304] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:26.512367 30066 leader_election.cc:304] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:26.514585 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:26.515223 30102 raft_consensus.cc:3060] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Advancing to term 7
W20260709 13:11:26.514580 30022 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:52098 (request call id 682) took 1522 ms (client timeout 1668 ms). Trace:
W20260709 13:11:26.516105 30022 rpcz_store.cc:269] 0709 13:11:24.992479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.992633 (+   154us) service_pool.cc:224] Handling call
0709 13:11:26.514391 (+1521758us) spinlock_profiling.cc:243] Waited 594 ms on lock 0x7b5400107f54. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:11:26.514495 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1365552384}
I20260709 13:11:26.519977   900 raft_consensus.cc:493] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.520505   900 raft_consensus.cc:515] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:26.525352 30731 raft_consensus.cc:1240] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:26.526607 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:26.526636 30098 raft_consensus.cc:2468] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 12.
I20260709 13:11:26.527433 30728 raft_consensus.cc:2393] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 11: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:11:26.527896 29994 leader_election.cc:304] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:26.528342 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:26.528916 30737 raft_consensus.cc:2468] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 7.
I20260709 13:11:26.530387 29993 leader_election.cc:304] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:26.487587  1133 raft_consensus.cc:493] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:26.532752  1160 raft_consensus.cc:2804] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:26.532871  1133 raft_consensus.cc:515] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:26.538904 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:26.533301  1160 raft_consensus.cc:697] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:26.539602 30736 raft_consensus.cc:3060] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:26.544683 30102 raft_consensus.cc:2468] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 7.
I20260709 13:11:26.545637  1133 leader_election.cc:290] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:11:26.546190 30023 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.012s	sys 0.010s
W20260709 13:11:26.546559 30023 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.012s	sys 0.011s
I20260709 13:11:26.546187  1133 raft_consensus.cc:2804] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:26.547122  1133 raft_consensus.cc:493] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:26.547339 30023 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54198 (request call id 2070) took 1787 ms. Trace:
I20260709 13:11:26.548130   900 leader_election.cc:290] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:26.548944   900 raft_consensus.cc:2804] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:11:26.549074 30096 consensus_meta.cc:287] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719: Time spent flushing consensus metadata: real 0.586s	user 0.009s	sys 0.001s
I20260709 13:11:26.547448  1133 raft_consensus.cc:3060] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:26.549444 30096 raft_consensus.cc:2468] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 11.
I20260709 13:11:26.550886 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:26.546244 29994 leader_election.cc:304] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:26.547744 30023 rpcz_store.cc:276] 0709 13:11:24.759622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.764838 (+  5216us) service_pool.cc:224] Handling call
0709 13:11:24.797805 (+ 32967us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:24.821292 (+ 23487us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:24.821322 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:25.952288 (+1130966us) spinlock_profiling.cc:243] Waited 3.09 ms on lock 0x7b2c00000658. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f09b3a11 00007f99f09c3372 00007f99f20f5a01 00007f99f20ba43a 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2
0709 13:11:25.952622 (+   334us) log.cc:844] Serialized 26 byte log entry
0709 13:11:26.546893 (+594271us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:26.546934 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:26.547003 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:26.547046 (+    43us) raft_consensus.cc:1685] finished
0709 13:11:26.547057 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:26.547261 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2321,"raft.queue_time_us":587,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":16001,"spinlock_wait_cycles":7106816,"thread_start_us":593901,"threads_started":1,"wal-append.queue_time_us":210316}
I20260709 13:11:26.553889 29994 leader_election.cc:304] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:26.554037   853 consensus_queue.cc:1059] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:26.554807   853 raft_consensus.cc:2804] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:26.555162   853 raft_consensus.cc:697] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 7 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:26.555814   853 consensus_queue.cc:237] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:26.558585   928 raft_consensus.cc:493] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.559057   928 raft_consensus.cc:515] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:26.560058   910 raft_consensus.cc:2804] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:26.560501   910 raft_consensus.cc:697] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 9 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:26.561034   928 leader_election.cc:290] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:26.561300   910 consensus_queue.cc:237] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:26.561525   928 raft_consensus.cc:493] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:26.563647   928 raft_consensus.cc:515] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:26.564065   948 raft_consensus.cc:2804] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:26.564574   948 raft_consensus.cc:697] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:26.565270 30737 raft_consensus.cc:1275] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:11:26.566357  1055 raft_consensus.cc:493] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:26.566872  1055 raft_consensus.cc:515] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:26.570412   928 leader_election.cc:290] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:26.572022   928 raft_consensus.cc:493] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.572603   928 raft_consensus.cc:515] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:26.576061  1056 raft_consensus.cc:493] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:26.576627  1056 raft_consensus.cc:515] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:26.575826   928 leader_election.cc:290] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:26.565330   948 consensus_queue.cc:237] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:26.577926   928 raft_consensus.cc:493] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:26.578716  1099 raft_consensus.cc:2804] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:26.578558   928 raft_consensus.cc:515] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:26.579263  1099 raft_consensus.cc:697] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:26.583315  1100 consensus_queue.cc:1048] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:26.583261  1099 consensus_queue.cc:237] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:26.580428   900 raft_consensus.cc:697] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 8 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:26.585992   900 consensus_queue.cc:237] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:26.588964   853 raft_consensus.cc:493] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.587246  1055 leader_election.cc:290] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:26.595527  1055 raft_consensus.cc:493] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:26.596019  1055 raft_consensus.cc:515] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:26.589521   853 raft_consensus.cc:515] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:26.600255   853 leader_election.cc:290] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:26.602306   853 raft_consensus.cc:3055] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:26.602665   853 raft_consensus.cc:740] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:26.604818  1055 leader_election.cc:290] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:26.610788  1056 leader_election.cc:290] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:26.614501 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:26.615198 30028 raft_consensus.cc:2468] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 5.
I20260709 13:11:26.666153 30736 raft_consensus.cc:2468] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 12.
W20260709 13:11:26.658550 30700 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.54.65:34451 timed out after 1.668s (SENT) [suppressed 21 similar messages]
W20260709 13:11:26.726306 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 67791.6us
I20260709 13:11:26.589775   928 leader_election.cc:290] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:26.602944  1160 consensus_queue.cc:237] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:26.727346   948 raft_consensus.cc:493] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:26.742374 30729 raft_consensus.cc:1275] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:11:26.746239 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:26.746863 30735 raft_consensus.cc:2468] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 11.
I20260709 13:11:26.753743 30027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:52098 (request call id 675) took 2685 ms. Trace:
I20260709 13:11:26.739755   948 raft_consensus.cc:515] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:26.754355  1099 raft_consensus.cc:493] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:26.756029   948 leader_election.cc:290] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:26.754220 30027 rpcz_store.cc:276] 0709 13:11:24.068110 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.068951 (+   841us) service_pool.cc:224] Handling call
0709 13:11:24.086400 (+ 17449us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:24.989209 (+902809us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:26.753498 (+1764289us) spinlock_profiling.cc:243] Waited 901 ms on lock 0x7b5400353c54. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:11:26.753657 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2072509696}
I20260709 13:11:26.614369   853 consensus_queue.cc:260] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:26.762691   853 raft_consensus.cc:3060] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:26.754992  1099 raft_consensus.cc:515] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:26.781243  1133 raft_consensus.cc:515] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:26.782423 30023 raft_consensus.cc:1240] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:26.783471  1133 leader_election.cc:290] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:26.785599 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:26.787312   853 consensus_queue.cc:1059] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:26.788419  1117 raft_consensus.cc:3055] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:26.788782  1117 raft_consensus.cc:740] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:26.789405  1099 leader_election.cc:290] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:26.789549  1117 consensus_queue.cc:260] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:26.790725  1117 raft_consensus.cc:3060] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:26.737174   928 raft_consensus.cc:493] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
W20260709 13:11:26.810770 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 73644.9us
I20260709 13:11:26.813555 30100 raft_consensus.cc:1275] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 13:11:26.816197 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:26.816783 30735 raft_consensus.cc:2468] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 4.
I20260709 13:11:26.817586 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:26.818143 30729 raft_consensus.cc:3060] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:26.820591 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:26.821157 30735 raft_consensus.cc:2468] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 11.
I20260709 13:11:26.822855 29993 leader_election.cc:304] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:26.825949 29993 leader_election.cc:304] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:26.825057  1098 consensus_queue.cc:1048] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 13:11:26.833632 30729 raft_consensus.cc:2468] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 8.
I20260709 13:11:26.810436   928 raft_consensus.cc:515] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:26.836889  1098 raft_consensus.cc:2804] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:26.837972  1098 raft_consensus.cc:493] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:26.838344  1098 raft_consensus.cc:3060] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:26.838665   928 leader_election.cc:290] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:26.839195   928 raft_consensus.cc:493] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:26.839614   928 raft_consensus.cc:515] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:26.836628 29993 leader_election.cc:304] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:26.834012  1133 raft_consensus.cc:2804] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:26.872318  1160 raft_consensus.cc:2804] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:26.872723  1160 raft_consensus.cc:493] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:26.873054  1160 raft_consensus.cc:3060] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:26.877980  1097 raft_consensus.cc:2804] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:26.827004  1099 consensus_queue.cc:1048] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 13:11:26.881603 30142 leader_election.cc:304] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:26.882421  1133 raft_consensus.cc:493] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:26.882880  1133 raft_consensus.cc:3060] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:26.885852 30143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.886154 29993 leader_election.cc:304] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:26.890318  1099 raft_consensus.cc:2804] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:26.890787  1099 raft_consensus.cc:697] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:26.891606  1099 consensus_queue.cc:237] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:26.896411 29993 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.893962   840 raft_consensus.cc:493] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:26.916644   840 raft_consensus.cc:515] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:26.923032 30066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:26.898607   959 raft_consensus.cc:2749] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:26.932886  1133 raft_consensus.cc:515] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:26.935829 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:26.950107 30094 raft_consensus.cc:3060] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:26.937224 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:26.950785 30021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54198 (request call id 2087) took 1023 ms. Trace:
I20260709 13:11:26.950904 30101 raft_consensus.cc:2468] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 7.
I20260709 13:11:26.938133 30095 raft_consensus.cc:1240] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 7 LEADER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:26.939074 30096 raft_consensus.cc:1240] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:11:26.939838 30098 raft_consensus.cc:1240] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 9 LEADER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:26.940407 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:26.951325  1160 raft_consensus.cc:515] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:26.941658 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:26.941048 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:26.956784 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:26.957377 30102 raft_consensus.cc:2468] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 8.
I20260709 13:11:26.958215   840 leader_election.cc:290] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:26.958782   840 raft_consensus.cc:493] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:26.959247   840 raft_consensus.cc:515] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:26.960037 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:26.951198 30021 rpcz_store.cc:276] 0709 13:11:25.927532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:25.938016 (+ 10484us) service_pool.cc:224] Handling call
0709 13:11:26.943517 (+1005501us) spinlock_profiling.cc:243] Waited 884 ms on lock 0x7b540013c4d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:11:26.950732 (+  7215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2033941376}
I20260709 13:11:26.961236 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:26.961722 30098 raft_consensus.cc:3060] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:26.953549 30103 raft_consensus.cc:2468] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 9.
I20260709 13:11:26.952679 30099 raft_consensus.cc:2468] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 7.
I20260709 13:11:26.964052 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:26.962037   840 leader_election.cc:290] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:26.966040 30025 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54198 (request call id 2086) took 1038 ms. Trace:
I20260709 13:11:26.967674 30025 rpcz_store.cc:276] 0709 13:11:25.927248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:25.927396 (+   148us) service_pool.cc:224] Handling call
0709 13:11:25.927697 (+   301us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:25.928013 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:25.928039 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:25.941009 (+ 12970us) log.cc:844] Serialized 26 byte log entry
0709 13:11:26.724873 (+783864us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b18003bf080. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f7e95de1 00007f99f7ea25b1 00007f99eefafe07 00007f99f7e0aab9 00007f99eefcc69b 00007f99eefca93f 00007f99eefccc02 00007f99f1c5420b 00007f99f1c59d23 00007f99f1c5a0d1 00007f99f2075a0f
0709 13:11:26.871306 (+146433us) raft_consensus.cc:1645] Marking committed up to 4
0709 13:11:26.871452 (+   146us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:26.871527 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:26.964991 (+ 93464us) raft_consensus.cc:1685] finished
0709 13:11:26.965010 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:26.965967 (+   957us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3455,"raft.queue_time_us":2100,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":14233,"spinlock_wait_cycles":37479680,"thread_start_us":146234,"threads_started":1,"wal-append.queue_time_us":1015489}
I20260709 13:11:26.979110  1160 leader_election.cc:290] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 12 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:26.979621  1098 raft_consensus.cc:515] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:26.967684 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:26.990571  1097 raft_consensus.cc:493] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:26.991134  1097 raft_consensus.cc:3060] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:27.002501  1133 leader_election.cc:290] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 12 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:27.053009  1177 raft_consensus.cc:493] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:27.053582  1177 raft_consensus.cc:515] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:27.061291  1178 raft_consensus.cc:493] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.061856  1178 raft_consensus.cc:515] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:27.063964  1178 leader_election.cc:290] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:27.066205 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:27.066706 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:27.066967 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:27.200742 30095 raft_consensus.cc:2468] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 9.
I20260709 13:11:27.097692 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:27.087153 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:27.151065 30098 raft_consensus.cc:2468] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 9.
W20260709 13:11:27.074668 30069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.066813 30100 raft_consensus.cc:2468] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 6.
I20260709 13:11:27.068485 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:27.215375 30099 raft_consensus.cc:2468] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 8.
I20260709 13:11:27.199766  1177 leader_election.cc:290] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:11:27.081969 30067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.207576 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:27.199546 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:27.222874 30102 raft_consensus.cc:2468] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 8.
W20260709 13:11:27.166419 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 130099us
I20260709 13:11:27.201108  1097 raft_consensus.cc:515] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:27.245932  1097 leader_election.cc:290] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:27.103523   948 raft_consensus.cc:493] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.248279   948 raft_consensus.cc:515] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:27.250876   948 leader_election.cc:290] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:27.251929 30094 raft_consensus.cc:2468] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 11.
I20260709 13:11:27.255972  1098 leader_election.cc:290] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:27.271353 30020 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54198 (request call id 2085) took 1555 ms. Trace:
I20260709 13:11:27.271848 30020 rpcz_store.cc:276] 0709 13:11:25.715704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:25.741504 (+ 25800us) service_pool.cc:224] Handling call
0709 13:11:25.741779 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:25.746470 (+  4691us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:25.746498 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:25.746534 (+    36us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:25.746568 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:27.271095 (+1524527us) spinlock_profiling.cc:243] Waited 4.5 ms on lock 0x7b54001a90d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:11:27.271146 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:27.271276 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10351360}
I20260709 13:11:27.291805   878 leader_election.cc:290] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:27.292315  1113 consensus_queue.cc:1059] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:27.293689  1113 raft_consensus.cc:3055] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:27.294134  1113 raft_consensus.cc:740] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:27.294984  1113 consensus_queue.cc:260] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:27.296082  1113 raft_consensus.cc:3060] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:27.298013   948 raft_consensus.cc:493] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.298580   948 raft_consensus.cc:515] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:27.305444 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:27.306087 30101 raft_consensus.cc:2468] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 5.
I20260709 13:11:27.306931 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:27.307859 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:27.308804 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:27.309290 30101 raft_consensus.cc:2468] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 7.
I20260709 13:11:27.310768   948 leader_election.cc:290] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:27.314363 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:27.314950 30099 raft_consensus.cc:2468] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 7.
I20260709 13:11:27.315680 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:27.316614 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:27.317085 30099 raft_consensus.cc:2468] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 10.
I20260709 13:11:27.318428 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:27.318941 30100 raft_consensus.cc:2468] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 7.
I20260709 13:11:27.319813 30100 raft_consensus.cc:1240] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 5. Current term is 7. Ops: []
I20260709 13:11:27.322299 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:27.322808 30095 raft_consensus.cc:2468] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 5.
I20260709 13:11:27.323880 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:27.324398 30729 raft_consensus.cc:3060] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:27.327461 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:27.327991 30737 raft_consensus.cc:3060] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:27.328231 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:27.328724 30735 raft_consensus.cc:3060] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:27.329317 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:27.331525 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:27.332247 30736 raft_consensus.cc:2393] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 12: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:11:27.332345 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:27.335405 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:27.337389 30020 raft_consensus.cc:1240] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:27.338706 30737 raft_consensus.cc:2468] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 12.
I20260709 13:11:27.339823   911 consensus_queue.cc:1059] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:27.346244 29994 leader_election.cc:304] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:27.347232   948 raft_consensus.cc:2804] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:27.347610   948 raft_consensus.cc:493] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:27.347916   948 raft_consensus.cc:3060] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:27.350356 30095 raft_consensus.cc:1275] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:11:27.317749 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:27.351600 30099 raft_consensus.cc:2468] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 10.
I20260709 13:11:27.354578   948 raft_consensus.cc:515] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:27.356302 30729 raft_consensus.cc:2468] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 12.
I20260709 13:11:27.356590   948 leader_election.cc:290] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 12 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:27.361397  1032 consensus_queue.cc:1048] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:27.305936   996 consensus_queue.cc:1059] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 13:11:27.365203 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:27.366129 30735 raft_consensus.cc:2468] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 5.
W20260709 13:11:27.356629 29993 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.374511 30095 raft_consensus.cc:3060] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:11:27.375602 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:27.372624 30703 leader_election.cc:304] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:11:27.376870   997 raft_consensus.cc:493] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.378376   997 raft_consensus.cc:515] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:27.380313   997 leader_election.cc:290] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:11:27.381676 30066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.381662 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:27.382375 30101 raft_consensus.cc:2468] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 8.
I20260709 13:11:27.383713 29993 leader_election.cc:304] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:27.385250 30020 raft_consensus.cc:1275] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:11:27.376919  1077 consensus_queue.cc:1059] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 13:11:27.386544 29993 leader_election.cc:304] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:27.386837   928 leader_election.cc:290] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:27.387383  1098 raft_consensus.cc:2804] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:27.387843  1098 raft_consensus.cc:697] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:27.389015 30735 raft_consensus.cc:1240] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:27.388671  1098 consensus_queue.cc:237] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:27.390178 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:27.391230 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:27.391765 30737 raft_consensus.cc:3060] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:27.394048 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:27.394824 30736 raft_consensus.cc:2410] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:11:27.395031 30733 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51014 (request call id 991) took 2565 ms. Trace:
I20260709 13:11:27.395699 30728 raft_consensus.cc:1217] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Deduplicated request from leader. Original: 6.8->[8.9-9.10]   Dedup: 9.10->[]
I20260709 13:11:27.396157 30728 raft_consensus.cc:1240] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 9. Current term is 10. Ops: [8.9-9.10]
I20260709 13:11:27.384507 30097 raft_consensus.cc:1275] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:27.397961   996 consensus_queue.cc:1243] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer 5ec73dc157ed476ca903a7d596271719 log is divergent from this leader: its last log entry 7.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:11:27.398139 29994 leader_election.cc:304] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:27.398658 30703 leader_election.cc:304] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:11:27.399202  1097 raft_consensus.cc:2804] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:27.399598  1097 raft_consensus.cc:493] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:27.399901 30703 leader_election.cc:304] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:11:27.400094  1177 raft_consensus.cc:2804] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:27.400503  1177 raft_consensus.cc:493] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:27.400695  1151 raft_consensus.cc:2804] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:27.399936  1097 raft_consensus.cc:3060] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:27.401424 30703 leader_election.cc:304] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:11:27.402208 30703 leader_election.cc:304] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:11:27.402968  1049 raft_consensus.cc:2804] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:27.403322  1049 raft_consensus.cc:493] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:27.403700  1049 raft_consensus.cc:3060] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:27.406322 30703 leader_election.cc:304] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:11:27.406895 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:27.407596 30728 raft_consensus.cc:2393] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 12: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:11:27.408340 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:27.408862 30736 raft_consensus.cc:2468] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 7.
I20260709 13:11:27.395368 30733 rpcz_store.cc:276] 0709 13:11:24.829149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.931703 (+102554us) service_pool.cc:224] Handling call
0709 13:11:25.174117 (+242414us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:25.174743 (+   626us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:27.394823 (+2220080us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b5400775bd0. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20b98ad 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:11:27.394958 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":556701056}
I20260709 13:11:27.411772 30020 raft_consensus.cc:1275] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:27.418051 30737 raft_consensus.cc:2468] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 8.
I20260709 13:11:27.423841 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:27.428378 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:27.429857 30703 leader_election.cc:304] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:11:27.431067 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:27.431209 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:27.431849 30737 raft_consensus.cc:2468] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 11.
I20260709 13:11:27.432049 29993 leader_election.cc:304] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:27.409687   840 raft_consensus.cc:2804] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:27.409595  1151 raft_consensus.cc:493] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:27.438438 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:27.439396 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:27.451378 30735 raft_consensus.cc:2468] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 7.
I20260709 13:11:27.439983 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:27.440052 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:27.441526 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:27.444307 30734 raft_consensus.cc:1275] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:27.447690 30095 raft_consensus.cc:2468] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 12.
I20260709 13:11:27.412530  1178 raft_consensus.cc:2804] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:27.386848  1032 raft_consensus.cc:2804] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:27.412853  1177 raft_consensus.cc:3060] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:27.450711 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:27.455029 29994 leader_election.cc:304] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:27.460834 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:27.434425   996 raft_consensus.cc:2764] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 13:11:27.434676  1099 raft_consensus.cc:2804] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:27.448179  1121 raft_consensus.cc:2804] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:27.463620  1121 raft_consensus.cc:493] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:27.463990  1121 raft_consensus.cc:3060] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:27.465821 30758 debug-util.cc:398] Leaking SignalData structure 0x7b080024e880 after lost signal to thread 28889
W20260709 13:11:27.466224 30758 debug-util.cc:398] Leaking SignalData structure 0x7b080024e8c0 after lost signal to thread 28892
I20260709 13:11:27.430181  1105 consensus_queue.cc:1048] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 13:11:27.431926  1057 consensus_queue.cc:1048] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 13:11:27.452150  1151 raft_consensus.cc:3060] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:27.457741   840 raft_consensus.cc:697] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:27.469862   840 consensus_queue.cc:237] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:27.419836   997 consensus_queue.cc:1048] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.033s
I20260709 13:11:27.461300  1159 raft_consensus.cc:2804] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:27.473145  1159 raft_consensus.cc:697] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:27.473968  1159 consensus_queue.cc:237] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:27.473718  1099 raft_consensus.cc:697] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:27.476131  1099 consensus_queue.cc:237] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:27.478271 30737 raft_consensus.cc:1275] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:27.481989   997 consensus_queue.cc:1048] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:27.458420  1178 raft_consensus.cc:493] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:27.485260  1178 raft_consensus.cc:3060] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:27.460456  1032 raft_consensus.cc:697] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:27.487550  1113 raft_consensus.cc:3055] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:27.487948  1113 raft_consensus.cc:740] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:27.487866  1032 consensus_queue.cc:237] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:27.488852  1113 consensus_queue.cc:260] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:27.491098 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:27.491632 30096 raft_consensus.cc:3060] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:27.467125 30758 debug-util.cc:398] Leaking SignalData structure 0x7b08000e6060 after lost signal to thread 29960
I20260709 13:11:27.508028 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:27.508711 30103 raft_consensus.cc:2393] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 10: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
W20260709 13:11:27.509387 30758 debug-util.cc:398] Leaking SignalData structure 0x7b0800299ce0 after lost signal to thread 30052
W20260709 13:11:27.510248 30758 debug-util.cc:398] Leaking SignalData structure 0x7b080036f220 after lost signal to thread 30127
W20260709 13:11:27.510468 30758 debug-util.cc:398] Leaking SignalData structure 0x7b08000cd920 after lost signal to thread 30128
W20260709 13:11:27.510669 30758 debug-util.cc:398] Leaking SignalData structure 0x7b08002dec20 after lost signal to thread 30141
W20260709 13:11:27.511104 30758 debug-util.cc:398] Leaking SignalData structure 0x7b080016aba0 after lost signal to thread 30170
W20260709 13:11:27.511324 30758 debug-util.cc:398] Leaking SignalData structure 0x7b08003e1f80 after lost signal to thread 30173
W20260709 13:11:27.511821 30758 debug-util.cc:398] Leaking SignalData structure 0x7b080015b580 after lost signal to thread 30201
W20260709 13:11:27.512027 30758 debug-util.cc:398] Leaking SignalData structure 0x7b08003cc1a0 after lost signal to thread 30202
W20260709 13:11:27.514927 30758 debug-util.cc:398] Leaking SignalData structure 0x7b08003a5780 after lost signal to thread 30761
W20260709 13:11:27.515147 30758 debug-util.cc:398] Leaking SignalData structure 0x7b0800369bc0 after lost signal to thread 30762
W20260709 13:11:27.515374 30758 debug-util.cc:398] Leaking SignalData structure 0x7b08001f4300 after lost signal to thread 389
W20260709 13:11:27.515588 30758 debug-util.cc:398] Leaking SignalData structure 0x7b08003a07a0 after lost signal to thread 622
I20260709 13:11:27.519870  1077 consensus_queue.cc:1243] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer 5ec73dc157ed476ca903a7d596271719 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:11:27.520864 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 146232us
W20260709 13:11:27.523116 30068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:27.524364 30068 connection.cc:256] RPC call timeout handler was delayed by -1.2241268739999214s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1906s for a response
I20260709 13:11:27.524441  1035 raft_consensus.cc:493] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:27.525911  1035 raft_consensus.cc:515] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:27.526562 30068 leader_election.cc:304] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:27.527989  1104 raft_consensus.cc:493] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:27.528541  1144 raft_consensus.cc:2804] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:27.528451  1104 raft_consensus.cc:515] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:27.528949  1144 raft_consensus.cc:493] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:27.529326  1144 raft_consensus.cc:3060] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:27.530140 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:27.530504  1104 leader_election.cc:290] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:27.532717 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:27.534446  1035 leader_election.cc:290] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:11:27.523151 30700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.536216  1055 raft_consensus.cc:493] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.536664  1055 raft_consensus.cc:515] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:27.537937 30068 leader_election.cc:304] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:27.538712  1055 leader_election.cc:290] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:27.539281  1105 raft_consensus.cc:2749] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:27.540131 30068 leader_election.cc:304] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:27.541448  1105 raft_consensus.cc:2804] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:27.541908  1105 raft_consensus.cc:493] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:27.542265  1105 raft_consensus.cc:3060] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:27.544714 30068 leader_election.cc:304] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:11:27.545439  1035 raft_consensus.cc:2804] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:27.545535 30068 leader_election.cc:304] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:11:27.546007  1035 raft_consensus.cc:493] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:27.546352  1104 raft_consensus.cc:2804] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:27.546430  1035 raft_consensus.cc:3060] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:27.546792  1104 raft_consensus.cc:493] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:27.547201  1104 raft_consensus.cc:3060] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:27.549091 30703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.549873  1144 raft_consensus.cc:515] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:27.552597 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:27.554922 30021 raft_consensus.cc:2393] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 6: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:11:27.561058 30096 raft_consensus.cc:2468] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 10.
I20260709 13:11:27.563376 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:27.564044 30096 raft_consensus.cc:2468] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 6.
I20260709 13:11:27.564792 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:27.565275 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:27.565433 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:27.566596 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:27.568621 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:27.563630 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:27.571800 30100 raft_consensus.cc:2393] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 10: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:27.563898 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:27.570010 30703 leader_election.cc:304] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:11:27.571019 30729 raft_consensus.cc:3055] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:27.572969 30729 raft_consensus.cc:740] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:27.553884  1113 raft_consensus.cc:3060] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:27.575956 30103 raft_consensus.cc:2393] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 5: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:27.553480   997 raft_consensus.cc:493] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.580260 30703 leader_election.cc:304] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:11:27.573679 30729 consensus_queue.cc:260] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:27.591150 30729 raft_consensus.cc:3060] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:27.590550 30703 leader_election.cc:304] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:11:27.606881 30729 raft_consensus.cc:1275] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:11:27.607328 30729 pending_rounds.cc:85] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a: Aborting all ops after (but not including) 8
I20260709 13:11:27.607596 30729 pending_rounds.cc:107] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:11:27.607873 30729 raft_consensus.cc:2889] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:27.609066  1144 leader_election.cc:290] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:27.597227  1055 raft_consensus.cc:2804] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:27.556953  1057 consensus_queue.cc:1048] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:11:27.589818  1193 raft_consensus.cc:2804] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:27.601387  1077 raft_consensus.cc:2804] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:27.629634   389 raft_consensus.cc:2804] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:27.630113   389 raft_consensus.cc:493] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:27.630487   389 raft_consensus.cc:3060] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:27.632824 29925 catalog_manager.cc:5697] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 3 to 5, leader changed from 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) to 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68). New cstate: current_term: 5 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:27.634552 29925 catalog_manager.cc:5697] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } }
I20260709 13:11:27.636963   809 raft_consensus.cc:493] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:27.637466   809 raft_consensus.cc:515] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:27.641372 29925 catalog_manager.cc:5697] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:27.628643  1077 raft_consensus.cc:493] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:27.646508  1077 raft_consensus.cc:3060] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:27.617257  1055 raft_consensus.cc:493] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
W20260709 13:11:27.630064  1188 log.cc:927] Time spent T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 13:11:27.627960  1193 raft_consensus.cc:493] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:27.597409   997 raft_consensus.cc:515] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:27.681710 29925 catalog_manager.cc:5697] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 5 to 7, leader changed from 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 7 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:27.620291  1164 consensus_queue.cc:1048] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
W20260709 13:11:27.695508  1195 log.cc:927] Time spent T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:11:27.656383  1055 raft_consensus.cc:3060] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:27.684206   997 leader_election.cc:290] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:27.715114 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:27.719092 29925 catalog_manager.cc:5697] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 6 to 8, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68). New cstate: current_term: 8 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:27.685694  1193 raft_consensus.cc:3060] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:27.721026 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:27.726361 30098 raft_consensus.cc:2393] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 5: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
W20260709 13:11:27.750003 29922 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51818 (request call id 322) took 30882 ms (client timeout 15000 ms). Trace:
W20260709 13:11:27.750533 30758 debug-util.cc:398] Leaking SignalData structure 0x7b0800081340 after lost signal to thread 823
W20260709 13:11:27.754277 30758 debug-util.cc:398] Leaking SignalData structure 0x7b08003db320 after lost signal to thread 877
I20260709 13:11:27.760727 29925 catalog_manager.cc:5697] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 4 to 5, leader changed from 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 5 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } }
I20260709 13:11:27.762303 30176 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43840 (request call id 1940) took 2856 ms. Trace:
I20260709 13:11:27.762504 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:27.768467 30026 raft_consensus.cc:1275] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:27.685351   996 consensus_queue.cc:1059] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 13:11:27.769656 30100 raft_consensus.cc:2468] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 11.
I20260709 13:11:27.762816 30176 rpcz_store.cc:276] 0709 13:11:24.869791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:25.115113 (+245322us) service_pool.cc:224] Handling call
0709 13:11:25.115392 (+   279us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:25.115587 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 13:11:25.216720 (+101133us) log.cc:844] Serialized 14 byte log entry
0709 13:11:27.725825 (+2509105us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:27.725879 (+    54us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:27.725942 (+    63us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:27.726007 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:27.726114 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2292002,"prepare.queue_time_us":62103,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"thread_start_us":276373,"threads_started":2}
I20260709 13:11:27.777161 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:27.777848 30729 raft_consensus.cc:2468] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 11.
I20260709 13:11:27.778580 30174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54540 (request call id 770) took 2910 ms. Trace:
I20260709 13:11:27.774796 29994 leader_election.cc:304] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
W20260709 13:11:27.784025 30067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.786821   996 raft_consensus.cc:3055] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:27.780856   997 raft_consensus.cc:493] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.787505   997 raft_consensus.cc:515] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:27.778976 30174 rpcz_store.cc:276] 0709 13:11:24.867702 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:25.104378 (+236676us) service_pool.cc:224] Handling call
0709 13:11:25.117131 (+ 12753us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:27.402096 (+2284965us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:27.402123 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:27.402677 (+   554us) log.cc:844] Serialized 26 byte log entry
0709 13:11:27.508324 (+105647us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:27.508359 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:27.508421 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:27.778390 (+269969us) raft_consensus.cc:1685] finished
0709 13:11:27.778409 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:27.778526 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2272473,"thread_start_us":105224,"threads_started":1,"wal-append.queue_time_us":151500}
I20260709 13:11:27.758477  1049 raft_consensus.cc:515] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:27.793042   389 raft_consensus.cc:515] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:27.798133   389 leader_election.cc:290] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:27.799739   809 leader_election.cc:290] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:27.800417 30728 raft_consensus.cc:2393] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 10: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:11:27.801967  1056 raft_consensus.cc:3055] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:27.802389  1056 raft_consensus.cc:740] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:27.803278  1056 consensus_queue.cc:260] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:27.804416  1056 raft_consensus.cc:3060] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:27.805403  1077 raft_consensus.cc:515] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:27.806903  1117 consensus_queue.cc:1048] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:27.807544  1077 leader_election.cc:290] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:27.771867  1097 raft_consensus.cc:515] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:27.810026 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:27.810823 29925 catalog_manager.cc:5697] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 7 to 9, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 9 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:27.798085  1049 leader_election.cc:290] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:27.814098 29925 catalog_manager.cc:5697] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:27.815753 29925 catalog_manager.cc:5697] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 2 to 7, leader changed from 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 7 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:27.811533  1097 leader_election.cc:290] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:27.816510  1121 raft_consensus.cc:515] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:27.817901 30733 raft_consensus.cc:2468] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 8.
I20260709 13:11:27.818858  1055 raft_consensus.cc:515] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:27.822866  1121 leader_election.cc:290] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:27.750447 29922 rpcz_store.cc:269] 0709 13:10:56.737714 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:10:56.807508 (+ 69794us) service_pool.cc:224] Handling call
0709 13:11:27.616634 (+30809126us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:20.376716 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:20.457218 (+ 80502us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:20.458731 (+  1513us) write_op.cc:435] Acquired schema lock
0709 13:11:20.458748 (+    17us) tablet.cc:662] Decoding operations
0709 13:11:20.483451 (+ 24703us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:20.483503 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:20.483534 (+    31us) tablet.cc:685] Acquiring locks for 10 operations
0709 13:11:20.484233 (+   699us) tablet.cc:701] Row locks acquired
0709 13:11:20.484247 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:11:20.484399 (+   152us) write_op.cc:270] Start()
0709 13:11:20.484528 (+   129us) write_op.cc:276] Timestamp: P: 1783602680484338 usec, L: 0
0709 13:11:20.484549 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 13:11:20.485116 (+   567us) log.cc:844] Serialized 3965 byte log entry
0709 13:11:22.348190 (+1863074us) op_driver.cc:464] REPLICATION: finished
0709 13:11:22.709817 (+361627us) write_op.cc:301] APPLY: starting
0709 13:11:22.713961 (+  4144us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:22.759902 (+ 45941us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:22.794868 (+ 34966us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:22.821623 (+ 26755us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:22.821866 (+   243us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 13:11:22.821908 (+    42us) write_op.cc:312] APPLY: finished
0709 13:11:22.822172 (+   264us) log.cc:844] Serialized 77 byte log entry
0709 13:11:22.822333 (+   161us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:22.822447 (+   114us) write_op.cc:454] Released schema lock
0709 13:11:22.822491 (+    44us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:22.822859 (+   368us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:22.822885 (+    26us) write_op.cc:454] Released schema lock
0709 13:11:23.129126 (+306241us) spinlock_profiling.cc:243] Waited 2.7 ms on lock 0x7b54001a4354. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20b732a 00007f99f203cf14 00007f99f203cec3 00007f99f203ce38 00007f99f203cdf3 00007f99f203c0dc 00007f99f2065e16 00007f99f204dcbb 00007f99f203839d 00007f99f203bd75
Metrics: {"mutex_wait_us":784237,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":313102,"apply.run_cpu_time_us":3362,"apply.run_wall_time_us":127846,"num_ops":10,"prepare.queue_time_us":228906,"prepare.run_cpu_time_us":27542,"prepare.run_wall_time_us":518526,"raft.queue_time_us":901263,"raft.run_cpu_time_us":12775,"raft.run_wall_time_us":808541,"replication_time_us":1848094,"spinlock_wait_cycles":6203520,"thread_start_us":1361632,"threads_started":4,"wal-append.queue_time_us":428025,"wal-append.run_cpu_time_us":57721,"wal-append.run_wall_time_us":2911341}]]}
I20260709 13:11:27.824721 30729 raft_consensus.cc:1240] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:27.826396 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:27.827023 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:27.827798 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:27.821506  1055 leader_election.cc:290] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:27.838164 30700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.830029 29925 catalog_manager.cc:5697] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 4 to 5, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 5 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:27.842039 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:27.718043  1104 raft_consensus.cc:515] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:27.862246 30170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43838 (request call id 2257) took 3013 ms. Trace:
I20260709 13:11:27.794680  1098 raft_consensus.cc:2804] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:27.791673   996 raft_consensus.cc:740] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:27.863334 29925 catalog_manager.cc:5697] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 2 to 10. New cstate: current_term: 10 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } }
I20260709 13:11:27.873397 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:27.817464  1105 raft_consensus.cc:515] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:27.875531 30097 raft_consensus.cc:2393] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 8: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:27.875819 30100 raft_consensus.cc:2468] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 8.
I20260709 13:11:27.862718 30170 rpcz_store.cc:276] 0709 13:11:24.849008 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:24.869291 (+ 20283us) service_pool.cc:224] Handling call
0709 13:11:24.880298 (+ 11007us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:24.931146 (+ 50848us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:11:25.009459 (+ 78313us) log.cc:844] Serialized 14 byte log entry
0709 13:11:25.108616 (+ 99157us) log.cc:844] Serialized 14 byte log entry
0709 13:11:25.108846 (+   230us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:25.109335 (+   489us) log.cc:844] Serialized 26 byte log entry
0709 13:11:25.109466 (+   131us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:25.109622 (+   156us) log.cc:844] Serialized 14 byte log entry
0709 13:11:26.329770 (+1220148us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b180039eb60. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f7e95de1 00007f99f7ea25b1 00007f99eef47c0a 00007f99f8687219 00007f99f5f8e58f 00007f99eefcd571 00007f99eefcf7c1 00007f99eefcf779 00007f99eefcf709 00007f99eefcf6d1 00007f99eefce9cd
0709 13:11:27.843910 (+1514140us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:27.855251 (+ 11341us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:27.862042 (+  6791us) raft_consensus.cc:1685] finished
0709 13:11:27.862056 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:27.862182 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3743058,"prepare.queue_time_us":336229,"prepare.run_cpu_time_us":120,"prepare.run_wall_time_us":8983,"raft.queue_time_us":59053,"raft.run_cpu_time_us":398,"raft.run_wall_time_us":37592,"spinlock_wait_cycles":25908992,"thread_start_us":390398,"threads_started":3,"wal-append.queue_time_us":168510,"wal-append.run_cpu_time_us":2454,"wal-append.run_wall_time_us":1013558}
I20260709 13:11:27.878646 30703 leader_election.cc:304] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:11:27.865242  1098 raft_consensus.cc:493] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:27.888399  1098 raft_consensus.cc:3060] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:27.889518  1026 raft_consensus.cc:493] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:27.890077  1026 raft_consensus.cc:515] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:27.892563  1026 leader_election.cc:290] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:27.893038  1026 raft_consensus.cc:493] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.895247   622 raft_consensus.cc:493] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:27.895758   622 raft_consensus.cc:515] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:27.846709  1178 raft_consensus.cc:515] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:27.900141   823 raft_consensus.cc:493] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.901445   877 raft_consensus.cc:493] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.901676 30103 raft_consensus.cc:1240] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:27.906874 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:27.903823   622 leader_election.cc:290] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:27.909300 30737 raft_consensus.cc:2393] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 8: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:11:27.855046  1032 consensus_queue.cc:1059] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
W20260709 13:11:27.909531 30142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 955964us
W20260709 13:11:27.919306 30700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:27.917285 30143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.919497 29925 catalog_manager.cc:5697] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 3 to 6, leader changed from 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 6 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:27.920853 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:27.921039 29925 catalog_manager.cc:5697] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 4 to 7, leader changed from c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 7 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } }
I20260709 13:11:27.921988 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:27.922688 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:27.893424  1026 raft_consensus.cc:515] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:27.928126 29925 catalog_manager.cc:5697] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 4 to 7, leader changed from 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 7 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:27.904327  1055 raft_consensus.cc:2804] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:27.901479  1105 leader_election.cc:290] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:11:27.931290  1197 log.cc:927] Time spent T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 13:11:27.929409 30143 leader_election.cc:304] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:27.936465 30098 raft_consensus.cc:1240] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 7 LEADER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:27.936245 29925 catalog_manager.cc:5697] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 2 to 7, leader changed from 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 7 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:11:27.939054 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 95476.8us
I20260709 13:11:27.943416 30021 raft_consensus.cc:1275] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:27.944077 30027 raft_consensus.cc:1275] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:27.951341 29925 catalog_manager.cc:5697] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 2 to 6, leader changed from 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) to 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68). New cstate: current_term: 6 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:27.933135  1083 raft_consensus.cc:493] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.953877 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:27.914316   877 raft_consensus.cc:515] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:27.914498   823 raft_consensus.cc:515] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:27.958314 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:27.963420 30174 raft_consensus.cc:3060] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:27.946895   809 raft_consensus.cc:493] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:27.960968 29925 catalog_manager.cc:5697] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:27.960636 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:27.941109  1055 raft_consensus.cc:697] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:27.960546 30098 raft_consensus.cc:1275] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:27.987846 29994 leader_election.cc:304] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:27.987974 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:27.988582 30170 raft_consensus.cc:3060] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:27.990156 29925 catalog_manager.cc:5697] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } }
I20260709 13:11:27.991469 29925 catalog_manager.cc:5697] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 2 to 7, leader changed from 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 7 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:27.992321 30068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:27.965070   967 raft_consensus.cc:3060] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:27.933914   996 consensus_queue.cc:260] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:27.995594 30142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 76390.2us
I20260709 13:11:28.001542 30027 raft_consensus.cc:1240] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:28.000375 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:27.995247   809 raft_consensus.cc:515] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:28.004197 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 74865.8us
I20260709 13:11:28.005172 30143 leader_election.cc:304] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:28.005295 30172 raft_consensus.cc:2468] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 10.
I20260709 13:11:28.006029 30143 leader_election.cc:304] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
W20260709 13:11:28.003757 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 69387.5us
I20260709 13:11:28.007758   389 consensus_queue.cc:1048] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:28.008630 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:28.019497 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:28.008211 30140 leader_election.cc:304] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:27.983682  1201 raft_consensus.cc:493] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:28.029659 30026 raft_consensus.cc:1240] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 8. Current term is 9. Ops: []
W20260709 13:11:27.993595  1177 consensus_meta.cc:287] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent flushing consensus metadata: real 0.531s	user 0.005s	sys 0.005s
I20260709 13:11:28.009104 30142 leader_election.cc:304] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:28.017933 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:28.027549 30728 raft_consensus.cc:1275] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 13:11:28.037632 30728 pending_rounds.cc:85] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a: Aborting all ops after (but not including) 6
I20260709 13:11:28.037941 30728 pending_rounds.cc:107] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 13:11:28.038173 30728 raft_consensus.cc:2889] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:28.040906 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:28.041560 30023 raft_consensus.cc:3060] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:28.048647 30170 raft_consensus.cc:2468] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 11.
I20260709 13:11:28.040261 30066 leader_election.cc:304] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:27.990509  1199 raft_consensus.cc:493] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:28.054821 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:27.993237  1035 raft_consensus.cc:515] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:28.053706 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:28.056716 30172 raft_consensus.cc:3060] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:27.982038  1083 raft_consensus.cc:515] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:27.990279  1049 consensus_queue.cc:1048] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:11:28.029417  1107 raft_consensus.cc:2804] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:28.010175  1208 raft_consensus.cc:493] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:28.059643 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:28.058302 29925 catalog_manager.cc:5697] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } }
I20260709 13:11:28.076529 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:28.060933 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:28.077504 30728 raft_consensus.cc:2393] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 8: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:11:28.061318   910 raft_consensus.cc:2749] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:28.039695   787 consensus_queue.cc:1048] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:11:28.053145   898 consensus_queue.cc:1048] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.013s
W20260709 13:11:28.066279  1203 log.cc:927] Time spent T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:11:28.061436  1026 leader_election.cc:290] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:28.067973 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:28.068288 30023 raft_consensus.cc:2468] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 12.
I20260709 13:11:28.068440   809 leader_election.cc:290] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:28.035668   492 raft_consensus.cc:2804] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:28.073696 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:28.073810 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:28.040094  1021 raft_consensus.cc:2804] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:28.078184 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:28.075289  1107 raft_consensus.cc:493] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.051820  1177 raft_consensus.cc:515] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:28.083868 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 75747.2us
I20260709 13:11:28.111996 30140 leader_election.cc:304] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:11:28.084311 30142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 75269.4us
I20260709 13:11:28.086004 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:28.067395   823 leader_election.cc:290] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:28.088701 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:28.090044 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:28.091043 30173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54540 (request call id 771) took 3137 ms. Trace:
I20260709 13:11:28.077306 29925 catalog_manager.cc:5697] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:28.092494 30028 raft_consensus.cc:2468] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 10.
I20260709 13:11:28.092634 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:28.070421  1104 leader_election.cc:290] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:28.093349 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:28.114735 30019 raft_consensus.cc:2468] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 12.
I20260709 13:11:28.115577 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:28.094039 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:28.074903   878 raft_consensus.cc:2804] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:28.113828 30173 rpcz_store.cc:276] 0709 13:11:24.953496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:25.143135 (+189639us) service_pool.cc:224] Handling call
0709 13:11:25.143521 (+   386us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:27.775644 (+2632123us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:27.775709 (+    65us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:27.793618 (+ 17909us) log.cc:844] Serialized 26 byte log entry
0709 13:11:28.084438 (+290820us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:28.090748 (+  6310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:28.090817 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:28.090861 (+    44us) raft_consensus.cc:1685] finished
0709 13:11:28.090873 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:28.090985 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2469525,"raft.queue_time_us":2757471,"raft.run_cpu_time_us":48,"raft.run_wall_time_us":48,"thread_start_us":345010,"threads_started":2,"wal-append.queue_time_us":226937}
I20260709 13:11:28.080305 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
W20260709 13:11:28.098325  1151 consensus_meta.cc:287] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent flushing consensus metadata: real 0.631s	user 0.008s	sys 0.002s
I20260709 13:11:28.099831   492 raft_consensus.cc:697] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 10 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:28.100080 30700 leader_election.cc:304] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:28.101643  1134 raft_consensus.cc:2749] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:28.102030  1107 raft_consensus.cc:3060] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:28.094599  1021 raft_consensus.cc:493] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.088002   943 consensus_queue.cc:1048] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260709 13:11:28.106344   877 leader_election.cc:290] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:28.107651  1035 leader_election.cc:290] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 12 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:28.079130  1055 consensus_queue.cc:237] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:28.123054 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:28.123214 30142 leader_election.cc:304] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:28.128701 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:28.040616  1201 raft_consensus.cc:515] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:28.131335 30140 leader_election.cc:304] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:28.131336 30700 leader_election.cc:304] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:11:28.132078 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 92258.6us
I20260709 13:11:28.132483 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:28.138502 30024 raft_consensus.cc:2368] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 8. Current term is 9.
I20260709 13:11:28.144186 30730 raft_consensus.cc:2468] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 9.
I20260709 13:11:28.137883 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:28.138016 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:28.133982 29925 catalog_manager.cc:5697] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:28.154841 30174 raft_consensus.cc:2468] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 8.
W20260709 13:11:28.155243 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 136673us
I20260709 13:11:28.161044 30140 leader_election.cc:304] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:28.155179 30172 raft_consensus.cc:2468] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 12.
I20260709 13:11:28.135231 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:28.152848 30020 raft_consensus.cc:2468] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 7.
I20260709 13:11:28.159235 30142 leader_election.cc:304] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
W20260709 13:11:28.138185  1216 log.cc:927] Time spent T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 13:11:28.163223 30022 raft_consensus.cc:2376] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 12. Re-sending same reply.
W20260709 13:11:28.164129 30067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.156653  1021 raft_consensus.cc:3060] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:28.175173 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:28.175770 30174 raft_consensus.cc:3060] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:28.167641 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:28.168624 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:28.162318 30700 leader_election.cc:304] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:28.168366 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:28.179545 30737 raft_consensus.cc:3060] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:28.167974 30020 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
mode: GRACEFUL
new_leader_uuid: "c99569d27a6f4c648eae7119fe3db124"
 from {username='slave'} at 127.0.0.1:47450
I20260709 13:11:28.181178 30020 raft_consensus.cc:606] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 LEADER]: Received request to transfer leadership to TS c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:28.181438 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:28.182144 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:28.182622 30096 raft_consensus.cc:2468] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 6.
W20260709 13:11:28.186339  1210 log.cc:927] Time spent T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.300s	user 0.000s	sys 0.003s
I20260709 13:11:28.187940  1201 leader_election.cc:290] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:28.134431   840 raft_consensus.cc:2749] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:28.134068  1178 leader_election.cc:290] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:28.192232 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:28.145252  1177 leader_election.cc:290] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:28.072757  1199 raft_consensus.cc:515] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:28.191788 30700 leader_election.cc:304] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:28.213977 30700 leader_election.cc:304] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:28.214881 30700 leader_election.cc:304] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:28.193517 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:28.215890 30095 raft_consensus.cc:2410] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:11:28.218209 30174 raft_consensus.cc:2468] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 11.
W20260709 13:11:28.193297   928 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:11:28.194265 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:28.148487  1193 raft_consensus.cc:515] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:28.195132   934 raft_consensus.cc:2749] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:28.195873   492 consensus_queue.cc:237] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:28.230446 30169 raft_consensus.cc:2468] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 10.
I20260709 13:11:28.123795  1208 raft_consensus.cc:515] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:28.190867  1099 consensus_queue.cc:1059] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:11:28.189953  1211 raft_consensus.cc:493] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.203548 30170 raft_consensus.cc:1275] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:11:28.140048  1083 leader_election.cc:290] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:28.237154  1083 raft_consensus.cc:493] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:28.237601  1083 raft_consensus.cc:515] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:28.239455  1083 leader_election.cc:290] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:28.239876  1083 raft_consensus.cc:493] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.240264  1083 raft_consensus.cc:515] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:28.241003  1199 leader_election.cc:290] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:28.212239  1221 raft_consensus.cc:2749] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:28.171981   877 raft_consensus.cc:2749] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:28.243440 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
W20260709 13:11:28.245054 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 84059.2us
I20260709 13:11:28.245537 30095 raft_consensus.cc:2393] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 9: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:11:28.133479  1151 raft_consensus.cc:515] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:28.162140   809 raft_consensus.cc:3060] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:28.206573   823 consensus_queue.cc:1059] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:28.207091 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:28.208101  1220 raft_consensus.cc:2749] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:28.208774 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:28.209419 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:28.140465   878 raft_consensus.cc:697] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 9 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:28.163234   622 raft_consensus.cc:2764] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:11:28.220177 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:28.220261 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:28.170825  1121 raft_consensus.cc:2749] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:28.263643 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:28.264712 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:28.265201 30175 raft_consensus.cc:2376] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 11. Re-sending same reply.
I20260709 13:11:28.266410 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:28.266381   878 consensus_queue.cc:237] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:28.142658  1098 raft_consensus.cc:515] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:28.221462 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:28.201381  1107 raft_consensus.cc:515] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:28.234689 30732 raft_consensus.cc:2368] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for earlier term 5. Current term is 6.
I20260709 13:11:28.221838   840 raft_consensus.cc:2804] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:28.235119 30737 raft_consensus.cc:2468] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 8.
I20260709 13:11:28.219458  1201 raft_consensus.cc:493] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.236598 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:28.151783   997 leader_election.cc:290] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:28.193961 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:28.227543  1178 raft_consensus.cc:2804] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:28.176673   980 raft_consensus.cc:2804] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:28.243649 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:28.246357 30140 leader_election.cc:304] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:28.243994 30700 leader_election.cc:304] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:28.287559 30700 leader_election.cc:304] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:28.226485  1049 raft_consensus.cc:2749] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:28.289831  1107 leader_election.cc:290] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 12 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:28.282059   840 raft_consensus.cc:493] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.290795   840 raft_consensus.cc:3060] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:28.292276  1178 raft_consensus.cc:493] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Starting leader election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:28.292724  1178 raft_consensus.cc:3060] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:28.293833   980 raft_consensus.cc:493] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.294234   980 raft_consensus.cc:3060] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:28.243872 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:28.289031 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:28.297106 30170 raft_consensus.cc:2393] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 12: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:11:28.297366 30026 raft_consensus.cc:2368] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 11. Current term is 12.
I20260709 13:11:28.253614 30728 raft_consensus.cc:2393] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 8: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:11:28.257334 30019 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
mode: GRACEFUL
new_leader_uuid: "c99569d27a6f4c648eae7119fe3db124"
 from {username='slave'} at 127.0.0.1:47450
I20260709 13:11:28.298288 30019 raft_consensus.cc:606] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 LEADER]: Received request to transfer leadership to TS c99569d27a6f4c648eae7119fe3db124
W20260709 13:11:28.300100 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 53821.6us
I20260709 13:11:28.300879 30140 leader_election.cc:304] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:28.257452 30171 raft_consensus.cc:2468] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 6.
I20260709 13:11:28.260669   823 consensus_queue.cc:1243] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer 5ec73dc157ed476ca903a7d596271719 log is divergent from this leader: its last log entry 7.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 13:11:28.261019  1208 leader_election.cc:290] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:28.258950 30173 raft_consensus.cc:2468] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 11.
I20260709 13:11:28.272328 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:28.309648 30175 raft_consensus.cc:2376] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 11. Re-sending same reply.
I20260709 13:11:28.273623 30174 raft_consensus.cc:2376] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 8. Re-sending same reply.
I20260709 13:11:28.274507 30736 raft_consensus.cc:2393] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 8: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:11:28.297484 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:28.311074 30098 raft_consensus.cc:2393] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 12: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:11:28.307058 30700 leader_election.cc:304] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:28.274062   877 raft_consensus.cc:493] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:28.314738 30700 leader_election.cc:304] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:28.322036 30140 leader_election.cc:304] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:28.307984   934 raft_consensus.cc:2749] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:28.311931  1107 raft_consensus.cc:2749] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:28.310956  1049 raft_consensus.cc:2749] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:28.310469  1083 leader_election.cc:290] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:28.316390  1121 raft_consensus.cc:2749] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:28.321686   823 raft_consensus.cc:2749] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:28.341187 30140 leader_election.cc:304] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:28.339057 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:28.242933  1211 raft_consensus.cc:515] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:28.343330 30140 leader_election.cc:304] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:28.296244  1201 raft_consensus.cc:515] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:28.347100 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:28.344558  1107 raft_consensus.cc:2749] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:28.355850 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:28.357472 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:28.358048 30020 raft_consensus.cc:3060] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:28.340221  1177 raft_consensus.cc:2764] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
W20260709 13:11:28.359261 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 44620.8us
I20260709 13:11:28.361701 30700 leader_election.cc:304] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:28.360303 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:28.322866   877 raft_consensus.cc:515] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:28.363898 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:28.348650  1220 raft_consensus.cc:2804] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:28.365875  1220 raft_consensus.cc:493] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.366273  1220 raft_consensus.cc:3060] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:28.370911  1201 leader_election.cc:290] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:28.371444 30028 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
mode: GRACEFUL
new_leader_uuid: "5ec73dc157ed476ca903a7d596271719"
 from {username='slave'} at 127.0.0.1:47450
I20260709 13:11:28.371954 30028 raft_consensus.cc:606] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Received request to transfer leadership to TS 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:28.372232 30028 raft_consensus.cc:614] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:28.362118 30177 raft_consensus.cc:2468] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 11.
I20260709 13:11:28.376279 30020 raft_consensus.cc:2468] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 8.
I20260709 13:11:28.377332 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:28.378304 30020 raft_consensus.cc:1240] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:28.380810 30142 leader_election.cc:304] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:28.377085   934 raft_consensus.cc:493] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.393501   877 leader_election.cc:290] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:28.394495 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:28.394995 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:28.354981  1232 consensus_queue.cc:1048] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:11:28.377003  1049 raft_consensus.cc:2804] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:28.402372 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:28.405779 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:28.412688 30025 raft_consensus.cc:2468] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 10.
I20260709 13:11:28.413501 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:28.407688  1211 leader_election.cc:290] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:28.408047  1151 leader_election.cc:290] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:28.408257   980 raft_consensus.cc:515] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:28.411490 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:28.408912 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:28.409093 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:28.409818  1056 raft_consensus.cc:493] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:28.410213  1225 log.cc:927] Time spent T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 13:11:28.426487 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:28.428596 30025 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
mode: GRACEFUL
new_leader_uuid: "c99569d27a6f4c648eae7119fe3db124"
 from {username='slave'} at 127.0.0.1:47450
I20260709 13:11:28.432653 30020 raft_consensus.cc:2393] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 8: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:11:28.434437 30025 raft_consensus.cc:606] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Received request to transfer leadership to TS c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:28.434821 30025 raft_consensus.cc:614] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:28.429410  1049 raft_consensus.cc:697] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:28.402127  1193 leader_election.cc:290] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:28.402736   934 raft_consensus.cc:515] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:28.445062 30737 raft_consensus.cc:1240] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:28.446008 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:28.432998  1098 leader_election.cc:290] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 12 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:28.472213  1178 raft_consensus.cc:515] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:28.472635   809 raft_consensus.cc:2749] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:11:28.473450  1139 raft_consensus.cc:3055] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:28.473846  1139 raft_consensus.cc:740] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:28.457614 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:28.474329   840 raft_consensus.cc:515] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:28.474824  1049 consensus_queue.cc:237] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:28.475898 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:28.476449   840 leader_election.cc:290] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 12 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:28.477113 30729 raft_consensus.cc:2393] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 12: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:11:28.436200  1056 raft_consensus.cc:515] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:28.478395 30730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56954 (request call id 711) took 1038 ms. Trace:
I20260709 13:11:28.478751 30730 rpcz_store.cc:276] 0709 13:11:27.439668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.439769 (+   101us) service_pool.cc:224] Handling call
0709 13:11:28.478237 (+1038468us) spinlock_profiling.cc:243] Waited 688 ms on lock 0x7b540028fd54. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:11:28.478340 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1582512896}
I20260709 13:11:28.479955  1056 leader_election.cc:290] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:11:28.450845  1209 log.cc:927] Time spent T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.520s	user 0.001s	sys 0.004s
I20260709 13:11:28.454144 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:28.482080 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:28.482383 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:28.482558 30728 raft_consensus.cc:1275] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:11:28.482926 30103 raft_consensus.cc:3060] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:11:28.483290 30171 raft_consensus.cc:2468] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 5.
I20260709 13:11:28.484001 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:28.484423 30728 raft_consensus.cc:1275] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:11:28.454771   934 leader_election.cc:290] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:28.486052 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:28.486620 30096 raft_consensus.cc:3060] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:28.489430 30176 raft_consensus.cc:2468] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 8.
I20260709 13:11:28.490260 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:28.455096   980 leader_election.cc:290] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:28.459163 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:28.490736 30176 raft_consensus.cc:2376] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 11. Re-sending same reply.
I20260709 13:11:28.491050 30025 raft_consensus.cc:2468] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 9.
I20260709 13:11:28.459807 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:28.491499 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:28.462697 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:28.492543 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:28.444250 28889 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:11:28.494014 30700 leader_election.cc:304] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:28.494474 28889 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:28.491313 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:28.495276 30022 raft_consensus.cc:3060] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Advancing to term 12
I20260709 13:11:28.495411 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:28.496480 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:28.497099 30173 raft_consensus.cc:2393] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 8: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:11:28.481937 30735 raft_consensus.cc:1275] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260709 13:11:28.499571 29993 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.467406 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:28.503311 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:28.492621 30169 raft_consensus.cc:2376] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 12. Re-sending same reply.
I20260709 13:11:28.504818 30176 raft_consensus.cc:3060] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:28.504889 30173 raft_consensus.cc:2468] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 10.
I20260709 13:11:28.484650 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:28.501004 30068 leader_election.cc:304] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:11:28.479962 30730 raft_consensus.cc:1240] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:28.477006 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:28.505550 30171 raft_consensus.cc:2468] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 6.
I20260709 13:11:28.503439 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:28.506196 30025 raft_consensus.cc:2468] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 12.
I20260709 13:11:28.497058 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:28.496832 30103 raft_consensus.cc:2468] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 8.
I20260709 13:11:28.499756 30095 raft_consensus.cc:2368] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 9. Current term is 10.
I20260709 13:11:28.504868 30098 raft_consensus.cc:2393] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 8: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:28.501247 30096 raft_consensus.cc:2468] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 6.
I20260709 13:11:28.506338 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:28.566826 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:28.694746 30100 raft_consensus.cc:1275] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:11:28.677704 30097 raft_consensus.cc:1275] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:28.603266 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:11:28.690042 30703 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.681131 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
W20260709 13:11:28.530457 30700 leader_election.cc:336] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Timed out: RequestConsensusVote RPC to 127.28.54.65:34451 timed out after 1.668s (SENT)
I20260709 13:11:28.550984 30022 raft_consensus.cc:2468] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 12.
W20260709 13:11:28.605856 30067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.695005 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:28.697063 30100 raft_consensus.cc:1240] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:28.698514 30099 raft_consensus.cc:3060] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:28.701362 30176 raft_consensus.cc:2468] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 8.
I20260709 13:11:28.699245 30737 raft_consensus.cc:2468] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 7.
I20260709 13:11:28.710558 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:28.698792 30700 leader_election.cc:304] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:11:28.698367 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 197587us
I20260709 13:11:28.714910 30732 raft_consensus.cc:3060] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:28.714367 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:28.715471 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:28.716042 30173 raft_consensus.cc:2468] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 5.
I20260709 13:11:28.716185 30068 leader_election.cc:400] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Vote denied by peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469) with higher term. Message: Invalid argument: T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for earlier term 5. Current term is 6.
I20260709 13:11:28.716631 30068 leader_election.cc:403] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 13:11:28.717063 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:28.717329 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:28.494815   934 raft_consensus.cc:2804] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:28.718998 30731 raft_consensus.cc:2468] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 9.
I20260709 13:11:28.719144 30101 raft_consensus.cc:1275] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:11:28.719632 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:28.720304 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:28.720722 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:28.721452 30171 raft_consensus.cc:2393] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 8: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
W20260709 13:11:28.716110 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 185688us
I20260709 13:11:28.721834 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:28.722332 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:28.722982 30176 raft_consensus.cc:2393] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 12: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:11:28.722939 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:28.723531 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:28.723709 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:28.724104 30022 raft_consensus.cc:3060] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:28.724864 30700 leader_election.cc:304] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:28.725596 30176 raft_consensus.cc:2393] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 8: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:11:28.727470 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:28.728271 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:28.728363 30169 raft_consensus.cc:2468] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 7.
I20260709 13:11:28.728996 30171 raft_consensus.cc:3060] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:28.680823  1220 raft_consensus.cc:515] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:28.732640  1220 leader_election.cc:290] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451)
I20260709 13:11:28.720789 30173 raft_consensus.cc:2468] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 9.
I20260709 13:11:28.734462 30732 raft_consensus.cc:2468] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 12.
I20260709 13:11:28.719615   934 raft_consensus.cc:493] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:28.733520 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:28.733343 30022 raft_consensus.cc:2468] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 13.
I20260709 13:11:28.734740 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:28.737041 30700 leader_election.cc:304] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:28.735246   934 raft_consensus.cc:3060] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:28.737342 30173 raft_consensus.cc:2468] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 11.
I20260709 13:11:28.738369 30174 raft_consensus.cc:3060] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:28.739530 30173 raft_consensus.cc:1275] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:11:28.739717  1055 raft_consensus.cc:2804] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:28.740269  1055 raft_consensus.cc:697] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 13 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:28.741057  1055 consensus_queue.cc:237] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:28.743854 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:28.747917 30101 raft_consensus.cc:1275] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:28.750007 30169 raft_consensus.cc:1240] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 6. Current term is 8. Ops: []
I20260709 13:11:28.752456   934 raft_consensus.cc:515] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:28.756665   934 leader_election.cc:290] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:28.756707 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:28.782552 30169 raft_consensus.cc:3055] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:28.782616 30022 raft_consensus.cc:3060] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:28.783118 30169 raft_consensus.cc:740] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:28.764424 30174 raft_consensus.cc:1275] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:28.790905 30022 raft_consensus.cc:2468] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 10.
I20260709 13:11:28.792230 30173 raft_consensus.cc:3060] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:28.792704 30177 raft_consensus.cc:1240] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:28.759358 30099 raft_consensus.cc:2468] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 12.
I20260709 13:11:28.682509  1021 raft_consensus.cc:515] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:28.783828 30169 consensus_queue.cc:260] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:28.795360 30736 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:56954 (request call id 703) took 1381 ms (client timeout 1502 ms). Trace:
I20260709 13:11:28.795953 30169 raft_consensus.cc:3060] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Advancing to term 12
W20260709 13:11:28.795718 30736 rpcz_store.cc:269] 0709 13:11:27.413988 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:27.414086 (+    98us) service_pool.cc:224] Handling call
0709 13:11:28.795186 (+1381100us) spinlock_profiling.cc:243] Waited 842 ms on lock 0x7b54005334d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:11:28.795310 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1937613696}
I20260709 13:11:28.797271 30733 raft_consensus.cc:1240] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:28.797469 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:28.798296 30168 raft_consensus.cc:2393] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 7: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:11:28.726316 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:28.784088  1099 raft_consensus.cc:493] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.701910  1104 raft_consensus.cc:2764] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 13:11:28.800112 30173 raft_consensus.cc:1275] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:11:28.749907   840 raft_consensus.cc:2749] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:28.802099 30177 raft_consensus.cc:1275] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:11:28.801164 30700 leader_election.cc:304] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:28.794754 30170 raft_consensus.cc:3055] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:28.806818 30170 raft_consensus.cc:740] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:28.718943   900 raft_consensus.cc:2749] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469) with higher term. Message: Invalid argument: T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for earlier term 5. Current term is 6.
I20260709 13:11:28.810858   934 raft_consensus.cc:2804] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:28.816103 30169 raft_consensus.cc:1275] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:11:28.796206  1021 leader_election.cc:290] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:28.789242   996 raft_consensus.cc:3060] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:28.812968 30170 consensus_queue.cc:260] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:28.756910  1049 raft_consensus.cc:2804] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:28.681013  1139 consensus_queue.cc:260] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:28.826799 30170 raft_consensus.cc:3060] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:28.810273  1178 leader_election.cc:290] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 13 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:28.829917 30171 raft_consensus.cc:2468] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 9.
I20260709 13:11:28.830873 30174 raft_consensus.cc:1275] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:28.820518   934 raft_consensus.cc:697] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:28.809922  1099 raft_consensus.cc:515] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:28.870055  1139 raft_consensus.cc:3060] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:28.857928  1104 raft_consensus.cc:493] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:28.864961  1049 raft_consensus.cc:697] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:28.887589 30170 raft_consensus.cc:1275] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
W20260709 13:11:28.890174 30702 leader_election.cc:336] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Timed out: RequestConsensusVote RPC to 127.28.54.67:45001 timed out after 1.837s (SENT)
I20260709 13:11:28.894181  1049 consensus_queue.cc:237] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:28.895303  1238 log.cc:927] Time spent T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.488s	user 0.003s	sys 0.000s
I20260709 13:11:28.887470  1104 raft_consensus.cc:515] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:28.899274  1077 raft_consensus.cc:493] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:28.906124  1246 log.cc:927] Time spent T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260709 13:11:28.907262 30700 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.909080  1099 leader_election.cc:290] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:11:28.924853 29992 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:28.939210 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:28.939836 30733 raft_consensus.cc:3060] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:28.943493  1104 leader_election.cc:290] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:28.955072 30733 raft_consensus.cc:2468] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 12.
I20260709 13:11:28.958847 30026 raft_consensus.cc:1240] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:28.960913   934 consensus_queue.cc:237] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:28.907209  1077 raft_consensus.cc:515] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:28.964016  1077 leader_election.cc:290] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:28.967360 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:28.967967 30099 raft_consensus.cc:2468] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 10.
I20260709 13:11:28.974339  1229 raft_consensus.cc:3055] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:28.974776  1229 raft_consensus.cc:740] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:28.975553  1229 consensus_queue.cc:260] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:28.976488  1229 raft_consensus.cc:3060] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:28.978514 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 11 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:28.981192  1083 raft_consensus.cc:2804] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:28.982334  1026 raft_consensus.cc:493] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:28.982847  1026 raft_consensus.cc:515] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:28.984711  1026 leader_election.cc:290] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:28.986007 30142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 605223us
I20260709 13:11:28.986677 30142 leader_election.cc:304] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:28.990839  1199 raft_consensus.cc:2749] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:28.991456  1199 raft_consensus.cc:2804] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:28.991705 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:28.991866  1199 raft_consensus.cc:697] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 8 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:28.992763   948 consensus_queue.cc:1048] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:28.992949   809 consensus_queue.cc:1059] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:28.993959   809 consensus_queue.cc:1059] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:28.981600  1083 raft_consensus.cc:493] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:28.995095  1083 raft_consensus.cc:3060] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:28.996169  1221 raft_consensus.cc:3055] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:28.996527  1221 raft_consensus.cc:740] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:28.996770 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:28.997529 30731 raft_consensus.cc:2393] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 12: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:11:28.997255  1221 consensus_queue.cc:260] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:28.998605  1221 raft_consensus.cc:3060] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:28.998873  1211 consensus_queue.cc:1048] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:29.000032 29994 leader_election.cc:304] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:29.000551  1211 consensus_queue.cc:1048] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:29.000857   948 raft_consensus.cc:2804] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:29.001117  1211 consensus_queue.cc:1243] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer 5ec73dc157ed476ca903a7d596271719 log is divergent from this leader: its last log entry 9.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 13:11:29.002147 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:29.002862 30737 raft_consensus.cc:2393] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 8: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:11:29.007752 30731 raft_consensus.cc:1240] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 13 LEADER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:29.008939 30702 leader_election.cc:304] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:29.012697 30026 raft_consensus.cc:1275] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:11:29.019346 30702 leader_election.cc:304] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:29.004958 30143 leader_election.cc:304] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
W20260709 13:11:29.027905 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 95275.9us
W20260709 13:11:29.029538 30068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.036181 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:29.059355 30168 raft_consensus.cc:2393] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 10: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:11:29.037971 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:29.038880 30173 raft_consensus.cc:1240] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:11:29.060168 30177 raft_consensus.cc:2468] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 9.
I20260709 13:11:29.039479 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:29.040367 30170 raft_consensus.cc:1240] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:29.040941 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:29.061065 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:29.041615 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:29.044103 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:29.060094 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:29.044828 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:28.995050   809 raft_consensus.cc:3055] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:29.050087 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:29.030722  1077 consensus_queue.cc:1048] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:29.068800 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:29.069837 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:11:29.058060 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 92116.1us
I20260709 13:11:29.060546 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:29.071899 30099 raft_consensus.cc:3060] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:29.028306   840 raft_consensus.cc:2749] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 13:11:29.079069 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 74194.4us
I20260709 13:11:29.079854 30143 leader_election.cc:304] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:29.001068 29994 leader_election.cc:304] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:29.063095 30703 leader_election.cc:400] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 election: Vote denied by peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821) with higher term. Message: Invalid argument: T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 9. Current term is 10.
I20260709 13:11:29.064893 30094 raft_consensus.cc:2393] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 10: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:29.064870 30174 raft_consensus.cc:2393] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 8: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:11:29.064491   809 raft_consensus.cc:740] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:29.030144   996 consensus_queue.cc:1059] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
W20260709 13:11:29.049070 29992 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.082450 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:29.071437 30066 leader_election.cc:304] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:29.078779 30068 leader_election.cc:304] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
W20260709 13:11:29.062918 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 43645.5us
W20260709 13:11:29.083403 30067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.083119 30168 raft_consensus.cc:2393] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 10: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
W20260709 13:11:29.081115 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 80106.6us
I20260709 13:11:29.084930 30702 leader_election.cc:304] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:29.032325   948 raft_consensus.cc:697] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:29.079160 30175 raft_consensus.cc:2410] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:11:29.081058 30703 leader_election.cc:403] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:11:29.086802 30143 leader_election.cc:304] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:29.087486 30099 raft_consensus.cc:2468] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 7.
I20260709 13:11:29.070684  1177 raft_consensus.cc:2804] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:29.093995 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:29.094203 30143 leader_election.cc:304] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:29.095768 30703 leader_election.cc:304] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:11:29.093710   809 consensus_queue.cc:260] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:29.096830  1114 raft_consensus.cc:2804] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:29.100634 30731 raft_consensus.cc:1240] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 LEADER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:29.101226 30143 leader_election.cc:304] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:28.992795  1199 consensus_queue.cc:237] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:29.122514 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:29.126094 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:29.086437   959 raft_consensus.cc:2804] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:29.117070 30737 raft_consensus.cc:3060] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:29.123246 30703 leader_election.cc:304] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:11:29.131915 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:29.133451 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:29.097962   878 raft_consensus.cc:2749] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:29.097895  1208 raft_consensus.cc:2749] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:29.127878 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:29.095181  1177 raft_consensus.cc:493] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:29.128046  1229 consensus_queue.cc:1059] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:29.118649  1114 raft_consensus.cc:697] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 12 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:29.097517  1256 raft_consensus.cc:493] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:29.098076   853 raft_consensus.cc:2804] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:29.089223   934 raft_consensus.cc:2749] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:29.117210  1202 consensus_queue.cc:1059] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 13:11:29.098299 30101 pending_rounds.cc:85] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719: Aborting all ops after (but not including) 7
W20260709 13:11:29.134392 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 438683us
I20260709 13:11:29.178246 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:29.191929 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:29.205619 30173 raft_consensus.cc:2468] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 5.
I20260709 13:11:29.167233 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:29.189244 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:29.134797 30022 raft_consensus.cc:1240] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 13 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 13:11:29.171092 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:29.169292 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:29.209028 30177 raft_consensus.cc:3060] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:29.164979 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:29.137044 30143 leader_election.cc:304] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:29.142561 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "de39104c229542e3a29860956492edea" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:29.134913 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:29.220211 30024 raft_consensus.cc:3060] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:29.203917 30101 pending_rounds.cc:107] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260709 13:11:29.225124 30101 raft_consensus.cc:2889] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:29.095340   622 raft_consensus.cc:2804] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:29.221521 30174 raft_consensus.cc:2468] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 5.
I20260709 13:11:29.259461 30737 raft_consensus.cc:1275] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:11:29.138634 30140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:29.242209 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 105224us
I20260709 13:11:29.293953 30140 leader_election.cc:304] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:29.295258 30140 leader_election.cc:304] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:29.260529 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:29.296972 30169 raft_consensus.cc:2468] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 12.
I20260709 13:11:29.297885 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:11:29.259155 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 122417us
I20260709 13:11:29.096895  1026 raft_consensus.cc:2749] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:11:29.171725  1254 log.cc:927] Time spent T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.116s	user 0.001s	sys 0.001s
I20260709 13:11:29.318447 30140 leader_election.cc:304] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:29.320930 30140 leader_election.cc:304] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:29.135509  1178 raft_consensus.cc:2804] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:11:29.316746 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 46588.1us
I20260709 13:11:29.237419   853 raft_consensus.cc:493] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:29.308652 30024 raft_consensus.cc:2468] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 7.
I20260709 13:11:29.164686   928 raft_consensus.cc:2804] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:29.161968  1232 raft_consensus.cc:2749] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:29.208477  1177 raft_consensus.cc:3060] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:29.306931  1229 consensus_queue.cc:1243] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer 6f3eb161e2194f6891f12e2cfcaaf73a log is divergent from this leader: its last log entry 12.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 13:11:29.130600   959 raft_consensus.cc:493] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:29.240783   622 raft_consensus.cc:493] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:29.380815   622 raft_consensus.cc:3060] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:29.343299 29993 leader_election.cc:304] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:29.342208  1107 raft_consensus.cc:2749] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:29.386068 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:29.386683 30170 raft_consensus.cc:2468] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 8.
I20260709 13:11:29.386906   840 raft_consensus.cc:3055] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:29.387300   840 raft_consensus.cc:740] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:29.387533   959 raft_consensus.cc:3060] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:11:29.370052 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 206602us
I20260709 13:11:29.370474 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:29.301011  1202 consensus_queue.cc:1243] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer 6f3eb161e2194f6891f12e2cfcaaf73a log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
W20260709 13:11:29.371193 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 50338.8us
I20260709 13:11:29.301163  1201 raft_consensus.cc:2749] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:29.391700 30173 raft_consensus.cc:2393] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 8: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:11:29.392554 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:29.344583   853 raft_consensus.cc:3060] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:29.393590 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:29.394771   928 raft_consensus.cc:697] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:29.395167 30173 raft_consensus.cc:3060] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:29.395982  1251 log.cc:927] Time spent T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.341s	user 0.003s	sys 0.008s
I20260709 13:11:29.396944  1222 raft_consensus.cc:3055] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:29.397332  1222 raft_consensus.cc:740] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:29.164994  1077 consensus_queue.cc:1048] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.209s
I20260709 13:11:29.398360  1099 raft_consensus.cc:2749] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:29.240902  1256 raft_consensus.cc:515] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:29.338500   877 raft_consensus.cc:2749] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:29.309652   492 raft_consensus.cc:2749] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:29.369876  1178 raft_consensus.cc:697] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:29.241437  1049 consensus_queue.cc:1048] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.139s
I20260709 13:11:29.399968  1114 consensus_queue.cc:237] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:29.402730 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:29.409605 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:29.376612 30177 raft_consensus.cc:2468] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 12.
I20260709 13:11:29.306077   996 raft_consensus.cc:2749] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821) with higher term. Message: Invalid argument: T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 9. Current term is 10.
I20260709 13:11:29.403659 30140 leader_election.cc:304] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:29.405002 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:29.415596 30170 raft_consensus.cc:2368] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for earlier term 6. Current term is 7.
I20260709 13:11:29.416339 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "978900c67750481aba3e58987ac43180" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:29.416435 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:29.127718   948 consensus_queue.cc:237] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:29.417297 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:29.412016 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:29.424768 30140 leader_election.cc:304] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:29.419548 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:29.425203 30177 raft_consensus.cc:2393] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 9: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:11:29.426059 30140 leader_election.cc:304] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:29.427201 30140 leader_election.cc:304] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:29.430042 30023 raft_consensus.cc:1275] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 13 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:11:29.424803 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:29.432379 30170 raft_consensus.cc:2368] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for earlier term 6. Current term is 7.
I20260709 13:11:29.433162 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:29.433874 30170 raft_consensus.cc:2393] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 8: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:11:29.434507 30175 raft_consensus.cc:2393] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 8: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:11:29.434924 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:29.404760  1256 leader_election.cc:290] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:29.435707 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:29.435815 30174 raft_consensus.cc:2410] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 13:11:29.436950 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:29.437265 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:29.437747 30177 raft_consensus.cc:2468] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 12.
I20260709 13:11:29.438773 30140 leader_election.cc:304] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:29.440819 30143 leader_election.cc:304] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:29.442032   898 raft_consensus.cc:493] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.442508   898 raft_consensus.cc:515] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:29.443011 30177 raft_consensus.cc:1275] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:11:29.445583 30728 raft_consensus.cc:1240] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 LEADER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:29.444548 30177 raft_consensus.cc:1275] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 13:11:29.446518 30177 pending_rounds.cc:85] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124: Aborting all ops after (but not including) 4
I20260709 13:11:29.446744 30177 pending_rounds.cc:107] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124: Aborting uncommitted NO_OP operation due to leader change: 6.5
I20260709 13:11:29.446965 30177 raft_consensus.cc:2889] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:29.414623  1026 raft_consensus.cc:2764] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:11:29.449335 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "632c5405056e40be8152973f0c966318" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:29.451233 30095 raft_consensus.cc:1275] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:11:29.451123 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:29.453034 30100 raft_consensus.cc:2468] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 9.
I20260709 13:11:29.452973 30173 raft_consensus.cc:2468] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 6.
I20260709 13:11:29.401671   959 raft_consensus.cc:515] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:29.462042 30703 leader_election.cc:304] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:11:29.468191 30068 leader_election.cc:304] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:29.469441 30023 raft_consensus.cc:1275] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:11:29.469993 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:29.473599 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:29.440138   980 raft_consensus.cc:2749] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 13:11:29.449723   492 raft_consensus.cc:2749] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:29.449925   877 raft_consensus.cc:2749] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:29.486011 30068 leader_election.cc:304] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:29.486677 30028 raft_consensus.cc:2368] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 10. Current term is 11.
I20260709 13:11:29.459187  1256 raft_consensus.cc:2749] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:29.476327  1229 raft_consensus.cc:2804] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:29.471788  1202 raft_consensus.cc:493] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
W20260709 13:11:29.495246 30067 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.495729 30068 leader_election.cc:304] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:29.496459 30177 raft_consensus.cc:3055] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:29.496824 30177 raft_consensus.cc:740] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:29.497536 30177 consensus_queue.cc:260] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:29.498868 30177 raft_consensus.cc:3060] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:29.471995  1208 raft_consensus.cc:2749] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:29.466642  1201 consensus_queue.cc:1048] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 13:11:29.510591 30177 raft_consensus.cc:1275] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 13:11:29.511158 29992 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.510720 30068 leader_election.cc:304] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:29.437418  1222 consensus_queue.cc:260] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:29.487923  1259 raft_consensus.cc:3060] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:29.489617  1117 raft_consensus.cc:493] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:29.439587   840 consensus_queue.cc:260] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:29.514393  1200 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260709 13:11:29.509866  1057 raft_consensus.cc:493] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:29.484664  1077 consensus_queue.cc:1048] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.023s
W20260709 13:11:29.539608  1221 consensus_meta.cc:287] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124: Time spent flushing consensus metadata: real 0.541s	user 0.005s	sys 0.004s
I20260709 13:11:29.540482 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:29.541921 30176 raft_consensus.cc:2468] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 8.
I20260709 13:11:29.544520  1215 raft_consensus.cc:993] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4: : Instructing follower c99569d27a6f4c648eae7119fe3db124 to start an election
I20260709 13:11:29.544991  1215 raft_consensus.cc:1081] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 LEADER]: Signalling peer c99569d27a6f4c648eae7119fe3db124 to start an election
I20260709 13:11:29.502727  1178 consensus_queue.cc:237] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:29.525506  1104 raft_consensus.cc:2804] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:29.547240  1104 raft_consensus.cc:493] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:29.547621  1104 raft_consensus.cc:3060] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:29.483340   928 consensus_queue.cc:237] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:29.524767 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 181532us
I20260709 13:11:29.528314 30068 leader_election.cc:304] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:29.509665  1229 raft_consensus.cc:697] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 7 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:29.506126   910 raft_consensus.cc:3060] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:29.513522  1144 raft_consensus.cc:2749] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:29.551966 29993 leader_election.cc:304] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
W20260709 13:11:29.528534  1083 consensus_meta.cc:287] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124: Time spent flushing consensus metadata: real 0.533s	user 0.007s	sys 0.003s
I20260709 13:11:29.556668 30068 leader_election.cc:304] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:29.563521 29993 leader_election.cc:304] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:29.513600  1107 consensus_queue.cc:1048] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 13:11:29.508450  1202 raft_consensus.cc:515] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:29.567293 30068 leader_election.cc:304] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:29.528398  1263 raft_consensus.cc:2804] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:29.539000  1262 raft_consensus.cc:493] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.554915   840 raft_consensus.cc:3060] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:29.577097 30068 leader_election.cc:400] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 election: Vote denied by peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001) with higher term. Message: Invalid argument: T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for earlier term 6. Current term is 7.
I20260709 13:11:29.573026  1263 raft_consensus.cc:493] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:29.576021 29993 leader_election.cc:304] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:29.565075  1222 raft_consensus.cc:3060] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:29.570084  1215 raft_consensus.cc:2749] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:29.582552 30702 leader_election.cc:304] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:29.582942 30068 leader_election.cc:403] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 13:11:29.568087   996 raft_consensus.cc:493] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.527977  1117 raft_consensus.cc:515] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:29.567214  1260 raft_consensus.cc:2749] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:29.585561 29993 leader_election.cc:304] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:29.584582 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:29.571321  1035 raft_consensus.cc:2749] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:29.561041   997 consensus_queue.cc:1048] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 13:11:29.578907  1144 raft_consensus.cc:2749] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:29.594496 29993 leader_election.cc:304] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:29.561149   622 raft_consensus.cc:515] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:29.554898  1266 consensus_queue.cc:1048] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 13:11:29.579934   948 raft_consensus.cc:2804] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:29.554744  1057 raft_consensus.cc:515] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:29.584074  1164 raft_consensus.cc:493] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:29.611488  1164 raft_consensus.cc:515] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:29.613394   959 leader_election.cc:290] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 11 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:29.619179   622 leader_election.cc:290] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:29.620786   853 raft_consensus.cc:515] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:29.622225  1258 log.cc:927] Time spent T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:11:29.622970   853 leader_election.cc:290] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 13 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:29.585505  1269 raft_consensus.cc:2749] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:11:29.621551  1264 log.cc:927] Time spent T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 13:11:29.570942  1083 raft_consensus.cc:515] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:29.582580  1263 raft_consensus.cc:3060] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:29.624600 30172 raft_consensus.cc:2393] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 8: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:11:29.624927  1215 raft_consensus.cc:2804] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:29.581187  1262 raft_consensus.cc:515] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:29.625247  1055 raft_consensus.cc:2749] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:29.601049  1099 raft_consensus.cc:2804] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:29.651530  1099 raft_consensus.cc:493] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:29.651957  1099 raft_consensus.cc:3060] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:29.645035  1117 leader_election.cc:290] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:29.655851  1057 leader_election.cc:290] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:29.645432  1177 raft_consensus.cc:515] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:29.659276  1177 leader_election.cc:290] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:29.661048 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:29.612071  1229 consensus_queue.cc:237] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:29.628316   948 raft_consensus.cc:697] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:29.662659  1099 raft_consensus.cc:515] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:29.662803   948 consensus_queue.cc:237] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:29.593094  1178 raft_consensus.cc:493] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
W20260709 13:11:29.668252 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 85763.3us
W20260709 13:11:29.668212 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 91242.3us
I20260709 13:11:29.669480 30702 leader_election.cc:304] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:29.661917  1202 leader_election.cc:290] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:29.672596  1259 raft_consensus.cc:2749] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:29.651602  1262 leader_election.cc:290] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:29.673859 30025 raft_consensus.cc:1217] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Deduplicated request from leader. Original: 10.10->[11.11-11.11]   Dedup: 11.11->[]
I20260709 13:11:29.682066 30068 leader_election.cc:400] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Vote denied by peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001) with higher term. Message: Invalid argument: T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for earlier term 6. Current term is 7.
I20260709 13:11:29.676335 30702 leader_election.cc:304] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:29.611642  1260 raft_consensus.cc:2749] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001) with higher term. Message: Invalid argument: T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for earlier term 6. Current term is 7.
I20260709 13:11:29.601660   996 raft_consensus.cc:515] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:29.682921 30025 raft_consensus.cc:1240] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:11:29.682928 30068 leader_election.cc:403] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:29.684166 30102 raft_consensus.cc:1240] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 12 LEADER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 11. Current term is 12. Ops: []
W20260709 13:11:29.691258  1265 log.cc:927] Time spent T 00000000000000000000000000000000 P 1c91346f9a2a480e908d4e0323634aeb: Append to log took a long time: real 0.204s	user 0.000s	sys 0.004s
I20260709 13:11:29.669263  1215 raft_consensus.cc:697] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
W20260709 13:11:29.698151 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 103702us
I20260709 13:11:29.684132  1178 raft_consensus.cc:515] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:29.682365   840 raft_consensus.cc:2764] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 13:11:29.700780 29993 leader_election.cc:304] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:29.703094 30702 leader_election.cc:304] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:29.703642  1262 raft_consensus.cc:2749] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:29.704867  1260 consensus_queue.cc:1048] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:29.699721 30169 raft_consensus.cc:2468] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 13.
I20260709 13:11:29.705672 30068 leader_election.cc:304] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:29.687587  1114 raft_consensus.cc:2749] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001) with higher term. Message: Invalid argument: T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for earlier term 6. Current term is 7.
I20260709 13:11:29.711880 29993 leader_election.cc:304] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:29.712606 30702 leader_election.cc:304] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:29.715332 30068 leader_election.cc:304] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:29.718957 30728 raft_consensus.cc:2410] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 13:11:29.688099  1104 raft_consensus.cc:515] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:29.726833   996 leader_election.cc:290] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:29.728448  1083 leader_election.cc:290] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:29.717308  1266 raft_consensus.cc:2764] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 13:11:29.710193  1222 raft_consensus.cc:493] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:29.729868  1270 consensus_queue.cc:1048] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:11:29.730247  1222 raft_consensus.cc:515] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:29.724483  1211 raft_consensus.cc:2804] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:29.731977  1211 raft_consensus.cc:493] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:29.713557   948 raft_consensus.cc:2804] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:29.732074 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:29.732610   948 raft_consensus.cc:697] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:29.709659  1099 leader_election.cc:290] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 11 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:29.717479  1057 raft_consensus.cc:2749] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:29.716418  1177 raft_consensus.cc:2749] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:29.728709 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:29.740952 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:29.741320 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:29.740916 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:29.724680  1056 raft_consensus.cc:2749] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:29.733239   997 consensus_queue.cc:1048] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 13:11:29.745914 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:29.736011  1211 raft_consensus.cc:3060] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:29.748667 30175 raft_consensus.cc:3060] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:29.732231  1222 leader_election.cc:290] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:29.731752  1270 consensus_queue.cc:1048] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:11:29.738932   853 raft_consensus.cc:493] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:29.759435 30140 leader_election.cc:304] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:29.760551 30140 leader_election.cc:304] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:29.770830 30140 leader_election.cc:304] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:29.772914 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:29.773329 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:29.773489 30098 raft_consensus.cc:3060] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:11:29.780779 30140 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:29.733644  1283 consensus_queue.cc:1048] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260709 13:11:29.743402   959 consensus_queue.cc:1048] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:11:29.739347  1269 consensus_queue.cc:1048] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 13:11:29.782313  1229 raft_consensus.cc:2749] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:29.784349  1083 raft_consensus.cc:2749] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:11:29.788419  1255 log.cc:927] Time spent T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.733s	user 0.001s	sys 0.002s
I20260709 13:11:29.788524   910 raft_consensus.cc:2749] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:29.789676 30098 raft_consensus.cc:2468] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 11.
W20260709 13:11:29.794533 30142 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:29.809360 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 49989.7us
I20260709 13:11:29.733445   948 consensus_queue.cc:237] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:29.798566   809 raft_consensus.cc:3060] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:29.744735  1284 consensus_queue.cc:1048] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 13:11:29.763665  1222 raft_consensus.cc:2749] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:29.802826  1178 leader_election.cc:290] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:29.823247 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:29.781613   853 raft_consensus.cc:515] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:29.750684  1215 consensus_queue.cc:237] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:29.814852 30737 raft_consensus.cc:1217] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 LEADER]: Deduplicated request from leader. Original: 10.10->[11.11-11.11]   Dedup: 11.11->[]
I20260709 13:11:29.831115 30737 raft_consensus.cc:1240] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 LEADER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 13:11:29.815747 30728 raft_consensus.cc:1240] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:29.820956 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:29.836797  1211 raft_consensus.cc:515] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:29.838555  1104 leader_election.cc:290] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 10 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:29.820868  1049 consensus_queue.cc:1048] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 13:11:29.842319  1211 leader_election.cc:290] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:29.842661   853 leader_election.cc:290] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:29.828346  1083 raft_consensus.cc:493] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:29.845600  1083 raft_consensus.cc:515] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:29.847622  1083 leader_election.cc:290] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:29.841507  1164 leader_election.cc:290] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:29.849673  1263 raft_consensus.cc:515] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:29.855041 30173 raft_consensus.cc:2393] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 8: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:11:29.855475  1263 leader_election.cc:290] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:11:29.862165 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 128838us
I20260709 13:11:29.854275   898 leader_election.cc:290] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:11:29.893622 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 146032us
I20260709 13:11:29.893741 30175 raft_consensus.cc:2468] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 13.
I20260709 13:11:29.894835 30068 leader_election.cc:304] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:29.897917 30703 leader_election.cc:304] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:29.900278 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:29.901363 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:29.901885 30177 raft_consensus.cc:3060] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:29.902563 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:29.903196 30731 raft_consensus.cc:2468] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 12.
I20260709 13:11:29.904748 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:29.905364 30169 raft_consensus.cc:2468] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 6.
I20260709 13:11:29.906378 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:29.907195 30171 raft_consensus.cc:2393] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 8: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:11:29.900334 30173 raft_consensus.cc:1240] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:29.912854 30731 raft_consensus.cc:1240] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 5. Current term is 6. Ops: []
I20260709 13:11:29.913089 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:29.914197 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:29.914717 30171 raft_consensus.cc:2468] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 8.
I20260709 13:11:29.915449 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:29.915901 30171 raft_consensus.cc:3060] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:11:29.921259 30177 raft_consensus.cc:2468] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 10.
I20260709 13:11:29.922551 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:29.922787 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8495d060d6b042a3b7bd9dba1055dbbf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:29.924258 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:29.924520 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:29.924800 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:29.925120 30702 leader_election.cc:304] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:29.925498 30102 raft_consensus.cc:2393] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 8: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:11:29.925086 30099 raft_consensus.cc:3060] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:29.926048 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:29.926606 30169 raft_consensus.cc:2468] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 8.
I20260709 13:11:29.927716 30169 raft_consensus.cc:1275] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:11:29.927618 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:29.928176 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:29.926739 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:29.935052 30099 raft_consensus.cc:2468] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 10.
I20260709 13:11:29.930962 30068 leader_election.cc:304] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:29.943464 30176 raft_consensus.cc:1275] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 13 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:11:29.945042 30702 leader_election.cc:304] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:29.904014  1026 consensus_queue.cc:1059] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 13:11:29.912218  1293 raft_consensus.cc:2749] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:29.956295 30068 leader_election.cc:304] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:29.947938   928 raft_consensus.cc:2749] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:29.964414 30068 leader_election.cc:304] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:29.946353  1104 raft_consensus.cc:493] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:29.924605  1049 raft_consensus.cc:2749] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:29.976009 30028 raft_consensus.cc:1275] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 13:11:29.979393 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 114164us
I20260709 13:11:29.976613 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:29.980159 29993 leader_election.cc:304] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:29.961261  1266 raft_consensus.cc:2804] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:29.940809  1178 consensus_queue.cc:1059] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:11:29.973469 30068 leader_election.cc:304] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:29.969311  1260 raft_consensus.cc:2804] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:29.987903 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:29.911881   492 consensus_queue.cc:1059] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 13:11:29.994274 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:11:29.994805 30702 leader_election.cc:336] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Timed out: RequestConsensusVote RPC to 127.28.54.67:45001 timed out after 1.543s (SENT)
I20260709 13:11:29.994367 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:29.980330   996 consensus_queue.cc:1048] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 13:11:29.999585  1193 raft_consensus.cc:493] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:30.000095  1193 raft_consensus.cc:515] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:30.001827 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:30.003225 30023 raft_consensus.cc:1240] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:30.003846 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:29.989329 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:29.970247  1026 consensus_queue.cc:1243] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer 6f3eb161e2194f6891f12e2cfcaaf73a log is divergent from this leader: its last log entry 10.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 13:11:30.005295 30026 raft_consensus.cc:1275] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:30.006886 30177 raft_consensus.cc:3055] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:29.969664  1105 raft_consensus.cc:2804] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:30.000378   492 raft_consensus.cc:3055] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:30.007215  1270 raft_consensus.cc:2749] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:30.007480   492 raft_consensus.cc:740] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:30.007236 30177 raft_consensus.cc:740] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:29.972337  1261 raft_consensus.cc:493] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:29.974574  1113 raft_consensus.cc:493] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.008981 30177 consensus_queue.cc:260] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:30.022541 30177 raft_consensus.cc:3060] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Advancing to term 10
W20260709 13:11:30.009964 29992 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.012506 30728 raft_consensus.cc:1275] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:11:29.988346  1114 raft_consensus.cc:2804] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:30.014580 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:30.091193 30176 raft_consensus.cc:2468] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 10.
I20260709 13:11:30.092137 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:30.092711 30176 raft_consensus.cc:2468] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 12.
I20260709 13:11:30.017377 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:29.983501  1266 raft_consensus.cc:493] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:29.987053  1077 raft_consensus.cc:493] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:29.985625 30171 raft_consensus.cc:2468] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 10.
I20260709 13:11:30.086658 30177 raft_consensus.cc:1275] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 13:11:30.100504 30177 pending_rounds.cc:85] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124: Aborting all ops after (but not including) 8
I20260709 13:11:30.100756 30177 pending_rounds.cc:107] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 13:11:30.100982 30177 raft_consensus.cc:2889] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:30.106083 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:30.106680 30171 raft_consensus.cc:3060] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:30.087525 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64e2b2bd54d3454a9f64030c149e2e25" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:30.109375 30172 raft_consensus.cc:2368] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 11. Current term is 12.
I20260709 13:11:30.089376 30733 raft_consensus.cc:1240] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:30.008793   943 raft_consensus.cc:2804] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:29.988898 30068 leader_election.cc:304] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:30.112703 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:30.008036  1105 raft_consensus.cc:493] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:29.982036  1104 raft_consensus.cc:515] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:30.128255 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:29.986701  1177 consensus_queue.cc:1048] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.111s
I20260709 13:11:30.129978  1259 raft_consensus.cc:2749] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:30.130434 30020 raft_consensus.cc:1240] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:30.090871  1114 raft_consensus.cc:493] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:30.146333 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:30.018352  1201 consensus_queue.cc:1059] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.119s
I20260709 13:11:30.099714  1200 raft_consensus.cc:493] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:30.089982  1260 raft_consensus.cc:697] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 13 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
W20260709 13:11:30.129381  1265 log.cc:927] Time spent T 00000000000000000000000000000000 P 1c91346f9a2a480e908d4e0323634aeb: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
W20260709 13:11:30.150010 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 161173us
I20260709 13:11:30.099570  1266 raft_consensus.cc:3060] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:30.153306 30171 raft_consensus.cc:2468] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 11.
I20260709 13:11:30.158051 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:30.126631 30177 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752"
dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
 from {username='slave'} at 127.0.0.1:43838
I20260709 13:11:30.162176 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:30.165992 30143 leader_election.cc:304] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:30.168404 30703 leader_election.cc:304] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:30.172742 30177 raft_consensus.cc:493] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:30.090375  1113 raft_consensus.cc:515] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:30.024094  1261 raft_consensus.cc:515] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:30.127250  1105 raft_consensus.cc:3060] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:30.174216 30177 raft_consensus.cc:3060] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:30.181008 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:30.183528 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:30.138505   943 raft_consensus.cc:697] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 10 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:30.150831  1114 raft_consensus.cc:3060] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:30.182811 30068 leader_election.cc:304] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:11:30.208024 30177 raft_consensus.cc:515] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:30.125591  1077 raft_consensus.cc:515] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:30.177659  1201 consensus_queue.cc:1243] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer 5ec73dc157ed476ca903a7d596271719 log is divergent from this leader: its last log entry 12.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 13:11:30.146492  1211 consensus_queue.cc:1048] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 13:11:30.220656 30140 leader_election.cc:400] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 election: Vote denied by peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451) with higher term. Message: Invalid argument: T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 10. Current term is 11.
I20260709 13:11:30.235898 30140 leader_election.cc:403] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 13:11:30.237265 30140 leader_election.cc:304] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:30.239554 30140 leader_election.cc:304] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:30.230024 30177 leader_election.cc:290] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:30.148434  1139 consensus_queue.cc:1048] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 13:11:30.184818  1021 raft_consensus.cc:2749] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:30.232261 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:30.184716  1259 raft_consensus.cc:493] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.255050  1259 raft_consensus.cc:515] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:30.257458  1222 raft_consensus.cc:2749] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451) with higher term. Message: Invalid argument: T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 10. Current term is 11.
I20260709 13:11:30.258405 30099 raft_consensus.cc:1275] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:30.260336  1083 raft_consensus.cc:2749] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:30.261049  1083 raft_consensus.cc:2749] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:30.164870  1200 raft_consensus.cc:515] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:30.253506  1298 log.cc:927] Time spent T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.267s	user 0.000s	sys 0.000s
I20260709 13:11:30.219933   900 raft_consensus.cc:2804] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:30.155377  1297 consensus_queue.cc:1048] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:11:30.308163  1200 leader_election.cc:290] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:30.308588  1261 leader_election.cc:290] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:30.210599   996 raft_consensus.cc:2749] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:30.310156  1113 leader_election.cc:290] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:30.217715  1283 consensus_queue.cc:1059] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.093s
W20260709 13:11:30.311074  1301 log.cc:927] Time spent T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 13:11:30.254277  1300 log.cc:927] Time spent T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 13:11:30.315017 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:30.320360  1077 leader_election.cc:290] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:30.333427 30140 leader_election.cc:304] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:30.316730  1222 raft_consensus.cc:493] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:30.335315 30140 leader_election.cc:304] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:11:30.347790 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 223756us
I20260709 13:11:30.316224   900 raft_consensus.cc:493] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:30.348991 29993 leader_election.cc:304] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:30.349314 30140 leader_election.cc:304] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:30.369429 29994 leader_election.cc:304] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:30.335215  1021 raft_consensus.cc:2749] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:11:30.396633 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 47729.5us
I20260709 13:11:30.369717   900 raft_consensus.cc:3060] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:30.318020  1260 consensus_queue.cc:237] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:30.359793  1200 raft_consensus.cc:2749] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:30.368854  1232 raft_consensus.cc:2749] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:30.368810  1077 raft_consensus.cc:493] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.398080 29993 leader_election.cc:304] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:30.378453  1139 raft_consensus.cc:493] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.443465 30094 raft_consensus.cc:1275] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:11:30.403862   948 raft_consensus.cc:2804] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:30.412907 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:30.413583 30025 raft_consensus.cc:1275] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:30.418411 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:30.397444  1107 raft_consensus.cc:493] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:30.359344  1222 raft_consensus.cc:515] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:30.335681   943 consensus_queue.cc:237] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:30.405647  1295 raft_consensus.cc:2804] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:30.373107  1083 consensus_queue.cc:1048] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260709 13:11:30.450758 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:30.411024  1104 leader_election.cc:290] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:30.457176 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:30.458446 30019 raft_consensus.cc:3055] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 LEADER]: Stepping down as leader of term 9
W20260709 13:11:30.411226 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 191564us
W20260709 13:11:30.447263   809 consensus_meta.cc:287] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124: Time spent flushing consensus metadata: real 0.618s	user 0.009s	sys 0.000s
I20260709 13:11:30.461077 30019 raft_consensus.cc:740] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:30.463835 30066 leader_election.cc:304] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:30.465876 30168 raft_consensus.cc:2468] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 10.
I20260709 13:11:30.455940  1222 leader_election.cc:290] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:30.463156 30019 consensus_queue.cc:260] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:30.473487 30019 raft_consensus.cc:3060] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:11:30.475173  1269 raft_consensus.cc:2764] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
W20260709 13:11:30.476136 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 78119.2us
I20260709 13:11:30.450240  1139 raft_consensus.cc:515] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:30.449893  1077 raft_consensus.cc:515] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:30.502080  1312 raft_consensus.cc:493] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:30.504117  1215 raft_consensus.cc:493] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:30.504550  1261 raft_consensus.cc:493] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:30.505232  1269 consensus_queue.cc:1048] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 13:11:30.464704  1311 consensus_queue.cc:1048] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 13:11:30.470157  1056 raft_consensus.cc:2749] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:30.499531 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:30.457643  1107 raft_consensus.cc:515] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:30.511965 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 343613us
I20260709 13:11:30.472186   948 raft_consensus.cc:697] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:30.468292 30066 leader_election.cc:304] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:30.546351 30019 raft_consensus.cc:2468] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 11.
I20260709 13:11:30.551399 30703 leader_election.cc:304] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:11:30.577445 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:30.578958 30097 raft_consensus.cc:1275] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:30.534593  1317 raft_consensus.cc:493] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:30.583223 30733 raft_consensus.cc:1275] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 13:11:30.550534  1232 raft_consensus.cc:493] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:30.591156 29994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:30.645123 29994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:30.542361  1261 raft_consensus.cc:515] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:30.589437  1276 raft_consensus.cc:2804] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:30.589150   840 raft_consensus.cc:493] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.550158  1312 raft_consensus.cc:515] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:30.673544 30102 raft_consensus.cc:1240] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 10 LEADER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:30.550592  1215 raft_consensus.cc:515] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:30.711041  1215 leader_election.cc:290] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:30.712146  1105 raft_consensus.cc:515] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:30.714090 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:30.715723  1077 leader_election.cc:290] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:30.671803  1325 raft_consensus.cc:493] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:30.716707   948 consensus_queue.cc:237] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:30.717067  1325 raft_consensus.cc:515] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:30.719234  1325 leader_election.cc:290] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:30.603721  1056 raft_consensus.cc:2749] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:11:30.702006  1266 consensus_meta.cc:287] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent flushing consensus metadata: real 0.510s	user 0.007s	sys 0.002s
W20260709 13:11:30.702669  1315 log.cc:927] Time spent T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.222s	user 0.000s	sys 0.000s
I20260709 13:11:30.706856  1276 raft_consensus.cc:697] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:30.708814  1107 leader_election.cc:290] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:30.800773 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:30.589841  1317 raft_consensus.cc:515] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:30.690704  1269 raft_consensus.cc:493] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.820237  1269 raft_consensus.cc:515] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:30.822433  1269 leader_election.cc:290] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:30.824415  1317 leader_election.cc:290] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:30.825137  1105 leader_election.cc:290] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:30.791381   853 raft_consensus.cc:493] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.826174   853 raft_consensus.cc:515] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:30.826472  1276 consensus_queue.cc:237] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:30.828263   853 leader_election.cc:290] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:30.716445  1114 raft_consensus.cc:515] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:30.720345   840 raft_consensus.cc:515] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:30.799225  1266 raft_consensus.cc:515] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:30.816515  1261 leader_election.cc:290] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:30.818091  1312 leader_election.cc:290] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:30.604557  1232 raft_consensus.cc:515] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:30.847106 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 378865us
I20260709 13:11:30.885540 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:30.885767 30066 leader_election.cc:304] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:30.883538 30098 raft_consensus.cc:1240] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:30.885860 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:30.824298  1295 raft_consensus.cc:493] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:30.886595 30019 raft_consensus.cc:2468] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 4.
W20260709 13:11:30.875428  1328 log.cc:927] Time spent T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
W20260709 13:11:30.879492  1321 log.cc:927] Time spent T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 13:11:30.875075  1077 raft_consensus.cc:493] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:30.892215 29993 leader_election.cc:400] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 11 pre-election: Vote denied by peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001) with higher term. Message: Invalid argument: T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 11. Current term is 12.
I20260709 13:11:30.895819 29993 leader_election.cc:403] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:30.898573  1114 leader_election.cc:290] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:30.892185   853 consensus_queue.cc:1059] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 13:11:30.902767   853 raft_consensus.cc:3055] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:30.903110   853 raft_consensus.cc:740] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:30.904049   853 consensus_queue.cc:260] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:30.894452  1105 raft_consensus.cc:2749] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:30.909065   840 leader_election.cc:290] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:30.910168 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:30.911252 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:30.911823 30019 raft_consensus.cc:2468] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 8.
I20260709 13:11:30.804992   900 raft_consensus.cc:515] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:30.918140  1342 raft_consensus.cc:2749] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001) with higher term. Message: Invalid argument: T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 11. Current term is 12.
I20260709 13:11:30.913977 29993 leader_election.cc:304] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:30.916496 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:30.917155 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:30.910768 30099 raft_consensus.cc:2468] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 8.
I20260709 13:11:30.931362  1139 leader_election.cc:290] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:30.932204  1139 raft_consensus.cc:2749] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:30.932435 29993 leader_election.cc:304] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:30.889170  1295 raft_consensus.cc:3060] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:30.934124 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:30.937150 30733 raft_consensus.cc:1240] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:30.941406  1339 raft_consensus.cc:2749] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:30.944281  1326 raft_consensus.cc:493] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:30.944834  1326 raft_consensus.cc:515] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:30.947017  1326 leader_election.cc:290] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:30.947302 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:30.947867 30734 raft_consensus.cc:2468] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 8.
I20260709 13:11:30.952335 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:30.942961 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:30.954000 30728 raft_consensus.cc:2410] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:11:30.955219 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:30.942556 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:30.955790 30027 raft_consensus.cc:2468] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 8.
I20260709 13:11:30.957527 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:30.958191 30176 raft_consensus.cc:2468] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 4.
I20260709 13:11:30.958966 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:30.959481 30176 raft_consensus.cc:2468] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 8.
I20260709 13:11:30.913699  1077 raft_consensus.cc:515] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:30.976248  1293 raft_consensus.cc:3055] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:30.976719  1293 raft_consensus.cc:740] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:30.977531  1293 consensus_queue.cc:260] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:30.978785  1293 raft_consensus.cc:3060] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:30.986063  1320 log.cc:927] Time spent T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.381s	user 0.004s	sys 0.006s
I20260709 13:11:30.986943   840 consensus_queue.cc:1048] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:30.987756   928 raft_consensus.cc:3055] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:30.988190   928 raft_consensus.cc:740] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:30.990103 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:30.990664 30733 raft_consensus.cc:2468] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 8.
I20260709 13:11:30.995918 30703 leader_election.cc:304] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:11:30.996776  1113 consensus_queue.cc:1048] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:30.998001  1107 raft_consensus.cc:493] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:30.998507  1107 raft_consensus.cc:515] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:30.981508  1259 leader_election.cc:290] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:30.999900 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:31.000517  1107 leader_election.cc:290] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:30.998071  1113 raft_consensus.cc:2804] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:31.001191 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:31.001585  1113 raft_consensus.cc:493] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.002089  1113 raft_consensus.cc:3060] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:31.002630 30174 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43840 (request call id 1986) took 1260 ms. Trace:
I20260709 13:11:31.002995 30174 rpcz_store.cc:276] 0709 13:11:29.741906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.742076 (+   170us) service_pool.cc:224] Handling call
0709 13:11:29.891623 (+149547us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:29.896557 (+  4934us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 13:11:29.944084 (+ 47527us) log.cc:844] Serialized 14 byte log entry
0709 13:11:30.203926 (+259842us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:30.204352 (+   426us) log.cc:844] Serialized 26 byte log entry
0709 13:11:30.204586 (+   234us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:30.372145 (+167559us) log.cc:844] Serialized 14 byte log entry
0709 13:11:30.537051 (+164906us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:30.537131 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:30.537166 (+    35us) raft_consensus.cc:1685] finished
0709 13:11:30.537188 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:31.002459 (+465271us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b54000ea1d0. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20b98ad 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:11:31.002571 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":149220,"prepare.queue_time_us":218216,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":69,"raft.queue_time_us":40559,"raft.run_cpu_time_us":341,"raft.run_wall_time_us":38558,"spinlock_wait_cycles":342999808,"thread_start_us":387586,"threads_started":2,"wal-append.queue_time_us":351781}
I20260709 13:11:31.004551 30095 raft_consensus.cc:1275] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:31.005214 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:31.006994 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:31.007189 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:31.007675 30021 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54198 (request call id 2159) took 1006 ms. Trace:
I20260709 13:11:31.007866 30027 raft_consensus.cc:2393] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 11: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:11:31.008718 30021 rpcz_store.cc:276] 0709 13:11:30.001274 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:31.006765 (+1005491us) service_pool.cc:224] Handling call
0709 13:11:31.007622 (+   857us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:11:31.009603 30174 raft_consensus.cc:3060] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:31.012118 30068 leader_election.cc:304] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:11:31.015636 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:31.015450  1259 raft_consensus.cc:493] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:31.017268  1266 leader_election.cc:290] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:31.017078  1259 raft_consensus.cc:515] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:31.021684 30736 raft_consensus.cc:1275] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:31.025818 30732 raft_consensus.cc:1240] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:31.034447 30172 raft_consensus.cc:2468] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 8.
I20260709 13:11:31.035497 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:31.038304 30068 leader_election.cc:304] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:30.989014   928 consensus_queue.cc:260] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:31.052907 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:31.068434 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:31.070374 30734 raft_consensus.cc:1275] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:11:31.070258 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:31.071803 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:31.040768  1105 raft_consensus.cc:2804] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:31.020843   840 consensus_queue.cc:1048] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
W20260709 13:11:31.080133  1304 log.cc:927] Time spent T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.771s	user 0.004s	sys 0.007s
W20260709 13:11:31.080909  1335 log.cc:927] Time spent T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 13:11:31.081259 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:31.085176 30176 raft_consensus.cc:2468] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 6.
I20260709 13:11:31.014744  1222 consensus_queue.cc:1048] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
I20260709 13:11:31.087247 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:31.090981  1232 leader_election.cc:290] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:31.093899  1323 raft_consensus.cc:493] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.094448  1323 raft_consensus.cc:515] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:31.096473  1323 leader_election.cc:290] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:31.101491  1113 raft_consensus.cc:515] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:31.082971  1105 raft_consensus.cc:493] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.102500  1105 raft_consensus.cc:3060] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:31.102953  1259 leader_election.cc:290] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:31.103106 30101 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33992 (request call id 1899) took 1175 ms. Trace:
I20260709 13:11:31.103477 30101 rpcz_store.cc:276] 0709 13:11:29.927578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.927863 (+   285us) service_pool.cc:224] Handling call
0709 13:11:29.928663 (+   800us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:29.943640 (+ 14977us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:29.943668 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:30.469605 (+525937us) spinlock_profiling.cc:243] Waited 2.74 ms on lock 0x7b2c000249e8. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f09b3a11 00007f99f09c3372 00007f99f20f5a01 00007f99f20ba43a 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2
0709 13:11:30.473833 (+  4228us) log.cc:844] Serialized 26 byte log entry
0709 13:11:30.579109 (+105276us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:30.579140 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:30.579210 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:31.102835 (+523625us) raft_consensus.cc:1685] finished
0709 13:11:31.102854 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:31.103048 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1973,"raft.queue_time_us":14824,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":3844,"spinlock_wait_cycles":7409280,"thread_start_us":42914,"threads_started":1,"wal-append.queue_time_us":437365}
I20260709 13:11:31.106446   900 leader_election.cc:290] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 13 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:11:31.110635 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 72420.2us
I20260709 13:11:31.113093 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:31.113327 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:31.113942 30097 raft_consensus.cc:2468] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 8.
I20260709 13:11:31.122973 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:31.113749 30101 raft_consensus.cc:2468] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 8.
I20260709 13:11:31.126610 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:31.127058 30703 leader_election.cc:304] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:11:31.127296 30021 raft_consensus.cc:2393] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 9: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:11:31.128947 30068 leader_election.cc:304] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:31.128271 30703 leader_election.cc:304] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:11:31.058746   996 consensus_queue.cc:1048] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 13:11:31.136737 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:31.137362 30176 raft_consensus.cc:3060] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:31.136411 30174 raft_consensus.cc:2468] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 9.
I20260709 13:11:31.138136 30170 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43838 (request call id 2329) took 1032 ms. Trace:
I20260709 13:11:31.138378 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:31.139856 30170 rpcz_store.cc:276] 0709 13:11:30.105487 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:30.974171 (+868684us) service_pool.cc:224] Handling call
0709 13:11:30.974501 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:30.974847 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:30.974875 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:30.975362 (+   487us) log.cc:844] Serialized 26 byte log entry
0709 13:11:31.137845 (+162483us) raft_consensus.cc:1645] Marking committed up to 11
0709 13:11:31.137881 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:31.137941 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:31.137981 (+    40us) raft_consensus.cc:1685] finished
0709 13:11:31.137992 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:31.138090 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":8494,"raft.run_cpu_time_us":59,"raft.run_wall_time_us":59,"thread_start_us":161971,"threads_started":1,"wal-append.queue_time_us":159498}
I20260709 13:11:31.130266  1317 consensus_queue.cc:1048] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:31.145047 30174 raft_consensus.cc:1240] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 9. Current term is 11. Ops: []
I20260709 13:11:31.136397  1266 raft_consensus.cc:2804] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:31.147698  1266 raft_consensus.cc:493] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.148033  1266 raft_consensus.cc:3060] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:31.138326  1323 raft_consensus.cc:2804] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:31.150931  1323 raft_consensus.cc:493] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.151258  1323 raft_consensus.cc:3060] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:31.130740  1220 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260709 13:11:31.164594 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:31.165086 30170 raft_consensus.cc:2468] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 8.
I20260709 13:11:31.166241 30170 raft_consensus.cc:1240] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:31.169926 30170 raft_consensus.cc:1240] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 13 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:31.171074  1295 raft_consensus.cc:515] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:31.137619   928 raft_consensus.cc:3060] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:31.174523 30140 leader_election.cc:304] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:31.175264 30097 raft_consensus.cc:1240] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 13 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:31.176417 30140 leader_election.cc:304] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:31.177904 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:31.178419 30096 raft_consensus.cc:1240] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 13 LEADER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:31.179301 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:31.180222 30140 leader_election.cc:304] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:31.181000 30140 leader_election.cc:304] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:31.181648 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:31.181869 30140 leader_election.cc:304] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:31.183264 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea42d6bd0dbb4438a96c31b335069e3c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:31.184285 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:31.175275 30068 leader_election.cc:304] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:31.187187 30176 raft_consensus.cc:2468] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 9.
I20260709 13:11:31.187770 30174 raft_consensus.cc:1240] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:31.181635 30097 raft_consensus.cc:1240] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:31.189633 30140 leader_election.cc:304] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:31.195756 30176 raft_consensus.cc:1275] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:31.202386  1113 leader_election.cc:290] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:31.193641   943 raft_consensus.cc:2804] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:31.191363  1083 raft_consensus.cc:2749] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:31.209123 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
W20260709 13:11:31.210630  1340 log.cc:927] Time spent T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.305s	user 0.003s	sys 0.004s
I20260709 13:11:31.214272   997 consensus_queue.cc:1059] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:31.215049   997 consensus_queue.cc:1243] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer 5ec73dc157ed476ca903a7d596271719 log is divergent from this leader: its last log entry 13.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 13:11:31.215526  1336 log.cc:927] Time spent T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.317s	user 0.000s	sys 0.004s
I20260709 13:11:31.216471   997 consensus_queue.cc:1059] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:31.217561  1139 raft_consensus.cc:3055] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:31.217978  1139 raft_consensus.cc:740] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:31.218751  1139 consensus_queue.cc:260] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:31.193507  1326 raft_consensus.cc:2804] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:31.219599  1326 raft_consensus.cc:493] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:31.219781 30169 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43838 (request call id 2323) took 1115 ms. Trace:
I20260709 13:11:31.220170 30169 rpcz_store.cc:276] 0709 13:11:30.104189 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:30.175210 (+ 71021us) service_pool.cc:224] Handling call
0709 13:11:30.175512 (+   302us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:30.176182 (+   670us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 13:11:30.467054 (+290872us) log.cc:844] Serialized 14 byte log entry
0709 13:11:30.845936 (+378882us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:30.876063 (+ 30127us) log.cc:844] Serialized 52 byte log entry
0709 13:11:30.876208 (+   145us) raft_consensus.cc:1645] Marking committed up to 6
0709 13:11:30.876404 (+   196us) log.cc:844] Serialized 14 byte log entry
0709 13:11:30.876724 (+   320us) log.cc:844] Serialized 14 byte log entry
0709 13:11:30.876880 (+   156us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:30.876945 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:30.983010 (+106065us) spinlock_profiling.cc:243] Waited 2.3 ms on lock 0x7b180045a840. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f7e95de1 00007f99f7ea25b1 00007f99eefcd3f3 00007f99eefcf7c1 00007f99eefcf779 00007f99eefcf709 00007f99eefcf6d1 00007f99eefce9cd 000000000038f354 000000000038f199 00007f99eefb083a
0709 13:11:30.996281 (+ 13271us) spinlock_profiling.cc:243] Waited 4.79 ms on lock 0x7b180045a840. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f7e95de1 00007f99f7ea25b1 00007f99eefcd522 00007f99eefcf7c1 00007f99eefcf779 00007f99eefcf709 00007f99eefcf6d1 00007f99eefce9cd 000000000038f354 000000000038f199 00007f99eefb083a
0709 13:11:31.214997 (+218716us) spinlock_profiling.cc:243] Waited 22.9 ms on lock 0x7b4400022b4c. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eeef3c85 00007f99eeef46a2 00007f99f1c661db 00007f99f1c61aaf 00007f99f1c5586e 00007f99f1c54bb6 00007f99f1c547d8 00007f99f1c5e221 00007f99f1c5e1d9 00007f99f1c5e169
0709 13:11:31.219588 (+  4591us) raft_consensus.cc:1685] finished
0709 13:11:31.219607 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:31.219728 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":53278,"prepare.queue_time_us":108763,"prepare.run_cpu_time_us":123,"prepare.run_wall_time_us":3247,"raft.queue_time_us":832,"raft.run_cpu_time_us":425,"raft.run_wall_time_us":20095,"spinlock_wait_cycles":69010816,"thread_start_us":503329,"threads_started":2,"wal-append.queue_time_us":413949}
I20260709 13:11:31.222067 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:31.222988   840 raft_consensus.cc:493] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.223464   840 raft_consensus.cc:515] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:31.223929  1049 raft_consensus.cc:493] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.224402  1049 raft_consensus.cc:515] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:31.192270  1201 raft_consensus.cc:2804] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:31.229704 30169 raft_consensus.cc:1240] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 9. Current term is 10. Ops: []
I20260709 13:11:31.230403 30176 raft_consensus.cc:1275] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 13:11:31.230584 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:31.239315 30100 raft_consensus.cc:2410] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 13:11:31.179520  1220 raft_consensus.cc:2749] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:31.186304  1026 raft_consensus.cc:2749] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:31.248095 30102 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33990 (request call id 2383) took 1016 ms. Trace:
I20260709 13:11:31.217440   997 raft_consensus.cc:3055] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:31.248523 30102 rpcz_store.cc:276] 0709 13:11:30.231309 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:30.233354 (+  2045us) service_pool.cc:224] Handling call
0709 13:11:30.233605 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:30.691892 (+458287us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:31.247875 (+555983us) spinlock_profiling.cc:243] Waited 435 ms on lock 0x7b54001f6b54. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:11:31.248039 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1000214784}
I20260709 13:11:31.253932 30702 leader_election.cc:304] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:31.217186  1105 raft_consensus.cc:515] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:31.191731  1269 raft_consensus.cc:493] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:31.238888  1326 raft_consensus.cc:3060] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:31.186797  1222 consensus_queue.cc:1048] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.061s
I20260709 13:11:31.255918  1327 consensus_queue.cc:1048] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 13:11:31.264184   996 consensus_queue.cc:1048] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260709 13:11:31.266505  1049 leader_election.cc:290] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:31.267650  1077 leader_election.cc:290] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:31.237337  1201 raft_consensus.cc:697] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 11 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:31.269140  1201 consensus_queue.cc:237] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:31.252502   997 raft_consensus.cc:740] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:31.270462   997 consensus_queue.cc:260] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:31.272224  1333 log.cc:927] Time spent T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.371s	user 0.009s	sys 0.005s
I20260709 13:11:31.271517   997 raft_consensus.cc:3060] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:31.241768  1215 raft_consensus.cc:493] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:31.274452  1215 raft_consensus.cc:515] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:31.275410 29993 leader_election.cc:304] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:31.276584  1215 leader_election.cc:290] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:31.247130  1114 raft_consensus.cc:2804] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:31.228381  1270 consensus_queue.cc:1059] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.057s
I20260709 13:11:31.295431 30097 raft_consensus.cc:2393] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 9: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:31.256287   900 raft_consensus.cc:2804] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:31.265450  1083 raft_consensus.cc:2804] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:31.247309  1232 consensus_queue.cc:1059] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:11:31.264418  1113 raft_consensus.cc:2804] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:31.294690  1297 raft_consensus.cc:2749] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:11:31.326097 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 131430us
I20260709 13:11:31.299914   943 raft_consensus.cc:697] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 9 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:31.304117  1342 raft_consensus.cc:3055] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:31.303506  1083 raft_consensus.cc:493] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:31.341271 30066 leader_election.cc:304] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:31.277554  1269 raft_consensus.cc:515] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:31.352288  1342 raft_consensus.cc:740] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:31.298091  1215 consensus_queue.cc:1048] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 13:11:31.362527   943 consensus_queue.cc:237] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:31.356915  1083 raft_consensus.cc:3060] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:31.366567  1105 leader_election.cc:290] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:31.367487   840 leader_election.cc:290] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:31.366477  1342 consensus_queue.cc:260] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:31.374950  1295 leader_election.cc:290] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:31.339438  1113 raft_consensus.cc:697] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
W20260709 13:11:31.358574  1305 log.cc:927] Time spent T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 13:11:31.361274  1293 raft_consensus.cc:2749] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:11:31.390939 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 145699us
W20260709 13:11:31.385028 30142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 155247us
I20260709 13:11:31.393494 30028 raft_consensus.cc:1240] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:31.395569 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:31.396183 30021 raft_consensus.cc:3060] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:31.431872  1269 leader_election.cc:290] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:31.383683  1344 raft_consensus.cc:493] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:31.432720  1344 raft_consensus.cc:515] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:31.434692  1344 leader_election.cc:290] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:31.434846   787 raft_consensus.cc:493] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.409408  1342 raft_consensus.cc:3060] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:31.435322   787 raft_consensus.cc:515] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:31.442265 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 252663us
W20260709 13:11:31.442938 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 51099.2us
I20260709 13:11:31.444312 30140 leader_election.cc:304] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:31.409013   840 consensus_queue.cc:1048] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:11:31.460745  1358 raft_consensus.cc:493] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
W20260709 13:11:31.467368  1351 log.cc:927] Time spent T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 13:11:31.467207  1358 raft_consensus.cc:515] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:31.469681  1355 consensus_queue.cc:1059] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:31.471053  1354 raft_consensus.cc:3055] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:31.471400  1354 raft_consensus.cc:740] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:31.472175  1354 consensus_queue.cc:260] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:31.473415  1354 raft_consensus.cc:3060] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Advancing to term 8
W20260709 13:11:31.474205  1350 log.cc:927] Time spent T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 13:11:31.474370   787 leader_election.cc:290] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:31.477819 30021 raft_consensus.cc:2468] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 9.
W20260709 13:11:31.481310  1352 log.cc:927] Time spent T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.181s	user 0.000s	sys 0.001s
I20260709 13:11:31.485077   492 consensus_queue.cc:260] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:31.486085   492 raft_consensus.cc:3060] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:31.461966  1220 raft_consensus.cc:493] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:31.475018  1026 raft_consensus.cc:2749] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:11:31.496277 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 52030.6us
W20260709 13:11:31.508173 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 231448us
I20260709 13:11:31.463001  1113 consensus_queue.cc:237] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:31.523051 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:31.508076  1297 raft_consensus.cc:493] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:31.496531  1220 raft_consensus.cc:515] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:31.525333 29993 leader_election.cc:304] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:31.508253  1201 raft_consensus.cc:493] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:31.521922  1361 raft_consensus.cc:493] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.556149  1361 raft_consensus.cc:515] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:31.532945  1083 raft_consensus.cc:515] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:31.535068  1201 raft_consensus.cc:515] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:31.561070  1083 leader_election.cc:290] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:31.539371  1220 leader_election.cc:290] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:31.529981  1297 raft_consensus.cc:515] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:31.563239  1361 leader_election.cc:290] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:31.563488  1297 leader_election.cc:290] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:31.541280 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:31.564921 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
W20260709 13:11:31.542547  1322 log.cc:927] Time spent T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.643s	user 0.007s	sys 0.000s
W20260709 13:11:31.549060 29994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:31.566174  1266 raft_consensus.cc:515] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:31.566885 29994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:31.567252 30737 raft_consensus.cc:2368] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for earlier term 9. Current term is 10.
I20260709 13:11:31.568771 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:31.569960  1266 leader_election.cc:290] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:31.572484  1358 leader_election.cc:290] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:31.568691 30168 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54540 (request call id 806) took 2472 ms (client timeout 1543 ms). Trace:
I20260709 13:11:31.572814 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:31.572772 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:11:31.573099 30168 rpcz_store.cc:269] 0709 13:11:29.096508 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.126568 (+ 30060us) service_pool.cc:224] Handling call
0709 13:11:31.568491 (+2441923us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b5400407ed4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:11:31.568584 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2894496128}
I20260709 13:11:31.573849 30169 raft_consensus.cc:2468] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 10.
W20260709 13:11:31.549710  1324 log.cc:927] Time spent T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.833s	user 0.002s	sys 0.012s
I20260709 13:11:31.553356  1232 raft_consensus.cc:493] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
W20260709 13:11:31.555431  1363 log.cc:927] Time spent T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:11:31.512101  1215 consensus_queue.cc:1059] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 13:11:31.585160 30702 leader_election.cc:304] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:31.593868 30027 raft_consensus.cc:1275] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 13 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 13:11:31.603077 30702 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:31.599972 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 74737.5us
I20260709 13:11:31.608310 29993 leader_election.cc:304] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:31.609416 29993 leader_election.cc:304] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:31.590698  1057 raft_consensus.cc:493] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.590332  1178 raft_consensus.cc:493] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.613052  1211 raft_consensus.cc:2749] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:31.613422  1282 raft_consensus.cc:2804] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:31.640376  1282 raft_consensus.cc:493] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.635489 30172 raft_consensus.cc:1275] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 13:11:31.572525  1144 raft_consensus.cc:493] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:31.600813 30066 leader_election.cc:304] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:31.665004 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:31.666882 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:31.668078 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:31.669981 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:31.671006 30026 raft_consensus.cc:1240] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 9. Current term is 10. Ops: []
W20260709 13:11:31.681659 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 80922.4us
I20260709 13:11:31.683936 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:31.685659 30099 raft_consensus.cc:2468] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 8.
I20260709 13:11:31.688499 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:31.693679 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7be23af8c824b3bb048a59d6bdf884c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:31.695667  1193 leader_election.cc:290] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:31.698397 30173 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43838 (request call id 2325) took 1593 ms. Trace:
I20260709 13:11:31.699379 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:31.640748  1282 raft_consensus.cc:3060] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:31.701877  1293 consensus_queue.cc:1048] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:31.702531  1293 consensus_queue.cc:1243] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer b2cea0098c1040f69755ea4d3dab7fc4 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:11:31.698796 30173 rpcz_store.cc:276] 0709 13:11:30.104622 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:30.345482 (+240860us) service_pool.cc:224] Handling call
0709 13:11:30.345819 (+   337us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:30.346174 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:30.346201 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:30.346635 (+   434us) log.cc:844] Serialized 26 byte log entry
0709 13:11:30.536746 (+190111us) raft_consensus.cc:1645] Marking committed up to 7
0709 13:11:30.536788 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:30.536850 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:31.549120 (+1012270us) spinlock_profiling.cc:243] Waited 68.7 ms on lock 0x7b4400022b4c. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eeef3c85 00007f99eeef46a2 00007f99f1c661db 00007f99f1c61aaf 00007f99f1c5586e 00007f99f1c54bb6 00007f99f1c547d8 00007f99f1c5e221 00007f99f1c5e1d9 00007f99f1c5e169
0709 13:11:31.696191 (+147071us) raft_consensus.cc:1685] finished
0709 13:11:31.696210 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:31.698320 (+  2110us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1904,"raft.queue_time_us":6555,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":11710,"spinlock_wait_cycles":158079744,"thread_start_us":189765,"threads_started":1,"wal-append.queue_time_us":306803}
I20260709 13:11:31.636610  1215 raft_consensus.cc:3055] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:31.704735 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:31.700309 30028 raft_consensus.cc:2468] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 9.
I20260709 13:11:31.623836  1361 raft_consensus.cc:493] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:31.713894 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:31.599416  1323 raft_consensus.cc:515] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:31.706454 30026 pending_rounds.cc:85] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4: Aborting all ops after (but not including) 6
I20260709 13:11:31.626011  1370 raft_consensus.cc:2764] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 13:11:31.680282  1306 raft_consensus.cc:2749] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:31.698024  1354 raft_consensus.cc:2804] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:31.716746 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:31.713986  1215 raft_consensus.cc:740] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:31.714851 30026 pending_rounds.cc:107] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4: Aborting uncommitted NO_OP operation due to leader change: 12.7
I20260709 13:11:31.724538 30026 raft_consensus.cc:2889] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:31.725610 30171 raft_consensus.cc:3060] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:31.720121 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:31.728829 30700 leader_election.cc:304] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:31.731822 30021 raft_consensus.cc:2393] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 9: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:31.646566  1057 raft_consensus.cc:515] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:31.691869  1222 raft_consensus.cc:493] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:31.600257  1232 raft_consensus.cc:515] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:31.726980   492 raft_consensus.cc:493] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.646719  1178 raft_consensus.cc:515] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:31.716187  1263 raft_consensus.cc:493] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.715343 30173 raft_consensus.cc:1275] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:11:31.743064 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:31.743635 30028 raft_consensus.cc:3060] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:31.698948  1326 raft_consensus.cc:515] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:31.680742  1144 raft_consensus.cc:515] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:31.738819   928 raft_consensus.cc:2749] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:31.760706 30174 raft_consensus.cc:2468] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 12.
I20260709 13:11:31.717495  1361 raft_consensus.cc:515] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:31.738600  1354 raft_consensus.cc:697] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 9 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:31.730326 30700 leader_election.cc:304] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:31.773216 30028 raft_consensus.cc:2468] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 10.
I20260709 13:11:31.745604  1222 raft_consensus.cc:515] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:31.777935 30700 leader_election.cc:304] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:31.748764 30171 raft_consensus.cc:2468] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 7.
I20260709 13:11:31.750485   492 raft_consensus.cc:515] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:31.751695  1263 raft_consensus.cc:515] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:31.777073  1113 raft_consensus.cc:2749] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:11:31.784178  1368 log.cc:927] Time spent T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
W20260709 13:11:31.797283  1377 log.cc:927] Time spent T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 13:11:31.798511  1361 leader_election.cc:290] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:31.799367 30095 raft_consensus.cc:1275] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:11:31.800300 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:11:31.801332  1331 log.cc:927] Time spent T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.904s	user 0.007s	sys 0.000s
I20260709 13:11:31.803728  1114 raft_consensus.cc:493] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
W20260709 13:11:31.803875  1337 log.cc:927] Time spent T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.907s	user 0.003s	sys 0.004s
I20260709 13:11:31.803617 29994 leader_election.cc:304] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:31.808964  1200 raft_consensus.cc:493] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.784052  1325 raft_consensus.cc:493] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:31.822504 29992 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:31.832573 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 54735.5us
I20260709 13:11:31.763509  1215 consensus_queue.cc:260] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:31.853055 30700 leader_election.cc:304] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:31.846885  1114 raft_consensus.cc:3060] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:31.844909  1113 raft_consensus.cc:493] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.847748   928 raft_consensus.cc:2749] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:31.860046   840 raft_consensus.cc:2804] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:31.879350  1144 leader_election.cc:290] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:31.879571   840 raft_consensus.cc:697] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
W20260709 13:11:31.879786  1330 log.cc:927] Time spent T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 1.189s	user 0.000s	sys 0.013s
I20260709 13:11:31.880208 30731 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:51014 (request call id 1042) took 1303 ms. Trace:
I20260709 13:11:31.880589 30731 rpcz_store.cc:276] 0709 13:11:30.576828 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:30.576950 (+   122us) service_pool.cc:224] Handling call
0709 13:11:30.577256 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:30.580721 (+  3465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:30.580753 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:30.581222 (+   469us) log.cc:844] Serialized 26 byte log entry
0709 13:11:30.861504 (+280282us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:30.861548 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:30.861624 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:31.803278 (+941654us) spinlock_profiling.cc:243] Waited 26.3 ms on lock 0x7b4400022b4c. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eeef3c85 00007f99eeef46a2 00007f99f1c661db 00007f99f1c61aaf 00007f99f1c5586e 00007f99f1c54bb6 00007f99f1c547d8 00007f99f1c5e221 00007f99f1c5e1d9 00007f99f1c5e169
0709 13:11:31.877874 (+ 74596us) raft_consensus.cc:1685] finished
0709 13:11:31.877898 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:31.880147 (+  2249us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5298,"raft.queue_time_us":11714,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":5233,"spinlock_wait_cycles":60594048,"thread_start_us":279957,"threads_started":1,"wal-append.queue_time_us":315129}
I20260709 13:11:31.884423 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:31.850580  1200 raft_consensus.cc:515] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:31.860908  1215 raft_consensus.cc:3060] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:31.886999 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:31.887172 30177 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43838 (request call id 2324) took 1782 ms. Trace:
I20260709 13:11:31.882863   840 consensus_queue.cc:237] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:31.892189  1326 leader_election.cc:290] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:31.892932  1057 leader_election.cc:290] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:31.894011  1222 leader_election.cc:290] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:31.850910  1354 consensus_queue.cc:237] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:31.902931  1263 leader_election.cc:290] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:31.903574  1232 leader_election.cc:290] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:31.852923  1325 raft_consensus.cc:515] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:31.887916  1374 log.cc:927] Time spent T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 13:11:31.907702  1325 leader_election.cc:290] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:31.865556  1113 raft_consensus.cc:515] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:31.909845  1113 leader_election.cc:290] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:31.911723  1200 leader_election.cc:290] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451)
W20260709 13:11:31.883294  1379 log.cc:927] Time spent T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.125s	user 0.002s	sys 0.000s
W20260709 13:11:31.914640 30068 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.016s	sys 0.034s
W20260709 13:11:31.915031 30068 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.016s	sys 0.034s
W20260709 13:11:31.915280 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 728506us
I20260709 13:11:31.889902  1178 leader_election.cc:290] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:31.891440 30176 raft_consensus.cc:3060] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:31.906348 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:31.891367 30177 rpcz_store.cc:276] 0709 13:11:30.104400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:30.312097 (+207697us) service_pool.cc:224] Handling call
0709 13:11:30.312415 (+   318us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:30.314967 (+  2552us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:30.314999 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:30.315494 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 13:11:30.551216 (+235722us) raft_consensus.cc:1645] Marking committed up to 5
0709 13:11:30.584189 (+ 32973us) log.cc:844] Serialized 14 byte log entry
0709 13:11:30.600077 (+ 15888us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:30.600165 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:31.879284 (+1279119us) spinlock_profiling.cc:243] Waited 75.1 ms on lock 0x7b4400022b4c. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eeef3c85 00007f99eeef46a2 00007f99f1c661db 00007f99f1c61aaf 00007f99f1c5586e 00007f99f1c54bb6 00007f99f1c547d8 00007f99f1c5e221 00007f99f1c5e1d9 00007f99f1c5e169
0709 13:11:31.883521 (+  4237us) raft_consensus.cc:1685] finished
0709 13:11:31.886982 (+  3461us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:31.887119 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44241,"prepare.queue_time_us":37955,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":19469,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":46529,"spinlock_wait_cycles":172829568,"thread_start_us":166915,"threads_started":1,"wal-append.queue_time_us":212318}
I20260709 13:11:31.927377 30170 raft_consensus.cc:2468] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 8.
I20260709 13:11:31.873855  1323 leader_election.cc:290] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:31.932369 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:31.933153 30177 raft_consensus.cc:2410] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 13:11:31.933039 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:31.933705 30731 raft_consensus.cc:2468] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 8.
I20260709 13:11:31.926985 30068 leader_election.cc:304] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:31.934983 30142 leader_election.cc:304] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:31.935894 30176 raft_consensus.cc:2468] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 9.
W20260709 13:11:31.938367 30143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:31.883244   492 leader_election.cc:290] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:31.937244 30702 leader_election.cc:304] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:31.942215 30068 leader_election.cc:400] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469) with higher term. Message: Invalid argument: T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for earlier term 9. Current term is 10.
I20260709 13:11:31.944229  1114 raft_consensus.cc:515] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:31.954979  1114 leader_election.cc:290] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:31.955580 30098 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33990 (request call id 2389) took 1502 ms. Trace:
W20260709 13:11:31.955780  1384 log.cc:927] Time spent T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260709 13:11:31.948894 30068 leader_election.cc:403] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:31.947935  1026 raft_consensus.cc:2804] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:31.956517  1026 raft_consensus.cc:493] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:31.956912  1026 raft_consensus.cc:3060] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:31.947198  1338 raft_consensus.cc:2749] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 13:11:31.949774  1309 log.cc:927] Time spent T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 1.641s	user 0.010s	sys 0.011s
I20260709 13:11:31.963495  1222 raft_consensus.cc:493] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.940795 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:31.964032  1222 raft_consensus.cc:515] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:31.963707 30175 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54540 (request call id 822) took 2063 ms. Trace:
I20260709 13:11:31.966061  1222 leader_election.cc:290] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:31.965399 30175 rpcz_store.cc:276] 0709 13:11:29.900603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:29.902746 (+  2143us) service_pool.cc:224] Handling call
0709 13:11:29.903032 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:11:29.910256 (+  7224us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:29.910287 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:11:29.911058 (+   771us) log.cc:844] Serialized 26 byte log entry
0709 13:11:30.156292 (+245234us) raft_consensus.cc:1645] Marking committed up to 9
0709 13:11:30.459065 (+302773us) log.cc:844] Serialized 14 byte log entry
0709 13:11:30.464983 (+  5918us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:30.465058 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:31.937113 (+1472055us) spinlock_profiling.cc:243] Waited 3.25 ms on lock 0x7b4400022b4c. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eeef3c85 00007f99eeef46a2 00007f99f1c661db 00007f99f1c61aaf 00007f99f1c5586e 00007f99f1c54bb6 00007f99f1c547d8 00007f99f1c5e221 00007f99f1c5e1d9 00007f99f1c5e169
0709 13:11:31.963458 (+ 26345us) raft_consensus.cc:1685] finished
0709 13:11:31.963536 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:31.963651 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5685,"prepare.queue_time_us":96810,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":27,"raft.queue_time_us":23356,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":23749,"spinlock_wait_cycles":7478656,"thread_start_us":427652,"threads_started":2,"wal-append.queue_time_us":362484}
I20260709 13:11:31.968761  1026 raft_consensus.cc:515] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:31.971443  1338 raft_consensus.cc:3060] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Advancing to term 10
I20260709 13:11:31.947463  1325 raft_consensus.cc:493] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:31.974787  1325 raft_consensus.cc:515] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:31.963821  1334 log.cc:927] Time spent T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 1.062s	user 0.000s	sys 0.008s
I20260709 13:11:31.977053  1325 leader_election.cc:290] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:31.977700 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:31.981613  1338 raft_consensus.cc:2749] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469) with higher term. Message: Invalid argument: T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for earlier term 9. Current term is 10.
I20260709 13:11:31.986268  1325 raft_consensus.cc:493] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:31.986693  1325 raft_consensus.cc:515] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:31.989185  1325 leader_election.cc:290] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:31.974453 30098 rpcz_store.cc:276] 0709 13:11:30.453507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:30.454138 (+   631us) service_pool.cc:224] Handling call
0709 13:11:30.454405 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:30.886407 (+432002us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:31.955375 (+1068968us) spinlock_profiling.cc:243] Waited 429 ms on lock 0x7b5400022e54. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:11:31.955527 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":986513152}
I20260709 13:11:31.990774 30172 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43840 (request call id 1997) took 1823 ms. Trace:
I20260709 13:11:31.991144 30172 rpcz_store.cc:276] 0709 13:11:30.167733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:31.124114 (+956381us) service_pool.cc:224] Handling call
0709 13:11:31.124372 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:31.641044 (+516672us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:31.990560 (+349516us) spinlock_profiling.cc:243] Waited 511 ms on lock 0x7b54002b4654. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20bae01 00007f99f20b983e 00007f99f707e419 00007f99f05f5bd4 00007f99f05f5b62 00007f99f05f5a91 00007f99f05f5a0c 00007f99f05f4cc2 00007f99f03f548c 00007f99f03f48c6
0709 13:11:31.990711 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1174587776}
I20260709 13:11:31.992203 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:31.992413 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:31.992669 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:30.686893 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:32.001986  1282 raft_consensus.cc:515] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:32.004055  1201 leader_election.cc:290] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:32.010156  1263 raft_consensus.cc:2804] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:32.010547  1263 raft_consensus.cc:493] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.010871  1263 raft_consensus.cc:3060] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:32.012028  1378 log.cc:927] Time spent T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
I20260709 13:11:32.015182 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:32.017107 30174 raft_consensus.cc:1240] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:32.017366 30168 raft_consensus.cc:1275] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:11:32.017669  1263 raft_consensus.cc:515] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:32.026970 30170 raft_consensus.cc:2468] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 10.
I20260709 13:11:32.019575 30173 raft_consensus.cc:1240] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 8. Current term is 9. Ops: []
W20260709 13:11:32.019153 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 81951us
I20260709 13:11:32.036051 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:32.036628 30173 raft_consensus.cc:3060] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:32.038151 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:32.041265 30728 raft_consensus.cc:2393] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 9: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:11:32.047838 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:32.048601 30731 raft_consensus.cc:2393] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 11: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:11:32.058092 30173 raft_consensus.cc:2468] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 11.
I20260709 13:11:32.060091 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:32.061301 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:32.063191 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:32.064383 30099 raft_consensus.cc:1275] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:11:32.064334 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:32.065732 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:32.065773 30097 raft_consensus.cc:2468] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 10.
I20260709 13:11:32.067438 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:32.070179 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:32.004015  1282 leader_election.cc:290] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 11 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:32.082996 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:32.087313 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:32.076465 30099 raft_consensus.cc:2468] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 10.
I20260709 13:11:32.077481 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:32.088686 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:32.089021 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:32.089304 30097 raft_consensus.cc:2468] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 8.
I20260709 13:11:32.090128 30095 raft_consensus.cc:3060] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:32.099262 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:32.100735 30099 raft_consensus.cc:2468] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 6.
I20260709 13:11:32.100167   928 raft_consensus.cc:493] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:32.101632   928 raft_consensus.cc:515] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:32.104910   928 leader_election.cc:290] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:32.106208 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:32.106992 30732 raft_consensus.cc:2393] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 9: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:11:32.106277 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:32.109536 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:32.112957 30099 raft_consensus.cc:1240] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:32.113317 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:32.112857 30173 raft_consensus.cc:1275] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:11:32.117106 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:32.117656 30098 raft_consensus.cc:3060] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:32.118881 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:32.119428 30100 raft_consensus.cc:3060] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:32.120633 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:32.126134 30098 raft_consensus.cc:2468] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 11.
I20260709 13:11:32.127238 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:32.129770 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:32.093114  1282 raft_consensus.cc:493] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:32.131280 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:32.132612 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:32.133232 30168 raft_consensus.cc:2393] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 9: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:11:32.138559 30096 raft_consensus.cc:3055] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:32.138943 30096 raft_consensus.cc:740] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:32.140667  1282 raft_consensus.cc:515] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:32.142105 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:32.142673 30101 raft_consensus.cc:2468] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 10.
I20260709 13:11:32.147879 30095 raft_consensus.cc:2468] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 9.
I20260709 13:11:32.148018 30100 raft_consensus.cc:2468] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 9.
I20260709 13:11:32.139657 30096 consensus_queue.cc:260] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:32.150884 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:32.108304  1026 leader_election.cc:290] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:32.157745 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:32.166676   853 raft_consensus.cc:3060] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:32.172818  1139 raft_consensus.cc:3060] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:32.142812  1282 leader_election.cc:290] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:32.186862 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:32.187680 30171 raft_consensus.cc:2393] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 9: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:11:32.190424 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:32.191185 30095 raft_consensus.cc:2393] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 9: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:11:32.191566 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:32.193477 30068 leader_election.cc:304] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:32.194821  1354 raft_consensus.cc:2804] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:32.196842  1344 consensus_queue.cc:1048] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:32.194367 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:32.198551 30100 raft_consensus.cc:2393] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 9: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:11:32.200687 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:32.196892 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:32.208838 30095 raft_consensus.cc:2468] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 11.
I20260709 13:11:32.213604 30171 raft_consensus.cc:1275] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:32.212563  1338 consensus_queue.cc:1048] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 13:11:32.197516  1057 consensus_queue.cc:1059] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:32.218037  1057 raft_consensus.cc:3055] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:11:32.218382  1057 raft_consensus.cc:740] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:32.219159  1057 consensus_queue.cc:260] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:32.220304  1057 raft_consensus.cc:3060] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:32.223587 30068 leader_election.cc:304] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:32.225387 30703 leader_election.cc:304] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:32.225404   898 raft_consensus.cc:2764] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 13:11:32.227111  1390 consensus_queue.cc:1048] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:32.227540   898 consensus_queue.cc:1059] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:32.228535   898 raft_consensus.cc:3055] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:32.228858   898 raft_consensus.cc:740] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:32.230247 30703 leader_election.cc:304] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:32.231506 30703 leader_election.cc:304] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:32.232153  1389 raft_consensus.cc:2749] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:32.196164  1354 raft_consensus.cc:697] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 7 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:32.235611 30703 leader_election.cc:304] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:11:32.235638 30171 raft_consensus.cc:1275] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 13 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:11:32.247658 30703 leader_election.cc:304] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:11:32.244306 30143 leader_election.cc:304] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:32.251426 30143 leader_election.cc:304] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:32.252440 30143 leader_election.cc:304] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:32.253528 30703 leader_election.cc:304] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:11:32.257311   840 raft_consensus.cc:2804] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:32.229663   898 consensus_queue.cc:260] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:32.257695  1222 raft_consensus.cc:2749] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:32.258333 30143 leader_election.cc:304] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:32.262336 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
W20260709 13:11:32.234720  1391 log.cc:927] Time spent T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 13:11:32.259032 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:32.259678 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:32.264804 30736 raft_consensus.cc:2468] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 10.
I20260709 13:11:32.226866  1113 raft_consensus.cc:2749] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:32.263410 30143 leader_election.cc:304] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:32.266005 30068 leader_election.cc:304] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:32.269608 30143 leader_election.cc:304] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
W20260709 13:11:32.310798 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 44869.3us
I20260709 13:11:32.311620 30068 leader_election.cc:304] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:32.316444 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:32.317250 30731 raft_consensus.cc:2393] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 9: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:11:32.321117 30142 leader_election.cc:304] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:32.322285 30142 leader_election.cc:304] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:32.257710   840 raft_consensus.cc:493] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.261004  1325 raft_consensus.cc:2749] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:32.327056 30068 leader_election.cc:304] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:32.265079  1026 raft_consensus.cc:2749] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:32.264922  1266 raft_consensus.cc:2804] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:32.309567  1200 raft_consensus.cc:2804] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:32.263965  1232 raft_consensus.cc:2804] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:32.329151 30068 leader_election.cc:304] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:32.319607   898 raft_consensus.cc:3060] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:32.331643  1104 raft_consensus.cc:2749] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:32.338883 30094 raft_consensus.cc:2468] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 11.
I20260709 13:11:32.329126  1035 raft_consensus.cc:2749] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:32.322682  1323 raft_consensus.cc:2804] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:11:32.351780 30069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:32.327391   492 raft_consensus.cc:2804] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:32.325142  1056 raft_consensus.cc:2749] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:32.262038  1193 consensus_queue.cc:1059] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.072s
I20260709 13:11:32.355744  1344 consensus_queue.cc:1048] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:32.328716  1222 raft_consensus.cc:2749] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:32.327584   840 raft_consensus.cc:3060] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:32.358700 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:32.329810  1390 raft_consensus.cc:2749] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:32.348081  1200 raft_consensus.cc:493] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.359674   853 raft_consensus.cc:2749] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 13:11:32.351485  1266 raft_consensus.cc:697] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:32.353586  1232 raft_consensus.cc:493] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:32.371616 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 118148us
I20260709 13:11:32.364588   492 raft_consensus.cc:493] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:32.364502  1323 raft_consensus.cc:697] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:32.386504 30703 leader_election.cc:304] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:11:32.348562  1354 consensus_queue.cc:237] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:32.407270  1263 leader_election.cc:290] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:32.410502 30176 raft_consensus.cc:1240] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 11 LEADER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:32.410879 30096 raft_consensus.cc:3060] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:11:32.386463  1394 log.cc:927] Time spent T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 13:11:32.383878  1200 raft_consensus.cc:3060] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:32.387508  1232 raft_consensus.cc:3060] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:32.388976   492 raft_consensus.cc:3060] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:32.390025  1107 raft_consensus.cc:2749] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:32.433940 30102 raft_consensus.cc:1240] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 12 LEADER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:32.437470 30096 raft_consensus.cc:1275] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 13:11:32.438930 30096 pending_rounds.cc:85] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719: Aborting all ops after (but not including) 5
I20260709 13:11:32.439284 30096 pending_rounds.cc:107] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 13:11:32.439586 30096 raft_consensus.cc:2889] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:32.427246  1405 raft_consensus.cc:2804] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader election won for term 9
W20260709 13:11:32.441638 30094 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:33992 (request call id 1908) took 1429 ms (client timeout 1775 ms). Trace:
W20260709 13:11:32.443832 30094 rpcz_store.cc:269] 0709 13:11:31.011780 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:31.011884 (+   104us) service_pool.cc:224] Handling call
0709 13:11:32.441493 (+1429609us) spinlock_profiling.cc:243] Waited 1.32 s on lock 0x7b54002f67d4. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20be2fa 00007f99f707fb17 00007f99f05fa6d4 00007f99f05fa662 00007f99f05fa591 00007f99f05fa50c 00007f99f05f97c2 00007f99f03f548c 00007f99f03f48c6 00007f99f03f426f
0709 13:11:32.441586 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3041750912}
I20260709 13:11:32.445399  1222 consensus_queue.cc:1048] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:32.447786 30103 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:33990 (request call id 2395) took 1265 ms. Trace:
I20260709 13:11:32.448132 30103 rpcz_store.cc:276] 0709 13:11:31.182044 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:31.182962 (+   918us) service_pool.cc:224] Handling call
0709 13:11:31.194343 (+ 11381us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 13:11:31.194696 (+   353us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:11:31.194722 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 13:11:31.207189 (+ 12467us) log.cc:844] Serialized 52 byte log entry
0709 13:11:32.357011 (+1149822us) spinlock_profiling.cc:243] Waited 23.1 ms on lock 0x7b1800350f80. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f7e95de1 00007f99f7ea25b1 00007f99eefafe07 00007f99f7e0aab9 00007f99eefcc69b 00007f99eefca93f 00007f99eefccc02 00007f99f1c5420b 00007f99f1c59d23 00007f99f1c5a0d1 00007f99f2075a0f
0709 13:11:32.438698 (+ 81687us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:32.447256 (+  8558us) log.cc:844] Serialized 14 byte log entry
0709 13:11:32.447449 (+   193us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:32.447511 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:11:32.447543 (+    32us) raft_consensus.cc:1685] finished
0709 13:11:32.447616 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:32.447726 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":9765,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":6666,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":72,"spinlock_wait_cycles":53030272,"thread_start_us":80800,"threads_started":1,"wal-append.queue_time_us":1233183}
I20260709 13:11:32.438736  1113 raft_consensus.cc:3055] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 LEADER]: Stepping down as leader of term 6
I20260709 13:11:32.454373 30143 leader_election.cc:304] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:32.456375  1361 raft_consensus.cc:2804] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:32.456310  1405 raft_consensus.cc:697] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:32.456825  1361 raft_consensus.cc:493] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:32.457224  1361 raft_consensus.cc:3060] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:32.457427  1405 consensus_queue.cc:237] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:32.470837  1401 log.cc:927] Time spent T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 13:11:32.450938  1323 consensus_queue.cc:237] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:32.451292  1266 consensus_queue.cc:237] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:32.491626  1222 raft_consensus.cc:493] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:32.491804  1107 raft_consensus.cc:493] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:32.492203  1222 raft_consensus.cc:515] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:32.492277  1107 raft_consensus.cc:515] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:32.455416  1113 raft_consensus.cc:740] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:32.494303  1107 leader_election.cc:290] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:32.473517   840 raft_consensus.cc:515] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:32.495805 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:32.496393 30731 raft_consensus.cc:2468] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 12.
I20260709 13:11:32.496688   840 leader_election.cc:290] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:32.497229   840 raft_consensus.cc:493] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:32.497496 30142 leader_election.cc:304] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:32.498473  1326 raft_consensus.cc:2804] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:32.498889  1326 raft_consensus.cc:493] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:32.499327  1326 raft_consensus.cc:3060] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:32.502012   900 raft_consensus.cc:493] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:32.502482   900 raft_consensus.cc:3060] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:32.497629   840 raft_consensus.cc:515] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:32.507267  1326 raft_consensus.cc:515] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:32.509509  1200 raft_consensus.cc:515] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:32.516482 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:32.517030 30731 raft_consensus.cc:3060] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:32.518066 30094 raft_consensus.cc:1275] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:11:32.519574 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:32.520227 30102 raft_consensus.cc:3060] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:32.525817  1193 consensus_queue.cc:1048] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:11:32.527369 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 723784us
I20260709 13:11:32.494158  1113 consensus_queue.cc:260] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:32.529160  1339 raft_consensus.cc:2804] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:11:32.528851 29994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:32.530063 29994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:32.530815 29994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:32.529481 30731 raft_consensus.cc:2468] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 13.
I20260709 13:11:32.531769 30142 leader_election.cc:304] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:32.532583 30140 leader_election.cc:304] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:11:32.517669 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 79500.4us
I20260709 13:11:32.529572  1113 raft_consensus.cc:3060] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:32.529682  1339 raft_consensus.cc:697] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:32.586891 30102 raft_consensus.cc:2468] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 7.
I20260709 13:11:32.589733 30703 leader_election.cc:304] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:11:32.549090  1107 raft_consensus.cc:2804] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:32.545984  1326 leader_election.cc:290] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 13 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:32.562752  1325 raft_consensus.cc:2749] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:11:32.600977 30068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:32.604473  1107 raft_consensus.cc:697] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 13 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:32.605319   492 raft_consensus.cc:515] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:32.605370  1107 consensus_queue.cc:237] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:32.607532   492 leader_election.cc:290] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:32.608428 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:32.609011 30731 raft_consensus.cc:3060] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:11:32.612920 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 49703.6us
W20260709 13:11:32.613560 30069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:32.602944 29925 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51840 (request call id 328) took 18179 ms (client timeout 15000 ms). Trace:
I20260709 13:11:32.596014  1383 raft_consensus.cc:493] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:32.625365 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:32.601015  1297 raft_consensus.cc:493] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.626750 30731 raft_consensus.cc:2468] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 11.
I20260709 13:11:32.630434 30142 leader_election.cc:304] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:32.631004 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
W20260709 13:11:32.629403 29992 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:32.631843 30102 raft_consensus.cc:2393] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 8: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:11:32.631335   492 raft_consensus.cc:2804] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:32.632550   492 raft_consensus.cc:697] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 11 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:32.633018  1358 raft_consensus.cc:493] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:32.633509  1358 raft_consensus.cc:515] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:32.634047 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:32.613298   928 raft_consensus.cc:2804] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:32.636510 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:32.633395   492 consensus_queue.cc:237] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:32.641390 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:32.643538 30102 raft_consensus.cc:3060] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:32.644582 30025 raft_consensus.cc:1275] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:11:32.645630 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:32.646858 30021 raft_consensus.cc:1275] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 13:11:32.647089 30021 pending_rounds.cc:85] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4: Aborting all ops after (but not including) 8
I20260709 13:11:32.647217 30021 pending_rounds.cc:107] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 13:11:32.647343 30021 raft_consensus.cc:2889] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:32.650727  1232 raft_consensus.cc:515] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:32.651994  1270 raft_consensus.cc:493] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:32.643334   928 raft_consensus.cc:697] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:32.654603  1326 raft_consensus.cc:493] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:32.662122  1326 raft_consensus.cc:515] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:32.662425   928 consensus_queue.cc:237] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:32.664045  1326 leader_election.cc:290] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:32.654068 29924 catalog_manager.cc:5697] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:32.661243  1270 raft_consensus.cc:515] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:32.666716 29924 catalog_manager.cc:5697] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: term changed from 7 to 8, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68). New cstate: current_term: 8 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:32.668382  1270 leader_election.cc:290] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:32.648555  1266 consensus_queue.cc:1048] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.013s
I20260709 13:11:32.668679 29924 catalog_manager.cc:5697] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:32.671479 29924 catalog_manager.cc:5697] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: term changed from 5 to 8, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68). New cstate: current_term: 8 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:32.636148 30020 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:32.627151  1178 consensus_queue.cc:1048] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:11:32.678032 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:32.629285   840 leader_election.cc:290] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:32.678438  1339 consensus_queue.cc:237] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:32.660365  1358 leader_election.cc:290] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:32.680364 29924 catalog_manager.cc:5697] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:32.685376 30021 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0be979412dd54241bd212ddbb7611046"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
mode: GRACEFUL
new_leader_uuid: "5ec73dc157ed476ca903a7d596271719"
 from {username='slave'} at 127.0.0.1:47450
I20260709 13:11:32.674007 30102 raft_consensus.cc:2468] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 12.
I20260709 13:11:32.689013 30700 leader_election.cc:304] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:32.690078 30143 leader_election.cc:304] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:32.690326 30700 leader_election.cc:304] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
W20260709 13:11:32.694178 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 54971.8us
I20260709 13:11:32.696651 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:32.693979  1193 raft_consensus.cc:2749] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:32.695482  1114 raft_consensus.cc:493] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
W20260709 13:11:32.615356 29925 rpcz_store.cc:269] 0709 13:11:14.423079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:14.456904 (+ 33825us) service_pool.cc:224] Handling call
0709 13:11:14.752648 (+295744us) spinlock_profiling.cc:243] Waited 4.1 ms on lock 0x7b54001a4354. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2024090 00007f99f20c2f3a 00007f99f7e791cc 00007f99f7f7737e 00007f99f64382a4 00007f99f6438232 00007f99f6438161 00007f99f64380dc 00007f99f6437392 00007f99f03f548c 00007f99f03f48c6
0709 13:11:32.596954 (+17844306us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:28.884194 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:28.951165 (+ 66971us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:28.951213 (+    48us) write_op.cc:435] Acquired schema lock
0709 13:11:28.951231 (+    18us) tablet.cc:662] Decoding operations
0709 13:11:29.001931 (+ 50700us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:29.002002 (+    71us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:29.002027 (+    25us) tablet.cc:685] Acquiring locks for 22 operations
0709 13:11:29.063522 (+ 61495us) tablet.cc:701] Row locks acquired
0709 13:11:29.080032 (+ 16510us) write_op.cc:260] PREPARE: finished
0709 13:11:29.119138 (+ 39106us) write_op.cc:270] Start()
0709 13:11:29.119297 (+   159us) write_op.cc:276] Timestamp: P: 1783602689090332 usec, L: 0
0709 13:11:29.119319 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 13:11:29.182823 (+ 63504us) log.cc:844] Serialized 8607 byte log entry
0709 13:11:29.548925 (+366102us) spinlock_profiling.cc:243] Waited 1.91 ms on lock 0x7b4400022b4c. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eeef3c85 00007f99eeef46a2 00007f99f1c661db 00007f99f1c61aaf 00007f99f1c5586e 00007f99f1c54bb6 00007f99f1c547d8 00007f99f1c5e221 00007f99f1c5e1d9 00007f99f1c5e169
0709 13:11:29.742136 (+193211us) op_driver.cc:464] REPLICATION: finished
0709 13:11:29.860028 (+117892us) write_op.cc:301] APPLY: starting
0709 13:11:29.860119 (+    91us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:29.860519 (+   400us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:29.860554 (+    35us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:29.863786 (+  3232us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:29.864199 (+   413us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=22
0709 13:11:29.864245 (+    46us) write_op.cc:312] APPLY: finished
0709 13:11:29.983564 (+119319us) log.cc:844] Serialized 152 byte log entry
0709 13:11:30.024412 (+ 40848us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:30.095955 (+ 71543us) write_op.cc:454] Released schema lock
0709 13:11:30.096031 (+    76us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:30.129902 (+ 33871us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:30.129934 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3320620,"reported_tablets":47,"spinlock_wait_cycles":9431296,"child_traces":[["op",{"apply.queue_time_us":117647,"apply.run_cpu_time_us":5247,"apply.run_wall_time_us":262828,"num_ops":22,"prepare.queue_time_us":395397,"prepare.run_cpu_time_us":17797,"prepare.run_wall_time_us":603077,"raft.queue_time_us":49598,"raft.run_cpu_time_us":46884,"raft.run_wall_time_us":66971,"replication_time_us":622645,"spinlock_wait_cycles":4437504,"thread_start_us":492347,"threads_started":4,"wal-append.queue_time_us":302012,"wal-append.run_cpu_time_us":16063,"wal-append.run_wall_time_us":1715028}]]}
I20260709 13:11:32.699913 29993 leader_election.cc:304] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:32.638228  1297 raft_consensus.cc:515] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:32.682546  1312 raft_consensus.cc:493] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.688444   997 raft_consensus.cc:493] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:32.704784 30700 leader_election.cc:304] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:32.628372  1383 raft_consensus.cc:515] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:32.696655  1026 raft_consensus.cc:2804] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:32.710295 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:32.704157  1200 leader_election.cc:290] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 12 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451)
I20260709 13:11:32.698127  1114 raft_consensus.cc:515] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:32.711396  1383 leader_election.cc:290] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:32.738402 30700 leader_election.cc:304] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:32.741601 29993 leader_election.cc:304] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:32.746210  1283 raft_consensus.cc:493] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:32.699036  1222 leader_election.cc:290] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:32.746718  1283 raft_consensus.cc:515] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:32.708246  1232 leader_election.cc:290] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:32.751371  1211 raft_consensus.cc:2804] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:11:32.735074  1266 raft_consensus.cc:3060] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:32.706310  1423 raft_consensus.cc:2749] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:32.721698  1057 raft_consensus.cc:493] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:32.721256  1317 raft_consensus.cc:493] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:32.721073   997 raft_consensus.cc:515] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:32.769800 30066 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:32.748163  1370 raft_consensus.cc:493] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:32.774037 29924 catalog_manager.cc:5697] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:32.751227  1311 raft_consensus.cc:2804] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:32.747833  1026 raft_consensus.cc:697] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 12 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:32.748402  1193 raft_consensus.cc:2749] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:32.738554   900 raft_consensus.cc:515] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:32.793897  1026 consensus_queue.cc:237] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:32.760154  1211 raft_consensus.cc:493] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:32.777104 30021 raft_consensus.cc:606] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 LEADER]: Received request to transfer leadership to TS 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:32.778066 30020 raft_consensus.cc:3055] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:32.798815 30020 raft_consensus.cc:740] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:32.778157 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:32.800099 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:32.766510  1283 leader_election.cc:290] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:32.785312 30028 raft_consensus.cc:1240] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 10. Current term is 11. Ops: []
I20260709 13:11:32.783528 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:32.788460 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:32.785581  1215 consensus_queue.cc:1059] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.007s
I20260709 13:11:32.782935  1311 raft_consensus.cc:493] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:32.792258   997 leader_election.cc:290] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:32.795110 30098 raft_consensus.cc:1240] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:32.804461  1311 raft_consensus.cc:3060] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:32.795961 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:32.720566  1406 consensus_queue.cc:1048] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.048s
I20260709 13:11:32.806270 30731 raft_consensus.cc:1275] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:32.811337  1297 leader_election.cc:290] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:32.797845 30024 raft_consensus.cc:1275] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:32.812990  1311 raft_consensus.cc:515] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:32.800311  1211 raft_consensus.cc:3060] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:11:32.739130  1421 consensus_queue.cc:1048] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 13:11:32.815883 30026 raft_consensus.cc:1240] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:32.817597  1311 leader_election.cc:290] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:32.763139  1114 leader_election.cc:290] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:32.721480  1361 raft_consensus.cc:515] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:32.801493 30171 raft_consensus.cc:2468] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 6.
I20260709 13:11:32.772125  1057 raft_consensus.cc:515] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:32.785580  1370 raft_consensus.cc:515] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:32.832258  1057 leader_election.cc:290] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:32.804132   900 leader_election.cc:290] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:32.797119   928 raft_consensus.cc:493] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:32.833556  1370 leader_election.cc:290] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:32.833892   928 raft_consensus.cc:515] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:32.836225   928 leader_election.cc:290] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:32.837296 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:32.840530 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:32.842257 30068 leader_election.cc:304] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:32.844439 30168 raft_consensus.cc:1240] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 10. Current term is 11. Ops: [10.10-10.10]
W20260709 13:11:32.854909 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 53542.5us
I20260709 13:11:32.856909 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:32.848912 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:32.862659 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:32.863677 30022 raft_consensus.cc:1275] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 13:11:32.864734 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:32.865295 30170 raft_consensus.cc:2468] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 7.
I20260709 13:11:32.718919  1312 raft_consensus.cc:515] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:32.869903 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:32.862495 30020 consensus_queue.cc:260] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:32.869637 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 14 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:32.869988 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:32.879257 30020 raft_consensus.cc:3060] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:32.880043 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:32.776369  1317 raft_consensus.cc:515] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:32.896206 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:32.897253 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:32.892697 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "80006b8186d74baba29992ade1966048" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:32.898988 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:32.894191 29993 leader_election.cc:304] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:32.904935 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:32.905710 30174 raft_consensus.cc:1240] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:32.906689 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:32.907640 30168 raft_consensus.cc:1240] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 13 LEADER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:32.912029 30021 raft_consensus.cc:2468] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 10.
I20260709 13:11:32.913861 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:32.916427 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:32.916891 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:32.917433 30173 raft_consensus.cc:2468] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 7.
I20260709 13:11:32.877868  1293 raft_consensus.cc:2804] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:32.917898 30020 raft_consensus.cc:1275] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:11:32.925704 30020 pending_rounds.cc:85] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4: Aborting all ops after (but not including) 5
I20260709 13:11:32.925992 30020 pending_rounds.cc:107] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4: Aborting uncommitted NO_OP operation due to leader change: 8.6
W20260709 13:11:32.925899 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 47889.9us
W20260709 13:11:32.922063 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 44639.8us
I20260709 13:11:32.916497 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:32.928701 30174 raft_consensus.cc:2393] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 9: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:11:32.919436 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:32.912647 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:32.926281 30020 raft_consensus.cc:2889] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:32.924860 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:32.931448 30022 raft_consensus.cc:3060] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:32.931828 29993 leader_election.cc:304] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:32.933475 29993 leader_election.cc:304] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:32.935568 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:32.935933 30732 raft_consensus.cc:1240] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 LEADER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 13:11:32.941084 30736 raft_consensus.cc:1240] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 13 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:32.878324  1370 consensus_queue.cc:1048] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260709 13:11:32.949405 30022 raft_consensus.cc:2468] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 11.
I20260709 13:11:32.921918   948 raft_consensus.cc:2804] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:32.958771 30021 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "407fb380b889498d94c7525edbc34b23"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
mode: GRACEFUL
new_leader_uuid: "5ec73dc157ed476ca903a7d596271719"
 from {username='slave'} at 127.0.0.1:47450
I20260709 13:11:32.973630  1057 consensus_queue.cc:1048] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:32.992399 30021 raft_consensus.cc:606] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Received request to transfer leadership to TS 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:32.992815 30021 raft_consensus.cc:614] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:32.925424  1293 raft_consensus.cc:493] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:32.940304  1099 raft_consensus.cc:2749] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:32.986861 30068 leader_election.cc:304] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:32.989969 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1136db29fbad4093bcad74bb6274f752" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 12 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:32.928632  1311 raft_consensus.cc:493] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:32.943732  1215 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 13:11:32.945039  1342 raft_consensus.cc:2749] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:32.981155 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:32.996464 30140 leader_election.cc:304] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:33.023135 30140 leader_election.cc:304] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:32.990442  1193 consensus_queue.cc:1059] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 13:11:32.918320   928 consensus_queue.cc:1059] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 13:11:32.982749 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:32.999933 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:32.991245   948 raft_consensus.cc:493] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:33.001876 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:33.003981 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e218d3c3e368401a8eff81a5699074b8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:33.008972 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:33.010474 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:33.010906 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:33.006512  1293 raft_consensus.cc:3060] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:33.012099 30099 raft_consensus.cc:1275] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:11:33.048230 30103 raft_consensus.cc:2468] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 9.
I20260709 13:11:33.016942 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:33.025100 30140 leader_election.cc:304] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:32.991470  1295 consensus_queue.cc:1048] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260709 13:11:33.020732  1366 raft_consensus.cc:2749] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 13:11:33.028173 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:32.996402 30066 leader_election.cc:304] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:33.035266 30095 raft_consensus.cc:2368] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 6. Current term is 7.
W20260709 13:11:32.992617  1412 log.cc:927] Time spent T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 13:11:33.026247  1201 raft_consensus.cc:2749] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:33.029359  1325 raft_consensus.cc:2749] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 13:11:32.996400 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 58485us
I20260709 13:11:33.049628 30140 leader_election.cc:304] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:33.021236   900 raft_consensus.cc:493] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
W20260709 13:11:33.055393 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 59065.2us
I20260709 13:11:33.065768 30140 leader_election.cc:304] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:33.035249   948 raft_consensus.cc:3060] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:33.045097  1266 raft_consensus.cc:2749] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:33.050207  1200 raft_consensus.cc:2749] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:33.045212  1222 raft_consensus.cc:493] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:33.026247  1311 raft_consensus.cc:515] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:33.091209 30021 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "80006b8186d74baba29992ade1966048"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
mode: GRACEFUL
new_leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
 from {username='slave'} at 127.0.0.1:47450
I20260709 13:11:33.096180 30021 raft_consensus.cc:606] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 LEADER]: Received request to transfer leadership to TS 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:33.032676  1232 consensus_queue.cc:1048] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 13:11:33.061685   898 raft_consensus.cc:2749] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:33.054461   492 raft_consensus.cc:493] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:33.072141  1326 raft_consensus.cc:2749] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:33.099466 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:33.106629 29994 leader_election.cc:304] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:33.111250  1261 consensus_queue.cc:1059] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 13:11:33.132714  1311 leader_election.cc:290] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:33.133211 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:33.133862 30097 raft_consensus.cc:2468] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 13.
I20260709 13:11:33.103322  1222 raft_consensus.cc:515] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:33.134879  1431 log.cc:927] Time spent T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 13:11:33.136003  1222 leader_election.cc:290] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:33.136240  1312 leader_election.cc:290] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:33.136816  1317 leader_election.cc:290] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:33.136977 29994 leader_election.cc:304] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:33.138559  1383 raft_consensus.cc:2804] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:33.138912  1383 raft_consensus.cc:493] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:33.139227  1383 raft_consensus.cc:3060] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:33.140789  1211 raft_consensus.cc:515] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:33.141834 30023 raft_consensus.cc:1240] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 4. Current term is 5. Ops: []
I20260709 13:11:33.120065   492 raft_consensus.cc:515] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:33.145320   492 leader_election.cc:290] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:33.074406   900 raft_consensus.cc:515] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:33.115213  1361 leader_election.cc:290] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:33.147351   900 leader_election.cc:290] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:33.147509  1339 raft_consensus.cc:3055] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:33.147953  1339 raft_consensus.cc:740] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:33.148738   997 raft_consensus.cc:2804] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:33.149263   997 raft_consensus.cc:697] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:33.150048   997 consensus_queue.cc:237] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:33.154309  1383 raft_consensus.cc:515] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:33.179320 30069 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:33.136125  1425 log.cc:927] Time spent T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
W20260709 13:11:33.235478  1430 log.cc:927] Time spent T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.163s	user 0.002s	sys 0.000s
I20260709 13:11:33.245891  1361 raft_consensus.cc:493] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:33.148715  1339 consensus_queue.cc:260] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:33.358472  1361 raft_consensus.cc:515] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:33.414220  1339 raft_consensus.cc:3060] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:33.416559  1361 leader_election.cc:290] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:33.418355  1383 leader_election.cc:290] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 14 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:33.423489  1211 leader_election.cc:290] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:33.423261  1293 raft_consensus.cc:515] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:33.494902  1293 leader_election.cc:290] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:11:33.495772  1417 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.002s	sys 0.011s
W20260709 13:11:33.496220  1417 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.002s	sys 0.011s
W20260709 13:11:33.544798 29994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:33.551781 30068 leader_election.cc:304] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:33.553364 30096 raft_consensus.cc:1240] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:33.559535 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:33.559378 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:33.560791 30095 raft_consensus.cc:3060] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 13 FOLLOWER]: Advancing to term 14
W20260709 13:11:33.564611 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 498793us
I20260709 13:11:33.578992   492 raft_consensus.cc:493] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:33.582353 30168 raft_consensus.cc:1275] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 13:11:33.567889  1114 raft_consensus.cc:493] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:33.570990 30170 raft_consensus.cc:1275] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:11:33.580185   492 raft_consensus.cc:515] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:33.597479 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 46041.5us
I20260709 13:11:33.604390  1114 raft_consensus.cc:515] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:33.612138  1261 raft_consensus.cc:493] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.613036  1261 raft_consensus.cc:515] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:33.614517 30176 raft_consensus.cc:3060] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Advancing to term 7
I20260709 13:11:33.621434 30732 raft_consensus.cc:1275] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 13 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:11:33.634119  1283 consensus_queue.cc:1048] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:33.631374   898 consensus_queue.cc:1048] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:33.598624   853 raft_consensus.cc:2804] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:33.634202  1420 raft_consensus.cc:493] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:33.635020  1389 consensus_queue.cc:1048] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:33.625973   840 raft_consensus.cc:493] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
W20260709 13:11:33.596946 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 498503us
I20260709 13:11:33.642021   853 raft_consensus.cc:493] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:33.650059  1443 raft_consensus.cc:493] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:33.656661   853 raft_consensus.cc:3060] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:33.665855   840 raft_consensus.cc:515] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:33.669231  1443 raft_consensus.cc:515] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:33.672477  1443 leader_election.cc:290] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:33.672806 30098 raft_consensus.cc:1275] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:33.677744   492 leader_election.cc:290] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:33.683917  1114 leader_election.cc:290] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:33.677191  1420 raft_consensus.cc:515] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:33.692366 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 111661us
I20260709 13:11:33.692597 30168 raft_consensus.cc:1240] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:11:33.695443  1201 raft_consensus.cc:2749] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:33.700673 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:33.701658 30100 raft_consensus.cc:2468] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 11.
W20260709 13:11:33.703696  1433 log.cc:927] Time spent T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.284s	user 0.002s	sys 0.010s
I20260709 13:11:33.688412 30703 leader_election.cc:304] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
W20260709 13:11:33.699316 30027 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.011s	sys 0.015s
I20260709 13:11:33.710038 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
W20260709 13:11:33.712061 30027 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.012s	sys 0.015s
I20260709 13:11:33.699105 29993 leader_election.cc:304] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:33.716522  1452 consensus_queue.cc:1048] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 13:11:33.721307  1261 leader_election.cc:290] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:33.721776   840 leader_election.cc:290] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:33.727660 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 97981.8us
I20260709 13:11:33.724735 29994 leader_election.cc:304] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:33.731550  1193 raft_consensus.cc:2749] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:33.733618  1420 leader_election.cc:290] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:11:33.739177  1444 log.cc:927] Time spent T 00000000000000000000000000000000 P 1c91346f9a2a480e908d4e0323634aeb: Append to log took a long time: real 0.325s	user 0.006s	sys 0.008s
I20260709 13:11:33.712929  1297 consensus_queue.cc:1059] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.027s
I20260709 13:11:33.743708  1452 raft_consensus.cc:2749] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:33.743038  1261 raft_consensus.cc:2804] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 13:11:33.746151   948 consensus_meta.cc:287] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4: Time spent flushing consensus metadata: real 0.657s	user 0.016s	sys 0.000s
I20260709 13:11:33.766441 30170 raft_consensus.cc:1275] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:33.767792  1448 consensus_queue.cc:1048] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
W20260709 13:11:33.772930  1445 log.cc:927] Time spent T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.357s	user 0.005s	sys 0.009s
I20260709 13:11:33.776077 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:33.777916 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:33.778119 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:33.778580  1423 consensus_queue.cc:1048] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 13:11:33.778685  1266 consensus_queue.cc:1048] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:33.779448 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:33.780838 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:33.781904  1405 consensus_queue.cc:1059] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:33.782824   948 raft_consensus.cc:515] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:33.785006   948 leader_election.cc:290] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 13 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:33.788657 30100 raft_consensus.cc:2468] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 11.
W20260709 13:11:33.762756  1459 log.cc:927] Time spent T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 13:11:33.818897 30101 raft_consensus.cc:1275] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 13:11:33.763278  1261 raft_consensus.cc:493] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:33.823051  1113 consensus_queue.cc:1048] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 13:11:33.765064 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:33.832844 30097 raft_consensus.cc:2468] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 5.
I20260709 13:11:33.842404 30095 raft_consensus.cc:2468] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 14.
I20260709 13:11:33.846930 30099 raft_consensus.cc:1240] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:11:33.847234 30140 leader_election.cc:304] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:11:33.848453 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 83117.5us
I20260709 13:11:33.854257  1326 raft_consensus.cc:2749] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:33.809376   853 raft_consensus.cc:515] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:33.857372   853 leader_election.cc:290] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:33.858168 30019 raft_consensus.cc:1240] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 13 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 12. Current term is 13. Ops: []
I20260709 13:11:33.858682  1295 raft_consensus.cc:493] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.859375  1295 raft_consensus.cc:515] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:33.863816 30169 raft_consensus.cc:1240] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:11:33.865278  1113 consensus_queue.cc:1059] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:33.866822 30173 raft_consensus.cc:2468] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 11.
I20260709 13:11:33.868909 30143 leader_election.cc:400] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821) with higher term. Message: Invalid argument: T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 6. Current term is 7.
I20260709 13:11:33.869307 30143 leader_election.cc:403] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:33.868822 30702 leader_election.cc:304] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:33.870489  1423 raft_consensus.cc:2804] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:33.870904  1423 raft_consensus.cc:493] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:33.871344  1423 raft_consensus.cc:3060] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:33.838912  1261 raft_consensus.cc:3060] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:33.878391 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:33.880008  1423 raft_consensus.cc:515] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:33.881820  1450 log.cc:927] Time spent T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.467s	user 0.017s	sys 0.013s
I20260709 13:11:33.882236 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:33.883282 30019 raft_consensus.cc:2368] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 13. Current term is 14.
W20260709 13:11:33.883296  1451 log.cc:927] Time spent T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.466s	user 0.010s	sys 0.006s
I20260709 13:11:33.885385 30028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:33.890295  1423 leader_election.cc:290] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 12 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:33.891220 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:33.891980 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:33.892614 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:33.895750 30021 raft_consensus.cc:1275] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:33.861517  1295 leader_election.cc:290] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:33.895823 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:33.909199 29994 leader_election.cc:304] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
W20260709 13:11:33.903877 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 215055us
I20260709 13:11:33.911003 29993 leader_election.cc:304] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:33.912148  1323 raft_consensus.cc:493] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:33.912818 29993 leader_election.cc:304] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:33.912948  1323 raft_consensus.cc:515] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:33.892578 30174 raft_consensus.cc:3060] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:33.915019   853 raft_consensus.cc:493] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:33.917299   853 raft_consensus.cc:515] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:33.917826  1323 leader_election.cc:290] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:33.918200 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:33.917320 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:33.870705 30143 leader_election.cc:304] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:33.917632 30027 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:54198 (request call id 2205) took 1130 ms. Trace:
I20260709 13:11:33.918642 30101 raft_consensus.cc:1275] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:33.920868  1361 raft_consensus.cc:2749] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 13:11:33.924901  1283 raft_consensus.cc:493] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.925572 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:33.926045 30176 raft_consensus.cc:1275] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:33.925480  1283 raft_consensus.cc:515] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:33.913659   948 raft_consensus.cc:2749] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:33.926578  1326 raft_consensus.cc:2749] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821) with higher term. Message: Invalid argument: T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 6. Current term is 7.
I20260709 13:11:33.928333  1283 leader_election.cc:290] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:33.929889 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:33.930663 30094 raft_consensus.cc:2368] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 13. Current term is 14.
I20260709 13:11:33.931876  1452 raft_consensus.cc:2749] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:33.932565 30099 raft_consensus.cc:1275] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:33.933923 29993 leader_election.cc:304] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:33.935303  1295 raft_consensus.cc:2804] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 13:11:33.935600 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 86421.2us
I20260709 13:11:33.936479 30140 leader_election.cc:304] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:33.937244 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:33.919853 30027 rpcz_store.cc:276] 0709 13:11:32.787538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:32.802142 (+ 14604us) service_pool.cc:224] Handling call
0709 13:11:32.802392 (+   250us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:11:32.802568 (+   176us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 13:11:33.001681 (+199113us) log.cc:844] Serialized 14 byte log entry
0709 13:11:33.582581 (+580900us) spinlock_profiling.cc:243] Waited 28.9 ms on lock 0x7b1800043420. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f7e95de1 00007f99f7ea25b1 00007f99eefcd522 00007f99eefcf7c1 00007f99eefcf779 00007f99eefcf709 00007f99eefcf6d1 00007f99eefce9cd 000000000038f354 000000000038f199 00007f99eefb083a
0709 13:11:33.747009 (+164428us) log.cc:844] Serialized 14 byte log entry
0709 13:11:33.802918 (+ 55909us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 13:11:33.833498 (+ 30580us) raft_consensus.cc:1645] Marking committed up to 8
0709 13:11:33.900670 (+ 67172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:11:33.917388 (+ 16718us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:11:33.917568 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":29107,"prepare.queue_time_us":300566,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":82,"raft.queue_time_us":48712,"raft.run_cpu_time_us":367,"raft.run_wall_time_us":116389,"spinlock_wait_cycles":66391936,"thread_start_us":830649,"threads_started":3,"wal-append.queue_time_us":360962}
I20260709 13:11:33.942023  1458 raft_consensus.cc:3055] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Stepping down as leader of term 6
W20260709 13:11:33.925745 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 55177.4us
I20260709 13:11:33.943357 30140 leader_election.cc:304] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:33.944168  1361 raft_consensus.cc:2749] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:33.954480 30736 raft_consensus.cc:1275] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:11:33.954917 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:33.955475  1323 raft_consensus.cc:493] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:33.955569 30169 raft_consensus.cc:2468] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 7.
I20260709 13:11:33.956291   928 consensus_queue.cc:1048] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:33.956215  1323 raft_consensus.cc:515] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:33.942442  1458 raft_consensus.cc:740] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:33.987560  1323 leader_election.cc:290] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:33.987205  1458 consensus_queue.cc:260] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:33.988070  1421 raft_consensus.cc:3055] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:33.993662 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "143490b42f5d4687a680435e8cd86d1f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:33.942962  1295 raft_consensus.cc:493] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:33.997980 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 88951.1us
I20260709 13:11:34.002545 30176 raft_consensus.cc:3060] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:34.002787 30027 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:11:33.999598 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 65870.6us
I20260709 13:11:34.016482 29994 leader_election.cc:304] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:33.999291  1423 consensus_queue.cc:1048] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 13:11:34.026432 30703 leader_election.cc:400] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 13 pre-election: Vote denied by peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821) with higher term. Message: Invalid argument: T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 13. Current term is 14.
I20260709 13:11:34.026777 30703 leader_election.cc:403] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:34.033838 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:34.034950 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3a0f0dc1823e4c99aa3cc53ce8a58efa" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:33.997932  1295 raft_consensus.cc:3060] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:34.002931  1297 raft_consensus.cc:2804] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:34.037233 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:33.996693  1421 raft_consensus.cc:740] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:34.044523 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:34.044443 30099 raft_consensus.cc:2468] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 7.
I20260709 13:11:34.046386 30097 raft_consensus.cc:1275] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 13:11:33.994472  1361 consensus_queue.cc:1048] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.050s
I20260709 13:11:33.995280  1323 consensus_queue.cc:1048] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.048s
W20260709 13:11:34.053738 29994 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:34.052389 30066 leader_election.cc:304] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:34.066190 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:34.065699 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:34.066344 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:34.068667 30025 raft_consensus.cc:1275] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 13:11:34.069439 30026 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:34.087433 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:34.058548  1458 raft_consensus.cc:3060] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:34.053020  1297 raft_consensus.cc:697] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 14 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:34.095432 30703 leader_election.cc:304] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
W20260709 13:11:34.089198  1057 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.908s	user 0.029s	sys 0.024s
I20260709 13:11:34.098475 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:34.102310  1293 raft_consensus.cc:493] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.102703  1178 raft_consensus.cc:3060] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Advancing to term 14
I20260709 13:11:34.103039  1453 raft_consensus.cc:2804] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:11:34.102880 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:34.103322  1339 consensus_queue.cc:1059] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 13:11:34.104147 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:34.058548  1266 consensus_queue.cc:1048] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 13:11:34.105878  1282 consensus_queue.cc:1059] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 13:11:34.107985 30700 leader_election.cc:304] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:34.101620 30143 leader_election.cc:304] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
W20260709 13:11:34.106788  1057 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.031s	user 0.029s	sys 0.024s
I20260709 13:11:34.045092 30021 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
mode: GRACEFUL
new_leader_uuid: "5ec73dc157ed476ca903a7d596271719"
 from {username='slave'} at 127.0.0.1:47450
I20260709 13:11:34.062625  1317 consensus_queue.cc:1048] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.079s
I20260709 13:11:34.109185  1344 raft_consensus.cc:2749] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:34.141615 30175 raft_consensus.cc:3060] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:34.126819  1293 raft_consensus.cc:515] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:34.154011  1293 leader_election.cc:290] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:34.126220   853 leader_election.cc:290] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:34.143626 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b66f98d7fcfe4102a01ace9ed64355ed" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:34.157940  1421 consensus_queue.cc:260] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:34.159256  1421 raft_consensus.cc:3060] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:34.159606   959 raft_consensus.cc:993] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4: : Instructing follower 5ec73dc157ed476ca903a7d596271719 to start an election
I20260709 13:11:34.160184   959 raft_consensus.cc:1081] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 LEADER]: Signalling peer 5ec73dc157ed476ca903a7d596271719 to start an election
I20260709 13:11:34.120297  1261 raft_consensus.cc:515] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:34.140362  1453 raft_consensus.cc:697] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:34.180897 29993 leader_election.cc:304] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:34.145020  1201 consensus_queue.cc:1048] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 13:11:34.188874 30023 raft_consensus.cc:2368] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 11. Current term is 12.
I20260709 13:11:34.175139   492 raft_consensus.cc:2804] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:34.177337 30095 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0be979412dd54241bd212ddbb7611046"
dest_uuid: "5ec73dc157ed476ca903a7d596271719"
 from {username='slave'} at 127.0.0.1:33990
I20260709 13:11:34.201992 30095 raft_consensus.cc:493] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:34.202358 30095 raft_consensus.cc:3060] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:34.203272 30176 raft_consensus.cc:2468] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 7.
I20260709 13:11:34.196858  1295 raft_consensus.cc:515] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:34.198923 30177 raft_consensus.cc:1275] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:34.199441  1261 leader_election.cc:290] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 12 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:34.212466 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:34.213021 30100 raft_consensus.cc:3060] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:34.184319  1297 consensus_queue.cc:237] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:34.219955 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 85325.4us
I20260709 13:11:34.229796  1366 raft_consensus.cc:493] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:34.230501 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:34.230350  1366 raft_consensus.cc:515] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:34.231298 30176 raft_consensus.cc:2393] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 in current term 5: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
I20260709 13:11:34.231345  1417 raft_consensus.cc:2749] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:34.233152  1453 consensus_queue.cc:237] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:34.228857 30095 raft_consensus.cc:515] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:34.238461 30095 leader_election.cc:290] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:34.243750 30068 leader_election.cc:304] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:34.244418 30140 leader_election.cc:304] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:34.245873  1283 raft_consensus.cc:2804] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:34.246351  1283 raft_consensus.cc:493] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:34.245282 30068 leader_election.cc:304] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:34.246706  1283 raft_consensus.cc:3060] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:34.247696  1317 raft_consensus.cc:2749] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:34.250869 30024 raft_consensus.cc:3055] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:34.251276 30024 raft_consensus.cc:740] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:34.252063 30024 consensus_queue.cc:260] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:34.253105 30024 raft_consensus.cc:3060] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:34.254531  1448 raft_consensus.cc:2749] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:34.255693 30140 leader_election.cc:304] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:34.261785 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:34.266501 30068 leader_election.cc:304] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:34.270584  1260 raft_consensus.cc:2804] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:34.271281  1260 raft_consensus.cc:697] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 7 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:34.272253  1260 consensus_queue.cc:237] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:34.273950  1448 raft_consensus.cc:2749] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:34.276324 30103 raft_consensus.cc:1275] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:11:34.279224 30140 leader_election.cc:304] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:11:34.280022 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 184676us
I20260709 13:11:34.280545  1323 raft_consensus.cc:2804] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:34.281839 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:34.282140  1323 raft_consensus.cc:493] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:34.282539  1323 raft_consensus.cc:3060] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:34.284189  1114 consensus_queue.cc:1048] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:34.280843 30023 raft_consensus.cc:1275] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 13 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:11:34.285949  1443 raft_consensus.cc:3055] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:34.286335  1443 raft_consensus.cc:740] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:34.287173  1443 consensus_queue.cc:260] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:34.288292  1443 raft_consensus.cc:3060] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:34.288911 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:34.289741 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5616428acc64e24945a779e1aee597f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:34.282639 30177 raft_consensus.cc:2393] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 11: Already voted for candidate c99569d27a6f4c648eae7119fe3db124 in this term.
W20260709 13:11:34.292161 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 198075us
I20260709 13:11:34.298480 30174 raft_consensus.cc:2468] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 12.
I20260709 13:11:34.298679 30700 leader_election.cc:400] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 13 pre-election: Vote denied by peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451) with higher term. Message: Invalid argument: T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 13. Current term is 14.
I20260709 13:11:34.226568   492 raft_consensus.cc:697] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 11 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:34.302634   492 consensus_queue.cc:237] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:34.303546  1420 raft_consensus.cc:2749] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:34.303027 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:34.326661 30175 raft_consensus.cc:2468] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 8.
I20260709 13:11:34.331858 30024 raft_consensus.cc:1275] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
W20260709 13:11:34.337548 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 213638us
I20260709 13:11:34.289633  1178 raft_consensus.cc:2749] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821) with higher term. Message: Invalid argument: T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 13. Current term is 14.
I20260709 13:11:34.339499 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:34.332270 30024 pending_rounds.cc:85] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4: Aborting all ops after (but not including) 7
W20260709 13:11:34.340018 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 60893.5us
I20260709 13:11:34.341279 30140 leader_election.cc:304] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:34.340052 30100 raft_consensus.cc:2468] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 12.
I20260709 13:11:34.306990  1326 raft_consensus.cc:2749] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:34.343154 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:11:34.344085 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 247948us
I20260709 13:11:34.352411 30023 raft_consensus.cc:1240] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 13:11:34.346063 30700 leader_election.cc:304] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:34.347203 29994 leader_election.cc:304] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:34.340315 30024 pending_rounds.cc:107] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 13:11:34.358229 30024 raft_consensus.cc:2889] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:34.359475 30175 raft_consensus.cc:1240] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 12 LEADER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 13:11:34.360028 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:34.358364 30728 raft_consensus.cc:2468] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 14.
I20260709 13:11:34.373775 30737 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:34.339553  1448 raft_consensus.cc:2749] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:34.370266 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:34.385223 30734 raft_consensus.cc:1275] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:34.389570 30021 raft_consensus.cc:606] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 14 LEADER]: Received request to transfer leadership to TS 5ec73dc157ed476ca903a7d596271719
W20260709 13:11:34.382191  1452 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
W20260709 13:11:34.394865 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 53660.4us
I20260709 13:11:34.393716 30068 leader_election.cc:304] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:34.396672 30140 leader_election.cc:400] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 election: Vote denied by peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451) with higher term. Message: Invalid argument: T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 11. Current term is 12.
I20260709 13:11:34.360620  1201 consensus_queue.cc:1048] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 13:11:34.409233  1269 raft_consensus.cc:2804] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:34.391238  1178 raft_consensus.cc:2749] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:34.415830 30068 leader_election.cc:304] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:34.420892 30172 raft_consensus.cc:1240] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:34.421298  1057 raft_consensus.cc:2804] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:34.421571 30733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a3e809a994e4cbf98d7ea56807b8dad" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:34.422101  1057 raft_consensus.cc:697] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 8 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:34.422607  1306 raft_consensus.cc:493] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
W20260709 13:11:34.423002 29992 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:34.423672  1270 raft_consensus.cc:493] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:34.423475  1057 consensus_queue.cc:237] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:34.424254  1270 raft_consensus.cc:515] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:34.426007 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "57ce415a86d343cb8bdff28acc41c6a6" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:34.436643 30019 raft_consensus.cc:3055] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:34.437041 30019 raft_consensus.cc:740] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:34.434707  1269 raft_consensus.cc:697] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:34.450203  1270 leader_election.cc:290] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:34.459328 30730 raft_consensus.cc:1240] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:34.450448  1358 raft_consensus.cc:2749] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:11:34.452114  1478 log.cc:927] Time spent T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:11:34.447335  1411 raft_consensus.cc:3055] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 LEADER]: Stepping down as leader of term 10
I20260709 13:11:34.456741 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
W20260709 13:11:34.498977 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 106186us
I20260709 13:11:34.436787  1114 consensus_queue.cc:1059] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260709 13:11:34.423208  1306 raft_consensus.cc:515] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:34.441664  1370 consensus_queue.cc:1048] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.147s
I20260709 13:11:34.461745  1323 raft_consensus.cc:515] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:34.504948 30019 consensus_queue.cc:260] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:34.515125 30019 raft_consensus.cc:3060] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:34.481149  1411 raft_consensus.cc:740] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:34.461544  1283 raft_consensus.cc:515] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:34.513429   492 raft_consensus.cc:493] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:11:34.569366 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 143747us
I20260709 13:11:34.502175  1448 consensus_queue.cc:1048] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.018s
I20260709 13:11:34.504333  1358 consensus_queue.cc:1048] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
W20260709 13:11:34.570544 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 70820us
I20260709 13:11:34.563651  1339 raft_consensus.cc:493] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:34.581765   900 raft_consensus.cc:3055] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:34.603740 30172 raft_consensus.cc:1240] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 6. Current term is 7. Ops: []
I20260709 13:11:34.604489 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
W20260709 13:11:34.634207 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 51559.3us
I20260709 13:11:34.581815  1481 raft_consensus.cc:2749] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:34.598021   900 raft_consensus.cc:740] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:34.657171  1495 raft_consensus.cc:493] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:34.657908  1495 raft_consensus.cc:515] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:34.597812   492 raft_consensus.cc:515] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:34.668776 29992 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:34.672957  1323 leader_election.cc:290] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:34.673146  1495 leader_election.cc:290] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:34.674404  1483 log.cc:927] Time spent T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260709 13:11:34.678203   900 consensus_queue.cc:260] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:34.679358   900 raft_consensus.cc:3060] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:34.642297  1339 raft_consensus.cc:515] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:34.690608 30019 raft_consensus.cc:2468] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 9.
I20260709 13:11:34.599086  1269 consensus_queue.cc:237] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:34.692485  1493 raft_consensus.cc:493] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:34.700258 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
W20260709 13:11:34.701189 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 253559us
I20260709 13:11:34.708536 30731 raft_consensus.cc:2468] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 13.
W20260709 13:11:34.710359 29991 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:34.711886  1490 log.cc:927] Time spent T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 13:11:34.700699  1496 raft_consensus.cc:493] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:34.717546  1496 raft_consensus.cc:515] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:34.719571  1496 leader_election.cc:290] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:11:34.719830 30068 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:34.727519  1358 raft_consensus.cc:493] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:34.728174  1358 raft_consensus.cc:515] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:34.714576  1283 leader_election.cc:290] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:34.713650  1493 raft_consensus.cc:515] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:34.733490  1493 leader_election.cc:290] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:34.734438  1358 leader_election.cc:290] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:34.735729   492 leader_election.cc:290] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:34.738610  1339 leader_election.cc:290] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:34.764380 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:34.765805 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:34.766498 30101 raft_consensus.cc:2468] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 9.
I20260709 13:11:34.767715 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:34.768426 30097 raft_consensus.cc:2393] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 7: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:34.770545 30094 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
W20260709 13:11:34.774648 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 65495.8us
I20260709 13:11:34.777326 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:34.783465 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:34.786787 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:34.793213 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:34.799327 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:34.801090 30729 raft_consensus.cc:2368] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 7. Current term is 8.
I20260709 13:11:34.824709 30142 leader_election.cc:400] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469) with higher term. Message: Invalid argument: T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 7. Current term is 8.
I20260709 13:11:34.825030 30142 leader_election.cc:403] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:34.826470  1496 raft_consensus.cc:3060] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Advancing to term 8
I20260709 13:11:34.834502  1057 raft_consensus.cc:493] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:34.835140  1057 raft_consensus.cc:515] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:34.836215 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:34.837895 30177 raft_consensus.cc:1275] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:11:34.850726 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 215800us
I20260709 13:11:34.851469 30702 leader_election.cc:304] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:11:34.853964  1503 log.cc:927] Time spent T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.168s	user 0.003s	sys 0.000s
I20260709 13:11:34.861129  1366 leader_election.cc:290] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:34.867307 30022 raft_consensus.cc:1240] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 LEADER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:34.877036  1496 raft_consensus.cc:2749] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469) with higher term. Message: Invalid argument: T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 7. Current term is 8.
I20260709 13:11:34.888514 29993 leader_election.cc:304] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
W20260709 13:11:34.969282 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 101868us
I20260709 13:11:34.991948 30175 raft_consensus.cc:1240] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 11. Current term is 12. Ops: []
W20260709 13:11:34.908638 29992 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:34.992620 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:34.989373 30171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:34.990733 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:11:34.989573 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 138192us
I20260709 13:11:34.993413 30025 raft_consensus.cc:1275] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:34.994100 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:34.994823 30174 raft_consensus.cc:1275] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 13:11:34.990252 30143 leader_election.cc:304] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:34.973589  1178 raft_consensus.cc:2804] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:35.004348 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:35.005010 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:35.005272 30101 raft_consensus.cc:3060] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:35.004436 30143 leader_election.cc:304] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:35.009711 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:34.998879  1417 raft_consensus.cc:2749] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:34.999744  1389 raft_consensus.cc:493] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.010195  1501 raft_consensus.cc:2804] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:35.010078   492 raft_consensus.cc:2749] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:11:35.026216 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 137792us
I20260709 13:11:35.029465 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c6d87bb3ff11400cbdaf30e614c4b3da" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:35.049192 29993 leader_election.cc:304] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:35.069206  1383 raft_consensus.cc:2749] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:11:35.070495 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 69682us
I20260709 13:11:35.021045  1178 raft_consensus.cc:697] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:35.042009  1501 raft_consensus.cc:493] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:35.089943  1501 raft_consensus.cc:3060] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:35.092531   997 consensus_queue.cc:1059] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:35.094631  1383 raft_consensus.cc:3055] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:35.095026  1383 raft_consensus.cc:740] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:35.024834  1057 leader_election.cc:290] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:35.095894  1383 consensus_queue.cc:260] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:35.097072  1383 raft_consensus.cc:3060] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:35.100068  1501 raft_consensus.cc:515] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:35.107306  1501 leader_election.cc:290] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:35.109234  1295 leader_election.cc:290] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:35.110008 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "21562b36aa874c9cba1acd5dc79cf517" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:35.111274 30026 raft_consensus.cc:3055] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:35.111618 30026 raft_consensus.cc:740] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:35.112433 30026 consensus_queue.cc:260] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:35.113379 30026 raft_consensus.cc:3060] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:35.024063  1389 raft_consensus.cc:515] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:35.116014  1389 leader_election.cc:290] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:35.117336  1358 raft_consensus.cc:493] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.117882  1358 raft_consensus.cc:515] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:35.119585 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:35.120420 30096 raft_consensus.cc:2410] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 4.
I20260709 13:11:35.122054 30099 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:35.124292 30100 raft_consensus.cc:1240] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 8 LEADER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:35.127523 30098 raft_consensus.cc:1240] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:35.133231 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff758e6a87fa49b99c35558fafe39f11" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:35.136870  1178 consensus_queue.cc:237] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:35.141628 30734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "30a540a1b03746b785f2fc4692e05833" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:35.146736 30140 leader_election.cc:304] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:35.147621 30101 raft_consensus.cc:2468] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 8.
I20260709 13:11:35.149729 30736 raft_consensus.cc:1275] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 14 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:11:35.150048 30103 raft_consensus.cc:1275] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:11:35.119872  1358 leader_election.cc:290] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:35.172359  1411 consensus_queue.cc:260] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:35.152850  1326 raft_consensus.cc:2749] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:35.177263 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:35.180163 30101 raft_consensus.cc:1275] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 14 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 13:11:35.183805 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:35.186764 29993 leader_election.cc:304] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:35.188637 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:35.191991 29993 leader_election.cc:304] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:35.193393 30066 leader_election.cc:304] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:35.190269  1411 raft_consensus.cc:3060] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:35.193933   997 raft_consensus.cc:2749] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:35.179194  1497 consensus_queue.cc:1059] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:11:35.191479  1295 raft_consensus.cc:2749] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:35.179546  1453 consensus_queue.cc:1048] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.020s
I20260709 13:11:35.195336  1260 consensus_queue.cc:1048] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260709 13:11:35.205513  1366 raft_consensus.cc:2804] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:35.210507  1497 consensus_queue.cc:1243] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer b2cea0098c1040f69755ea4d3dab7fc4 log is divergent from this leader: its last log entry 12.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 13:11:35.230074 29993 leader_election.cc:304] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:35.227332  1366 raft_consensus.cc:697] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 9 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
W20260709 13:11:35.245194 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 45358.5us
W20260709 13:11:35.249359  1500 log.cc:927] Time spent T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.575s	user 0.002s	sys 0.000s
I20260709 13:11:35.250469 30026 raft_consensus.cc:1275] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 13:11:35.256145 29994 leader_election.cc:304] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
W20260709 13:11:35.272249  1531 log.cc:927] Time spent T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 13:11:35.254968  1201 raft_consensus.cc:3055] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 13:11:35.282039  1201 raft_consensus.cc:740] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:35.255726  1453 raft_consensus.cc:2804] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:35.278370 30177 raft_consensus.cc:1240] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:11:35.261914  1452 consensus_queue.cc:1059] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:35.280651 30173 raft_consensus.cc:2468] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 8.
I20260709 13:11:35.283622  1339 raft_consensus.cc:2749] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:35.291898 30025 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
mode: GRACEFUL
new_leader_uuid: "5ec73dc157ed476ca903a7d596271719"
 from {username='slave'} at 127.0.0.1:47450
I20260709 13:11:35.292450 30025 raft_consensus.cc:606] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Received request to transfer leadership to TS 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:35.293094 30025 raft_consensus.cc:614] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:35.295559 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:35.296294 30021 raft_consensus.cc:2393] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 9: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:35.306073 30173 raft_consensus.cc:1240] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Rejecting Update request from peer 6f3eb161e2194f6891f12e2cfcaaf73a for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 13:11:35.307819 30702 leader_election.cc:304] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:35.295495  1453 raft_consensus.cc:697] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 13 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
W20260709 13:11:35.325415  1527 log.cc:927] Time spent T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
I20260709 13:11:35.334129 28889 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:11:35.325714  1443 raft_consensus.cc:2804] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader election won for term 8
W20260709 13:11:35.338222  1535 log.cc:927] Time spent T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 13:11:35.339665  1453 consensus_queue.cc:237] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:35.286888  1201 consensus_queue.cc:260] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:35.343659  1201 raft_consensus.cc:3060] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:35.348923  1443 raft_consensus.cc:697] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:35.350589  1443 consensus_queue.cc:237] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:35.311002  1366 consensus_queue.cc:237] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:35.362267  1534 log.cc:927] Time spent T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:11:35.320888  1339 consensus_queue.cc:1048] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.044s
W20260709 13:11:35.378448  1530 log.cc:927] Time spent T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.365s	user 0.000s	sys 0.003s
I20260709 13:11:35.387202 28889 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
W20260709 13:11:35.421166 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 126926us
I20260709 13:11:35.402627  1497 raft_consensus.cc:493] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:35.432556  1497 raft_consensus.cc:515] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:35.451579  1497 leader_election.cc:290] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:35.469305 30098 raft_consensus.cc:1275] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:11:35.470845 30703 leader_election.cc:304] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:35.424073  1538 consensus_queue.cc:1048] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 13:11:35.488844 30175 raft_consensus.cc:1275] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 13:11:35.489288 30175 pending_rounds.cc:85] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124: Aborting all ops after (but not including) 6
I20260709 13:11:35.489493 30175 pending_rounds.cc:107] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 13:11:35.489699 30175 raft_consensus.cc:2889] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:11:35.493736 30068 leader_election.cc:304] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:35.499562   898 consensus_queue.cc:1048] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:35.500859 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:35.501420 30728 raft_consensus.cc:2468] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 9.
I20260709 13:11:35.502161   910 consensus_queue.cc:1048] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:35.503077   898 raft_consensus.cc:2749] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:35.504360 30174 raft_consensus.cc:1275] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:11:35.506621  1370 consensus_queue.cc:1048] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 13:11:35.473599  1448 raft_consensus.cc:493] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:35.514938  1448 raft_consensus.cc:515] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:35.516991  1448 leader_election.cc:290] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:35.518916  1417 raft_consensus.cc:3055] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:35.519326  1417 raft_consensus.cc:740] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:35.520140  1417 consensus_queue.cc:260] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:35.521126  1417 raft_consensus.cc:3060] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:35.547303  1306 leader_election.cc:290] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:35.506279  1510 raft_consensus.cc:2749] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:35.582588 29993 leader_election.cc:304] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
W20260709 13:11:35.596179 30143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:11:35.596606 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 85567.3us
I20260709 13:11:35.657938 30172 raft_consensus.cc:1275] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260709 13:11:35.658187 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 75720.3us
I20260709 13:11:35.627228 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:35.662508 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:35.663453 30732 raft_consensus.cc:2468] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 9.
I20260709 13:11:35.675836   997 consensus_queue.cc:1048] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:35.676834 30102 raft_consensus.cc:1240] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 7. Current term is 8. Ops: []
I20260709 13:11:35.665558  1537 consensus_queue.cc:1059] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 13:11:35.671411  1443 consensus_queue.cc:1048] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 13:11:35.659932  1453 raft_consensus.cc:2749] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 13:11:35.688105  1448 raft_consensus.cc:493] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:35.688637  1448 raft_consensus.cc:515] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:35.692832 30025 raft_consensus.cc:1275] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 13:11:35.595827  1358 raft_consensus.cc:493] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.672515 30068 leader_election.cc:304] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:35.615336  1481 raft_consensus.cc:493] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:35.700380 30068 leader_election.cc:304] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:35.701151   853 raft_consensus.cc:2749] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:35.708907 30068 leader_election.cc:304] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:35.701440  1260 raft_consensus.cc:3060] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:35.697604  1495 consensus_queue.cc:1048] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260709 13:11:35.712188   853 raft_consensus.cc:2749] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:11:35.712790 30701 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:35.713634  1540 consensus_queue.cc:1048] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:35.727967 30142 leader_election.cc:304] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:35.737877 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:35.698729  1358 raft_consensus.cc:515] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:35.702099  1481 raft_consensus.cc:515] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:35.733810  1542 log.cc:927] Time spent T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 13:11:35.733956  1501 raft_consensus.cc:2804] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 13:11:35.812048 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 81963.7us
I20260709 13:11:35.809445  1545 consensus_queue.cc:1048] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.106s
I20260709 13:11:35.815704 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:35.765255  1501 raft_consensus.cc:493] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:35.845618  1501 raft_consensus.cc:3060] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:35.862162 30736 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:35.866108 30177 raft_consensus.cc:1240] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Rejecting Update request from peer b2cea0098c1040f69755ea4d3dab7fc4 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 13:11:35.866382 30736 raft_consensus.cc:2393] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 13: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:11:35.872059 30142 leader_election.cc:304] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:35.864450  1448 leader_election.cc:290] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:35.882718  1492 raft_consensus.cc:3060] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:35.892727  1492 raft_consensus.cc:2749] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:11:35.898660  1557 log.cc:927] Time spent T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 13:11:35.911082  1552 raft_consensus.cc:493] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:35.911587  1552 raft_consensus.cc:515] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:35.913553  1552 leader_election.cc:290] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:11:35.948935 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 92117.3us
W20260709 13:11:35.950927 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 112245us
I20260709 13:11:35.952404  1358 leader_election.cc:290] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:35.970413  1269 raft_consensus.cc:3055] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:35.981833  1269 raft_consensus.cc:740] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:35.986511 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:35.987331 30730 raft_consensus.cc:2410] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 13:11:35.992969  1260 raft_consensus.cc:2749] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:35.977260 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:35.995051 30019 raft_consensus.cc:2468] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 8.
I20260709 13:11:36.001277  1481 leader_election.cc:290] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:35.958395 30068 leader_election.cc:304] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: c99569d27a6f4c648eae7119fe3db124
W20260709 13:11:36.031170 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 70651us
I20260709 13:11:35.881739  1453 consensus_queue.cc:1059] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.129s
I20260709 13:11:36.035079   898 raft_consensus.cc:2804] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:36.043758   898 raft_consensus.cc:493] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:36.044077   898 raft_consensus.cc:3060] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:36.047504 29920 catalog_manager.cc:5697] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 3 to 8, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 8 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } }
I20260709 13:11:36.034235 30066 leader_election.cc:304] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:36.054996 30101 raft_consensus.cc:1240] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 11. Current term is 12. Ops: []
I20260709 13:11:36.054164 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
W20260709 13:11:36.083623 30143 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:36.084868 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:36.089730 30098 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:36.061926  1569 raft_consensus.cc:2804] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:36.093398 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a14bd61c7a94d1ca54063afae0c68e8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:36.049391 29920 catalog_manager.cc:5697] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 8 to 11, leader changed from 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 11 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } }
W20260709 13:11:36.109127 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 155786us
I20260709 13:11:36.098116  1569 raft_consensus.cc:493] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:36.128052  1269 consensus_queue.cc:260] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:36.129287  1269 raft_consensus.cc:3060] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:36.132493 30730 raft_consensus.cc:1275] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 13 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:11:36.136503 30168 raft_consensus.cc:1275] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 13 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 13:11:36.138103 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:36.142505 30703 leader_election.cc:304] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:36.146920 30174 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:36.147576 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:36.153352 30143 leader_election.cc:304] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:36.154498 30170 raft_consensus.cc:1275] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 13:11:36.161345 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 48930.9us
I20260709 13:11:36.156968 30143 leader_election.cc:304] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:36.134047  1569 raft_consensus.cc:3060] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:36.167897 30143 leader_election.cc:304] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:11:36.210593 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 68177.4us
I20260709 13:11:36.162120  1448 raft_consensus.cc:2749] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:36.209365  1492 raft_consensus.cc:2749] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:11:36.211431 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 43628.7us
I20260709 13:11:36.215989  1443 raft_consensus.cc:493] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.231679   492 raft_consensus.cc:493] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:36.232156   492 raft_consensus.cc:515] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:36.233424 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2964592ff08b4434889d830c05501d8e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
W20260709 13:11:36.236748 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 73338.9us
I20260709 13:11:36.236593   910 consensus_queue.cc:1048] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 13:11:36.234310  1443 raft_consensus.cc:515] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:36.244791  1443 leader_election.cc:290] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:11:36.228408 29924 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39956 (request call id 230) took 22383 ms (client timeout 15000 ms). Trace:
W20260709 13:11:36.247989  1562 log.cc:927] Time spent T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 13:11:36.249768  1498 raft_consensus.cc:2749] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:36.216830  1495 raft_consensus.cc:3060] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:36.170785 29920 catalog_manager.cc:5697] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 3 to 5, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 5 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } }
I20260709 13:11:36.256318 29920 catalog_manager.cc:5697] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:36.263224  1567 raft_consensus.cc:493] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:36.263785  1567 raft_consensus.cc:515] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:36.264762 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:36.264981 30170 raft_consensus.cc:1275] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:36.265465 30021 raft_consensus.cc:2393] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 8: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:11:36.265144 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:36.266148 30168 raft_consensus.cc:2468] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 11.
I20260709 13:11:36.270224 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:36.264148   492 leader_election.cc:290] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:36.276973 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 48466.6us
I20260709 13:11:36.273958  1567 leader_election.cc:290] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:36.227876   898 raft_consensus.cc:515] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:36.292285   898 leader_election.cc:290] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 10 election: Requested vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:36.279253  1370 consensus_queue.cc:1048] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
I20260709 13:11:36.292966 30098 raft_consensus.cc:2368] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 9. Current term is 10.
W20260709 13:11:36.246193 29924 rpcz_store.cc:269] 0709 13:11:13.778698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:13.778919 (+   221us) service_pool.cc:224] Handling call
0709 13:11:14.593859 (+814940us) spinlock_profiling.cc:243] Waited 2.52 ms on lock 0x7b54001a4354. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2024090 00007f99f20c2f3a 00007f99f7e791cc 00007f99f7f7737e 00007f99f64382a4 00007f99f6438232 00007f99f6438161 00007f99f64380dc 00007f99f6437392 00007f99f03f548c 00007f99f03f48c6
0709 13:11:36.152465 (+21558606us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:33.037451 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:33.038041 (+   590us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:33.038071 (+    30us) write_op.cc:435] Acquired schema lock
0709 13:11:33.038089 (+    18us) tablet.cc:662] Decoding operations
0709 13:11:33.038804 (+   715us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:33.038873 (+    69us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:33.038897 (+    24us) tablet.cc:685] Acquiring locks for 6 operations
0709 13:11:33.039411 (+   514us) tablet.cc:701] Row locks acquired
0709 13:11:33.039433 (+    22us) write_op.cc:260] PREPARE: finished
0709 13:11:33.039577 (+   144us) write_op.cc:270] Start()
0709 13:11:33.039684 (+   107us) write_op.cc:276] Timestamp: P: 1783602693039534 usec, L: 0
0709 13:11:33.039702 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:11:33.044595 (+  4893us) log.cc:844] Serialized 2434 byte log entry
0709 13:11:33.734580 (+689985us) spinlock_profiling.cc:243] Waited 26.6 ms on lock 0x7b4400022b4c. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99eee55db1 00007f99eeef3c85 00007f99eeef46a2 00007f99f1c661db 00007f99f1c61aaf 00007f99f1c5586e 00007f99f1c54bb6 00007f99f1c547d8 00007f99f1c5e221 00007f99f1c5e1d9 00007f99f1c5e169
0709 13:11:34.024471 (+289891us) op_driver.cc:464] REPLICATION: finished
0709 13:11:34.221972 (+197501us) write_op.cc:301] APPLY: starting
0709 13:11:34.262934 (+ 40962us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:34.263184 (+   250us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:34.263218 (+    34us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:34.264115 (+   897us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:34.264492 (+   377us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 13:11:34.264535 (+    43us) write_op.cc:312] APPLY: finished
0709 13:11:34.264933 (+   398us) log.cc:844] Serialized 53 byte log entry
0709 13:11:34.265116 (+   183us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:34.265278 (+   162us) write_op.cc:454] Released schema lock
0709 13:11:34.265330 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:34.328104 (+ 62774us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:34.334892 (+  6788us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":200,"mutex_wait_us":3617127,"reported_tablets":36,"spinlock_wait_cycles":5802368,"child_traces":[["op",{"apply.queue_time_us":177909,"apply.run_cpu_time_us":6695,"apply.run_wall_time_us":49065,"num_ops":6,"prepare.queue_time_us":85374,"prepare.run_cpu_time_us":20266,"prepare.run_wall_time_us":241192,"raft.queue_time_us":257158,"raft.run_cpu_time_us":18886,"raft.run_wall_time_us":94899,"replication_time_us":984593,"spinlock_wait_cycles":61300352,"thread_start_us":367822,"threads_started":4,"wal-append.queue_time_us":338762,"wal-append.run_cpu_time_us":45579,"wal-append.run_wall_time_us":1893708}]]}
I20260709 13:11:36.316808 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:36.317927 30143 leader_election.cc:304] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:36.321827  1201 raft_consensus.cc:2749] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:36.347523 30096 raft_consensus.cc:1275] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:36.348289 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:36.349116 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:36.342198  1306 raft_consensus.cc:493] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:36.359651 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:36.297657  1501 raft_consensus.cc:515] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:36.360633 30731 raft_consensus.cc:3060] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:36.363448 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:36.296168 29920 catalog_manager.cc:5697] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 7 to 10, leader changed from c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) to 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68). New cstate: current_term: 10 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:36.394090 30068 leader_election.cc:304] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:36.394927   853 raft_consensus.cc:2749] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:36.397460 30170 raft_consensus.cc:3060] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:36.397595 30068 leader_election.cc:304] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:36.351871  1569 raft_consensus.cc:515] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:36.403285   948 consensus_queue.cc:1048] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 13:11:36.404235  1569 leader_election.cc:290] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:36.404999 30096 raft_consensus.cc:2368] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 8. Current term is 9.
I20260709 13:11:36.396039  1306 raft_consensus.cc:515] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:36.405740 29920 catalog_manager.cc:5697] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 7 to 12. New cstate: current_term: 12 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:36.407225 29920 catalog_manager.cc:5697] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } }
I20260709 13:11:36.407960  1306 leader_election.cc:290] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:36.410372 30702 leader_election.cc:304] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:36.398789 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:36.412910 29920 catalog_manager.cc:5697] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:36.414278 29920 catalog_manager.cc:5697] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 5 to 7, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 7 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } }
I20260709 13:11:36.415640 29920 catalog_manager.cc:5697] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 8 to 12, leader changed from c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 12 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } }
I20260709 13:11:36.417037 29920 catalog_manager.cc:5697] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:36.418440 29920 catalog_manager.cc:5697] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 9 to 12, leader changed from c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 12 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
W20260709 13:11:36.425488 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 52306.6us
I20260709 13:11:36.425837 30728 consensus_queue.cc:237] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:36.420099  1495 raft_consensus.cc:2749] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:36.422780  1266 raft_consensus.cc:2804] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:36.423177  1389 consensus_queue.cc:1048] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:36.428694 30143 leader_election.cc:400] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821) with higher term. Message: Invalid argument: T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 9. Current term is 10.
I20260709 13:11:36.429235 30025 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:36.509747 30025 raft_consensus.cc:3060] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:36.510739 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 82173.9us
W20260709 13:11:36.509166 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 85522.4us
I20260709 13:11:36.516010 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
W20260709 13:11:36.518630 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 121609us
I20260709 13:11:36.518038 29920 catalog_manager.cc:5697] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 5 to 7, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68). New cstate: current_term: 7 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:36.519618 29920 catalog_manager.cc:5697] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 3 to 7. New cstate: current_term: 7 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } }
I20260709 13:11:36.520890 29920 catalog_manager.cc:5697] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:36.429504  1266 raft_consensus.cc:493] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:11:36.529906 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 101943us
I20260709 13:11:36.536739 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f7c9e9bbe0c44a8d803c3d45799906f2" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:36.537436 30176 raft_consensus.cc:3060] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Advancing to term 9
I20260709 13:11:36.425016  1554 raft_consensus.cc:2749] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:36.538147  1266 raft_consensus.cc:3060] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:36.544085  1501 leader_election.cc:290] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:11:36.538136 30142 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 104620us
I20260709 13:11:36.550446  1514 consensus_queue.cc:1048] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:36.556383  1266 raft_consensus.cc:515] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:36.570113 30170 raft_consensus.cc:2468] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 10.
I20260709 13:11:36.540439 30025 raft_consensus.cc:2468] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 9.
I20260709 13:11:36.563737 29920 catalog_manager.cc:5697] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 8 to 13, leader changed from c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) to 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68). New cstate: current_term: 13 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:36.538355 30143 leader_election.cc:400] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821) with higher term. Message: Invalid argument: T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 8. Current term is 9.
W20260709 13:11:36.567101 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 56130.5us
I20260709 13:11:36.572614 30731 raft_consensus.cc:2468] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 10.
I20260709 13:11:36.577736 30143 leader_election.cc:403] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:36.578123 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:36.566785  1537 raft_consensus.cc:493] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:36.581082 30066 leader_election.cc:304] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:36.583361 30730 raft_consensus.cc:2368] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 9. Current term is 10.
I20260709 13:11:36.594528 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:36.595191 30100 raft_consensus.cc:2368] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 9. Current term is 10.
I20260709 13:11:36.602208 30142 leader_election.cc:400] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 election: Vote denied by peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469) with higher term. Message: Invalid argument: T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 9. Current term is 10.
I20260709 13:11:36.602568 30142 leader_election.cc:403] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 13:11:36.604274 30143 leader_election.cc:400] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 election: Vote denied by peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821) with higher term. Message: Invalid argument: T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 9. Current term is 10.
I20260709 13:11:36.608208   853 raft_consensus.cc:2804] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:36.607304   492 raft_consensus.cc:2749] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469) with higher term. Message: Invalid argument: T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 9. Current term is 10.
I20260709 13:11:36.609570   853 raft_consensus.cc:697] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 9 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:36.614042 30176 raft_consensus.cc:2468] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 9.
I20260709 13:11:36.618418   853 consensus_queue.cc:237] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:36.630046 29920 catalog_manager.cc:5697] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 2 to 11, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 11 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:36.632054 29920 catalog_manager.cc:5697] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 5 to 7, leader changed from c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 7 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } }
I20260709 13:11:36.614598  1496 raft_consensus.cc:2749] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821) with higher term. Message: Invalid argument: T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 for earlier term 8. Current term is 9.
I20260709 13:11:36.597201  1537 raft_consensus.cc:515] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:36.650935 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 134412us
I20260709 13:11:36.644407  1495 raft_consensus.cc:493] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:36.674839  1495 raft_consensus.cc:515] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:36.674199 29920 catalog_manager.cc:5697] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 2 to 10, leader changed from 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 10 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:36.686154 30068 leader_election.cc:304] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:36.699827 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b58427f5fe51486b983433e11caa8a3f" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:36.714962 29920 catalog_manager.cc:5697] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } }
I20260709 13:11:36.716390 29920 catalog_manager.cc:5697] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 8 to 11, leader changed from 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 11 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:36.701021  1113 raft_consensus.cc:493] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:36.718228  1113 raft_consensus.cc:515] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:36.720474  1113 leader_election.cc:290] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:36.721527 30730 raft_consensus.cc:1275] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:36.721565 30170 raft_consensus.cc:1275] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:11:36.705906  1569 raft_consensus.cc:2804] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:36.723242  1569 raft_consensus.cc:697] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 10 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:36.724077  1569 consensus_queue.cc:237] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:36.726850  1514 raft_consensus.cc:493] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:36.727331  1514 raft_consensus.cc:515] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:36.729208  1514 leader_election.cc:290] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:36.736462  1282 consensus_queue.cc:1048] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:36.737425 30170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:36.741494  1537 leader_election.cc:290] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:36.747721 30730 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:36.748986 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:36.751863 30098 raft_consensus.cc:1275] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:11:36.748447 30730 raft_consensus.cc:2468] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 9.
W20260709 13:11:36.718161  1585 log.cc:927] Time spent T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 13:11:36.755602 30019 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0a722bee3f14472ebed5b798e61c64b3" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
W20260709 13:11:36.756991 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 147341us
I20260709 13:11:36.759810 30100 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:36.764853 30022 raft_consensus.cc:1275] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:36.765136 29993 leader_election.cc:304] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:36.767884 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:36.775071 29993 leader_election.cc:304] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:36.781936   928 consensus_queue.cc:1048] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:36.785081 30700 leader_election.cc:304] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:36.804862 30703 leader_election.cc:304] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:36.786522  1537 raft_consensus.cc:2749] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:36.807322  1514 raft_consensus.cc:2749] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:36.808832 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:36.809913  1282 raft_consensus.cc:2749] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:36.798000  1452 raft_consensus.cc:2804] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:36.817907  1452 raft_consensus.cc:493] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:36.818295  1452 raft_consensus.cc:3060] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:36.773916  1563 consensus_queue.cc:1048] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 13:11:36.819764   853 consensus_queue.cc:1048] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:36.753165 29920 catalog_manager.cc:5697] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 6 to 8, leader changed from c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 8 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:36.823313  1495 leader_election.cc:290] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:36.823513 29920 catalog_manager.cc:5697] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 7 to 8, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 8 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } }
W20260709 13:11:36.832551 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 47535.1us
I20260709 13:11:36.839210 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:36.852191  1452 raft_consensus.cc:515] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:36.879343 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 80280.6us
I20260709 13:11:36.881103 30103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:36.889338 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c41a6d79ca9c459eb4b0b41302fb76a9" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:36.894474 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:36.897189 30177 raft_consensus.cc:3060] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:36.903817 30703 leader_election.cc:304] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:36.904762 30021 raft_consensus.cc:1240] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Rejecting Update request from peer 5ec73dc157ed476ca903a7d596271719 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 13:11:36.878527  1266 leader_election.cc:290] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 12 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:36.914172   928 raft_consensus.cc:2749] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:36.918599  1452 leader_election.cc:290] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:36.828681 29920 catalog_manager.cc:5697] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:36.914336  1366 consensus_queue.cc:1059] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 13:11:36.941783  1567 raft_consensus.cc:3055] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 13:11:36.950165  1567 raft_consensus.cc:740] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:36.972896 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
W20260709 13:11:36.996018 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 74279.8us
I20260709 13:11:36.963963 29920 catalog_manager.cc:5697] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 7 to 9, leader changed from c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) to 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68). New cstate: current_term: 9 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
W20260709 13:11:37.014979  1593 log.cc:927] Time spent T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.117s	user 0.002s	sys 0.001s
I20260709 13:11:37.015511 29920 catalog_manager.cc:5697] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 3 to 6, leader changed from 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 6 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } }
I20260709 13:11:37.018427  1510 raft_consensus.cc:2955] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 4 to 6, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:37.022711  1498 raft_consensus.cc:493] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:37.023243  1498 raft_consensus.cc:515] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:37.025242  1498 leader_election.cc:290] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:37.028333 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:37.034861 30021 raft_consensus.cc:2468] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 8.
I20260709 13:11:37.041006 30140 leader_election.cc:304] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:37.042841 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:37.043617 30102 raft_consensus.cc:2393] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 8: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:36.995105  1567 consensus_queue.cc:260] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:37.067837  1567 raft_consensus.cc:3060] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:37.065788 29912 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 18a72905c2e24e33af2e64672417cfcf with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:37.048108  1498 raft_consensus.cc:2804] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 13:11:37.071568  1498 raft_consensus.cc:493] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:37.071949  1498 raft_consensus.cc:3060] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:37.017526 29920 catalog_manager.cc:5697] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 3 to 7, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 7 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:37.077804 30172 raft_consensus.cc:2955] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 4 to 6, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:37.077934 29920 catalog_manager.cc:5697] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 2 to 5, leader changed from 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 5 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:37.079535 29920 catalog_manager.cc:5697] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:37.102320 29920 catalog_manager.cc:5697] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 5 to 11. New cstate: current_term: 11 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } }
I20260709 13:11:37.105002 29920 catalog_manager.cc:5697] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 8 to 10, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 10 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } }
I20260709 13:11:37.098978 30177 raft_consensus.cc:2468] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 12.
I20260709 13:11:37.113875 29920 catalog_manager.cc:5697] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 6 to 8, leader changed from c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) to 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68). New cstate: current_term: 8 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
W20260709 13:11:37.100420  1595 log.cc:927] Time spent T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 13:11:37.114537 30702 leader_election.cc:304] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:37.129734  1510 raft_consensus.cc:2804] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:37.131346  1510 raft_consensus.cc:697] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:37.111173  1498 raft_consensus.cc:515] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:37.132148  1510 consensus_queue.cc:237] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:37.134500 30177 raft_consensus.cc:1275] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:11:37.138954  1563 consensus_queue.cc:1048] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:37.143499 30021 raft_consensus.cc:1275] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:11:37.145249  1591 consensus_queue.cc:1048] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:11:37.146306 30101 raft_consensus.cc:2955] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 4 to 6, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:37.155646 30175 raft_consensus.cc:1275] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:11:37.157341  1591 consensus_queue.cc:1048] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:37.165580 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:37.168444 29993 leader_election.cc:304] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:37.175938  1498 leader_election.cc:290] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:37.176118 30024 raft_consensus.cc:2468] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 8.
I20260709 13:11:37.177424 30140 leader_election.cc:304] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:37.180177 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:37.180862 30102 raft_consensus.cc:2393] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate c99569d27a6f4c648eae7119fe3db124 in current term 8: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:37.182217  1573 raft_consensus.cc:2749] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 13:11:37.179872  1498 raft_consensus.cc:2804] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:37.184233  1498 raft_consensus.cc:697] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 8 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:37.185302  1498 consensus_queue.cc:237] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:37.236829  1370 raft_consensus.cc:493] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.237317  1370 raft_consensus.cc:515] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:37.240213 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:37.248277 30732 raft_consensus.cc:1275] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 13:11:37.241859  1370 leader_election.cc:290] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:37.253667  1366 consensus_queue.cc:1048] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:37.273231 30177 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:37.273844 30177 raft_consensus.cc:2468] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 10.
I20260709 13:11:37.275314 29993 leader_election.cc:304] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:37.276028  1573 raft_consensus.cc:2804] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:37.276388  1573 raft_consensus.cc:493] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:37.276703  1573 raft_consensus.cc:3060] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:37.309919  1573 raft_consensus.cc:515] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:37.313242 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:37.333688 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:37.334408 30175 raft_consensus.cc:3060] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:37.332846  1573 leader_election.cc:290] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 11 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:37.356964 30175 raft_consensus.cc:2468] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 11.
I20260709 13:11:37.358775 29993 leader_election.cc:304] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:37.361938  1573 raft_consensus.cc:2804] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:37.362568  1573 raft_consensus.cc:697] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:37.364398  1573 consensus_queue.cc:237] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:37.417021  1591 raft_consensus.cc:493] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.417497  1591 raft_consensus.cc:515] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:37.421944 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:37.422547 30024 raft_consensus.cc:2468] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 8.
I20260709 13:11:37.423943 30066 leader_election.cc:304] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:37.430694 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:37.430066  1591 leader_election.cc:290] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:37.426064  1563 raft_consensus.cc:2804] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:37.440240  1563 raft_consensus.cc:493] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:37.440621  1563 raft_consensus.cc:3060] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:37.475093  1563 raft_consensus.cc:515] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:37.498678 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:37.499284 30024 raft_consensus.cc:3060] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:37.501372  1563 leader_election.cc:290] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:37.502938 30175 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "98e11967c3504e11865ed831f2584aea" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:37.505578 30024 raft_consensus.cc:2468] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 9.
I20260709 13:11:37.505870  1563 raft_consensus.cc:493] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:37.506727 30066 leader_election.cc:304] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:37.500468 29921 catalog_manager.cc:5697] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 3 to 5, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 5 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:37.507452  1567 raft_consensus.cc:2804] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:37.512718  1567 raft_consensus.cc:697] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 9 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:37.513638  1567 consensus_queue.cc:237] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:37.506876  1563 raft_consensus.cc:515] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:37.548026  1563 leader_election.cc:290] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:37.552198 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:37.552968 30172 raft_consensus.cc:2393] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 12: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:11:37.554420 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2ef07e332d8e432eaf9fc64b07cd74f0" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:37.556474 30068 leader_election.cc:304] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:37.558256  1563 raft_consensus.cc:3060] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:37.580677  1563 raft_consensus.cc:2749] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:37.582913  1573 raft_consensus.cc:493] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:37.589680  1573 raft_consensus.cc:515] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:37.590729 29921 catalog_manager.cc:5697] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 9 to 12, leader changed from c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 12 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:37.594660 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:37.596172 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:37.598090 29993 leader_election.cc:304] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:37.598827  1545 raft_consensus.cc:2749] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:37.592409  1573 leader_election.cc:290] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:37.592621 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "18a72905c2e24e33af2e64672417cfcf" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:37.596184 29921 catalog_manager.cc:5697] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 5 to 7, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 7 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:37.611217  1567 raft_consensus.cc:493] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:37.611714  1567 raft_consensus.cc:515] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:37.614370 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:37.615429  1567 leader_election.cc:290] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:37.618148 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:37.618840 30172 raft_consensus.cc:2368] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for earlier term 10. Current term is 11.
I20260709 13:11:37.620473 29920 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51840 (request call id 329) took 5285 ms. Trace:
I20260709 13:11:37.622310 29921 catalog_manager.cc:5697] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 4 to 8, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 8 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:37.623927 29921 catalog_manager.cc:5697] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 4 to 7, leader changed from 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 7 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:37.625734 29921 catalog_manager.cc:5697] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:37.638608 29921 catalog_manager.cc:5697] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 6 to 9, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 9 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:37.641006 30068 leader_election.cc:400] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 10 pre-election: Vote denied by peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001) with higher term. Message: Invalid argument: T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for earlier term 10. Current term is 11.
I20260709 13:11:37.643769 30068 leader_election.cc:403] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:11:37.642494 29921 catalog_manager.cc:5697] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 1 to 8, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 8 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:37.644371  1558 raft_consensus.cc:3060] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Advancing to term 11
I20260709 13:11:37.653797 29921 catalog_manager.cc:5697] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:37.620875 29920 rpcz_store.cc:276] 0709 13:11:32.334694 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:32.345876 (+ 11182us) service_pool.cc:224] Handling call
0709 13:11:37.620393 (+5274517us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:37.229269 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:37.230036 (+   767us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:37.230083 (+    47us) write_op.cc:435] Acquired schema lock
0709 13:11:37.230101 (+    18us) tablet.cc:662] Decoding operations
0709 13:11:37.238778 (+  8677us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:37.238864 (+    86us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:37.238903 (+    39us) tablet.cc:685] Acquiring locks for 32 operations
0709 13:11:37.267282 (+ 28379us) tablet.cc:701] Row locks acquired
0709 13:11:37.267331 (+    49us) write_op.cc:260] PREPARE: finished
0709 13:11:37.267482 (+   151us) write_op.cc:270] Start()
0709 13:11:37.267727 (+   245us) write_op.cc:276] Timestamp: P: 1783602697267427 usec, L: 0
0709 13:11:37.267753 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 13:11:37.268414 (+   661us) log.cc:844] Serialized 12385 byte log entry
0709 13:11:37.378636 (+110222us) op_driver.cc:464] REPLICATION: finished
0709 13:11:37.386507 (+  7871us) write_op.cc:301] APPLY: starting
0709 13:11:37.386581 (+    74us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:37.387088 (+   507us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:37.387193 (+   105us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:37.389903 (+  2710us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:37.390285 (+   382us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=32
0709 13:11:37.390332 (+    47us) write_op.cc:312] APPLY: finished
0709 13:11:37.390752 (+   420us) log.cc:844] Serialized 212 byte log entry
0709 13:11:37.398413 (+  7661us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:37.398645 (+   232us) write_op.cc:454] Released schema lock
0709 13:11:37.398708 (+    63us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:37.425525 (+ 26817us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:37.425555 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":136450,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":7635,"apply.run_cpu_time_us":5092,"apply.run_wall_time_us":38917,"num_ops":32,"prepare.queue_time_us":5773,"prepare.run_cpu_time_us":8846,"prepare.run_wall_time_us":60322,"raft.queue_time_us":20193,"raft.run_cpu_time_us":874,"raft.run_wall_time_us":19578,"replication_time_us":110739,"thread_start_us":66082,"threads_started":4,"wal-append.queue_time_us":47209}]]}
I20260709 13:11:37.663656 30172 raft_consensus.cc:1275] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:11:37.666481  1113 consensus_queue.cc:1048] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:37.679132  1558 raft_consensus.cc:2749] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001) with higher term. Message: Invalid argument: T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 for earlier term 10. Current term is 11.
I20260709 13:11:37.679921 29921 catalog_manager.cc:5697] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 3 to 4, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 4 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:37.682448 29921 catalog_manager.cc:5697] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 4 to 8, leader changed from 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 8 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:37.690519 29921 catalog_manager.cc:5697] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:37.718114 30024 raft_consensus.cc:1240] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Rejecting Update request from peer c99569d27a6f4c648eae7119fe3db124 for earlier term 8. Current term is 9. Ops: []
I20260709 13:11:37.719952  1498 consensus_queue.cc:1059] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:37.724337 30096 raft_consensus.cc:1275] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 13:11:37.729929  1113 consensus_queue.cc:1048] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 13:11:37.769547  1497 raft_consensus.cc:3055] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:37.770182  1497 raft_consensus.cc:740] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:37.771142  1497 consensus_queue.cc:260] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:37.772413  1497 raft_consensus.cc:3060] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:37.794389 30177 raft_consensus.cc:1275] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:11:37.799088  1417 consensus_queue.cc:1048] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 13:11:37.800828 30102 raft_consensus.cc:1275] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 13:11:37.803844  1417 consensus_queue.cc:1048] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:11:37.811259 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 84053.1us
W20260709 13:11:37.907377  1612 log.cc:927] Time spent T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 13:11:37.950218 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 50267.4us
W20260709 13:11:38.032856 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 70563us
I20260709 13:11:38.037523 29926 catalog_manager.cc:5697] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:37.950928 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:38.119112 30170 raft_consensus.cc:1275] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 13:11:38.119506 30170 pending_rounds.cc:85] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124: Aborting all ops after (but not including) 5
I20260709 13:11:38.119735 30170 pending_rounds.cc:107] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 13:11:38.119962 30170 raft_consensus.cc:2889] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 13:11:38.104817  1616 log.cc:927] Time spent T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124: Append to log took a long time: real 0.072s	user 0.002s	sys 0.002s
W20260709 13:11:38.117700  1618 log.cc:927] Time spent T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.164s	user 0.005s	sys 0.000s
I20260709 13:11:38.182935  1591 consensus_queue.cc:1048] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 13:11:38.234179 29921 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51828 (request call id 310) took 7981 ms. Trace:
I20260709 13:11:38.234616 29921 rpcz_store.cc:276] 0709 13:11:30.252709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:30.253717 (+  1008us) service_pool.cc:224] Handling call
0709 13:11:38.234095 (+7980378us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:37.716486 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:37.716968 (+   482us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:37.717001 (+    33us) write_op.cc:435] Acquired schema lock
0709 13:11:37.717017 (+    16us) tablet.cc:662] Decoding operations
0709 13:11:37.717995 (+   978us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:37.718049 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:37.718074 (+    25us) tablet.cc:685] Acquiring locks for 12 operations
0709 13:11:37.719018 (+   944us) tablet.cc:701] Row locks acquired
0709 13:11:37.719032 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:11:37.719157 (+   125us) write_op.cc:270] Start()
0709 13:11:37.719261 (+   104us) write_op.cc:276] Timestamp: P: 1783602697719114 usec, L: 0
0709 13:11:37.719275 (+    14us) op_driver.cc:348] REPLICATION: starting
0709 13:11:37.726732 (+  7457us) log.cc:844] Serialized 4724 byte log entry
0709 13:11:37.730928 (+  4196us) spinlock_profiling.cc:243] Waited 6.84 ms on lock 0x7b54001a4354. stack: 00007f99eef9b343 00007f99eef9b240 00007f99ee92a1d4 00007f99f8668304 00007f99f8668299 00007f99f2023571 00007f99f20b5e28 00007f99f5af0581 00007f99f5aefd58 00007f99f5af49f1 00007f99f5af49a9 00007f99f5af4939 00007f99f5af4901 00007f99f5af3b2d 000000000038f354 000000000038f199
0709 13:11:37.749801 (+ 18873us) op_driver.cc:464] REPLICATION: finished
0709 13:11:37.752880 (+  3079us) write_op.cc:301] APPLY: starting
0709 13:11:37.753961 (+  1081us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:37.754205 (+   244us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:37.754222 (+    17us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:37.755212 (+   990us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:37.755452 (+   240us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0709 13:11:37.755497 (+    45us) write_op.cc:312] APPLY: finished
0709 13:11:37.755734 (+   237us) log.cc:844] Serialized 89 byte log entry
0709 13:11:37.755877 (+   143us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:37.756004 (+   127us) write_op.cc:454] Released schema lock
0709 13:11:37.756052 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:37.756381 (+   329us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:37.756412 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1603157,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":1645,"apply.run_cpu_time_us":2484,"apply.run_wall_time_us":3452,"num_ops":12,"prepare.queue_time_us":13276,"prepare.run_cpu_time_us":5845,"prepare.run_wall_time_us":14600,"replication_time_us":20053,"spinlock_wait_cycles":15726336}]]}
I20260709 13:11:38.240136 30025 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24644eca754d40189c8264977160368a"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
mode: GRACEFUL
new_leader_uuid: "c99569d27a6f4c648eae7119fe3db124"
 from {username='slave'} at 127.0.0.1:47450
I20260709 13:11:38.240672 30025 raft_consensus.cc:606] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 13 FOLLOWER]: Received request to transfer leadership to TS c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:38.240988 30025 raft_consensus.cc:614] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 13:11:38.239799 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 131889us
I20260709 13:11:38.271507 30021 raft_consensus.cc:1275] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:11:38.273748 30024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "80006b8186d74baba29992ade1966048"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
mode: GRACEFUL
new_leader_uuid: "c99569d27a6f4c648eae7119fe3db124"
 from {username='slave'} at 127.0.0.1:47450
I20260709 13:11:38.274344 30024 raft_consensus.cc:606] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 13 FOLLOWER]: Received request to transfer leadership to TS c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:38.274698 30024 raft_consensus.cc:614] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:38.298445 30024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
mode: GRACEFUL
new_leader_uuid: "c99569d27a6f4c648eae7119fe3db124"
 from {username='slave'} at 127.0.0.1:47450
I20260709 13:11:38.299026 30024 raft_consensus.cc:606] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Received request to transfer leadership to TS c99569d27a6f4c648eae7119fe3db124
W20260709 13:11:38.330240 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 74319.2us
I20260709 13:11:38.339567  1625 consensus_queue.cc:1048] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:38.345716  1634 raft_consensus.cc:993] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4: : Instructing follower c99569d27a6f4c648eae7119fe3db124 to start an election
I20260709 13:11:38.346266  1634 raft_consensus.cc:1081] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Signalling peer c99569d27a6f4c648eae7119fe3db124 to start an election
I20260709 13:11:38.345994 30024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c56071aeace442bebfbcd88e12fe4376"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
mode: GRACEFUL
new_leader_uuid: "c99569d27a6f4c648eae7119fe3db124"
 from {username='slave'} at 127.0.0.1:47450
I20260709 13:11:38.347945 30024 raft_consensus.cc:606] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Received request to transfer leadership to TS c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:38.348272 30024 raft_consensus.cc:614] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 13:11:38.355104 30024 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
mode: GRACEFUL
new_leader_uuid: "5ec73dc157ed476ca903a7d596271719"
 from {username='slave'} at 127.0.0.1:47450
I20260709 13:11:38.355703 30024 raft_consensus.cc:606] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 LEADER]: Received request to transfer leadership to TS 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:38.360030 28889 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:11:38.361788 28889 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:38.396463  1411 raft_consensus.cc:493] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:38.413549  1411 raft_consensus.cc:515] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:38.415872  1411 leader_election.cc:290] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:38.417419 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" is_pre_election: true
I20260709 13:11:38.411998 30172 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f"
dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
 from {username='slave'} at 127.0.0.1:43838
I20260709 13:11:38.418159 30024 raft_consensus.cc:2393] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 10: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:11:38.428105 30172 raft_consensus.cc:493] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:38.428560 30172 raft_consensus.cc:3060] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:38.445000 30172 raft_consensus.cc:515] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:38.448513 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: true dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:38.449038 30024 raft_consensus.cc:3055] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 13:11:38.449299 30024 raft_consensus.cc:740] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:38.462081 30172 leader_election.cc:290] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:38.466730 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "817d4a23671d4a1d9c3b9db3b4e77b0f" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: true dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:38.467319 30732 raft_consensus.cc:3060] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:38.473996 30732 raft_consensus.cc:2468] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 6.
I20260709 13:11:38.475041 30142 leader_election.cc:304] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:38.480118  1613 raft_consensus.cc:2804] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 13:11:38.480610  1613 raft_consensus.cc:697] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 6 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:38.481413  1613 consensus_queue.cc:237] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:38.487562 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:38.488251 30101 raft_consensus.cc:2468] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 10.
I20260709 13:11:38.489149 30024 consensus_queue.cc:260] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:38.490075 30024 raft_consensus.cc:3060] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Advancing to term 6
W20260709 13:11:38.497182  1637 consensus_queue.cc:1175] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" responder_term: 5 status { last_received { term: 5 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 5 index: 8 } }
I20260709 13:11:38.534397 30024 raft_consensus.cc:2468] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 6.
W20260709 13:11:38.534561 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 43991.6us
I20260709 13:11:38.536478 30703 leader_election.cc:304] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:38.538342  1510 raft_consensus.cc:2804] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:38.538729  1510 raft_consensus.cc:493] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:38.539080  1510 raft_consensus.cc:3060] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:38.545905  1510 raft_consensus.cc:515] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:38.549741 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:38.550478 30024 raft_consensus.cc:2393] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 10: Already voted for candidate b2cea0098c1040f69755ea4d3dab7fc4 in this term.
I20260709 13:11:38.563040  1510 leader_election.cc:290] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:38.563205 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
W20260709 13:11:38.565814 29926 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51828 (request call id 309) took 28093 ms (client timeout 15000 ms). Trace:
W20260709 13:11:38.566193 29926 rpcz_store.cc:269] 0709 13:11:10.472885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:10.473061 (+   176us) service_pool.cc:224] Handling call
0709 13:11:38.565717 (+28092656us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:38.241965 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:38.266902 (+ 24937us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:38.266936 (+    34us) write_op.cc:435] Acquired schema lock
0709 13:11:38.266949 (+    13us) tablet.cc:662] Decoding operations
0709 13:11:38.275562 (+  8613us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:38.280988 (+  5426us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:38.282844 (+  1856us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:11:38.297432 (+ 14588us) tablet.cc:701] Row locks acquired
0709 13:11:38.297447 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:11:38.297575 (+   128us) write_op.cc:270] Start()
0709 13:11:38.297685 (+   110us) write_op.cc:276] Timestamp: P: 1783602698297533 usec, L: 0
0709 13:11:38.297704 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:11:38.298285 (+   581us) log.cc:844] Serialized 533 byte log entry
0709 13:11:38.363919 (+ 65634us) op_driver.cc:464] REPLICATION: finished
0709 13:11:38.476937 (+113018us) write_op.cc:301] APPLY: starting
0709 13:11:38.477013 (+    76us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:38.477098 (+    85us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:38.477197 (+    99us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:38.477394 (+   197us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:38.477560 (+   166us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:11:38.477601 (+    41us) write_op.cc:312] APPLY: finished
0709 13:11:38.477788 (+   187us) log.cc:844] Serialized 23 byte log entry
0709 13:11:38.479813 (+  2025us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:38.479889 (+    76us) write_op.cc:454] Released schema lock
0709 13:11:38.479924 (+    35us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:38.499172 (+ 19248us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:38.499205 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1165826,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":109760,"apply.run_cpu_time_us":1525,"apply.run_wall_time_us":22205,"num_ops":1,"prepare.queue_time_us":790,"prepare.run_cpu_time_us":2540,"prepare.run_wall_time_us":58051,"replication_time_us":34662,"thread_start_us":79448,"threads_started":1}]]}
I20260709 13:11:38.563198 29923 catalog_manager.cc:5697] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: term changed from 6 to 12. New cstate: current_term: 12 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:38.571192 30101 raft_consensus.cc:2468] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 10.
I20260709 13:11:38.572885 30703 leader_election.cc:304] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:38.575575  1620 raft_consensus.cc:2804] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:38.576073  1620 raft_consensus.cc:697] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:38.576853  1620 consensus_queue.cc:237] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:38.582280 29923 catalog_manager.cc:5697] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: term changed from 7 to 10, leader changed from c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) to 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68). New cstate: current_term: 10 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:38.589080 29923 catalog_manager.cc:5697] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: term changed from 7 to 9, leader changed from c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) to 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68). New cstate: current_term: 9 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:38.618693 29920 catalog_manager.cc:5697] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 reported cstate change: config changed from index 4 to 6, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New cstate: current_term: 5 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:38.631866  1638 raft_consensus.cc:993] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4: : Instructing follower 5ec73dc157ed476ca903a7d596271719 to start an election
I20260709 13:11:38.632392  1638 raft_consensus.cc:1081] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 LEADER]: Signalling peer 5ec73dc157ed476ca903a7d596271719 to start an election
I20260709 13:11:38.646572 30101 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6"
dest_uuid: "5ec73dc157ed476ca903a7d596271719"
 from {username='slave'} at 127.0.0.1:33990
I20260709 13:11:38.647131 30101 raft_consensus.cc:493] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:38.647471 30101 raft_consensus.cc:3060] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:38.660478 30101 raft_consensus.cc:515] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:38.659662 29920 catalog_manager.cc:5697] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 5 to 12, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 12 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:38.664626 30024 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:38.664532 29920 catalog_manager.cc:5697] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 6 to 9, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 9 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } }
I20260709 13:11:38.665166 30024 raft_consensus.cc:3055] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:38.665493 30024 raft_consensus.cc:740] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:38.666222 30024 consensus_queue.cc:260] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:38.667255 30024 raft_consensus.cc:3060] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:38.668105 29923 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:39956 (request call id 231) took 6527 ms. Trace:
I20260709 13:11:38.666163 29920 catalog_manager.cc:5697] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 9 to 11, leader changed from c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) to 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68). New cstate: current_term: 11 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:38.672720 29920 catalog_manager.cc:5697] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 7 to 8, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 8 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:38.674196 29920 catalog_manager.cc:5697] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 9 to 11, leader changed from 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 11 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:38.677543 30024 raft_consensus.cc:2468] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 8.
W20260709 13:11:38.680018 29912 catalog_manager.cc:5220] ChangeConfig:REMOVE_PEER RPC for tablet 18a72905c2e24e33af2e64672417cfcf with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469) due to CAS failure; no further retry: Illegal state: Request specified cas_config_opid_index of 4 but the committed config has opid_index of 6
I20260709 13:11:38.681891 30066 leader_election.cc:304] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:38.683162  1567 raft_consensus.cc:2804] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:38.683643  1567 raft_consensus.cc:697] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 8 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:38.684448  1567 consensus_queue.cc:237] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:38.692668 29920 catalog_manager.cc:5697] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 10 to 12, leader changed from 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 12 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } }
I20260709 13:11:38.700345 29920 catalog_manager.cc:5697] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:38.701527 29920 catalog_manager.cc:5697] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 6 to 9, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 9 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } }
I20260709 13:11:38.705994 30101 leader_election.cc:290] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:38.668592 29923 rpcz_store.cc:276] 0709 13:11:32.141093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:32.141230 (+   137us) service_pool.cc:224] Handling call
0709 13:11:38.668043 (+6526813us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:38.597032 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:38.597548 (+   516us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:38.597577 (+    29us) write_op.cc:435] Acquired schema lock
0709 13:11:38.597594 (+    17us) tablet.cc:662] Decoding operations
0709 13:11:38.598118 (+   524us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:38.598166 (+    48us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:38.598192 (+    26us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:11:38.598485 (+   293us) tablet.cc:701] Row locks acquired
0709 13:11:38.598503 (+    18us) write_op.cc:260] PREPARE: finished
0709 13:11:38.598637 (+   134us) write_op.cc:270] Start()
0709 13:11:38.598728 (+    91us) write_op.cc:276] Timestamp: P: 1783602698598592 usec, L: 0
0709 13:11:38.598746 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:11:38.599361 (+   615us) log.cc:844] Serialized 1293 byte log entry
0709 13:11:38.601274 (+  1913us) op_driver.cc:464] REPLICATION: finished
0709 13:11:38.601566 (+   292us) write_op.cc:301] APPLY: starting
0709 13:11:38.601645 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:38.601781 (+   136us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:38.601866 (+    85us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:38.602210 (+   344us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:38.602366 (+   156us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:11:38.602406 (+    40us) write_op.cc:312] APPLY: finished
0709 13:11:38.602580 (+   174us) log.cc:844] Serialized 35 byte log entry
0709 13:11:38.602718 (+   138us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:38.602804 (+    86us) write_op.cc:454] Released schema lock
0709 13:11:38.602838 (+    34us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:38.603161 (+   323us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:38.603192 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":106865,"reported_tablets":37,"spinlock_wait_cycles":2304,"child_traces":[["op",{"apply.queue_time_us":87,"apply.run_cpu_time_us":1553,"apply.run_wall_time_us":1553,"num_ops":3,"prepare.queue_time_us":123,"prepare.run_cpu_time_us":2572,"prepare.run_wall_time_us":2585,"replication_time_us":2406}]]}
I20260709 13:11:38.708176 30732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f5c869d5410b4a83adc1ca35397defb6" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:38.708671 30732 raft_consensus.cc:3060] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:38.703317 29920 catalog_manager.cc:5697] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 12 to 13, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 13 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:38.713290 29920 catalog_manager.cc:5697] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:38.717875 29920 catalog_manager.cc:5697] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 12 to 13, leader changed from 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 13 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:38.719336 29920 catalog_manager.cc:5697] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 10 to 13, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 13 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } }
I20260709 13:11:38.720631 29920 catalog_manager.cc:5697] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 6 to 7, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 7 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } }
I20260709 13:11:38.747364 29920 catalog_manager.cc:5697] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 5 to 7, leader changed from 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) to 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68). New cstate: current_term: 7 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:38.743441 30732 raft_consensus.cc:2468] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 8.
I20260709 13:11:38.753599 29920 catalog_manager.cc:5697] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 7 to 8, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 8 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } }
I20260709 13:11:38.779852 29920 catalog_manager.cc:5697] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 7 to 9, leader changed from c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) to 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68). New cstate: current_term: 9 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:38.794435 29920 catalog_manager.cc:5697] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 4 to 5, leader changed from 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 5 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } }
I20260709 13:11:38.798866 29920 catalog_manager.cc:5697] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 8 to 10, leader changed from 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 10 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:38.803536 29920 catalog_manager.cc:5697] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 11 to 12, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68). New cstate: current_term: 12 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:38.804852 29920 catalog_manager.cc:5697] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:38.876297 30732 raft_consensus.cc:1275] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:11:38.877928  1613 consensus_queue.cc:1048] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:38.890352 29921 catalog_manager.cc:5697] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:38.894209 29921 catalog_manager.cc:5697] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 8 to 11, leader changed from 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 11 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } }
I20260709 13:11:38.899243 29921 catalog_manager.cc:5697] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 8 to 9, leader changed from c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 9 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:38.900322 29920 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51840 (request call id 330) took 1142 ms. Trace:
I20260709 13:11:38.901557 29921 catalog_manager.cc:5697] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 3 to 9, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 9 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:38.903095 29921 catalog_manager.cc:5697] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:38.904723 29921 catalog_manager.cc:5697] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 5 to 10, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68). New cstate: current_term: 10 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:38.905712 29920 rpcz_store.cc:276] 0709 13:11:37.757484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:37.758288 (+   804us) service_pool.cc:224] Handling call
0709 13:11:38.900244 (+1141956us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:11:38.832413 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:11:38.832889 (+   476us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:11:38.832925 (+    36us) write_op.cc:435] Acquired schema lock
0709 13:11:38.832946 (+    21us) tablet.cc:662] Decoding operations
0709 13:11:38.834495 (+  1549us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:11:38.834550 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 13:11:38.834593 (+    43us) tablet.cc:685] Acquiring locks for 21 operations
0709 13:11:38.836083 (+  1490us) tablet.cc:701] Row locks acquired
0709 13:11:38.836098 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:11:38.836224 (+   126us) write_op.cc:270] Start()
0709 13:11:38.836326 (+   102us) write_op.cc:276] Timestamp: P: 1783602698836184 usec, L: 0
0709 13:11:38.836353 (+    27us) op_driver.cc:348] REPLICATION: starting
0709 13:11:38.837042 (+   689us) log.cc:844] Serialized 8175 byte log entry
0709 13:11:38.839668 (+  2626us) op_driver.cc:464] REPLICATION: finished
0709 13:11:38.840103 (+   435us) write_op.cc:301] APPLY: starting
0709 13:11:38.840173 (+    70us) tablet.cc:1367] starting BulkCheckPresence
0709 13:11:38.840512 (+   339us) tablet.cc:1370] finished BulkCheckPresence
0709 13:11:38.840597 (+    85us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:11:38.842576 (+  1979us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:11:38.842997 (+   421us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=21
0709 13:11:38.843071 (+    74us) write_op.cc:312] APPLY: finished
0709 13:11:38.843468 (+   397us) log.cc:844] Serialized 145 byte log entry
0709 13:11:38.843627 (+   159us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:38.843834 (+   207us) write_op.cc:454] Released schema lock
0709 13:11:38.843887 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 13:11:38.844162 (+   275us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:11:38.844187 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":98754,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":229,"apply.run_cpu_time_us":4033,"apply.run_wall_time_us":4033,"num_ops":21,"prepare.queue_time_us":93,"prepare.run_cpu_time_us":4929,"prepare.run_wall_time_us":4929,"replication_time_us":3209}]]}
I20260709 13:11:38.911298 29921 catalog_manager.cc:5697] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:38.912515  1632 raft_consensus.cc:493] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:38.913053  1632 raft_consensus.cc:515] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:38.915078  1632 leader_election.cc:290] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:38.915627 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:38.916446 30102 raft_consensus.cc:2410] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate b2cea0098c1040f69755ea4d3dab7fc4 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 13:11:38.916831 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0be979412dd54241bd212ddbb7611046" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:38.918236 29993 leader_election.cc:304] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:38.919654  1632 raft_consensus.cc:2749] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:38.936316 30024 raft_consensus.cc:1275] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 13:11:38.938383  1613 consensus_queue.cc:1048] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:38.985517 30102 raft_consensus.cc:1275] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:11:38.987071  1411 consensus_queue.cc:1048] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:39.015218 29922 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:51818 (request call id 323) took 10519 ms. Trace:
I20260709 13:11:39.016113 29922 rpcz_store.cc:276] 0709 13:11:28.496017 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:28.496214 (+   197us) service_pool.cc:224] Handling call
0709 13:11:39.014883 (+10518669us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":12762,"reported_tablets":47}
I20260709 13:11:39.029150 29923 catalog_manager.cc:5697] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: term changed from 7 to 10, leader changed from 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) to 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68). New cstate: current_term: 10 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:39.041705 30024 raft_consensus.cc:1275] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:11:39.043382  1620 consensus_queue.cc:1048] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:39.059968 30009 tablet_service.cc:1558] Processing DeleteTablet for tablet 18a72905c2e24e33af2e64672417cfcf with delete_type TABLET_DATA_TOMBSTONED (TS b2cea0098c1040f69755ea4d3dab7fc4 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:41782
I20260709 13:11:39.091145 30024 raft_consensus.cc:1275] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:39.093055  1567 consensus_queue.cc:1048] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:39.096539 29920 catalog_manager.cc:5697] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 7 to 8, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 8 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:39.089731  1659 tablet_replica.cc:333] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:11:39.119982  1659 raft_consensus.cc:2243] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:39.122313  1659 raft_consensus.cc:2272] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:39.122810 29921 catalog_manager.cc:5697] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 5 to 6, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 6 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:39.129079  1659 ts_tablet_manager.cc:1916] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:39.145315 30732 raft_consensus.cc:1275] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:39.149519  1661 consensus_queue.cc:1048] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:39.185932  1659 ts_tablet_manager.cc:1929] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.5
I20260709 13:11:39.186491  1659 log.cc:1199] T 18a72905c2e24e33af2e64672417cfcf P b2cea0098c1040f69755ea4d3dab7fc4: Deleting WAL directory at /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-0-root/wals/18a72905c2e24e33af2e64672417cfcf
I20260709 13:11:39.198208 29910 catalog_manager.cc:5028] TS b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): tablet 18a72905c2e24e33af2e64672417cfcf (table test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]) successfully deleted
I20260709 13:11:39.363267 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:40.046864 30024 consensus_queue.cc:237] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:11:40.084492 30172 raft_consensus.cc:1275] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:11:40.088201  1663 consensus_queue.cc:1048] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 13:11:40.111687 29993 consensus_peers.cc:597] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 -> Peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469): Couldn't send request to peer 6f3eb161e2194f6891f12e2cfcaaf73a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 802499fd316b44c9b21bede0e714fcfb. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:40.119272 30101 raft_consensus.cc:1275] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 13:11:40.121507  1663 consensus_queue.cc:1048] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:40.169678  1637 raft_consensus.cc:2955] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 LEADER]: Committing config change with OpId 8.6: config changed from index -1 to 6, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:11:40.171491 30172 raft_consensus.cc:2955] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Committing config change with OpId 8.6: config changed from index -1 to 6, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:11:40.191375 29923 catalog_manager.cc:5697] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 reported cstate change: config changed from index -1 to 6, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New cstate: current_term: 8 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:11:40.195971 30024 consensus_queue.cc:237] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:11:40.198792 30101 raft_consensus.cc:2955] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Committing config change with OpId 8.6: config changed from index -1 to 6, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
W20260709 13:11:40.230845 29993 consensus_peers.cc:597] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 -> Peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469): Couldn't send request to peer 6f3eb161e2194f6891f12e2cfcaaf73a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 651beb51dcbf4055b1178a304fe23043. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:40.233179 30172 raft_consensus.cc:1275] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:11:40.237032  1632 consensus_queue.cc:1048] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:40.241333 30102 raft_consensus.cc:1275] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 13:11:40.242760  1632 consensus_queue.cc:1048] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:40.274344  1632 raft_consensus.cc:2955] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index -1 to 6, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:11:40.275496 30101 raft_consensus.cc:2955] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index -1 to 6, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:11:40.306977 30170 raft_consensus.cc:2955] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index -1 to 6, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:11:40.327585 30102 consensus_queue.cc:237] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:11:40.327891 29921 catalog_manager.cc:5697] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 reported cstate change: config changed from index -1 to 6, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New cstate: current_term: 5 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:11:40.379454 30170 raft_consensus.cc:1275] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:11:40.380792  1558 consensus_queue.cc:1048] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:11:40.381701 30068 consensus_peers.cc:597] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 -> Peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469): Couldn't send request to peer 6f3eb161e2194f6891f12e2cfcaaf73a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f71bd695ecc748db8c77f136fb53616b. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:40.385332 30024 raft_consensus.cc:1275] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:11:40.386950  1567 consensus_queue.cc:1048] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:40.446822  1558 raft_consensus.cc:2955] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 8 LEADER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:11:40.454747 30023 raft_consensus.cc:2955] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:11:40.470599 30102 consensus_queue.cc:237] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:11:40.483353 29921 catalog_manager.cc:5697] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: config changed from index -1 to 7, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New cstate: current_term: 8 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:11:40.496217 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:40.496716 30170 raft_consensus.cc:2955] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index -1 to 7, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:11:40.506207 30172 raft_consensus.cc:1275] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:11:40.507637 30068 consensus_peers.cc:597] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 -> Peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469): Couldn't send request to peer 6f3eb161e2194f6891f12e2cfcaaf73a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 143490b42f5d4687a680435e8cd86d1f. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:40.508631  1567 consensus_queue.cc:1048] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:40.509243 30021 raft_consensus.cc:1275] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:11:40.510843  1567 consensus_queue.cc:1048] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:40.593353 30172 raft_consensus.cc:2955] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:11:40.592255  1558 raft_consensus.cc:2955] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 7 LEADER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:11:40.611357  1685 ts_tablet_manager.cc:933] T 802499fd316b44c9b21bede0e714fcfb P 6f3eb161e2194f6891f12e2cfcaaf73a: Initiating tablet copy from peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451)
I20260709 13:11:40.613711 29923 catalog_manager.cc:5697] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 reported cstate change: config changed from index -1 to 6, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New cstate: current_term: 7 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:11:40.629546 30021 raft_consensus.cc:2955] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:11:40.630748  1685 tablet_copy_client.cc:323] T 802499fd316b44c9b21bede0e714fcfb P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Beginning tablet copy session from remote peer at address 127.28.54.65:34451
I20260709 13:11:40.633510 30038 tablet_copy_service.cc:140] P b2cea0098c1040f69755ea4d3dab7fc4: Received BeginTabletCopySession request for tablet 802499fd316b44c9b21bede0e714fcfb from peer 6f3eb161e2194f6891f12e2cfcaaf73a ({username='slave'} at 127.0.0.1:52098)
I20260709 13:11:40.634079 30038 tablet_copy_service.cc:161] P b2cea0098c1040f69755ea4d3dab7fc4: Beginning new tablet copy session on tablet 802499fd316b44c9b21bede0e714fcfb from peer 6f3eb161e2194f6891f12e2cfcaaf73a at {username='slave'} at 127.0.0.1:52098: session id = 6f3eb161e2194f6891f12e2cfcaaf73a-802499fd316b44c9b21bede0e714fcfb
I20260709 13:11:40.695420 30038 tablet_copy_source_session.cc:215] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:40.700538 30102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24644eca754d40189c8264977160368a"
dest_uuid: "5ec73dc157ed476ca903a7d596271719"
mode: GRACEFUL
new_leader_uuid: "c99569d27a6f4c648eae7119fe3db124"
 from {username='slave'} at 127.0.0.1:51746
I20260709 13:11:40.703380 30102 raft_consensus.cc:606] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 13 LEADER]: Received request to transfer leadership to TS c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:40.707041  1685 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 802499fd316b44c9b21bede0e714fcfb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:40.707499 30102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3068102662114944a63195a8d764e93d"
dest_uuid: "5ec73dc157ed476ca903a7d596271719"
mode: GRACEFUL
new_leader_uuid: "c99569d27a6f4c648eae7119fe3db124"
 from {username='slave'} at 127.0.0.1:51746
I20260709 13:11:40.708045 30102 raft_consensus.cc:606] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 8 LEADER]: Received request to transfer leadership to TS c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:40.711849 30731 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe"
dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
mode: GRACEFUL
new_leader_uuid: "c99569d27a6f4c648eae7119fe3db124"
 from {username='slave'} at 127.0.0.1:55634
I20260709 13:11:40.712368 30731 raft_consensus.cc:606] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 13 LEADER]: Received request to transfer leadership to TS c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:40.716881 30102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee"
dest_uuid: "5ec73dc157ed476ca903a7d596271719"
mode: GRACEFUL
new_leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
 from {username='slave'} at 127.0.0.1:51746
I20260709 13:11:40.717375 30102 raft_consensus.cc:606] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 8 LEADER]: Received request to transfer leadership to TS b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:40.721444 30102 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43"
dest_uuid: "5ec73dc157ed476ca903a7d596271719"
mode: GRACEFUL
new_leader_uuid: "c99569d27a6f4c648eae7119fe3db124"
 from {username='slave'} at 127.0.0.1:51746
I20260709 13:11:40.721941 30102 raft_consensus.cc:606] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 8 LEADER]: Received request to transfer leadership to TS c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:40.723585 28889 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:11:40.725076 28889 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:40.739913  1685 tablet_copy_client.cc:806] T 802499fd316b44c9b21bede0e714fcfb P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:40.740532  1685 tablet_copy_client.cc:670] T 802499fd316b44c9b21bede0e714fcfb P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:40.745270  1685 tablet_copy_client.cc:538] T 802499fd316b44c9b21bede0e714fcfb P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:40.761417  1685 tablet_bootstrap.cc:492] T 802499fd316b44c9b21bede0e714fcfb P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap starting.
I20260709 13:11:40.844033  1690 ts_tablet_manager.cc:933] T 651beb51dcbf4055b1178a304fe23043 P 6f3eb161e2194f6891f12e2cfcaaf73a: Initiating tablet copy from peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451)
I20260709 13:11:40.860265  1678 raft_consensus.cc:993] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719: : Instructing follower c99569d27a6f4c648eae7119fe3db124 to start an election
I20260709 13:11:40.860756  1661 raft_consensus.cc:1081] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 8 LEADER]: Signalling peer c99569d27a6f4c648eae7119fe3db124 to start an election
I20260709 13:11:40.865281 30172 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3068102662114944a63195a8d764e93d"
dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
 from {username='slave'} at 127.0.0.1:43840
I20260709 13:11:40.865833 30172 raft_consensus.cc:493] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:40.866178 30172 raft_consensus.cc:3060] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:40.872485 30172 raft_consensus.cc:515] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:40.874919 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:40.875379 30172 leader_election.cc:290] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:40.875483 30021 raft_consensus.cc:3060] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:40.882843 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3068102662114944a63195a8d764e93d" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: true dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:40.883381 30096 raft_consensus.cc:3055] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:40.883652 30096 raft_consensus.cc:740] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:40.884536 30096 consensus_queue.cc:260] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:40.885646 30096 raft_consensus.cc:3060] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:40.883579 30021 raft_consensus.cc:2468] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 9.
I20260709 13:11:40.894096 30140 leader_election.cc:304] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:40.894922  1665 raft_consensus.cc:2804] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:40.895403  1665 raft_consensus.cc:697] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 9 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:40.896199  1665 consensus_queue.cc:237] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:40.904500 30096 raft_consensus.cc:2468] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 9.
I20260709 13:11:40.952024 29923 catalog_manager.cc:5697] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 8 to 9, leader changed from 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 9 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:40.972043  1684 raft_consensus.cc:993] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a: : Instructing follower c99569d27a6f4c648eae7119fe3db124 to start an election
I20260709 13:11:40.972672  1684 raft_consensus.cc:1081] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 13 LEADER]: Signalling peer c99569d27a6f4c648eae7119fe3db124 to start an election
I20260709 13:11:40.976708 30172 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe"
dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
 from {username='slave'} at 127.0.0.1:54540
I20260709 13:11:40.977280 30172 raft_consensus.cc:493] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:40.977633 30172 raft_consensus.cc:3060] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:40.983451  1558 raft_consensus.cc:993] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719: : Instructing follower b2cea0098c1040f69755ea4d3dab7fc4 to start an election
I20260709 13:11:40.983922  1558 raft_consensus.cc:1081] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 8 LEADER]: Signalling peer b2cea0098c1040f69755ea4d3dab7fc4 to start an election
I20260709 13:11:41.004985 30023 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
 from {username='slave'} at 127.0.0.1:54198
I20260709 13:11:41.005529 30023 raft_consensus.cc:493] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:41.005889 30023 raft_consensus.cc:3060] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:41.014052  1685 tablet_bootstrap.cc:492] T 802499fd316b44c9b21bede0e714fcfb P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:41.015015  1685 tablet_bootstrap.cc:492] T 802499fd316b44c9b21bede0e714fcfb P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap complete.
I20260709 13:11:41.015707  1685 ts_tablet_manager.cc:1403] T 802499fd316b44c9b21bede0e714fcfb P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent bootstrapping tablet: real 0.255s	user 0.031s	sys 0.002s
I20260709 13:11:41.030339 30023 raft_consensus.cc:515] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:41.036689  1685 raft_consensus.cc:359] T 802499fd316b44c9b21bede0e714fcfb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:11:41.055083  1685 raft_consensus.cc:740] T 802499fd316b44c9b21bede0e714fcfb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 LEARNER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Initialized, Role: LEARNER
I20260709 13:11:41.026263  1689 ts_tablet_manager.cc:933] T f71bd695ecc748db8c77f136fb53616b P 6f3eb161e2194f6891f12e2cfcaaf73a: Initiating tablet copy from peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:40.954169  1690 tablet_copy_client.cc:323] T 651beb51dcbf4055b1178a304fe23043 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Beginning tablet copy session from remote peer at address 127.28.54.65:34451
I20260709 13:11:41.048491  1678 raft_consensus.cc:993] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719: : Instructing follower c99569d27a6f4c648eae7119fe3db124 to start an election
I20260709 13:11:41.057358  1678 raft_consensus.cc:1081] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 13 LEADER]: Signalling peer c99569d27a6f4c648eae7119fe3db124 to start an election
I20260709 13:11:41.058725 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:41.059254 30731 raft_consensus.cc:3060] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:41.059515 30038 tablet_copy_service.cc:140] P b2cea0098c1040f69755ea4d3dab7fc4: Received BeginTabletCopySession request for tablet 651beb51dcbf4055b1178a304fe23043 from peer 6f3eb161e2194f6891f12e2cfcaaf73a ({username='slave'} at 127.0.0.1:52098)
I20260709 13:11:41.060060 30038 tablet_copy_service.cc:161] P b2cea0098c1040f69755ea4d3dab7fc4: Beginning new tablet copy session on tablet 651beb51dcbf4055b1178a304fe23043 from peer 6f3eb161e2194f6891f12e2cfcaaf73a at {username='slave'} at 127.0.0.1:52098: session id = 6f3eb161e2194f6891f12e2cfcaaf73a-651beb51dcbf4055b1178a304fe23043
I20260709 13:11:41.042296 30172 raft_consensus.cc:515] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:41.065024 30172 leader_election.cc:290] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 14 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:41.066906 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:41.067407 30735 raft_consensus.cc:3055] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:41.067654 30735 raft_consensus.cc:740] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:41.068374 30735 consensus_queue.cc:260] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:41.068706  1685 consensus_queue.cc:260] T 802499fd316b44c9b21bede0e714fcfb P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:11:41.069432 30735 raft_consensus.cc:3060] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:41.069840 30023 leader_election.cc:290] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:41.073434 30731 raft_consensus.cc:2468] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 9.
I20260709 13:11:41.073994 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: true dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:41.094163 30102 raft_consensus.cc:3055] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:41.094484 30102 raft_consensus.cc:740] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:41.095160 30102 consensus_queue.cc:260] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:41.096329 30102 raft_consensus.cc:3060] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:41.074640 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "935127b9887c4175b5b65fd739c5cffe" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:41.106106 30023 raft_consensus.cc:3060] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:41.081840 30038 tablet_copy_source_session.cc:215] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:41.086445 30735 raft_consensus.cc:2468] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 14.
I20260709 13:11:41.110802 30142 leader_election.cc:304] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:41.111994 30730 raft_consensus.cc:1217] T 802499fd316b44c9b21bede0e714fcfb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 LEARNER]: Deduplicated request from leader. Original: 8.5->[8.6-8.6]   Dedup: 8.6->[]
I20260709 13:11:41.112681  1690 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 651beb51dcbf4055b1178a304fe23043. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:41.089675  1685 ts_tablet_manager.cc:1434] T 802499fd316b44c9b21bede0e714fcfb P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent starting tablet: real 0.074s	user 0.003s	sys 0.005s
I20260709 13:11:41.089582 30172 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "24644eca754d40189c8264977160368a"
dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
 from {username='slave'} at 127.0.0.1:43840
I20260709 13:11:41.128823 30172 raft_consensus.cc:493] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:41.129192 30172 raft_consensus.cc:3060] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:41.115893 29993 leader_election.cc:304] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4; no voters: 
I20260709 13:11:41.114966 30102 raft_consensus.cc:2468] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b2cea0098c1040f69755ea4d3dab7fc4 in term 9.
I20260709 13:11:41.121869  1665 raft_consensus.cc:2804] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:41.132790 30023 raft_consensus.cc:2468] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 14.
I20260709 13:11:41.132928  1665 raft_consensus.cc:697] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 14 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:41.133883  1665 consensus_queue.cc:237] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:41.137152  1637 raft_consensus.cc:2804] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:41.137662  1637 raft_consensus.cc:697] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 LEADER]: Becoming Leader. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:41.144204 30172 raft_consensus.cc:515] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:41.146242 30172 leader_election.cc:290] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 14 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:41.147122 30023 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:41.147403 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24644eca754d40189c8264977160368a" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:41.147677 30023 raft_consensus.cc:3060] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:41.150118 30102 raft_consensus.cc:3055] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 13:11:41.150484 30102 raft_consensus.cc:740] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:41.151639  1567 raft_consensus.cc:993] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719: : Instructing follower c99569d27a6f4c648eae7119fe3db124 to start an election
I20260709 13:11:41.152055  1567 raft_consensus.cc:1081] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 8 LEADER]: Signalling peer c99569d27a6f4c648eae7119fe3db124 to start an election
I20260709 13:11:41.138535  1637 consensus_queue.cc:237] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:41.154906 30023 raft_consensus.cc:2468] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 14.
I20260709 13:11:41.156316 30172 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43"
dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
 from {username='slave'} at 127.0.0.1:43840
I20260709 13:11:41.156909 30172 raft_consensus.cc:493] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:41.156935 30140 leader_election.cc:304] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:41.157351 30172 raft_consensus.cc:3060] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:41.160055 30102 consensus_queue.cc:260] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:41.170954  1636 raft_consensus.cc:2804] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:41.171813  1636 raft_consensus.cc:697] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 14 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:41.172634  1636 consensus_queue.cc:237] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:41.191404 30102 raft_consensus.cc:3060] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:41.198479 30102 raft_consensus.cc:2468] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 14.
I20260709 13:11:41.171119  1689 tablet_copy_client.cc:323] T f71bd695ecc748db8c77f136fb53616b P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Beginning tablet copy session from remote peer at address 127.28.54.66:43821
I20260709 13:11:41.199329 30038 tablet_copy_service.cc:342] P b2cea0098c1040f69755ea4d3dab7fc4: Request end of tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-802499fd316b44c9b21bede0e714fcfb received from {username='slave'} at 127.0.0.1:52098
I20260709 13:11:41.202615 30172 raft_consensus.cc:515] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:41.206159 30038 tablet_copy_service.cc:434] P b2cea0098c1040f69755ea4d3dab7fc4: ending tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-802499fd316b44c9b21bede0e714fcfb on tablet 802499fd316b44c9b21bede0e714fcfb with peer 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:41.200273  1697 ts_tablet_manager.cc:933] T 143490b42f5d4687a680435e8cd86d1f P 6f3eb161e2194f6891f12e2cfcaaf73a: Initiating tablet copy from peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:41.218890 29923 catalog_manager.cc:5697] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: term changed from 8 to 9, leader changed from 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) to b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65). New cstate: current_term: 9 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:41.227744 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:41.228857 30172 leader_election.cc:290] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:41.229295 30102 raft_consensus.cc:3055] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 13:11:41.229663 30102 raft_consensus.cc:740] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:41.229739 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b52e70a06b534fbf90cbcb6a010e9d43" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:41.230291 30731 raft_consensus.cc:3060] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:41.230326 29921 catalog_manager.cc:5697] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 13 to 14, leader changed from 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 14 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:41.233338 30102 consensus_queue.cc:260] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:41.239174 30113 tablet_copy_service.cc:140] P 5ec73dc157ed476ca903a7d596271719: Received BeginTabletCopySession request for tablet f71bd695ecc748db8c77f136fb53616b from peer 6f3eb161e2194f6891f12e2cfcaaf73a ({username='slave'} at 127.0.0.1:48558)
I20260709 13:11:41.239781 30113 tablet_copy_service.cc:161] P 5ec73dc157ed476ca903a7d596271719: Beginning new tablet copy session on tablet f71bd695ecc748db8c77f136fb53616b from peer 6f3eb161e2194f6891f12e2cfcaaf73a at {username='slave'} at 127.0.0.1:48558: session id = 6f3eb161e2194f6891f12e2cfcaaf73a-f71bd695ecc748db8c77f136fb53616b
I20260709 13:11:41.242136 30102 raft_consensus.cc:3060] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:41.246995 30113 tablet_copy_source_session.cc:215] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:41.249861 30102 raft_consensus.cc:2468] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 9.
I20260709 13:11:41.251016 30731 raft_consensus.cc:2468] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 9.
I20260709 13:11:41.253873 30143 leader_election.cc:304] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:41.257313  1636 raft_consensus.cc:2804] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:41.258045  1636 raft_consensus.cc:697] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 9 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:41.258744  1689 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f71bd695ecc748db8c77f136fb53616b. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:11:41.272501  1699 log.cc:927] Time spent T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
I20260709 13:11:41.258900  1636 consensus_queue.cc:237] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:41.376701  1690 tablet_copy_client.cc:806] T 651beb51dcbf4055b1178a304fe23043 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:41.377298  1690 tablet_copy_client.cc:670] T 651beb51dcbf4055b1178a304fe23043 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 1 WAL segments...
W20260709 13:11:41.446364 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 49867.9us
W20260709 13:11:41.460207 30700 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 94321us
I20260709 13:11:41.470218  1697 tablet_copy_client.cc:323] T 143490b42f5d4687a680435e8cd86d1f P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Beginning tablet copy session from remote peer at address 127.28.54.66:43821
I20260709 13:11:41.515048 30023 raft_consensus.cc:1275] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 13:11:41.523823  1690 tablet_copy_client.cc:538] T 651beb51dcbf4055b1178a304fe23043 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:41.564895 30102 raft_consensus.cc:1275] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 13:11:41.585140 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 97940.6us
I20260709 13:11:41.583220  1695 consensus_queue.cc:1048] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 13:11:41.590400  1690 tablet_bootstrap.cc:492] T 651beb51dcbf4055b1178a304fe23043 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap starting.
I20260709 13:11:41.590649  1716 consensus_queue.cc:1048] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 13:11:41.607363 30023 raft_consensus.cc:1275] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 14 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:11:41.613919  1689 tablet_copy_client.cc:806] T f71bd695ecc748db8c77f136fb53616b P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:41.614503  1689 tablet_copy_client.cc:670] T f71bd695ecc748db8c77f136fb53616b P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:41.615240 29921 catalog_manager.cc:5697] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 13 to 14, leader changed from 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 14 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:41.623255 30113 tablet_copy_service.cc:140] P 5ec73dc157ed476ca903a7d596271719: Received BeginTabletCopySession request for tablet 143490b42f5d4687a680435e8cd86d1f from peer 6f3eb161e2194f6891f12e2cfcaaf73a ({username='slave'} at 127.0.0.1:48558)
I20260709 13:11:41.623754 30113 tablet_copy_service.cc:161] P 5ec73dc157ed476ca903a7d596271719: Beginning new tablet copy session on tablet 143490b42f5d4687a680435e8cd86d1f from peer 6f3eb161e2194f6891f12e2cfcaaf73a at {username='slave'} at 127.0.0.1:48558: session id = 6f3eb161e2194f6891f12e2cfcaaf73a-143490b42f5d4687a680435e8cd86d1f
I20260709 13:11:41.616937 29921 catalog_manager.cc:5697] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 8 to 9, leader changed from 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 9 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:41.645023  1708 consensus_queue.cc:1048] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:41.659226  1689 tablet_copy_client.cc:538] T f71bd695ecc748db8c77f136fb53616b P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:41.688242 30113 tablet_copy_source_session.cc:215] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:41.691881 30023 raft_consensus.cc:1275] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 14 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:11:41.704605  1708 consensus_queue.cc:1048] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:41.709453 30732 raft_consensus.cc:1275] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 14 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 13:11:41.711179  1636 consensus_queue.cc:1048] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 13:11:41.726650 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:41.778450  1719 raft_consensus.cc:1064] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4: attempting to promote NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a to VOTER
I20260709 13:11:41.782039 30102 raft_consensus.cc:1275] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:41.787285  1721 consensus_queue.cc:1048] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:11:41.789281 29993 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:11:41.791944 30735 raft_consensus.cc:1275] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:11:41.792245  1719 consensus_queue.cc:237] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 4, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:41.794178  1636 consensus_queue.cc:1048] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:41.804522 30731 raft_consensus.cc:1275] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:41.822075 30096 raft_consensus.cc:1275] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 14 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 13:11:41.849696  1697 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 143490b42f5d4687a680435e8cd86d1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:41.817790  1721 consensus_queue.cc:1048] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 13:11:41.847970  1716 consensus_queue.cc:1048] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 13:11:41.924144  1689 tablet_bootstrap.cc:492] T f71bd695ecc748db8c77f136fb53616b P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap starting.
W20260709 13:11:41.964732 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 64561.1us
I20260709 13:11:42.004267 30730 raft_consensus.cc:1275] T 802499fd316b44c9b21bede0e714fcfb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 LEARNER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:11:42.005185 30173 raft_consensus.cc:1275] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:11:42.010938 30098 raft_consensus.cc:1275] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 13:11:42.013449 30095 raft_consensus.cc:1275] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:11:42.025319  1676 consensus_queue.cc:1048] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
W20260709 13:11:42.051424 30143 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 46302us
I20260709 13:11:42.057000  1636 consensus_queue.cc:1048] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:42.041616  1719 consensus_queue.cc:1048] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260709 13:11:42.118692  1714 consensus_queue.cc:1048] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 13:11:42.166836  1697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:56954 (request call id 891) took 1062 ms. Trace:
I20260709 13:11:42.175035  1690 tablet_bootstrap.cc:492] T 651beb51dcbf4055b1178a304fe23043 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:42.183027  1690 tablet_bootstrap.cc:492] T 651beb51dcbf4055b1178a304fe23043 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap complete.
I20260709 13:11:42.185736  1690 ts_tablet_manager.cc:1403] T 651beb51dcbf4055b1178a304fe23043 P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent bootstrapping tablet: real 0.596s	user 0.032s	sys 0.010s
W20260709 13:11:42.229411  1742 log.cc:927] Time spent T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a: Append to log took a long time: real 0.210s	user 0.010s	sys 0.005s
I20260709 13:11:42.170235  1697 rpcz_store.cc:276] 0709 13:11:41.104059 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:11:41.104186 (+   127us) service_pool.cc:224] Handling call
0709 13:11:41.214740 (+110554us) ts_tablet_manager.cc:934] T 143490b42f5d4687a680435e8cd86d1f P 6f3eb161e2194f6891f12e2cfcaaf73a: Initiating tablet copy from peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
0709 13:11:41.816873 (+602133us) tablet_copy_client.cc:368] Tablet copy session begun
0709 13:11:42.079862 (+262989us) tablet_metadata.cc:665] Metadata flushed
0709 13:11:42.079987 (+   125us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 13:11:42.166121 (+ 86134us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 13:11:42.166411 (+   290us) tablet_replica.cc:206] Creating consensus instance
0709 13:11:42.166695 (+   284us) ts_tablet_manager.cc:989] Replica registered.
0709 13:11:42.166753 (+    58us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":25437,"tablet-copy.queue_time_us":39305,"thread_start_us":233334,"threads_started":2}
I20260709 13:11:42.239801  1697 tablet_copy_client.cc:806] T 143490b42f5d4687a680435e8cd86d1f P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:42.240491  1697 tablet_copy_client.cc:670] T 143490b42f5d4687a680435e8cd86d1f P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:42.276136  1690 raft_consensus.cc:359] T 651beb51dcbf4055b1178a304fe23043 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:11:42.281911  1690 raft_consensus.cc:740] T 651beb51dcbf4055b1178a304fe23043 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 LEARNER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Initialized, Role: LEARNER
I20260709 13:11:42.282727  1690 consensus_queue.cc:260] T 651beb51dcbf4055b1178a304fe23043 P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:11:42.429957  1690 ts_tablet_manager.cc:1434] T 651beb51dcbf4055b1178a304fe23043 P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent starting tablet: real 0.233s	user 0.005s	sys 0.005s
I20260709 13:11:42.527766 30038 tablet_copy_service.cc:342] P b2cea0098c1040f69755ea4d3dab7fc4: Request end of tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-651beb51dcbf4055b1178a304fe23043 received from {username='slave'} at 127.0.0.1:52098
I20260709 13:11:42.528172 30038 tablet_copy_service.cc:434] P b2cea0098c1040f69755ea4d3dab7fc4: ending tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-651beb51dcbf4055b1178a304fe23043 on tablet 651beb51dcbf4055b1178a304fe23043 with peer 6f3eb161e2194f6891f12e2cfcaaf73a
W20260709 13:11:42.535495 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 50494.3us
W20260709 13:11:42.574347 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 77157.9us
W20260709 13:11:42.580489 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 60838.1us
W20260709 13:11:42.583532 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 62218.9us
W20260709 13:11:42.603616 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 75689.7us
I20260709 13:11:42.636831  1697 tablet_copy_client.cc:538] T 143490b42f5d4687a680435e8cd86d1f P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:42.663483  1689 tablet_bootstrap.cc:492] T f71bd695ecc748db8c77f136fb53616b P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=1 applied=7 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:42.664973  1689 tablet_bootstrap.cc:492] T f71bd695ecc748db8c77f136fb53616b P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap complete.
I20260709 13:11:42.670112  1689 ts_tablet_manager.cc:1403] T f71bd695ecc748db8c77f136fb53616b P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent bootstrapping tablet: real 0.742s	user 0.035s	sys 0.035s
W20260709 13:11:42.677700 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 141464us
W20260709 13:11:42.680317 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 72655.8us
I20260709 13:11:42.728212  1697 tablet_bootstrap.cc:492] T 143490b42f5d4687a680435e8cd86d1f P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap starting.
I20260709 13:11:42.738960  1689 raft_consensus.cc:359] T f71bd695ecc748db8c77f136fb53616b P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:11:42.739889  1689 raft_consensus.cc:740] T f71bd695ecc748db8c77f136fb53616b P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 LEARNER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Initialized, Role: LEARNER
I20260709 13:11:42.744908  1767 raft_consensus.cc:2955] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 LEADER]: Committing config change with OpId 8.7: config changed from index 6 to 7, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
W20260709 13:11:42.746214  1769 log.cc:927] Time spent T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 13:11:42.751722 30731 raft_consensus.cc:1217] T 651beb51dcbf4055b1178a304fe23043 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 LEARNER]: Deduplicated request from leader. Original: 5.5->[5.6-5.6]   Dedup: 5.6->[]
I20260709 13:11:42.760435 30177 raft_consensus.cc:2955] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 6 to 7, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:42.741557  1689 consensus_queue.cc:260] T f71bd695ecc748db8c77f136fb53616b P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:11:42.800228  1689 ts_tablet_manager.cc:1434] T f71bd695ecc748db8c77f136fb53616b P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent starting tablet: real 0.130s	user 0.004s	sys 0.002s
I20260709 13:11:42.851506  1697 tablet_bootstrap.cc:492] T 143490b42f5d4687a680435e8cd86d1f P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=1 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:42.852641  1697 tablet_bootstrap.cc:492] T 143490b42f5d4687a680435e8cd86d1f P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap complete.
I20260709 13:11:42.853340  1697 ts_tablet_manager.cc:1403] T 143490b42f5d4687a680435e8cd86d1f P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent bootstrapping tablet: real 0.125s	user 0.033s	sys 0.004s
I20260709 13:11:42.857864  1697 raft_consensus.cc:359] T 143490b42f5d4687a680435e8cd86d1f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:11:42.858675  1697 raft_consensus.cc:740] T 143490b42f5d4687a680435e8cd86d1f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Initialized, Role: LEARNER
I20260709 13:11:42.859333  1697 consensus_queue.cc:260] T 143490b42f5d4687a680435e8cd86d1f P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:11:42.861240  1697 ts_tablet_manager.cc:1434] T 143490b42f5d4687a680435e8cd86d1f P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:11:42.912838 30113 tablet_copy_service.cc:342] P 5ec73dc157ed476ca903a7d596271719: Request end of tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-f71bd695ecc748db8c77f136fb53616b received from {username='slave'} at 127.0.0.1:48558
I20260709 13:11:42.913317 30113 tablet_copy_service.cc:434] P 5ec73dc157ed476ca903a7d596271719: ending tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-f71bd695ecc748db8c77f136fb53616b on tablet f71bd695ecc748db8c77f136fb53616b with peer 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:42.949023 30730 raft_consensus.cc:1217] T f71bd695ecc748db8c77f136fb53616b P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 LEARNER]: Deduplicated request from leader. Original: 8.6->[8.7-8.7]   Dedup: 8.7->[]
I20260709 13:11:42.961059 30112 tablet_copy_service.cc:342] P 5ec73dc157ed476ca903a7d596271719: Request end of tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-143490b42f5d4687a680435e8cd86d1f received from {username='slave'} at 127.0.0.1:48558
I20260709 13:11:42.961587 30112 tablet_copy_service.cc:434] P 5ec73dc157ed476ca903a7d596271719: ending tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-143490b42f5d4687a680435e8cd86d1f on tablet 143490b42f5d4687a680435e8cd86d1f with peer 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:42.984958 29920 catalog_manager.cc:5697] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 reported cstate change: config changed from index 6 to 7, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
W20260709 13:11:43.145942 29993 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:46469, user_credentials={real_user=slave}} blocked reactor thread for 83160.9us
I20260709 13:11:43.174868 30730 raft_consensus.cc:2955] T 802499fd316b44c9b21bede0e714fcfb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 6 to 7, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:43.195355 30097 raft_consensus.cc:2955] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Committing config change with OpId 8.7: config changed from index 6 to 7, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:43.207554 30733 raft_consensus.cc:1217] T 143490b42f5d4687a680435e8cd86d1f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 LEARNER]: Deduplicated request from leader. Original: 7.5->[7.6-7.6]   Dedup: 7.6->[]
I20260709 13:11:43.251725  1753 raft_consensus.cc:1064] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4: attempting to promote NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a to VOTER
I20260709 13:11:43.289516  1753 consensus_queue.cc:237] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:43.371593 30025 consensus_queue.cc:237] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:43.378371 30731 raft_consensus.cc:1275] T 802499fd316b44c9b21bede0e714fcfb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:43.378829 30175 raft_consensus.cc:1275] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:43.382018  1767 consensus_queue.cc:1048] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:43.387385  1767 consensus_queue.cc:1048] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:43.387806 30168 raft_consensus.cc:1275] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:43.390427 30731 raft_consensus.cc:1275] T 651beb51dcbf4055b1178a304fe23043 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 LEARNER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:43.399273 30097 raft_consensus.cc:1275] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 13:11:43.390430  1767 consensus_queue.cc:1048] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 13:11:43.402093  1753 consensus_queue.cc:1048] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:43.403609  1759 raft_consensus.cc:2955] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 LEADER]: Committing config change with OpId 8.8: config changed from index 7 to 8, VOTER 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:43.405385 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:43.415904  1712 consensus_queue.cc:1048] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:43.417387 29910 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 802499fd316b44c9b21bede0e714fcfb with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:43.419726 30168 raft_consensus.cc:2955] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, VOTER 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:43.429960 30735 raft_consensus.cc:2955] T 802499fd316b44c9b21bede0e714fcfb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, VOTER 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:43.444694 29921 catalog_manager.cc:5697] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: config changed from index 7 to 8, VOTER 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) evicted. New cstate: current_term: 8 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:43.517560  1720 raft_consensus.cc:2955] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Committing config change with OpId 5.7: config changed from index 6 to 7, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:43.521345 30097 raft_consensus.cc:2955] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 6 to 7, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:43.536329 30735 raft_consensus.cc:2955] T 651beb51dcbf4055b1178a304fe23043 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 6 to 7, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:43.535794 30175 raft_consensus.cc:2955] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 6 to 7, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:43.552038 29921 catalog_manager.cc:5697] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: config changed from index 6 to 7, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:43.555219  1755 raft_consensus.cc:1064] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719: attempting to promote NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a to VOTER
I20260709 13:11:43.557667  1755 consensus_queue.cc:237] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:43.571343 30025 consensus_queue.cc:237] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:43.577098 30096 raft_consensus.cc:1275] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:11:43.578943  1767 consensus_queue.cc:1048] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:43.588034 30175 raft_consensus.cc:1275] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:43.588858  1758 raft_consensus.cc:2955] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Committing config change with OpId 5.8: config changed from index 7 to 8, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:43.594332 30735 raft_consensus.cc:1275] T f71bd695ecc748db8c77f136fb53616b P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 LEARNER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:43.597694 30021 raft_consensus.cc:1275] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:43.598575  1775 consensus_queue.cc:1048] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:43.605160  1734 consensus_queue.cc:1048] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:43.608215 30096 raft_consensus.cc:2955] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Committing config change with OpId 5.8: config changed from index 7 to 8, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:43.613034  1734 consensus_queue.cc:1048] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:43.613361 30735 raft_consensus.cc:1275] T 651beb51dcbf4055b1178a304fe23043 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Refusing update from remote peer b2cea0098c1040f69755ea4d3dab7fc4: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 13:11:43.630295  1720 consensus_queue.cc:1048] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:43.640588 29910 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 651beb51dcbf4055b1178a304fe23043 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:43.657125 30735 raft_consensus.cc:2955] T 651beb51dcbf4055b1178a304fe23043 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Committing config change with OpId 5.8: config changed from index 7 to 8, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:43.664739 29915 maintenance_manager.cc:419] P 1c91346f9a2a480e908d4e0323634aeb: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033381
I20260709 13:11:43.688813 29921 catalog_manager.cc:5697] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: config changed from index 7 to 8, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New cstate: current_term: 5 leader_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:43.794732  1775 raft_consensus.cc:1064] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719: attempting to promote NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a to VOTER
I20260709 13:11:43.802192 30731 raft_consensus.cc:2955] T f71bd695ecc748db8c77f136fb53616b P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
W20260709 13:11:43.804433  1787 log.cc:927] Time spent T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 13:11:43.810024 30087 tablet_service.cc:1558] Processing DeleteTablet for tablet 802499fd316b44c9b21bede0e714fcfb with delete_type TABLET_DATA_TOMBSTONED (TS 5ec73dc157ed476ca903a7d596271719 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:51762
I20260709 13:11:43.797397  1775 consensus_queue.cc:237] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 4, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:43.801075  1765 raft_consensus.cc:2955] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 8 LEADER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:43.831910  1794 tablet_replica.cc:333] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
W20260709 13:11:43.834913 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 59870.5us
I20260709 13:11:43.835510  1794 raft_consensus.cc:2243] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:43.836447  1794 raft_consensus.cc:2272] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:43.840775  1794 ts_tablet_manager.cc:1916] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:43.875502 30021 raft_consensus.cc:2955] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:43.914683 30023 raft_consensus.cc:1275] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:43.939273 30172 raft_consensus.cc:1275] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:43.937273 30168 raft_consensus.cc:2955] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 7 to 8, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:43.971771  1755 consensus_queue.cc:1048] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:44.000773 30731 raft_consensus.cc:1275] T 143490b42f5d4687a680435e8cd86d1f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 LEARNER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 13:11:43.952960 29994 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 44286.2us
W20260709 13:11:44.062955 30124 debug-util.cc:398] Leaking SignalData structure 0x7b08002db1a0 after lost signal to thread 28892
I20260709 13:11:44.061340  1558 consensus_queue.cc:1048] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 13:11:44.064572 30124 debug-util.cc:398] Leaking SignalData structure 0x7b0800275240 after lost signal to thread 29960
W20260709 13:11:44.067833 30124 debug-util.cc:398] Leaking SignalData structure 0x7b0800263860 after lost signal to thread 30052
W20260709 13:11:44.075676 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 113537us
I20260709 13:11:44.085183 29922 catalog_manager.cc:5697] T f71bd695ecc748db8c77f136fb53616b P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: config changed from index 7 to 8, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New cstate: current_term: 8 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
W20260709 13:11:44.091588 30124 debug-util.cc:398] Leaking SignalData structure 0x7b080013bba0 after lost signal to thread 30201
W20260709 13:11:44.093181 30124 debug-util.cc:398] Leaking SignalData structure 0x7b080004d860 after lost signal to thread 30761
I20260709 13:11:44.104040 30164 tablet_service.cc:1558] Processing DeleteTablet for tablet 651beb51dcbf4055b1178a304fe23043 with delete_type TABLET_DATA_TOMBSTONED (TS c99569d27a6f4c648eae7119fe3db124 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:41318
I20260709 13:11:44.116605  1734 consensus_queue.cc:1048] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 13:11:44.159700  1794 ts_tablet_manager.cc:1929] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 8.7
I20260709 13:11:44.160457  1794 log.cc:1199] T 802499fd316b44c9b21bede0e714fcfb P 5ec73dc157ed476ca903a7d596271719: Deleting WAL directory at /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-1-root/wals/802499fd316b44c9b21bede0e714fcfb
I20260709 13:11:44.160743 30025 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3"
dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
mode: GRACEFUL
new_leader_uuid: "c99569d27a6f4c648eae7119fe3db124"
 from {username='slave'} at 127.0.0.1:47450
I20260709 13:11:44.161676 30025 raft_consensus.cc:606] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 LEADER]: Received request to transfer leadership to TS c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:44.163463 29913 catalog_manager.cc:5028] TS 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): tablet 802499fd316b44c9b21bede0e714fcfb (table test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]) successfully deleted
I20260709 13:11:44.176752 30097 consensus_queue.cc:237] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:44.200735  1802 tablet_replica.cc:333] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:11:44.202127  1802 raft_consensus.cc:2243] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:44.202989  1802 raft_consensus.cc:2272] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:44.215065 30731 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c"
dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
mode: GRACEFUL
new_leader_uuid: "c99569d27a6f4c648eae7119fe3db124"
 from {username='slave'} at 127.0.0.1:55634
I20260709 13:11:44.215677 30731 raft_consensus.cc:606] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 LEADER]: Received request to transfer leadership to TS c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:44.219594 28889 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:11:44.222764 28889 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:11:44.225519 30731 raft_consensus.cc:1275] T f71bd695ecc748db8c77f136fb53616b P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:44.227775 30173 raft_consensus.cc:1275] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 13:11:44.238745  1755 consensus_queue.cc:1048] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:44.243762  1763 raft_consensus.cc:993] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a: : Instructing follower c99569d27a6f4c648eae7119fe3db124 to start an election
I20260709 13:11:44.244289  1763 raft_consensus.cc:1081] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 LEADER]: Signalling peer c99569d27a6f4c648eae7119fe3db124 to start an election
I20260709 13:11:44.247056  1558 consensus_queue.cc:1048] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 13:11:44.248509 30173 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c"
dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
 from {username='slave'} at 127.0.0.1:54540
I20260709 13:11:44.249119 30173 raft_consensus.cc:493] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:44.249468 30173 raft_consensus.cc:3060] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:44.257516 30173 raft_consensus.cc:515] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:44.259456  1802 ts_tablet_manager.cc:1916] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:44.273710  1558 raft_consensus.cc:2955] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index 6 to 7, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:44.278956 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:44.279671 30731 raft_consensus.cc:3055] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 LEADER]: Stepping down as leader of term 7
I20260709 13:11:44.279809 30173 leader_election.cc:290] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:44.280131 30731 raft_consensus.cc:740] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:44.281056 30731 consensus_queue.cc:260] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:44.282162 30731 raft_consensus.cc:3060] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:44.282929  1755 raft_consensus.cc:2955] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 8 LEADER]: Committing config change with OpId 8.9: config changed from index 8 to 9, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:44.292614 30021 raft_consensus.cc:2955] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:44.293263 30728 raft_consensus.cc:2955] T 143490b42f5d4687a680435e8cd86d1f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:44.305136 30731 raft_consensus.cc:2468] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 8.
I20260709 13:11:44.328099 29922 catalog_manager.cc:5697] T 143490b42f5d4687a680435e8cd86d1f P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: config changed from index 6 to 7, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:44.321445 30022 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64effd13e9a741368e16bc2f52fb573c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: true dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:44.333793 30022 raft_consensus.cc:3060] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Advancing to term 8
I20260709 13:11:44.344991 30142 leader_election.cc:304] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:44.346024  1636 raft_consensus.cc:2804] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 13:11:44.346537  1636 raft_consensus.cc:697] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 8 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:44.347538  1636 consensus_queue.cc:237] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:44.349277  1752 raft_consensus.cc:993] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4: : Instructing follower c99569d27a6f4c648eae7119fe3db124 to start an election
I20260709 13:11:44.349777  1752 raft_consensus.cc:1081] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 LEADER]: Signalling peer c99569d27a6f4c648eae7119fe3db124 to start an election
I20260709 13:11:44.350391 30022 raft_consensus.cc:2468] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 8.
I20260709 13:11:44.342514 30168 raft_consensus.cc:2955] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } attrs { replace: true } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:44.362968 30173 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3"
dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
 from {username='slave'} at 127.0.0.1:43838
I20260709 13:11:44.363619 30173 raft_consensus.cc:493] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:11:44.364192 30173 raft_consensus.cc:3060] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:44.366060 30176 raft_consensus.cc:2955] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 8 to 9, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:44.379205 30731 raft_consensus.cc:2955] T f71bd695ecc748db8c77f136fb53616b P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Committing config change with OpId 8.9: config changed from index 8 to 9, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New config: { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:44.431488 30102 consensus_queue.cc:237] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:44.436677 29913 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet f71bd695ecc748db8c77f136fb53616b with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:44.449007 30021 raft_consensus.cc:1275] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:44.453775 30728 raft_consensus.cc:1275] T 143490b42f5d4687a680435e8cd86d1f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:44.467695  1567 consensus_queue.cc:1048] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:44.471984 30173 raft_consensus.cc:515] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 13 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:44.482426 30173 leader_election.cc:290] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 13 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:44.484265 30021 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "b2cea0098c1040f69755ea4d3dab7fc4"
I20260709 13:11:44.483749  1567 consensus_queue.cc:1048] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 13:11:44.485828 30021 raft_consensus.cc:3055] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 13:11:44.486166 30021 raft_consensus.cc:740] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: b2cea0098c1040f69755ea4d3dab7fc4, State: Running, Role: LEADER
I20260709 13:11:44.487867 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31b19922895c4885a5a8bc5030afcba3" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: true dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:44.489051 30731 raft_consensus.cc:3060] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:44.488644 30021 consensus_queue.cc:260] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:44.497685 29921 catalog_manager.cc:5697] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 7 to 8, leader changed from 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 8 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:44.497339 30021 raft_consensus.cc:3060] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:44.507320  1755 raft_consensus.cc:2955] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 7 LEADER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:44.520437 30022 raft_consensus.cc:2955] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:44.537781 29922 catalog_manager.cc:5697] T f71bd695ecc748db8c77f136fb53616b P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: config changed from index 8 to 9, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New cstate: current_term: 8 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:44.540614 30021 raft_consensus.cc:2468] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 13.
I20260709 13:11:44.541854 30140 leader_election.cc:304] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:44.543558  1800 raft_consensus.cc:2804] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:44.545102  1800 raft_consensus.cc:697] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 13 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:44.545965  1800 consensus_queue.cc:237] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:44.559993 30009 tablet_service.cc:1558] Processing DeleteTablet for tablet f71bd695ecc748db8c77f136fb53616b with delete_type TABLET_DATA_TOMBSTONED (TS b2cea0098c1040f69755ea4d3dab7fc4 not found in new config with opid_index 9) from {username='slave'} at 127.0.0.1:41782
I20260709 13:11:44.577651 29922 catalog_manager.cc:5697] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 reported cstate change: config changed from index 7 to 8, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New cstate: current_term: 7 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:44.607362 30731 raft_consensus.cc:2468] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 13.
I20260709 13:11:44.619441 30735 raft_consensus.cc:2955] T 143490b42f5d4687a680435e8cd86d1f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER c99569d27a6f4c648eae7119fe3db124 (127.28.54.67) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:44.631639 29913 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 143490b42f5d4687a680435e8cd86d1f with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:44.633167 30164 tablet_service.cc:1558] Processing DeleteTablet for tablet 143490b42f5d4687a680435e8cd86d1f with delete_type TABLET_DATA_TOMBSTONED (TS c99569d27a6f4c648eae7119fe3db124 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:41318
I20260709 13:11:44.637224  1809 tablet_replica.cc:333] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
W20260709 13:11:44.645196 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 51090.5us
I20260709 13:11:44.651098 29923 catalog_manager.cc:5697] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 12 to 13, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 13 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:44.652549  1802 ts_tablet_manager.cc:1929] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.7
I20260709 13:11:44.655313  1802 log.cc:1199] T 651beb51dcbf4055b1178a304fe23043 P c99569d27a6f4c648eae7119fe3db124: Deleting WAL directory at /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-2-root/wals/651beb51dcbf4055b1178a304fe23043
I20260709 13:11:44.661702  1809 raft_consensus.cc:2243] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:44.662694  1809 raft_consensus.cc:2272] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:44.671751  1809 ts_tablet_manager.cc:1916] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:44.695642  1802 tablet_replica.cc:333] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:11:44.695683 29912 catalog_manager.cc:5028] TS c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): tablet 651beb51dcbf4055b1178a304fe23043 (table test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]) successfully deleted
I20260709 13:11:44.721271  1802 raft_consensus.cc:2243] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:44.722231  1802 raft_consensus.cc:2272] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:44.727768  1802 ts_tablet_manager.cc:1916] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 13:11:44.731178  1809 ts_tablet_manager.cc:1929] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 8.8
I20260709 13:11:44.736403  1809 log.cc:1199] T f71bd695ecc748db8c77f136fb53616b P b2cea0098c1040f69755ea4d3dab7fc4: Deleting WAL directory at /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-0-root/wals/f71bd695ecc748db8c77f136fb53616b
I20260709 13:11:44.738492 29910 catalog_manager.cc:5028] TS b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): tablet f71bd695ecc748db8c77f136fb53616b (table test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]) successfully deleted
I20260709 13:11:44.770990 30735 raft_consensus.cc:1275] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:44.773828  1636 consensus_queue.cc:1048] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:44.795519  1802 ts_tablet_manager.cc:1929] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 7.7
I20260709 13:11:44.796012  1802 log.cc:1199] T 143490b42f5d4687a680435e8cd86d1f P c99569d27a6f4c648eae7119fe3db124: Deleting WAL directory at /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783602558744475-28889-0/minicluster-data/ts-2-root/wals/143490b42f5d4687a680435e8cd86d1f
I20260709 13:11:44.797427 29912 catalog_manager.cc:5028] TS c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): tablet 143490b42f5d4687a680435e8cd86d1f (table test-workload [id=ab0f2439b33d4f6c90a38766c65645e2]) successfully deleted
I20260709 13:11:44.866668 30021 raft_consensus.cc:1275] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 13:11:44.868111  1745 consensus_queue.cc:1048] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:44.967634 30022 raft_consensus.cc:1275] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 13 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:11:44.971589  1636 consensus_queue.cc:1048] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 13:11:44.984859 30728 raft_consensus.cc:1275] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 13 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 13:11:44.986217  1745 consensus_queue.cc:1048] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 13:11:45.169420 29914 maintenance_manager.cc:643] P 1c91346f9a2a480e908d4e0323634aeb: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 1.503s	user 0.147s	sys 0.072s Metrics: {"bytes_written":29900,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":86206,"dirs.run_cpu_time_us":321,"dirs.run_wall_time_us":3548,"drs_written":1,"lbm_read_time_us":199,"lbm_reads_lt_1ms":4,"lbm_write_time_us":69344,"lbm_writes_10-100_ms":2,"lbm_writes_lt_1ms":33,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":68528,"threads_started":1,"update_count":7}
I20260709 13:11:45.173578 29915 maintenance_manager.cc:419] P 1c91346f9a2a480e908d4e0323634aeb: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 12007 bytes on disk
I20260709 13:11:45.177675 29914 maintenance_manager.cc:643] P 1c91346f9a2a480e908d4e0323634aeb: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.001s	user 0.000s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":286,"lbm_reads_lt_1ms":4}
I20260709 13:11:45.225425 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:11:45.351500 28889 tablet_server.cc:179] TabletServer@127.28.54.65:0 shutting down...
W20260709 13:11:45.415132 30140 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 49 similar messages]
W20260709 13:11:45.415426 30066 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 140324us
W20260709 13:11:45.454092 30066 consensus_peers.cc:597] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:45.456382 30066 consensus_peers.cc:597] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:45.457293 30066 consensus_peers.cc:597] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:45.473341 30140 consensus_peers.cc:597] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:45.478022 30140 consensus_peers.cc:597] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:45.478157 30066 consensus_peers.cc:597] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:45.480018 30066 consensus_peers.cc:597] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:45.483562 30066 consensus_peers.cc:597] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:45.485109 30066 consensus_peers.cc:597] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:45.486351 30140 consensus_peers.cc:597] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:45.503746 30700 consensus_peers.cc:597] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:45.508693 30140 consensus_peers.cc:597] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:45.532649 30140 consensus_peers.cc:597] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:45.542351 30140 consensus_peers.cc:597] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:45.552428 28889 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:45.553396 28889 tablet_replica.cc:333] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:11:45.559417 28889 raft_consensus.cc:2243] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.560109 28889 raft_consensus.cc:2272] T 632c5405056e40be8152973f0c966318 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.563010 28889 tablet_replica.cc:333] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:11:45.574366 28889 raft_consensus.cc:2243] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.575143 28889 raft_consensus.cc:2272] T 935127b9887c4175b5b65fd739c5cffe P b2cea0098c1040f69755ea4d3dab7fc4 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:45.576397 30140 consensus_peers.cc:597] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:45.578122 28889 tablet_replica.cc:333] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:11:45.579036 28889 raft_consensus.cc:2243] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 13 LEADER]: Raft consensus shutting down.
W20260709 13:11:45.583297 30066 consensus_peers.cc:597] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:45.583297 30700 consensus_peers.cc:597] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:45.584141 28889 raft_consensus.cc:2272] T 7d7c81315a41495eafb4a8020a99cb7c P b2cea0098c1040f69755ea4d3dab7fc4 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.586907 28889 tablet_replica.cc:333] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:11:45.588130 28889 raft_consensus.cc:2243] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 LEADER]: Raft consensus shutting down.
I20260709 13:11:45.589134 28889 raft_consensus.cc:2272] T f68c2b86f7fc4ef48b6dc19371d4560b P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:45.599032 30066 consensus_peers.cc:597] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:45.601492 28889 tablet_replica.cc:333] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:11:45.602685 28889 raft_consensus.cc:2243] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:11:45.603703 28889 raft_consensus.cc:2272] T 5c8539fb97344b07aed5af91eaf0806f P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:45.605404 30700 consensus_peers.cc:597] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:45.606374 28889 tablet_replica.cc:333] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:11:45.607169 28889 raft_consensus.cc:2243] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.607720 28889 raft_consensus.cc:2272] T f5c869d5410b4a83adc1ca35397defb6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:45.608850 30700 consensus_peers.cc:597] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:45.610500 28889 tablet_replica.cc:333] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:11:45.611394 28889 raft_consensus.cc:2243] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:11:45.612354 28889 raft_consensus.cc:2272] T 407fb380b889498d94c7525edbc34b23 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.615265 28889 tablet_replica.cc:333] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:11:45.615974 28889 raft_consensus.cc:2243] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:11:45.616987 28889 raft_consensus.cc:2272] T 56168b79f56f4dee859bee3ef7df4712 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.619968 28889 tablet_replica.cc:333] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:11:45.620729 28889 raft_consensus.cc:2243] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.621290 28889 raft_consensus.cc:2272] T ea42d6bd0dbb4438a96c31b335069e3c P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.623807 28889 tablet_replica.cc:333] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:11:45.624506 28889 raft_consensus.cc:2243] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.625054 28889 raft_consensus.cc:2272] T 24644eca754d40189c8264977160368a P b2cea0098c1040f69755ea4d3dab7fc4 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.627555 28889 tablet_replica.cc:333] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:11:45.628293 28889 raft_consensus.cc:2243] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:11:45.630188 28889 raft_consensus.cc:2272] T 777fb4e4b87a4d549e79b74a36a2ac08 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.633036 28889 tablet_replica.cc:333] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:11:45.633744 28889 raft_consensus.cc:2243] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.634284 28889 raft_consensus.cc:2272] T de39104c229542e3a29860956492edea P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.636703 28889 tablet_replica.cc:333] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:11:45.637521 28889 raft_consensus.cc:2243] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:11:45.638542 28889 raft_consensus.cc:2272] T d3f3f9c9793f4390874e250718c41697 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.640925 28889 tablet_replica.cc:333] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:11:45.641607 28889 raft_consensus.cc:2243] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.642251 28889 raft_consensus.cc:2272] T 5a14bd61c7a94d1ca54063afae0c68e8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.644690 28889 tablet_replica.cc:333] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:11:45.645350 28889 raft_consensus.cc:2243] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.645864 28889 raft_consensus.cc:2272] T 57ce415a86d343cb8bdff28acc41c6a6 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:45.666630 30066 consensus_peers.cc:597] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:45.674266 28889 tablet_replica.cc:333] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:11:45.676066 28889 raft_consensus.cc:2243] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.683424 28889 raft_consensus.cc:2272] T 0a722bee3f14472ebed5b798e61c64b3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.686089 28889 tablet_replica.cc:333] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:11:45.686821 28889 raft_consensus.cc:2243] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:11:45.690264 28889 raft_consensus.cc:2272] T d968b6d22e3243bfb840139be8b6dddd P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.692713 28889 tablet_replica.cc:333] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:11:45.698937 28889 raft_consensus.cc:2243] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:11:45.699971 28889 raft_consensus.cc:2272] T 9cd772608bf64bf9b1c1aec00dc57eee P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.702386 28889 tablet_replica.cc:333] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:11:45.703506 28889 raft_consensus.cc:2243] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Raft consensus shutting down.
W20260709 13:11:45.704049 30700 consensus_peers.cc:597] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:45.704698 28889 raft_consensus.cc:2272] T d7be23af8c824b3bb048a59d6bdf884c P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.707540 28889 tablet_replica.cc:333] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:11:45.708266 28889 raft_consensus.cc:2243] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.709941 28889 raft_consensus.cc:2272] T 64effd13e9a741368e16bc2f52fb573c P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.716135 28889 tablet_replica.cc:333] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:11:45.716862 28889 raft_consensus.cc:2243] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.717490 28889 raft_consensus.cc:2272] T 3068102662114944a63195a8d764e93d P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.719940 28889 tablet_replica.cc:333] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:11:45.720650 28889 raft_consensus.cc:2243] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 LEADER]: Raft consensus shutting down.
W20260709 13:11:45.727896 30066 consensus_peers.cc:597] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:45.735368 30140 consensus_peers.cc:597] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:45.743676 30140 consensus_peers.cc:597] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:45.721604 28889 raft_consensus.cc:2272] T f8fcd3026125450694af59415c94e029 P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.752491 28889 tablet_replica.cc:333] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:11:45.753271 28889 raft_consensus.cc:2243] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.753867 28889 raft_consensus.cc:2272] T b58427f5fe51486b983433e11caa8a3f P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.756578 28889 tablet_replica.cc:333] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:11:45.757364 28889 raft_consensus.cc:2243] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.785799 28889 raft_consensus.cc:2272] T 80006b8186d74baba29992ade1966048 P b2cea0098c1040f69755ea4d3dab7fc4 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.788817 28889 tablet_replica.cc:333] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:11:45.789554 28889 raft_consensus.cc:2243] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.790227 28889 raft_consensus.cc:2272] T c56071aeace442bebfbcd88e12fe4376 P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.796183 28889 tablet_replica.cc:333] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:11:45.796902 28889 raft_consensus.cc:2243] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.797508 28889 raft_consensus.cc:2272] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.800129 28889 tablet_replica.cc:333] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:11:45.800943 28889 raft_consensus.cc:2243] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.801741 28889 raft_consensus.cc:2272] T 143490b42f5d4687a680435e8cd86d1f P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.805975 28889 tablet_replica.cc:333] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
W20260709 13:11:45.808468 30066 consensus_peers.cc:597] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:45.811456 30700 consensus_peers.cc:597] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:45.813273 28889 raft_consensus.cc:2243] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.813916 28889 raft_consensus.cc:2272] T 98e11967c3504e11865ed831f2584aea P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.816814 28889 tablet_replica.cc:333] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:11:45.817508 28889 raft_consensus.cc:2243] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Raft consensus shutting down.
W20260709 13:11:45.823966 30140 consensus_peers.cc:597] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:45.825388 28889 raft_consensus.cc:2272] T f5616428acc64e24945a779e1aee597f P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.830229 28889 tablet_replica.cc:333] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:11:45.830930 28889 raft_consensus.cc:2243] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:11:45.835294 28889 raft_consensus.cc:2272] T b38ec265ce704d799b58d99914a46422 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.837700 28889 tablet_replica.cc:333] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:11:45.838392 28889 raft_consensus.cc:2243] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.838830 28889 raft_consensus.cc:2272] T 31b19922895c4885a5a8bc5030afcba3 P b2cea0098c1040f69755ea4d3dab7fc4 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.847674 28889 tablet_replica.cc:333] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:11:45.848385 28889 raft_consensus.cc:2243] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.848943 28889 raft_consensus.cc:2272] T f7c9e9bbe0c44a8d803c3d45799906f2 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.862463 28889 tablet_replica.cc:333] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:11:45.863107 28889 raft_consensus.cc:2243] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.863722 28889 raft_consensus.cc:2272] T 0be979412dd54241bd212ddbb7611046 P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:45.867378 30140 consensus_peers.cc:597] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:45.877918 30140 consensus_peers.cc:597] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:45.898617 28889 tablet_replica.cc:333] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:11:45.899487 28889 raft_consensus.cc:2243] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.900036 28889 raft_consensus.cc:2272] T 64e2b2bd54d3454a9f64030c149e2e25 P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.902534 28889 tablet_replica.cc:333] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:11:45.903107 28889 raft_consensus.cc:2243] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.914052 28889 raft_consensus.cc:2272] T e218d3c3e368401a8eff81a5699074b8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.916808 28889 tablet_replica.cc:333] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:11:45.920084 28889 raft_consensus.cc:2243] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.920717 28889 raft_consensus.cc:2272] T 1136db29fbad4093bcad74bb6274f752 P b2cea0098c1040f69755ea4d3dab7fc4 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.924576 28889 tablet_replica.cc:333] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:11:45.925318 28889 raft_consensus.cc:2243] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.925977 28889 raft_consensus.cc:2272] T 21562b36aa874c9cba1acd5dc79cf517 P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.929549 30176 consensus_queue.cc:237] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:11:45.943902 28889 tablet_replica.cc:333] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:11:45.944924 28889 raft_consensus.cc:2243] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:11:45.946820 28889 raft_consensus.cc:2272] T 802499fd316b44c9b21bede0e714fcfb P b2cea0098c1040f69755ea4d3dab7fc4 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.949309 28889 tablet_replica.cc:333] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:11:45.952909 28889 raft_consensus.cc:2243] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.953496 28889 raft_consensus.cc:2272] T 817d4a23671d4a1d9c3b9db3b4e77b0f P b2cea0098c1040f69755ea4d3dab7fc4 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.956979 30095 raft_consensus.cc:1275] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 14 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
W20260709 13:11:45.957367 30142 consensus_peers.cc:597] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 -> Peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469): Couldn't send request to peer 6f3eb161e2194f6891f12e2cfcaaf73a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 24644eca754d40189c8264977160368a. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:45.959046 28889 tablet_replica.cc:333] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:11:45.959892 28889 raft_consensus.cc:2243] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.960506 28889 raft_consensus.cc:2272] T ff758e6a87fa49b99c35558fafe39f11 P b2cea0098c1040f69755ea4d3dab7fc4 [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:45.960913 30140 consensus_peers.cc:597] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:45.961476  1745 consensus_queue.cc:1048] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:45.964962 28889 tablet_replica.cc:333] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:11:45.974656 28889 raft_consensus.cc:2243] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:11:45.976620 28889 raft_consensus.cc:2272] T 63253e2671134725b8fe85f63070e4c8 P b2cea0098c1040f69755ea4d3dab7fc4 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.980383 28889 tablet_replica.cc:333] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:11:45.983573 28889 raft_consensus.cc:2243] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.984872 28889 raft_consensus.cc:2272] T 48d3196b43924d35bf72234ad500783e P b2cea0098c1040f69755ea4d3dab7fc4 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.987807 28889 tablet_replica.cc:333] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:11:45.990867 28889 raft_consensus.cc:2243] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:45.992115 28889 raft_consensus.cc:2272] T c41a6d79ca9c459eb4b0b41302fb76a9 P b2cea0098c1040f69755ea4d3dab7fc4 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:45.994994 28889 tablet_replica.cc:333] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:11:45.996212 28889 raft_consensus.cc:2243] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:11:45.997171 28889 raft_consensus.cc:2272] T 651beb51dcbf4055b1178a304fe23043 P b2cea0098c1040f69755ea4d3dab7fc4 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:46.000146 28889 tablet_replica.cc:333] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4: stopping tablet replica
I20260709 13:11:46.000777  1745 raft_consensus.cc:2955] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 14 LEADER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:11:46.002667 30095 raft_consensus.cc:2955] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 14 FOLLOWER]: Committing config change with OpId 14.10: config changed from index -1 to 10, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:11:46.000770 28889 raft_consensus.cc:2243] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:11:46.013530 28889 raft_consensus.cc:2272] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P b2cea0098c1040f69755ea4d3dab7fc4 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:46.018817 29923 catalog_manager.cc:5697] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 reported cstate change: config changed from index -1 to 10, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New cstate: current_term: 14 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
W20260709 13:11:46.027796 29974 auto_rebalancer.cc:629] Failed to schedule move for tablet 63253e2671134725b8fe85f63070e4c8: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:11:46.035912 30173 consensus_queue.cc:237] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
W20260709 13:11:46.067164 30142 consensus_peers.cc:597] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 -> Peer 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469): Couldn't send request to peer 6f3eb161e2194f6891f12e2cfcaaf73a. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ff758e6a87fa49b99c35558fafe39f11. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:46.072858 30102 raft_consensus.cc:1275] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260709 13:11:46.074865 30140 consensus_peers.cc:597] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:46.076244  1745 consensus_queue.cc:1048] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 13:11:46.115600 30102 raft_consensus.cc:2955] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:11:46.113327  1800 raft_consensus.cc:2955] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 7 LEADER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } } }
I20260709 13:11:46.249023 29921 catalog_manager.cc:5697] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: config changed from index -1 to 6, NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) added. New cstate: current_term: 7 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:46.363211  1839 ts_tablet_manager.cc:933] T 24644eca754d40189c8264977160368a P 6f3eb161e2194f6891f12e2cfcaaf73a: Initiating tablet copy from peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:46.398881  1839 tablet_copy_client.cc:323] T 24644eca754d40189c8264977160368a P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Beginning tablet copy session from remote peer at address 127.28.54.67:45001
I20260709 13:11:46.400794 30187 tablet_copy_service.cc:140] P c99569d27a6f4c648eae7119fe3db124: Received BeginTabletCopySession request for tablet 24644eca754d40189c8264977160368a from peer 6f3eb161e2194f6891f12e2cfcaaf73a ({username='slave'} at 127.0.0.1:54540)
I20260709 13:11:46.401388 30187 tablet_copy_service.cc:161] P c99569d27a6f4c648eae7119fe3db124: Beginning new tablet copy session on tablet 24644eca754d40189c8264977160368a from peer 6f3eb161e2194f6891f12e2cfcaaf73a at {username='slave'} at 127.0.0.1:54540: session id = 6f3eb161e2194f6891f12e2cfcaaf73a-24644eca754d40189c8264977160368a
I20260709 13:11:46.409708 30187 tablet_copy_source_session.cc:215] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:46.416100  1839 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24644eca754d40189c8264977160368a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:46.483279  1839 tablet_copy_client.cc:806] T 24644eca754d40189c8264977160368a P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:46.483987  1839 tablet_copy_client.cc:670] T 24644eca754d40189c8264977160368a P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:46.494168  1839 tablet_copy_client.cc:538] T 24644eca754d40189c8264977160368a P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:46.524025  1839 tablet_bootstrap.cc:492] T 24644eca754d40189c8264977160368a P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap starting.
I20260709 13:11:46.541501  1841 ts_tablet_manager.cc:933] T ff758e6a87fa49b99c35558fafe39f11 P 6f3eb161e2194f6891f12e2cfcaaf73a: Initiating tablet copy from peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:46.576109  1841 tablet_copy_client.cc:323] T ff758e6a87fa49b99c35558fafe39f11 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Beginning tablet copy session from remote peer at address 127.28.54.67:45001
I20260709 13:11:46.578363 30187 tablet_copy_service.cc:140] P c99569d27a6f4c648eae7119fe3db124: Received BeginTabletCopySession request for tablet ff758e6a87fa49b99c35558fafe39f11 from peer 6f3eb161e2194f6891f12e2cfcaaf73a ({username='slave'} at 127.0.0.1:54540)
I20260709 13:11:46.578898 30187 tablet_copy_service.cc:161] P c99569d27a6f4c648eae7119fe3db124: Beginning new tablet copy session on tablet ff758e6a87fa49b99c35558fafe39f11 from peer 6f3eb161e2194f6891f12e2cfcaaf73a at {username='slave'} at 127.0.0.1:54540: session id = 6f3eb161e2194f6891f12e2cfcaaf73a-ff758e6a87fa49b99c35558fafe39f11
I20260709 13:11:46.637109  1810 raft_consensus.cc:493] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:46.637784  1810 raft_consensus.cc:515] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:46.646786 30700 leader_election.cc:336] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:46.650110 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:46.651861 30703 leader_election.cc:304] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:46.652765  1722 raft_consensus.cc:2749] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:46.649955  1810 leader_election.cc:290] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:46.673606  1567 raft_consensus.cc:493] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:46.674167  1567 raft_consensus.cc:515] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:46.676999  1567 leader_election.cc:290] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:46.677162 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:46.686967  1839 tablet_bootstrap.cc:492] T 24644eca754d40189c8264977160368a P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap replayed 1/1 log segments. Stats: ops{read=10 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:46.687902  1839 tablet_bootstrap.cc:492] T 24644eca754d40189c8264977160368a P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap complete.
I20260709 13:11:46.688592  1839 ts_tablet_manager.cc:1403] T 24644eca754d40189c8264977160368a P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent bootstrapping tablet: real 0.165s	user 0.041s	sys 0.007s
I20260709 13:11:46.697939  1722 raft_consensus.cc:493] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:46.698556  1722 raft_consensus.cc:515] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:46.699716  1839 raft_consensus.cc:359] T 24644eca754d40189c8264977160368a P 6f3eb161e2194f6891f12e2cfcaaf73a [term 14 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:11:46.700544  1839 raft_consensus.cc:740] T 24644eca754d40189c8264977160368a P 6f3eb161e2194f6891f12e2cfcaaf73a [term 14 LEARNER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Initialized, Role: LEARNER
I20260709 13:11:46.701175  1839 consensus_queue.cc:260] T 24644eca754d40189c8264977160368a P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:11:46.702369 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:46.708607  1755 raft_consensus.cc:493] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:46.709091  1755 raft_consensus.cc:515] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:46.710981  1755 leader_election.cc:290] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:46.713665 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:46.725315 30187 tablet_copy_source_session.cc:215] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 13:11:46.702447  1722 leader_election.cc:290] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:11:46.733891 30066 leader_election.cc:336] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:46.734444 30066 leader_election.cc:304] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:46.735203  1567 raft_consensus.cc:2749] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 13:11:46.741609  1841 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff758e6a87fa49b99c35558fafe39f11. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:11:46.753505  1839 ts_tablet_manager.cc:1434] T 24644eca754d40189c8264977160368a P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent starting tablet: real 0.065s	user 0.004s	sys 0.009s
W20260709 13:11:46.756649 30066 leader_election.cc:336] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:46.757138 30066 leader_election.cc:304] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:46.757827  1567 raft_consensus.cc:2749] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:46.761070 30187 tablet_copy_service.cc:342] P c99569d27a6f4c648eae7119fe3db124: Request end of tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-24644eca754d40189c8264977160368a received from {username='slave'} at 127.0.0.1:54540
I20260709 13:11:46.774693  1800 raft_consensus.cc:493] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:46.775255  1800 raft_consensus.cc:515] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:46.778177 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:46.777663  1800 leader_election.cc:290] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:46.785928 30140 leader_election.cc:336] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:46.786355 30140 leader_election.cc:304] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:46.787612  1828 raft_consensus.cc:2749] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:11:46.802805 30700 leader_election.cc:336] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:46.803339 30700 leader_election.cc:304] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:46.802847 30187 tablet_copy_service.cc:434] P c99569d27a6f4c648eae7119fe3db124: ending tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-24644eca754d40189c8264977160368a on tablet 24644eca754d40189c8264977160368a with peer 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:46.806015  1722 raft_consensus.cc:2749] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:46.813231  1841 tablet_copy_client.cc:806] T ff758e6a87fa49b99c35558fafe39f11 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 0 data blocks...
I20260709 13:11:46.813918  1841 tablet_copy_client.cc:670] T ff758e6a87fa49b99c35558fafe39f11 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Starting download of 1 WAL segments...
I20260709 13:11:46.830971  1841 tablet_copy_client.cc:538] T ff758e6a87fa49b99c35558fafe39f11 P 6f3eb161e2194f6891f12e2cfcaaf73a: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 13:11:46.836016  1567 raft_consensus.cc:493] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:46.836570  1567 raft_consensus.cc:515] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:46.847184  1567 leader_election.cc:290] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:46.849061 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:11:46.852138 30066 leader_election.cc:336] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:46.859812 30068 leader_election.cc:304] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:46.860639  1567 raft_consensus.cc:2749] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:46.862527  1800 raft_consensus.cc:493] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:46.863191  1841 tablet_bootstrap.cc:492] T ff758e6a87fa49b99c35558fafe39f11 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap starting.
I20260709 13:11:46.863059  1800 raft_consensus.cc:515] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:46.865067  1800 leader_election.cc:290] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:46.866595 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:46.867192 30095 raft_consensus.cc:2468] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 10.
I20260709 13:11:46.868928 30143 leader_election.cc:304] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:46.869686  1800 raft_consensus.cc:2804] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:46.870059  1800 raft_consensus.cc:493] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:46.870396  1800 raft_consensus.cc:3060] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:11:46.871397 30140 leader_election.cc:336] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:46.874418  1828 raft_consensus.cc:493] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:46.874920  1828 raft_consensus.cc:515] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:46.876825  1828 leader_election.cc:290] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:46.878268 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:46.878855 30735 raft_consensus.cc:2468] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 13.
I20260709 13:11:46.880041 30142 leader_election.cc:304] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:46.880769  1828 raft_consensus.cc:2804] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 13:11:46.881126  1828 raft_consensus.cc:493] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 13 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:46.881484  1828 raft_consensus.cc:3060] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:46.885908  1745 raft_consensus.cc:493] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:46.886430  1745 raft_consensus.cc:515] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:46.888434  1745 leader_election.cc:290] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:46.890309 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:46.890924 30095 raft_consensus.cc:2468] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 11.
I20260709 13:11:46.892158 30143 leader_election.cc:304] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:46.893915  1745 raft_consensus.cc:2804] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:46.881460  1800 raft_consensus.cc:515] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:46.897928 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "777fb4e4b87a4d549e79b74a36a2ac08" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:46.898459 30102 raft_consensus.cc:3060] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:46.894277  1745 raft_consensus.cc:493] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:46.899396  1745 raft_consensus.cc:3060] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:46.902408  1722 raft_consensus.cc:493] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:46.902915  1722 raft_consensus.cc:515] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:46.905624  1722 leader_election.cc:290] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:46.909461 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
W20260709 13:11:46.910573 30700 leader_election.cc:336] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:46.911583 30102 raft_consensus.cc:2468] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 11.
I20260709 13:11:46.912339 30703 leader_election.cc:304] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:46.912832 30143 leader_election.cc:304] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:46.913447  1846 raft_consensus.cc:2749] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:46.918156  1567 raft_consensus.cc:493] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:46.918648  1567 raft_consensus.cc:515] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:46.920390  1722 raft_consensus.cc:493] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:46.920933  1722 raft_consensus.cc:515] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:46.921517  1819 raft_consensus.cc:493] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:46.922076  1819 raft_consensus.cc:515] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:46.923544  1722 leader_election.cc:290] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:46.924045  1819 leader_election.cc:290] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:46.925913 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:46.930154 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:46.930719 30095 raft_consensus.cc:2468] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 8.
W20260709 13:11:46.933167 30700 leader_election.cc:336] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
W20260709 13:11:46.938072 30066 leader_election.cc:336] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:46.896633  1828 raft_consensus.cc:515] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:46.939119 30703 leader_election.cc:304] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:46.943373  1846 raft_consensus.cc:2804] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:46.943725  1846 raft_consensus.cc:493] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:46.944089  1846 raft_consensus.cc:3060] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:46.945855 30066 leader_election.cc:336] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:46.948221  1745 raft_consensus.cc:515] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:46.949229  1755 raft_consensus.cc:493] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:46.949729  1755 raft_consensus.cc:515] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:46.938599  1848 raft_consensus.cc:2804] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:46.951700  1755 leader_election.cc:290] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:46.939427 30068 leader_election.cc:304] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:46.939905  1819 raft_consensus.cc:493] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:46.952527  1819 raft_consensus.cc:515] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:46.953284  1755 raft_consensus.cc:2749] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:46.954494  1819 leader_election.cc:290] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:46.940711  1567 leader_election.cc:290] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:46.956351  1846 raft_consensus.cc:515] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:46.951959 30140 leader_election.cc:336] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:46.959002  1800 leader_election.cc:290] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:46.963186 30735 raft_consensus.cc:1217] T 24644eca754d40189c8264977160368a P 6f3eb161e2194f6891f12e2cfcaaf73a [term 14 LEARNER]: Deduplicated request from leader. Original: 14.9->[14.10-14.10]   Dedup: 14.10->[]
W20260709 13:11:46.960923 30140 leader_election.cc:336] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
W20260709 13:11:46.965013 30140 leader_election.cc:336] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:46.967130 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:46.977963  1567 raft_consensus.cc:493] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:46.979511 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:46.980104 30176 raft_consensus.cc:2468] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 12.
I20260709 13:11:46.978472  1567 raft_consensus.cc:515] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:46.981400 30068 leader_election.cc:304] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:46.983011 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:46.989439 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d7c81315a41495eafb4a8020a99cb7c" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:46.990106 30728 raft_consensus.cc:3060] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 13 FOLLOWER]: Advancing to term 14
I20260709 13:11:46.997087 30728 raft_consensus.cc:2468] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 14.
I20260709 13:11:46.998806 30142 leader_election.cc:304] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:46.997742  1828 leader_election.cc:290] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 14 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:11:47.003114 30066 leader_election.cc:336] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
W20260709 13:11:47.003677 30066 leader_election.cc:336] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:47.004386 30735 raft_consensus.cc:2393] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 9: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
I20260709 13:11:46.969120  1848 raft_consensus.cc:697] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 11 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:47.022459  1567 leader_election.cc:290] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:47.026084 30068 leader_election.cc:304] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:47.027297  1567 raft_consensus.cc:3060] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:47.028015 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 50259.4us
I20260709 13:11:47.005203  1755 raft_consensus.cc:2804] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:47.003793  1851 raft_consensus.cc:2804] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 13:11:47.033430  1851 raft_consensus.cc:697] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 14 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:47.034322  1851 consensus_queue.cc:237] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:47.035463  1745 leader_election.cc:290] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 12 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:47.036022  1745 raft_consensus.cc:493] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:47.036428  1745 raft_consensus.cc:515] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:47.030402 30068 leader_election.cc:304] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:47.028235 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:47.040112 30728 raft_consensus.cc:2468] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 12.
I20260709 13:11:47.030236  1755 raft_consensus.cc:493] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:47.041975  1819 raft_consensus.cc:2749] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:47.050963  1849 raft_consensus.cc:493] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:47.063026  1846 leader_election.cc:290] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:47.084090  1567 raft_consensus.cc:2749] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:47.085369  1850 raft_consensus.cc:493] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:47.047833  1848 consensus_queue.cc:237] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:47.085897  1850 raft_consensus.cc:515] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:47.087841  1850 leader_election.cc:290] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:47.050150  1755 raft_consensus.cc:3060] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:47.089025  1849 raft_consensus.cc:515] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:47.098814  1845 raft_consensus.cc:493] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:47.099342  1845 raft_consensus.cc:515] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:47.101341  1845 leader_election.cc:290] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:47.101799  1745 leader_election.cc:290] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:47.104192 30700 leader_election.cc:336] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:47.104307  1755 raft_consensus.cc:515] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:47.109411 30700 leader_election.cc:336] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:47.123339  1567 raft_consensus.cc:493] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:47.123876  1567 raft_consensus.cc:515] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:47.125219  1567 leader_election.cc:290] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:47.125577  1567 raft_consensus.cc:493] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:47.125916  1567 raft_consensus.cc:515] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:47.127147  1567 leader_election.cc:290] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:47.127651  1567 raft_consensus.cc:493] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:47.128017  1567 raft_consensus.cc:515] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:47.130381  1567 leader_election.cc:290] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:47.132753  1755 leader_election.cc:290] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 13 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:47.136525  1849 leader_election.cc:290] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:11:47.138098 30140 leader_election.cc:336] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 14 election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
W20260709 13:11:47.139042 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 97409.9us
I20260709 13:11:47.142168 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:47.147440 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:47.147934 30735 raft_consensus.cc:2468] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 10.
I20260709 13:11:47.148802 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:47.149389 30176 raft_consensus.cc:2468] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 11.
I20260709 13:11:47.150995 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:47.154006 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f8fcd3026125450694af59415c94e029" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:47.154120 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b38ec265ce704d799b58d99914a46422" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:47.154520 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:47.154692 30102 raft_consensus.cc:3060] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:47.155097 30095 raft_consensus.cc:2468] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 11.
I20260709 13:11:47.156205 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:47.156684 30095 raft_consensus.cc:2468] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 6.
I20260709 13:11:47.154529 30176 raft_consensus.cc:3060] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:47.158217 30066 leader_election.cc:336] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:47.162309 30102 raft_consensus.cc:2468] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 12.
W20260709 13:11:47.163288 30140 leader_election.cc:336] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
W20260709 13:11:47.164204 30140 leader_election.cc:336] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
W20260709 13:11:47.164852 30140 leader_election.cc:336] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
W20260709 13:11:47.165318 30140 leader_election.cc:336] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:47.165681 30140 leader_election.cc:304] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:47.166813  1841 tablet_bootstrap.cc:492] T ff758e6a87fa49b99c35558fafe39f11 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:11:47.167286  1854 raft_consensus.cc:2749] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:47.167726  1841 tablet_bootstrap.cc:492] T ff758e6a87fa49b99c35558fafe39f11 P 6f3eb161e2194f6891f12e2cfcaaf73a: Bootstrap complete.
I20260709 13:11:47.168478  1841 ts_tablet_manager.cc:1403] T ff758e6a87fa49b99c35558fafe39f11 P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent bootstrapping tablet: real 0.306s	user 0.025s	sys 0.011s
I20260709 13:11:47.169564 30068 leader_election.cc:304] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:47.171474  1858 raft_consensus.cc:2804] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:47.171859  1858 raft_consensus.cc:493] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:47.172235  1858 raft_consensus.cc:3060] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:47.176192 29921 catalog_manager.cc:5697] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 10 to 11, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 11 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:47.179348  1858 raft_consensus.cc:515] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:47.181299  1858 leader_election.cc:290] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 13 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:47.182273 30068 leader_election.cc:304] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
W20260709 13:11:47.184600 28889 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 30049)
I20260709 13:11:47.185632 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3f3f9c9793f4390874e250718c41697" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:47.186076 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:47.186638 30101 raft_consensus.cc:2468] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 9.
I20260709 13:11:47.187808  1858 raft_consensus.cc:2804] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:47.187597  1841 raft_consensus.cc:359] T ff758e6a87fa49b99c35558fafe39f11 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:11:47.188215  1858 raft_consensus.cc:493] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:47.188606  1858 raft_consensus.cc:3060] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:47.194742 30143 leader_election.cc:304] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:47.195715  1854 raft_consensus.cc:2804] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:47.196079  1854 raft_consensus.cc:493] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:47.196251 30097 raft_consensus.cc:2468] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 9.
I20260709 13:11:47.196442  1854 raft_consensus.cc:3060] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:47.197983 30143 leader_election.cc:304] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:47.198614 30176 raft_consensus.cc:2468] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 13.
I20260709 13:11:47.199342  1828 raft_consensus.cc:2804] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:47.199744  1828 raft_consensus.cc:493] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:47.200119  1828 raft_consensus.cc:3060] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:47.201262 30143 leader_election.cc:304] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:47.209559  1848 raft_consensus.cc:2804] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:47.210130  1848 raft_consensus.cc:697] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 12 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:47.210973  1848 consensus_queue.cc:237] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:47.201768 30066 leader_election.cc:336] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:47.201133  1755 raft_consensus.cc:493] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
W20260709 13:11:47.215917 30066 leader_election.cc:336] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
W20260709 13:11:47.216485 30066 leader_election.cc:336] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:47.216835 30066 leader_election.cc:304] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:47.217557  1819 raft_consensus.cc:2749] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:47.209034  1854 raft_consensus.cc:515] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:47.220654  1854 leader_election.cc:290] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 12 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:47.221272 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 50796.5us
I20260709 13:11:47.223289 30703 leader_election.cc:304] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:47.208513  1828 raft_consensus.cc:515] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:47.215735  1755 raft_consensus.cc:515] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:47.225905  1845 raft_consensus.cc:2804] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 13:11:47.226274  1845 raft_consensus.cc:493] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:47.226619  1845 raft_consensus.cc:3060] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:47.227180  1755 leader_election.cc:290] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:47.188549  1841 raft_consensus.cc:740] T ff758e6a87fa49b99c35558fafe39f11 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Initialized, Role: LEARNER
W20260709 13:11:47.227550 30066 leader_election.cc:336] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:47.228928  1841 consensus_queue.cc:260] T ff758e6a87fa49b99c35558fafe39f11 P 6f3eb161e2194f6891f12e2cfcaaf73a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: NON_VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: true } }
I20260709 13:11:47.231454  1841 ts_tablet_manager.cc:1434] T ff758e6a87fa49b99c35558fafe39f11 P 6f3eb161e2194f6891f12e2cfcaaf73a: Time spent starting tablet: real 0.063s	user 0.008s	sys 0.000s
I20260709 13:11:47.232404 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d968b6d22e3243bfb840139be8b6dddd" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:47.232909 30735 raft_consensus.cc:3060] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:47.236286 30186 tablet_copy_service.cc:342] P c99569d27a6f4c648eae7119fe3db124: Request end of tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-ff758e6a87fa49b99c35558fafe39f11 received from {username='slave'} at 127.0.0.1:54540
I20260709 13:11:47.236706 30186 tablet_copy_service.cc:434] P c99569d27a6f4c648eae7119fe3db124: ending tablet copy session 6f3eb161e2194f6891f12e2cfcaaf73a-ff758e6a87fa49b99c35558fafe39f11 on tablet ff758e6a87fa49b99c35558fafe39f11 with peer 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:47.239805  1722 raft_consensus.cc:493] T 651beb51dcbf4055b1178a304fe23043 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:47.240298  1722 raft_consensus.cc:515] T 651beb51dcbf4055b1178a304fe23043 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:47.242379  1722 leader_election.cc:290] T 651beb51dcbf4055b1178a304fe23043 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:47.243383 30140 leader_election.cc:336] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:47.240206  1844 raft_consensus.cc:493] T 802499fd316b44c9b21bede0e714fcfb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:47.231158 30068 leader_election.cc:304] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:47.246889  1828 leader_election.cc:290] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:47.246614  1844 raft_consensus.cc:515] T 802499fd316b44c9b21bede0e714fcfb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:47.248684  1844 leader_election.cc:290] T 802499fd316b44c9b21bede0e714fcfb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:47.246325 30068 leader_election.cc:304] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:47.250000  1755 raft_consensus.cc:2804] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:47.250453  1819 raft_consensus.cc:2804] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 13:11:47.250818  1819 raft_consensus.cc:493] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:47.251140  1819 raft_consensus.cc:3060] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:47.252391 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:11:47.252835 30700 leader_election.cc:336] T 651beb51dcbf4055b1178a304fe23043 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:47.252986 30168 raft_consensus.cc:2468] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 8.
I20260709 13:11:47.255053 30702 leader_election.cc:304] T 802499fd316b44c9b21bede0e714fcfb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
W20260709 13:11:47.256839 30140 leader_election.cc:336] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:47.257567  1846 raft_consensus.cc:2804] T 802499fd316b44c9b21bede0e714fcfb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:47.257965  1846 raft_consensus.cc:493] T 802499fd316b44c9b21bede0e714fcfb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:47.258314  1846 raft_consensus.cc:3060] T 802499fd316b44c9b21bede0e714fcfb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:47.261276 30066 leader_election.cc:336] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:47.255002  1755 raft_consensus.cc:697] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 13 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:47.266278 30101 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "407fb380b889498d94c7525edbc34b23" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:47.266853 30101 raft_consensus.cc:3060] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:47.266537  1755 consensus_queue.cc:237] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:47.270280 30700 leader_election.cc:336] T 802499fd316b44c9b21bede0e714fcfb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:47.275170  1567 raft_consensus.cc:493] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:47.275671  1567 raft_consensus.cc:515] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:47.278231 30101 raft_consensus.cc:2468] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 12.
I20260709 13:11:47.278791 30735 raft_consensus.cc:2468] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 13.
I20260709 13:11:47.281149 30703 leader_election.cc:304] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:47.285447 30731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:47.286062 30731 raft_consensus.cc:2468] T 651beb51dcbf4055b1178a304fe23043 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 5.
I20260709 13:11:47.289343 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68c2b86f7fc4ef48b6dc19371d4560b" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:47.289893 30097 raft_consensus.cc:3060] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:47.290134 30143 leader_election.cc:304] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:47.291230  1849 raft_consensus.cc:2804] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:47.296734 30097 raft_consensus.cc:2468] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 7.
I20260709 13:11:47.315961  1567 leader_election.cc:290] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:47.293798  1849 raft_consensus.cc:697] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 12 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:47.302832  1810 raft_consensus.cc:2804] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:47.364180  1845 raft_consensus.cc:515] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:47.361585  1849 consensus_queue.cc:237] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:47.372089  1858 raft_consensus.cc:515] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:47.372956 30066 leader_election.cc:336] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:47.343549  1819 raft_consensus.cc:515] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:47.348192  1844 raft_consensus.cc:493] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
W20260709 13:11:47.407991 30066 leader_election.cc:336] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:47.411339  1858 leader_election.cc:290] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 11 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:11:47.411972 30700 leader_election.cc:336] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:47.400710  1844 raft_consensus.cc:515] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:47.398885  1810 raft_consensus.cc:697] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:47.414100  1845 leader_election.cc:290] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:47.413915  1810 consensus_queue.cc:237] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:47.414487  1844 leader_election.cc:290] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:47.399937  1846 raft_consensus.cc:515] T 802499fd316b44c9b21bede0e714fcfb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:47.420511  1846 leader_election.cc:290] T 802499fd316b44c9b21bede0e714fcfb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:47.422665  1819 leader_election.cc:290] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 12 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:11:47.423790 30700 leader_election.cc:336] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:47.427064 30097 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:47.427651 30097 raft_consensus.cc:2468] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 5.
I20260709 13:11:47.428508 30095 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9cd772608bf64bf9b1c1aec00dc57eee" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:47.428771 30143 leader_election.cc:304] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:47.429045 30095 raft_consensus.cc:3060] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Advancing to term 10
I20260709 13:11:47.430518 30176 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:47.432336 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:47.432973 30096 raft_consensus.cc:2468] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 14.
W20260709 13:11:47.435957 30700 leader_election.cc:336] T 802499fd316b44c9b21bede0e714fcfb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:47.432952  1854 raft_consensus.cc:2804] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:47.438011  1854 raft_consensus.cc:697] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 7 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:47.438825  1854 consensus_queue.cc:237] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:47.440883 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "802499fd316b44c9b21bede0e714fcfb" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:47.441486 30173 raft_consensus.cc:3060] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Advancing to term 9
I20260709 13:11:47.444109 30095 raft_consensus.cc:2468] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 10.
I20260709 13:11:47.447939 30735 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c8539fb97344b07aed5af91eaf0806f" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:47.448064 30168 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56168b79f56f4dee859bee3ef7df4712" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:47.448508 30735 raft_consensus.cc:3060] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:47.448604 30168 raft_consensus.cc:3060] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Advancing to term 12
I20260709 13:11:47.447477 30068 leader_election.cc:304] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:47.454480 30068 leader_election.cc:304] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:47.460847 29923 catalog_manager.cc:5697] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 12 to 13, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 13 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:47.466290 30168 raft_consensus.cc:2468] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 12.
I20260709 13:11:47.466640  1755 raft_consensus.cc:2804] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:47.467147  1755 raft_consensus.cc:697] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 13 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:47.467000 30068 leader_election.cc:304] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:47.476927 30735 raft_consensus.cc:2468] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 11.
I20260709 13:11:47.471251  1755 consensus_queue.cc:237] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:47.480327 30173 raft_consensus.cc:2468] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 9.
I20260709 13:11:47.484880 30702 leader_election.cc:304] T 802499fd316b44c9b21bede0e714fcfb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:47.487325  1844 raft_consensus.cc:2804] T 802499fd316b44c9b21bede0e714fcfb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:47.488323  1844 raft_consensus.cc:697] T 802499fd316b44c9b21bede0e714fcfb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:47.489440  1844 consensus_queue.cc:237] T 802499fd316b44c9b21bede0e714fcfb P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:47.498149  1819 raft_consensus.cc:2749] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:47.471856  1856 raft_consensus.cc:2804] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:47.481072  1859 raft_consensus.cc:493] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:47.523175  1859 raft_consensus.cc:515] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:47.514248  1856 raft_consensus.cc:493] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:47.531102  1856 raft_consensus.cc:3060] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:47.516781 30068 leader_election.cc:304] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
W20260709 13:11:47.577600 30068 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 60891.6us
I20260709 13:11:47.577731  1867 raft_consensus.cc:2804] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 13:11:47.578377  1867 raft_consensus.cc:697] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 12 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:47.579231  1867 consensus_queue.cc:237] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:47.582558 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 62285us
I20260709 13:11:47.588515 29922 catalog_manager.cc:5697] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: term changed from 8 to 9, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68). New cstate: current_term: 9 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:47.595633 30731 raft_consensus.cc:1217] T ff758e6a87fa49b99c35558fafe39f11 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 LEARNER]: Deduplicated request from leader. Original: 7.5->[7.6-7.6]   Dedup: 7.6->[]
I20260709 13:11:47.596619 30728 raft_consensus.cc:1275] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 14 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 14 index: 14. (index mismatch)
I20260709 13:11:47.598639  1856 raft_consensus.cc:515] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:47.601016  1859 leader_election.cc:290] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:47.605420  1745 consensus_queue.cc:1048] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 13:11:47.600692  1856 leader_election.cc:290] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:11:47.601238 30066 leader_election.cc:336] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
W20260709 13:11:47.609310 30066 leader_election.cc:336] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:47.609983  1848 raft_consensus.cc:1064] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124: attempting to promote NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a to VOTER
I20260709 13:11:47.615270 30068 leader_election.cc:304] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:47.617632 30703 leader_election.cc:304] T 651beb51dcbf4055b1178a304fe23043 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:47.631366  1846 raft_consensus.cc:2804] T 651beb51dcbf4055b1178a304fe23043 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 13:11:47.631806  1846 raft_consensus.cc:493] T 651beb51dcbf4055b1178a304fe23043 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:47.632170  1846 raft_consensus.cc:3060] T 651beb51dcbf4055b1178a304fe23043 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Advancing to term 6
I20260709 13:11:47.633543 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719" is_pre_election: true
I20260709 13:11:47.634177 30096 raft_consensus.cc:2468] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 12.
I20260709 13:11:47.635869 30703 leader_election.cc:304] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:47.637066  1872 raft_consensus.cc:2804] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 13:11:47.637437  1872 raft_consensus.cc:493] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 14 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:47.637789  1872 raft_consensus.cc:3060] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 14 FOLLOWER]: Advancing to term 15
I20260709 13:11:47.640746  1846 raft_consensus.cc:515] T 651beb51dcbf4055b1178a304fe23043 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:47.641845 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 50252us
I20260709 13:11:47.642589 30703 leader_election.cc:304] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:47.612443  1848 consensus_queue.cc:237] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 8, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:47.646871  1869 raft_consensus.cc:2804] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 13:11:47.647444  1869 raft_consensus.cc:697] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 11 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:47.648280  1869 consensus_queue.cc:237] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:47.648699 30066 leader_election.cc:336] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:47.651034 30143 leader_election.cc:304] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:47.653365  1800 raft_consensus.cc:2804] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:47.653775  1800 raft_consensus.cc:493] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Starting leader election (detected failure of leader b2cea0098c1040f69755ea4d3dab7fc4)
I20260709 13:11:47.654136  1800 raft_consensus.cc:3060] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:47.663771 30101 raft_consensus.cc:1275] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 13:11:47.669906  1828 consensus_queue.cc:1048] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:47.675946  1871 raft_consensus.cc:2804] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Leader election won for term 10
I20260709 13:11:47.676595 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:47.677356 30728 raft_consensus.cc:2393] T 651beb51dcbf4055b1178a304fe23043 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 5ec73dc157ed476ca903a7d596271719 in current term 6: Already voted for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in this term.
W20260709 13:11:47.679693 30140 consensus_peers.cc:597] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:47.680331 30140 consensus_peers.cc:597] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:47.680758 30140 leader_election.cc:336] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:47.690407 30068 leader_election.cc:304] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:47.692265 30101 raft_consensus.cc:1275] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 13:11:47.694653  1828 consensus_queue.cc:1048] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 13:11:47.703130 29921 catalog_manager.cc:5697] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 11 to 12, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 12 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:47.704360 29921 catalog_manager.cc:5697] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 13 to 14, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 14 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:47.705690 29921 catalog_manager.cc:5697] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 11 to 12, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 12 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:47.693428  1867 raft_consensus.cc:2749] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:47.709121 29921 catalog_manager.cc:5697] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 6 to 7, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 7 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } }
I20260709 13:11:47.699357  1871 raft_consensus.cc:697] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:47.716921  1871 consensus_queue.cc:237] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:47.719875 30168 raft_consensus.cc:1275] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 13 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 13:11:47.720880  1872 raft_consensus.cc:515] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:47.727377  1868 consensus_queue.cc:1048] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
I20260709 13:11:47.727664  1872 leader_election.cc:290] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 15 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:47.727624  1846 leader_election.cc:290] T 651beb51dcbf4055b1178a304fe23043 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:47.739046  1800 raft_consensus.cc:515] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:47.741071 30066 consensus_peers.cc:597] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:47.741053  1800 leader_election.cc:290] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 13 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:47.774576 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 79563.4us
I20260709 13:11:47.774955 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:47.775524 30102 raft_consensus.cc:3060] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:47.789366 30700 leader_election.cc:336] T 651beb51dcbf4055b1178a304fe23043 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
W20260709 13:11:47.790014 30700 leader_election.cc:336] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:47.793192 30102 raft_consensus.cc:2468] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c99569d27a6f4c648eae7119fe3db124 in term 13.
W20260709 13:11:47.813478 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 104944us
I20260709 13:11:47.811667 30143 leader_election.cc:304] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:47.814584  1859 raft_consensus.cc:2804] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 13:11:47.815106  1859 raft_consensus.cc:697] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 13 LEADER]: Becoming Leader. State: Replica: c99569d27a6f4c648eae7119fe3db124, State: Running, Role: LEADER
I20260709 13:11:47.815964  1859 consensus_queue.cc:237] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:47.831590 30096 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:47.833880 30096 raft_consensus.cc:2393] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 6f3eb161e2194f6891f12e2cfcaaf73a in current term 6: Already voted for candidate 5ec73dc157ed476ca903a7d596271719 in this term.
I20260709 13:11:47.851117 30102 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "88d3759f7fe14a4d8e7ba8670ce5cfeb" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "5ec73dc157ed476ca903a7d596271719"
I20260709 13:11:47.851895 30102 raft_consensus.cc:3060] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 14 FOLLOWER]: Advancing to term 15
W20260709 13:11:47.865098 30140 leader_election.cc:336] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
W20260709 13:11:47.866063 30140 consensus_peers.cc:597] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:47.866688 30140 consensus_peers.cc:597] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:47.867244 30066 consensus_peers.cc:597] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:47.867707 30066 consensus_peers.cc:597] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:47.869459 30102 raft_consensus.cc:2468] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 15.
I20260709 13:11:47.886557 30703 leader_election.cc:304] T 651beb51dcbf4055b1178a304fe23043 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:11:47.901857 30140 consensus_peers.cc:597] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:47.902396 30140 consensus_peers.cc:597] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:47.913409 30735 raft_consensus.cc:1275] T 24644eca754d40189c8264977160368a P 6f3eb161e2194f6891f12e2cfcaaf73a [term 14 LEARNER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:11:47.914875 30095 raft_consensus.cc:1275] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:11:47.915550  1848 consensus_queue.cc:1048] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:11:47.923902 30700 consensus_peers.cc:597] T 802499fd316b44c9b21bede0e714fcfb P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:47.927459 30095 raft_consensus.cc:1275] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 14 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 13:11:47.949371  1848 consensus_queue.cc:1048] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:11:47.955838 30066 consensus_peers.cc:597] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:47.956358 30066 consensus_peers.cc:597] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:47.956740 30066 consensus_peers.cc:597] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:47.966647 30703 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:43821, user_credentials={real_user=slave}} blocked reactor thread for 80175.9us
I20260709 13:11:47.967501 30703 leader_election.cc:304] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:47.972556  1884 raft_consensus.cc:2749] T 651beb51dcbf4055b1178a304fe23043 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 13:11:47.972936  1846 raft_consensus.cc:2804] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 15 FOLLOWER]: Leader election won for term 15
I20260709 13:11:48.003899  1846 raft_consensus.cc:697] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 15 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:48.004874  1846 consensus_queue.cc:237] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:48.008965 30101 raft_consensus.cc:1275] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:11:48.029366 30140 consensus_peers.cc:597] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:48.029925 30140 consensus_peers.cc:597] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:47.972764  1722 consensus_queue.cc:1048] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 13:11:48.039634  1848 consensus_queue.cc:1048] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:48.042851 30096 raft_consensus.cc:1275] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 13:11:48.064154 30735 raft_consensus.cc:1275] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 13:11:48.065840  1755 consensus_queue.cc:1048] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 13:11:48.078469  1901 log.cc:927] Time spent T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
W20260709 13:11:48.084167 30700 consensus_peers.cc:597] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:48.066286  1745 consensus_queue.cc:1048] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 13:11:48.087028 29921 catalog_manager.cc:5697] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 12 to 13, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 13 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:48.105679 30700 consensus_peers.cc:597] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:48.114893 29921 catalog_manager.cc:5697] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 10 to 11, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 11 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:48.104925 29923 catalog_manager.cc:5697] T 802499fd316b44c9b21bede0e714fcfb P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: term changed from 8 to 9, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68). New cstate: current_term: 9 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:48.118748 29923 catalog_manager.cc:5697] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: term changed from 9 to 10, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68). New cstate: current_term: 10 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:48.116959 29921 catalog_manager.cc:5697] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 11 to 12, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 12 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } }
I20260709 13:11:48.122195 29923 catalog_manager.cc:5697] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: term changed from 14 to 15, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68). New cstate: current_term: 15 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:11:48.130615 30066 consensus_peers.cc:597] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:48.131109 30066 consensus_peers.cc:597] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:48.135356  1850 raft_consensus.cc:2955] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 14 LEADER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:48.137889 30177 raft_consensus.cc:1275] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 13:11:48.160008  1846 consensus_queue.cc:1048] T 802499fd316b44c9b21bede0e714fcfb P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:11:48.163484 30140 consensus_peers.cc:597] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:48.164026 30140 consensus_peers.cc:597] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:48.168694 30735 raft_consensus.cc:2955] T 24644eca754d40189c8264977160368a P 6f3eb161e2194f6891f12e2cfcaaf73a [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:48.184878 30730 raft_consensus.cc:1275] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 13 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260709 13:11:48.186372 28889 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 30049)
I20260709 13:11:48.195048  1800 raft_consensus.cc:1064] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124: attempting to promote NON_VOTER 6f3eb161e2194f6891f12e2cfcaaf73a to VOTER
W20260709 13:11:48.198513 30700 consensus_peers.cc:597] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:48.206928  1800 consensus_queue.cc:237] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 4, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:48.210002 30700 consensus_peers.cc:597] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:48.216078 30066 consensus_peers.cc:597] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:48.218106  1755 consensus_queue.cc:1048] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 13:11:48.215533 29922 catalog_manager.cc:5697] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: term changed from 12 to 13, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to c99569d27a6f4c648eae7119fe3db124 (127.28.54.67). New cstate: current_term: 13 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } }
W20260709 13:11:48.223053 30140 consensus_peers.cc:597] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:48.223491 30140 consensus_peers.cc:597] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:48.224956 30168 raft_consensus.cc:1275] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 13:11:48.224488 30066 consensus_peers.cc:597] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:48.229811 30066 consensus_peers.cc:597] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:48.235258  1755 consensus_queue.cc:1048] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:48.250623 30098 raft_consensus.cc:1275] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 13:11:48.253731  1873 consensus_queue.cc:1048] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:11:48.258646 30700 consensus_peers.cc:597] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:48.253744 30066 consensus_peers.cc:597] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:48.259737 30066 consensus_peers.cc:597] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:48.260200 30066 consensus_peers.cc:597] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:48.266142 30140 consensus_peers.cc:597] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:48.266839 30140 consensus_peers.cc:597] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:48.278142 30066 consensus_peers.cc:597] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:48.278705 30066 consensus_peers.cc:597] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:48.289645 30140 consensus_peers.cc:597] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:48.297927 30095 raft_consensus.cc:1275] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 13 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 13:11:48.302930  1854 consensus_queue.cc:1048] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 13:11:48.306030 30700 consensus_peers.cc:597] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:48.311471 29922 catalog_manager.cc:5697] T 24644eca754d40189c8264977160368a P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: config changed from index 10 to 11, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New cstate: current_term: 14 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:48.309181 30096 raft_consensus.cc:2955] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 14 FOLLOWER]: Committing config change with OpId 14.11: config changed from index 10 to 11, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
W20260709 13:11:48.338621 30140 consensus_peers.cc:597] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:48.354020 30140 consensus_peers.cc:597] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:48.392199 30730 raft_consensus.cc:1275] T ff758e6a87fa49b99c35558fafe39f11 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 LEARNER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:48.394076 30098 raft_consensus.cc:1275] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 13:11:48.396234  1828 consensus_queue.cc:1048] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 13:11:48.398773  1828 consensus_queue.cc:1048] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 13:11:48.415247 30140 consensus_peers.cc:597] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:48.445885 30700 consensus_peers.cc:597] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:48.460780 30098 raft_consensus.cc:1275] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 15 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 13:11:48.463279  1894 consensus_queue.cc:1048] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:11:48.470825 30700 consensus_peers.cc:597] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:48.490206  1850 raft_consensus.cc:2955] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 7 LEADER]: Committing config change with OpId 7.7: config changed from index 6 to 7, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:48.504076 30730 raft_consensus.cc:2955] T ff758e6a87fa49b99c35558fafe39f11 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:48.513134 30096 raft_consensus.cc:2955] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Committing config change with OpId 7.7: config changed from index 6 to 7, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:48.520891 29923 catalog_manager.cc:5697] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 reported cstate change: config changed from index 6 to 7, 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68) changed from NON_VOTER to VOTER. New cstate: current_term: 7 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:48.539439 30169 consensus_queue.cc:237] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:48.555687 30096 raft_consensus.cc:1275] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:48.557135  1850 consensus_queue.cc:1048] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:48.566018  1854 raft_consensus.cc:2955] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 7 LEADER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
W20260709 13:11:48.574213 30700 consensus_peers.cc:597] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:48.583978 30098 raft_consensus.cc:2955] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:48.595825 30730 raft_consensus.cc:1275] T ff758e6a87fa49b99c35558fafe39f11 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Refusing update from remote peer c99569d27a6f4c648eae7119fe3db124: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 13:11:48.596145 29912 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ff758e6a87fa49b99c35558fafe39f11 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 13:11:48.597201  1850 consensus_queue.cc:1048] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 13:11:48.601158 30728 raft_consensus.cc:2955] T ff758e6a87fa49b99c35558fafe39f11 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Committing config change with OpId 7.8: config changed from index 7 to 8, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
I20260709 13:11:48.635596 29923 catalog_manager.cc:5697] T ff758e6a87fa49b99c35558fafe39f11 P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: config changed from index 7 to 8, VOTER b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) evicted. New cstate: current_term: 7 leader_uuid: "c99569d27a6f4c648eae7119fe3db124" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } } }
W20260709 13:11:48.667972 29910 catalog_manager.cc:4755] TS b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ff758e6a87fa49b99c35558fafe39f11: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
W20260709 13:11:49.186791 28889 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 30049)
I20260709 13:11:49.749320  1919 raft_consensus.cc:493] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:11:49.751818  1919 raft_consensus.cc:515] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:49.753808  1919 leader_election.cc:290] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:49.801373 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:49.802136 30729 raft_consensus.cc:2468] T 651beb51dcbf4055b1178a304fe23043 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 6.
I20260709 13:11:49.820334 30068 leader_election.cc:304] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 
I20260709 13:11:49.823101  1925 raft_consensus.cc:2804] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 13:11:49.823503  1925 raft_consensus.cc:493] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:11:49.823825  1925 raft_consensus.cc:3060] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 6 FOLLOWER]: Advancing to term 7
W20260709 13:11:49.840103 30066 leader_election.cc:336] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:49.866940  1925 raft_consensus.cc:515] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:49.915503  1925 leader_election.cc:290] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 election: Requested vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
W20260709 13:11:49.919992 30702 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:45001, user_credentials={real_user=slave}} blocked reactor thread for 53247.1us
W20260709 13:11:49.925838 29910 catalog_manager.cc:4755] TS b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ff758e6a87fa49b99c35558fafe39f11: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
W20260709 13:11:49.933492 30066 leader_election.cc:336] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:49.945325 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "651beb51dcbf4055b1178a304fe23043" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a"
I20260709 13:11:49.945962 30729 raft_consensus.cc:3060] T 651beb51dcbf4055b1178a304fe23043 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Advancing to term 7
I20260709 13:11:49.952430 30729 raft_consensus.cc:2468] T 651beb51dcbf4055b1178a304fe23043 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5ec73dc157ed476ca903a7d596271719 in term 7.
W20260709 13:11:49.953862 30140 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 84052.3us
I20260709 13:11:49.954806 30068 leader_election.cc:304] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:49.959533  1925 raft_consensus.cc:2804] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 13:11:49.960011  1925 raft_consensus.cc:697] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 7 LEADER]: Becoming Leader. State: Replica: 5ec73dc157ed476ca903a7d596271719, State: Running, Role: LEADER
I20260709 13:11:49.960822  1925 consensus_queue.cc:237] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:49.989622 29923 catalog_manager.cc:5697] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 reported cstate change: term changed from 5 to 7, leader changed from b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65) to 5ec73dc157ed476ca903a7d596271719 (127.28.54.66). New cstate: current_term: 7 leader_uuid: "5ec73dc157ed476ca903a7d596271719" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 13:11:50.158428 30140 consensus_peers.cc:597] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:50.187212 28889 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 30049)
W20260709 13:11:50.344529 30140 consensus_peers.cc:597] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:50.365386 30066 consensus_peers.cc:597] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:50.384522 30124 debug-util.cc:398] Leaking SignalData structure 0x7b08003463e0 after lost signal to thread 28892
W20260709 13:11:50.385565 30124 debug-util.cc:398] Leaking SignalData structure 0x7b08003aa060 after lost signal to thread 29960
W20260709 13:11:50.386814 30124 debug-util.cc:398] Leaking SignalData structure 0x7b080004ca40 after lost signal to thread 30127
W20260709 13:11:50.387846 30124 debug-util.cc:398] Leaking SignalData structure 0x7b08002021e0 after lost signal to thread 30201
W20260709 13:11:50.388934 30124 debug-util.cc:398] Leaking SignalData structure 0x7b080010d1e0 after lost signal to thread 30761
W20260709 13:11:50.389341 30124 debug-util.cc:398] Leaking SignalData structure 0x7b08000a4700 after lost signal to thread 1850
W20260709 13:11:50.415658 30700 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111) [suppressed 400 similar messages]
I20260709 13:11:50.418846 30729 raft_consensus.cc:1275] T 651beb51dcbf4055b1178a304fe23043 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Refusing update from remote peer 5ec73dc157ed476ca903a7d596271719: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 13:11:50.437371  1925 consensus_queue.cc:1048] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260709 13:11:50.480347 30140 consensus_peers.cc:597] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:50.514843 30066 consensus_peers.cc:597] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:50.539827 30066 consensus_peers.cc:597] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:50.602797 30066 consensus_peers.cc:597] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:50.619874 30700 consensus_peers.cc:597] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:50.638638 30066 consensus_peers.cc:597] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:50.640908 30066 consensus_peers.cc:597] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:50.684970 30066 consensus_peers.cc:597] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:50.687783 30140 consensus_peers.cc:597] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:50.699535 30066 consensus_peers.cc:597] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:50.700049 30066 consensus_peers.cc:597] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:50.709517 30066 consensus_peers.cc:597] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:50.710059 30066 consensus_peers.cc:597] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:50.731178 30066 consensus_peers.cc:597] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:50.756664 30140 consensus_peers.cc:597] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:50.778308 30066 consensus_peers.cc:597] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:50.790144 30140 consensus_peers.cc:597] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:50.799124 30066 consensus_peers.cc:597] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:50.802266 30140 consensus_peers.cc:597] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:50.833585 30140 consensus_peers.cc:597] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:50.850872 30700 consensus_peers.cc:597] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:50.852639 30140 consensus_peers.cc:597] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:50.857947 30140 consensus_peers.cc:597] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:50.877149 30140 consensus_peers.cc:597] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:50.899084 30700 consensus_peers.cc:597] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:50.911862 30700 consensus_peers.cc:597] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:50.920429 30066 consensus_peers.cc:597] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:51.036468 29910 catalog_manager.cc:4755] TS b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ff758e6a87fa49b99c35558fafe39f11: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
W20260709 13:11:51.063664 30700 consensus_peers.cc:597] T 802499fd316b44c9b21bede0e714fcfb P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:51.110231 30700 consensus_peers.cc:597] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:51.130820 30140 consensus_peers.cc:597] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:51.155903 30140 consensus_peers.cc:597] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:51.187155 30700 consensus_peers.cc:597] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:51.187702 28889 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 30049)
W20260709 13:11:51.218150 30140 consensus_peers.cc:597] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:51.262223 30700 consensus_peers.cc:597] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:51.266580 30700 consensus_peers.cc:597] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:51.382907 30140 consensus_peers.cc:597] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:51.395612 30140 consensus_peers.cc:597] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:51.489452 30140 consensus_peers.cc:597] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:51.497912 30066 consensus_peers.cc:597] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:51.502058 30066 consensus_peers.cc:597] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:51.566924 30700 consensus_peers.cc:597] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:52.188163 28889 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 30049)
W20260709 13:11:52.752182 30140 consensus_peers.cc:597] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:52.886869 30066 consensus_peers.cc:597] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:52.889817 30140 consensus_peers.cc:597] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:52.928673 30140 consensus_peers.cc:597] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:52.939627 30066 consensus_peers.cc:597] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:52.983232 30066 consensus_peers.cc:597] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:53.003952 30066 consensus_peers.cc:597] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:53.019335 30066 consensus_peers.cc:597] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:53.082053 30140 consensus_peers.cc:597] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:53.160794 30066 consensus_peers.cc:597] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:53.175905 30066 consensus_peers.cc:597] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:53.188642 28889 thread.cc:527] Waited for 7000ms trying to join with diag-logger (tid 30049)
W20260709 13:11:53.203608 30140 consensus_peers.cc:597] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:53.213018 30066 consensus_peers.cc:597] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:53.223429 30066 consensus_peers.cc:597] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:53.249902 29910 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.28.54.65:34451, user_credentials={real_user=slave}} blocked reactor thread for 96092.4us
W20260709 13:11:53.252678 29910 catalog_manager.cc:4755] TS b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ff758e6a87fa49b99c35558fafe39f11: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
W20260709 13:11:53.306506 30066 consensus_peers.cc:597] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:53.315858 30700 consensus_peers.cc:597] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:53.335080 30140 consensus_peers.cc:597] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:53.359705 30700 consensus_peers.cc:597] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:53.364425 30140 consensus_peers.cc:597] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:53.366168 30066 consensus_peers.cc:597] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:53.373034 30066 consensus_peers.cc:597] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:53.396647 30140 consensus_peers.cc:597] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:53.425101 30700 consensus_peers.cc:597] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:53.429306 30066 consensus_peers.cc:597] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:53.482108 30140 consensus_peers.cc:597] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:53.489512 30066 consensus_peers.cc:597] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:53.518543 30140 consensus_peers.cc:597] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:53.532936 30700 consensus_peers.cc:597] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:53.539211 30066 consensus_peers.cc:597] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:53.553611 30140 consensus_peers.cc:597] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:53.559073 30700 consensus_peers.cc:597] T 802499fd316b44c9b21bede0e714fcfb P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:53.561367 30700 consensus_peers.cc:597] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:53.562161 30140 consensus_peers.cc:597] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:53.647917 30140 consensus_peers.cc:597] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:53.653934 30140 consensus_peers.cc:597] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:11:53.677660 28889 tablet_server.cc:196] TabletServer@127.28.54.65:0 shutdown complete.
W20260709 13:11:53.699900 30140 consensus_peers.cc:597] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:53.775225 30700 consensus_peers.cc:597] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:53.785259 30066 consensus_peers.cc:597] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:53.827150 30700 consensus_peers.cc:597] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:53.855186 30140 consensus_peers.cc:597] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:53.899145 30140 consensus_peers.cc:597] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:53.976475 28889 tablet_server.cc:179] TabletServer@127.28.54.66:0 shutting down...
W20260709 13:11:53.990020 30700 consensus_peers.cc:597] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:11:54.017437 30700 consensus_peers.cc:597] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:54.038636 30143 consensus_peers.cc:597] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:54.039745 30703 consensus_peers.cc:597] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:54.045706 30143 consensus_peers.cc:597] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:54.046312 30703 consensus_peers.cc:597] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:54.082130 30143 consensus_peers.cc:597] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:54.084045 30703 consensus_peers.cc:597] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:54.102139 30703 consensus_peers.cc:597] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:54.216950 30143 consensus_peers.cc:597] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:54.313155 30703 consensus_peers.cc:597] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:54.314123 30703 consensus_peers.cc:597] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:54.315390 30143 consensus_peers.cc:597] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:54.332528 30703 consensus_peers.cc:597] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:54.335114 30143 consensus_peers.cc:597] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:54.336252 30143 consensus_peers.cc:597] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:54.368016 30143 consensus_peers.cc:597] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:54.368896 30703 consensus_peers.cc:597] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:54.369771 30703 consensus_peers.cc:597] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:54.373937 30703 consensus_peers.cc:597] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:54.375470 30143 consensus_peers.cc:597] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:54.376771 30703 consensus_peers.cc:597] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:54.406184 30143 consensus_peers.cc:597] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:54.413017 30703 consensus_peers.cc:597] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:54.428386 30143 consensus_peers.cc:597] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:54.463189 28889 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:54.465955 28889 tablet_replica.cc:333] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:11:54.468104 28889 raft_consensus.cc:2243] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 8 LEADER]: Raft consensus shutting down.
W20260709 13:11:54.469786 30703 consensus_peers.cc:597] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:54.471302 28889 raft_consensus.cc:2272] T f71bd695ecc748db8c77f136fb53616b P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.481602 28889 tablet_replica.cc:333] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:11:54.485952 28889 raft_consensus.cc:2243] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:54.486826 28889 raft_consensus.cc:2272] T 30a540a1b03746b785f2fc4692e05833 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:54.495379 30066 consensus_peers.cc:597] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:54.504458 28889 tablet_replica.cc:333] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:11:54.505831 28889 raft_consensus.cc:2243] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Raft consensus shutting down.
W20260709 13:11:54.506610 30703 consensus_peers.cc:597] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:54.506974 28889 raft_consensus.cc:2272] T 0be979412dd54241bd212ddbb7611046 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.511628 28889 tablet_replica.cc:333] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:11:54.512598 28889 raft_consensus.cc:2243] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 9 LEADER]: Raft consensus shutting down.
W20260709 13:11:54.512693 30143 consensus_peers.cc:597] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:54.522269 28889 raft_consensus.cc:2272] T f7c9e9bbe0c44a8d803c3d45799906f2 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.526919 28889 tablet_replica.cc:333] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:11:54.527949 28889 raft_consensus.cc:2243] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:54.528960 28889 raft_consensus.cc:2272] T f68c2b86f7fc4ef48b6dc19371d4560b P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.536336 28889 tablet_replica.cc:333] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:11:54.537374 28889 raft_consensus.cc:2243] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:11:54.539352 28889 raft_consensus.cc:2272] T 5c8539fb97344b07aed5af91eaf0806f P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.552570 28889 tablet_replica.cc:333] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:11:54.553508 28889 raft_consensus.cc:2243] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:11:54.556524 28889 raft_consensus.cc:2272] T f5c869d5410b4a83adc1ca35397defb6 P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.560257 28889 tablet_replica.cc:333] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:11:54.561232 28889 raft_consensus.cc:2243] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:54.574440 28889 raft_consensus.cc:2272] T 407fb380b889498d94c7525edbc34b23 P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.577458 28889 tablet_replica.cc:333] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:11:54.589660 28889 raft_consensus.cc:2243] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:11:54.595032 28889 raft_consensus.cc:2272] T 56168b79f56f4dee859bee3ef7df4712 P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.597908 28889 tablet_replica.cc:333] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:11:54.598868 28889 raft_consensus.cc:2243] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:54.630276 28889 raft_consensus.cc:2272] T d3f3f9c9793f4390874e250718c41697 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.639460 28889 tablet_replica.cc:333] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:11:54.644457 28889 raft_consensus.cc:2243] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:11:54.645923 28889 raft_consensus.cc:2272] T 5a14bd61c7a94d1ca54063afae0c68e8 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.648674 28889 tablet_replica.cc:333] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:11:54.659590 28889 raft_consensus.cc:2243] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:11:54.666229 28889 raft_consensus.cc:2272] T 57ce415a86d343cb8bdff28acc41c6a6 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.669183 28889 tablet_replica.cc:333] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:11:54.670712 28889 raft_consensus.cc:2243] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:11:54.679629 28889 raft_consensus.cc:2272] T 0a722bee3f14472ebed5b798e61c64b3 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.687685 28889 tablet_replica.cc:333] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:11:54.689903 28889 raft_consensus.cc:2243] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:11:54.692268 28889 raft_consensus.cc:2272] T d968b6d22e3243bfb840139be8b6dddd P 5ec73dc157ed476ca903a7d596271719 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.707343 28889 tablet_replica.cc:333] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:11:54.714483 28889 raft_consensus.cc:2243] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:54.715447 28889 raft_consensus.cc:2272] T 8a3e809a994e4cbf98d7ea56807b8dad P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.718312 28889 tablet_replica.cc:333] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:11:54.722930 28889 raft_consensus.cc:2243] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:11:54.724041 28889 raft_consensus.cc:2272] T ea42d6bd0dbb4438a96c31b335069e3c P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.737062 28889 tablet_replica.cc:333] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:11:54.742568 28889 raft_consensus.cc:2243] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:54.752243 28889 raft_consensus.cc:2272] T 24644eca754d40189c8264977160368a P 5ec73dc157ed476ca903a7d596271719 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.755791 28889 tablet_replica.cc:333] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:11:54.771989 28889 raft_consensus.cc:2243] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:54.772692 28889 raft_consensus.cc:2272] T b52e70a06b534fbf90cbcb6a010e9d43 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.782130 28889 tablet_replica.cc:333] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:11:54.789004 28889 raft_consensus.cc:2243] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:54.793797 28889 raft_consensus.cc:2272] T 777fb4e4b87a4d549e79b74a36a2ac08 P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.802562 28889 tablet_replica.cc:333] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:11:54.809909 28889 raft_consensus.cc:2243] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:11:54.810993 28889 raft_consensus.cc:2272] T de39104c229542e3a29860956492edea P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.822052 28889 tablet_replica.cc:333] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:11:54.831331 28889 raft_consensus.cc:2243] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:54.832115 28889 raft_consensus.cc:2272] T 9cd772608bf64bf9b1c1aec00dc57eee P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.834942 28889 tablet_replica.cc:333] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:11:54.835716 28889 raft_consensus.cc:2243] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:54.850752 28889 raft_consensus.cc:2272] T 8495d060d6b042a3b7bd9dba1055dbbf P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.853559 28889 tablet_replica.cc:333] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:11:54.854331 28889 raft_consensus.cc:2243] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:54.867704 28889 raft_consensus.cc:2272] T b66f98d7fcfe4102a01ace9ed64355ed P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.871923 28889 tablet_replica.cc:333] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:11:54.877408 28889 raft_consensus.cc:2243] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:11:54.922530 28889 raft_consensus.cc:2272] T fe9a5ae7a3c04826a4bdde9445be46bb P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.929355 28889 tablet_replica.cc:333] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:11:54.932901  1958 raft_consensus.cc:493] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:54.942569 28889 raft_consensus.cc:2243] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:54.942464  1958 raft_consensus.cc:515] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:54.945052  1958 leader_election.cc:290] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:54.947228 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:54.948845 28889 raft_consensus.cc:2272] T c6d87bb3ff11400cbdaf30e614c4b3da P 5ec73dc157ed476ca903a7d596271719 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.950079 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1cd924402bd0402aa7ad47fac1308ac9" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
I20260709 13:11:54.952167 28889 tablet_replica.cc:333] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:11:54.952972 28889 raft_consensus.cc:2243] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:11:54.954707 30068 leader_election.cc:304] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:54.960322  1958 raft_consensus.cc:2749] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:54.958793 28889 raft_consensus.cc:2272] T 143490b42f5d4687a680435e8cd86d1f P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.975472 28889 tablet_replica.cc:333] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:11:54.979472 28889 raft_consensus.cc:2243] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:11:54.980808 28889 raft_consensus.cc:2272] T 98e11967c3504e11865ed831f2584aea P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:54.989068 28889 tablet_replica.cc:333] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:11:54.989923 28889 raft_consensus.cc:2243] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:55.001552 28889 raft_consensus.cc:2272] T 2964592ff08b4434889d830c05501d8e P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.009266 28889 tablet_replica.cc:333] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:11:55.012712  1958 raft_consensus.cc:493] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 6f3eb161e2194f6891f12e2cfcaaf73a)
I20260709 13:11:55.013484  1958 raft_consensus.cc:515] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:55.015525  1958 leader_election.cc:290] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:55.020857 30728 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "48d3196b43924d35bf72234ad500783e" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
W20260709 13:11:55.024328 30066 leader_election.cc:336] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:55.024763 30066 leader_election.cc:304] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: 6f3eb161e2194f6891f12e2cfcaaf73a, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:55.025907  1958 raft_consensus.cc:2749] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 13:11:55.027351 28889 raft_consensus.cc:2243] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:55.030216 28889 raft_consensus.cc:2272] T b38ec265ce704d799b58d99914a46422 P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.033586 28889 tablet_replica.cc:333] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:11:55.038954 28889 raft_consensus.cc:2243] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:55.039680 28889 raft_consensus.cc:2272] T 48d3196b43924d35bf72234ad500783e P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.042804 28889 tablet_replica.cc:333] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:11:55.044698 28889 raft_consensus.cc:2243] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:11:55.047068 28889 raft_consensus.cc:2272] T c41a6d79ca9c459eb4b0b41302fb76a9 P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.047941  1958 raft_consensus.cc:493] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:55.048543  1958 raft_consensus.cc:515] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:55.050688  1958 leader_election.cc:290] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:55.054117 30173 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63253e2671134725b8fe85f63070e4c8" candidate_uuid: "5ec73dc157ed476ca903a7d596271719" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
W20260709 13:11:55.066414 30066 leader_election.cc:336] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:55.066908 30066 leader_election.cc:304] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5ec73dc157ed476ca903a7d596271719; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:55.069854  1962 raft_consensus.cc:2749] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:55.063726 28889 tablet_replica.cc:333] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:11:55.074916 28889 raft_consensus.cc:2243] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:55.075949 28889 raft_consensus.cc:2272] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 5ec73dc157ed476ca903a7d596271719 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.079041 28889 tablet_replica.cc:333] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:11:55.079799 28889 raft_consensus.cc:2243] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:55.081211 28889 raft_consensus.cc:2272] T 978900c67750481aba3e58987ac43180 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.089375 28889 tablet_replica.cc:333] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:11:55.090270 28889 raft_consensus.cc:2243] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:55.092831 28889 raft_consensus.cc:2272] T 18a72905c2e24e33af2e64672417cfcf P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.104979 28889 tablet_replica.cc:333] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:11:55.105796 28889 raft_consensus.cc:2243] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Raft consensus shutting down.
W20260709 13:11:55.106462  1958 raft_consensus.cc:670] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719: failed to trigger leader election: Illegal state: RaftConsensus is not running: State = Stopping
I20260709 13:11:55.107698 28889 raft_consensus.cc:2272] T 1136db29fbad4093bcad74bb6274f752 P 5ec73dc157ed476ca903a7d596271719 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.114810 28889 tablet_replica.cc:333] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:11:55.115620 28889 raft_consensus.cc:2243] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:55.117269 28889 raft_consensus.cc:2272] T ff758e6a87fa49b99c35558fafe39f11 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.139966 28889 tablet_replica.cc:333] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:11:55.140808 28889 raft_consensus.cc:2243] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:55.141673 28889 raft_consensus.cc:2272] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.144730 28889 tablet_replica.cc:333] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:11:55.145445 28889 raft_consensus.cc:2243] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:55.146116 28889 raft_consensus.cc:2272] T c56071aeace442bebfbcd88e12fe4376 P 5ec73dc157ed476ca903a7d596271719 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.160786 28889 tablet_replica.cc:333] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:11:55.163535 28889 raft_consensus.cc:2243] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:11:55.165624 28889 raft_consensus.cc:2272] T f8fcd3026125450694af59415c94e029 P 5ec73dc157ed476ca903a7d596271719 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.178714 28889 tablet_replica.cc:333] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:11:55.179590 28889 raft_consensus.cc:2243] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:11:55.180877 28889 raft_consensus.cc:2272] T b58427f5fe51486b983433e11caa8a3f P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.218616 28889 tablet_replica.cc:333] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:11:55.219914 28889 raft_consensus.cc:2243] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:11:55.222646 28889 raft_consensus.cc:2272] T e218d3c3e368401a8eff81a5699074b8 P 5ec73dc157ed476ca903a7d596271719 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.231839 28889 tablet_replica.cc:333] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:11:55.232553 28889 raft_consensus.cc:2243] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:55.233397 28889 raft_consensus.cc:2272] T 3068102662114944a63195a8d764e93d P 5ec73dc157ed476ca903a7d596271719 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.237062 28889 tablet_replica.cc:333] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:11:55.237807 28889 raft_consensus.cc:2243] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:11:55.238845 28889 raft_consensus.cc:2272] T 38e941311158407e8c0e2f4ca4b31d32 P 5ec73dc157ed476ca903a7d596271719 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.241701 28889 tablet_replica.cc:333] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:11:55.242480 28889 raft_consensus.cc:2243] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:55.243330 28889 raft_consensus.cc:2272] T 63253e2671134725b8fe85f63070e4c8 P 5ec73dc157ed476ca903a7d596271719 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.253306 28889 tablet_replica.cc:333] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:11:55.253989 28889 raft_consensus.cc:2243] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:11:55.255846 28889 raft_consensus.cc:2272] T 651beb51dcbf4055b1178a304fe23043 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:55.258873 28889 tablet_replica.cc:333] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719: stopping tablet replica
I20260709 13:11:55.259538 28889 raft_consensus.cc:2243] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:55.260145 28889 raft_consensus.cc:2272] T 1cd924402bd0402aa7ad47fac1308ac9 P 5ec73dc157ed476ca903a7d596271719 [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:55.286943 30140 consensus_peers.cc:597] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:55.289207 30140 consensus_peers.cc:597] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:55.436534 30703 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 497 similar messages]
W20260709 13:11:55.460916 30140 consensus_peers.cc:597] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:11:55.659209  1963 raft_consensus.cc:493] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:55.659747  1963 raft_consensus.cc:515] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:55.661902  1963 leader_election.cc:290] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:55.680024 30700 leader_election.cc:336] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
W20260709 13:11:55.715610 30703 leader_election.cc:336] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111)
I20260709 13:11:55.716058 30703 leader_election.cc:304] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:55.717191  1970 raft_consensus.cc:2749] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:11:55.719322 30140 consensus_peers.cc:597] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:55.719877 30140 consensus_peers.cc:597] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:55.725656  1966 raft_consensus.cc:493] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:55.726207  1966 raft_consensus.cc:515] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:55.728165  1966 leader_election.cc:290] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:55.735167 30143 leader_election.cc:336] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111)
W20260709 13:11:55.750293 30140 consensus_peers.cc:597] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:55.750814 30140 leader_election.cc:336] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:55.751196 30140 leader_election.cc:304] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:55.751881  1966 raft_consensus.cc:2749] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:11:55.810729 30140 consensus_peers.cc:597] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:11:55.811978  1966 raft_consensus.cc:493] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:55.812516  1966 raft_consensus.cc:515] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:55.815263  1966 leader_election.cc:290] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:55.820883  1966 raft_consensus.cc:493] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:55.821381  1966 raft_consensus.cc:515] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:55.822237  1968 raft_consensus.cc:493] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:55.822710  1968 raft_consensus.cc:515] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:55.823700  1966 leader_election.cc:290] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:55.824546  1968 leader_election.cc:290] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:55.825062 30140 leader_election.cc:336] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:55.825457 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
W20260709 13:11:55.826313 30143 leader_election.cc:336] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111)
I20260709 13:11:55.826719 30143 leader_election.cc:304] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:55.828470  1968 raft_consensus.cc:2749] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:11:55.834894 30140 leader_election.cc:336] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
W20260709 13:11:55.838454 30143 leader_election.cc:336] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111)
I20260709 13:11:55.838873 30143 leader_election.cc:304] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:55.841982  1968 raft_consensus.cc:2749] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:11:55.842813 30143 leader_election.cc:336] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111)
I20260709 13:11:55.843206 30143 leader_election.cc:304] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:55.844094  1968 raft_consensus.cc:2749] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:55.850898  1970 raft_consensus.cc:493] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:55.851472  1970 raft_consensus.cc:515] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:55.855013  1964 raft_consensus.cc:493] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:55.855530  1964 raft_consensus.cc:515] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:55.857488  1964 leader_election.cc:290] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:55.853514  1970 leader_election.cc:290] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:55.863549 30703 leader_election.cc:336] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111)
W20260709 13:11:55.870398 30703 leader_election.cc:336] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111)
W20260709 13:11:55.873445 30700 leader_election.cc:336] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:55.879779 30700 leader_election.cc:304] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:55.880638  1970 raft_consensus.cc:2749] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:11:55.882879 30700 leader_election.cc:336] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:55.883337 30700 leader_election.cc:304] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:55.884056  1970 raft_consensus.cc:2749] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:11:55.888331 30700 consensus_peers.cc:597] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:55.897737 30700 consensus_peers.cc:597] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:55.903730 30140 consensus_peers.cc:597] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:11:55.915351  1970 raft_consensus.cc:493] T f71bd695ecc748db8c77f136fb53616b P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:55.915951  1970 raft_consensus.cc:515] T f71bd695ecc748db8c77f136fb53616b P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:55.920261 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:55.920862 30169 raft_consensus.cc:2468] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 8.
I20260709 13:11:55.921991 30702 leader_election.cc:304] T f71bd695ecc748db8c77f136fb53616b P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:55.922811  1964 raft_consensus.cc:2804] T f71bd695ecc748db8c77f136fb53616b P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 13:11:55.923260  1964 raft_consensus.cc:493] T f71bd695ecc748db8c77f136fb53616b P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:55.923663  1964 raft_consensus.cc:3060] T f71bd695ecc748db8c77f136fb53616b P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:55.928431 30703 leader_election.cc:336] T f71bd695ecc748db8c77f136fb53616b P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111)
I20260709 13:11:55.922868  1970 leader_election.cc:290] T f71bd695ecc748db8c77f136fb53616b P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:55.936695  1964 raft_consensus.cc:515] T f71bd695ecc748db8c77f136fb53616b P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting leader election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:55.943374  1964 leader_election.cc:290] T f71bd695ecc748db8c77f136fb53616b P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:55.944226 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f71bd695ecc748db8c77f136fb53616b" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:55.944784 30169 raft_consensus.cc:3060] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Advancing to term 9
W20260709 13:11:55.946746 30703 leader_election.cc:336] T f71bd695ecc748db8c77f136fb53616b P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111)
W20260709 13:11:55.950958 30140 consensus_peers.cc:597] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:55.953197  1964 raft_consensus.cc:493] T 143490b42f5d4687a680435e8cd86d1f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:55.953457 30169 raft_consensus.cc:2468] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 9.
I20260709 13:11:55.953729  1964 raft_consensus.cc:515] T 143490b42f5d4687a680435e8cd86d1f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:55.954864 30702 leader_election.cc:304] T f71bd695ecc748db8c77f136fb53616b P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:55.955829  1970 raft_consensus.cc:2804] T f71bd695ecc748db8c77f136fb53616b P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader election won for term 9
I20260709 13:11:55.956313  1970 raft_consensus.cc:697] T f71bd695ecc748db8c77f136fb53616b P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:55.956502  1964 leader_election.cc:290] T 143490b42f5d4687a680435e8cd86d1f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:55.959656 30703 leader_election.cc:336] T 143490b42f5d4687a680435e8cd86d1f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111)
I20260709 13:11:55.957247  1970 consensus_queue.cc:237] T f71bd695ecc748db8c77f136fb53616b P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:55.965579 30700 leader_election.cc:336] T 143490b42f5d4687a680435e8cd86d1f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:55.966044 30700 leader_election.cc:304] T 143490b42f5d4687a680435e8cd86d1f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:55.966701  1963 raft_consensus.cc:2749] T 143490b42f5d4687a680435e8cd86d1f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:55.994553  1970 raft_consensus.cc:493] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:55.993714 29923 catalog_manager.cc:5697] T f71bd695ecc748db8c77f136fb53616b P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: term changed from 8 to 9, leader changed from 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) to 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68). New cstate: current_term: 9 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:55.999354  1970 raft_consensus.cc:515] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:56.001513  1970 leader_election.cc:290] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:56.008762 30703 leader_election.cc:336] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111)
W20260709 13:11:56.009553 30700 leader_election.cc:336] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:56.009964 30700 leader_election.cc:304] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:11:56.010756 30700 consensus_peers.cc:597] T 802499fd316b44c9b21bede0e714fcfb P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:56.011505  1964 raft_consensus.cc:2749] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 13:11:56.016006 30700 consensus_peers.cc:597] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:56.049190 30140 consensus_peers.cc:597] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:56.066541  1968 raft_consensus.cc:493] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:56.067032  1968 raft_consensus.cc:515] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:56.068969  1968 leader_election.cc:290] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:56.074200 30140 leader_election.cc:336] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
W20260709 13:11:56.088465 30143 leader_election.cc:336] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111)
I20260709 13:11:56.089462 30143 leader_election.cc:304] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:56.090230  1968 raft_consensus.cc:2749] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 13:11:56.110158  1968 raft_consensus.cc:493] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:56.110662  1968 raft_consensus.cc:515] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:56.112679  1968 leader_election.cc:290] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:56.119453 30143 leader_election.cc:336] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111)
I20260709 13:11:56.122813  1968 raft_consensus.cc:493] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
W20260709 13:11:56.123445 30140 leader_election.cc:336] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:56.123379  1968 raft_consensus.cc:515] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:56.123955 30140 leader_election.cc:304] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:56.126684  1969 raft_consensus.cc:2749] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:56.125581  1968 leader_election.cc:290] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:56.129060 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
W20260709 13:11:56.136387 30143 leader_election.cc:336] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111)
I20260709 13:11:56.136830 30143 leader_election.cc:304] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:56.138775  1968 raft_consensus.cc:2749] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 13:11:56.141860 30140 consensus_peers.cc:597] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:56.173266 30700 consensus_peers.cc:597] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:56.204993 30140 consensus_peers.cc:597] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:56.205895  1970 raft_consensus.cc:493] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:56.206413  1970 raft_consensus.cc:515] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:56.208433  1970 leader_election.cc:290] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:56.205500  1963 raft_consensus.cc:493] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:56.210563  1963 raft_consensus.cc:515] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:56.212545  1963 leader_election.cc:290] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:56.214967 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:56.215512 30169 raft_consensus.cc:2468] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 12.
I20260709 13:11:56.218304 30702 leader_election.cc:304] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:56.219293  1964 raft_consensus.cc:2804] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 13:11:56.219642  1964 raft_consensus.cc:493] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:56.219991  1964 raft_consensus.cc:3060] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Advancing to term 13
W20260709 13:11:56.222031 30143 consensus_peers.cc:597] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:56.226297 30700 leader_election.cc:336] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
W20260709 13:11:56.228237 30703 leader_election.cc:336] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111)
W20260709 13:11:56.228972 30703 leader_election.cc:336] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111)
I20260709 13:11:56.229415 30703 leader_election.cc:304] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:56.231554  1963 raft_consensus.cc:2749] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:56.237277  1970 raft_consensus.cc:493] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:56.237893  1970 raft_consensus.cc:515] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:56.243773 30700 consensus_peers.cc:597] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:56.246632 30700 leader_election.cc:336] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:56.258311  1970 leader_election.cc:290] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:56.234728  1964 raft_consensus.cc:515] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:56.267124 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe9a5ae7a3c04826a4bdde9445be46bb" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:56.267699 30172 raft_consensus.cc:3060] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Advancing to term 13
I20260709 13:11:56.268028  1964 leader_election.cc:290] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 13 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:56.274538 30172 raft_consensus.cc:2468] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 13.
I20260709 13:11:56.278527 30702 leader_election.cc:304] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:56.283458  1979 raft_consensus.cc:2804] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 13 FOLLOWER]: Leader election won for term 13
W20260709 13:11:56.284921 30703 leader_election.cc:336] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111)
I20260709 13:11:56.285527 30703 leader_election.cc:304] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:11:56.286453 30703 leader_election.cc:336] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111)
I20260709 13:11:56.286924  1964 raft_consensus.cc:2749] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 13:11:56.284075  1979 raft_consensus.cc:697] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 13 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:56.291093  1979 consensus_queue.cc:237] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:56.302597 30143 consensus_peers.cc:597] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:56.308492 30140 consensus_peers.cc:597] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:56.315609 30140 consensus_peers.cc:597] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:56.316066 30140 consensus_peers.cc:597] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 13:11:56.320752 29923 catalog_manager.cc:5697] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: term changed from 12 to 13, leader changed from 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) to 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68). New cstate: current_term: 13 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 13:11:56.378796 30700 consensus_peers.cc:597] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:56.385887 30140 consensus_peers.cc:597] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:56.417950 30143 consensus_peers.cc:597] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:56.442559  1964 raft_consensus.cc:493] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:56.443130  1964 raft_consensus.cc:515] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:56.445153  1964 leader_election.cc:290] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:56.446770 30700 consensus_peers.cc:597] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:56.451400 30700 leader_election.cc:336] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
W20260709 13:11:56.453301 30703 leader_election.cc:336] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111)
I20260709 13:11:56.453692 30703 leader_election.cc:304] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:11:56.455900 30700 consensus_peers.cc:597] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:11:56.460171  1979 raft_consensus.cc:2749] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:11:56.463550 30703 consensus_peers.cc:597] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:56.465425  1966 raft_consensus.cc:493] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:56.470348  1966 raft_consensus.cc:515] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:56.473337  1966 leader_election.cc:290] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68:46469)
I20260709 13:11:56.473491 30729 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "c99569d27a6f4c648eae7119fe3db124" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" is_pre_election: true
W20260709 13:11:56.477471 30143 leader_election.cc:336] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111)
I20260709 13:11:56.477893 30143 leader_election.cc:304] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, 6f3eb161e2194f6891f12e2cfcaaf73a
I20260709 13:11:56.478902  1966 raft_consensus.cc:2749] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 13:11:56.486092 30700 consensus_peers.cc:597] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 13:11:56.489286 30703 consensus_peers.cc:597] T f71bd695ecc748db8c77f136fb53616b P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:56.492434 30703 consensus_peers.cc:597] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:56.507159  1969 raft_consensus.cc:493] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
W20260709 13:11:56.507819 30703 consensus_peers.cc:597] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:56.507694  1969 raft_consensus.cc:515] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:56.515487 30140 leader_election.cc:336] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:56.509747  1969 leader_election.cc:290] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:56.519553 30143 leader_election.cc:336] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111)
I20260709 13:11:56.519980 30143 leader_election.cc:304] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:56.521003  1969 raft_consensus.cc:2749] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:11:56.568615 30703 consensus_peers.cc:597] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:56.577579  1969 raft_consensus.cc:493] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:56.578166  1969 raft_consensus.cc:515] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
I20260709 13:11:56.580190  1969 leader_election.cc:290] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
I20260709 13:11:56.581475 30172 raft_consensus.cc:1275] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 13:11:56.582919  1979 consensus_queue.cc:1048] T f71bd695ecc748db8c77f136fb53616b P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 13:11:56.589037 30140 leader_election.cc:336] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
W20260709 13:11:56.589782 30143 leader_election.cc:336] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111)
I20260709 13:11:56.590173 30143 leader_election.cc:304] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:56.591187  1969 raft_consensus.cc:2749] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:11:56.606550 30198 debug-util.cc:398] Leaking SignalData structure 0x7b08001c51c0 after lost signal to thread 28892
W20260709 13:11:56.607646 30198 debug-util.cc:398] Leaking SignalData structure 0x7b0800325740 after lost signal to thread 29960
W20260709 13:11:56.608916 30198 debug-util.cc:398] Leaking SignalData structure 0x7b080004b540 after lost signal to thread 30201
W20260709 13:11:56.610033 30198 debug-util.cc:398] Leaking SignalData structure 0x7b0800329ec0 after lost signal to thread 30761
I20260709 13:11:56.612308  1969 raft_consensus.cc:493] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:56.612857  1969 raft_consensus.cc:515] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } }
W20260709 13:11:56.614506 30703 consensus_peers.cc:597] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:56.614914  1969 leader_election.cc:290] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:56.623211 30143 leader_election.cc:336] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111)
W20260709 13:11:56.623910 30140 leader_election.cc:336] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:56.624322 30140 leader_election.cc:304] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:56.624984  1966 raft_consensus.cc:2749] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:11:56.636408 30703 consensus_peers.cc:597] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:56.639015  1964 raft_consensus.cc:493] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:56.639577  1964 raft_consensus.cc:515] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:56.640326 30143 consensus_peers.cc:597] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:56.641611  1964 leader_election.cc:290] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:56.643082 30172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124" is_pre_election: true
I20260709 13:11:56.643653 30172 raft_consensus.cc:2468] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 10.
I20260709 13:11:56.645100 30702 leader_election.cc:304] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 
I20260709 13:11:56.646181  1963 raft_consensus.cc:2804] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 13:11:56.646535  1963 raft_consensus.cc:493] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Starting leader election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:56.646893  1963 raft_consensus.cc:3060] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Advancing to term 11
W20260709 13:11:56.654830 30703 leader_election.cc:336] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111)
I20260709 13:11:56.655311  1963 raft_consensus.cc:515] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:56.665601 30703 leader_election.cc:336] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111)
I20260709 13:11:56.667626 30169 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38e941311158407e8c0e2f4ca4b31d32" candidate_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "c99569d27a6f4c648eae7119fe3db124"
I20260709 13:11:56.668428 30169 raft_consensus.cc:3060] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Advancing to term 11
I20260709 13:11:56.668500  1963 leader_election.cc:290] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 11 election: Requested vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:11:56.667593 30140 consensus_peers.cc:597] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:11:56.675830 30169 raft_consensus.cc:2468] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3eb161e2194f6891f12e2cfcaaf73a in term 11.
I20260709 13:11:56.679605 30702 leader_election.cc:304] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a, c99569d27a6f4c648eae7119fe3db124; no voters: 5ec73dc157ed476ca903a7d596271719
I20260709 13:11:56.681185  1970 raft_consensus.cc:2804] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Leader election won for term 11
W20260709 13:11:56.682777 30703 consensus_peers.cc:597] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:56.691689  1970 raft_consensus.cc:697] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 LEADER]: Becoming Leader. State: Replica: 6f3eb161e2194f6891f12e2cfcaaf73a, State: Running, Role: LEADER
I20260709 13:11:56.692670  1970 consensus_queue.cc:237] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:56.699184 30703 consensus_peers.cc:597] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:56.712648 30703 consensus_peers.cc:597] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:56.715513 30703 consensus_peers.cc:597] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:56.716374 30143 consensus_peers.cc:597] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:56.728307 29921 catalog_manager.cc:5697] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a reported cstate change: term changed from 10 to 11, leader changed from 5ec73dc157ed476ca903a7d596271719 (127.28.54.66) to 6f3eb161e2194f6891f12e2cfcaaf73a (127.28.54.68). New cstate: current_term: 11 leader_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 13:11:56.734174  1963 raft_consensus.cc:493] T 651beb51dcbf4055b1178a304fe23043 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:56.734717  1963 raft_consensus.cc:515] T 651beb51dcbf4055b1178a304fe23043 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:56.736636  1963 leader_election.cc:290] T 651beb51dcbf4055b1178a304fe23043 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:56.746129 30700 leader_election.cc:336] T 651beb51dcbf4055b1178a304fe23043 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:56.747654 28889 tablet_server.cc:196] TabletServer@127.28.54.66:0 shutdown complete.
W20260709 13:11:56.756695 30703 consensus_peers.cc:597] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:56.771811 30703 leader_election.cc:336] T 651beb51dcbf4055b1178a304fe23043 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111)
I20260709 13:11:56.772267 30703 leader_election.cc:304] T 651beb51dcbf4055b1178a304fe23043 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:56.772945  1970 raft_consensus.cc:2749] T 651beb51dcbf4055b1178a304fe23043 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 13:11:56.782541 30143 consensus_peers.cc:597] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:56.827725 30703 consensus_peers.cc:597] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:56.836782 30703 consensus_peers.cc:597] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:56.843451 30143 consensus_peers.cc:597] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:56.857146 30172 raft_consensus.cc:1275] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 13 FOLLOWER]: Refusing update from remote peer 6f3eb161e2194f6891f12e2cfcaaf73a: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 13:11:56.860668  1970 consensus_queue.cc:1048] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 13:11:56.891589 30143 consensus_peers.cc:597] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:56.919008 30703 consensus_peers.cc:597] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:56.919454 30703 consensus_peers.cc:597] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:56.920491 30143 consensus_peers.cc:597] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:56.945446 30143 consensus_peers.cc:597] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:57.020462 28889 tablet_server.cc:179] TabletServer@127.28.54.67:0 shutting down...
W20260709 13:11:57.039047 30143 consensus_peers.cc:597] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:57.044878 30702 consensus_peers.cc:597] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Couldn't send request to peer c99569d27a6f4c648eae7119fe3db124. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:57.048537 30702 consensus_peers.cc:597] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Couldn't send request to peer c99569d27a6f4c648eae7119fe3db124. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:57.060170 30143 consensus_peers.cc:597] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:11:57.100451 30702 consensus_peers.cc:597] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Couldn't send request to peer c99569d27a6f4c648eae7119fe3db124. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:57.118028 28889 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:57.121147 28889 tablet_replica.cc:333] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:11:57.122138 28889 raft_consensus.cc:2243] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:11:57.123972 28889 raft_consensus.cc:2272] T 935127b9887c4175b5b65fd739c5cffe P c99569d27a6f4c648eae7119fe3db124 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:57.133626 30702 consensus_peers.cc:597] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Couldn't send request to peer c99569d27a6f4c648eae7119fe3db124. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:57.136315 28889 tablet_replica.cc:333] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:11:57.137475 28889 raft_consensus.cc:2243] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:57.138345 28889 raft_consensus.cc:2272] T 30a540a1b03746b785f2fc4692e05833 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.140900 28889 tablet_replica.cc:333] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:11:57.141981 28889 raft_consensus.cc:2243] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:57.143020 28889 raft_consensus.cc:2272] T f71bd695ecc748db8c77f136fb53616b P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.154196 28889 tablet_replica.cc:333] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:11:57.155124 28889 raft_consensus.cc:2243] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:57.155740 28889 raft_consensus.cc:2272] T 632c5405056e40be8152973f0c966318 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.158337 28889 tablet_replica.cc:333] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:11:57.159121 28889 raft_consensus.cc:2243] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:57.159760 28889 raft_consensus.cc:2272] T f8fcd3026125450694af59415c94e029 P c99569d27a6f4c648eae7119fe3db124 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.162436 28889 tablet_replica.cc:333] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:11:57.163187 28889 raft_consensus.cc:2243] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:57.163776 28889 raft_consensus.cc:2272] T 8a3e809a994e4cbf98d7ea56807b8dad P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.166440 28889 tablet_replica.cc:333] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:11:57.167177 28889 raft_consensus.cc:2243] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:11:57.168583 28889 raft_consensus.cc:2272] T 24644eca754d40189c8264977160368a P c99569d27a6f4c648eae7119fe3db124 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.171067 28889 tablet_replica.cc:333] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:11:57.171844 28889 raft_consensus.cc:2243] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:57.172420 28889 raft_consensus.cc:2272] T 8495d060d6b042a3b7bd9dba1055dbbf P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.174808 28889 tablet_replica.cc:333] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:11:57.175519 28889 raft_consensus.cc:2243] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:57.176183 28889 raft_consensus.cc:2272] T b66f98d7fcfe4102a01ace9ed64355ed P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.178575 28889 tablet_replica.cc:333] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:11:57.179332 28889 raft_consensus.cc:2243] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:11:57.180653 28889 raft_consensus.cc:2272] T 407fb380b889498d94c7525edbc34b23 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.183030 28889 tablet_replica.cc:333] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:11:57.183845 28889 raft_consensus.cc:2243] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:57.187139 28889 raft_consensus.cc:2272] T 56168b79f56f4dee859bee3ef7df4712 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.200093 28889 tablet_replica.cc:333] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:11:57.200901 28889 raft_consensus.cc:2243] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:11:57.201992 28889 raft_consensus.cc:2272] T b52e70a06b534fbf90cbcb6a010e9d43 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.204602 28889 tablet_replica.cc:333] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:11:57.205389 28889 raft_consensus.cc:2243] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:11:57.206646 28889 raft_consensus.cc:2272] T 777fb4e4b87a4d549e79b74a36a2ac08 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:57.207360 30702 consensus_peers.cc:597] T f71bd695ecc748db8c77f136fb53616b P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Couldn't send request to peer c99569d27a6f4c648eae7119fe3db124. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:57.209388 28889 tablet_replica.cc:333] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:11:57.220294 28889 raft_consensus.cc:2243] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:57.220952 28889 raft_consensus.cc:2272] T de39104c229542e3a29860956492edea P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:57.236194 30702 consensus_peers.cc:597] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Couldn't send request to peer c99569d27a6f4c648eae7119fe3db124. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:57.242888 30702 consensus_peers.cc:597] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Couldn't send request to peer c99569d27a6f4c648eae7119fe3db124. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:57.244024 30702 consensus_peers.cc:597] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Couldn't send request to peer c99569d27a6f4c648eae7119fe3db124. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:57.247134 28889 tablet_replica.cc:333] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
W20260709 13:11:57.250347 30702 consensus_peers.cc:597] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Couldn't send request to peer c99569d27a6f4c648eae7119fe3db124. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:57.250599 28889 raft_consensus.cc:2243] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:57.251230 28889 raft_consensus.cc:2272] T 5a14bd61c7a94d1ca54063afae0c68e8 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.256115 28889 tablet_replica.cc:333] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:11:57.261634 28889 raft_consensus.cc:2243] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:11:57.262946 28889 raft_consensus.cc:2272] T 64effd13e9a741368e16bc2f52fb573c P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.265496 28889 tablet_replica.cc:333] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:11:57.270373 28889 raft_consensus.cc:2243] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:57.270934 28889 raft_consensus.cc:2272] T d7be23af8c824b3bb048a59d6bdf884c P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.278064 28889 tablet_replica.cc:333] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:11:57.282182 28889 raft_consensus.cc:2243] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:57.282794 28889 raft_consensus.cc:2272] T fe9a5ae7a3c04826a4bdde9445be46bb P c99569d27a6f4c648eae7119fe3db124 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.287796 28889 tablet_replica.cc:333] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:11:57.288600 28889 raft_consensus.cc:2243] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:11:57.289690 28889 raft_consensus.cc:2272] T 31b19922895c4885a5a8bc5030afcba3 P c99569d27a6f4c648eae7119fe3db124 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.296098 28889 tablet_replica.cc:333] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
W20260709 13:11:57.291996 30702 consensus_peers.cc:597] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Couldn't send request to peer c99569d27a6f4c648eae7119fe3db124. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:57.300279 30702 consensus_peers.cc:597] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Couldn't send request to peer c99569d27a6f4c648eae7119fe3db124. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:57.296846 28889 raft_consensus.cc:2243] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:57.301124 28889 raft_consensus.cc:2272] T f7c9e9bbe0c44a8d803c3d45799906f2 P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.303565 28889 tablet_replica.cc:333] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:11:57.304334 28889 raft_consensus.cc:2243] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:57.304984 28889 raft_consensus.cc:2272] T c6d87bb3ff11400cbdaf30e614c4b3da P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.310276 28889 tablet_replica.cc:333] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:11:57.311013 28889 raft_consensus.cc:2243] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:11:57.312207 28889 raft_consensus.cc:2272] T 80006b8186d74baba29992ade1966048 P c99569d27a6f4c648eae7119fe3db124 [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:57.322975 30703 consensus_peers.cc:597] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:57.326150 28889 tablet_replica.cc:333] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:11:57.327049 28889 raft_consensus.cc:2243] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:11:57.328287 28889 raft_consensus.cc:2272] T b38ec265ce704d799b58d99914a46422 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.330675 28889 tablet_replica.cc:333] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:11:57.331511 28889 raft_consensus.cc:2243] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:57.332139 28889 raft_consensus.cc:2272] T 2964592ff08b4434889d830c05501d8e P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.334537 28889 tablet_replica.cc:333] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:11:57.335618 28889 raft_consensus.cc:2243] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:11:57.336642 28889 raft_consensus.cc:2272] T f5616428acc64e24945a779e1aee597f P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.344550 28889 tablet_replica.cc:333] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:11:57.345292 28889 raft_consensus.cc:2243] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:57.346149 28889 raft_consensus.cc:2272] T 98e11967c3504e11865ed831f2584aea P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.348644 28889 tablet_replica.cc:333] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:11:57.349294 28889 raft_consensus.cc:2243] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:11:57.350528 28889 raft_consensus.cc:2272] T f68c2b86f7fc4ef48b6dc19371d4560b P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:57.356259 30702 consensus_peers.cc:597] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Couldn't send request to peer c99569d27a6f4c648eae7119fe3db124. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:57.357918 28889 tablet_replica.cc:333] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:11:57.358700 28889 raft_consensus.cc:2243] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:11:57.359681 28889 raft_consensus.cc:2272] T 3068102662114944a63195a8d764e93d P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.362502 28889 tablet_replica.cc:333] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:11:57.363241 28889 raft_consensus.cc:2243] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 14 LEADER]: Raft consensus shutting down.
I20260709 13:11:57.370143 28889 raft_consensus.cc:2272] T 7d7c81315a41495eafb4a8020a99cb7c P c99569d27a6f4c648eae7119fe3db124 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.372641 28889 tablet_replica.cc:333] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
W20260709 13:11:57.383216 30702 consensus_peers.cc:597] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Couldn't send request to peer c99569d27a6f4c648eae7119fe3db124. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:11:57.387670 30702 consensus_peers.cc:597] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Couldn't send request to peer c99569d27a6f4c648eae7119fe3db124. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:57.388186 28889 raft_consensus.cc:2243] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:57.388918 28889 raft_consensus.cc:2272] T b58427f5fe51486b983433e11caa8a3f P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.391319 28889 tablet_replica.cc:333] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:11:57.392053 28889 raft_consensus.cc:2243] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:57.393785 28889 raft_consensus.cc:2272] T 38e941311158407e8c0e2f4ca4b31d32 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.396319 28889 tablet_replica.cc:333] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:11:57.397051 28889 raft_consensus.cc:2243] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:11:57.398345 28889 raft_consensus.cc:2272] T 63253e2671134725b8fe85f63070e4c8 P c99569d27a6f4c648eae7119fe3db124 [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.405277 28889 tablet_replica.cc:333] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:11:57.413386 28889 raft_consensus.cc:2243] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:57.415165 28889 raft_consensus.cc:2272] T 18a72905c2e24e33af2e64672417cfcf P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.419181 28889 tablet_replica.cc:333] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:11:57.419971 28889 raft_consensus.cc:2243] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:11:57.424365 28889 raft_consensus.cc:2272] T 1136db29fbad4093bcad74bb6274f752 P c99569d27a6f4c648eae7119fe3db124 [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.431437 28889 tablet_replica.cc:333] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
W20260709 13:11:57.432190 29910 catalog_manager.cc:4755] TS b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ff758e6a87fa49b99c35558fafe39f11: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:57.432144 28889 raft_consensus.cc:2243] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:11:57.437984 28889 raft_consensus.cc:2272] T 21562b36aa874c9cba1acd5dc79cf517 P c99569d27a6f4c648eae7119fe3db124 [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.440932 28889 tablet_replica.cc:333] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:11:57.441795 28889 raft_consensus.cc:2243] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Raft consensus shutting down.
W20260709 13:11:57.447718 30702 consensus_peers.cc:597] T 802499fd316b44c9b21bede0e714fcfb P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Couldn't send request to peer c99569d27a6f4c648eae7119fe3db124. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:57.448489 28889 raft_consensus.cc:2272] T 802499fd316b44c9b21bede0e714fcfb P c99569d27a6f4c648eae7119fe3db124 [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.451037 28889 tablet_replica.cc:333] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:11:57.457409 28889 raft_consensus.cc:2243] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:11:57.458477 28889 raft_consensus.cc:2272] T 978900c67750481aba3e58987ac43180 P c99569d27a6f4c648eae7119fe3db124 [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.461054 28889 tablet_replica.cc:333] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:11:57.467657 28889 raft_consensus.cc:2243] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:57.474197 28889 raft_consensus.cc:2272] T 2ef07e332d8e432eaf9fc64b07cd74f0 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.476884 28889 tablet_replica.cc:333] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:11:57.477620 28889 raft_consensus.cc:2243] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 6 LEADER]: Raft consensus shutting down.
I20260709 13:11:57.478725 28889 raft_consensus.cc:2272] T 817d4a23671d4a1d9c3b9db3b4e77b0f P c99569d27a6f4c648eae7119fe3db124 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.483860 28889 tablet_replica.cc:333] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:11:57.490335 28889 raft_consensus.cc:2243] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:11:57.491497 28889 raft_consensus.cc:2272] T ff758e6a87fa49b99c35558fafe39f11 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.494971 28889 tablet_replica.cc:333] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:11:57.495656 28889 raft_consensus.cc:2243] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:57.496743 28889 raft_consensus.cc:2272] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.505316 28889 tablet_replica.cc:333] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:11:57.506069 28889 raft_consensus.cc:2243] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:11:57.507136 28889 raft_consensus.cc:2272] T c56071aeace442bebfbcd88e12fe4376 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.509727 28889 tablet_replica.cc:333] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:11:57.512161 28889 raft_consensus.cc:2243] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:57.518971 28889 raft_consensus.cc:2272] T 1cd924402bd0402aa7ad47fac1308ac9 P c99569d27a6f4c648eae7119fe3db124 [term 7 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:57.519707 30702 consensus_peers.cc:597] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Couldn't send request to peer c99569d27a6f4c648eae7119fe3db124. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:57.521443 28889 tablet_replica.cc:333] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:11:57.522212 28889 raft_consensus.cc:2243] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:57.522814 28889 raft_consensus.cc:2272] T 64e2b2bd54d3454a9f64030c149e2e25 P c99569d27a6f4c648eae7119fe3db124 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:57.525367 28889 tablet_replica.cc:333] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124: stopping tablet replica
I20260709 13:11:57.530947 28889 raft_consensus.cc:2243] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:57.531637 28889 raft_consensus.cc:2272] T e218d3c3e368401a8eff81a5699074b8 P c99569d27a6f4c648eae7119fe3db124 [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:57.559590 30702 consensus_peers.cc:597] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Couldn't send request to peer c99569d27a6f4c648eae7119fe3db124. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:11:57.650494  1970 raft_consensus.cc:493] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:57.650998  1970 raft_consensus.cc:515] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:57.653004  1970 leader_election.cc:290] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:57.658329 30703 leader_election.cc:336] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111)
W20260709 13:11:57.659076 30700 leader_election.cc:336] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:57.659446 30700 leader_election.cc:304] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:57.660461  1970 raft_consensus.cc:2749] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 13:11:57.734166 30702 connection.cc:573] client connection to 127.28.54.67:45001 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260709 13:11:57.765625  1991 raft_consensus.cc:493] T 143490b42f5d4687a680435e8cd86d1f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:57.766184  1991 raft_consensus.cc:515] T 143490b42f5d4687a680435e8cd86d1f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:57.768164  1991 leader_election.cc:290] T 143490b42f5d4687a680435e8cd86d1f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:57.773106 30700 leader_election.cc:336] T 143490b42f5d4687a680435e8cd86d1f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
W20260709 13:11:57.787292 30703 leader_election.cc:336] T 143490b42f5d4687a680435e8cd86d1f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111)
I20260709 13:11:57.787719 30703 leader_election.cc:304] T 143490b42f5d4687a680435e8cd86d1f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:57.788365  1991 raft_consensus.cc:2749] T 143490b42f5d4687a680435e8cd86d1f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 13:11:57.813094  1991 raft_consensus.cc:493] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:57.813601  1991 raft_consensus.cc:515] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:57.815610  1991 leader_election.cc:290] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:57.822158 30700 leader_election.cc:336] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
W20260709 13:11:57.823740 30703 leader_election.cc:336] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111)
I20260709 13:11:57.824128 30703 leader_election.cc:304] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:57.826172  1991 raft_consensus.cc:2749] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:57.859342  1990 raft_consensus.cc:493] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:57.859848  1990 raft_consensus.cc:515] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:57.861883  1990 leader_election.cc:290] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:57.865510 30703 leader_election.cc:336] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111)
W20260709 13:11:57.866431 30700 leader_election.cc:336] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:57.866791 30700 leader_election.cc:304] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:57.867434  1990 raft_consensus.cc:2749] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:58.004745  1990 raft_consensus.cc:493] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:58.005266  1990 raft_consensus.cc:515] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:58.007530  1990 leader_election.cc:290] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:58.017932 30700 leader_election.cc:336] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
W20260709 13:11:58.020426 30703 leader_election.cc:336] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111)
I20260709 13:11:58.020889 30703 leader_election.cc:304] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:58.021739  1991 raft_consensus.cc:2749] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 13:11:58.231604  1990 raft_consensus.cc:493] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:58.232122  1990 raft_consensus.cc:515] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:58.234117  1990 leader_election.cc:290] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:58.245030 30703 leader_election.cc:336] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111)
W20260709 13:11:58.248425 30700 leader_election.cc:336] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:58.248802 30700 leader_election.cc:304] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:58.249645  1963 raft_consensus.cc:2749] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:58.250221  1963 raft_consensus.cc:493] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:58.250662  1963 raft_consensus.cc:515] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:58.252846  1963 leader_election.cc:290] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:11:58.257711 30702 leader_election.cc:336] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Network error: Client connection negotiation failed: client connection to 127.28.54.67:45001: connect: Connection refused (error 111)
W20260709 13:11:58.261588 30700 consensus_peers.cc:597] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 13:11:58.263067 30703 leader_election.cc:336] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111)
I20260709 13:11:58.265184 30703 leader_election.cc:304] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, c99569d27a6f4c648eae7119fe3db124
W20260709 13:11:58.265902 30700 consensus_peers.cc:597] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:11:58.266460  1963 raft_consensus.cc:2749] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 13:11:58.360489  1990 raft_consensus.cc:493] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:58.361145 28889 tablet_server.cc:196] TabletServer@127.28.54.67:0 shutdown complete.
I20260709 13:11:58.360993  1990 raft_consensus.cc:515] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:58.369228 30702 leader_election.cc:336] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Network error: Client connection negotiation failed: client connection to 127.28.54.67:45001: connect: Connection refused (error 111)
I20260709 13:11:58.369882  1990 leader_election.cc:290] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:11:58.374264 30700 leader_election.cc:336] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:58.374644 30700 leader_election.cc:304] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:58.375921  1990 raft_consensus.cc:2749] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:58.409282  1991 raft_consensus.cc:493] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:58.409801  1991 raft_consensus.cc:515] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:58.411821  1991 leader_election.cc:290] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:58.416816 30700 leader_election.cc:336] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
W20260709 13:11:58.433827 30703 leader_election.cc:336] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111)
I20260709 13:11:58.435061 30703 leader_election.cc:304] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:58.434496  1990 raft_consensus.cc:493] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5ec73dc157ed476ca903a7d596271719)
I20260709 13:11:58.435956  1990 raft_consensus.cc:515] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:58.438166  1990 leader_election.cc:290] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821)
W20260709 13:11:58.443322 30700 leader_election.cc:336] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:58.443820  1963 raft_consensus.cc:2749] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 13:11:58.460229 30703 leader_election.cc:336] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111)
I20260709 13:11:58.460693 30703 leader_election.cc:304] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
I20260709 13:11:58.461386  1963 raft_consensus.cc:2749] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 13:11:58.462940 30700 consensus_peers.cc:597] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:11:58.535796  1990 raft_consensus.cc:493] T 24644eca754d40189c8264977160368a P 6f3eb161e2194f6891f12e2cfcaaf73a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:58.536299  1990 raft_consensus.cc:515] T 24644eca754d40189c8264977160368a P 6f3eb161e2194f6891f12e2cfcaaf73a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "5ec73dc157ed476ca903a7d596271719" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43821 } attrs { replace: true } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:58.546171 30703 leader_election.cc:336] T 24644eca754d40189c8264977160368a P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111)
W20260709 13:11:58.548331 30700 leader_election.cc:336] T 24644eca754d40189c8264977160368a P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:58.548692 30700 leader_election.cc:304] T 24644eca754d40189c8264977160368a P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: 5ec73dc157ed476ca903a7d596271719, b2cea0098c1040f69755ea4d3dab7fc4
W20260709 13:11:58.550303 30702 leader_election.cc:336] T 24644eca754d40189c8264977160368a P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Network error: Client connection negotiation failed: client connection to 127.28.54.67:45001: connect: Connection refused (error 111)
I20260709 13:11:58.551087  1991 raft_consensus.cc:2749] T 24644eca754d40189c8264977160368a P 6f3eb161e2194f6891f12e2cfcaaf73a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:58.552454  1991 raft_consensus.cc:493] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 13 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:58.552897  1991 raft_consensus.cc:515] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:58.561661 30700 leader_election.cc:336] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:58.566177 28889 tablet_server.cc:179] TabletServer@127.28.54.68:0 shutting down...
I20260709 13:11:58.569653  1991 leader_election.cc:290] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:58.556592  1990 leader_election.cc:290] T 24644eca754d40189c8264977160368a P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:11:58.573114 30700 consensus_peers.cc:597] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:11:58.578298  1990 raft_consensus.cc:493] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:58.578833  1990 raft_consensus.cc:515] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:58.580631  1990 leader_election.cc:290] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:11:58.588348 30702 leader_election.cc:336] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Network error: Client connection negotiation failed: client connection to 127.28.54.67:45001: connect: Connection refused (error 111)
I20260709 13:11:58.588765 30702 leader_election.cc:304] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:58.594539  1991 raft_consensus.cc:2749] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 13:11:58.595960 30700 leader_election.cc:336] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
W20260709 13:11:58.598421 30702 leader_election.cc:336] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Network error: Client connection negotiation failed: client connection to 127.28.54.67:45001: connect: Connection refused (error 111)
I20260709 13:11:58.598866 30702 leader_election.cc:304] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:58.600358  1991 raft_consensus.cc:2749] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 13:11:58.599380 30700 consensus_peers.cc:597] T 802499fd316b44c9b21bede0e714fcfb P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 13:11:58.614114  1991 raft_consensus.cc:493] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:58.614684  1991 raft_consensus.cc:515] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:58.616773  1991 leader_election.cc:290] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:11:58.635464 30702 leader_election.cc:336] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Network error: Client connection negotiation failed: client connection to 127.28.54.67:45001: connect: Connection refused (error 111)
W20260709 13:11:58.637615 30700 leader_election.cc:336] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:58.638145 30700 leader_election.cc:304] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:58.640822  1991 raft_consensus.cc:2749] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:58.652640 28889 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:11:58.653584 28889 tablet_replica.cc:333] T ff758e6a87fa49b99c35558fafe39f11 P 6f3eb161e2194f6891f12e2cfcaaf73a: stopping tablet replica
I20260709 13:11:58.654605 28889 raft_consensus.cc:2243] T ff758e6a87fa49b99c35558fafe39f11 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.655462 28889 raft_consensus.cc:2272] T ff758e6a87fa49b99c35558fafe39f11 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.659507 28889 tablet_replica.cc:333] T 24644eca754d40189c8264977160368a P 6f3eb161e2194f6891f12e2cfcaaf73a: stopping tablet replica
I20260709 13:11:58.660465 28889 raft_consensus.cc:2243] T 24644eca754d40189c8264977160368a P 6f3eb161e2194f6891f12e2cfcaaf73a [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.661185 28889 raft_consensus.cc:2272] T 24644eca754d40189c8264977160368a P 6f3eb161e2194f6891f12e2cfcaaf73a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.664142 28889 tablet_replica.cc:333] T 143490b42f5d4687a680435e8cd86d1f P 6f3eb161e2194f6891f12e2cfcaaf73a: stopping tablet replica
I20260709 13:11:58.665019 28889 raft_consensus.cc:2243] T 143490b42f5d4687a680435e8cd86d1f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.665880 28889 raft_consensus.cc:2272] T 143490b42f5d4687a680435e8cd86d1f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.668622 28889 tablet_replica.cc:333] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a: stopping tablet replica
I20260709 13:11:58.669404 28889 raft_consensus.cc:2243] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.670550 28889 raft_consensus.cc:2272] T 18a72905c2e24e33af2e64672417cfcf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.674881 28889 tablet_replica.cc:333] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a: stopping tablet replica
I20260709 13:11:58.675736 28889 raft_consensus.cc:2243] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 15 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.676975 28889 raft_consensus.cc:2272] T 88d3759f7fe14a4d8e7ba8670ce5cfeb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.679683 28889 tablet_replica.cc:333] T 802499fd316b44c9b21bede0e714fcfb P 6f3eb161e2194f6891f12e2cfcaaf73a: stopping tablet replica
I20260709 13:11:58.680511 28889 raft_consensus.cc:2243] T 802499fd316b44c9b21bede0e714fcfb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.681607 28889 raft_consensus.cc:2272] T 802499fd316b44c9b21bede0e714fcfb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.683517  1991 raft_consensus.cc:493] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 14 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:58.684007  1991 raft_consensus.cc:515] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:58.686143  1991 leader_election.cc:290] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:58.690224 28889 tablet_replica.cc:333] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a: stopping tablet replica
I20260709 13:11:58.691262 28889 raft_consensus.cc:2243] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.692344 28889 raft_consensus.cc:2272] T 3a0f0dc1823e4c99aa3cc53ce8a58efa P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:58.692514 30700 leader_election.cc:336] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
W20260709 13:11:58.693288 30702 leader_election.cc:336] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Network error: Client connection negotiation failed: client connection to 127.28.54.67:45001: connect: Connection refused (error 111)
I20260709 13:11:58.693693 30702 leader_election.cc:304] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:58.694424  1991 raft_consensus.cc:2749] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 13:11:58.696408 28889 tablet_replica.cc:333] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a: stopping tablet replica
I20260709 13:11:58.697345 28889 raft_consensus.cc:2243] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.698091 28889 raft_consensus.cc:2272] T 978900c67750481aba3e58987ac43180 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.701115 28889 tablet_replica.cc:333] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a: stopping tablet replica
I20260709 13:11:58.701920 28889 raft_consensus.cc:2243] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.702912 28889 raft_consensus.cc:2272] T b66f98d7fcfe4102a01ace9ed64355ed P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.705564 28889 tablet_replica.cc:333] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a: stopping tablet replica
I20260709 13:11:58.706318 28889 raft_consensus.cc:2243] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.707311 28889 raft_consensus.cc:2272] T 8495d060d6b042a3b7bd9dba1055dbbf P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.719978 28889 tablet_replica.cc:333] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a: stopping tablet replica
I20260709 13:11:58.720460  1991 raft_consensus.cc:493] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:58.720738 28889 raft_consensus.cc:2243] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.721686 28889 raft_consensus.cc:2272] T 57ce415a86d343cb8bdff28acc41c6a6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:58.722067 30700 consensus_peers.cc:597] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Couldn't send request to peer b2cea0098c1040f69755ea4d3dab7fc4. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 13:11:58.722941  1991 raft_consensus.cc:515] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
W20260709 13:11:58.731122 30702 leader_election.cc:336] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Network error: Client connection negotiation failed: client connection to 127.28.54.67:45001: connect: Connection refused (error 111)
I20260709 13:11:58.734375  1991 leader_election.cc:290] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
W20260709 13:11:58.735011 30700 leader_election.cc:336] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:11:58.735585 30700 leader_election.cc:304] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:58.736065 28889 tablet_replica.cc:333] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a: stopping tablet replica
I20260709 13:11:58.736443  1991 raft_consensus.cc:2749] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 13:11:58.736971 28889 raft_consensus.cc:2243] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.737581 28889 raft_consensus.cc:2272] T f5c869d5410b4a83adc1ca35397defb6 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.740396 28889 tablet_replica.cc:333] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a: stopping tablet replica
I20260709 13:11:58.741173 28889 raft_consensus.cc:2243] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.741772 28889 raft_consensus.cc:2272] T b52e70a06b534fbf90cbcb6a010e9d43 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.742781  1991 raft_consensus.cc:493] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Starting pre-election (detected failure of leader c99569d27a6f4c648eae7119fe3db124)
I20260709 13:11:58.743252  1991 raft_consensus.cc:515] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "b2cea0098c1040f69755ea4d3dab7fc4" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34451 } } peers { permanent_uuid: "c99569d27a6f4c648eae7119fe3db124" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 45001 } } peers { permanent_uuid: "6f3eb161e2194f6891f12e2cfcaaf73a" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 46469 } attrs { promote: false } }
I20260709 13:11:58.744480 28889 tablet_replica.cc:333] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a: stopping tablet replica
I20260709 13:11:58.745296  1991 leader_election.cc:290] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451), c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001)
I20260709 13:11:58.745790 28889 raft_consensus.cc:2243] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.746587 28889 raft_consensus.cc:2272] T 31b19922895c4885a5a8bc5030afcba3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.749405 28889 tablet_replica.cc:333] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a: stopping tablet replica
I20260709 13:11:58.750165 28889 raft_consensus.cc:2243] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.750746 28889 raft_consensus.cc:2272] T 64effd13e9a741368e16bc2f52fb573c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.753158 28889 tablet_replica.cc:333] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a: stopping tablet replica
I20260709 13:11:58.753938 28889 raft_consensus.cc:2243] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 13 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.754995 28889 raft_consensus.cc:2272] T fe9a5ae7a3c04826a4bdde9445be46bb P 6f3eb161e2194f6891f12e2cfcaaf73a [term 13 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:58.755483 30700 leader_election.cc:336] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
W20260709 13:11:58.756167 30702 leader_election.cc:336] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer c99569d27a6f4c648eae7119fe3db124 (127.28.54.67:45001): Network error: Client connection negotiation failed: client connection to 127.28.54.67:45001: connect: Connection refused (error 111)
I20260709 13:11:58.756590 30702 leader_election.cc:304] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f3eb161e2194f6891f12e2cfcaaf73a; no voters: b2cea0098c1040f69755ea4d3dab7fc4, c99569d27a6f4c648eae7119fe3db124
I20260709 13:11:58.757583 28889 tablet_replica.cc:333] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a: stopping tablet replica
I20260709 13:11:58.757784  1991 raft_consensus.cc:2749] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 13:11:58.758526 28889 raft_consensus.cc:2243] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.759533 28889 raft_consensus.cc:2272] T 64e2b2bd54d3454a9f64030c149e2e25 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.762055 28889 tablet_replica.cc:333] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a: stopping tablet replica
I20260709 13:11:58.762826 28889 raft_consensus.cc:2243] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.763870 28889 raft_consensus.cc:2272] T 0be979412dd54241bd212ddbb7611046 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.766675 28889 tablet_replica.cc:333] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a: stopping tablet replica
I20260709 13:11:58.767453 28889 raft_consensus.cc:2243] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.768520 28889 raft_consensus.cc:2272] T 2ef07e332d8e432eaf9fc64b07cd74f0 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.771147 28889 tablet_replica.cc:333] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a: stopping tablet replica
I20260709 13:11:58.771994 28889 raft_consensus.cc:2243] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.773005 28889 raft_consensus.cc:2272] T 2964592ff08b4434889d830c05501d8e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.775668 28889 tablet_replica.cc:333] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a: stopping tablet replica
I20260709 13:11:58.776439 28889 raft_consensus.cc:2243] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.777489 28889 raft_consensus.cc:2272] T 9cd772608bf64bf9b1c1aec00dc57eee P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.780174 28889 tablet_replica.cc:333] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a: stopping tablet replica
I20260709 13:11:58.780915 28889 raft_consensus.cc:2243] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.781728 28889 raft_consensus.cc:2272] T 0a722bee3f14472ebed5b798e61c64b3 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.789019 28889 tablet_replica.cc:333] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a: stopping tablet replica
I20260709 13:11:58.789819 28889 raft_consensus.cc:2243] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.790503 28889 raft_consensus.cc:2272] T 80006b8186d74baba29992ade1966048 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.793118 28889 tablet_replica.cc:333] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a: stopping tablet replica
I20260709 13:11:58.793936 28889 raft_consensus.cc:2243] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.794552 28889 raft_consensus.cc:2272] T 7d7c81315a41495eafb4a8020a99cb7c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.797115 28889 tablet_replica.cc:333] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a: stopping tablet replica
I20260709 13:11:58.798113 28889 raft_consensus.cc:2243] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.799243 28889 raft_consensus.cc:2272] T c6d87bb3ff11400cbdaf30e614c4b3da P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.801741 28889 tablet_replica.cc:333] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a: stopping tablet replica
I20260709 13:11:58.802541 28889 raft_consensus.cc:2243] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.803548 28889 raft_consensus.cc:2272] T 632c5405056e40be8152973f0c966318 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.806306 28889 tablet_replica.cc:333] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a: stopping tablet replica
I20260709 13:11:58.807118 28889 raft_consensus.cc:2243] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.808149 28889 raft_consensus.cc:2272] T d7be23af8c824b3bb048a59d6bdf884c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.810812 28889 tablet_replica.cc:333] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a: stopping tablet replica
I20260709 13:11:58.811523 28889 raft_consensus.cc:2243] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.812554 28889 raft_consensus.cc:2272] T 48d3196b43924d35bf72234ad500783e P 6f3eb161e2194f6891f12e2cfcaaf73a [term 10 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.814983 28889 tablet_replica.cc:333] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a: stopping tablet replica
I20260709 13:11:58.815759 28889 raft_consensus.cc:2243] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.816399 28889 raft_consensus.cc:2272] T c41a6d79ca9c459eb4b0b41302fb76a9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.818928 28889 tablet_replica.cc:333] T 651beb51dcbf4055b1178a304fe23043 P 6f3eb161e2194f6891f12e2cfcaaf73a: stopping tablet replica
I20260709 13:11:58.819650 28889 raft_consensus.cc:2243] T 651beb51dcbf4055b1178a304fe23043 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.820428 28889 raft_consensus.cc:2272] T 651beb51dcbf4055b1178a304fe23043 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.823076 28889 tablet_replica.cc:333] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a: stopping tablet replica
I20260709 13:11:58.823755 28889 raft_consensus.cc:2243] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.824790 28889 raft_consensus.cc:2272] T 8a3e809a994e4cbf98d7ea56807b8dad P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:58.830652 30703 consensus_peers.cc:597] T f71bd695ecc748db8c77f136fb53616b P 6f3eb161e2194f6891f12e2cfcaaf73a -> Peer 5ec73dc157ed476ca903a7d596271719 (127.28.54.66:43821): Couldn't send request to peer 5ec73dc157ed476ca903a7d596271719. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.66:43821: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:11:58.831234 28889 tablet_replica.cc:333] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a: stopping tablet replica
I20260709 13:11:58.832073 28889 raft_consensus.cc:2243] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.833031 28889 raft_consensus.cc:2272] T 1cd924402bd0402aa7ad47fac1308ac9 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.835497 28889 tablet_replica.cc:333] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a: stopping tablet replica
I20260709 13:11:58.836201 28889 raft_consensus.cc:2243] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.837155 28889 raft_consensus.cc:2272] T 30a540a1b03746b785f2fc4692e05833 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 7 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.841961 28889 tablet_replica.cc:333] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a: stopping tablet replica
I20260709 13:11:58.842697 28889 raft_consensus.cc:2243] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.843257 28889 raft_consensus.cc:2272] T 817d4a23671d4a1d9c3b9db3b4e77b0f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.846009 28889 tablet_replica.cc:333] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a: stopping tablet replica
I20260709 13:11:58.846720 28889 raft_consensus.cc:2243] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 13 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.847581 28889 raft_consensus.cc:2272] T d968b6d22e3243bfb840139be8b6dddd P 6f3eb161e2194f6891f12e2cfcaaf73a [term 13 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.850041 28889 tablet_replica.cc:333] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a: stopping tablet replica
I20260709 13:11:58.850726 28889 raft_consensus.cc:2243] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.851816 28889 raft_consensus.cc:2272] T d3f3f9c9793f4390874e250718c41697 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.854265 28889 tablet_replica.cc:333] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a: stopping tablet replica
I20260709 13:11:58.854976 28889 raft_consensus.cc:2243] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.855929 28889 pending_rounds.cc:70] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a: Trying to abort 1 pending ops.
I20260709 13:11:58.856202 28889 pending_rounds.cc:77] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a: Aborting op as it isn't in flight: id { term: 11 index: 10 } timestamp: 7305636727622696960 op_type: NO_OP noop_request { }
I20260709 13:11:58.856618 28889 raft_consensus.cc:2889] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:11:58.856971 28889 raft_consensus.cc:2272] T 38e941311158407e8c0e2f4ca4b31d32 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.859287 28889 tablet_replica.cc:333] T f71bd695ecc748db8c77f136fb53616b P 6f3eb161e2194f6891f12e2cfcaaf73a: stopping tablet replica
I20260709 13:11:58.859985 28889 raft_consensus.cc:2243] T f71bd695ecc748db8c77f136fb53616b P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 LEADER]: Raft consensus shutting down.
I20260709 13:11:58.861230 28889 raft_consensus.cc:2272] T f71bd695ecc748db8c77f136fb53616b P 6f3eb161e2194f6891f12e2cfcaaf73a [term 9 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.863994 28889 tablet_replica.cc:333] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a: stopping tablet replica
I20260709 13:11:58.864689 28889 raft_consensus.cc:2243] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.865408 28889 raft_consensus.cc:2272] T ea42d6bd0dbb4438a96c31b335069e3c P 6f3eb161e2194f6891f12e2cfcaaf73a [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.867859 28889 tablet_replica.cc:333] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a: stopping tablet replica
I20260709 13:11:58.868577 28889 raft_consensus.cc:2243] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.869187 28889 raft_consensus.cc:2272] T 21562b36aa874c9cba1acd5dc79cf517 P 6f3eb161e2194f6891f12e2cfcaaf73a [term 8 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.871734 28889 tablet_replica.cc:333] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a: stopping tablet replica
I20260709 13:11:58.872403 28889 raft_consensus.cc:2243] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.872951 28889 raft_consensus.cc:2272] T 935127b9887c4175b5b65fd739c5cffe P 6f3eb161e2194f6891f12e2cfcaaf73a [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.875504 28889 tablet_replica.cc:333] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a: stopping tablet replica
I20260709 13:11:58.876159 28889 raft_consensus.cc:2243] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.876760 28889 raft_consensus.cc:2272] T f5616428acc64e24945a779e1aee597f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Raft consensus is shut down!
I20260709 13:11:58.879222 28889 tablet_replica.cc:333] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a: stopping tablet replica
I20260709 13:11:58.879822 28889 raft_consensus.cc:2243] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Raft consensus shutting down.
I20260709 13:11:58.880410 28889 raft_consensus.cc:2272] T 5c8539fb97344b07aed5af91eaf0806f P 6f3eb161e2194f6891f12e2cfcaaf73a [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 13:11:59.965517 28889 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 30758)
I20260709 13:12:00.349794 28889 tablet_server.cc:196] TabletServer@127.28.54.68:0 shutdown complete.
I20260709 13:12:00.427809 28889 master.cc:562] Master@127.28.54.126:45283 shutting down...
W20260709 13:12:00.467118 29974 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 13:12:00.467609 29974 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:12:00.467947 29974 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 13:12:03.765848 29957 debug-util.cc:398] Leaking SignalData structure 0x7b0800034740 after lost signal to thread 28892
W20260709 13:12:03.766235 29957 debug-util.cc:398] Leaking SignalData structure 0x7b0800067fa0 after lost signal to thread 29960
W20260709 13:12:05.678103 29910 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111) [suppressed 422 similar messages]
W20260709 13:12:05.683602 29910 catalog_manager.cc:4755] TS b2cea0098c1040f69755ea4d3dab7fc4 (127.28.54.65:34451): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet ff758e6a87fa49b99c35558fafe39f11: Network error: Client connection negotiation failed: client connection to 127.28.54.65:34451: connect: Connection refused (error 111)
I20260709 13:12:06.088821 28889 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 1c91346f9a2a480e908d4e0323634aeb [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:06.089865 28889 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 1c91346f9a2a480e908d4e0323634aeb [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:06.090240 28889 tablet_replica.cc:333] T 00000000000000000000000000000000 P 1c91346f9a2a480e908d4e0323634aeb: stopping tablet replica
I20260709 13:12:06.280964 28889 master.cc:584] Master@127.28.54.126:45283 shutdown complete.
[       OK ] LeaderRebalancerTest.AddTserver (142990 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 13:12:06.385156 28889 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.28.54.126:35419
I20260709 13:12:06.386536 28889 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:06.392130  1996 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:06.392181  1997 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:06.393066  1999 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:06.393451 28889 server_base.cc:1061] running on GCE node
I20260709 13:12:06.395792 28889 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:06.395969 28889 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:06.396134 28889 hybrid_clock.cc:648] HybridClock initialized: now 1783602726396119 us; error 0 us; skew 500 ppm
I20260709 13:12:06.396661 28889 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:06.399024 28889 webserver.cc:533] Webserver started at http://127.28.54.126:32773/ using document root <none> and password file <none>
I20260709 13:12:06.399477 28889 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:06.399639 28889 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:06.399910 28889 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:06.401105 28889 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602558744475-28889-0/minicluster-data/master-0-root/instance:
uuid: "bab1ceb4d36d4793a27161880e6a7bf7"
format_stamp: "Formatted at 2026-07-09 13:12:06 on dist-test-slave-vpdx"
I20260709 13:12:06.405426 28889 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 13:12:06.408658  2004 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:06.409405 28889 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:12:06.409677 28889 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602558744475-28889-0/minicluster-data/master-0-root
uuid: "bab1ceb4d36d4793a27161880e6a7bf7"
format_stamp: "Formatted at 2026-07-09 13:12:06 on dist-test-slave-vpdx"
I20260709 13:12:06.410032 28889 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602558744475-28889-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602558744475-28889-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602558744475-28889-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:06.432941 28889 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:06.434432 28889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:06.470958 28889 rpc_server.cc:307] RPC server started. Bound to: 127.28.54.126:35419
I20260709 13:12:06.471081  2055 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.54.126:35419 every 8 connection(s)
I20260709 13:12:06.474879  2056 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:06.485312  2056 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bab1ceb4d36d4793a27161880e6a7bf7: Bootstrap starting.
I20260709 13:12:06.489935  2056 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P bab1ceb4d36d4793a27161880e6a7bf7: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:06.493999  2056 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P bab1ceb4d36d4793a27161880e6a7bf7: No bootstrap required, opened a new log
I20260709 13:12:06.496107  2056 raft_consensus.cc:359] T 00000000000000000000000000000000 P bab1ceb4d36d4793a27161880e6a7bf7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bab1ceb4d36d4793a27161880e6a7bf7" member_type: VOTER }
I20260709 13:12:06.496534  2056 raft_consensus.cc:385] T 00000000000000000000000000000000 P bab1ceb4d36d4793a27161880e6a7bf7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:06.496730  2056 raft_consensus.cc:740] T 00000000000000000000000000000000 P bab1ceb4d36d4793a27161880e6a7bf7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bab1ceb4d36d4793a27161880e6a7bf7, State: Initialized, Role: FOLLOWER
I20260709 13:12:06.497246  2056 consensus_queue.cc:260] T 00000000000000000000000000000000 P bab1ceb4d36d4793a27161880e6a7bf7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bab1ceb4d36d4793a27161880e6a7bf7" member_type: VOTER }
I20260709 13:12:06.497711  2056 raft_consensus.cc:399] T 00000000000000000000000000000000 P bab1ceb4d36d4793a27161880e6a7bf7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:12:06.497931  2056 raft_consensus.cc:493] T 00000000000000000000000000000000 P bab1ceb4d36d4793a27161880e6a7bf7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:12:06.498142  2056 raft_consensus.cc:3060] T 00000000000000000000000000000000 P bab1ceb4d36d4793a27161880e6a7bf7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:06.502315  2056 raft_consensus.cc:515] T 00000000000000000000000000000000 P bab1ceb4d36d4793a27161880e6a7bf7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bab1ceb4d36d4793a27161880e6a7bf7" member_type: VOTER }
I20260709 13:12:06.502754  2056 leader_election.cc:304] T 00000000000000000000000000000000 P bab1ceb4d36d4793a27161880e6a7bf7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: bab1ceb4d36d4793a27161880e6a7bf7; no voters: 
I20260709 13:12:06.503757  2056 leader_election.cc:290] T 00000000000000000000000000000000 P bab1ceb4d36d4793a27161880e6a7bf7 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:12:06.504144  2059 raft_consensus.cc:2804] T 00000000000000000000000000000000 P bab1ceb4d36d4793a27161880e6a7bf7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:06.505407  2059 raft_consensus.cc:697] T 00000000000000000000000000000000 P bab1ceb4d36d4793a27161880e6a7bf7 [term 1 LEADER]: Becoming Leader. State: Replica: bab1ceb4d36d4793a27161880e6a7bf7, State: Running, Role: LEADER
I20260709 13:12:06.506083  2059 consensus_queue.cc:237] T 00000000000000000000000000000000 P bab1ceb4d36d4793a27161880e6a7bf7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bab1ceb4d36d4793a27161880e6a7bf7" member_type: VOTER }
I20260709 13:12:06.506526  2056 sys_catalog.cc:565] T 00000000000000000000000000000000 P bab1ceb4d36d4793a27161880e6a7bf7 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:12:06.514111  2060 sys_catalog.cc:455] T 00000000000000000000000000000000 P bab1ceb4d36d4793a27161880e6a7bf7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "bab1ceb4d36d4793a27161880e6a7bf7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bab1ceb4d36d4793a27161880e6a7bf7" member_type: VOTER } }
I20260709 13:12:06.514510  2061 sys_catalog.cc:455] T 00000000000000000000000000000000 P bab1ceb4d36d4793a27161880e6a7bf7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader bab1ceb4d36d4793a27161880e6a7bf7. Latest consensus state: current_term: 1 leader_uuid: "bab1ceb4d36d4793a27161880e6a7bf7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "bab1ceb4d36d4793a27161880e6a7bf7" member_type: VOTER } }
I20260709 13:12:06.514720  2060 sys_catalog.cc:458] T 00000000000000000000000000000000 P bab1ceb4d36d4793a27161880e6a7bf7 [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:06.515048  2061 sys_catalog.cc:458] T 00000000000000000000000000000000 P bab1ceb4d36d4793a27161880e6a7bf7 [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:06.516584  2067 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:12:06.521370  2067 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:12:06.524178 28889 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:12:06.530023  2067 catalog_manager.cc:1383] Generated new cluster ID: ac82214ac32a4d14bd41ee45d1209fae
I20260709 13:12:06.530282  2067 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:12:06.553879  2067 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:12:06.555037  2067 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:12:06.568378  2067 catalog_manager.cc:6070] T 00000000000000000000000000000000 P bab1ceb4d36d4793a27161880e6a7bf7: Generated new TSK 0
I20260709 13:12:06.568907  2067 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:12:06.590939 28889 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:06.596779  2077 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:06.597623  2078 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:06.599313  2080 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:06.599700 28889 server_base.cc:1061] running on GCE node
I20260709 13:12:06.601424 28889 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:06.601613 28889 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:06.601795 28889 hybrid_clock.cc:648] HybridClock initialized: now 1783602726601777 us; error 0 us; skew 500 ppm
I20260709 13:12:06.602358 28889 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:06.604687 28889 webserver.cc:533] Webserver started at http://127.28.54.65:45623/ using document root <none> and password file <none>
I20260709 13:12:06.605141 28889 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:06.605298 28889 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:06.605552 28889 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:06.606706 28889 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602558744475-28889-0/minicluster-data/ts-0-root/instance:
uuid: "2ac5c5682f914ed9b9982b5a080d5472"
format_stamp: "Formatted at 2026-07-09 13:12:06 on dist-test-slave-vpdx"
I20260709 13:12:06.611202 28889 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:12:06.614389  2085 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:06.615077 28889 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:12:06.615342 28889 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602558744475-28889-0/minicluster-data/ts-0-root
uuid: "2ac5c5682f914ed9b9982b5a080d5472"
format_stamp: "Formatted at 2026-07-09 13:12:06 on dist-test-slave-vpdx"
I20260709 13:12:06.615593 28889 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602558744475-28889-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602558744475-28889-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602558744475-28889-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:06.631282 28889 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:06.632405 28889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:06.633790 28889 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:06.635998 28889 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:06.636176 28889 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:06.636386 28889 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:06.636543 28889 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:06.675227 28889 rpc_server.cc:307] RPC server started. Bound to: 127.28.54.65:36557
I20260709 13:12:06.675325  2147 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.54.65:36557 every 8 connection(s)
I20260709 13:12:06.679900 28889 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:06.686899  2152 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:06.687677  2153 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:06.692106 28889 server_base.cc:1061] running on GCE node
W20260709 13:12:06.692265  2155 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:06.692600  2148 heartbeater.cc:344] Connected to a master server at 127.28.54.126:35419
I20260709 13:12:06.692978  2148 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:06.693719  2148 heartbeater.cc:507] Master 127.28.54.126:35419 requested a full tablet report, sending...
I20260709 13:12:06.694191 28889 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:06.694427 28889 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:06.694615 28889 hybrid_clock.cc:648] HybridClock initialized: now 1783602726694599 us; error 0 us; skew 500 ppm
I20260709 13:12:06.695271 28889 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:06.696017  2021 ts_manager.cc:194] Registered new tserver with Master: 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:06.698081 28889 webserver.cc:533] Webserver started at http://127.28.54.66:34035/ using document root <none> and password file <none>
I20260709 13:12:06.698729 28889 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:06.698614  2021 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50228
I20260709 13:12:06.699028 28889 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:06.699371 28889 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:06.700655 28889 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602558744475-28889-0/minicluster-data/ts-1-root/instance:
uuid: "0ec6a5d1452a41bd992a8c7922473b35"
format_stamp: "Formatted at 2026-07-09 13:12:06 on dist-test-slave-vpdx"
I20260709 13:12:06.704819 28889 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:12:06.708338  2160 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:06.709031 28889 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:12:06.709285 28889 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602558744475-28889-0/minicluster-data/ts-1-root
uuid: "0ec6a5d1452a41bd992a8c7922473b35"
format_stamp: "Formatted at 2026-07-09 13:12:06 on dist-test-slave-vpdx"
I20260709 13:12:06.709549 28889 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602558744475-28889-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602558744475-28889-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602558744475-28889-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:06.721519 28889 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:06.722718 28889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:06.724139 28889 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:06.726349 28889 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:06.726554 28889 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:06.726765 28889 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:06.726909 28889 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:06.766575 28889 rpc_server.cc:307] RPC server started. Bound to: 127.28.54.66:38859
I20260709 13:12:06.766680  2222 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.54.66:38859 every 8 connection(s)
I20260709 13:12:06.771355 28889 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:06.778600  2226 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:06.780195  2227 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:06.781561  2229 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:06.783368  2223 heartbeater.cc:344] Connected to a master server at 127.28.54.126:35419
I20260709 13:12:06.783702  2223 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:06.784399  2223 heartbeater.cc:507] Master 127.28.54.126:35419 requested a full tablet report, sending...
I20260709 13:12:06.786208  2021 ts_manager.cc:194] Registered new tserver with Master: 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:06.787529  2021 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50236
I20260709 13:12:06.788302 28889 server_base.cc:1061] running on GCE node
I20260709 13:12:06.789330 28889 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:06.789605 28889 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:06.789829 28889 hybrid_clock.cc:648] HybridClock initialized: now 1783602726789811 us; error 0 us; skew 500 ppm
I20260709 13:12:06.790350 28889 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:06.792552 28889 webserver.cc:533] Webserver started at http://127.28.54.67:33795/ using document root <none> and password file <none>
I20260709 13:12:06.792955 28889 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:06.793105 28889 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:06.793303 28889 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:06.794440 28889 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602558744475-28889-0/minicluster-data/ts-2-root/instance:
uuid: "79b6e57d59e4468ebe4423d871a31b39"
format_stamp: "Formatted at 2026-07-09 13:12:06 on dist-test-slave-vpdx"
I20260709 13:12:06.798658 28889 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:12:06.801697  2234 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:06.802431 28889 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:12:06.802697 28889 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602558744475-28889-0/minicluster-data/ts-2-root
uuid: "79b6e57d59e4468ebe4423d871a31b39"
format_stamp: "Formatted at 2026-07-09 13:12:06 on dist-test-slave-vpdx"
I20260709 13:12:06.802949 28889 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602558744475-28889-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602558744475-28889-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602558744475-28889-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:06.836313 28889 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:06.837482 28889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:06.838927 28889 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:06.840993 28889 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:06.841187 28889 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:06.841434 28889 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:06.841631 28889 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:06.879602 28889 rpc_server.cc:307] RPC server started. Bound to: 127.28.54.67:34303
I20260709 13:12:06.879694  2296 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.54.67:34303 every 8 connection(s)
I20260709 13:12:06.884167 28889 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:06.891536  2300 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:06.893594  2301 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:06.894491  2303 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:06.895952 28889 server_base.cc:1061] running on GCE node
I20260709 13:12:06.896822  2297 heartbeater.cc:344] Connected to a master server at 127.28.54.126:35419
I20260709 13:12:06.896864 28889 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:06.897346 28889 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:06.897370  2297 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:06.897568 28889 hybrid_clock.cc:648] HybridClock initialized: now 1783602726897552 us; error 0 us; skew 500 ppm
I20260709 13:12:06.898303 28889 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:06.898299  2297 heartbeater.cc:507] Master 127.28.54.126:35419 requested a full tablet report, sending...
I20260709 13:12:06.900640  2021 ts_manager.cc:194] Registered new tserver with Master: 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:06.900995 28889 webserver.cc:533] Webserver started at http://127.28.54.68:39769/ using document root <none> and password file <none>
I20260709 13:12:06.901595 28889 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:06.901862 28889 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:06.902163 28889 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:06.902451  2021 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50244
I20260709 13:12:06.903749 28889 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602558744475-28889-0/minicluster-data/ts-3-root/instance:
uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
format_stamp: "Formatted at 2026-07-09 13:12:06 on dist-test-slave-vpdx"
I20260709 13:12:06.908200 28889 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:12:06.911471  2308 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:06.912226 28889 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:12:06.912490 28889 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602558744475-28889-0/minicluster-data/ts-3-root
uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
format_stamp: "Formatted at 2026-07-09 13:12:06 on dist-test-slave-vpdx"
I20260709 13:12:06.912750 28889 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602558744475-28889-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602558744475-28889-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602558744475-28889-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:06.942600 28889 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:06.943825 28889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:06.945214 28889 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:06.947311 28889 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:06.947513 28889 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:06.947723 28889 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:06.947871 28889 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:06.993376 28889 rpc_server.cc:307] RPC server started. Bound to: 127.28.54.68:38869
I20260709 13:12:06.993898  2370 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.54.68:38869 every 8 connection(s)
I20260709 13:12:07.007496  2371 heartbeater.cc:344] Connected to a master server at 127.28.54.126:35419
I20260709 13:12:07.007918  2371 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:07.008682  2371 heartbeater.cc:507] Master 127.28.54.126:35419 requested a full tablet report, sending...
I20260709 13:12:07.010542  2021 ts_manager.cc:194] Registered new tserver with Master: 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:07.010735 28889 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.013493614s
I20260709 13:12:07.012060  2021 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:45096
I20260709 13:12:07.038476  2021 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:45100:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 13:12:07.264261  2113 tablet_service.cc:1511] Processing CreateTablet for tablet 56bba8336a054d969e18859a84f180d6 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:12:07.265733  2113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56bba8336a054d969e18859a84f180d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.267437  2112 tablet_service.cc:1511] Processing CreateTablet for tablet 67db2f978ea64fbd9a32274d4ad374c9 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:12:07.268772  2112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67db2f978ea64fbd9a32274d4ad374c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.274673  2188 tablet_service.cc:1511] Processing CreateTablet for tablet 67db2f978ea64fbd9a32274d4ad374c9 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:12:07.276057  2188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67db2f978ea64fbd9a32274d4ad374c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.278914  2187 tablet_service.cc:1511] Processing CreateTablet for tablet 93d627aa01fd4aefbbae482eb2fb2453 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:12:07.279465  2111 tablet_service.cc:1511] Processing CreateTablet for tablet 93d627aa01fd4aefbbae482eb2fb2453 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:12:07.280779  2111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93d627aa01fd4aefbbae482eb2fb2453. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.280695  2186 tablet_service.cc:1511] Processing CreateTablet for tablet 7e716da7cd3d4ad390e049dc845b8004 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:12:07.282084  2186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e716da7cd3d4ad390e049dc845b8004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.284217  2185 tablet_service.cc:1511] Processing CreateTablet for tablet 4edf26b74c5d4e5d9a33d2b1fc1bb0ae (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:12:07.285504  2185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4edf26b74c5d4e5d9a33d2b1fc1bb0ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.286892  2184 tablet_service.cc:1511] Processing CreateTablet for tablet d7a50365dcc843f4a4f6bfb29a736f26 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:12:07.291793  2182 tablet_service.cc:1511] Processing CreateTablet for tablet e259bf23e7904d9fb8b2345bb5b667f3 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:12:07.292500  2180 tablet_service.cc:1511] Processing CreateTablet for tablet f3f0f1b0143c4363a9b900eae4ac3ea9 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:12:07.292596  2183 tablet_service.cc:1511] Processing CreateTablet for tablet 2993800f8e7e4c09bfe0b2be13e4394c (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:12:07.294273  2183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2993800f8e7e4c09bfe0b2be13e4394c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.294179  2181 tablet_service.cc:1511] Processing CreateTablet for tablet 765b8df93039426e925b94637a061cc2 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:12:07.295540  2181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 765b8df93039426e925b94637a061cc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.297151  2187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93d627aa01fd4aefbbae482eb2fb2453. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.298162  2180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3f0f1b0143c4363a9b900eae4ac3ea9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.299847  2335 tablet_service.cc:1511] Processing CreateTablet for tablet 93d627aa01fd4aefbbae482eb2fb2453 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 13:12:07.302455  2336 tablet_service.cc:1511] Processing CreateTablet for tablet 56bba8336a054d969e18859a84f180d6 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:12:07.303458  2334 tablet_service.cc:1511] Processing CreateTablet for tablet 7e716da7cd3d4ad390e049dc845b8004 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:12:07.304704  2335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 93d627aa01fd4aefbbae482eb2fb2453. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.305294  2334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e716da7cd3d4ad390e049dc845b8004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.307644  2179 tablet_service.cc:1511] Processing CreateTablet for tablet 8a0fb3f7bf85419cbf7ecda4727ccb89 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:12:07.310683  2336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56bba8336a054d969e18859a84f180d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.310417  2111 tablet_service.cc:1511] Processing CreateTablet for tablet 4edf26b74c5d4e5d9a33d2b1fc1bb0ae (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:12:07.313126  2184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7a50365dcc843f4a4f6bfb29a736f26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.313468  2333 tablet_service.cc:1511] Processing CreateTablet for tablet d7a50365dcc843f4a4f6bfb29a736f26 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:12:07.314846  2333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7a50365dcc843f4a4f6bfb29a736f26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.317198  2179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a0fb3f7bf85419cbf7ecda4727ccb89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.319015  2182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e259bf23e7904d9fb8b2345bb5b667f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.327715  2110 tablet_service.cc:1511] Processing CreateTablet for tablet d7a50365dcc843f4a4f6bfb29a736f26 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 13:12:07.329107  2110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7a50365dcc843f4a4f6bfb29a736f26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.342145  2111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4edf26b74c5d4e5d9a33d2b1fc1bb0ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.347903  2332 tablet_service.cc:1511] Processing CreateTablet for tablet a0394490f6984f028daa10be921e242b (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:12:07.349309  2332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0394490f6984f028daa10be921e242b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.363654  2109 tablet_service.cc:1511] Processing CreateTablet for tablet a0394490f6984f028daa10be921e242b (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:12:07.365036  2109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0394490f6984f028daa10be921e242b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.375952  2331 tablet_service.cc:1511] Processing CreateTablet for tablet 2993800f8e7e4c09bfe0b2be13e4394c (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:12:07.377345  2331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2993800f8e7e4c09bfe0b2be13e4394c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.378711  2391 tablet_bootstrap.cc:492] T 56bba8336a054d969e18859a84f180d6 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:07.383978  2108 tablet_service.cc:1511] Processing CreateTablet for tablet e259bf23e7904d9fb8b2345bb5b667f3 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:12:07.385383  2108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e259bf23e7904d9fb8b2345bb5b667f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.397591  2186 tablet_service.cc:1511] Processing CreateTablet for tablet d3370eb67fff4896b1f8e3ce56eceb9b (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:12:07.404821  2113 tablet_service.cc:1511] Processing CreateTablet for tablet 765b8df93039426e925b94637a061cc2 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:12:07.400133  2188 tablet_service.cc:1511] Processing CreateTablet for tablet 01a3c95e54104a998cdf16d06db2800a (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:12:07.402303  2330 tablet_service.cc:1511] Processing CreateTablet for tablet 765b8df93039426e925b94637a061cc2 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 13:12:07.406229  2113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 765b8df93039426e925b94637a061cc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.405458  2186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3370eb67fff4896b1f8e3ce56eceb9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.410786  2330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 765b8df93039426e925b94637a061cc2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.420009  2391 tablet_bootstrap.cc:654] T 56bba8336a054d969e18859a84f180d6 P 2ac5c5682f914ed9b9982b5a080d5472: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.428382  2181 tablet_service.cc:1511] Processing CreateTablet for tablet 8a672ef15abf47e4b650405c29044d3e (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:12:07.429448  2188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01a3c95e54104a998cdf16d06db2800a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.407661  2107 tablet_service.cc:1511] Processing CreateTablet for tablet 2e178ff57d964223aca095ceff76b339 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:12:07.433473  2107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e178ff57d964223aca095ceff76b339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.405798  2329 tablet_service.cc:1511] Processing CreateTablet for tablet 2e178ff57d964223aca095ceff76b339 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:12:07.434212  2112 tablet_service.cc:1511] Processing CreateTablet for tablet 8a0fb3f7bf85419cbf7ecda4727ccb89 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:12:07.409708  2328 tablet_service.cc:1511] Processing CreateTablet for tablet f3f0f1b0143c4363a9b900eae4ac3ea9 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:12:07.438019  2106 tablet_service.cc:1511] Processing CreateTablet for tablet d3370eb67fff4896b1f8e3ce56eceb9b (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:12:07.438748  2329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e178ff57d964223aca095ceff76b339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.407527  2187 tablet_service.cc:1511] Processing CreateTablet for tablet cc02522cf9704f58a9d2bfd5326e3625 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:12:07.441725  2327 tablet_service.cc:1511] Processing CreateTablet for tablet 7475d672f7b3489393d6202c8b31e47f (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:12:07.442484  2184 tablet_service.cc:1511] Processing CreateTablet for tablet 12b5593f051548fea374da76afa08c3f (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:12:07.443096  2105 tablet_service.cc:1511] Processing CreateTablet for tablet 7475d672f7b3489393d6202c8b31e47f (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:12:07.444836  2185 tablet_service.cc:1511] Processing CreateTablet for tablet 5aac56f958fb4fe29fe46d2a9be60ffd (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:12:07.445863  2106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3370eb67fff4896b1f8e3ce56eceb9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.446352  2327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7475d672f7b3489393d6202c8b31e47f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.446481  2105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7475d672f7b3489393d6202c8b31e47f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.448307  2112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a0fb3f7bf85419cbf7ecda4727ccb89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.450908  2179 tablet_service.cc:1511] Processing CreateTablet for tablet 1478f883c539464bb54fe9bff44148d5 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:12:07.453387  2328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3f0f1b0143c4363a9b900eae4ac3ea9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.425371  2183 tablet_service.cc:1511] Processing CreateTablet for tablet b3b82132c31545aab274c7cf3f77c277 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:12:07.470502  2393 tablet_bootstrap.cc:492] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 0ec6a5d1452a41bd992a8c7922473b35: Bootstrap starting.
I20260709 13:12:07.478791  2104 tablet_service.cc:1511] Processing CreateTablet for tablet cc02522cf9704f58a9d2bfd5326e3625 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:12:07.480242  2104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc02522cf9704f58a9d2bfd5326e3625. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.479192  2334 tablet_service.cc:1511] Processing CreateTablet for tablet 01a3c95e54104a998cdf16d06db2800a (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:12:07.482029  2334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01a3c95e54104a998cdf16d06db2800a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.482759  2333 tablet_service.cc:1511] Processing CreateTablet for tablet b3b82132c31545aab274c7cf3f77c277 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:12:07.494660  2336 tablet_service.cc:1511] Processing CreateTablet for tablet d3370eb67fff4896b1f8e3ce56eceb9b (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 13:12:07.498842  2182 tablet_service.cc:1511] Processing CreateTablet for tablet 5c3646d79bc840e9b4396f4351d1803d (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:12:07.504136  2109 tablet_service.cc:1511] Processing CreateTablet for tablet 0668be6a554b4c5f8bf93d0588a6bfcc (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:12:07.505466  2109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0668be6a554b4c5f8bf93d0588a6bfcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.507709  2187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc02522cf9704f58a9d2bfd5326e3625. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.508074  2110 tablet_service.cc:1511] Processing CreateTablet for tablet b3b82132c31545aab274c7cf3f77c277 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 13:12:07.509186  2179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1478f883c539464bb54fe9bff44148d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.510195  2392 tablet_bootstrap.cc:492] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Bootstrap starting.
I20260709 13:12:07.511775  2182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c3646d79bc840e9b4396f4351d1803d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.512351  2108 tablet_service.cc:1511] Processing CreateTablet for tablet 5c3646d79bc840e9b4396f4351d1803d (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:12:07.509239  2110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3b82132c31545aab274c7cf3f77c277. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.515187  2108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c3646d79bc840e9b4396f4351d1803d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.516335  2391 tablet_bootstrap.cc:492] T 56bba8336a054d969e18859a84f180d6 P 2ac5c5682f914ed9b9982b5a080d5472: No bootstrap required, opened a new log
I20260709 13:12:07.516505  2180 tablet_service.cc:1511] Processing CreateTablet for tablet bc42d18a324e4f6d97f07cf770c5daa8 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:12:07.517917  2113 tablet_service.cc:1511] Processing CreateTablet for tablet 12b5593f051548fea374da76afa08c3f (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:12:07.514387  2184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12b5593f051548fea374da76afa08c3f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 13:12:07.520998  2069 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:07.513770  2335 tablet_service.cc:1511] Processing CreateTablet for tablet 8a672ef15abf47e4b650405c29044d3e (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:12:07.522830  2332 tablet_service.cc:1511] Processing CreateTablet for tablet 0668be6a554b4c5f8bf93d0588a6bfcc (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:12:07.523293  2105 tablet_service.cc:1511] Processing CreateTablet for tablet 427b10072083419c89d5a4bf5d6413fc (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:12:07.524820  2331 tablet_service.cc:1511] Processing CreateTablet for tablet 12b5593f051548fea374da76afa08c3f (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 13:12:07.522722  2336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3370eb67fff4896b1f8e3ce56eceb9b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.527683  2391 ts_tablet_manager.cc:1403] T 56bba8336a054d969e18859a84f180d6 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.149s	user 0.009s	sys 0.003s
I20260709 13:12:07.550376  2335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a672ef15abf47e4b650405c29044d3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.532848  2185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aac56f958fb4fe29fe46d2a9be60ffd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.552805  2106 tablet_service.cc:1511] Processing CreateTablet for tablet bc42d18a324e4f6d97f07cf770c5daa8 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:12:07.558256  2331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12b5593f051548fea374da76afa08c3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.561435  2392 tablet_bootstrap.cc:654] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.562180  2333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3b82132c31545aab274c7cf3f77c277. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.566839  2187 tablet_service.cc:1511] Processing CreateTablet for tablet bdee3fd7553a47afae3ec9dbdce6d829 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:12:07.568087  2187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdee3fd7553a47afae3ec9dbdce6d829. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.572314  2393 tablet_bootstrap.cc:654] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 0ec6a5d1452a41bd992a8c7922473b35: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:07.545406  2113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12b5593f051548fea374da76afa08c3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.546291  2111 tablet_service.cc:1511] Processing CreateTablet for tablet 1478f883c539464bb54fe9bff44148d5 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:12:07.572876  2181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a672ef15abf47e4b650405c29044d3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.603117  2111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1478f883c539464bb54fe9bff44148d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.603706  2183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3b82132c31545aab274c7cf3f77c277. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.601611  2328 tablet_service.cc:1511] Processing CreateTablet for tablet bc42d18a324e4f6d97f07cf770c5daa8 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 13:12:07.574014  2104 tablet_service.cc:1511] Processing CreateTablet for tablet 86834d94d1d64596abfa609754b5d58a (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:12:07.575569  2334 tablet_service.cc:1511] Processing CreateTablet for tablet 5aac56f958fb4fe29fe46d2a9be60ffd (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:12:07.577004  2109 tablet_service.cc:1511] Processing CreateTablet for tablet 36b22aafe7104cec82607dab40b4aed8 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:12:07.579850  2329 tablet_service.cc:1511] Processing CreateTablet for tablet 86834d94d1d64596abfa609754b5d58a (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:12:07.592979  2187 tablet_service.cc:1511] Processing CreateTablet for tablet 36b22aafe7104cec82607dab40b4aed8 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:12:07.566900  2391 raft_consensus.cc:359] T 56bba8336a054d969e18859a84f180d6 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:07.600737  2112 tablet_service.cc:1511] Processing CreateTablet for tablet 0bd8fc2d57c14adeaeae16583eef7c84 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:12:07.620697  2391 raft_consensus.cc:385] T 56bba8336a054d969e18859a84f180d6 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.573639  2332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0668be6a554b4c5f8bf93d0588a6bfcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.606283  2105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 427b10072083419c89d5a4bf5d6413fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.623685  2104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86834d94d1d64596abfa609754b5d58a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.606746  2180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc42d18a324e4f6d97f07cf770c5daa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.622999  2327 tablet_service.cc:1511] Processing CreateTablet for tablet 8b65903ab966485c9c65bdfbdf1e1054 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:12:07.606451  2335 tablet_service.cc:1511] Processing CreateTablet for tablet 36b22aafe7104cec82607dab40b4aed8 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 13:12:07.629659  2106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc42d18a324e4f6d97f07cf770c5daa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.618721  2336 tablet_service.cc:1511] Processing CreateTablet for tablet bdee3fd7553a47afae3ec9dbdce6d829 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:12:07.540465  2330 tablet_service.cc:1511] Processing CreateTablet for tablet 427b10072083419c89d5a4bf5d6413fc (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:12:07.622943  2334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aac56f958fb4fe29fe46d2a9be60ffd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.589486  2186 tablet_service.cc:1511] Processing CreateTablet for tablet 0bd8fc2d57c14adeaeae16583eef7c84 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:12:07.647138  2392 tablet_bootstrap.cc:492] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea: No bootstrap required, opened a new log
I20260709 13:12:07.647301  2109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36b22aafe7104cec82607dab40b4aed8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.650039  2329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86834d94d1d64596abfa609754b5d58a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.650589  2112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bd8fc2d57c14adeaeae16583eef7c84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.651196  2392 ts_tablet_manager.cc:1403] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent bootstrapping tablet: real 0.141s	user 0.004s	sys 0.009s
I20260709 13:12:07.614063  2331 tablet_service.cc:1511] Processing CreateTablet for tablet 28f2272230d34efa880d5eeed8859669 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:12:07.653828  2331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28f2272230d34efa880d5eeed8859669. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.650712  2188 tablet_service.cc:1511] Processing CreateTablet for tablet 8b65903ab966485c9c65bdfbdf1e1054 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:12:07.630028  2187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36b22aafe7104cec82607dab40b4aed8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.658048  2335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36b22aafe7104cec82607dab40b4aed8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.658288  2186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bd8fc2d57c14adeaeae16583eef7c84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.622421  2391 raft_consensus.cc:740] T 56bba8336a054d969e18859a84f180d6 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.663439  2185 tablet_service.cc:1511] Processing CreateTablet for tablet f2a1307186df4616a9759118c2e456a6 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:12:07.664657  2185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2a1307186df4616a9759118c2e456a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.666052  2328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc42d18a324e4f6d97f07cf770c5daa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.666666  2184 tablet_service.cc:1511] Processing CreateTablet for tablet ee1baa7401cd48e48e7125dcd607f44f (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:12:07.667879  2184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee1baa7401cd48e48e7125dcd607f44f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.670055  2327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b65903ab966485c9c65bdfbdf1e1054. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.649695  2108 tablet_service.cc:1511] Processing CreateTablet for tablet ddf48e4f6be64627a0ed06d6198ca054 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:12:07.671113  2108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddf48e4f6be64627a0ed06d6198ca054. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.643893  2182 tablet_service.cc:1511] Processing CreateTablet for tablet ddf48e4f6be64627a0ed06d6198ca054 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:12:07.673992  2336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdee3fd7553a47afae3ec9dbdce6d829. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.603111  2107 tablet_service.cc:1511] Processing CreateTablet for tablet 28f2272230d34efa880d5eeed8859669 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:12:07.675316  2107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28f2272230d34efa880d5eeed8859669. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.674521  2182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddf48e4f6be64627a0ed06d6198ca054. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.679433  2110 tablet_service.cc:1511] Processing CreateTablet for tablet 78734884e0a441759b51d258ad2697aa (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:12:07.680649  2110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78734884e0a441759b51d258ad2697aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.680289  2391 consensus_queue.cc:260] T 56bba8336a054d969e18859a84f180d6 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:07.681919  2179 tablet_service.cc:1511] Processing CreateTablet for tablet 7e3782f3d54b4a19bacbd125c31127a9 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:12:07.681939  2188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b65903ab966485c9c65bdfbdf1e1054. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.674500  2392 raft_consensus.cc:359] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:07.686782  2392 raft_consensus.cc:385] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.687101  2392 raft_consensus.cc:740] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.688017  2392 consensus_queue.cc:260] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:07.689098  2330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 427b10072083419c89d5a4bf5d6413fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.689689  2111 tablet_service.cc:1511] Processing CreateTablet for tablet ee1baa7401cd48e48e7125dcd607f44f (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:12:07.691038  2111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee1baa7401cd48e48e7125dcd607f44f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.701300  2148 heartbeater.cc:499] Master 127.28.54.126:35419 was elected leader, sending a full tablet report...
I20260709 13:12:07.691112  2393 tablet_bootstrap.cc:492] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 0ec6a5d1452a41bd992a8c7922473b35: No bootstrap required, opened a new log
I20260709 13:12:07.702170  2393 ts_tablet_manager.cc:1403] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent bootstrapping tablet: real 0.232s	user 0.011s	sys 0.006s
I20260709 13:12:07.705209  2393 raft_consensus.cc:359] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:07.705901  2393 raft_consensus.cc:385] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:07.706177  2393 raft_consensus.cc:740] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Initialized, Role: FOLLOWER
I20260709 13:12:07.706921  2393 consensus_queue.cc:260] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:07.697669  2181 tablet_service.cc:1511] Processing CreateTablet for tablet a4a5ce298d24406ea94fb68aba5b37ae (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:12:07.730851  2179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e3782f3d54b4a19bacbd125c31127a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.734712  2104 tablet_service.cc:1511] Processing CreateTablet for tablet 7e3782f3d54b4a19bacbd125c31127a9 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:12:07.736089  2104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e3782f3d54b4a19bacbd125c31127a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.740284  2333 tablet_service.cc:1511] Processing CreateTablet for tablet ee1baa7401cd48e48e7125dcd607f44f (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 13:12:07.741505  2333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ee1baa7401cd48e48e7125dcd607f44f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.746881  2262 tablet_service.cc:1511] Processing CreateTablet for tablet 56bba8336a054d969e18859a84f180d6 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 13:12:07.748169  2262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56bba8336a054d969e18859a84f180d6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.750914  2260 tablet_service.cc:1511] Processing CreateTablet for tablet 7e716da7cd3d4ad390e049dc845b8004 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 13:12:07.752202  2260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e716da7cd3d4ad390e049dc845b8004. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.754884  2259 tablet_service.cc:1511] Processing CreateTablet for tablet 4edf26b74c5d4e5d9a33d2b1fc1bb0ae (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 13:12:07.756182  2259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4edf26b74c5d4e5d9a33d2b1fc1bb0ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.758884  2258 tablet_service.cc:1511] Processing CreateTablet for tablet a0394490f6984f028daa10be921e242b (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 13:12:07.760186  2258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0394490f6984f028daa10be921e242b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.762749  2113 tablet_service.cc:1511] Processing CreateTablet for tablet a4a5ce298d24406ea94fb68aba5b37ae (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:12:07.749569  2261 tablet_service.cc:1511] Processing CreateTablet for tablet 67db2f978ea64fbd9a32274d4ad374c9 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 13:12:07.763948  2113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4a5ce298d24406ea94fb68aba5b37ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.764205  2261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 67db2f978ea64fbd9a32274d4ad374c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.762869  2257 tablet_service.cc:1511] Processing CreateTablet for tablet 2993800f8e7e4c09bfe0b2be13e4394c (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 13:12:07.766848  2257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2993800f8e7e4c09bfe0b2be13e4394c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.768827  2183 tablet_service.cc:1511] Processing CreateTablet for tablet d2f88787abb54ffea037f35cf48b22c4 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:12:07.771533  2183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2f88787abb54ffea037f35cf48b22c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.759299  2187 tablet_service.cc:1511] Processing CreateTablet for tablet e5bbfa12bce4430fa6e7e6abd281ded6 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:12:07.775087  2187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5bbfa12bce4430fa6e7e6abd281ded6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.775642  2256 tablet_service.cc:1511] Processing CreateTablet for tablet e259bf23e7904d9fb8b2345bb5b667f3 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 13:12:07.776952  2256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e259bf23e7904d9fb8b2345bb5b667f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.778895  2255 tablet_service.cc:1511] Processing CreateTablet for tablet 2e178ff57d964223aca095ceff76b339 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 13:12:07.781459  2254 tablet_service.cc:1511] Processing CreateTablet for tablet f3f0f1b0143c4363a9b900eae4ac3ea9 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 13:12:07.783996  2253 tablet_service.cc:1511] Processing CreateTablet for tablet 8a0fb3f7bf85419cbf7ecda4727ccb89 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 13:12:07.790213  2223 heartbeater.cc:499] Master 127.28.54.126:35419 was elected leader, sending a full tablet report...
I20260709 13:12:07.792512  2104 tablet_service.cc:1511] Processing CreateTablet for tablet d2f88787abb54ffea037f35cf48b22c4 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:12:07.793920  2104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2f88787abb54ffea037f35cf48b22c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.815785  2188 tablet_service.cc:1511] Processing CreateTablet for tablet dc33c7c3cfd14ab7a99e39cfd971fc3c (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:12:07.816083  2334 tablet_service.cc:1511] Processing CreateTablet for tablet f2a1307186df4616a9759118c2e456a6 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:12:07.823467  2188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc33c7c3cfd14ab7a99e39cfd971fc3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.824465  2105 tablet_service.cc:1511] Processing CreateTablet for tablet b206de895e36490688cb2c1c537774a5 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:12:07.823952  2187 tablet_service.cc:1511] Processing CreateTablet for tablet f9934bcaed6743b2a30104e13b8cf18b (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:12:07.831709  2187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9934bcaed6743b2a30104e13b8cf18b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.861927  2327 tablet_service.cc:1511] Processing CreateTablet for tablet dc33c7c3cfd14ab7a99e39cfd971fc3c (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:12:07.842270  2331 tablet_service.cc:1511] Processing CreateTablet for tablet 78734884e0a441759b51d258ad2697aa (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:12:07.825747  2105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b206de895e36490688cb2c1c537774a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.874927  2371 heartbeater.cc:499] Master 127.28.54.126:35419 was elected leader, sending a full tablet report...
I20260709 13:12:07.875752  2401 raft_consensus.cc:493] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.908456  2397 raft_consensus.cc:493] T 56bba8336a054d969e18859a84f180d6 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.913976  2253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a0fb3f7bf85419cbf7ecda4727ccb89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.916780  2179 tablet_service.cc:1511] Processing CreateTablet for tablet 38d5e9a8f42c4a2993d25a8a341fddbf (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:12:07.860567  2329 tablet_service.cc:1511] Processing CreateTablet for tablet e5bbfa12bce4430fa6e7e6abd281ded6 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:12:07.848832  2104 tablet_service.cc:1511] Processing CreateTablet for tablet dc33c7c3cfd14ab7a99e39cfd971fc3c (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 13:12:07.858922  2328 tablet_service.cc:1511] Processing CreateTablet for tablet b206de895e36490688cb2c1c537774a5 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:12:07.856408  2109 tablet_service.cc:1511] Processing CreateTablet for tablet a9be6d55d1f348bcaf96405abc80244d (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:12:07.919325  2106 tablet_service.cc:1511] Processing CreateTablet for tablet 10de08c2346d47dbbd720596cd7e02fd (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:12:07.920074  2107 tablet_service.cc:1511] Processing CreateTablet for tablet 6bf4f728eedf41bdb027f554c3a5ae1f (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:12:07.920524  2185 tablet_service.cc:1511] Processing CreateTablet for tablet 10de08c2346d47dbbd720596cd7e02fd (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:12:07.902858  2181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4a5ce298d24406ea94fb68aba5b37ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.845603  2261 tablet_service.cc:1511] Processing CreateTablet for tablet 7475d672f7b3489393d6202c8b31e47f (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 13:12:07.923831  2334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2a1307186df4616a9759118c2e456a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.918344  2297 heartbeater.cc:499] Master 127.28.54.126:35419 was elected leader, sending a full tablet report...
I20260709 13:12:07.859141  2112 tablet_service.cc:1511] Processing CreateTablet for tablet d0d102459578474fbe77af94f3986a84 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:12:07.856415  2332 tablet_service.cc:1511] Processing CreateTablet for tablet a4a5ce298d24406ea94fb68aba5b37ae (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 13:12:07.845187  2186 tablet_service.cc:1511] Processing CreateTablet for tablet d0d102459578474fbe77af94f3986a84 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 13:12:07.922844  2397 raft_consensus.cc:515] T 56bba8336a054d969e18859a84f180d6 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:07.925788  2401 raft_consensus.cc:515] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:07.947772  2254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f3f0f1b0143c4363a9b900eae4ac3ea9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.950546  2401 leader_election.cc:290] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:07.951931  2255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e178ff57d964223aca095ceff76b339. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.953297  2392 ts_tablet_manager.cc:1434] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent starting tablet: real 0.302s	user 0.013s	sys 0.010s
I20260709 13:12:07.965672  2113 tablet_service.cc:1511] Processing CreateTablet for tablet 622b6cfd76ff495ea6692a1ec0faefc4 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:12:07.970402  2392 tablet_bootstrap.cc:492] T 56bba8336a054d969e18859a84f180d6 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Bootstrap starting.
I20260709 13:12:07.971657  2188 tablet_service.cc:1511] Processing CreateTablet for tablet a332070dcdff450b939e74ef5b68425a (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:12:07.972548  2397 leader_election.cc:290] T 56bba8336a054d969e18859a84f180d6 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:07.950170  2336 tablet_service.cc:1511] Processing CreateTablet for tablet a9be6d55d1f348bcaf96405abc80244d (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:12:07.972843  2329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5bbfa12bce4430fa6e7e6abd281ded6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.979661  2108 tablet_service.cc:1511] Processing CreateTablet for tablet 1588358a9e7542dfbd8b5d2f65212aec (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:12:07.979962  2330 tablet_service.cc:1511] Processing CreateTablet for tablet f9934bcaed6743b2a30104e13b8cf18b (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:12:07.980297  2257 tablet_service.cc:1511] Processing CreateTablet for tablet cc02522cf9704f58a9d2bfd5326e3625 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 13:12:07.988605  2111 tablet_service.cc:1511] Processing CreateTablet for tablet a332070dcdff450b939e74ef5b68425a (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:12:07.992290  2393 ts_tablet_manager.cc:1434] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent starting tablet: real 0.290s	user 0.017s	sys 0.013s
I20260709 13:12:07.995848  2399 raft_consensus.cc:493] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:07.974152  2104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc33c7c3cfd14ab7a99e39cfd971fc3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.984856  2179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38d5e9a8f42c4a2993d25a8a341fddbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:07.934432  2184 tablet_service.cc:1511] Processing CreateTablet for tablet 622b6cfd76ff495ea6692a1ec0faefc4 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
W20260709 13:12:08.014403  2372 tablet.cc:2406] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:12:08.013289  2399 raft_consensus.cc:515] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:08.030134  2335 tablet_service.cc:1511] Processing CreateTablet for tablet 10de08c2346d47dbbd720596cd7e02fd (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 13:12:08.030921  2399 leader_election.cc:290] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:08.004369  2391 ts_tablet_manager.cc:1434] T 56bba8336a054d969e18859a84f180d6 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.454s	user 0.030s	sys 0.032s
I20260709 13:12:08.019083  2257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc02522cf9704f58a9d2bfd5326e3625. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.019405  2331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78734884e0a441759b51d258ad2697aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.019130  2262 tablet_service.cc:1511] Processing CreateTablet for tablet 01a3c95e54104a998cdf16d06db2800a (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 13:12:08.028167  2258 tablet_service.cc:1511] Processing CreateTablet for tablet 0668be6a554b4c5f8bf93d0588a6bfcc (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 13:12:08.055792  2402 tablet_bootstrap.cc:492] T 56bba8336a054d969e18859a84f180d6 P 79b6e57d59e4468ebe4423d871a31b39: Bootstrap starting.
I20260709 13:12:08.060048  2111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a332070dcdff450b939e74ef5b68425a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.061657  2391 tablet_bootstrap.cc:492] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:08.064285  2328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b206de895e36490688cb2c1c537774a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.060065  2185 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10de08c2346d47dbbd720596cd7e02fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.067114  2180 tablet_service.cc:1511] Processing CreateTablet for tablet e1ad60fa3bce47daac74b01143b54132 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:12:08.068347  2180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1ad60fa3bce47daac74b01143b54132. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.070117  2186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0d102459578474fbe77af94f3986a84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.070744  2112 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0d102459578474fbe77af94f3986a84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.071573  2393 tablet_bootstrap.cc:492] T 7e716da7cd3d4ad390e049dc845b8004 P 0ec6a5d1452a41bd992a8c7922473b35: Bootstrap starting.
I20260709 13:12:08.072701  2107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bf4f728eedf41bdb027f554c3a5ae1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.074139  2188 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a332070dcdff450b939e74ef5b68425a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.074936  2183 tablet_service.cc:1511] Processing CreateTablet for tablet d4e943e5bbd7402da6bcc00db70cec14 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:12:08.075902  2109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9be6d55d1f348bcaf96405abc80244d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.076198  2183 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4e943e5bbd7402da6bcc00db70cec14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.077612  2184 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 622b6cfd76ff495ea6692a1ec0faefc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.079202  2108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1588358a9e7542dfbd8b5d2f65212aec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.080209  2182 tablet_service.cc:1511] Processing CreateTablet for tablet 421302a9721e4cc9a86e52a183469a70 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:12:08.081415  2182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 421302a9721e4cc9a86e52a183469a70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.082207  2106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10de08c2346d47dbbd720596cd7e02fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.083817  2332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4a5ce298d24406ea94fb68aba5b37ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.085098  2258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0668be6a554b4c5f8bf93d0588a6bfcc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.085548  2327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dc33c7c3cfd14ab7a99e39cfd971fc3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.086220  2260 tablet_service.cc:1511] Processing CreateTablet for tablet 8a672ef15abf47e4b650405c29044d3e (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 13:12:08.087105  2113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 622b6cfd76ff495ea6692a1ec0faefc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.087481  2260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a672ef15abf47e4b650405c29044d3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.089381  2261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7475d672f7b3489393d6202c8b31e47f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.091735  2262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01a3c95e54104a998cdf16d06db2800a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.086241  2335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 10de08c2346d47dbbd720596cd7e02fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.094790  2330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9934bcaed6743b2a30104e13b8cf18b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.100399  2336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9be6d55d1f348bcaf96405abc80244d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.063959  2187 tablet_service.cc:1511] Processing CreateTablet for tablet bad0fdea1e3a409aab372c59eaa33767 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:12:08.102757  2187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bad0fdea1e3a409aab372c59eaa33767. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.140738  2392 tablet_bootstrap.cc:654] T 56bba8336a054d969e18859a84f180d6 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.144649  2402 tablet_bootstrap.cc:654] T 56bba8336a054d969e18859a84f180d6 P 79b6e57d59e4468ebe4423d871a31b39: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.168812  2198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d627aa01fd4aefbbae482eb2fb2453" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
W20260709 13:12:08.170720  2311 leader_election.cc:343] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:08.222158  2391 tablet_bootstrap.cc:654] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.177686  2393 tablet_bootstrap.cc:654] T 7e716da7cd3d4ad390e049dc845b8004 P 0ec6a5d1452a41bd992a8c7922473b35: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.236347  2123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d627aa01fd4aefbbae482eb2fb2453" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
W20260709 13:12:08.250759  2310 leader_election.cc:343] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:08.251248  2310 leader_election.cc:304] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:08.252370  2401 raft_consensus.cc:2749] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:08.270529  2256 tablet_service.cc:1511] Processing CreateTablet for tablet 427b10072083419c89d5a4bf5d6413fc (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 13:12:08.271780  2256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 427b10072083419c89d5a4bf5d6413fc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.278354  2334 tablet_service.cc:1511] Processing CreateTablet for tablet 6bf4f728eedf41bdb027f554c3a5ae1f (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:12:08.280361  2334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bf4f728eedf41bdb027f554c3a5ae1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.283994  2111 tablet_service.cc:1511] Processing CreateTablet for tablet 583390912c6d4daca2df9b5534fb8dca (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:12:08.284693  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56bba8336a054d969e18859a84f180d6" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:08.285269  2111 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 583390912c6d4daca2df9b5534fb8dca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.286437  2179 tablet_service.cc:1511] Processing CreateTablet for tablet d1ddcfd4d0914e40ae0a684fd8726d24 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:12:08.287582  2179 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1ddcfd4d0914e40ae0a684fd8726d24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.287884  2259 tablet_service.cc:1511] Processing CreateTablet for tablet 1478f883c539464bb54fe9bff44148d5 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 13:12:08.289206  2259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1478f883c539464bb54fe9bff44148d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.290313  2333 tablet_service.cc:1511] Processing CreateTablet for tablet df8d897471684531826528a5751d6246 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:12:08.291612  2333 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df8d897471684531826528a5751d6246. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.295157  2402 tablet_bootstrap.cc:492] T 56bba8336a054d969e18859a84f180d6 P 79b6e57d59e4468ebe4423d871a31b39: No bootstrap required, opened a new log
I20260709 13:12:08.295660  2402 ts_tablet_manager.cc:1403] T 56bba8336a054d969e18859a84f180d6 P 79b6e57d59e4468ebe4423d871a31b39: Time spent bootstrapping tablet: real 0.347s	user 0.013s	sys 0.000s
W20260709 13:12:08.295869  2087 leader_election.cc:343] T 56bba8336a054d969e18859a84f180d6 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:08.240206  2254 tablet_service.cc:1511] Processing CreateTablet for tablet 5c3646d79bc840e9b4396f4351d1803d (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 13:12:08.296651  2392 tablet_bootstrap.cc:492] T 56bba8336a054d969e18859a84f180d6 P 66e9a8fffd4b4e5a81ca4fa2762773ea: No bootstrap required, opened a new log
I20260709 13:12:08.307832  2392 ts_tablet_manager.cc:1403] T 56bba8336a054d969e18859a84f180d6 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent bootstrapping tablet: real 0.338s	user 0.023s	sys 0.005s
I20260709 13:12:08.312724  2392 raft_consensus.cc:359] T 56bba8336a054d969e18859a84f180d6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:08.312815  2113 tablet_service.cc:1511] Processing CreateTablet for tablet d4e943e5bbd7402da6bcc00db70cec14 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:12:08.314230  2113 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4e943e5bbd7402da6bcc00db70cec14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.313449  2392 raft_consensus.cc:385] T 56bba8336a054d969e18859a84f180d6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.318497  2392 raft_consensus.cc:740] T 56bba8336a054d969e18859a84f180d6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.319415  2392 consensus_queue.cc:260] T 56bba8336a054d969e18859a84f180d6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:08.320977  2253 tablet_service.cc:1511] Processing CreateTablet for tablet bdee3fd7553a47afae3ec9dbdce6d829 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 13:12:08.322239  2253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bdee3fd7553a47afae3ec9dbdce6d829. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.302742  2261 tablet_service.cc:1511] Processing CreateTablet for tablet 86834d94d1d64596abfa609754b5d58a (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 13:12:08.306425  2330 tablet_service.cc:1511] Processing CreateTablet for tablet a332070dcdff450b939e74ef5b68425a (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 13:12:08.323274  2392 ts_tablet_manager.cc:1434] T 56bba8336a054d969e18859a84f180d6 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 13:12:08.323585  2329 tablet_service.cc:1511] Processing CreateTablet for tablet 583390912c6d4daca2df9b5534fb8dca (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:12:08.300624  2402 raft_consensus.cc:359] T 56bba8336a054d969e18859a84f180d6 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:08.326682  2107 tablet_service.cc:1511] Processing CreateTablet for tablet e1ad60fa3bce47daac74b01143b54132 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:12:08.299741  2260 tablet_service.cc:1511] Processing CreateTablet for tablet 28f2272230d34efa880d5eeed8859669 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 13:12:08.339536  2109 tablet_service.cc:1511] Processing CreateTablet for tablet d1ddcfd4d0914e40ae0a684fd8726d24 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:12:08.269623  2255 tablet_service.cc:1511] Processing CreateTablet for tablet 5aac56f958fb4fe29fe46d2a9be60ffd (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 13:12:08.376261  2331 tablet_service.cc:1511] Processing CreateTablet for tablet d4e943e5bbd7402da6bcc00db70cec14 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 13:12:08.377171  2256 tablet_service.cc:1511] Processing CreateTablet for tablet 8b65903ab966485c9c65bdfbdf1e1054 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 13:12:08.326803  2182 tablet_service.cc:1511] Processing CreateTablet for tablet 46887c40373b4aca811c6382c97cb9bf (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:12:08.318426  2332 tablet_service.cc:1511] Processing CreateTablet for tablet 38d5e9a8f42c4a2993d25a8a341fddbf (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:12:08.348629  2110 tablet_service.cc:1511] Processing CreateTablet for tablet 46887c40373b4aca811c6382c97cb9bf (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:12:08.350572  2105 tablet_service.cc:1511] Processing CreateTablet for tablet df8d897471684531826528a5751d6246 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:12:08.360321  2392 tablet_bootstrap.cc:492] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Bootstrap starting.
I20260709 13:12:08.361636  2330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a332070dcdff450b939e74ef5b68425a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.371344  2260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28f2272230d34efa880d5eeed8859669. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.371685  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56bba8336a054d969e18859a84f180d6" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:08.388962  2255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5aac56f958fb4fe29fe46d2a9be60ffd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.372176  2107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1ad60fa3bce47daac74b01143b54132. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.368957  2402 raft_consensus.cc:385] T 56bba8336a054d969e18859a84f180d6 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.380003  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f0f1b0143c4363a9b900eae4ac3ea9" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:08.389978  2402 raft_consensus.cc:740] T 56bba8336a054d969e18859a84f180d6 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.390766  2402 consensus_queue.cc:260] T 56bba8336a054d969e18859a84f180d6 P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:08.389147  2182 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46887c40373b4aca811c6382c97cb9bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.366225  2336 tablet_service.cc:1511] Processing CreateTablet for tablet bad0fdea1e3a409aab372c59eaa33767 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:12:08.384260  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f0f1b0143c4363a9b900eae4ac3ea9" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:08.388037  2329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 583390912c6d4daca2df9b5534fb8dca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.392756  2272 raft_consensus.cc:2468] T 56bba8336a054d969e18859a84f180d6 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 0.
I20260709 13:12:08.396301  2109 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1ddcfd4d0914e40ae0a684fd8726d24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.396633  2087 leader_election.cc:304] T 56bba8336a054d969e18859a84f180d6 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39; no voters: 66e9a8fffd4b4e5a81ca4fa2762773ea
I20260709 13:12:08.397812  2397 raft_consensus.cc:2804] T 56bba8336a054d969e18859a84f180d6 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:08.398181  2397 raft_consensus.cc:493] T 56bba8336a054d969e18859a84f180d6 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.398510  2397 raft_consensus.cc:3060] T 56bba8336a054d969e18859a84f180d6 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.398473  2332 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38d5e9a8f42c4a2993d25a8a341fddbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.402469  2105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df8d897471684531826528a5751d6246. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.404945  2335 tablet_service.cc:1511] Processing CreateTablet for tablet 421302a9721e4cc9a86e52a183469a70 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:12:08.406311  2110 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46887c40373b4aca811c6382c97cb9bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.412171  2392 tablet_bootstrap.cc:654] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.415632  2397 raft_consensus.cc:515] T 56bba8336a054d969e18859a84f180d6 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:08.418587  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56bba8336a054d969e18859a84f180d6" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:08.419171  2346 raft_consensus.cc:3060] T 56bba8336a054d969e18859a84f180d6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.384200  2262 tablet_service.cc:1511] Processing CreateTablet for tablet 0bd8fc2d57c14adeaeae16583eef7c84 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 13:12:08.426682  2402 ts_tablet_manager.cc:1434] T 56bba8336a054d969e18859a84f180d6 P 79b6e57d59e4468ebe4423d871a31b39: Time spent starting tablet: real 0.131s	user 0.014s	sys 0.000s
I20260709 13:12:08.427160  2256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b65903ab966485c9c65bdfbdf1e1054. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.432274  2258 tablet_service.cc:1511] Processing CreateTablet for tablet ddf48e4f6be64627a0ed06d6198ca054 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 13:12:08.438313  2331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4e943e5bbd7402da6bcc00db70cec14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.441143  2254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c3646d79bc840e9b4396f4351d1803d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.442039  2336 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bad0fdea1e3a409aab372c59eaa33767. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.443861  2261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 86834d94d1d64596abfa609754b5d58a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.442055  2327 tablet_service.cc:1511] Processing CreateTablet for tablet 46887c40373b4aca811c6382c97cb9bf (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 13:12:08.447078  2327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46887c40373b4aca811c6382c97cb9bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.377485  2328 tablet_service.cc:1511] Processing CreateTablet for tablet 1588358a9e7542dfbd8b5d2f65212aec (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
W20260709 13:12:08.459339  2162 leader_election.cc:343] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:08.460057  2162 leader_election.cc:343] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:08.460455  2162 leader_election.cc:304] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35; no voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:08.461334  2407 raft_consensus.cc:2749] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:08.460996  2393 tablet_bootstrap.cc:492] T 7e716da7cd3d4ad390e049dc845b8004 P 0ec6a5d1452a41bd992a8c7922473b35: No bootstrap required, opened a new log
I20260709 13:12:08.463390  2402 tablet_bootstrap.cc:492] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39: Bootstrap starting.
I20260709 13:12:08.462513  2393 ts_tablet_manager.cc:1403] T 7e716da7cd3d4ad390e049dc845b8004 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent bootstrapping tablet: real 0.391s	user 0.015s	sys 0.011s
I20260709 13:12:08.468626  2393 raft_consensus.cc:359] T 7e716da7cd3d4ad390e049dc845b8004 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:08.469300  2393 raft_consensus.cc:385] T 7e716da7cd3d4ad390e049dc845b8004 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.454109  2397 leader_election.cc:290] T 56bba8336a054d969e18859a84f180d6 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 election: Requested vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:08.455210  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56bba8336a054d969e18859a84f180d6" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:08.473670  2272 raft_consensus.cc:3060] T 56bba8336a054d969e18859a84f180d6 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.455515  2346 raft_consensus.cc:2468] T 56bba8336a054d969e18859a84f180d6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 1.
I20260709 13:12:08.480876  2335 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 421302a9721e4cc9a86e52a183469a70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.485431  2257 tablet_service.cc:1511] Processing CreateTablet for tablet 78734884e0a441759b51d258ad2697aa (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 13:12:08.486603  2258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ddf48e4f6be64627a0ed06d6198ca054. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.489743  2262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0bd8fc2d57c14adeaeae16583eef7c84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.493839  2272 raft_consensus.cc:2468] T 56bba8336a054d969e18859a84f180d6 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 1.
I20260709 13:12:08.494657  2087 leader_election.cc:304] T 56bba8336a054d969e18859a84f180d6 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:08.496551  2397 raft_consensus.cc:2804] T 56bba8336a054d969e18859a84f180d6 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:08.498210  2328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1588358a9e7542dfbd8b5d2f65212aec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.507812  2402 tablet_bootstrap.cc:654] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.510563  2179 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47484 (request call id 42) took 1011 ms. Trace:
I20260709 13:12:08.524446  2179 rpcz_store.cc:276] 0709 13:12:07.501678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:08.249283 (+747605us) service_pool.cc:224] Handling call
0709 13:12:08.287167 (+ 37884us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:12:08.287247 (+    80us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:12:08.473512 (+186265us) tablet_metadata.cc:665] Metadata flushed
0709 13:12:08.510090 (+ 36578us) tablet_replica.cc:206] Creating consensus instance
0709 13:12:08.510504 (+   414us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:08.469588  2393 raft_consensus.cc:740] T 7e716da7cd3d4ad390e049dc845b8004 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Initialized, Role: FOLLOWER
W20260709 13:12:08.526162  2069 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:08.526319  2393 consensus_queue.cc:260] T 7e716da7cd3d4ad390e049dc845b8004 P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:08.531750  2257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78734884e0a441759b51d258ad2697aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.531967  2393 ts_tablet_manager.cc:1434] T 7e716da7cd3d4ad390e049dc845b8004 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent starting tablet: real 0.066s	user 0.006s	sys 0.000s
I20260709 13:12:08.533004  2393 tablet_bootstrap.cc:492] T 67db2f978ea64fbd9a32274d4ad374c9 P 0ec6a5d1452a41bd992a8c7922473b35: Bootstrap starting.
I20260709 13:12:08.533807  2253 tablet_service.cc:1511] Processing CreateTablet for tablet f2a1307186df4616a9759118c2e456a6 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 13:12:08.535054  2253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f2a1307186df4616a9759118c2e456a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.538949  2393 tablet_bootstrap.cc:654] T 67db2f978ea64fbd9a32274d4ad374c9 P 0ec6a5d1452a41bd992a8c7922473b35: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.520978  2182 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:47484 (request call id 43) took 1014 ms. Trace:
I20260709 13:12:08.539422  2254 tablet_service.cc:1511] Processing CreateTablet for tablet 7e3782f3d54b4a19bacbd125c31127a9 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 13:12:08.540655  2254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e3782f3d54b4a19bacbd125c31127a9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.544759  2255 tablet_service.cc:1511] Processing CreateTablet for tablet b206de895e36490688cb2c1c537774a5 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 13:12:08.545646  2255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b206de895e36490688cb2c1c537774a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.551795  2392 tablet_bootstrap.cc:492] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea: No bootstrap required, opened a new log
I20260709 13:12:08.552311  2392 ts_tablet_manager.cc:1403] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent bootstrapping tablet: real 0.192s	user 0.008s	sys 0.007s
I20260709 13:12:08.539806  2182 rpcz_store.cc:276] 0709 13:12:07.506361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:08.326022 (+819661us) service_pool.cc:224] Handling call
0709 13:12:08.388719 (+ 62697us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 13:12:08.388809 (+    90us) ts_tablet_manager.cc:682] Creating new metadata...
0709 13:12:08.503370 (+114561us) tablet_metadata.cc:665] Metadata flushed
0709 13:12:08.520513 (+ 17143us) tablet_replica.cc:206] Creating consensus instance
0709 13:12:08.520919 (+   406us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:08.560932  2261 tablet_service.cc:1511] Processing CreateTablet for tablet a9be6d55d1f348bcaf96405abc80244d (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 13:12:08.542542  2397 raft_consensus.cc:697] T 56bba8336a054d969e18859a84f180d6 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 LEADER]: Becoming Leader. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Running, Role: LEADER
I20260709 13:12:08.566759  2391 tablet_bootstrap.cc:492] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472: No bootstrap required, opened a new log
I20260709 13:12:08.567257  2391 ts_tablet_manager.cc:1403] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.506s	user 0.011s	sys 0.036s
I20260709 13:12:08.563942  2261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a9be6d55d1f348bcaf96405abc80244d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.566401  2392 raft_consensus.cc:359] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:08.569924  2392 raft_consensus.cc:385] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.570241  2392 raft_consensus.cc:740] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.570940  2392 consensus_queue.cc:260] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:08.574481  2397 consensus_queue.cc:237] T 56bba8336a054d969e18859a84f180d6 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:08.579449  2407 raft_consensus.cc:493] T 7e716da7cd3d4ad390e049dc845b8004 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.573668  2253 tablet_service.cc:1511] Processing CreateTablet for tablet f9934bcaed6743b2a30104e13b8cf18b (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 13:12:08.579934  2407 raft_consensus.cc:515] T 7e716da7cd3d4ad390e049dc845b8004 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:08.580884  2253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f9934bcaed6743b2a30104e13b8cf18b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.582960  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e716da7cd3d4ad390e049dc845b8004" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:08.583977  2258 tablet_service.cc:1511] Processing CreateTablet for tablet d0d102459578474fbe77af94f3986a84 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
W20260709 13:12:08.584436  2162 leader_election.cc:343] T 7e716da7cd3d4ad390e049dc845b8004 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:08.585197  2391 raft_consensus.cc:359] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:08.585903  2391 raft_consensus.cc:385] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.586164  2391 raft_consensus.cc:740] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.586894  2391 consensus_queue.cc:260] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:08.559618  2260 tablet_service.cc:1511] Processing CreateTablet for tablet e5bbfa12bce4430fa6e7e6abd281ded6 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 13:12:08.586313  2392 ts_tablet_manager.cc:1434] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent starting tablet: real 0.034s	user 0.008s	sys 0.000s
I20260709 13:12:08.589203  2260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e5bbfa12bce4430fa6e7e6abd281ded6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.589571  2392 tablet_bootstrap.cc:492] T 7e716da7cd3d4ad390e049dc845b8004 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Bootstrap starting.
I20260709 13:12:08.589974  2407 leader_election.cc:290] T 7e716da7cd3d4ad390e049dc845b8004 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:08.591575  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e716da7cd3d4ad390e049dc845b8004" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
W20260709 13:12:08.592974  2162 leader_election.cc:343] T 7e716da7cd3d4ad390e049dc845b8004 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:08.593402  2162 leader_election.cc:304] T 7e716da7cd3d4ad390e049dc845b8004 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35; no voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:08.594483  2407 raft_consensus.cc:2749] T 7e716da7cd3d4ad390e049dc845b8004 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:08.596009  2391 ts_tablet_manager.cc:1434] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 13:12:08.596984  2391 tablet_bootstrap.cc:492] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:08.594595  2258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0d102459578474fbe77af94f3986a84. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.615214  2257 tablet_service.cc:1511] Processing CreateTablet for tablet df8d897471684531826528a5751d6246 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 13:12:08.616618  2392 tablet_bootstrap.cc:654] T 7e716da7cd3d4ad390e049dc845b8004 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.618937  2257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df8d897471684531826528a5751d6246. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.621222  2256 tablet_service.cc:1511] Processing CreateTablet for tablet 6bf4f728eedf41bdb027f554c3a5ae1f (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 13:12:08.622563  2256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6bf4f728eedf41bdb027f554c3a5ae1f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.629267  2262 tablet_service.cc:1511] Processing CreateTablet for tablet d1ddcfd4d0914e40ae0a684fd8726d24 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 13:12:08.630679  2262 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d1ddcfd4d0914e40ae0a684fd8726d24. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.630565  2259 tablet_service.cc:1511] Processing CreateTablet for tablet d2f88787abb54ffea037f35cf48b22c4 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 13:12:08.643114  2402 tablet_bootstrap.cc:492] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39: No bootstrap required, opened a new log
I20260709 13:12:08.643636  2402 ts_tablet_manager.cc:1403] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39: Time spent bootstrapping tablet: real 0.180s	user 0.014s	sys 0.016s
I20260709 13:12:08.637890  2020 catalog_manager.cc:5697] T 56bba8336a054d969e18859a84f180d6 P 2ac5c5682f914ed9b9982b5a080d5472 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "2ac5c5682f914ed9b9982b5a080d5472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:08.646667  2402 raft_consensus.cc:359] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:08.653313  2393 tablet_bootstrap.cc:492] T 67db2f978ea64fbd9a32274d4ad374c9 P 0ec6a5d1452a41bd992a8c7922473b35: No bootstrap required, opened a new log
I20260709 13:12:08.653918  2393 ts_tablet_manager.cc:1403] T 67db2f978ea64fbd9a32274d4ad374c9 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent bootstrapping tablet: real 0.121s	user 0.010s	sys 0.030s
I20260709 13:12:08.655443  2260 tablet_service.cc:1511] Processing CreateTablet for tablet 622b6cfd76ff495ea6692a1ec0faefc4 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 13:12:08.656577  2402 raft_consensus.cc:385] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.656944  2402 raft_consensus.cc:740] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.657797  2402 consensus_queue.cc:260] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:08.657001  2392 tablet_bootstrap.cc:492] T 7e716da7cd3d4ad390e049dc845b8004 P 66e9a8fffd4b4e5a81ca4fa2762773ea: No bootstrap required, opened a new log
I20260709 13:12:08.649474  2259 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d2f88787abb54ffea037f35cf48b22c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.665925  2392 ts_tablet_manager.cc:1403] T 7e716da7cd3d4ad390e049dc845b8004 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent bootstrapping tablet: real 0.077s	user 0.014s	sys 0.003s
I20260709 13:12:08.660266  2402 ts_tablet_manager.cc:1434] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:12:08.666548  2260 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 622b6cfd76ff495ea6692a1ec0faefc4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.663625  2257 tablet_service.cc:1511] Processing CreateTablet for tablet 583390912c6d4daca2df9b5534fb8dca (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 13:12:08.664516  2255 tablet_service.cc:1511] Processing CreateTablet for tablet 38d5e9a8f42c4a2993d25a8a341fddbf (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 13:12:08.664491  2391 tablet_bootstrap.cc:654] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.676611  2392 raft_consensus.cc:359] T 7e716da7cd3d4ad390e049dc845b8004 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:08.677331  2392 raft_consensus.cc:385] T 7e716da7cd3d4ad390e049dc845b8004 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.667258  2402 tablet_bootstrap.cc:492] T 2993800f8e7e4c09bfe0b2be13e4394c P 79b6e57d59e4468ebe4423d871a31b39: Bootstrap starting.
I20260709 13:12:08.660580  2393 raft_consensus.cc:359] T 67db2f978ea64fbd9a32274d4ad374c9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:08.678382  2393 raft_consensus.cc:385] T 67db2f978ea64fbd9a32274d4ad374c9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.678839  2393 raft_consensus.cc:740] T 67db2f978ea64fbd9a32274d4ad374c9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.680740  2261 tablet_service.cc:1511] Processing CreateTablet for tablet bad0fdea1e3a409aab372c59eaa33767 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 13:12:08.680441  2393 consensus_queue.cc:260] T 67db2f978ea64fbd9a32274d4ad374c9 P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:08.684376  2254 tablet_service.cc:1511] Processing CreateTablet for tablet e1ad60fa3bce47daac74b01143b54132 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 13:12:08.677616  2392 raft_consensus.cc:740] T 7e716da7cd3d4ad390e049dc845b8004 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.675129  2257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 583390912c6d4daca2df9b5534fb8dca. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.687115  2261 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bad0fdea1e3a409aab372c59eaa33767. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.689996  2255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38d5e9a8f42c4a2993d25a8a341fddbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.694356  2392 consensus_queue.cc:260] T 7e716da7cd3d4ad390e049dc845b8004 P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:08.697503  2253 tablet_service.cc:1511] Processing CreateTablet for tablet 1588358a9e7542dfbd8b5d2f65212aec (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 13:12:08.698799  2253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1588358a9e7542dfbd8b5d2f65212aec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.699318  2258 tablet_service.cc:1511] Processing CreateTablet for tablet 421302a9721e4cc9a86e52a183469a70 (DEFAULT_TABLE table=test-workload [id=465e22daacf040bcb7c9990dda22f132]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 13:12:08.700548  2258 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 421302a9721e4cc9a86e52a183469a70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.704290  2402 tablet_bootstrap.cc:654] T 2993800f8e7e4c09bfe0b2be13e4394c P 79b6e57d59e4468ebe4423d871a31b39: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.705575  2393 ts_tablet_manager.cc:1434] T 67db2f978ea64fbd9a32274d4ad374c9 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent starting tablet: real 0.051s	user 0.003s	sys 0.005s
I20260709 13:12:08.706828  2392 ts_tablet_manager.cc:1434] T 7e716da7cd3d4ad390e049dc845b8004 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260709 13:12:08.707366  2254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e1ad60fa3bce47daac74b01143b54132. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:08.715376  2393 tablet_bootstrap.cc:492] T 93d627aa01fd4aefbbae482eb2fb2453 P 0ec6a5d1452a41bd992a8c7922473b35: Bootstrap starting.
I20260709 13:12:08.715605  2392 tablet_bootstrap.cc:492] T a0394490f6984f028daa10be921e242b P 66e9a8fffd4b4e5a81ca4fa2762773ea: Bootstrap starting.
I20260709 13:12:08.728446  2392 tablet_bootstrap.cc:654] T a0394490f6984f028daa10be921e242b P 66e9a8fffd4b4e5a81ca4fa2762773ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.722671  2393 tablet_bootstrap.cc:654] T 93d627aa01fd4aefbbae482eb2fb2453 P 0ec6a5d1452a41bd992a8c7922473b35: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.738411  2392 tablet_bootstrap.cc:492] T a0394490f6984f028daa10be921e242b P 66e9a8fffd4b4e5a81ca4fa2762773ea: No bootstrap required, opened a new log
I20260709 13:12:08.738831  2392 ts_tablet_manager.cc:1403] T a0394490f6984f028daa10be921e242b P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.000s
I20260709 13:12:08.740959  2392 raft_consensus.cc:359] T a0394490f6984f028daa10be921e242b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:08.741465  2392 raft_consensus.cc:385] T a0394490f6984f028daa10be921e242b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.741741  2392 raft_consensus.cc:740] T a0394490f6984f028daa10be921e242b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.742856  2391 tablet_bootstrap.cc:492] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472: No bootstrap required, opened a new log
I20260709 13:12:08.742446  2392 consensus_queue.cc:260] T a0394490f6984f028daa10be921e242b P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:08.743364  2391 ts_tablet_manager.cc:1403] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.147s	user 0.019s	sys 0.010s
I20260709 13:12:08.744921  2392 ts_tablet_manager.cc:1434] T a0394490f6984f028daa10be921e242b P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:12:08.745944  2392 tablet_bootstrap.cc:492] T 2993800f8e7e4c09bfe0b2be13e4394c P 66e9a8fffd4b4e5a81ca4fa2762773ea: Bootstrap starting.
I20260709 13:12:08.751837  2402 tablet_bootstrap.cc:492] T 2993800f8e7e4c09bfe0b2be13e4394c P 79b6e57d59e4468ebe4423d871a31b39: No bootstrap required, opened a new log
I20260709 13:12:08.752364  2402 ts_tablet_manager.cc:1403] T 2993800f8e7e4c09bfe0b2be13e4394c P 79b6e57d59e4468ebe4423d871a31b39: Time spent bootstrapping tablet: real 0.085s	user 0.015s	sys 0.008s
I20260709 13:12:08.755244  2391 raft_consensus.cc:359] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:08.755602  2402 raft_consensus.cc:359] T 2993800f8e7e4c09bfe0b2be13e4394c P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:08.756265  2402 raft_consensus.cc:385] T 2993800f8e7e4c09bfe0b2be13e4394c P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.756033  2391 raft_consensus.cc:385] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.756558  2402 raft_consensus.cc:740] T 2993800f8e7e4c09bfe0b2be13e4394c P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.757115  2391 raft_consensus.cc:740] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.757669  2402 consensus_queue.cc:260] T 2993800f8e7e4c09bfe0b2be13e4394c P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:08.758306  2391 consensus_queue.cc:260] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:08.761186  2402 ts_tablet_manager.cc:1434] T 2993800f8e7e4c09bfe0b2be13e4394c P 79b6e57d59e4468ebe4423d871a31b39: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.008s
I20260709 13:12:08.762324  2391 ts_tablet_manager.cc:1434] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:12:08.763857  2392 tablet_bootstrap.cc:654] T 2993800f8e7e4c09bfe0b2be13e4394c P 66e9a8fffd4b4e5a81ca4fa2762773ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.766454  2393 tablet_bootstrap.cc:492] T 93d627aa01fd4aefbbae482eb2fb2453 P 0ec6a5d1452a41bd992a8c7922473b35: No bootstrap required, opened a new log
I20260709 13:12:08.766935  2393 ts_tablet_manager.cc:1403] T 93d627aa01fd4aefbbae482eb2fb2453 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent bootstrapping tablet: real 0.052s	user 0.008s	sys 0.004s
I20260709 13:12:08.768029  2419 raft_consensus.cc:493] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.768522  2419 raft_consensus.cc:515] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:08.769747  2393 raft_consensus.cc:359] T 93d627aa01fd4aefbbae482eb2fb2453 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:08.770454  2393 raft_consensus.cc:385] T 93d627aa01fd4aefbbae482eb2fb2453 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.770731  2393 raft_consensus.cc:740] T 93d627aa01fd4aefbbae482eb2fb2453 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.771888  2402 tablet_bootstrap.cc:492] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39: Bootstrap starting.
I20260709 13:12:08.772137  2419 leader_election.cc:290] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:08.771473  2393 consensus_queue.cc:260] T 93d627aa01fd4aefbbae482eb2fb2453 P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:08.779275  2393 ts_tablet_manager.cc:1434] T 93d627aa01fd4aefbbae482eb2fb2453 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:12:08.780689  2393 tablet_bootstrap.cc:492] T e259bf23e7904d9fb8b2345bb5b667f3 P 0ec6a5d1452a41bd992a8c7922473b35: Bootstrap starting.
I20260709 13:12:08.789645  2391 tablet_bootstrap.cc:492] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:08.796452  2391 tablet_bootstrap.cc:654] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.797595  2393 tablet_bootstrap.cc:654] T e259bf23e7904d9fb8b2345bb5b667f3 P 0ec6a5d1452a41bd992a8c7922473b35: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.798035  2397 raft_consensus.cc:493] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.799582  2397 raft_consensus.cc:515] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:08.803678  2402 tablet_bootstrap.cc:654] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.806576  2392 tablet_bootstrap.cc:492] T 2993800f8e7e4c09bfe0b2be13e4394c P 66e9a8fffd4b4e5a81ca4fa2762773ea: No bootstrap required, opened a new log
I20260709 13:12:08.807099  2392 ts_tablet_manager.cc:1403] T 2993800f8e7e4c09bfe0b2be13e4394c P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent bootstrapping tablet: real 0.061s	user 0.008s	sys 0.006s
I20260709 13:12:08.811407  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d627aa01fd4aefbbae482eb2fb2453" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:08.812150  2346 raft_consensus.cc:2468] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 0.
I20260709 13:12:08.806967  2397 leader_election.cc:290] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:08.813320  2087 leader_election.cc:304] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:08.814177  2397 raft_consensus.cc:2804] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:08.814507  2397 raft_consensus.cc:493] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.814810  2397 raft_consensus.cc:3060] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.818951  2392 raft_consensus.cc:359] T 2993800f8e7e4c09bfe0b2be13e4394c P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:08.820513  2392 raft_consensus.cc:385] T 2993800f8e7e4c09bfe0b2be13e4394c P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.820861  2392 raft_consensus.cc:740] T 2993800f8e7e4c09bfe0b2be13e4394c P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.820959  2419 raft_consensus.cc:493] T 2993800f8e7e4c09bfe0b2be13e4394c P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.821542  2419 raft_consensus.cc:515] T 2993800f8e7e4c09bfe0b2be13e4394c P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:08.821843  2392 consensus_queue.cc:260] T 2993800f8e7e4c09bfe0b2be13e4394c P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:08.824132  2392 ts_tablet_manager.cc:1434] T 2993800f8e7e4c09bfe0b2be13e4394c P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260709 13:12:08.825189  2392 tablet_bootstrap.cc:492] T 765b8df93039426e925b94637a061cc2 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Bootstrap starting.
I20260709 13:12:08.824031  2419 leader_election.cc:290] T 2993800f8e7e4c09bfe0b2be13e4394c P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:08.834726  2401 raft_consensus.cc:493] T 2993800f8e7e4c09bfe0b2be13e4394c P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.835224  2401 raft_consensus.cc:515] T 2993800f8e7e4c09bfe0b2be13e4394c P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:08.836972  2198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67db2f978ea64fbd9a32274d4ad374c9" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:08.837597  2198 raft_consensus.cc:2468] T 67db2f978ea64fbd9a32274d4ad374c9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 0.
I20260709 13:12:08.838683  2401 leader_election.cc:290] T 2993800f8e7e4c09bfe0b2be13e4394c P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:08.839195  2401 raft_consensus.cc:493] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.839624  2198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2993800f8e7e4c09bfe0b2be13e4394c" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:08.839607  2401 raft_consensus.cc:515] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:08.850425  2237 leader_election.cc:304] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:08.851361  2401 leader_election.cc:290] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:08.851989  2198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2993800f8e7e4c09bfe0b2be13e4394c" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:08.852703  2392 tablet_bootstrap.cc:654] T 765b8df93039426e925b94637a061cc2 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.853221  2198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a50365dcc843f4a4f6bfb29a736f26" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
W20260709 13:12:08.853389  2311 leader_election.cc:343] T 2993800f8e7e4c09bfe0b2be13e4394c P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:08.851450  2237 leader_election.cc:343] T 2993800f8e7e4c09bfe0b2be13e4394c P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:08.854808  2311 leader_election.cc:343] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:08.851797  2419 raft_consensus.cc:2804] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:08.855430  2419 raft_consensus.cc:493] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.855793  2419 raft_consensus.cc:3060] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.858820  2397 raft_consensus.cc:515] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:08.863376  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d627aa01fd4aefbbae482eb2fb2453" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:08.863404  2123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a50365dcc843f4a4f6bfb29a736f26" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:08.864087  2346 raft_consensus.cc:3060] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.866232  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2993800f8e7e4c09bfe0b2be13e4394c" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:08.866945  2345 raft_consensus.cc:2468] T 2993800f8e7e4c09bfe0b2be13e4394c P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 0.
I20260709 13:12:08.866591  2397 leader_election.cc:290] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 election: Requested vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
W20260709 13:12:08.867949  2310 leader_election.cc:343] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:08.868465  2310 leader_election.cc:304] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:08.879437  2401 raft_consensus.cc:2749] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:08.881109  2402 tablet_bootstrap.cc:492] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39: No bootstrap required, opened a new log
I20260709 13:12:08.881601  2402 ts_tablet_manager.cc:1403] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39: Time spent bootstrapping tablet: real 0.110s	user 0.016s	sys 0.031s
I20260709 13:12:08.881001  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2993800f8e7e4c09bfe0b2be13e4394c" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:08.882186  2391 tablet_bootstrap.cc:492] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472: No bootstrap required, opened a new log
I20260709 13:12:08.882514  2272 raft_consensus.cc:2468] T 2993800f8e7e4c09bfe0b2be13e4394c P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 0.
I20260709 13:12:08.882802  2391 ts_tablet_manager.cc:1403] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.105s	user 0.015s	sys 0.005s
I20260709 13:12:08.881742  2236 leader_election.cc:304] T 2993800f8e7e4c09bfe0b2be13e4394c P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39; no voters: 0ec6a5d1452a41bd992a8c7922473b35
I20260709 13:12:08.884706  2402 raft_consensus.cc:359] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:08.885430  2402 raft_consensus.cc:385] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.885783  2391 raft_consensus.cc:359] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:08.870704  2346 raft_consensus.cc:2468] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 1.
I20260709 13:12:08.874619  2419 raft_consensus.cc:515] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:08.886518  2391 raft_consensus.cc:385] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.886832  2391 raft_consensus.cc:740] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.888278  2419 leader_election.cc:290] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 election: Requested vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:08.872593  2397 raft_consensus.cc:493] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.885707  2402 raft_consensus.cc:740] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.889045  2198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67db2f978ea64fbd9a32274d4ad374c9" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:08.889194  2397 raft_consensus.cc:515] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:08.889719  2198 raft_consensus.cc:3060] T 67db2f978ea64fbd9a32274d4ad374c9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.889925  2402 consensus_queue.cc:260] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:08.890866  2310 leader_election.cc:304] T 2993800f8e7e4c09bfe0b2be13e4394c P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39; no voters: 0ec6a5d1452a41bd992a8c7922473b35
I20260709 13:12:08.892135  2402 ts_tablet_manager.cc:1434] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:12:08.877599  2123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67db2f978ea64fbd9a32274d4ad374c9" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:08.888911  2419 raft_consensus.cc:2804] T 2993800f8e7e4c09bfe0b2be13e4394c P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:08.893711  2401 raft_consensus.cc:2804] T 2993800f8e7e4c09bfe0b2be13e4394c P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:08.894145  2123 raft_consensus.cc:2468] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 0.
I20260709 13:12:08.894320  2087 leader_election.cc:304] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:08.895499  2397 leader_election.cc:290] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:08.896378  2197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d627aa01fd4aefbbae482eb2fb2453" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:08.898404  2197 raft_consensus.cc:2468] T 93d627aa01fd4aefbbae482eb2fb2453 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 0.
I20260709 13:12:08.899276  2422 raft_consensus.cc:2804] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:08.898406  2195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67db2f978ea64fbd9a32274d4ad374c9" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:08.896733  2196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d627aa01fd4aefbbae482eb2fb2453" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:08.900667  2196 raft_consensus.cc:3060] T 93d627aa01fd4aefbbae482eb2fb2453 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.900956  2402 tablet_bootstrap.cc:492] T 7e716da7cd3d4ad390e049dc845b8004 P 79b6e57d59e4468ebe4423d871a31b39: Bootstrap starting.
I20260709 13:12:08.897578  2401 raft_consensus.cc:493] T 2993800f8e7e4c09bfe0b2be13e4394c P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.901541  2401 raft_consensus.cc:3060] T 2993800f8e7e4c09bfe0b2be13e4394c P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.900804  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67db2f978ea64fbd9a32274d4ad374c9" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:08.903425  2272 raft_consensus.cc:2393] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ac5c5682f914ed9b9982b5a080d5472 in current term 1: Already voted for candidate 79b6e57d59e4468ebe4423d871a31b39 in this term.
I20260709 13:12:08.901551  2392 tablet_bootstrap.cc:492] T 765b8df93039426e925b94637a061cc2 P 66e9a8fffd4b4e5a81ca4fa2762773ea: No bootstrap required, opened a new log
I20260709 13:12:08.906549  2392 ts_tablet_manager.cc:1403] T 765b8df93039426e925b94637a061cc2 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent bootstrapping tablet: real 0.082s	user 0.023s	sys 0.011s
I20260709 13:12:08.907343  2088 leader_election.cc:304] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:08.897357  2419 raft_consensus.cc:493] T 2993800f8e7e4c09bfe0b2be13e4394c P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.910848  2419 raft_consensus.cc:3060] T 2993800f8e7e4c09bfe0b2be13e4394c P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.887679  2391 consensus_queue.cc:260] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:08.909654  2392 raft_consensus.cc:359] T 765b8df93039426e925b94637a061cc2 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:08.913152  2392 raft_consensus.cc:385] T 765b8df93039426e925b94637a061cc2 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.913482  2392 raft_consensus.cc:740] T 765b8df93039426e925b94637a061cc2 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.914322  2392 consensus_queue.cc:260] T 765b8df93039426e925b94637a061cc2 P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:08.915040  2402 tablet_bootstrap.cc:654] T 7e716da7cd3d4ad390e049dc845b8004 P 79b6e57d59e4468ebe4423d871a31b39: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.916731  2397 raft_consensus.cc:3060] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:08.917781  2393 tablet_bootstrap.cc:492] T e259bf23e7904d9fb8b2345bb5b667f3 P 0ec6a5d1452a41bd992a8c7922473b35: No bootstrap required, opened a new log
I20260709 13:12:08.915737  2198 raft_consensus.cc:2468] T 67db2f978ea64fbd9a32274d4ad374c9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 1.
I20260709 13:12:08.921150  2393 ts_tablet_manager.cc:1403] T e259bf23e7904d9fb8b2345bb5b667f3 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent bootstrapping tablet: real 0.141s	user 0.012s	sys 0.002s
I20260709 13:12:08.911109  2196 raft_consensus.cc:2468] T 93d627aa01fd4aefbbae482eb2fb2453 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 1.
I20260709 13:12:08.922433  2237 leader_election.cc:304] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:08.919694  2401 raft_consensus.cc:515] T 2993800f8e7e4c09bfe0b2be13e4394c P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:08.933429  2196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2993800f8e7e4c09bfe0b2be13e4394c" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:08.933826  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2993800f8e7e4c09bfe0b2be13e4394c" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:08.934449  2401 leader_election.cc:290] T 2993800f8e7e4c09bfe0b2be13e4394c P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 election: Requested vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
W20260709 13:12:08.934896  2311 leader_election.cc:343] T 2993800f8e7e4c09bfe0b2be13e4394c P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:08.935036  2392 ts_tablet_manager.cc:1434] T 765b8df93039426e925b94637a061cc2 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.000s
I20260709 13:12:08.936167  2392 tablet_bootstrap.cc:492] T 01a3c95e54104a998cdf16d06db2800a P 66e9a8fffd4b4e5a81ca4fa2762773ea: Bootstrap starting.
I20260709 13:12:08.936813  2391 ts_tablet_manager.cc:1434] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.054s	user 0.008s	sys 0.002s
I20260709 13:12:08.941540  2422 raft_consensus.cc:697] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 LEADER]: Becoming Leader. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Running, Role: LEADER
I20260709 13:12:08.942286  2448 raft_consensus.cc:2804] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:08.942466  2422 consensus_queue.cc:237] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:08.944723  2401 raft_consensus.cc:493] T 7e716da7cd3d4ad390e049dc845b8004 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.937736  2391 tablet_bootstrap.cc:492] T a0394490f6984f028daa10be921e242b P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:08.955616  2397 raft_consensus.cc:2749] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:08.956164  2448 raft_consensus.cc:697] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 LEADER]: Becoming Leader. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Running, Role: LEADER
I20260709 13:12:08.957072  2392 tablet_bootstrap.cc:654] T 01a3c95e54104a998cdf16d06db2800a P 66e9a8fffd4b4e5a81ca4fa2762773ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.957463  2448 consensus_queue.cc:237] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:08.958081  2419 raft_consensus.cc:515] T 2993800f8e7e4c09bfe0b2be13e4394c P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:08.959321  2272 raft_consensus.cc:2393] T 2993800f8e7e4c09bfe0b2be13e4394c P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in current term 1: Already voted for candidate 79b6e57d59e4468ebe4423d871a31b39 in this term.
W20260709 13:12:08.929302  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:38869, user_credentials={real_user=slave}} blocked reactor thread for 47825.3us
I20260709 13:12:08.939200  2393 raft_consensus.cc:359] T e259bf23e7904d9fb8b2345bb5b667f3 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:08.945588  2401 raft_consensus.cc:515] T 7e716da7cd3d4ad390e049dc845b8004 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:08.964857  2443 raft_consensus.cc:493] T 765b8df93039426e925b94637a061cc2 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:08.965250  2123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67db2f978ea64fbd9a32274d4ad374c9" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:08.965410  2443 raft_consensus.cc:515] T 765b8df93039426e925b94637a061cc2 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:08.966742  2402 tablet_bootstrap.cc:492] T 7e716da7cd3d4ad390e049dc845b8004 P 79b6e57d59e4468ebe4423d871a31b39: No bootstrap required, opened a new log
I20260709 13:12:08.967228  2402 ts_tablet_manager.cc:1403] T 7e716da7cd3d4ad390e049dc845b8004 P 79b6e57d59e4468ebe4423d871a31b39: Time spent bootstrapping tablet: real 0.067s	user 0.016s	sys 0.011s
I20260709 13:12:08.969091  2401 leader_election.cc:290] T 7e716da7cd3d4ad390e049dc845b8004 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:08.969748  2196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e716da7cd3d4ad390e049dc845b8004" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:08.970083  2310 leader_election.cc:304] T 2993800f8e7e4c09bfe0b2be13e4394c P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:08.970603  2196 raft_consensus.cc:2468] T 7e716da7cd3d4ad390e049dc845b8004 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 0.
I20260709 13:12:08.972157  2311 leader_election.cc:304] T 7e716da7cd3d4ad390e049dc845b8004 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:08.962924  2393 raft_consensus.cc:385] T e259bf23e7904d9fb8b2345bb5b667f3 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.972550  2391 tablet_bootstrap.cc:654] T a0394490f6984f028daa10be921e242b P 2ac5c5682f914ed9b9982b5a080d5472: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:08.971843  2401 raft_consensus.cc:2749] T 2993800f8e7e4c09bfe0b2be13e4394c P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:08.975629  2122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "765b8df93039426e925b94637a061cc2" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:08.977721  2443 leader_election.cc:290] T 765b8df93039426e925b94637a061cc2 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:08.986658  2401 raft_consensus.cc:2804] T 7e716da7cd3d4ad390e049dc845b8004 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:08.978648  2402 raft_consensus.cc:359] T 7e716da7cd3d4ad390e049dc845b8004 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:08.975481  2196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2993800f8e7e4c09bfe0b2be13e4394c" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:08.972265  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e716da7cd3d4ad390e049dc845b8004" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:08.976413  2393 raft_consensus.cc:740] T e259bf23e7904d9fb8b2345bb5b667f3 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Initialized, Role: FOLLOWER
W20260709 13:12:08.988806  2237 leader_election.cc:343] T 2993800f8e7e4c09bfe0b2be13e4394c P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:08.989145  2310 leader_election.cc:343] T 765b8df93039426e925b94637a061cc2 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:08.989581  2393 consensus_queue.cc:260] T e259bf23e7904d9fb8b2345bb5b667f3 P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:08.988791  2019 catalog_manager.cc:5697] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "2ac5c5682f914ed9b9982b5a080d5472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:08.991882  2393 ts_tablet_manager.cc:1434] T e259bf23e7904d9fb8b2345bb5b667f3 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent starting tablet: real 0.070s	user 0.006s	sys 0.000s
I20260709 13:12:08.992815  2393 tablet_bootstrap.cc:492] T 2993800f8e7e4c09bfe0b2be13e4394c P 0ec6a5d1452a41bd992a8c7922473b35: Bootstrap starting.
I20260709 13:12:08.978413  2419 leader_election.cc:290] T 2993800f8e7e4c09bfe0b2be13e4394c P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 election: Requested vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:08.987696  2402 raft_consensus.cc:385] T 7e716da7cd3d4ad390e049dc845b8004 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:08.994272  2402 raft_consensus.cc:740] T 7e716da7cd3d4ad390e049dc845b8004 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Initialized, Role: FOLLOWER
I20260709 13:12:08.994973  2402 consensus_queue.cc:260] T 7e716da7cd3d4ad390e049dc845b8004 P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:08.980331  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2993800f8e7e4c09bfe0b2be13e4394c" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:08.996707  2346 raft_consensus.cc:2393] T 2993800f8e7e4c09bfe0b2be13e4394c P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 79b6e57d59e4468ebe4423d871a31b39 in current term 1: Already voted for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in this term.
I20260709 13:12:08.997138  2402 ts_tablet_manager.cc:1434] T 7e716da7cd3d4ad390e049dc845b8004 P 79b6e57d59e4468ebe4423d871a31b39: Time spent starting tablet: real 0.030s	user 0.005s	sys 0.000s
I20260709 13:12:08.987066  2401 raft_consensus.cc:493] T 7e716da7cd3d4ad390e049dc845b8004 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:08.988679  2123 raft_consensus.cc:2468] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 1.
I20260709 13:12:08.997912  2272 raft_consensus.cc:2468] T 7e716da7cd3d4ad390e049dc845b8004 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 0.
I20260709 13:12:08.998564  2401 raft_consensus.cc:3060] T 7e716da7cd3d4ad390e049dc845b8004 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.001008  2402 tablet_bootstrap.cc:492] T e259bf23e7904d9fb8b2345bb5b667f3 P 79b6e57d59e4468ebe4423d871a31b39: Bootstrap starting.
I20260709 13:12:09.002979  2196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "765b8df93039426e925b94637a061cc2" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
W20260709 13:12:09.005810  2311 leader_election.cc:343] T 765b8df93039426e925b94637a061cc2 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:09.007743  2311 leader_election.cc:304] T 765b8df93039426e925b94637a061cc2 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:09.006910  2018 catalog_manager.cc:5697] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67). New cstate: current_term: 1 leader_uuid: "79b6e57d59e4468ebe4423d871a31b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:09.008567  2443 raft_consensus.cc:2749] T 765b8df93039426e925b94637a061cc2 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:09.010224  2402 tablet_bootstrap.cc:654] T e259bf23e7904d9fb8b2345bb5b667f3 P 79b6e57d59e4468ebe4423d871a31b39: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.012879  2393 tablet_bootstrap.cc:654] T 2993800f8e7e4c09bfe0b2be13e4394c P 0ec6a5d1452a41bd992a8c7922473b35: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.001935  2236 leader_election.cc:304] T 2993800f8e7e4c09bfe0b2be13e4394c P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b6e57d59e4468ebe4423d871a31b39; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea
I20260709 13:12:09.021003  2392 tablet_bootstrap.cc:492] T 01a3c95e54104a998cdf16d06db2800a P 66e9a8fffd4b4e5a81ca4fa2762773ea: No bootstrap required, opened a new log
I20260709 13:12:09.021831  2392 ts_tablet_manager.cc:1403] T 01a3c95e54104a998cdf16d06db2800a P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent bootstrapping tablet: real 0.086s	user 0.011s	sys 0.012s
I20260709 13:12:09.024314  2392 raft_consensus.cc:359] T 01a3c95e54104a998cdf16d06db2800a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:09.024598  2448 raft_consensus.cc:2749] T 2993800f8e7e4c09bfe0b2be13e4394c P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:09.024986  2392 raft_consensus.cc:385] T 01a3c95e54104a998cdf16d06db2800a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.025303  2392 raft_consensus.cc:740] T 01a3c95e54104a998cdf16d06db2800a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.026130  2392 consensus_queue.cc:260] T 01a3c95e54104a998cdf16d06db2800a P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:09.027959  2392 ts_tablet_manager.cc:1434] T 01a3c95e54104a998cdf16d06db2800a P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:12:09.017747  2401 raft_consensus.cc:515] T 7e716da7cd3d4ad390e049dc845b8004 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:09.033656  2196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e716da7cd3d4ad390e049dc845b8004" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:09.034235  2196 raft_consensus.cc:3060] T 7e716da7cd3d4ad390e049dc845b8004 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.035099  2392 tablet_bootstrap.cc:492] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Bootstrap starting.
I20260709 13:12:09.039355  2448 raft_consensus.cc:493] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.039871  2448 raft_consensus.cc:515] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:09.041277  2196 raft_consensus.cc:2468] T 7e716da7cd3d4ad390e049dc845b8004 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 1.
I20260709 13:12:09.041980  2448 leader_election.cc:290] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:09.042485  2311 leader_election.cc:304] T 7e716da7cd3d4ad390e049dc845b8004 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:09.043471  2456 raft_consensus.cc:2804] T 7e716da7cd3d4ad390e049dc845b8004 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:09.044150  2456 raft_consensus.cc:697] T 7e716da7cd3d4ad390e049dc845b8004 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 LEADER]: Becoming Leader. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Running, Role: LEADER
I20260709 13:12:09.044960  2123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0394490f6984f028daa10be921e242b" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:09.044128  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0394490f6984f028daa10be921e242b" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:09.045778  2346 raft_consensus.cc:2468] T a0394490f6984f028daa10be921e242b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 0.
I20260709 13:12:09.046689  2392 tablet_bootstrap.cc:654] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.046849  2236 leader_election.cc:304] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
W20260709 13:12:09.047727  2236 leader_election.cc:343] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:09.048520  2448 raft_consensus.cc:2804] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:09.048875  2448 raft_consensus.cc:493] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.049198  2448 raft_consensus.cc:3060] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.045214  2456 consensus_queue.cc:237] T 7e716da7cd3d4ad390e049dc845b8004 P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:09.052948  2393 tablet_bootstrap.cc:492] T 2993800f8e7e4c09bfe0b2be13e4394c P 0ec6a5d1452a41bd992a8c7922473b35: No bootstrap required, opened a new log
I20260709 13:12:09.053505  2393 ts_tablet_manager.cc:1403] T 2993800f8e7e4c09bfe0b2be13e4394c P 0ec6a5d1452a41bd992a8c7922473b35: Time spent bootstrapping tablet: real 0.061s	user 0.008s	sys 0.014s
I20260709 13:12:09.055559  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e716da7cd3d4ad390e049dc845b8004" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:09.056137  2272 raft_consensus.cc:3060] T 7e716da7cd3d4ad390e049dc845b8004 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.056630  2393 raft_consensus.cc:359] T 2993800f8e7e4c09bfe0b2be13e4394c P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:09.056968  2448 raft_consensus.cc:515] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:09.059605  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0394490f6984f028daa10be921e242b" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:09.060137  2346 raft_consensus.cc:3060] T a0394490f6984f028daa10be921e242b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.057355  2393 raft_consensus.cc:385] T 2993800f8e7e4c09bfe0b2be13e4394c P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.060906  2393 raft_consensus.cc:740] T 2993800f8e7e4c09bfe0b2be13e4394c P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.061672  2393 consensus_queue.cc:260] T 2993800f8e7e4c09bfe0b2be13e4394c P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:09.062920  2272 raft_consensus.cc:2468] T 7e716da7cd3d4ad390e049dc845b8004 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 1.
I20260709 13:12:09.064304  2401 leader_election.cc:290] T 7e716da7cd3d4ad390e049dc845b8004 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 election: Requested vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:09.066757  2346 raft_consensus.cc:2468] T a0394490f6984f028daa10be921e242b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 1.
I20260709 13:12:09.067956  2236 leader_election.cc:304] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:09.068719  2419 raft_consensus.cc:2804] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:09.069171  2419 raft_consensus.cc:697] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39 [term 1 LEADER]: Becoming Leader. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Running, Role: LEADER
I20260709 13:12:09.070019  2419 consensus_queue.cc:237] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:09.071800  2402 tablet_bootstrap.cc:492] T e259bf23e7904d9fb8b2345bb5b667f3 P 79b6e57d59e4468ebe4423d871a31b39: No bootstrap required, opened a new log
I20260709 13:12:09.071806  2391 tablet_bootstrap.cc:492] T a0394490f6984f028daa10be921e242b P 2ac5c5682f914ed9b9982b5a080d5472: No bootstrap required, opened a new log
I20260709 13:12:09.066702  2392 tablet_bootstrap.cc:492] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 66e9a8fffd4b4e5a81ca4fa2762773ea: No bootstrap required, opened a new log
I20260709 13:12:09.072616  2402 ts_tablet_manager.cc:1403] T e259bf23e7904d9fb8b2345bb5b667f3 P 79b6e57d59e4468ebe4423d871a31b39: Time spent bootstrapping tablet: real 0.072s	user 0.028s	sys 0.003s
I20260709 13:12:09.072746  2391 ts_tablet_manager.cc:1403] T a0394490f6984f028daa10be921e242b P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.135s	user 0.008s	sys 0.024s
I20260709 13:12:09.072783  2392 ts_tablet_manager.cc:1403] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent bootstrapping tablet: real 0.038s	user 0.014s	sys 0.002s
I20260709 13:12:09.076002  2402 raft_consensus.cc:359] T e259bf23e7904d9fb8b2345bb5b667f3 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:09.076220  2391 raft_consensus.cc:359] T a0394490f6984f028daa10be921e242b P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:09.076740  2402 raft_consensus.cc:385] T e259bf23e7904d9fb8b2345bb5b667f3 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.077039  2391 raft_consensus.cc:385] T a0394490f6984f028daa10be921e242b P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.068151  2393 ts_tablet_manager.cc:1434] T 2993800f8e7e4c09bfe0b2be13e4394c P 0ec6a5d1452a41bd992a8c7922473b35: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 13:12:09.077092  2402 raft_consensus.cc:740] T e259bf23e7904d9fb8b2345bb5b667f3 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.081125  2402 consensus_queue.cc:260] T e259bf23e7904d9fb8b2345bb5b667f3 P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:09.083130  2402 ts_tablet_manager.cc:1434] T e259bf23e7904d9fb8b2345bb5b667f3 P 79b6e57d59e4468ebe4423d871a31b39: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.003s
I20260709 13:12:09.082767  2018 catalog_manager.cc:5697] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67). New cstate: current_term: 1 leader_uuid: "79b6e57d59e4468ebe4423d871a31b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:09.083858  2402 tablet_bootstrap.cc:492] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 79b6e57d59e4468ebe4423d871a31b39: Bootstrap starting.
I20260709 13:12:09.087459  2019 catalog_manager.cc:5697] T 7e716da7cd3d4ad390e049dc845b8004 P 66e9a8fffd4b4e5a81ca4fa2762773ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68). New cstate: current_term: 1 leader_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:09.088666  2402 tablet_bootstrap.cc:654] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 79b6e57d59e4468ebe4423d871a31b39: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.077397  2391 raft_consensus.cc:740] T a0394490f6984f028daa10be921e242b P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.079022  2448 leader_election.cc:290] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 election: Requested vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:09.078944  2123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0394490f6984f028daa10be921e242b" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:09.079867  2393 tablet_bootstrap.cc:492] T 765b8df93039426e925b94637a061cc2 P 0ec6a5d1452a41bd992a8c7922473b35: Bootstrap starting.
I20260709 13:12:09.090721  2391 consensus_queue.cc:260] T a0394490f6984f028daa10be921e242b P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:09.091915  2123 raft_consensus.cc:3060] T a0394490f6984f028daa10be921e242b P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.093513  2391 ts_tablet_manager.cc:1434] T a0394490f6984f028daa10be921e242b P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 13:12:09.094558  2391 tablet_bootstrap.cc:492] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:09.098949  2123 raft_consensus.cc:2468] T a0394490f6984f028daa10be921e242b P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 1.
I20260709 13:12:09.079041  2392 raft_consensus.cc:359] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:09.100111  2392 raft_consensus.cc:385] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.100402  2392 raft_consensus.cc:740] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.100538  2391 tablet_bootstrap.cc:654] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.101099  2392 consensus_queue.cc:260] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:09.103533  2392 ts_tablet_manager.cc:1434] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent starting tablet: real 0.028s	user 0.005s	sys 0.000s
I20260709 13:12:09.104508  2392 tablet_bootstrap.cc:492] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Bootstrap starting.
I20260709 13:12:09.106422  2422 consensus_queue.cc:1048] T 56bba8336a054d969e18859a84f180d6 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:09.110073  2392 tablet_bootstrap.cc:654] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.113546  2393 tablet_bootstrap.cc:654] T 765b8df93039426e925b94637a061cc2 P 0ec6a5d1452a41bd992a8c7922473b35: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.122860  2391 tablet_bootstrap.cc:492] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472: No bootstrap required, opened a new log
I20260709 13:12:09.123612  2391 ts_tablet_manager.cc:1403] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.004s
I20260709 13:12:09.126817  2391 raft_consensus.cc:359] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:09.130565  2392 tablet_bootstrap.cc:492] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea: No bootstrap required, opened a new log
I20260709 13:12:09.131042  2392 ts_tablet_manager.cc:1403] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent bootstrapping tablet: real 0.027s	user 0.021s	sys 0.003s
I20260709 13:12:09.132808  2393 tablet_bootstrap.cc:492] T 765b8df93039426e925b94637a061cc2 P 0ec6a5d1452a41bd992a8c7922473b35: No bootstrap required, opened a new log
I20260709 13:12:09.132927  2402 tablet_bootstrap.cc:492] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 79b6e57d59e4468ebe4423d871a31b39: No bootstrap required, opened a new log
I20260709 13:12:09.133528  2393 ts_tablet_manager.cc:1403] T 765b8df93039426e925b94637a061cc2 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent bootstrapping tablet: real 0.054s	user 0.004s	sys 0.021s
I20260709 13:12:09.133957  2402 ts_tablet_manager.cc:1403] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 79b6e57d59e4468ebe4423d871a31b39: Time spent bootstrapping tablet: real 0.050s	user 0.010s	sys 0.005s
I20260709 13:12:09.134057  2392 raft_consensus.cc:359] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:09.134740  2392 raft_consensus.cc:385] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.135016  2392 raft_consensus.cc:740] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.135754  2392 consensus_queue.cc:260] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:09.136446  2393 raft_consensus.cc:359] T 765b8df93039426e925b94637a061cc2 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:09.137130  2393 raft_consensus.cc:385] T 765b8df93039426e925b94637a061cc2 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.137425  2393 raft_consensus.cc:740] T 765b8df93039426e925b94637a061cc2 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.137662  2392 ts_tablet_manager.cc:1434] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:12:09.138584  2392 tablet_bootstrap.cc:492] T d3370eb67fff4896b1f8e3ce56eceb9b P 66e9a8fffd4b4e5a81ca4fa2762773ea: Bootstrap starting.
I20260709 13:12:09.138312  2393 consensus_queue.cc:260] T 765b8df93039426e925b94637a061cc2 P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:09.138510  2402 raft_consensus.cc:359] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:09.139472  2402 raft_consensus.cc:385] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.139814  2402 raft_consensus.cc:740] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.140585  2402 consensus_queue.cc:260] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:09.143707  2393 ts_tablet_manager.cc:1434] T 765b8df93039426e925b94637a061cc2 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 13:12:09.144743  2393 tablet_bootstrap.cc:492] T d7a50365dcc843f4a4f6bfb29a736f26 P 0ec6a5d1452a41bd992a8c7922473b35: Bootstrap starting.
I20260709 13:12:09.146236  2392 tablet_bootstrap.cc:654] T d3370eb67fff4896b1f8e3ce56eceb9b P 66e9a8fffd4b4e5a81ca4fa2762773ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.148203  2402 ts_tablet_manager.cc:1434] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 79b6e57d59e4468ebe4423d871a31b39: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.002s
I20260709 13:12:09.153438  2393 tablet_bootstrap.cc:654] T d7a50365dcc843f4a4f6bfb29a736f26 P 0ec6a5d1452a41bd992a8c7922473b35: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.154526  2422 consensus_queue.cc:1048] T 56bba8336a054d969e18859a84f180d6 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:09.131018  2391 raft_consensus.cc:385] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.156971  2391 raft_consensus.cc:740] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.159993  2391 consensus_queue.cc:260] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:09.161172  2402 tablet_bootstrap.cc:492] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 79b6e57d59e4468ebe4423d871a31b39: Bootstrap starting.
I20260709 13:12:09.167382  2391 ts_tablet_manager.cc:1434] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.001s
I20260709 13:12:09.173415  2391 tablet_bootstrap.cc:492] T 765b8df93039426e925b94637a061cc2 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:09.177928  2407 raft_consensus.cc:493] T 765b8df93039426e925b94637a061cc2 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.178318  2456 raft_consensus.cc:493] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.178460  2407 raft_consensus.cc:515] T 765b8df93039426e925b94637a061cc2 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:09.178793  2456 raft_consensus.cc:515] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:09.184118  2407 leader_election.cc:290] T 765b8df93039426e925b94637a061cc2 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:09.184461  2392 tablet_bootstrap.cc:492] T d3370eb67fff4896b1f8e3ce56eceb9b P 66e9a8fffd4b4e5a81ca4fa2762773ea: No bootstrap required, opened a new log
I20260709 13:12:09.184352  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "765b8df93039426e925b94637a061cc2" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:09.184684  2196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f0f1b0143c4363a9b900eae4ac3ea9" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:09.184989  2392 ts_tablet_manager.cc:1403] T d3370eb67fff4896b1f8e3ce56eceb9b P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent bootstrapping tablet: real 0.047s	user 0.014s	sys 0.016s
I20260709 13:12:09.185099  2345 raft_consensus.cc:2468] T 765b8df93039426e925b94637a061cc2 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 0.
I20260709 13:12:09.185336  2196 raft_consensus.cc:2468] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 0.
I20260709 13:12:09.191229  2392 raft_consensus.cc:359] T d3370eb67fff4896b1f8e3ce56eceb9b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:09.191967  2392 raft_consensus.cc:385] T d3370eb67fff4896b1f8e3ce56eceb9b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.192248  2392 raft_consensus.cc:740] T d3370eb67fff4896b1f8e3ce56eceb9b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.191787  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f0f1b0143c4363a9b900eae4ac3ea9" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:09.194519  2393 tablet_bootstrap.cc:492] T d7a50365dcc843f4a4f6bfb29a736f26 P 0ec6a5d1452a41bd992a8c7922473b35: No bootstrap required, opened a new log
I20260709 13:12:09.194814  2271 raft_consensus.cc:2468] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 0.
I20260709 13:12:09.187827  2456 leader_election.cc:290] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:09.195151  2393 ts_tablet_manager.cc:1403] T d7a50365dcc843f4a4f6bfb29a736f26 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent bootstrapping tablet: real 0.051s	user 0.014s	sys 0.010s
I20260709 13:12:09.195086  2311 leader_election.cc:304] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:09.196259  2456 raft_consensus.cc:2804] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:09.196605  2456 raft_consensus.cc:493] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.196898  2162 leader_election.cc:304] T 765b8df93039426e925b94637a061cc2 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:09.196918  2456 raft_consensus.cc:3060] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.197649  2407 raft_consensus.cc:2804] T 765b8df93039426e925b94637a061cc2 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:09.198045  2407 raft_consensus.cc:493] T 765b8df93039426e925b94637a061cc2 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.194567  2392 consensus_queue.cc:260] T d3370eb67fff4896b1f8e3ce56eceb9b P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:09.198346  2407 raft_consensus.cc:3060] T 765b8df93039426e925b94637a061cc2 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.201241  2392 ts_tablet_manager.cc:1434] T d3370eb67fff4896b1f8e3ce56eceb9b P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:12:09.202328  2402 tablet_bootstrap.cc:654] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 79b6e57d59e4468ebe4423d871a31b39: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.202185  2393 raft_consensus.cc:359] T d7a50365dcc843f4a4f6bfb29a736f26 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:09.202966  2393 raft_consensus.cc:385] T d7a50365dcc843f4a4f6bfb29a736f26 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.203279  2393 raft_consensus.cc:740] T d7a50365dcc843f4a4f6bfb29a736f26 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.205447  2393 consensus_queue.cc:260] T d7a50365dcc843f4a4f6bfb29a736f26 P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:09.207109  2392 tablet_bootstrap.cc:492] T 7475d672f7b3489393d6202c8b31e47f P 66e9a8fffd4b4e5a81ca4fa2762773ea: Bootstrap starting.
I20260709 13:12:09.212337  2407 raft_consensus.cc:515] T 765b8df93039426e925b94637a061cc2 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:09.214818  2456 raft_consensus.cc:515] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:09.217803  2196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f0f1b0143c4363a9b900eae4ac3ea9" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:09.218420  2196 raft_consensus.cc:3060] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.214715  2392 tablet_bootstrap.cc:654] T 7475d672f7b3489393d6202c8b31e47f P 66e9a8fffd4b4e5a81ca4fa2762773ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.220069  2407 leader_election.cc:290] T 765b8df93039426e925b94637a061cc2 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 election: Requested vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:09.223737  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "765b8df93039426e925b94637a061cc2" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:09.228917  2391 tablet_bootstrap.cc:654] T 765b8df93039426e925b94637a061cc2 P 2ac5c5682f914ed9b9982b5a080d5472: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.229043  2346 raft_consensus.cc:3060] T 765b8df93039426e925b94637a061cc2 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.234992  2402 tablet_bootstrap.cc:492] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 79b6e57d59e4468ebe4423d871a31b39: No bootstrap required, opened a new log
I20260709 13:12:09.228331  2196 raft_consensus.cc:2468] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 1.
I20260709 13:12:09.238138  2402 ts_tablet_manager.cc:1403] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 79b6e57d59e4468ebe4423d871a31b39: Time spent bootstrapping tablet: real 0.077s	user 0.011s	sys 0.002s
I20260709 13:12:09.238831  2311 leader_election.cc:304] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:09.239045  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f0f1b0143c4363a9b900eae4ac3ea9" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:09.239672  2401 raft_consensus.cc:2804] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:09.239691  2272 raft_consensus.cc:3060] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.240358  2401 raft_consensus.cc:697] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 LEADER]: Becoming Leader. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Running, Role: LEADER
I20260709 13:12:09.241204  2401 consensus_queue.cc:237] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:09.242022  2402 raft_consensus.cc:359] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:09.242640  2402 raft_consensus.cc:385] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.242894  2402 raft_consensus.cc:740] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.244733  2393 ts_tablet_manager.cc:1434] T d7a50365dcc843f4a4f6bfb29a736f26 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.014s
I20260709 13:12:09.245780  2393 tablet_bootstrap.cc:492] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35: Bootstrap starting.
I20260709 13:12:09.245676  2402 consensus_queue.cc:260] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:09.247051  2272 raft_consensus.cc:2468] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 1.
I20260709 13:12:09.236793  2346 raft_consensus.cc:2468] T 765b8df93039426e925b94637a061cc2 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 1.
I20260709 13:12:09.249672  2392 tablet_bootstrap.cc:492] T 7475d672f7b3489393d6202c8b31e47f P 66e9a8fffd4b4e5a81ca4fa2762773ea: No bootstrap required, opened a new log
I20260709 13:12:09.250198  2392 ts_tablet_manager.cc:1403] T 7475d672f7b3489393d6202c8b31e47f P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent bootstrapping tablet: real 0.044s	user 0.015s	sys 0.003s
I20260709 13:12:09.250344  2162 leader_election.cc:304] T 765b8df93039426e925b94637a061cc2 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:09.251168  2456 leader_election.cc:290] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 election: Requested vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:09.252151  2475 raft_consensus.cc:2804] T 765b8df93039426e925b94637a061cc2 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:09.252707  2475 raft_consensus.cc:697] T 765b8df93039426e925b94637a061cc2 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 LEADER]: Becoming Leader. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Running, Role: LEADER
I20260709 13:12:09.253520  2475 consensus_queue.cc:237] T 765b8df93039426e925b94637a061cc2 P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:09.254863  2402 ts_tablet_manager.cc:1434] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 79b6e57d59e4468ebe4423d871a31b39: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:12:09.255420  2393 tablet_bootstrap.cc:654] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.255873  2402 tablet_bootstrap.cc:492] T 2e178ff57d964223aca095ceff76b339 P 79b6e57d59e4468ebe4423d871a31b39: Bootstrap starting.
I20260709 13:12:09.257377  2407 raft_consensus.cc:493] T 2993800f8e7e4c09bfe0b2be13e4394c P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.257872  2407 raft_consensus.cc:515] T 2993800f8e7e4c09bfe0b2be13e4394c P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:09.258801  2392 raft_consensus.cc:359] T 7475d672f7b3489393d6202c8b31e47f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:09.259454  2392 raft_consensus.cc:385] T 7475d672f7b3489393d6202c8b31e47f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.259711  2392 raft_consensus.cc:740] T 7475d672f7b3489393d6202c8b31e47f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.259783  2407 leader_election.cc:290] T 2993800f8e7e4c09bfe0b2be13e4394c P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:09.260480  2392 consensus_queue.cc:260] T 7475d672f7b3489393d6202c8b31e47f P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:09.261960  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2993800f8e7e4c09bfe0b2be13e4394c" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:09.262468  2392 ts_tablet_manager.cc:1434] T 7475d672f7b3489393d6202c8b31e47f P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.003s
I20260709 13:12:09.262718  2346 raft_consensus.cc:2393] T 2993800f8e7e4c09bfe0b2be13e4394c P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec6a5d1452a41bd992a8c7922473b35 in current term 1: Already voted for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in this term.
I20260709 13:12:09.266199  2393 tablet_bootstrap.cc:492] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35: No bootstrap required, opened a new log
I20260709 13:12:09.266638  2393 ts_tablet_manager.cc:1403] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35: Time spent bootstrapping tablet: real 0.021s	user 0.005s	sys 0.004s
I20260709 13:12:09.269279  2393 raft_consensus.cc:359] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:09.269934  2393 raft_consensus.cc:385] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.270231  2393 raft_consensus.cc:740] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.263329  2392 tablet_bootstrap.cc:492] T 8a672ef15abf47e4b650405c29044d3e P 66e9a8fffd4b4e5a81ca4fa2762773ea: Bootstrap starting.
I20260709 13:12:09.270785  2422 raft_consensus.cc:493] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.265734  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2993800f8e7e4c09bfe0b2be13e4394c" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:09.271286  2422 raft_consensus.cc:515] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:09.271906  2272 raft_consensus.cc:2393] T 2993800f8e7e4c09bfe0b2be13e4394c P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec6a5d1452a41bd992a8c7922473b35 in current term 1: Already voted for candidate 79b6e57d59e4468ebe4423d871a31b39 in this term.
I20260709 13:12:09.272922  2162 leader_election.cc:304] T 2993800f8e7e4c09bfe0b2be13e4394c P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35; no voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:09.274022  2407 raft_consensus.cc:3060] T 2993800f8e7e4c09bfe0b2be13e4394c P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.273286  2422 leader_election.cc:290] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:09.274966  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a50365dcc843f4a4f6bfb29a736f26" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:09.275591  2346 raft_consensus.cc:2468] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 0.
I20260709 13:12:09.276292  2392 tablet_bootstrap.cc:654] T 8a672ef15abf47e4b650405c29044d3e P 66e9a8fffd4b4e5a81ca4fa2762773ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.276638  2087 leader_election.cc:304] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:09.277473  2422 raft_consensus.cc:2804] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:09.277858  2422 raft_consensus.cc:493] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.274967  2196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a50365dcc843f4a4f6bfb29a736f26" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:09.278417  2422 raft_consensus.cc:3060] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.278609  2196 raft_consensus.cc:2468] T d7a50365dcc843f4a4f6bfb29a736f26 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 0.
I20260709 13:12:09.270829  2393 consensus_queue.cc:260] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:09.277112  2020 catalog_manager.cc:5697] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 66e9a8fffd4b4e5a81ca4fa2762773ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68). New cstate: current_term: 1 leader_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:09.282285  2123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "765b8df93039426e925b94637a061cc2" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:09.283365  2122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "765b8df93039426e925b94637a061cc2" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:09.283581  2448 raft_consensus.cc:493] T e259bf23e7904d9fb8b2345bb5b667f3 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.284060  2448 raft_consensus.cc:515] T e259bf23e7904d9fb8b2345bb5b667f3 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
W20260709 13:12:09.284931  2162 leader_election.cc:343] T 765b8df93039426e925b94637a061cc2 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:09.285910  2162 leader_election.cc:343] T 765b8df93039426e925b94637a061cc2 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:09.286497  2448 leader_election.cc:290] T e259bf23e7904d9fb8b2345bb5b667f3 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:09.287390  2122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e259bf23e7904d9fb8b2345bb5b667f3" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:09.287997  2122 raft_consensus.cc:2468] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 0.
I20260709 13:12:09.288569  2393 ts_tablet_manager.cc:1434] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 13:12:09.289023  2236 leader_election.cc:304] T e259bf23e7904d9fb8b2345bb5b667f3 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:09.289495  2393 tablet_bootstrap.cc:492] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35: Bootstrap starting.
I20260709 13:12:09.289706  2196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e259bf23e7904d9fb8b2345bb5b667f3" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:09.289913  2448 raft_consensus.cc:2804] T e259bf23e7904d9fb8b2345bb5b667f3 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:09.290331  2448 raft_consensus.cc:493] T e259bf23e7904d9fb8b2345bb5b667f3 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.290691  2448 raft_consensus.cc:3060] T e259bf23e7904d9fb8b2345bb5b667f3 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.290345  2196 raft_consensus.cc:2468] T e259bf23e7904d9fb8b2345bb5b667f3 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 0.
I20260709 13:12:09.293747  2407 raft_consensus.cc:2749] T 2993800f8e7e4c09bfe0b2be13e4394c P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:09.296156  2393 tablet_bootstrap.cc:654] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.299118  2392 tablet_bootstrap.cc:492] T 8a672ef15abf47e4b650405c29044d3e P 66e9a8fffd4b4e5a81ca4fa2762773ea: No bootstrap required, opened a new log
I20260709 13:12:09.299507  2392 ts_tablet_manager.cc:1403] T 8a672ef15abf47e4b650405c29044d3e P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent bootstrapping tablet: real 0.036s	user 0.007s	sys 0.003s
I20260709 13:12:09.302086  2402 tablet_bootstrap.cc:654] T 2e178ff57d964223aca095ceff76b339 P 79b6e57d59e4468ebe4423d871a31b39: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.308229  2019 catalog_manager.cc:5697] T 765b8df93039426e925b94637a061cc2 P 0ec6a5d1452a41bd992a8c7922473b35 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66). New cstate: current_term: 1 leader_uuid: "0ec6a5d1452a41bd992a8c7922473b35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:09.310513  2448 raft_consensus.cc:515] T e259bf23e7904d9fb8b2345bb5b667f3 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:09.310858  2392 raft_consensus.cc:359] T 8a672ef15abf47e4b650405c29044d3e P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:09.311569  2392 raft_consensus.cc:385] T 8a672ef15abf47e4b650405c29044d3e P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.311825  2392 raft_consensus.cc:740] T 8a672ef15abf47e4b650405c29044d3e P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.313700  2122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e259bf23e7904d9fb8b2345bb5b667f3" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:09.314096  2196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e259bf23e7904d9fb8b2345bb5b667f3" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:09.314713  2122 raft_consensus.cc:3060] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.312462  2392 consensus_queue.cc:260] T 8a672ef15abf47e4b650405c29044d3e P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:09.314786  2196 raft_consensus.cc:3060] T e259bf23e7904d9fb8b2345bb5b667f3 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.324563  2196 raft_consensus.cc:2468] T e259bf23e7904d9fb8b2345bb5b667f3 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 1.
I20260709 13:12:09.326771  2392 ts_tablet_manager.cc:1434] T 8a672ef15abf47e4b650405c29044d3e P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.001s
I20260709 13:12:09.327814  2392 tablet_bootstrap.cc:492] T 12b5593f051548fea374da76afa08c3f P 66e9a8fffd4b4e5a81ca4fa2762773ea: Bootstrap starting.
I20260709 13:12:09.328091  2122 raft_consensus.cc:2468] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 1.
I20260709 13:12:09.325102  2448 leader_election.cc:290] T e259bf23e7904d9fb8b2345bb5b667f3 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 election: Requested vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:09.327759  2237 leader_election.cc:304] T e259bf23e7904d9fb8b2345bb5b667f3 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:09.332726  2422 raft_consensus.cc:515] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:09.334137  2419 raft_consensus.cc:2804] T e259bf23e7904d9fb8b2345bb5b667f3 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:09.334663  2419 raft_consensus.cc:697] T e259bf23e7904d9fb8b2345bb5b667f3 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 LEADER]: Becoming Leader. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Running, Role: LEADER
I20260709 13:12:09.335505  2419 consensus_queue.cc:237] T e259bf23e7904d9fb8b2345bb5b667f3 P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:09.337476  2392 tablet_bootstrap.cc:654] T 12b5593f051548fea374da76afa08c3f P 66e9a8fffd4b4e5a81ca4fa2762773ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.338177  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a50365dcc843f4a4f6bfb29a736f26" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:09.338797  2346 raft_consensus.cc:3060] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.343436  2196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a50365dcc843f4a4f6bfb29a736f26" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:09.344019  2196 raft_consensus.cc:3060] T d7a50365dcc843f4a4f6bfb29a736f26 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.347570  2346 raft_consensus.cc:2468] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 1.
I20260709 13:12:09.348861  2087 leader_election.cc:304] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:09.349812  2451 raft_consensus.cc:2804] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:09.350251  2451 raft_consensus.cc:697] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 LEADER]: Becoming Leader. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Running, Role: LEADER
I20260709 13:12:09.350992  2451 consensus_queue.cc:237] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:09.351840  2422 leader_election.cc:290] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 election: Requested vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:09.351332  2196 raft_consensus.cc:2468] T d7a50365dcc843f4a4f6bfb29a736f26 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 1.
I20260709 13:12:09.358074  2402 tablet_bootstrap.cc:492] T 2e178ff57d964223aca095ceff76b339 P 79b6e57d59e4468ebe4423d871a31b39: No bootstrap required, opened a new log
I20260709 13:12:09.358378  2391 tablet_bootstrap.cc:492] T 765b8df93039426e925b94637a061cc2 P 2ac5c5682f914ed9b9982b5a080d5472: No bootstrap required, opened a new log
I20260709 13:12:09.358547  2402 ts_tablet_manager.cc:1403] T 2e178ff57d964223aca095ceff76b339 P 79b6e57d59e4468ebe4423d871a31b39: Time spent bootstrapping tablet: real 0.103s	user 0.011s	sys 0.000s
I20260709 13:12:09.359017  2391 ts_tablet_manager.cc:1403] T 765b8df93039426e925b94637a061cc2 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.186s	user 0.021s	sys 0.025s
I20260709 13:12:09.361265  2402 raft_consensus.cc:359] T 2e178ff57d964223aca095ceff76b339 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:09.361951  2402 raft_consensus.cc:385] T 2e178ff57d964223aca095ceff76b339 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.362265  2402 raft_consensus.cc:740] T 2e178ff57d964223aca095ceff76b339 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.364339  2391 raft_consensus.cc:359] T 765b8df93039426e925b94637a061cc2 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:09.365083  2391 raft_consensus.cc:385] T 765b8df93039426e925b94637a061cc2 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.365413  2391 raft_consensus.cc:740] T 765b8df93039426e925b94637a061cc2 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.365491  2402 consensus_queue.cc:260] T 2e178ff57d964223aca095ceff76b339 P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:09.366438  2391 consensus_queue.cc:260] T 765b8df93039426e925b94637a061cc2 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:09.369969  2020 catalog_manager.cc:5697] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "2ac5c5682f914ed9b9982b5a080d5472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:09.371693  2391 ts_tablet_manager.cc:1434] T 765b8df93039426e925b94637a061cc2 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:12:09.372880  2391 tablet_bootstrap.cc:492] T 7475d672f7b3489393d6202c8b31e47f P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:09.373366  2018 catalog_manager.cc:5697] T e259bf23e7904d9fb8b2345bb5b667f3 P 79b6e57d59e4468ebe4423d871a31b39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67). New cstate: current_term: 1 leader_uuid: "79b6e57d59e4468ebe4423d871a31b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:09.374792  2392 tablet_bootstrap.cc:492] T 12b5593f051548fea374da76afa08c3f P 66e9a8fffd4b4e5a81ca4fa2762773ea: No bootstrap required, opened a new log
I20260709 13:12:09.375265  2392 ts_tablet_manager.cc:1403] T 12b5593f051548fea374da76afa08c3f P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent bootstrapping tablet: real 0.048s	user 0.011s	sys 0.001s
I20260709 13:12:09.378288  2392 raft_consensus.cc:359] T 12b5593f051548fea374da76afa08c3f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:09.378894  2392 raft_consensus.cc:385] T 12b5593f051548fea374da76afa08c3f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.379137  2392 raft_consensus.cc:740] T 12b5593f051548fea374da76afa08c3f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.379755  2392 consensus_queue.cc:260] T 12b5593f051548fea374da76afa08c3f P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:09.380537  2391 tablet_bootstrap.cc:654] T 7475d672f7b3489393d6202c8b31e47f P 2ac5c5682f914ed9b9982b5a080d5472: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.381824  2393 tablet_bootstrap.cc:492] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35: No bootstrap required, opened a new log
I20260709 13:12:09.382263  2393 ts_tablet_manager.cc:1403] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent bootstrapping tablet: real 0.093s	user 0.036s	sys 0.014s
I20260709 13:12:09.384752  2393 raft_consensus.cc:359] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:09.385370  2393 raft_consensus.cc:385] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.385644  2393 raft_consensus.cc:740] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.386283  2393 consensus_queue.cc:260] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:09.388386  2392 ts_tablet_manager.cc:1434] T 12b5593f051548fea374da76afa08c3f P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:12:09.389578  2392 tablet_bootstrap.cc:492] T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Bootstrap starting.
I20260709 13:12:09.390106  2402 ts_tablet_manager.cc:1434] T 2e178ff57d964223aca095ceff76b339 P 79b6e57d59e4468ebe4423d871a31b39: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 13:12:09.391059  2402 tablet_bootstrap.cc:492] T 8a672ef15abf47e4b650405c29044d3e P 79b6e57d59e4468ebe4423d871a31b39: Bootstrap starting.
I20260709 13:12:09.391477  2391 tablet_bootstrap.cc:492] T 7475d672f7b3489393d6202c8b31e47f P 2ac5c5682f914ed9b9982b5a080d5472: No bootstrap required, opened a new log
I20260709 13:12:09.391927  2391 ts_tablet_manager.cc:1403] T 7475d672f7b3489393d6202c8b31e47f P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.008s
I20260709 13:12:09.394886  2392 tablet_bootstrap.cc:654] T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.394559  2391 raft_consensus.cc:359] T 7475d672f7b3489393d6202c8b31e47f P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:09.395328  2391 raft_consensus.cc:385] T 7475d672f7b3489393d6202c8b31e47f P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.395619  2391 raft_consensus.cc:740] T 7475d672f7b3489393d6202c8b31e47f P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.396240  2391 consensus_queue.cc:260] T 7475d672f7b3489393d6202c8b31e47f P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:09.397233  2393 ts_tablet_manager.cc:1434] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 13:12:09.398164  2393 tablet_bootstrap.cc:492] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35: Bootstrap starting.
I20260709 13:12:09.402122  2402 tablet_bootstrap.cc:654] T 8a672ef15abf47e4b650405c29044d3e P 79b6e57d59e4468ebe4423d871a31b39: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.403434  2393 tablet_bootstrap.cc:654] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.406847  2391 ts_tablet_manager.cc:1434] T 7475d672f7b3489393d6202c8b31e47f P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.015s	user 0.013s	sys 0.002s
I20260709 13:12:09.407858  2391 tablet_bootstrap.cc:492] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:09.413506  2391 tablet_bootstrap.cc:654] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.415710  2475 raft_consensus.cc:493] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.416261  2475 raft_consensus.cc:515] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:09.418421  2475 leader_election.cc:290] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:09.420601  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0fb3f7bf85419cbf7ecda4727ccb89" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
W20260709 13:12:09.422075  2162 leader_election.cc:343] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:09.422881  2122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0fb3f7bf85419cbf7ecda4727ccb89" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
W20260709 13:12:09.424232  2162 leader_election.cc:343] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:09.424640  2162 leader_election.cc:304] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:09.425491  2391 tablet_bootstrap.cc:492] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472: No bootstrap required, opened a new log
I20260709 13:12:09.425668  2475 raft_consensus.cc:2749] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:09.425983  2391 ts_tablet_manager.cc:1403] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.003s
I20260709 13:12:09.428834  2391 raft_consensus.cc:359] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:09.429555  2391 raft_consensus.cc:385] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.429841  2391 raft_consensus.cc:740] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.430341  2392 tablet_bootstrap.cc:492] T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea: No bootstrap required, opened a new log
I20260709 13:12:09.430985  2392 ts_tablet_manager.cc:1403] T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.002s
I20260709 13:12:09.430694  2391 consensus_queue.cc:260] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:09.432723  2402 tablet_bootstrap.cc:492] T 8a672ef15abf47e4b650405c29044d3e P 79b6e57d59e4468ebe4423d871a31b39: No bootstrap required, opened a new log
I20260709 13:12:09.433003  2391 ts_tablet_manager.cc:1434] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:12:09.433291  2402 ts_tablet_manager.cc:1403] T 8a672ef15abf47e4b650405c29044d3e P 79b6e57d59e4468ebe4423d871a31b39: Time spent bootstrapping tablet: real 0.042s	user 0.018s	sys 0.006s
I20260709 13:12:09.433641  2392 raft_consensus.cc:359] T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:09.434165  2391 tablet_bootstrap.cc:492] T d3370eb67fff4896b1f8e3ce56eceb9b P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:09.434333  2392 raft_consensus.cc:385] T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.434715  2392 raft_consensus.cc:740] T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.435485  2392 consensus_queue.cc:260] T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:09.436026  2402 raft_consensus.cc:359] T 8a672ef15abf47e4b650405c29044d3e P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:09.436730  2402 raft_consensus.cc:385] T 8a672ef15abf47e4b650405c29044d3e P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.437027  2402 raft_consensus.cc:740] T 8a672ef15abf47e4b650405c29044d3e P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.437975  2393 tablet_bootstrap.cc:492] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35: No bootstrap required, opened a new log
I20260709 13:12:09.437690  2402 consensus_queue.cc:260] T 8a672ef15abf47e4b650405c29044d3e P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:09.438433  2393 ts_tablet_manager.cc:1403] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent bootstrapping tablet: real 0.040s	user 0.007s	sys 0.005s
I20260709 13:12:09.440027  2402 ts_tablet_manager.cc:1434] T 8a672ef15abf47e4b650405c29044d3e P 79b6e57d59e4468ebe4423d871a31b39: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260709 13:12:09.440977  2402 tablet_bootstrap.cc:492] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39: Bootstrap starting.
I20260709 13:12:09.440755  2391 tablet_bootstrap.cc:654] T d3370eb67fff4896b1f8e3ce56eceb9b P 2ac5c5682f914ed9b9982b5a080d5472: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.447250  2402 tablet_bootstrap.cc:654] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.441023  2393 raft_consensus.cc:359] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:09.448210  2393 raft_consensus.cc:385] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.448510  2393 raft_consensus.cc:740] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.449544  2392 ts_tablet_manager.cc:1434] T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 13:12:09.449312  2393 consensus_queue.cc:260] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:09.451519  2393 ts_tablet_manager.cc:1434] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:12:09.452497  2393 tablet_bootstrap.cc:492] T d3370eb67fff4896b1f8e3ce56eceb9b P 0ec6a5d1452a41bd992a8c7922473b35: Bootstrap starting.
I20260709 13:12:09.454810  2392 tablet_bootstrap.cc:492] T 5aac56f958fb4fe29fe46d2a9be60ffd P 66e9a8fffd4b4e5a81ca4fa2762773ea: Bootstrap starting.
I20260709 13:12:09.460994  2392 tablet_bootstrap.cc:654] T 5aac56f958fb4fe29fe46d2a9be60ffd P 66e9a8fffd4b4e5a81ca4fa2762773ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.464767  2393 tablet_bootstrap.cc:654] T d3370eb67fff4896b1f8e3ce56eceb9b P 0ec6a5d1452a41bd992a8c7922473b35: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.467732  2402 tablet_bootstrap.cc:492] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39: No bootstrap required, opened a new log
I20260709 13:12:09.468334  2402 ts_tablet_manager.cc:1403] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39: Time spent bootstrapping tablet: real 0.028s	user 0.007s	sys 0.004s
I20260709 13:12:09.471355  2392 tablet_bootstrap.cc:492] T 5aac56f958fb4fe29fe46d2a9be60ffd P 66e9a8fffd4b4e5a81ca4fa2762773ea: No bootstrap required, opened a new log
I20260709 13:12:09.471840  2392 ts_tablet_manager.cc:1403] T 5aac56f958fb4fe29fe46d2a9be60ffd P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent bootstrapping tablet: real 0.017s	user 0.004s	sys 0.008s
I20260709 13:12:09.471401  2402 raft_consensus.cc:359] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:09.473332  2402 raft_consensus.cc:385] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.473587  2402 raft_consensus.cc:740] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.474227  2391 tablet_bootstrap.cc:492] T d3370eb67fff4896b1f8e3ce56eceb9b P 2ac5c5682f914ed9b9982b5a080d5472: No bootstrap required, opened a new log
I20260709 13:12:09.474217  2392 raft_consensus.cc:359] T 5aac56f958fb4fe29fe46d2a9be60ffd P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:09.474255  2402 consensus_queue.cc:260] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:09.475111  2391 ts_tablet_manager.cc:1403] T d3370eb67fff4896b1f8e3ce56eceb9b P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.041s	user 0.011s	sys 0.025s
I20260709 13:12:09.475219  2392 raft_consensus.cc:385] T 5aac56f958fb4fe29fe46d2a9be60ffd P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.475610  2392 raft_consensus.cc:740] T 5aac56f958fb4fe29fe46d2a9be60ffd P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.476258  2392 consensus_queue.cc:260] T 5aac56f958fb4fe29fe46d2a9be60ffd P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:09.477658  2402 ts_tablet_manager.cc:1434] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:12:09.476331  2393 tablet_bootstrap.cc:492] T d3370eb67fff4896b1f8e3ce56eceb9b P 0ec6a5d1452a41bd992a8c7922473b35: No bootstrap required, opened a new log
I20260709 13:12:09.477862  2391 raft_consensus.cc:359] T d3370eb67fff4896b1f8e3ce56eceb9b P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:09.478762  2391 raft_consensus.cc:385] T d3370eb67fff4896b1f8e3ce56eceb9b P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.479040  2391 raft_consensus.cc:740] T d3370eb67fff4896b1f8e3ce56eceb9b P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.479303  2393 ts_tablet_manager.cc:1403] T d3370eb67fff4896b1f8e3ce56eceb9b P 0ec6a5d1452a41bd992a8c7922473b35: Time spent bootstrapping tablet: real 0.027s	user 0.010s	sys 0.001s
I20260709 13:12:09.479678  2391 consensus_queue.cc:260] T d3370eb67fff4896b1f8e3ce56eceb9b P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:09.481901  2393 raft_consensus.cc:359] T d3370eb67fff4896b1f8e3ce56eceb9b P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:09.482528  2393 raft_consensus.cc:385] T d3370eb67fff4896b1f8e3ce56eceb9b P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.482771  2393 raft_consensus.cc:740] T d3370eb67fff4896b1f8e3ce56eceb9b P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.483490  2393 consensus_queue.cc:260] T d3370eb67fff4896b1f8e3ce56eceb9b P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:09.484091  2391 ts_tablet_manager.cc:1434] T d3370eb67fff4896b1f8e3ce56eceb9b P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 13:12:09.485466  2401 raft_consensus.cc:493] T 01a3c95e54104a998cdf16d06db2800a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.485675  2393 ts_tablet_manager.cc:1434] T d3370eb67fff4896b1f8e3ce56eceb9b P 0ec6a5d1452a41bd992a8c7922473b35: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:12:09.478902  2402 tablet_bootstrap.cc:492] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39: Bootstrap starting.
I20260709 13:12:09.488644  2448 consensus_queue.cc:1048] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:09.489705  2401 raft_consensus.cc:515] T 01a3c95e54104a998cdf16d06db2800a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:09.490778  2391 tablet_bootstrap.cc:492] T 0668be6a554b4c5f8bf93d0588a6bfcc P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:09.491789  2401 leader_election.cc:290] T 01a3c95e54104a998cdf16d06db2800a P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:09.493459  2393 tablet_bootstrap.cc:492] T bdee3fd7553a47afae3ec9dbdce6d829 P 0ec6a5d1452a41bd992a8c7922473b35: Bootstrap starting.
I20260709 13:12:09.494078  2451 consensus_queue.cc:1048] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:09.496827  2391 tablet_bootstrap.cc:654] T 0668be6a554b4c5f8bf93d0588a6bfcc P 2ac5c5682f914ed9b9982b5a080d5472: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.498361  2419 consensus_queue.cc:1048] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:09.499361  2393 tablet_bootstrap.cc:654] T bdee3fd7553a47afae3ec9dbdce6d829 P 0ec6a5d1452a41bd992a8c7922473b35: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.500558  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a3c95e54104a998cdf16d06db2800a" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:09.501799  2198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a3c95e54104a998cdf16d06db2800a" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:09.502344  2402 tablet_bootstrap.cc:654] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:09.503180  2311 leader_election.cc:343] T 01a3c95e54104a998cdf16d06db2800a P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:09.505213  2392 ts_tablet_manager.cc:1434] T 5aac56f958fb4fe29fe46d2a9be60ffd P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.001s
W20260709 13:12:09.509327  2310 leader_election.cc:343] T 01a3c95e54104a998cdf16d06db2800a P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:09.509685  2393 tablet_bootstrap.cc:492] T bdee3fd7553a47afae3ec9dbdce6d829 P 0ec6a5d1452a41bd992a8c7922473b35: No bootstrap required, opened a new log
I20260709 13:12:09.509778  2310 leader_election.cc:304] T 01a3c95e54104a998cdf16d06db2800a P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:09.510257  2393 ts_tablet_manager.cc:1403] T bdee3fd7553a47afae3ec9dbdce6d829 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.002s
I20260709 13:12:09.510910  2456 raft_consensus.cc:493] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.511394  2456 raft_consensus.cc:515] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:09.512856  2393 raft_consensus.cc:359] T bdee3fd7553a47afae3ec9dbdce6d829 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:09.513309  2456 leader_election.cc:290] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:09.514534  2392 tablet_bootstrap.cc:492] T 28f2272230d34efa880d5eeed8859669 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Bootstrap starting.
I20260709 13:12:09.514745  2402 tablet_bootstrap.cc:492] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39: No bootstrap required, opened a new log
I20260709 13:12:09.515232  2402 ts_tablet_manager.cc:1403] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.000s
I20260709 13:12:09.517908  2402 raft_consensus.cc:359] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:09.518517  2402 raft_consensus.cc:385] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.518827  2402 raft_consensus.cc:740] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.519410  2402 consensus_queue.cc:260] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:09.520550  2123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e178ff57d964223aca095ceff76b339" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:09.521080  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e178ff57d964223aca095ceff76b339" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:09.521723  2272 raft_consensus.cc:2468] T 2e178ff57d964223aca095ceff76b339 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 0.
I20260709 13:12:09.523741  2402 ts_tablet_manager.cc:1434] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:12:09.524667  2402 tablet_bootstrap.cc:492] T 01a3c95e54104a998cdf16d06db2800a P 79b6e57d59e4468ebe4423d871a31b39: Bootstrap starting.
I20260709 13:12:09.526249  2392 tablet_bootstrap.cc:654] T 28f2272230d34efa880d5eeed8859669 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.528945  2393 raft_consensus.cc:385] T bdee3fd7553a47afae3ec9dbdce6d829 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.529258  2393 raft_consensus.cc:740] T bdee3fd7553a47afae3ec9dbdce6d829 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.530042  2393 consensus_queue.cc:260] T bdee3fd7553a47afae3ec9dbdce6d829 P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:09.534292  2456 raft_consensus.cc:2749] T 01a3c95e54104a998cdf16d06db2800a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:09.535893  2402 tablet_bootstrap.cc:654] T 01a3c95e54104a998cdf16d06db2800a P 79b6e57d59e4468ebe4423d871a31b39: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.536720  2310 leader_election.cc:304] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
W20260709 13:12:09.537621  2310 leader_election.cc:343] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:09.538166  2069 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:09.538911  2393 ts_tablet_manager.cc:1434] T bdee3fd7553a47afae3ec9dbdce6d829 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.001s
I20260709 13:12:09.539842  2393 tablet_bootstrap.cc:492] T 01a3c95e54104a998cdf16d06db2800a P 0ec6a5d1452a41bd992a8c7922473b35: Bootstrap starting.
I20260709 13:12:09.539958  2448 consensus_queue.cc:1048] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:09.543620  2392 tablet_bootstrap.cc:492] T 28f2272230d34efa880d5eeed8859669 P 66e9a8fffd4b4e5a81ca4fa2762773ea: No bootstrap required, opened a new log
I20260709 13:12:09.544198  2392 ts_tablet_manager.cc:1403] T 28f2272230d34efa880d5eeed8859669 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.002s
I20260709 13:12:09.546062  2393 tablet_bootstrap.cc:654] T 01a3c95e54104a998cdf16d06db2800a P 0ec6a5d1452a41bd992a8c7922473b35: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.547310  2392 raft_consensus.cc:359] T 28f2272230d34efa880d5eeed8859669 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:09.548081  2392 raft_consensus.cc:385] T 28f2272230d34efa880d5eeed8859669 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.548374  2392 raft_consensus.cc:740] T 28f2272230d34efa880d5eeed8859669 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.549010  2443 raft_consensus.cc:2804] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:09.549393  2448 raft_consensus.cc:493] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.549057  2392 consensus_queue.cc:260] T 28f2272230d34efa880d5eeed8859669 P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:09.549619  2443 raft_consensus.cc:493] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.550148  2443 raft_consensus.cc:3060] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.549952  2448 raft_consensus.cc:515] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:09.551328  2392 ts_tablet_manager.cc:1434] T 28f2272230d34efa880d5eeed8859669 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:12:09.551972  2448 leader_election.cc:290] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:09.555110  2123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7475d672f7b3489393d6202c8b31e47f" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:09.555790  2123 raft_consensus.cc:2468] T 7475d672f7b3489393d6202c8b31e47f P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 0.
I20260709 13:12:09.557726  2443 raft_consensus.cc:515] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:09.559743  2443 leader_election.cc:290] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 election: Requested vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:09.567502  2402 tablet_bootstrap.cc:492] T 01a3c95e54104a998cdf16d06db2800a P 79b6e57d59e4468ebe4423d871a31b39: No bootstrap required, opened a new log
I20260709 13:12:09.569546  2236 leader_election.cc:304] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:09.569669  2402 ts_tablet_manager.cc:1403] T 01a3c95e54104a998cdf16d06db2800a P 79b6e57d59e4468ebe4423d871a31b39: Time spent bootstrapping tablet: real 0.045s	user 0.012s	sys 0.000s
I20260709 13:12:09.573523  2508 consensus_queue.cc:1048] T 7e716da7cd3d4ad390e049dc845b8004 P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:09.574061  2452 raft_consensus.cc:2804] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:09.576397  2452 raft_consensus.cc:493] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.576728  2452 raft_consensus.cc:3060] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.578994  2475 raft_consensus.cc:493] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.579459  2475 raft_consensus.cc:515] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:09.581498  2475 leader_election.cc:290] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:09.581940  2392 tablet_bootstrap.cc:492] T 86834d94d1d64596abfa609754b5d58a P 66e9a8fffd4b4e5a81ca4fa2762773ea: Bootstrap starting.
I20260709 13:12:09.583401  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc02522cf9704f58a9d2bfd5326e3625" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
W20260709 13:12:09.584903  2162 leader_election.cc:343] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:09.585956  2448 consensus_queue.cc:1048] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:09.587086  2452 raft_consensus.cc:515] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:09.575665  2402 raft_consensus.cc:359] T 01a3c95e54104a998cdf16d06db2800a P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:09.591727  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e178ff57d964223aca095ceff76b339" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:09.601631  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7475d672f7b3489393d6202c8b31e47f" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:09.602190  2271 raft_consensus.cc:3060] T 2e178ff57d964223aca095ceff76b339 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.602025  2402 raft_consensus.cc:385] T 01a3c95e54104a998cdf16d06db2800a P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.602676  2402 raft_consensus.cc:740] T 01a3c95e54104a998cdf16d06db2800a P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.603390  2402 consensus_queue.cc:260] T 01a3c95e54104a998cdf16d06db2800a P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:09.588351  2392 tablet_bootstrap.cc:654] T 86834d94d1d64596abfa609754b5d58a P 66e9a8fffd4b4e5a81ca4fa2762773ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.592475  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7475d672f7b3489393d6202c8b31e47f" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:09.606019  2120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7475d672f7b3489393d6202c8b31e47f" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:09.593855  2121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e178ff57d964223aca095ceff76b339" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:09.606627  2120 raft_consensus.cc:3060] T 7475d672f7b3489393d6202c8b31e47f P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.596000  2456 raft_consensus.cc:493] T 7475d672f7b3489393d6202c8b31e47f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.611585  2456 raft_consensus.cc:515] T 7475d672f7b3489393d6202c8b31e47f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:09.612705  2344 raft_consensus.cc:3060] T 7475d672f7b3489393d6202c8b31e47f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.613802  2456 leader_election.cc:290] T 7475d672f7b3489393d6202c8b31e47f P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:09.613945  2120 raft_consensus.cc:2468] T 7475d672f7b3489393d6202c8b31e47f P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 1.
I20260709 13:12:09.615200  2236 leader_election.cc:304] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:09.616490  2452 leader_election.cc:290] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 election: Requested vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:09.618208  2451 consensus_queue.cc:1048] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:09.599118  2393 tablet_bootstrap.cc:492] T 01a3c95e54104a998cdf16d06db2800a P 0ec6a5d1452a41bd992a8c7922473b35: No bootstrap required, opened a new log
I20260709 13:12:09.618600  2448 raft_consensus.cc:2804] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:09.619277  2448 raft_consensus.cc:697] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39 [term 1 LEADER]: Becoming Leader. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Running, Role: LEADER
I20260709 13:12:09.620105  2448 consensus_queue.cc:237] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:09.620174  2344 raft_consensus.cc:2468] T 7475d672f7b3489393d6202c8b31e47f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 1.
I20260709 13:12:09.596880  2122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc02522cf9704f58a9d2bfd5326e3625" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:09.623502  2392 tablet_bootstrap.cc:492] T 86834d94d1d64596abfa609754b5d58a P 66e9a8fffd4b4e5a81ca4fa2762773ea: No bootstrap required, opened a new log
I20260709 13:12:09.624297  2392 ts_tablet_manager.cc:1403] T 86834d94d1d64596abfa609754b5d58a P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.000s
W20260709 13:12:09.624647  2162 leader_election.cc:343] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:09.624891  2393 ts_tablet_manager.cc:1403] T 01a3c95e54104a998cdf16d06db2800a P 0ec6a5d1452a41bd992a8c7922473b35: Time spent bootstrapping tablet: real 0.085s	user 0.011s	sys 0.001s
I20260709 13:12:09.625146  2162 leader_election.cc:304] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:09.626269  2475 raft_consensus.cc:2749] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:09.628898  2392 raft_consensus.cc:359] T 86834d94d1d64596abfa609754b5d58a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:09.595541  2508 raft_consensus.cc:493] T 8a672ef15abf47e4b650405c29044d3e P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.631414  2392 raft_consensus.cc:385] T 86834d94d1d64596abfa609754b5d58a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.630076  2271 raft_consensus.cc:2468] T 2e178ff57d964223aca095ceff76b339 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 1.
I20260709 13:12:09.633921  2392 raft_consensus.cc:740] T 86834d94d1d64596abfa609754b5d58a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.634673  2392 consensus_queue.cc:260] T 86834d94d1d64596abfa609754b5d58a P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:09.645272  2402 ts_tablet_manager.cc:1434] T 01a3c95e54104a998cdf16d06db2800a P 79b6e57d59e4468ebe4423d871a31b39: Time spent starting tablet: real 0.073s	user 0.005s	sys 0.000s
I20260709 13:12:09.646082  2393 raft_consensus.cc:359] T 01a3c95e54104a998cdf16d06db2800a P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:09.646853  2392 ts_tablet_manager.cc:1434] T 86834d94d1d64596abfa609754b5d58a P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 13:12:09.646823  2393 raft_consensus.cc:385] T 01a3c95e54104a998cdf16d06db2800a P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.647327  2393 raft_consensus.cc:740] T 01a3c95e54104a998cdf16d06db2800a P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.650920  2392 tablet_bootstrap.cc:492] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Bootstrap starting.
I20260709 13:12:09.654549  2393 consensus_queue.cc:260] T 01a3c95e54104a998cdf16d06db2800a P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:09.644187  2448 raft_consensus.cc:493] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.662564  2402 tablet_bootstrap.cc:492] T 427b10072083419c89d5a4bf5d6413fc P 79b6e57d59e4468ebe4423d871a31b39: Bootstrap starting.
I20260709 13:12:09.652040  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7475d672f7b3489393d6202c8b31e47f" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:09.658136  2419 raft_consensus.cc:493] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.664111  2419 raft_consensus.cc:515] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:09.666213  2419 leader_election.cc:290] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:09.644352  2508 raft_consensus.cc:515] T 8a672ef15abf47e4b650405c29044d3e P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:09.668000  2122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7475d672f7b3489393d6202c8b31e47f" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:09.668036  2120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4edf26b74c5d4e5d9a33d2b1fc1bb0ae" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:09.676505  2393 ts_tablet_manager.cc:1434] T 01a3c95e54104a998cdf16d06db2800a P 0ec6a5d1452a41bd992a8c7922473b35: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.000s
I20260709 13:12:09.677436  2393 tablet_bootstrap.cc:492] T 5c3646d79bc840e9b4396f4351d1803d P 0ec6a5d1452a41bd992a8c7922473b35: Bootstrap starting.
I20260709 13:12:09.679450  2475 raft_consensus.cc:493] T bdee3fd7553a47afae3ec9dbdce6d829 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.679850  2391 tablet_bootstrap.cc:492] T 0668be6a554b4c5f8bf93d0588a6bfcc P 2ac5c5682f914ed9b9982b5a080d5472: No bootstrap required, opened a new log
I20260709 13:12:09.680605  2391 ts_tablet_manager.cc:1403] T 0668be6a554b4c5f8bf93d0588a6bfcc P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.190s	user 0.060s	sys 0.067s
I20260709 13:12:09.679919  2475 raft_consensus.cc:515] T bdee3fd7553a47afae3ec9dbdce6d829 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:09.682917  2122 raft_consensus.cc:2393] T 7475d672f7b3489393d6202c8b31e47f P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in current term 1: Already voted for candidate 79b6e57d59e4468ebe4423d871a31b39 in this term.
I20260709 13:12:09.683733  2120 raft_consensus.cc:2468] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 0.
I20260709 13:12:09.684158  2475 leader_election.cc:290] T bdee3fd7553a47afae3ec9dbdce6d829 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:09.690026  2310 leader_election.cc:304] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:09.690344  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdee3fd7553a47afae3ec9dbdce6d829" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:09.689016  2401 consensus_queue.cc:1048] T 7e716da7cd3d4ad390e049dc845b8004 P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 13:12:09.692433  2443 raft_consensus.cc:2804] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:09.692902  2443 raft_consensus.cc:697] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 LEADER]: Becoming Leader. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Running, Role: LEADER
W20260709 13:12:09.693442  2162 leader_election.cc:343] T bdee3fd7553a47afae3ec9dbdce6d829 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:09.691550  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdee3fd7553a47afae3ec9dbdce6d829" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:09.693738  2443 consensus_queue.cc:237] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:09.691743  2508 leader_election.cc:290] T 8a672ef15abf47e4b650405c29044d3e P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
W20260709 13:12:09.695327  2162 leader_election.cc:343] T bdee3fd7553a47afae3ec9dbdce6d829 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:09.695803  2162 leader_election.cc:304] T bdee3fd7553a47afae3ec9dbdce6d829 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35; no voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:09.696722  2198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a672ef15abf47e4b650405c29044d3e" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:09.696888  2475 raft_consensus.cc:493] T d3370eb67fff4896b1f8e3ce56eceb9b P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.697433  2475 raft_consensus.cc:515] T d3370eb67fff4896b1f8e3ce56eceb9b P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:09.698652  2236 leader_election.cc:304] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:09.699522  2475 leader_election.cc:290] T d3370eb67fff4896b1f8e3ce56eceb9b P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:09.700070  2475 raft_consensus.cc:2749] T bdee3fd7553a47afae3ec9dbdce6d829 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:09.701608  2419 raft_consensus.cc:2804] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:09.702049  2419 raft_consensus.cc:493] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.702386  2419 raft_consensus.cc:3060] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:09.702751  2310 leader_election.cc:343] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:09.704167  2120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3370eb67fff4896b1f8e3ce56eceb9b" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:09.704681  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3370eb67fff4896b1f8e3ce56eceb9b" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:09.704813  2120 raft_consensus.cc:2468] T d3370eb67fff4896b1f8e3ce56eceb9b P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 0.
I20260709 13:12:09.705331  2346 raft_consensus.cc:2468] T d3370eb67fff4896b1f8e3ce56eceb9b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 0.
I20260709 13:12:09.663059  2448 raft_consensus.cc:515] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:09.706082  2162 leader_election.cc:304] T d3370eb67fff4896b1f8e3ce56eceb9b P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472; no voters: 
I20260709 13:12:09.707000  2483 raft_consensus.cc:2804] T d3370eb67fff4896b1f8e3ce56eceb9b P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:12:09.708710  2311 leader_election.cc:343] T 8a672ef15abf47e4b650405c29044d3e P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:09.709679  2120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0fb3f7bf85419cbf7ecda4727ccb89" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:09.707383  2483 raft_consensus.cc:493] T d3370eb67fff4896b1f8e3ce56eceb9b P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.711015  2483 raft_consensus.cc:3060] T d3370eb67fff4896b1f8e3ce56eceb9b P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.711387  2392 tablet_bootstrap.cc:654] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.703693  2310 leader_election.cc:304] T 7475d672f7b3489393d6202c8b31e47f P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:09.713415  2402 tablet_bootstrap.cc:654] T 427b10072083419c89d5a4bf5d6413fc P 79b6e57d59e4468ebe4423d871a31b39: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.713492  2198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0fb3f7bf85419cbf7ecda4727ccb89" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:09.713984  2407 raft_consensus.cc:493] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.714187  2198 raft_consensus.cc:2468] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 0.
I20260709 13:12:09.715427  2237 leader_election.cc:304] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:09.714551  2407 raft_consensus.cc:515] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:09.716787  2456 raft_consensus.cc:2749] T 7475d672f7b3489393d6202c8b31e47f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:09.717670  2407 leader_election.cc:290] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
W20260709 13:12:09.718701  2236 leader_election.cc:343] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:09.707413  2448 leader_election.cc:290] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:09.721997  2448 raft_consensus.cc:2804] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:09.722358  2448 raft_consensus.cc:493] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.722688  2448 raft_consensus.cc:3060] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.720296  2508 raft_consensus.cc:493] T d3370eb67fff4896b1f8e3ce56eceb9b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.733301  2020 catalog_manager.cc:5697] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67). New cstate: current_term: 1 leader_uuid: "79b6e57d59e4468ebe4423d871a31b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:09.730720  2391 raft_consensus.cc:359] T 0668be6a554b4c5f8bf93d0588a6bfcc P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:09.734946  2391 raft_consensus.cc:385] T 0668be6a554b4c5f8bf93d0588a6bfcc P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.735224  2391 raft_consensus.cc:740] T 0668be6a554b4c5f8bf93d0588a6bfcc P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.736991  2391 consensus_queue.cc:260] T 0668be6a554b4c5f8bf93d0588a6bfcc P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:09.742569  2422 raft_consensus.cc:493] T 765b8df93039426e925b94637a061cc2 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.743018  2422 raft_consensus.cc:515] T 765b8df93039426e925b94637a061cc2 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:09.743156  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a672ef15abf47e4b650405c29044d3e" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:09.734210  2508 raft_consensus.cc:515] T d3370eb67fff4896b1f8e3ce56eceb9b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:09.745843  2391 ts_tablet_manager.cc:1434] T 0668be6a554b4c5f8bf93d0588a6bfcc P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.065s	user 0.008s	sys 0.000s
I20260709 13:12:09.746771  2391 tablet_bootstrap.cc:492] T cc02522cf9704f58a9d2bfd5326e3625 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:09.746935  2508 leader_election.cc:290] T d3370eb67fff4896b1f8e3ce56eceb9b P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:09.747964  2483 raft_consensus.cc:515] T d3370eb67fff4896b1f8e3ce56eceb9b P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:09.734508  2196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4edf26b74c5d4e5d9a33d2b1fc1bb0ae" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:09.750770  2393 tablet_bootstrap.cc:654] T 5c3646d79bc840e9b4396f4351d1803d P 0ec6a5d1452a41bd992a8c7922473b35: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.754158  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4edf26b74c5d4e5d9a33d2b1fc1bb0ae" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:09.743965  2272 raft_consensus.cc:2468] T 8a672ef15abf47e4b650405c29044d3e P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 0.
I20260709 13:12:09.755740  2508 consensus_queue.cc:1048] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:09.756421  2198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3370eb67fff4896b1f8e3ce56eceb9b" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:09.757179  2198 raft_consensus.cc:2393] T d3370eb67fff4896b1f8e3ce56eceb9b P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in current term 1: Already voted for candidate 0ec6a5d1452a41bd992a8c7922473b35 in this term.
I20260709 13:12:09.758065  2120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4edf26b74c5d4e5d9a33d2b1fc1bb0ae" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:09.758651  2120 raft_consensus.cc:2468] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 0.
I20260709 13:12:09.759284  2122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3370eb67fff4896b1f8e3ce56eceb9b" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:09.759928  2122 raft_consensus.cc:2468] T d3370eb67fff4896b1f8e3ce56eceb9b P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 0.
I20260709 13:12:09.760052  2310 leader_election.cc:304] T 8a672ef15abf47e4b650405c29044d3e P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39; no voters: 0ec6a5d1452a41bd992a8c7922473b35
I20260709 13:12:09.760846  2422 leader_election.cc:290] T 765b8df93039426e925b94637a061cc2 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:09.761868  2310 leader_election.cc:304] T d3370eb67fff4896b1f8e3ce56eceb9b P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 0ec6a5d1452a41bd992a8c7922473b35
I20260709 13:12:09.761838  2456 raft_consensus.cc:2804] T 8a672ef15abf47e4b650405c29044d3e P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:09.763273  2456 raft_consensus.cc:493] T 8a672ef15abf47e4b650405c29044d3e P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.763633  2456 raft_consensus.cc:3060] T 8a672ef15abf47e4b650405c29044d3e P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.763847  2162 leader_election.cc:304] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472; no voters: 
I20260709 13:12:09.762687  2401 raft_consensus.cc:2804] T d3370eb67fff4896b1f8e3ce56eceb9b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:09.765935  2401 raft_consensus.cc:493] T d3370eb67fff4896b1f8e3ce56eceb9b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.766337  2401 raft_consensus.cc:3060] T d3370eb67fff4896b1f8e3ce56eceb9b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.766774  2419 raft_consensus.cc:515] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:09.767884  2270 raft_consensus.cc:2393] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec6a5d1452a41bd992a8c7922473b35 in current term 1: Already voted for candidate 79b6e57d59e4468ebe4423d871a31b39 in this term.
I20260709 13:12:09.768864  2419 leader_election.cc:290] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 election: Requested vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:09.769773  2122 raft_consensus.cc:3060] T 765b8df93039426e925b94637a061cc2 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.770573  2120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4edf26b74c5d4e5d9a33d2b1fc1bb0ae" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:09.771203  2120 raft_consensus.cc:3060] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.774283  2448 raft_consensus.cc:515] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:09.765491  2196 raft_consensus.cc:2468] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 0.
I20260709 13:12:09.762640  2195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "765b8df93039426e925b94637a061cc2" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:09.785308  2516 raft_consensus.cc:493] T 01a3c95e54104a998cdf16d06db2800a P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.785909  2516 raft_consensus.cc:515] T 01a3c95e54104a998cdf16d06db2800a P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:09.788156  2516 leader_election.cc:290] T 01a3c95e54104a998cdf16d06db2800a P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:09.770679  2483 leader_election.cc:290] T d3370eb67fff4896b1f8e3ce56eceb9b P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 election: Requested vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:09.794713  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "765b8df93039426e925b94637a061cc2" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:09.795545  2344 raft_consensus.cc:2393] T 765b8df93039426e925b94637a061cc2 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ac5c5682f914ed9b9982b5a080d5472 in current term 1: Already voted for candidate 0ec6a5d1452a41bd992a8c7922473b35 in this term.
I20260709 13:12:09.797655  2087 leader_election.cc:304] T 765b8df93039426e925b94637a061cc2 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea
I20260709 13:12:09.798780  2451 raft_consensus.cc:2749] T 765b8df93039426e925b94637a061cc2 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:09.798969  2120 raft_consensus.cc:2468] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 1.
I20260709 13:12:09.780239  2407 raft_consensus.cc:2804] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:09.799801  2443 raft_consensus.cc:493] T 12b5593f051548fea374da76afa08c3f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.800689  2448 leader_election.cc:290] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 election: Requested vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:09.813066  2407 raft_consensus.cc:493] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.830816  2407 raft_consensus.cc:3060] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.813409  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3370eb67fff4896b1f8e3ce56eceb9b" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:09.806779  2443 raft_consensus.cc:515] T 12b5593f051548fea374da76afa08c3f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:09.837934  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a3c95e54104a998cdf16d06db2800a" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:09.838500  2345 raft_consensus.cc:2468] T 01a3c95e54104a998cdf16d06db2800a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 0.
I20260709 13:12:09.839084  2443 leader_election.cc:290] T 12b5593f051548fea374da76afa08c3f P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:09.815255  2195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4edf26b74c5d4e5d9a33d2b1fc1bb0ae" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:09.816439  2194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0fb3f7bf85419cbf7ecda4727ccb89" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:09.841073  2194 raft_consensus.cc:3060] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.817392  2197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a3c95e54104a998cdf16d06db2800a" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:09.819710  2236 leader_election.cc:304] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:09.819859  2483 consensus_queue.cc:1048] T 765b8df93039426e925b94637a061cc2 P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:09.848405  2475 consensus_queue.cc:1048] T 765b8df93039426e925b94637a061cc2 P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:09.821082  2456 raft_consensus.cc:515] T 8a672ef15abf47e4b650405c29044d3e P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:09.822628  2122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0fb3f7bf85419cbf7ecda4727ccb89" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:09.806386  2401 raft_consensus.cc:515] T d3370eb67fff4896b1f8e3ce56eceb9b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:09.828678  2393 tablet_bootstrap.cc:492] T 5c3646d79bc840e9b4396f4351d1803d P 0ec6a5d1452a41bd992a8c7922473b35: No bootstrap required, opened a new log
I20260709 13:12:09.851061  2393 ts_tablet_manager.cc:1403] T 5c3646d79bc840e9b4396f4351d1803d P 0ec6a5d1452a41bd992a8c7922473b35: Time spent bootstrapping tablet: real 0.174s	user 0.008s	sys 0.010s
I20260709 13:12:09.830184  2391 tablet_bootstrap.cc:654] T cc02522cf9704f58a9d2bfd5326e3625 P 2ac5c5682f914ed9b9982b5a080d5472: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.846902  2197 raft_consensus.cc:2468] T 01a3c95e54104a998cdf16d06db2800a P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 0.
I20260709 13:12:09.854141  2393 raft_consensus.cc:359] T 5c3646d79bc840e9b4396f4351d1803d P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:09.856657  2393 raft_consensus.cc:385] T 5c3646d79bc840e9b4396f4351d1803d P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.856985  2393 raft_consensus.cc:740] T 5c3646d79bc840e9b4396f4351d1803d P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.857738  2393 consensus_queue.cc:260] T 5c3646d79bc840e9b4396f4351d1803d P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:09.847121  2120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3370eb67fff4896b1f8e3ce56eceb9b" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:09.855947  2448 raft_consensus.cc:2804] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:09.865866  2448 raft_consensus.cc:697] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 79b6e57d59e4468ebe4423d871a31b39 [term 1 LEADER]: Becoming Leader. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Running, Role: LEADER
W20260709 13:12:09.866675  2236 leader_election.cc:343] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:09.867821  2344 raft_consensus.cc:2393] T d3370eb67fff4896b1f8e3ce56eceb9b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec6a5d1452a41bd992a8c7922473b35 in current term 1: Already voted for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in this term.
I20260709 13:12:09.868541  2456 leader_election.cc:290] T 8a672ef15abf47e4b650405c29044d3e P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 election: Requested vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:09.866701  2448 consensus_queue.cc:237] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:09.869333  2194 raft_consensus.cc:2468] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 1.
I20260709 13:12:09.870066  2237 leader_election.cc:304] T 01a3c95e54104a998cdf16d06db2800a P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:09.871034  2419 raft_consensus.cc:2804] T 01a3c95e54104a998cdf16d06db2800a P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:09.870911  2197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a672ef15abf47e4b650405c29044d3e" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:09.872565  2237 leader_election.cc:304] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39; no voters: 2ac5c5682f914ed9b9982b5a080d5472
W20260709 13:12:09.873020  2311 leader_election.cc:343] T 8a672ef15abf47e4b650405c29044d3e P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:09.873082  2402 tablet_bootstrap.cc:492] T 427b10072083419c89d5a4bf5d6413fc P 79b6e57d59e4468ebe4423d871a31b39: No bootstrap required, opened a new log
I20260709 13:12:09.848757  2407 raft_consensus.cc:515] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:09.874362  2402 ts_tablet_manager.cc:1403] T 427b10072083419c89d5a4bf5d6413fc P 79b6e57d59e4468ebe4423d871a31b39: Time spent bootstrapping tablet: real 0.212s	user 0.019s	sys 0.017s
I20260709 13:12:09.875564  2195 raft_consensus.cc:2393] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 79b6e57d59e4468ebe4423d871a31b39 in current term 1: Already voted for candidate 0ec6a5d1452a41bd992a8c7922473b35 in this term.
I20260709 13:12:09.876457  2407 leader_election.cc:290] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 election: Requested vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:09.877565  2393 ts_tablet_manager.cc:1434] T 5c3646d79bc840e9b4396f4351d1803d P 0ec6a5d1452a41bd992a8c7922473b35: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.001s
I20260709 13:12:09.878328  2393 tablet_bootstrap.cc:492] T 12b5593f051548fea374da76afa08c3f P 0ec6a5d1452a41bd992a8c7922473b35: Bootstrap starting.
I20260709 13:12:09.878985  2019 catalog_manager.cc:5697] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68). New cstate: current_term: 1 leader_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:09.872632  2197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3370eb67fff4896b1f8e3ce56eceb9b" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:09.873827  2518 raft_consensus.cc:2804] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:09.870859  2401 leader_election.cc:290] T d3370eb67fff4896b1f8e3ce56eceb9b P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 election: Requested vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:09.874173  2419 raft_consensus.cc:493] T 01a3c95e54104a998cdf16d06db2800a P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:09.874665  2120 raft_consensus.cc:3060] T d3370eb67fff4896b1f8e3ce56eceb9b P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.889091  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4edf26b74c5d4e5d9a33d2b1fc1bb0ae" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:09.895165  2198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b5593f051548fea374da76afa08c3f" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:09.910275  2197 raft_consensus.cc:2393] T d3370eb67fff4896b1f8e3ce56eceb9b P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in current term 1: Already voted for candidate 0ec6a5d1452a41bd992a8c7922473b35 in this term.
I20260709 13:12:09.895347  2419 raft_consensus.cc:3060] T 01a3c95e54104a998cdf16d06db2800a P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.914865  2121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4edf26b74c5d4e5d9a33d2b1fc1bb0ae" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:09.919173  2121 raft_consensus.cc:2393] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec6a5d1452a41bd992a8c7922473b35 in current term 1: Already voted for candidate 79b6e57d59e4468ebe4423d871a31b39 in this term.
I20260709 13:12:09.896688  2518 raft_consensus.cc:697] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 LEADER]: Becoming Leader. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Running, Role: LEADER
I20260709 13:12:09.918061  2392 tablet_bootstrap.cc:492] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea: No bootstrap required, opened a new log
I20260709 13:12:09.910611  2401 raft_consensus.cc:493] T 28f2272230d34efa880d5eeed8859669 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.920199  2392 ts_tablet_manager.cc:1403] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent bootstrapping tablet: real 0.269s	user 0.029s	sys 0.009s
I20260709 13:12:09.926231  2162 leader_election.cc:304] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:09.920799  2119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b5593f051548fea374da76afa08c3f" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:09.921712  2451 consensus_queue.cc:1048] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:09.924499  2519 consensus_queue.cc:1048] T e259bf23e7904d9fb8b2345bb5b667f3 P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:09.933743  2402 raft_consensus.cc:359] T 427b10072083419c89d5a4bf5d6413fc P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:09.934459  2402 raft_consensus.cc:385] T 427b10072083419c89d5a4bf5d6413fc P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.934731  2402 raft_consensus.cc:740] T 427b10072083419c89d5a4bf5d6413fc P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.931007  2456 raft_consensus.cc:493] T 5aac56f958fb4fe29fe46d2a9be60ffd P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.928131  2518 consensus_queue.cc:237] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:09.925312  2401 raft_consensus.cc:515] T 28f2272230d34efa880d5eeed8859669 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:09.932122  2525 raft_consensus.cc:2749] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:09.936846  2402 consensus_queue.cc:260] T 427b10072083419c89d5a4bf5d6413fc P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:09.933202  2508 raft_consensus.cc:493] T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.939129  2392 raft_consensus.cc:359] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:09.939626  2392 raft_consensus.cc:385] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:09.939815  2392 raft_consensus.cc:740] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:09.940860  2392 consensus_queue.cc:260] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:09.941905  2122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3370eb67fff4896b1f8e3ce56eceb9b" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
W20260709 13:12:09.942776  2311 leader_election.cc:343] T 12b5593f051548fea374da76afa08c3f P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:09.937418  2456 raft_consensus.cc:515] T 5aac56f958fb4fe29fe46d2a9be60ffd P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:09.945250  2456 leader_election.cc:290] T 5aac56f958fb4fe29fe46d2a9be60ffd P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:09.946970  2198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aac56f958fb4fe29fe46d2a9be60ffd" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
W20260709 13:12:09.948288  2311 leader_election.cc:343] T 5aac56f958fb4fe29fe46d2a9be60ffd P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:09.948362  2401 leader_election.cc:290] T 28f2272230d34efa880d5eeed8859669 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:09.942057  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a672ef15abf47e4b650405c29044d3e" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:09.950294  2270 raft_consensus.cc:3060] T 8a672ef15abf47e4b650405c29044d3e P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:09.950003  2402 ts_tablet_manager.cc:1434] T 427b10072083419c89d5a4bf5d6413fc P 79b6e57d59e4468ebe4423d871a31b39: Time spent starting tablet: real 0.075s	user 0.006s	sys 0.001s
I20260709 13:12:09.951977  2402 tablet_bootstrap.cc:492] T 0668be6a554b4c5f8bf93d0588a6bfcc P 79b6e57d59e4468ebe4423d871a31b39: Bootstrap starting.
I20260709 13:12:09.956616  2392 ts_tablet_manager.cc:1434] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.000s
I20260709 13:12:09.957593  2392 tablet_bootstrap.cc:492] T 0668be6a554b4c5f8bf93d0588a6bfcc P 66e9a8fffd4b4e5a81ca4fa2762773ea: Bootstrap starting.
I20260709 13:12:09.959935  2393 tablet_bootstrap.cc:654] T 12b5593f051548fea374da76afa08c3f P 0ec6a5d1452a41bd992a8c7922473b35: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.965579  2526 raft_consensus.cc:493] T 86834d94d1d64596abfa609754b5d58a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.965862  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f2272230d34efa880d5eeed8859669" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:09.964841  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aac56f958fb4fe29fe46d2a9be60ffd" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:09.959872  2519 consensus_queue.cc:1048] T e259bf23e7904d9fb8b2345bb5b667f3 P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260709 13:12:09.960871  2402 tablet_bootstrap.cc:654] T 0668be6a554b4c5f8bf93d0588a6bfcc P 79b6e57d59e4468ebe4423d871a31b39: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.971810  2392 tablet_bootstrap.cc:654] T 0668be6a554b4c5f8bf93d0588a6bfcc P 66e9a8fffd4b4e5a81ca4fa2762773ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:09.980531  2451 raft_consensus.cc:493] T 0668be6a554b4c5f8bf93d0588a6bfcc P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:09.982331  2451 raft_consensus.cc:515] T 0668be6a554b4c5f8bf93d0588a6bfcc P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:09.984560  2451 leader_election.cc:290] T 0668be6a554b4c5f8bf93d0588a6bfcc P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:09.981349  2123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f2272230d34efa880d5eeed8859669" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:09.985332  2270 raft_consensus.cc:2468] T 8a672ef15abf47e4b650405c29044d3e P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 1.
I20260709 13:12:09.942080  2508 raft_consensus.cc:515] T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:09.991257  2397 consensus_queue.cc:1048] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:09.993608  2508 leader_election.cc:290] T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:09.994364  2391 tablet_bootstrap.cc:492] T cc02522cf9704f58a9d2bfd5326e3625 P 2ac5c5682f914ed9b9982b5a080d5472: No bootstrap required, opened a new log
I20260709 13:12:09.994763  2391 ts_tablet_manager.cc:1403] T cc02522cf9704f58a9d2bfd5326e3625 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.248s	user 0.029s	sys 0.014s
I20260709 13:12:09.994022  2195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b82132c31545aab274c7cf3f77c277" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
W20260709 13:12:09.998291  2310 leader_election.cc:343] T 12b5593f051548fea374da76afa08c3f P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:09.999272  2311 leader_election.cc:343] T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:09.977679  2526 raft_consensus.cc:515] T 86834d94d1d64596abfa609754b5d58a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:10.001250  2120 raft_consensus.cc:2468] T d3370eb67fff4896b1f8e3ce56eceb9b P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 1.
I20260709 13:12:10.001994  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0668be6a554b4c5f8bf93d0588a6bfcc" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:10.002689  2526 leader_election.cc:290] T 86834d94d1d64596abfa609754b5d58a P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:10.003221  2526 consensus_queue.cc:1048] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:12:10.003738  2087 leader_election.cc:343] T 0668be6a554b4c5f8bf93d0588a6bfcc P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:10.009428  2391 raft_consensus.cc:359] T cc02522cf9704f58a9d2bfd5326e3625 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:10.010483  2391 raft_consensus.cc:385] T cc02522cf9704f58a9d2bfd5326e3625 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.010769  2391 raft_consensus.cc:740] T cc02522cf9704f58a9d2bfd5326e3625 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:10.011690  2391 consensus_queue.cc:260] T cc02522cf9704f58a9d2bfd5326e3625 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:10.003643  2419 raft_consensus.cc:515] T 01a3c95e54104a998cdf16d06db2800a P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:10.014638  2391 ts_tablet_manager.cc:1434] T cc02522cf9704f58a9d2bfd5326e3625 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:12:10.017318  2162 leader_election.cc:304] T d3370eb67fff4896b1f8e3ce56eceb9b P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472; no voters: 66e9a8fffd4b4e5a81ca4fa2762773ea
I20260709 13:12:10.024104  2407 raft_consensus.cc:2804] T d3370eb67fff4896b1f8e3ce56eceb9b P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:10.024639  2407 raft_consensus.cc:697] T d3370eb67fff4896b1f8e3ce56eceb9b P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 LEADER]: Becoming Leader. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Running, Role: LEADER
I20260709 13:12:10.025460  2407 consensus_queue.cc:237] T d3370eb67fff4896b1f8e3ce56eceb9b P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:10.003971  2310 leader_election.cc:304] T 12b5593f051548fea374da76afa08c3f P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:10.031607  2198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a3c95e54104a998cdf16d06db2800a" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:10.028461  2018 catalog_manager.cc:5697] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 79b6e57d59e4468ebe4423d871a31b39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67). New cstate: current_term: 1 leader_uuid: "79b6e57d59e4468ebe4423d871a31b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:10.032317  2198 raft_consensus.cc:3060] T 01a3c95e54104a998cdf16d06db2800a P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.035452  2391 tablet_bootstrap.cc:492] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:10.038584  2310 leader_election.cc:304] T d3370eb67fff4896b1f8e3ce56eceb9b P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:10.039317  2508 raft_consensus.cc:2749] T 12b5593f051548fea374da76afa08c3f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:12:10.039697  2310 leader_election.cc:343] T 28f2272230d34efa880d5eeed8859669 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:10.039924  2508 raft_consensus.cc:2749] T d3370eb67fff4896b1f8e3ce56eceb9b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:10.018636  2419 leader_election.cc:290] T 01a3c95e54104a998cdf16d06db2800a P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 election: Requested vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:10.047326  2198 raft_consensus.cc:2468] T 01a3c95e54104a998cdf16d06db2800a P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 1.
I20260709 13:12:10.049312  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0668be6a554b4c5f8bf93d0588a6bfcc" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:10.054545  2237 leader_election.cc:304] T 01a3c95e54104a998cdf16d06db2800a P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:10.050110  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86834d94d1d64596abfa609754b5d58a" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:10.050822  2123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86834d94d1d64596abfa609754b5d58a" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:10.052469  2120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b82132c31545aab274c7cf3f77c277" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:10.055469  2448 raft_consensus.cc:2804] T 01a3c95e54104a998cdf16d06db2800a P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:10.057040  2448 raft_consensus.cc:697] T 01a3c95e54104a998cdf16d06db2800a P 79b6e57d59e4468ebe4423d871a31b39 [term 1 LEADER]: Becoming Leader. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Running, Role: LEADER
I20260709 13:12:10.060652  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a3c95e54104a998cdf16d06db2800a" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:10.061254  2345 raft_consensus.cc:3060] T 01a3c95e54104a998cdf16d06db2800a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.061637  2391 tablet_bootstrap.cc:654] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:10.072422  2448 consensus_queue.cc:237] T 01a3c95e54104a998cdf16d06db2800a P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:10.077931  2393 tablet_bootstrap.cc:492] T 12b5593f051548fea374da76afa08c3f P 0ec6a5d1452a41bd992a8c7922473b35: No bootstrap required, opened a new log
I20260709 13:12:10.078513  2393 ts_tablet_manager.cc:1403] T 12b5593f051548fea374da76afa08c3f P 0ec6a5d1452a41bd992a8c7922473b35: Time spent bootstrapping tablet: real 0.200s	user 0.005s	sys 0.016s
I20260709 13:12:10.087410  2021 catalog_manager.cc:5697] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67). New cstate: current_term: 1 leader_uuid: "79b6e57d59e4468ebe4423d871a31b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:10.093119  2508 raft_consensus.cc:493] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.093654  2508 raft_consensus.cc:515] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:10.095618  2508 leader_election.cc:290] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:10.097028  2402 tablet_bootstrap.cc:492] T 0668be6a554b4c5f8bf93d0588a6bfcc P 79b6e57d59e4468ebe4423d871a31b39: No bootstrap required, opened a new log
I20260709 13:12:10.097499  2402 ts_tablet_manager.cc:1403] T 0668be6a554b4c5f8bf93d0588a6bfcc P 79b6e57d59e4468ebe4423d871a31b39: Time spent bootstrapping tablet: real 0.146s	user 0.010s	sys 0.018s
W20260709 13:12:10.097373  2310 leader_election.cc:343] T 28f2272230d34efa880d5eeed8859669 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:10.099280  2198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b65903ab966485c9c65bdfbdf1e1054" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
W20260709 13:12:10.100956  2311 leader_election.cc:343] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:10.101217  2345 raft_consensus.cc:2468] T 01a3c95e54104a998cdf16d06db2800a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 1.
I20260709 13:12:10.100919  2402 raft_consensus.cc:359] T 0668be6a554b4c5f8bf93d0588a6bfcc P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:10.102195  2402 raft_consensus.cc:385] T 0668be6a554b4c5f8bf93d0588a6bfcc P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.102487  2402 raft_consensus.cc:740] T 0668be6a554b4c5f8bf93d0588a6bfcc P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Initialized, Role: FOLLOWER
I20260709 13:12:10.103256  2402 consensus_queue.cc:260] T 0668be6a554b4c5f8bf93d0588a6bfcc P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:10.105284  2402 ts_tablet_manager.cc:1434] T 0668be6a554b4c5f8bf93d0588a6bfcc P 79b6e57d59e4468ebe4423d871a31b39: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:12:10.106335  2402 tablet_bootstrap.cc:492] T cc02522cf9704f58a9d2bfd5326e3625 P 79b6e57d59e4468ebe4423d871a31b39: Bootstrap starting.
I20260709 13:12:10.115726  2393 raft_consensus.cc:359] T 12b5593f051548fea374da76afa08c3f P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:10.115494  2019 catalog_manager.cc:5697] T d3370eb67fff4896b1f8e3ce56eceb9b P 0ec6a5d1452a41bd992a8c7922473b35 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66). New cstate: current_term: 1 leader_uuid: "0ec6a5d1452a41bd992a8c7922473b35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:10.099273  2310 leader_election.cc:304] T 28f2272230d34efa880d5eeed8859669 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:10.119194  2508 raft_consensus.cc:2749] T 28f2272230d34efa880d5eeed8859669 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:10.120122  2402 tablet_bootstrap.cc:654] T cc02522cf9704f58a9d2bfd5326e3625 P 79b6e57d59e4468ebe4423d871a31b39: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:10.120293  2310 leader_election.cc:343] T 5aac56f958fb4fe29fe46d2a9be60ffd P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:10.122581  2310 leader_election.cc:304] T 5aac56f958fb4fe29fe46d2a9be60ffd P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:10.118760  2393 raft_consensus.cc:385] T 12b5593f051548fea374da76afa08c3f P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.123324  2508 raft_consensus.cc:2749] T 5aac56f958fb4fe29fe46d2a9be60ffd P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:10.123478  2393 raft_consensus.cc:740] T 12b5593f051548fea374da76afa08c3f P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Initialized, Role: FOLLOWER
I20260709 13:12:10.124488  2310 leader_election.cc:304] T 8a672ef15abf47e4b650405c29044d3e P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39; no voters: 0ec6a5d1452a41bd992a8c7922473b35
I20260709 13:12:10.125101  2391 tablet_bootstrap.cc:492] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472: No bootstrap required, opened a new log
I20260709 13:12:10.124790  2393 consensus_queue.cc:260] T 12b5593f051548fea374da76afa08c3f P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:10.125562  2391 ts_tablet_manager.cc:1403] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.090s	user 0.009s	sys 0.005s
I20260709 13:12:10.126190  2020 catalog_manager.cc:5697] T 01a3c95e54104a998cdf16d06db2800a P 79b6e57d59e4468ebe4423d871a31b39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67). New cstate: current_term: 1 leader_uuid: "79b6e57d59e4468ebe4423d871a31b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:10.127444  2393 ts_tablet_manager.cc:1434] T 12b5593f051548fea374da76afa08c3f P 0ec6a5d1452a41bd992a8c7922473b35: Time spent starting tablet: real 0.049s	user 0.007s	sys 0.001s
I20260709 13:12:10.128239  2391 raft_consensus.cc:359] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:10.128670  2393 tablet_bootstrap.cc:492] T 5aac56f958fb4fe29fe46d2a9be60ffd P 0ec6a5d1452a41bd992a8c7922473b35: Bootstrap starting.
I20260709 13:12:10.128912  2391 raft_consensus.cc:385] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.129226  2391 raft_consensus.cc:740] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:10.129998  2391 consensus_queue.cc:260] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:10.132325  2391 ts_tablet_manager.cc:1434] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.001s
I20260709 13:12:10.133299  2391 tablet_bootstrap.cc:492] T 2e178ff57d964223aca095ceff76b339 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:10.135075  2402 tablet_bootstrap.cc:492] T cc02522cf9704f58a9d2bfd5326e3625 P 79b6e57d59e4468ebe4423d871a31b39: No bootstrap required, opened a new log
I20260709 13:12:10.135628  2402 ts_tablet_manager.cc:1403] T cc02522cf9704f58a9d2bfd5326e3625 P 79b6e57d59e4468ebe4423d871a31b39: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.000s
I20260709 13:12:10.139899  2508 raft_consensus.cc:2804] T 8a672ef15abf47e4b650405c29044d3e P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:10.138311  2402 raft_consensus.cc:359] T cc02522cf9704f58a9d2bfd5326e3625 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:10.140384  2508 raft_consensus.cc:697] T 8a672ef15abf47e4b650405c29044d3e P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 LEADER]: Becoming Leader. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Running, Role: LEADER
I20260709 13:12:10.141251  2508 consensus_queue.cc:237] T 8a672ef15abf47e4b650405c29044d3e P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:10.140590  2402 raft_consensus.cc:385] T cc02522cf9704f58a9d2bfd5326e3625 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.142330  2402 raft_consensus.cc:740] T cc02522cf9704f58a9d2bfd5326e3625 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Initialized, Role: FOLLOWER
I20260709 13:12:10.143405  2391 tablet_bootstrap.cc:654] T 2e178ff57d964223aca095ceff76b339 P 2ac5c5682f914ed9b9982b5a080d5472: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:10.143801  2393 tablet_bootstrap.cc:654] T 5aac56f958fb4fe29fe46d2a9be60ffd P 0ec6a5d1452a41bd992a8c7922473b35: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:10.145238  2392 tablet_bootstrap.cc:492] T 0668be6a554b4c5f8bf93d0588a6bfcc P 66e9a8fffd4b4e5a81ca4fa2762773ea: No bootstrap required, opened a new log
W20260709 13:12:10.146242  2310 leader_election.cc:343] T 86834d94d1d64596abfa609754b5d58a P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:10.143030  2402 consensus_queue.cc:260] T cc02522cf9704f58a9d2bfd5326e3625 P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:10.148167  2402 ts_tablet_manager.cc:1434] T cc02522cf9704f58a9d2bfd5326e3625 P 79b6e57d59e4468ebe4423d871a31b39: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:12:10.149183  2402 tablet_bootstrap.cc:492] T 86834d94d1d64596abfa609754b5d58a P 79b6e57d59e4468ebe4423d871a31b39: Bootstrap starting.
I20260709 13:12:10.155409  2402 tablet_bootstrap.cc:654] T 86834d94d1d64596abfa609754b5d58a P 79b6e57d59e4468ebe4423d871a31b39: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:10.156782  2087 leader_election.cc:343] T 0668be6a554b4c5f8bf93d0588a6bfcc P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:10.157296  2087 leader_election.cc:304] T 0668be6a554b4c5f8bf93d0588a6bfcc P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472; no voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:10.158869  2397 raft_consensus.cc:2749] T 0668be6a554b4c5f8bf93d0588a6bfcc P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:10.148146  2392 ts_tablet_manager.cc:1403] T 0668be6a554b4c5f8bf93d0588a6bfcc P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent bootstrapping tablet: real 0.191s	user 0.017s	sys 0.008s
W20260709 13:12:10.159595  2310 leader_election.cc:343] T 86834d94d1d64596abfa609754b5d58a P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:10.160115  2310 leader_election.cc:304] T 86834d94d1d64596abfa609754b5d58a P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:10.161985  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b65903ab966485c9c65bdfbdf1e1054" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:10.148217  2540 raft_consensus.cc:493] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.165612  2540 raft_consensus.cc:515] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:10.165975  2508 raft_consensus.cc:2749] T 86834d94d1d64596abfa609754b5d58a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:12:10.167176  2310 leader_election.cc:343] T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:10.167606  2310 leader_election.cc:304] T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:10.167850  2540 leader_election.cc:290] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:10.168493  2508 raft_consensus.cc:2749] T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:10.169587  2198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0fb3f7bf85419cbf7ecda4727ccb89" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:10.167078  2392 raft_consensus.cc:359] T 0668be6a554b4c5f8bf93d0588a6bfcc P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:10.170367  2392 raft_consensus.cc:385] T 0668be6a554b4c5f8bf93d0588a6bfcc P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.170475  2198 raft_consensus.cc:2393] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ac5c5682f914ed9b9982b5a080d5472 in current term 1: Already voted for candidate 79b6e57d59e4468ebe4423d871a31b39 in this term.
I20260709 13:12:10.170684  2392 raft_consensus.cc:740] T 0668be6a554b4c5f8bf93d0588a6bfcc P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:10.171509  2392 consensus_queue.cc:260] T 0668be6a554b4c5f8bf93d0588a6bfcc P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:10.173496  2392 ts_tablet_manager.cc:1434] T 0668be6a554b4c5f8bf93d0588a6bfcc P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.001s
I20260709 13:12:10.173785  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0fb3f7bf85419cbf7ecda4727ccb89" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:10.174257  2448 consensus_queue.cc:1048] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:10.175329  2087 leader_election.cc:304] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:10.176535  2540 raft_consensus.cc:3060] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.180266  2392 tablet_bootstrap.cc:492] T bc42d18a324e4f6d97f07cf770c5daa8 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Bootstrap starting.
I20260709 13:12:10.181371  2448 consensus_queue.cc:1048] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:10.186818  2419 raft_consensus.cc:493] T 427b10072083419c89d5a4bf5d6413fc P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.187266  2419 raft_consensus.cc:515] T 427b10072083419c89d5a4bf5d6413fc P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:10.187753  2540 raft_consensus.cc:2749] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:10.188462  2392 tablet_bootstrap.cc:654] T bc42d18a324e4f6d97f07cf770c5daa8 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:10.189163  2419 leader_election.cc:290] T 427b10072083419c89d5a4bf5d6413fc P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:10.190421  2391 tablet_bootstrap.cc:492] T 2e178ff57d964223aca095ceff76b339 P 2ac5c5682f914ed9b9982b5a080d5472: No bootstrap required, opened a new log
I20260709 13:12:10.190631  2020 catalog_manager.cc:5697] T 8a672ef15abf47e4b650405c29044d3e P 66e9a8fffd4b4e5a81ca4fa2762773ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68). New cstate: current_term: 1 leader_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:10.191787  2119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b10072083419c89d5a4bf5d6413fc" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
W20260709 13:12:10.192977  2236 leader_election.cc:343] T 427b10072083419c89d5a4bf5d6413fc P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:10.190951  2391 ts_tablet_manager.cc:1403] T 2e178ff57d964223aca095ceff76b339 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.058s	user 0.009s	sys 0.003s
I20260709 13:12:10.196489  2391 raft_consensus.cc:359] T 2e178ff57d964223aca095ceff76b339 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:10.197072  2391 raft_consensus.cc:385] T 2e178ff57d964223aca095ceff76b339 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.197326  2391 raft_consensus.cc:740] T 2e178ff57d964223aca095ceff76b339 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:10.200379  2391 consensus_queue.cc:260] T 2e178ff57d964223aca095ceff76b339 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:10.203555  2391 ts_tablet_manager.cc:1434] T 2e178ff57d964223aca095ceff76b339 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:12:10.206296  2391 tablet_bootstrap.cc:492] T b3b82132c31545aab274c7cf3f77c277 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
W20260709 13:12:10.210559  2310 leader_election.cc:343] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:10.211054  2310 leader_election.cc:304] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:10.212517  2508 raft_consensus.cc:2749] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:10.213821  2508 consensus_queue.cc:1048] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:10.216846  2391 tablet_bootstrap.cc:654] T b3b82132c31545aab274c7cf3f77c277 P 2ac5c5682f914ed9b9982b5a080d5472: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:10.224893  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b10072083419c89d5a4bf5d6413fc" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:10.228838  2402 tablet_bootstrap.cc:492] T 86834d94d1d64596abfa609754b5d58a P 79b6e57d59e4468ebe4423d871a31b39: No bootstrap required, opened a new log
I20260709 13:12:10.229374  2402 ts_tablet_manager.cc:1403] T 86834d94d1d64596abfa609754b5d58a P 79b6e57d59e4468ebe4423d871a31b39: Time spent bootstrapping tablet: real 0.080s	user 0.010s	sys 0.014s
I20260709 13:12:10.232177  2402 raft_consensus.cc:359] T 86834d94d1d64596abfa609754b5d58a P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:10.232851  2402 raft_consensus.cc:385] T 86834d94d1d64596abfa609754b5d58a P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.233218  2402 raft_consensus.cc:740] T 86834d94d1d64596abfa609754b5d58a P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Initialized, Role: FOLLOWER
I20260709 13:12:10.238240  2393 tablet_bootstrap.cc:492] T 5aac56f958fb4fe29fe46d2a9be60ffd P 0ec6a5d1452a41bd992a8c7922473b35: No bootstrap required, opened a new log
I20260709 13:12:10.238266  2407 raft_consensus.cc:493] T 5c3646d79bc840e9b4396f4351d1803d P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.238857  2393 ts_tablet_manager.cc:1403] T 5aac56f958fb4fe29fe46d2a9be60ffd P 0ec6a5d1452a41bd992a8c7922473b35: Time spent bootstrapping tablet: real 0.110s	user 0.033s	sys 0.031s
I20260709 13:12:10.238981  2407 raft_consensus.cc:515] T 5c3646d79bc840e9b4396f4351d1803d P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
W20260709 13:12:10.239670  2236 leader_election.cc:343] T 427b10072083419c89d5a4bf5d6413fc P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:10.240145  2236 leader_election.cc:304] T 427b10072083419c89d5a4bf5d6413fc P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b6e57d59e4468ebe4423d871a31b39; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea
I20260709 13:12:10.241214  2407 leader_election.cc:290] T 5c3646d79bc840e9b4396f4351d1803d P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:10.241643  2393 raft_consensus.cc:359] T 5aac56f958fb4fe29fe46d2a9be60ffd P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:10.242306  2393 raft_consensus.cc:385] T 5aac56f958fb4fe29fe46d2a9be60ffd P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.242558  2393 raft_consensus.cc:740] T 5aac56f958fb4fe29fe46d2a9be60ffd P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Initialized, Role: FOLLOWER
I20260709 13:12:10.243227  2120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3646d79bc840e9b4396f4351d1803d" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:10.243175  2393 consensus_queue.cc:260] T 5aac56f958fb4fe29fe46d2a9be60ffd P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:10.245126  2393 ts_tablet_manager.cc:1434] T 5aac56f958fb4fe29fe46d2a9be60ffd P 0ec6a5d1452a41bd992a8c7922473b35: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
W20260709 13:12:10.245323  2162 leader_election.cc:343] T 5c3646d79bc840e9b4396f4351d1803d P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:10.246289  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3646d79bc840e9b4396f4351d1803d" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
W20260709 13:12:10.248023  2162 leader_election.cc:343] T 5c3646d79bc840e9b4396f4351d1803d P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:10.248301  2393 tablet_bootstrap.cc:492] T 1478f883c539464bb54fe9bff44148d5 P 0ec6a5d1452a41bd992a8c7922473b35: Bootstrap starting.
I20260709 13:12:10.248481  2162 leader_election.cc:304] T 5c3646d79bc840e9b4396f4351d1803d P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:10.249290  2407 raft_consensus.cc:2749] T 5c3646d79bc840e9b4396f4351d1803d P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:10.249771  2419 raft_consensus.cc:2749] T 427b10072083419c89d5a4bf5d6413fc P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:10.250212  2402 consensus_queue.cc:260] T 86834d94d1d64596abfa609754b5d58a P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:10.252703  2402 ts_tablet_manager.cc:1434] T 86834d94d1d64596abfa609754b5d58a P 79b6e57d59e4468ebe4423d871a31b39: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260709 13:12:10.253722  2402 tablet_bootstrap.cc:492] T bdee3fd7553a47afae3ec9dbdce6d829 P 79b6e57d59e4468ebe4423d871a31b39: Bootstrap starting.
I20260709 13:12:10.252765  2392 tablet_bootstrap.cc:492] T bc42d18a324e4f6d97f07cf770c5daa8 P 66e9a8fffd4b4e5a81ca4fa2762773ea: No bootstrap required, opened a new log
I20260709 13:12:10.255240  2392 ts_tablet_manager.cc:1403] T bc42d18a324e4f6d97f07cf770c5daa8 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent bootstrapping tablet: real 0.075s	user 0.019s	sys 0.004s
I20260709 13:12:10.259626  2393 tablet_bootstrap.cc:654] T 1478f883c539464bb54fe9bff44148d5 P 0ec6a5d1452a41bd992a8c7922473b35: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:10.262676  2392 raft_consensus.cc:359] T bc42d18a324e4f6d97f07cf770c5daa8 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:10.263406  2392 raft_consensus.cc:385] T bc42d18a324e4f6d97f07cf770c5daa8 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.263652  2392 raft_consensus.cc:740] T bc42d18a324e4f6d97f07cf770c5daa8 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:10.264321  2392 consensus_queue.cc:260] T bc42d18a324e4f6d97f07cf770c5daa8 P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:10.266827  2402 tablet_bootstrap.cc:654] T bdee3fd7553a47afae3ec9dbdce6d829 P 79b6e57d59e4468ebe4423d871a31b39: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:10.268651  2120 raft_consensus.cc:3060] T 2e178ff57d964223aca095ceff76b339 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.273546  2392 ts_tablet_manager.cc:1434] T bc42d18a324e4f6d97f07cf770c5daa8 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 13:12:10.274507  2392 tablet_bootstrap.cc:492] T 36b22aafe7104cec82607dab40b4aed8 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Bootstrap starting.
I20260709 13:12:10.275386  2393 tablet_bootstrap.cc:492] T 1478f883c539464bb54fe9bff44148d5 P 0ec6a5d1452a41bd992a8c7922473b35: No bootstrap required, opened a new log
I20260709 13:12:10.275831  2393 ts_tablet_manager.cc:1403] T 1478f883c539464bb54fe9bff44148d5 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent bootstrapping tablet: real 0.028s	user 0.011s	sys 0.000s
I20260709 13:12:10.278723  2419 consensus_queue.cc:1048] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:10.281546  2393 raft_consensus.cc:359] T 1478f883c539464bb54fe9bff44148d5 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:10.282208  2393 raft_consensus.cc:385] T 1478f883c539464bb54fe9bff44148d5 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.282470  2393 raft_consensus.cc:740] T 1478f883c539464bb54fe9bff44148d5 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Initialized, Role: FOLLOWER
I20260709 13:12:10.283115  2393 consensus_queue.cc:260] T 1478f883c539464bb54fe9bff44148d5 P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:10.285109  2393 ts_tablet_manager.cc:1434] T 1478f883c539464bb54fe9bff44148d5 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:12:10.286110  2393 tablet_bootstrap.cc:492] T 8a672ef15abf47e4b650405c29044d3e P 0ec6a5d1452a41bd992a8c7922473b35: Bootstrap starting.
I20260709 13:12:10.288012  2508 consensus_queue.cc:1048] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:10.289068  2391 tablet_bootstrap.cc:492] T b3b82132c31545aab274c7cf3f77c277 P 2ac5c5682f914ed9b9982b5a080d5472: No bootstrap required, opened a new log
I20260709 13:12:10.289544  2391 ts_tablet_manager.cc:1403] T b3b82132c31545aab274c7cf3f77c277 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.083s	user 0.014s	sys 0.017s
I20260709 13:12:10.292106  2391 raft_consensus.cc:359] T b3b82132c31545aab274c7cf3f77c277 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:10.292743  2391 raft_consensus.cc:385] T b3b82132c31545aab274c7cf3f77c277 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.293002  2391 raft_consensus.cc:740] T b3b82132c31545aab274c7cf3f77c277 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:10.293630  2391 consensus_queue.cc:260] T b3b82132c31545aab274c7cf3f77c277 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:10.295969  2392 tablet_bootstrap.cc:654] T 36b22aafe7104cec82607dab40b4aed8 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:10.295996  2391 ts_tablet_manager.cc:1434] T b3b82132c31545aab274c7cf3f77c277 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:12:10.299173  2391 tablet_bootstrap.cc:492] T 5c3646d79bc840e9b4396f4351d1803d P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:10.304081  2519 raft_consensus.cc:493] T 0668be6a554b4c5f8bf93d0588a6bfcc P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.304630  2519 raft_consensus.cc:515] T 0668be6a554b4c5f8bf93d0588a6bfcc P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:10.306798  2519 leader_election.cc:290] T 0668be6a554b4c5f8bf93d0588a6bfcc P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:10.308327  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0668be6a554b4c5f8bf93d0588a6bfcc" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:10.308998  2346 raft_consensus.cc:2468] T 0668be6a554b4c5f8bf93d0588a6bfcc P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 0.
I20260709 13:12:10.310277  2236 leader_election.cc:304] T 0668be6a554b4c5f8bf93d0588a6bfcc P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:10.311000  2519 raft_consensus.cc:2804] T 0668be6a554b4c5f8bf93d0588a6bfcc P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:10.311342  2519 raft_consensus.cc:493] T 0668be6a554b4c5f8bf93d0588a6bfcc P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.311677  2519 raft_consensus.cc:3060] T 0668be6a554b4c5f8bf93d0588a6bfcc P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.311604  2452 consensus_queue.cc:1048] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:10.312302  2119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0668be6a554b4c5f8bf93d0588a6bfcc" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:10.313005  2119 raft_consensus.cc:2468] T 0668be6a554b4c5f8bf93d0588a6bfcc P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 0.
I20260709 13:12:10.320029  2519 raft_consensus.cc:515] T 0668be6a554b4c5f8bf93d0588a6bfcc P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:10.322892  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0668be6a554b4c5f8bf93d0588a6bfcc" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:10.323496  2346 raft_consensus.cc:3060] T 0668be6a554b4c5f8bf93d0588a6bfcc P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.325699  2393 tablet_bootstrap.cc:654] T 8a672ef15abf47e4b650405c29044d3e P 0ec6a5d1452a41bd992a8c7922473b35: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:10.330794  2346 raft_consensus.cc:2468] T 0668be6a554b4c5f8bf93d0588a6bfcc P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 1.
I20260709 13:12:10.326794  2391 tablet_bootstrap.cc:654] T 5c3646d79bc840e9b4396f4351d1803d P 2ac5c5682f914ed9b9982b5a080d5472: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:10.332106  2236 leader_election.cc:304] T 0668be6a554b4c5f8bf93d0588a6bfcc P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:10.332937  2419 raft_consensus.cc:2804] T 0668be6a554b4c5f8bf93d0588a6bfcc P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:10.333423  2419 raft_consensus.cc:697] T 0668be6a554b4c5f8bf93d0588a6bfcc P 79b6e57d59e4468ebe4423d871a31b39 [term 1 LEADER]: Becoming Leader. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Running, Role: LEADER
I20260709 13:12:10.334262  2419 consensus_queue.cc:237] T 0668be6a554b4c5f8bf93d0588a6bfcc P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:10.339830  2519 leader_election.cc:290] T 0668be6a554b4c5f8bf93d0588a6bfcc P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 election: Requested vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:10.341668  2402 tablet_bootstrap.cc:492] T bdee3fd7553a47afae3ec9dbdce6d829 P 79b6e57d59e4468ebe4423d871a31b39: No bootstrap required, opened a new log
I20260709 13:12:10.342137  2402 ts_tablet_manager.cc:1403] T bdee3fd7553a47afae3ec9dbdce6d829 P 79b6e57d59e4468ebe4423d871a31b39: Time spent bootstrapping tablet: real 0.089s	user 0.019s	sys 0.019s
I20260709 13:12:10.353838  2402 raft_consensus.cc:359] T bdee3fd7553a47afae3ec9dbdce6d829 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:10.354530  2402 raft_consensus.cc:385] T bdee3fd7553a47afae3ec9dbdce6d829 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.354780  2402 raft_consensus.cc:740] T bdee3fd7553a47afae3ec9dbdce6d829 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Initialized, Role: FOLLOWER
I20260709 13:12:10.355464  2402 consensus_queue.cc:260] T bdee3fd7553a47afae3ec9dbdce6d829 P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:10.356657  2120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0668be6a554b4c5f8bf93d0588a6bfcc" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:10.357323  2120 raft_consensus.cc:3060] T 0668be6a554b4c5f8bf93d0588a6bfcc P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.357227  2018 catalog_manager.cc:5697] T 0668be6a554b4c5f8bf93d0588a6bfcc P 79b6e57d59e4468ebe4423d871a31b39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67). New cstate: current_term: 1 leader_uuid: "79b6e57d59e4468ebe4423d871a31b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:10.358026  2540 raft_consensus.cc:493] T cc02522cf9704f58a9d2bfd5326e3625 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.357496  2393 tablet_bootstrap.cc:492] T 8a672ef15abf47e4b650405c29044d3e P 0ec6a5d1452a41bd992a8c7922473b35: No bootstrap required, opened a new log
I20260709 13:12:10.358465  2540 raft_consensus.cc:515] T cc02522cf9704f58a9d2bfd5326e3625 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:10.359042  2393 ts_tablet_manager.cc:1403] T 8a672ef15abf47e4b650405c29044d3e P 0ec6a5d1452a41bd992a8c7922473b35: Time spent bootstrapping tablet: real 0.073s	user 0.011s	sys 0.000s
I20260709 13:12:10.360097  2392 tablet_bootstrap.cc:492] T 36b22aafe7104cec82607dab40b4aed8 P 66e9a8fffd4b4e5a81ca4fa2762773ea: No bootstrap required, opened a new log
I20260709 13:12:10.360430  2540 leader_election.cc:290] T cc02522cf9704f58a9d2bfd5326e3625 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:10.360594  2392 ts_tablet_manager.cc:1403] T 36b22aafe7104cec82607dab40b4aed8 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent bootstrapping tablet: real 0.086s	user 0.023s	sys 0.004s
I20260709 13:12:10.362238  2393 raft_consensus.cc:359] T 8a672ef15abf47e4b650405c29044d3e P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:10.362833  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc02522cf9704f58a9d2bfd5326e3625" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:10.363628  2270 raft_consensus.cc:2468] T cc02522cf9704f58a9d2bfd5326e3625 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 0.
I20260709 13:12:10.364845  2087 leader_election.cc:304] T cc02522cf9704f58a9d2bfd5326e3625 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:10.365058  2391 tablet_bootstrap.cc:492] T 5c3646d79bc840e9b4396f4351d1803d P 2ac5c5682f914ed9b9982b5a080d5472: No bootstrap required, opened a new log
I20260709 13:12:10.362883  2393 raft_consensus.cc:385] T 8a672ef15abf47e4b650405c29044d3e P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.362854  2198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc02522cf9704f58a9d2bfd5326e3625" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:10.366200  2393 raft_consensus.cc:740] T 8a672ef15abf47e4b650405c29044d3e P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Initialized, Role: FOLLOWER
I20260709 13:12:10.366303  2198 raft_consensus.cc:2468] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 0.
I20260709 13:12:10.367046  2393 consensus_queue.cc:260] T 8a672ef15abf47e4b650405c29044d3e P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:10.365577  2391 ts_tablet_manager.cc:1403] T 5c3646d79bc840e9b4396f4351d1803d P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.067s	user 0.010s	sys 0.000s
I20260709 13:12:10.368983  2393 ts_tablet_manager.cc:1434] T 8a672ef15abf47e4b650405c29044d3e P 0ec6a5d1452a41bd992a8c7922473b35: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 13:12:10.367328  2540 raft_consensus.cc:2804] T cc02522cf9704f58a9d2bfd5326e3625 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:10.369421  2540 raft_consensus.cc:493] T cc02522cf9704f58a9d2bfd5326e3625 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.369844  2540 raft_consensus.cc:3060] T cc02522cf9704f58a9d2bfd5326e3625 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.371008  2393 tablet_bootstrap.cc:492] T 36b22aafe7104cec82607dab40b4aed8 P 0ec6a5d1452a41bd992a8c7922473b35: Bootstrap starting.
I20260709 13:12:10.369971  2392 raft_consensus.cc:359] T 36b22aafe7104cec82607dab40b4aed8 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:10.372741  2392 raft_consensus.cc:385] T 36b22aafe7104cec82607dab40b4aed8 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.372998  2392 raft_consensus.cc:740] T 36b22aafe7104cec82607dab40b4aed8 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:10.373616  2392 consensus_queue.cc:260] T 36b22aafe7104cec82607dab40b4aed8 P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:10.374744  2419 consensus_queue.cc:1048] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:10.370003  2120 raft_consensus.cc:2468] T 0668be6a554b4c5f8bf93d0588a6bfcc P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 1.
I20260709 13:12:10.378697  2391 raft_consensus.cc:359] T 5c3646d79bc840e9b4396f4351d1803d P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:10.379395  2391 raft_consensus.cc:385] T 5c3646d79bc840e9b4396f4351d1803d P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.379701  2391 raft_consensus.cc:740] T 5c3646d79bc840e9b4396f4351d1803d P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:10.380371  2391 consensus_queue.cc:260] T 5c3646d79bc840e9b4396f4351d1803d P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:10.383140  2391 ts_tablet_manager.cc:1434] T 5c3646d79bc840e9b4396f4351d1803d P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.002s
I20260709 13:12:10.383992  2392 ts_tablet_manager.cc:1434] T 36b22aafe7104cec82607dab40b4aed8 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.000s
I20260709 13:12:10.377955  2540 raft_consensus.cc:515] T cc02522cf9704f58a9d2bfd5326e3625 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:10.384153  2391 tablet_bootstrap.cc:492] T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:10.389117  2407 raft_consensus.cc:493] T 12b5593f051548fea374da76afa08c3f P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.389587  2407 raft_consensus.cc:515] T 12b5593f051548fea374da76afa08c3f P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:10.390455  2393 tablet_bootstrap.cc:654] T 36b22aafe7104cec82607dab40b4aed8 P 0ec6a5d1452a41bd992a8c7922473b35: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:10.391588  2407 leader_election.cc:290] T 12b5593f051548fea374da76afa08c3f P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:10.384876  2392 tablet_bootstrap.cc:492] T bdee3fd7553a47afae3ec9dbdce6d829 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Bootstrap starting.
I20260709 13:12:10.396376  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b5593f051548fea374da76afa08c3f" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:10.397065  2346 raft_consensus.cc:2468] T 12b5593f051548fea374da76afa08c3f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 0.
I20260709 13:12:10.399619  2392 tablet_bootstrap.cc:654] T bdee3fd7553a47afae3ec9dbdce6d829 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:10.400241  2162 leader_election.cc:304] T 12b5593f051548fea374da76afa08c3f P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:10.401260  2407 raft_consensus.cc:2804] T 12b5593f051548fea374da76afa08c3f P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:10.401636  2407 raft_consensus.cc:493] T 12b5593f051548fea374da76afa08c3f P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.402558  2407 raft_consensus.cc:3060] T 12b5593f051548fea374da76afa08c3f P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.402827  2391 tablet_bootstrap.cc:654] T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:10.408568  2120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b5593f051548fea374da76afa08c3f" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:10.388041  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc02522cf9704f58a9d2bfd5326e3625" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:10.410737  2270 raft_consensus.cc:3060] T cc02522cf9704f58a9d2bfd5326e3625 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:10.411131  2162 leader_election.cc:343] T 12b5593f051548fea374da76afa08c3f P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:10.388118  2540 leader_election.cc:290] T cc02522cf9704f58a9d2bfd5326e3625 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 election: Requested vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:10.421975  2519 consensus_queue.cc:1048] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:10.429277  2407 raft_consensus.cc:515] T 12b5593f051548fea374da76afa08c3f P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:10.431733  2393 tablet_bootstrap.cc:492] T 36b22aafe7104cec82607dab40b4aed8 P 0ec6a5d1452a41bd992a8c7922473b35: No bootstrap required, opened a new log
I20260709 13:12:10.432114  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b5593f051548fea374da76afa08c3f" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:10.432384  2270 raft_consensus.cc:2468] T cc02522cf9704f58a9d2bfd5326e3625 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 1.
I20260709 13:12:10.432801  2346 raft_consensus.cc:3060] T 12b5593f051548fea374da76afa08c3f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.433573  2087 leader_election.cc:304] T cc02522cf9704f58a9d2bfd5326e3625 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:10.434504  2540 raft_consensus.cc:2804] T cc02522cf9704f58a9d2bfd5326e3625 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:10.434986  2540 raft_consensus.cc:697] T cc02522cf9704f58a9d2bfd5326e3625 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 LEADER]: Becoming Leader. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Running, Role: LEADER
I20260709 13:12:10.435786  2540 consensus_queue.cc:237] T cc02522cf9704f58a9d2bfd5326e3625 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:10.441251  2407 leader_election.cc:290] T 12b5593f051548fea374da76afa08c3f P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 election: Requested vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:10.439824  2346 raft_consensus.cc:2468] T 12b5593f051548fea374da76afa08c3f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 1.
I20260709 13:12:10.441830  2119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b5593f051548fea374da76afa08c3f" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:10.442759  2162 leader_election.cc:304] T 12b5593f051548fea374da76afa08c3f P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:10.432251  2393 ts_tablet_manager.cc:1403] T 36b22aafe7104cec82607dab40b4aed8 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent bootstrapping tablet: real 0.061s	user 0.025s	sys 0.020s
W20260709 13:12:10.444619  2162 leader_election.cc:343] T 12b5593f051548fea374da76afa08c3f P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:10.386447  2198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc02522cf9704f58a9d2bfd5326e3625" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:10.445672  2198 raft_consensus.cc:3060] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.445508  2407 raft_consensus.cc:2804] T 12b5593f051548fea374da76afa08c3f P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:10.386132  2402 ts_tablet_manager.cc:1434] T bdee3fd7553a47afae3ec9dbdce6d829 P 79b6e57d59e4468ebe4423d871a31b39: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.000s
I20260709 13:12:10.446323  2393 raft_consensus.cc:359] T 36b22aafe7104cec82607dab40b4aed8 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:10.448024  2392 tablet_bootstrap.cc:492] T bdee3fd7553a47afae3ec9dbdce6d829 P 66e9a8fffd4b4e5a81ca4fa2762773ea: No bootstrap required, opened a new log
I20260709 13:12:10.449941  2393 raft_consensus.cc:385] T 36b22aafe7104cec82607dab40b4aed8 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.450282  2393 raft_consensus.cc:740] T 36b22aafe7104cec82607dab40b4aed8 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Initialized, Role: FOLLOWER
I20260709 13:12:10.446158  2401 raft_consensus.cc:493] T 36b22aafe7104cec82607dab40b4aed8 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.450937  2392 ts_tablet_manager.cc:1403] T bdee3fd7553a47afae3ec9dbdce6d829 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent bootstrapping tablet: real 0.066s	user 0.017s	sys 0.008s
I20260709 13:12:10.450990  2393 consensus_queue.cc:260] T 36b22aafe7104cec82607dab40b4aed8 P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:10.451017  2401 raft_consensus.cc:515] T 36b22aafe7104cec82607dab40b4aed8 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:10.451965  2198 raft_consensus.cc:2468] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 1.
I20260709 13:12:10.452507  2402 tablet_bootstrap.cc:492] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39: Bootstrap starting.
I20260709 13:12:10.453045  2393 ts_tablet_manager.cc:1434] T 36b22aafe7104cec82607dab40b4aed8 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.000s
I20260709 13:12:10.453959  2393 tablet_bootstrap.cc:492] T b3b82132c31545aab274c7cf3f77c277 P 0ec6a5d1452a41bd992a8c7922473b35: Bootstrap starting.
I20260709 13:12:10.454517  2119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b22aafe7104cec82607dab40b4aed8" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:10.454752  2197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b22aafe7104cec82607dab40b4aed8" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:10.455391  2197 raft_consensus.cc:2468] T 36b22aafe7104cec82607dab40b4aed8 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 0.
W20260709 13:12:10.455749  2310 leader_election.cc:343] T 36b22aafe7104cec82607dab40b4aed8 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:10.456470  2392 raft_consensus.cc:359] T bdee3fd7553a47afae3ec9dbdce6d829 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:10.456697  2311 leader_election.cc:304] T 36b22aafe7104cec82607dab40b4aed8 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:10.457141  2392 raft_consensus.cc:385] T bdee3fd7553a47afae3ec9dbdce6d829 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.457437  2392 raft_consensus.cc:740] T bdee3fd7553a47afae3ec9dbdce6d829 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:10.448443  2391 tablet_bootstrap.cc:492] T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472: No bootstrap required, opened a new log
I20260709 13:12:10.449623  2519 raft_consensus.cc:493] T bdee3fd7553a47afae3ec9dbdce6d829 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.474102  2402 tablet_bootstrap.cc:654] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:10.446949  2407 raft_consensus.cc:697] T 12b5593f051548fea374da76afa08c3f P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 LEADER]: Becoming Leader. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Running, Role: LEADER
I20260709 13:12:10.458127  2401 leader_election.cc:290] T 36b22aafe7104cec82607dab40b4aed8 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:10.457531  2456 raft_consensus.cc:2804] T 36b22aafe7104cec82607dab40b4aed8 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:10.479396  2018 catalog_manager.cc:5697] T cc02522cf9704f58a9d2bfd5326e3625 P 2ac5c5682f914ed9b9982b5a080d5472 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "2ac5c5682f914ed9b9982b5a080d5472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:10.458644  2393 tablet_bootstrap.cc:654] T b3b82132c31545aab274c7cf3f77c277 P 0ec6a5d1452a41bd992a8c7922473b35: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:10.496604  2391 ts_tablet_manager.cc:1403] T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.113s	user 0.005s	sys 0.021s
I20260709 13:12:10.496060  2407 consensus_queue.cc:237] T 12b5593f051548fea374da76afa08c3f P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:10.499724  2456 raft_consensus.cc:493] T 36b22aafe7104cec82607dab40b4aed8 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.500490  2392 consensus_queue.cc:260] T bdee3fd7553a47afae3ec9dbdce6d829 P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:10.502661  2392 ts_tablet_manager.cc:1434] T bdee3fd7553a47afae3ec9dbdce6d829 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.000s
I20260709 13:12:10.495033  2519 raft_consensus.cc:515] T bdee3fd7553a47afae3ec9dbdce6d829 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:10.506016  2402 tablet_bootstrap.cc:492] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39: No bootstrap required, opened a new log
I20260709 13:12:10.506489  2402 ts_tablet_manager.cc:1403] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39: Time spent bootstrapping tablet: real 0.054s	user 0.016s	sys 0.022s
I20260709 13:12:10.509056  2402 raft_consensus.cc:359] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:10.509694  2402 raft_consensus.cc:385] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.509977  2402 raft_consensus.cc:740] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Initialized, Role: FOLLOWER
I20260709 13:12:10.510667  2402 consensus_queue.cc:260] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:10.511720  2456 raft_consensus.cc:3060] T 36b22aafe7104cec82607dab40b4aed8 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.517511  2021 catalog_manager.cc:5697] T 12b5593f051548fea374da76afa08c3f P 0ec6a5d1452a41bd992a8c7922473b35 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66). New cstate: current_term: 1 leader_uuid: "0ec6a5d1452a41bd992a8c7922473b35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:10.518349  2195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdee3fd7553a47afae3ec9dbdce6d829" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:10.519073  2195 raft_consensus.cc:2468] T bdee3fd7553a47afae3ec9dbdce6d829 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 0.
I20260709 13:12:10.520021  2402 ts_tablet_manager.cc:1434] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 13:12:10.520678  2237 leader_election.cc:304] T bdee3fd7553a47afae3ec9dbdce6d829 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:10.521023  2402 tablet_bootstrap.cc:492] T 5c3646d79bc840e9b4396f4351d1803d P 79b6e57d59e4468ebe4423d871a31b39: Bootstrap starting.
I20260709 13:12:10.521478  2518 raft_consensus.cc:2804] T bdee3fd7553a47afae3ec9dbdce6d829 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:10.518395  2393 tablet_bootstrap.cc:492] T b3b82132c31545aab274c7cf3f77c277 P 0ec6a5d1452a41bd992a8c7922473b35: No bootstrap required, opened a new log
I20260709 13:12:10.521867  2518 raft_consensus.cc:493] T bdee3fd7553a47afae3ec9dbdce6d829 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.522272  2518 raft_consensus.cc:3060] T bdee3fd7553a47afae3ec9dbdce6d829 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.522539  2519 leader_election.cc:290] T bdee3fd7553a47afae3ec9dbdce6d829 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:10.523636  2393 ts_tablet_manager.cc:1403] T b3b82132c31545aab274c7cf3f77c277 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent bootstrapping tablet: real 0.070s	user 0.018s	sys 0.003s
I20260709 13:12:10.526508  2393 raft_consensus.cc:359] T b3b82132c31545aab274c7cf3f77c277 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:10.526769  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdee3fd7553a47afae3ec9dbdce6d829" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:10.527444  2346 raft_consensus.cc:2468] T bdee3fd7553a47afae3ec9dbdce6d829 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 0.
I20260709 13:12:10.528867  2391 raft_consensus.cc:359] T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:10.529531  2391 raft_consensus.cc:385] T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.529808  2391 raft_consensus.cc:740] T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:10.529891  2518 raft_consensus.cc:515] T bdee3fd7553a47afae3ec9dbdce6d829 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:10.482086  2419 consensus_queue.cc:1048] T 01a3c95e54104a998cdf16d06db2800a P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.040s
I20260709 13:12:10.530534  2391 consensus_queue.cc:260] T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:10.535171  2392 tablet_bootstrap.cc:492] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea: Bootstrap starting.
I20260709 13:12:10.527160  2393 raft_consensus.cc:385] T b3b82132c31545aab274c7cf3f77c277 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.544641  2393 raft_consensus.cc:740] T b3b82132c31545aab274c7cf3f77c277 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Initialized, Role: FOLLOWER
W20260709 13:12:10.555291  2069 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:10.556056  2198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdee3fd7553a47afae3ec9dbdce6d829" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:10.556738  2198 raft_consensus.cc:3060] T bdee3fd7553a47afae3ec9dbdce6d829 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.557637  2518 leader_election.cc:290] T bdee3fd7553a47afae3ec9dbdce6d829 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 election: Requested vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:10.559078  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdee3fd7553a47afae3ec9dbdce6d829" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:10.559634  2346 raft_consensus.cc:3060] T bdee3fd7553a47afae3ec9dbdce6d829 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.563867  2392 tablet_bootstrap.cc:654] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:10.564148  2198 raft_consensus.cc:2468] T bdee3fd7553a47afae3ec9dbdce6d829 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 1.
I20260709 13:12:10.564644  2402 tablet_bootstrap.cc:654] T 5c3646d79bc840e9b4396f4351d1803d P 79b6e57d59e4468ebe4423d871a31b39: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:10.565410  2237 leader_election.cc:304] T bdee3fd7553a47afae3ec9dbdce6d829 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:10.566457  2518 raft_consensus.cc:2804] T bdee3fd7553a47afae3ec9dbdce6d829 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:10.566947  2518 raft_consensus.cc:697] T bdee3fd7553a47afae3ec9dbdce6d829 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 LEADER]: Becoming Leader. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Running, Role: LEADER
I20260709 13:12:10.567853  2518 consensus_queue.cc:237] T bdee3fd7553a47afae3ec9dbdce6d829 P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:10.539700  2456 raft_consensus.cc:515] T 36b22aafe7104cec82607dab40b4aed8 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:10.566869  2346 raft_consensus.cc:2468] T bdee3fd7553a47afae3ec9dbdce6d829 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 1.
I20260709 13:12:10.571708  2119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b22aafe7104cec82607dab40b4aed8" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
W20260709 13:12:10.573288  2310 leader_election.cc:343] T 36b22aafe7104cec82607dab40b4aed8 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:10.568747  2391 ts_tablet_manager.cc:1434] T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.072s	user 0.006s	sys 0.000s
I20260709 13:12:10.574584  2391 tablet_bootstrap.cc:492] T 1478f883c539464bb54fe9bff44148d5 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:10.579713  2448 consensus_queue.cc:1048] T 01a3c95e54104a998cdf16d06db2800a P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:10.559412  2393 consensus_queue.cc:260] T b3b82132c31545aab274c7cf3f77c277 P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:10.593663  2407 consensus_queue.cc:1048] T d3370eb67fff4896b1f8e3ce56eceb9b P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:10.596187  2393 ts_tablet_manager.cc:1434] T b3b82132c31545aab274c7cf3f77c277 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent starting tablet: real 0.072s	user 0.008s	sys 0.000s
I20260709 13:12:10.611841  2393 tablet_bootstrap.cc:492] T f2a1307186df4616a9759118c2e456a6 P 0ec6a5d1452a41bd992a8c7922473b35: Bootstrap starting.
I20260709 13:12:10.618759  2540 raft_consensus.cc:493] T 5c3646d79bc840e9b4396f4351d1803d P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.619318  2540 raft_consensus.cc:515] T 5c3646d79bc840e9b4396f4351d1803d P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:10.620275  2391 tablet_bootstrap.cc:654] T 1478f883c539464bb54fe9bff44148d5 P 2ac5c5682f914ed9b9982b5a080d5472: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:10.622005  2540 leader_election.cc:290] T 5c3646d79bc840e9b4396f4351d1803d P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:10.622113  2195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3646d79bc840e9b4396f4351d1803d" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:10.622782  2456 leader_election.cc:290] T 36b22aafe7104cec82607dab40b4aed8 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 election: Requested vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:10.622826  2195 raft_consensus.cc:2468] T 5c3646d79bc840e9b4396f4351d1803d P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 0.
I20260709 13:12:10.623312  2198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b22aafe7104cec82607dab40b4aed8" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:10.623888  2198 raft_consensus.cc:3060] T 36b22aafe7104cec82607dab40b4aed8 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.624191  2088 leader_election.cc:304] T 5c3646d79bc840e9b4396f4351d1803d P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472; no voters: 
I20260709 13:12:10.624697  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3646d79bc840e9b4396f4351d1803d" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:10.625046  2540 raft_consensus.cc:2804] T 5c3646d79bc840e9b4396f4351d1803d P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:10.625485  2540 raft_consensus.cc:493] T 5c3646d79bc840e9b4396f4351d1803d P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.625871  2540 raft_consensus.cc:3060] T 5c3646d79bc840e9b4396f4351d1803d P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.625765  2422 raft_consensus.cc:493] T b3b82132c31545aab274c7cf3f77c277 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.630982  2422 raft_consensus.cc:515] T b3b82132c31545aab274c7cf3f77c277 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:10.631807  2393 tablet_bootstrap.cc:654] T f2a1307186df4616a9759118c2e456a6 P 0ec6a5d1452a41bd992a8c7922473b35: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:10.632345  2087 leader_election.cc:343] T 5c3646d79bc840e9b4396f4351d1803d P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:10.633038  2422 leader_election.cc:290] T b3b82132c31545aab274c7cf3f77c277 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:10.634220  2527 raft_consensus.cc:493] T 5aac56f958fb4fe29fe46d2a9be60ffd P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.634680  2527 raft_consensus.cc:515] T 5aac56f958fb4fe29fe46d2a9be60ffd P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:10.636561  2527 leader_election.cc:290] T 5aac56f958fb4fe29fe46d2a9be60ffd P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:10.634181  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b82132c31545aab274c7cf3f77c277" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:10.636890  2407 consensus_queue.cc:1048] T d3370eb67fff4896b1f8e3ce56eceb9b P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:10.637743  2346 raft_consensus.cc:2468] T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 0.
I20260709 13:12:10.637885  2195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b82132c31545aab274c7cf3f77c277" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:10.638840  2087 leader_election.cc:304] T b3b82132c31545aab274c7cf3f77c277 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:10.638593  2195 raft_consensus.cc:2468] T b3b82132c31545aab274c7cf3f77c277 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 0.
I20260709 13:12:10.639758  2422 raft_consensus.cc:2804] T b3b82132c31545aab274c7cf3f77c277 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:10.640205  2422 raft_consensus.cc:493] T b3b82132c31545aab274c7cf3f77c277 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.640583  2422 raft_consensus.cc:3060] T b3b82132c31545aab274c7cf3f77c277 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.640843  2018 catalog_manager.cc:5697] T bdee3fd7553a47afae3ec9dbdce6d829 P 79b6e57d59e4468ebe4423d871a31b39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67). New cstate: current_term: 1 leader_uuid: "79b6e57d59e4468ebe4423d871a31b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:10.642871  2518 raft_consensus.cc:493] T 86834d94d1d64596abfa609754b5d58a P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.643415  2518 raft_consensus.cc:515] T 86834d94d1d64596abfa609754b5d58a P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:10.645107  2198 raft_consensus.cc:2468] T 36b22aafe7104cec82607dab40b4aed8 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 1.
I20260709 13:12:10.645604  2402 tablet_bootstrap.cc:492] T 5c3646d79bc840e9b4396f4351d1803d P 79b6e57d59e4468ebe4423d871a31b39: No bootstrap required, opened a new log
I20260709 13:12:10.646101  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86834d94d1d64596abfa609754b5d58a" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:10.646394  2311 leader_election.cc:304] T 36b22aafe7104cec82607dab40b4aed8 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:10.646708  2346 raft_consensus.cc:2468] T 86834d94d1d64596abfa609754b5d58a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 0.
I20260709 13:12:10.647827  2456 raft_consensus.cc:2804] T 36b22aafe7104cec82607dab40b4aed8 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:10.648842  2120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86834d94d1d64596abfa609754b5d58a" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:10.649461  2120 raft_consensus.cc:2468] T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 0.
I20260709 13:12:10.646086  2402 ts_tablet_manager.cc:1403] T 5c3646d79bc840e9b4396f4351d1803d P 79b6e57d59e4468ebe4423d871a31b39: Time spent bootstrapping tablet: real 0.125s	user 0.025s	sys 0.009s
I20260709 13:12:10.650799  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aac56f958fb4fe29fe46d2a9be60ffd" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:10.648008  2236 leader_election.cc:304] T 86834d94d1d64596abfa609754b5d58a P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:10.652591  2402 raft_consensus.cc:359] T 5c3646d79bc840e9b4396f4351d1803d P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:10.653267  2402 raft_consensus.cc:385] T 5c3646d79bc840e9b4396f4351d1803d P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.653344  2419 raft_consensus.cc:2804] T 86834d94d1d64596abfa609754b5d58a P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:10.653748  2419 raft_consensus.cc:493] T 86834d94d1d64596abfa609754b5d58a P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.654170  2419 raft_consensus.cc:3060] T 86834d94d1d64596abfa609754b5d58a P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:10.652190  2162 leader_election.cc:343] T 5aac56f958fb4fe29fe46d2a9be60ffd P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:10.655567  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aac56f958fb4fe29fe46d2a9be60ffd" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:10.658241  2346 raft_consensus.cc:2468] T 5aac56f958fb4fe29fe46d2a9be60ffd P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 0.
I20260709 13:12:10.659703  2162 leader_election.cc:304] T 5aac56f958fb4fe29fe46d2a9be60ffd P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:10.648819  2456 raft_consensus.cc:697] T 36b22aafe7104cec82607dab40b4aed8 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 LEADER]: Becoming Leader. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Running, Role: LEADER
I20260709 13:12:10.661916  2527 raft_consensus.cc:2804] T 5aac56f958fb4fe29fe46d2a9be60ffd P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:10.662300  2527 raft_consensus.cc:493] T 5aac56f958fb4fe29fe46d2a9be60ffd P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.662648  2527 raft_consensus.cc:3060] T 5aac56f958fb4fe29fe46d2a9be60ffd P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.662160  2456 consensus_queue.cc:237] T 36b22aafe7104cec82607dab40b4aed8 P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:10.665663  2419 raft_consensus.cc:515] T 86834d94d1d64596abfa609754b5d58a P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:10.667810  2422 raft_consensus.cc:515] T b3b82132c31545aab274c7cf3f77c277 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:10.669508  2527 raft_consensus.cc:515] T 5aac56f958fb4fe29fe46d2a9be60ffd P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:10.670476  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b82132c31545aab274c7cf3f77c277" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:10.671128  2344 raft_consensus.cc:3060] T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.671535  2527 leader_election.cc:290] T 5aac56f958fb4fe29fe46d2a9be60ffd P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 election: Requested vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:10.672096  2518 leader_election.cc:290] T 86834d94d1d64596abfa609754b5d58a P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:10.673075  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aac56f958fb4fe29fe46d2a9be60ffd" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:10.673211  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aac56f958fb4fe29fe46d2a9be60ffd" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:10.673875  2343 raft_consensus.cc:3060] T 5aac56f958fb4fe29fe46d2a9be60ffd P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.672165  2401 consensus_queue.cc:1048] T 8a672ef15abf47e4b650405c29044d3e P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:12:10.675340  2540 raft_consensus.cc:515] T 5c3646d79bc840e9b4396f4351d1803d P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:10.677351  2540 leader_election.cc:290] T 5c3646d79bc840e9b4396f4351d1803d P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 election: Requested vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:10.678349  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3646d79bc840e9b4396f4351d1803d" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:10.678784  2198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b82132c31545aab274c7cf3f77c277" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:10.679353  2198 raft_consensus.cc:3060] T b3b82132c31545aab274c7cf3f77c277 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.679657  2344 raft_consensus.cc:2468] T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 1.
I20260709 13:12:10.680250  2392 tablet_bootstrap.cc:492] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea: No bootstrap required, opened a new log
I20260709 13:12:10.680737  2392 ts_tablet_manager.cc:1403] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent bootstrapping tablet: real 0.146s	user 0.011s	sys 0.002s
I20260709 13:12:10.681597  2195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3646d79bc840e9b4396f4351d1803d" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:10.682143  2195 raft_consensus.cc:3060] T 5c3646d79bc840e9b4396f4351d1803d P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.683406  2392 raft_consensus.cc:359] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:10.684132  2402 raft_consensus.cc:740] T 5c3646d79bc840e9b4396f4351d1803d P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Initialized, Role: FOLLOWER
I20260709 13:12:10.684057  2087 leader_election.cc:304] T b3b82132c31545aab274c7cf3f77c277 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:10.685091  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86834d94d1d64596abfa609754b5d58a" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:10.685657  2346 raft_consensus.cc:3060] T 86834d94d1d64596abfa609754b5d58a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.685668  2540 raft_consensus.cc:2804] T b3b82132c31545aab274c7cf3f77c277 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:10.686510  2540 raft_consensus.cc:697] T b3b82132c31545aab274c7cf3f77c277 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 LEADER]: Becoming Leader. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Running, Role: LEADER
I20260709 13:12:10.687925  2540 consensus_queue.cc:237] T b3b82132c31545aab274c7cf3f77c277 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:10.690557  2343 raft_consensus.cc:2468] T 5aac56f958fb4fe29fe46d2a9be60ffd P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 1.
I20260709 13:12:10.684075  2392 raft_consensus.cc:385] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.692829  2392 raft_consensus.cc:740] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:10.693622  2392 consensus_queue.cc:260] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:10.695339  2195 raft_consensus.cc:2468] T 5c3646d79bc840e9b4396f4351d1803d P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 1.
I20260709 13:12:10.696539  2088 leader_election.cc:304] T 5c3646d79bc840e9b4396f4351d1803d P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472; no voters: 
I20260709 13:12:10.696851  2197 raft_consensus.cc:3060] T 8a672ef15abf47e4b650405c29044d3e P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.697361  2451 raft_consensus.cc:2804] T 5c3646d79bc840e9b4396f4351d1803d P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:10.700161  2392 ts_tablet_manager.cc:1434] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 13:12:10.701181  2392 tablet_bootstrap.cc:492] T f2a1307186df4616a9759118c2e456a6 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Bootstrap starting.
I20260709 13:12:10.706254  2526 consensus_queue.cc:1048] T 8a672ef15abf47e4b650405c29044d3e P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:10.707020  2119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86834d94d1d64596abfa609754b5d58a" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:10.705497  2162 leader_election.cc:304] T 5aac56f958fb4fe29fe46d2a9be60ffd P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:10.707674  2119 raft_consensus.cc:3060] T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.709411  2407 raft_consensus.cc:2804] T 5aac56f958fb4fe29fe46d2a9be60ffd P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:12:10.711483  2162 leader_election.cc:343] T 5aac56f958fb4fe29fe46d2a9be60ffd P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:10.711086  2198 raft_consensus.cc:2468] T b3b82132c31545aab274c7cf3f77c277 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 1.
I20260709 13:12:10.684935  2402 consensus_queue.cc:260] T 5c3646d79bc840e9b4396f4351d1803d P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:10.714754  2272 raft_consensus.cc:3060] T 5c3646d79bc840e9b4396f4351d1803d P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.707278  2419 leader_election.cc:290] T 86834d94d1d64596abfa609754b5d58a P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 election: Requested vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:10.717862  2402 ts_tablet_manager.cc:1434] T 5c3646d79bc840e9b4396f4351d1803d P 79b6e57d59e4468ebe4423d871a31b39: Time spent starting tablet: real 0.068s	user 0.005s	sys 0.002s
I20260709 13:12:10.718683  2119 raft_consensus.cc:2468] T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 1.
I20260709 13:12:10.720181  2392 tablet_bootstrap.cc:654] T f2a1307186df4616a9759118c2e456a6 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:10.720095  2236 leader_election.cc:304] T 86834d94d1d64596abfa609754b5d58a P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:10.721427  2518 raft_consensus.cc:2804] T 86834d94d1d64596abfa609754b5d58a P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:10.722612  2272 raft_consensus.cc:2468] T 5c3646d79bc840e9b4396f4351d1803d P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 1.
I20260709 13:12:10.719978  2401 raft_consensus.cc:493] T bc42d18a324e4f6d97f07cf770c5daa8 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.724601  2401 raft_consensus.cc:515] T bc42d18a324e4f6d97f07cf770c5daa8 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:10.728513  2346 raft_consensus.cc:2468] T 86834d94d1d64596abfa609754b5d58a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 1.
I20260709 13:12:10.730613  2422 leader_election.cc:290] T b3b82132c31545aab274c7cf3f77c277 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 election: Requested vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:10.735620  2401 leader_election.cc:290] T bc42d18a324e4f6d97f07cf770c5daa8 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:10.723989  2518 raft_consensus.cc:697] T 86834d94d1d64596abfa609754b5d58a P 79b6e57d59e4468ebe4423d871a31b39 [term 1 LEADER]: Becoming Leader. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Running, Role: LEADER
I20260709 13:12:10.741539  2451 raft_consensus.cc:697] T 5c3646d79bc840e9b4396f4351d1803d P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 LEADER]: Becoming Leader. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Running, Role: LEADER
I20260709 13:12:10.742165  2518 consensus_queue.cc:237] T 86834d94d1d64596abfa609754b5d58a P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:10.742444  2451 consensus_queue.cc:237] T 5c3646d79bc840e9b4396f4351d1803d P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:10.740986  2197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc42d18a324e4f6d97f07cf770c5daa8" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:10.741180  2119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc42d18a324e4f6d97f07cf770c5daa8" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
W20260709 13:12:10.744645  2311 leader_election.cc:343] T bc42d18a324e4f6d97f07cf770c5daa8 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:10.745433  2310 leader_election.cc:343] T bc42d18a324e4f6d97f07cf770c5daa8 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:10.746049  2310 leader_election.cc:304] T bc42d18a324e4f6d97f07cf770c5daa8 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:10.747540  2401 raft_consensus.cc:2749] T bc42d18a324e4f6d97f07cf770c5daa8 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:10.755280  2391 tablet_bootstrap.cc:492] T 1478f883c539464bb54fe9bff44148d5 P 2ac5c5682f914ed9b9982b5a080d5472: No bootstrap required, opened a new log
I20260709 13:12:10.755797  2391 ts_tablet_manager.cc:1403] T 1478f883c539464bb54fe9bff44148d5 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.181s	user 0.010s	sys 0.007s
I20260709 13:12:10.758381  2391 raft_consensus.cc:359] T 1478f883c539464bb54fe9bff44148d5 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:10.759449  2391 raft_consensus.cc:385] T 1478f883c539464bb54fe9bff44148d5 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.759717  2391 raft_consensus.cc:740] T 1478f883c539464bb54fe9bff44148d5 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:10.760318  2391 consensus_queue.cc:260] T 1478f883c539464bb54fe9bff44148d5 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:10.763492  2391 ts_tablet_manager.cc:1434] T 1478f883c539464bb54fe9bff44148d5 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:12:10.764348  2391 tablet_bootstrap.cc:492] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:10.769868  2391 tablet_bootstrap.cc:654] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:10.772161  2419 raft_consensus.cc:493] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.772689  2419 raft_consensus.cc:515] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:10.774645  2393 tablet_bootstrap.cc:492] T f2a1307186df4616a9759118c2e456a6 P 0ec6a5d1452a41bd992a8c7922473b35: No bootstrap required, opened a new log
I20260709 13:12:10.774858  2419 leader_election.cc:290] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:10.775147  2393 ts_tablet_manager.cc:1403] T f2a1307186df4616a9759118c2e456a6 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent bootstrapping tablet: real 0.164s	user 0.017s	sys 0.000s
I20260709 13:12:10.776867  2119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1478f883c539464bb54fe9bff44148d5" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:10.777503  2119 raft_consensus.cc:2468] T 1478f883c539464bb54fe9bff44148d5 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 0.
I20260709 13:12:10.778172  2588 raft_consensus.cc:493] T 1478f883c539464bb54fe9bff44148d5 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.778666  2588 raft_consensus.cc:515] T 1478f883c539464bb54fe9bff44148d5 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:10.779608  2236 leader_election.cc:304] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:10.780730  2519 raft_consensus.cc:2804] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:10.781101  2519 raft_consensus.cc:493] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.781443  2519 raft_consensus.cc:3060] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.781855  2588 leader_election.cc:290] T 1478f883c539464bb54fe9bff44148d5 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:10.782395  2407 raft_consensus.cc:697] T 5aac56f958fb4fe29fe46d2a9be60ffd P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 LEADER]: Becoming Leader. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Running, Role: LEADER
I20260709 13:12:10.783248  2407 consensus_queue.cc:237] T 5aac56f958fb4fe29fe46d2a9be60ffd P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:10.785226  2402 tablet_bootstrap.cc:492] T 5aac56f958fb4fe29fe46d2a9be60ffd P 79b6e57d59e4468ebe4423d871a31b39: Bootstrap starting.
I20260709 13:12:10.785702  2119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1478f883c539464bb54fe9bff44148d5" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:10.786216  2197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1478f883c539464bb54fe9bff44148d5" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:10.786840  2197 raft_consensus.cc:2468] T 1478f883c539464bb54fe9bff44148d5 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 0.
I20260709 13:12:10.787370  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1478f883c539464bb54fe9bff44148d5" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:10.786295  2119 raft_consensus.cc:2468] T 1478f883c539464bb54fe9bff44148d5 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 0.
I20260709 13:12:10.788461  2392 tablet_bootstrap.cc:492] T f2a1307186df4616a9759118c2e456a6 P 66e9a8fffd4b4e5a81ca4fa2762773ea: No bootstrap required, opened a new log
I20260709 13:12:10.788875  2392 ts_tablet_manager.cc:1403] T f2a1307186df4616a9759118c2e456a6 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent bootstrapping tablet: real 0.088s	user 0.011s	sys 0.002s
I20260709 13:12:10.789165  2162 leader_election.cc:304] T 1478f883c539464bb54fe9bff44148d5 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472; no voters: 
I20260709 13:12:10.790643  2527 raft_consensus.cc:2804] T 1478f883c539464bb54fe9bff44148d5 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:10.790989  2527 raft_consensus.cc:493] T 1478f883c539464bb54fe9bff44148d5 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.791294  2527 raft_consensus.cc:3060] T 1478f883c539464bb54fe9bff44148d5 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.791460  2392 raft_consensus.cc:359] T f2a1307186df4616a9759118c2e456a6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:10.791337  2519 raft_consensus.cc:515] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:10.792166  2392 raft_consensus.cc:385] T f2a1307186df4616a9759118c2e456a6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.792495  2392 raft_consensus.cc:740] T f2a1307186df4616a9759118c2e456a6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:10.792884  2270 raft_consensus.cc:2393] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec6a5d1452a41bd992a8c7922473b35 in current term 1: Already voted for candidate 79b6e57d59e4468ebe4423d871a31b39 in this term.
I20260709 13:12:10.795733  2393 raft_consensus.cc:359] T f2a1307186df4616a9759118c2e456a6 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:10.796430  2393 raft_consensus.cc:385] T f2a1307186df4616a9759118c2e456a6 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.796689  2393 raft_consensus.cc:740] T f2a1307186df4616a9759118c2e456a6 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Initialized, Role: FOLLOWER
I20260709 13:12:10.797307  2119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1478f883c539464bb54fe9bff44148d5" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:10.797991  2119 raft_consensus.cc:3060] T 1478f883c539464bb54fe9bff44148d5 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.799778  2392 consensus_queue.cc:260] T f2a1307186df4616a9759118c2e456a6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:10.801220  2527 raft_consensus.cc:515] T 1478f883c539464bb54fe9bff44148d5 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:10.802048  2392 ts_tablet_manager.cc:1434] T f2a1307186df4616a9759118c2e456a6 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 13:12:10.802760  2392 tablet_bootstrap.cc:492] T ee1baa7401cd48e48e7125dcd607f44f P 66e9a8fffd4b4e5a81ca4fa2762773ea: Bootstrap starting.
I20260709 13:12:10.797370  2393 consensus_queue.cc:260] T f2a1307186df4616a9759118c2e456a6 P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:10.801887  2419 raft_consensus.cc:493] T 2993800f8e7e4c09bfe0b2be13e4394c P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.804347  2419 raft_consensus.cc:515] T 2993800f8e7e4c09bfe0b2be13e4394c P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:10.805164  2393 ts_tablet_manager.cc:1434] T f2a1307186df4616a9759118c2e456a6 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 13:12:10.805271  2519 leader_election.cc:290] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 election: Requested vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:10.806350  2419 leader_election.cc:290] T 2993800f8e7e4c09bfe0b2be13e4394c P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:10.808008  2402 tablet_bootstrap.cc:654] T 5aac56f958fb4fe29fe46d2a9be60ffd P 79b6e57d59e4468ebe4423d871a31b39: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:10.807859  2197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2993800f8e7e4c09bfe0b2be13e4394c" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:10.808584  2197 raft_consensus.cc:2468] T 2993800f8e7e4c09bfe0b2be13e4394c P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 1.
I20260709 13:12:10.809639  2237 leader_election.cc:304] T 2993800f8e7e4c09bfe0b2be13e4394c P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:10.810542  2419 raft_consensus.cc:2804] T 2993800f8e7e4c09bfe0b2be13e4394c P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:10.810931  2419 raft_consensus.cc:493] T 2993800f8e7e4c09bfe0b2be13e4394c P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.811180  2393 tablet_bootstrap.cc:492] T 8b65903ab966485c9c65bdfbdf1e1054 P 0ec6a5d1452a41bd992a8c7922473b35: Bootstrap starting.
I20260709 13:12:10.812652  2120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1478f883c539464bb54fe9bff44148d5" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:10.813246  2527 leader_election.cc:290] T 1478f883c539464bb54fe9bff44148d5 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 election: Requested vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:10.811275  2419 raft_consensus.cc:3060] T 2993800f8e7e4c09bfe0b2be13e4394c P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:10.819895  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1478f883c539464bb54fe9bff44148d5" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:10.820303  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2993800f8e7e4c09bfe0b2be13e4394c" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:10.820627  2270 raft_consensus.cc:2393] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec6a5d1452a41bd992a8c7922473b35 in current term 1: Already voted for candidate 79b6e57d59e4468ebe4423d871a31b39 in this term.
I20260709 13:12:10.821620  2119 raft_consensus.cc:2468] T 1478f883c539464bb54fe9bff44148d5 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 1.
I20260709 13:12:10.822815  2236 leader_election.cc:304] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:10.823995  2345 raft_consensus.cc:2468] T 2993800f8e7e4c09bfe0b2be13e4394c P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 1.
I20260709 13:12:10.824980  2021 catalog_manager.cc:5697] T 36b22aafe7104cec82607dab40b4aed8 P 66e9a8fffd4b4e5a81ca4fa2762773ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68). New cstate: current_term: 1 leader_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:10.825714  2198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1478f883c539464bb54fe9bff44148d5" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:10.827275  2198 raft_consensus.cc:2393] T 1478f883c539464bb54fe9bff44148d5 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 79b6e57d59e4468ebe4423d871a31b39 in current term 1: Already voted for candidate 0ec6a5d1452a41bd992a8c7922473b35 in this term.
I20260709 13:12:10.824636  2519 raft_consensus.cc:2804] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:10.828191  2519 raft_consensus.cc:697] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 LEADER]: Becoming Leader. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Running, Role: LEADER
I20260709 13:12:10.827998  2019 catalog_manager.cc:5697] T 5aac56f958fb4fe29fe46d2a9be60ffd P 0ec6a5d1452a41bd992a8c7922473b35 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66). New cstate: current_term: 1 leader_uuid: "0ec6a5d1452a41bd992a8c7922473b35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:10.829031  2519 consensus_queue.cc:237] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:10.823122  2018 catalog_manager.cc:5697] T 86834d94d1d64596abfa609754b5d58a P 79b6e57d59e4468ebe4423d871a31b39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67). New cstate: current_term: 1 leader_uuid: "79b6e57d59e4468ebe4423d871a31b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:10.833452  2162 leader_election.cc:304] T 1478f883c539464bb54fe9bff44148d5 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:10.835611  2020 catalog_manager.cc:5697] T b3b82132c31545aab274c7cf3f77c277 P 2ac5c5682f914ed9b9982b5a080d5472 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "2ac5c5682f914ed9b9982b5a080d5472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:10.836711  2392 tablet_bootstrap.cc:654] T ee1baa7401cd48e48e7125dcd607f44f P 66e9a8fffd4b4e5a81ca4fa2762773ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:10.848412  2419 raft_consensus.cc:515] T 2993800f8e7e4c09bfe0b2be13e4394c P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:10.853819  2393 tablet_bootstrap.cc:654] T 8b65903ab966485c9c65bdfbdf1e1054 P 0ec6a5d1452a41bd992a8c7922473b35: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:10.842408  2407 raft_consensus.cc:2749] T 1478f883c539464bb54fe9bff44148d5 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:10.854178  2402 tablet_bootstrap.cc:492] T 5aac56f958fb4fe29fe46d2a9be60ffd P 79b6e57d59e4468ebe4423d871a31b39: No bootstrap required, opened a new log
I20260709 13:12:10.855222  2419 leader_election.cc:290] T 2993800f8e7e4c09bfe0b2be13e4394c P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 election: Requested vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:10.856123  2402 ts_tablet_manager.cc:1403] T 5aac56f958fb4fe29fe46d2a9be60ffd P 79b6e57d59e4468ebe4423d871a31b39: Time spent bootstrapping tablet: real 0.071s	user 0.011s	sys 0.000s
I20260709 13:12:10.857436  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2993800f8e7e4c09bfe0b2be13e4394c" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:10.858033  2346 raft_consensus.cc:3060] T 2993800f8e7e4c09bfe0b2be13e4394c P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:10.858937  2402 raft_consensus.cc:359] T 5aac56f958fb4fe29fe46d2a9be60ffd P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:10.859648  2402 raft_consensus.cc:385] T 5aac56f958fb4fe29fe46d2a9be60ffd P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.859912  2402 raft_consensus.cc:740] T 5aac56f958fb4fe29fe46d2a9be60ffd P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Initialized, Role: FOLLOWER
I20260709 13:12:10.860697  2402 consensus_queue.cc:260] T 5aac56f958fb4fe29fe46d2a9be60ffd P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:10.863251  2402 ts_tablet_manager.cc:1434] T 5aac56f958fb4fe29fe46d2a9be60ffd P 79b6e57d59e4468ebe4423d871a31b39: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.004s
I20260709 13:12:10.864185  2402 tablet_bootstrap.cc:492] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39: Bootstrap starting.
I20260709 13:12:10.864593  2346 raft_consensus.cc:2468] T 2993800f8e7e4c09bfe0b2be13e4394c P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 2.
I20260709 13:12:10.865899  2236 leader_election.cc:304] T 2993800f8e7e4c09bfe0b2be13e4394c P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:10.866703  2419 raft_consensus.cc:2804] T 2993800f8e7e4c09bfe0b2be13e4394c P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:10.867149  2419 raft_consensus.cc:697] T 2993800f8e7e4c09bfe0b2be13e4394c P 79b6e57d59e4468ebe4423d871a31b39 [term 2 LEADER]: Becoming Leader. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Running, Role: LEADER
I20260709 13:12:10.867919  2419 consensus_queue.cc:237] T 2993800f8e7e4c09bfe0b2be13e4394c P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:10.869625  2402 tablet_bootstrap.cc:654] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:10.875785  2518 raft_consensus.cc:493] T 5aac56f958fb4fe29fe46d2a9be60ffd P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.878173  2518 raft_consensus.cc:515] T 5aac56f958fb4fe29fe46d2a9be60ffd P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:10.885668  2518 leader_election.cc:290] T 5aac56f958fb4fe29fe46d2a9be60ffd P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:10.890740  2197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aac56f958fb4fe29fe46d2a9be60ffd" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:10.891675  2391 tablet_bootstrap.cc:492] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472: No bootstrap required, opened a new log
I20260709 13:12:10.892515  2391 ts_tablet_manager.cc:1403] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.128s	user 0.013s	sys 0.005s
I20260709 13:12:10.897300  2402 tablet_bootstrap.cc:492] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39: No bootstrap required, opened a new log
I20260709 13:12:10.894093  2401 raft_consensus.cc:493] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:10.899151  2402 ts_tablet_manager.cc:1403] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.009s
I20260709 13:12:10.899942  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aac56f958fb4fe29fe46d2a9be60ffd" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:10.906435  2346 raft_consensus.cc:2393] T 5aac56f958fb4fe29fe46d2a9be60ffd P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79b6e57d59e4468ebe4423d871a31b39 in current term 1: Already voted for candidate 0ec6a5d1452a41bd992a8c7922473b35 in this term.
I20260709 13:12:10.900660  2392 tablet_bootstrap.cc:492] T ee1baa7401cd48e48e7125dcd607f44f P 66e9a8fffd4b4e5a81ca4fa2762773ea: No bootstrap required, opened a new log
I20260709 13:12:10.907322  2392 ts_tablet_manager.cc:1403] T ee1baa7401cd48e48e7125dcd607f44f P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent bootstrapping tablet: real 0.105s	user 0.005s	sys 0.034s
I20260709 13:12:10.907658  2236 leader_election.cc:304] T 5aac56f958fb4fe29fe46d2a9be60ffd P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b6e57d59e4468ebe4423d871a31b39; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea
I20260709 13:12:10.908502  2402 raft_consensus.cc:359] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:10.909188  2402 raft_consensus.cc:385] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.909459  2402 raft_consensus.cc:740] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Initialized, Role: FOLLOWER
I20260709 13:12:10.909821  2392 raft_consensus.cc:359] T ee1baa7401cd48e48e7125dcd607f44f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:10.910113  2402 consensus_queue.cc:260] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:10.910346  2451 consensus_queue.cc:1048] T cc02522cf9704f58a9d2bfd5326e3625 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:10.910876  2392 raft_consensus.cc:385] T ee1baa7401cd48e48e7125dcd607f44f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.911223  2392 raft_consensus.cc:740] T ee1baa7401cd48e48e7125dcd607f44f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:10.906054  2401 raft_consensus.cc:515] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:10.912660  2392 consensus_queue.cc:260] T ee1baa7401cd48e48e7125dcd607f44f P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:10.913385  2402 ts_tablet_manager.cc:1434] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:12:10.914034  2401 leader_election.cc:290] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:10.914402  2402 tablet_bootstrap.cc:492] T f2a1307186df4616a9759118c2e456a6 P 79b6e57d59e4468ebe4423d871a31b39: Bootstrap starting.
I20260709 13:12:10.915452  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b10072083419c89d5a4bf5d6413fc" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:10.915982  2119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b10072083419c89d5a4bf5d6413fc" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:10.898293  2198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2993800f8e7e4c09bfe0b2be13e4394c" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:10.903574  2391 raft_consensus.cc:359] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:10.916250  2392 ts_tablet_manager.cc:1434] T ee1baa7401cd48e48e7125dcd607f44f P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:12:10.916112  2272 raft_consensus.cc:2468] T 427b10072083419c89d5a4bf5d6413fc P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 0.
I20260709 13:12:10.918625  2198 raft_consensus.cc:3060] T 2993800f8e7e4c09bfe0b2be13e4394c P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:10.919085  2020 catalog_manager.cc:5697] T 5c3646d79bc840e9b4396f4351d1803d P 2ac5c5682f914ed9b9982b5a080d5472 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "2ac5c5682f914ed9b9982b5a080d5472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:10.920583  2310 leader_election.cc:304] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:10.921336  2401 raft_consensus.cc:2804] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:10.921789  2401 raft_consensus.cc:493] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:10.922142  2401 raft_consensus.cc:3060] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:10.922637  2310 leader_election.cc:343] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:10.921408  2451 consensus_queue.cc:1048] T cc02522cf9704f58a9d2bfd5326e3625 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:12:10.926853  2198 raft_consensus.cc:2468] T 2993800f8e7e4c09bfe0b2be13e4394c P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 2.
I20260709 13:12:10.927452  2393 tablet_bootstrap.cc:492] T 8b65903ab966485c9c65bdfbdf1e1054 P 0ec6a5d1452a41bd992a8c7922473b35: No bootstrap required, opened a new log
I20260709 13:12:10.927943  2391 raft_consensus.cc:385] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.928401  2391 raft_consensus.cc:740] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:10.929054  2391 consensus_queue.cc:260] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:10.929234  2401 raft_consensus.cc:515] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:10.931182  2391 ts_tablet_manager.cc:1434] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 13:12:10.932121  2391 tablet_bootstrap.cc:492] T 12b5593f051548fea374da76afa08c3f P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:10.932257  2018 catalog_manager.cc:5697] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67). New cstate: current_term: 1 leader_uuid: "79b6e57d59e4468ebe4423d871a31b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:10.933320  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b10072083419c89d5a4bf5d6413fc" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:10.933995  2272 raft_consensus.cc:3060] T 427b10072083419c89d5a4bf5d6413fc P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.908810  2519 raft_consensus.cc:3060] T 5aac56f958fb4fe29fe46d2a9be60ffd P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:10.937690  2391 tablet_bootstrap.cc:654] T 12b5593f051548fea374da76afa08c3f P 2ac5c5682f914ed9b9982b5a080d5472: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:10.940342  2393 ts_tablet_manager.cc:1403] T 8b65903ab966485c9c65bdfbdf1e1054 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent bootstrapping tablet: real 0.129s	user 0.013s	sys 0.006s
I20260709 13:12:10.943008  2393 raft_consensus.cc:359] T 8b65903ab966485c9c65bdfbdf1e1054 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:10.943619  2393 raft_consensus.cc:385] T 8b65903ab966485c9c65bdfbdf1e1054 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:10.943871  2393 raft_consensus.cc:740] T 8b65903ab966485c9c65bdfbdf1e1054 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Initialized, Role: FOLLOWER
I20260709 13:12:10.945092  2392 tablet_bootstrap.cc:492] T a4a5ce298d24406ea94fb68aba5b37ae P 66e9a8fffd4b4e5a81ca4fa2762773ea: Bootstrap starting.
I20260709 13:12:10.947468  2393 consensus_queue.cc:260] T 8b65903ab966485c9c65bdfbdf1e1054 P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:10.954653  2402 tablet_bootstrap.cc:654] T f2a1307186df4616a9759118c2e456a6 P 79b6e57d59e4468ebe4423d871a31b39: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:10.959784  2519 raft_consensus.cc:2749] T 5aac56f958fb4fe29fe46d2a9be60ffd P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:10.960662  2518 consensus_queue.cc:1048] T 0668be6a554b4c5f8bf93d0588a6bfcc P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:10.962152  2419 consensus_queue.cc:1048] T 0668be6a554b4c5f8bf93d0588a6bfcc P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:10.960660  2393 ts_tablet_manager.cc:1434] T 8b65903ab966485c9c65bdfbdf1e1054 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 13:12:10.965126  2272 raft_consensus.cc:2468] T 427b10072083419c89d5a4bf5d6413fc P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 1.
I20260709 13:12:10.966764  2393 tablet_bootstrap.cc:492] T e5bbfa12bce4430fa6e7e6abd281ded6 P 0ec6a5d1452a41bd992a8c7922473b35: Bootstrap starting.
I20260709 13:12:10.989289  2310 leader_election.cc:304] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:10.990619  2590 raft_consensus.cc:2804] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:10.991137  2590 raft_consensus.cc:697] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 LEADER]: Becoming Leader. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Running, Role: LEADER
I20260709 13:12:10.991969  2590 consensus_queue.cc:237] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:10.998814  2393 tablet_bootstrap.cc:654] T e5bbfa12bce4430fa6e7e6abd281ded6 P 0ec6a5d1452a41bd992a8c7922473b35: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:10.991309  2401 leader_election.cc:290] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 election: Requested vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:11.000010  2391 tablet_bootstrap.cc:492] T 12b5593f051548fea374da76afa08c3f P 2ac5c5682f914ed9b9982b5a080d5472: No bootstrap required, opened a new log
I20260709 13:12:11.000978  2391 ts_tablet_manager.cc:1403] T 12b5593f051548fea374da76afa08c3f P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.069s	user 0.010s	sys 0.000s
I20260709 13:12:11.004212  2392 tablet_bootstrap.cc:654] T a4a5ce298d24406ea94fb68aba5b37ae P 66e9a8fffd4b4e5a81ca4fa2762773ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:11.008409  2120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b10072083419c89d5a4bf5d6413fc" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:11.011226  2391 raft_consensus.cc:359] T 12b5593f051548fea374da76afa08c3f P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:11.012638  2391 raft_consensus.cc:385] T 12b5593f051548fea374da76afa08c3f P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:11.012916  2391 raft_consensus.cc:740] T 12b5593f051548fea374da76afa08c3f P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
W20260709 13:12:11.015596  2310 leader_election.cc:343] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.018741  2519 consensus_queue.cc:1048] T bdee3fd7553a47afae3ec9dbdce6d829 P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:12:11.019505  2162 consensus_peers.cc:597] T 12b5593f051548fea374da76afa08c3f P 0ec6a5d1452a41bd992a8c7922473b35 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:11.021382  2401 raft_consensus.cc:493] T f2a1307186df4616a9759118c2e456a6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.021860  2401 raft_consensus.cc:515] T f2a1307186df4616a9759118c2e456a6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:11.023885  2401 leader_election.cc:290] T f2a1307186df4616a9759118c2e456a6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:11.024828  2391 consensus_queue.cc:260] T 12b5593f051548fea374da76afa08c3f P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:11.030656  2391 ts_tablet_manager.cc:1434] T 12b5593f051548fea374da76afa08c3f P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 13:12:11.031654  2391 tablet_bootstrap.cc:492] T 7e3782f3d54b4a19bacbd125c31127a9 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:11.043318  2197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a1307186df4616a9759118c2e456a6" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:11.043658  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a1307186df4616a9759118c2e456a6" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:11.044142  2197 raft_consensus.cc:2468] T f2a1307186df4616a9759118c2e456a6 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 0.
I20260709 13:12:11.046140  2311 leader_election.cc:304] T f2a1307186df4616a9759118c2e456a6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:11.047874  2590 raft_consensus.cc:2804] T f2a1307186df4616a9759118c2e456a6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:11.049340  2021 catalog_manager.cc:5697] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68). New cstate: current_term: 1 leader_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:11.048226  2590 raft_consensus.cc:493] T f2a1307186df4616a9759118c2e456a6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:11.057614  2590 raft_consensus.cc:3060] T f2a1307186df4616a9759118c2e456a6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:11.061064  2407 consensus_queue.cc:1048] T 12b5593f051548fea374da76afa08c3f P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:12:11.061913  2310 leader_election.cc:343] T f2a1307186df4616a9759118c2e456a6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.065943  2590 raft_consensus.cc:515] T f2a1307186df4616a9759118c2e456a6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:11.069156  2198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a1307186df4616a9759118c2e456a6" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:11.069813  2198 raft_consensus.cc:3060] T f2a1307186df4616a9759118c2e456a6 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:11.071352  2020 catalog_manager.cc:5697] T 2993800f8e7e4c09bfe0b2be13e4394c P 79b6e57d59e4468ebe4423d871a31b39 reported cstate change: term changed from 0 to 2, leader changed from <none> to 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67). New cstate: current_term: 2 leader_uuid: "79b6e57d59e4468ebe4423d871a31b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:11.072592  2402 tablet_bootstrap.cc:492] T f2a1307186df4616a9759118c2e456a6 P 79b6e57d59e4468ebe4423d871a31b39: No bootstrap required, opened a new log
I20260709 13:12:11.073096  2402 ts_tablet_manager.cc:1403] T f2a1307186df4616a9759118c2e456a6 P 79b6e57d59e4468ebe4423d871a31b39: Time spent bootstrapping tablet: real 0.159s	user 0.039s	sys 0.028s
I20260709 13:12:11.075711  2402 raft_consensus.cc:359] T f2a1307186df4616a9759118c2e456a6 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:11.076413  2402 raft_consensus.cc:385] T f2a1307186df4616a9759118c2e456a6 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:11.076712  2402 raft_consensus.cc:740] T f2a1307186df4616a9759118c2e456a6 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.077870  2402 consensus_queue.cc:260] T f2a1307186df4616a9759118c2e456a6 P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:11.083756  2402 ts_tablet_manager.cc:1434] T f2a1307186df4616a9759118c2e456a6 P 79b6e57d59e4468ebe4423d871a31b39: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:12:11.084748  2402 tablet_bootstrap.cc:492] T ddf48e4f6be64627a0ed06d6198ca054 P 79b6e57d59e4468ebe4423d871a31b39: Bootstrap starting.
I20260709 13:12:11.089504  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a1307186df4616a9759118c2e456a6" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:11.090148  2272 raft_consensus.cc:3060] T f2a1307186df4616a9759118c2e456a6 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:11.090557  2392 tablet_bootstrap.cc:492] T a4a5ce298d24406ea94fb68aba5b37ae P 66e9a8fffd4b4e5a81ca4fa2762773ea: No bootstrap required, opened a new log
I20260709 13:12:11.091046  2392 ts_tablet_manager.cc:1403] T a4a5ce298d24406ea94fb68aba5b37ae P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent bootstrapping tablet: real 0.146s	user 0.011s	sys 0.015s
I20260709 13:12:11.091910  2393 tablet_bootstrap.cc:492] T e5bbfa12bce4430fa6e7e6abd281ded6 P 0ec6a5d1452a41bd992a8c7922473b35: No bootstrap required, opened a new log
I20260709 13:12:11.092353  2393 ts_tablet_manager.cc:1403] T e5bbfa12bce4430fa6e7e6abd281ded6 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent bootstrapping tablet: real 0.128s	user 0.011s	sys 0.020s
I20260709 13:12:11.084235  2590 leader_election.cc:290] T f2a1307186df4616a9759118c2e456a6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 election: Requested vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:11.099400  2519 consensus_queue.cc:1048] T bdee3fd7553a47afae3ec9dbdce6d829 P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:11.100656  2391 tablet_bootstrap.cc:654] T 7e3782f3d54b4a19bacbd125c31127a9 P 2ac5c5682f914ed9b9982b5a080d5472: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:11.096292  2393 raft_consensus.cc:359] T e5bbfa12bce4430fa6e7e6abd281ded6 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:11.101159  2393 raft_consensus.cc:385] T e5bbfa12bce4430fa6e7e6abd281ded6 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:11.101514  2393 raft_consensus.cc:740] T e5bbfa12bce4430fa6e7e6abd281ded6 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.102197  2393 consensus_queue.cc:260] T e5bbfa12bce4430fa6e7e6abd281ded6 P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:11.116732  2393 ts_tablet_manager.cc:1434] T e5bbfa12bce4430fa6e7e6abd281ded6 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent starting tablet: real 0.024s	user 0.002s	sys 0.005s
I20260709 13:12:11.120741  2392 raft_consensus.cc:359] T a4a5ce298d24406ea94fb68aba5b37ae P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:11.121992  2590 consensus_queue.cc:1048] T 36b22aafe7104cec82607dab40b4aed8 P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:11.130376  2392 raft_consensus.cc:385] T a4a5ce298d24406ea94fb68aba5b37ae P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:11.130719  2392 raft_consensus.cc:740] T a4a5ce298d24406ea94fb68aba5b37ae P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.130829  2393 tablet_bootstrap.cc:492] T 0bd8fc2d57c14adeaeae16583eef7c84 P 0ec6a5d1452a41bd992a8c7922473b35: Bootstrap starting.
I20260709 13:12:11.137545  2581 raft_consensus.cc:493] T e5bbfa12bce4430fa6e7e6abd281ded6 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.138101  2581 raft_consensus.cc:515] T e5bbfa12bce4430fa6e7e6abd281ded6 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:11.140116  2581 leader_election.cc:290] T e5bbfa12bce4430fa6e7e6abd281ded6 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:11.142719  2198 raft_consensus.cc:2468] T f2a1307186df4616a9759118c2e456a6 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 1.
I20260709 13:12:11.145440  2272 raft_consensus.cc:2468] T f2a1307186df4616a9759118c2e456a6 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 1.
I20260709 13:12:11.152959  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bbfa12bce4430fa6e7e6abd281ded6" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:11.155968  2311 leader_election.cc:304] T f2a1307186df4616a9759118c2e456a6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:11.156767  2590 raft_consensus.cc:2804] T f2a1307186df4616a9759118c2e456a6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:12:11.157246  2162 leader_election.cc:343] T e5bbfa12bce4430fa6e7e6abd281ded6 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.157209  2590 raft_consensus.cc:697] T f2a1307186df4616a9759118c2e456a6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 LEADER]: Becoming Leader. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Running, Role: LEADER
I20260709 13:12:11.158030  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bbfa12bce4430fa6e7e6abd281ded6" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:11.158327  2590 consensus_queue.cc:237] T f2a1307186df4616a9759118c2e456a6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:11.164881  2393 tablet_bootstrap.cc:654] T 0bd8fc2d57c14adeaeae16583eef7c84 P 0ec6a5d1452a41bd992a8c7922473b35: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:11.167285  2392 consensus_queue.cc:260] T a4a5ce298d24406ea94fb68aba5b37ae P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:11.173547  2451 consensus_queue.cc:1048] T 5c3646d79bc840e9b4396f4351d1803d P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:12:11.168447  2162 leader_election.cc:343] T e5bbfa12bce4430fa6e7e6abd281ded6 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.176119  2162 leader_election.cc:304] T e5bbfa12bce4430fa6e7e6abd281ded6 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35; no voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:11.180495  2392 ts_tablet_manager.cc:1434] T a4a5ce298d24406ea94fb68aba5b37ae P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent starting tablet: real 0.089s	user 0.007s	sys 0.002s
I20260709 13:12:11.182932  2392 tablet_bootstrap.cc:492] T f9934bcaed6743b2a30104e13b8cf18b P 66e9a8fffd4b4e5a81ca4fa2762773ea: Bootstrap starting.
I20260709 13:12:11.186568  2391 tablet_bootstrap.cc:492] T 7e3782f3d54b4a19bacbd125c31127a9 P 2ac5c5682f914ed9b9982b5a080d5472: No bootstrap required, opened a new log
I20260709 13:12:11.186934  2391 ts_tablet_manager.cc:1403] T 7e3782f3d54b4a19bacbd125c31127a9 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.156s	user 0.007s	sys 0.014s
I20260709 13:12:11.182030  2581 raft_consensus.cc:2749] T e5bbfa12bce4430fa6e7e6abd281ded6 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:11.192854  2540 consensus_queue.cc:1048] T b3b82132c31545aab274c7cf3f77c277 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:11.204612  2402 tablet_bootstrap.cc:654] T ddf48e4f6be64627a0ed06d6198ca054 P 79b6e57d59e4468ebe4423d871a31b39: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:11.206218  2018 catalog_manager.cc:5697] T f2a1307186df4616a9759118c2e456a6 P 66e9a8fffd4b4e5a81ca4fa2762773ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68). New cstate: current_term: 1 leader_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:11.215713  2392 tablet_bootstrap.cc:654] T f9934bcaed6743b2a30104e13b8cf18b P 66e9a8fffd4b4e5a81ca4fa2762773ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:11.214217  2391 raft_consensus.cc:359] T 7e3782f3d54b4a19bacbd125c31127a9 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:11.216344  2391 raft_consensus.cc:385] T 7e3782f3d54b4a19bacbd125c31127a9 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:11.216616  2391 raft_consensus.cc:740] T 7e3782f3d54b4a19bacbd125c31127a9 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.217240  2391 consensus_queue.cc:260] T 7e3782f3d54b4a19bacbd125c31127a9 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:11.220548  2391 ts_tablet_manager.cc:1434] T 7e3782f3d54b4a19bacbd125c31127a9 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.033s	user 0.007s	sys 0.000s
I20260709 13:12:11.221514  2391 tablet_bootstrap.cc:492] T 427b10072083419c89d5a4bf5d6413fc P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:11.221900  2540 consensus_queue.cc:1048] T 5c3646d79bc840e9b4396f4351d1803d P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:11.231323  2393 tablet_bootstrap.cc:492] T 0bd8fc2d57c14adeaeae16583eef7c84 P 0ec6a5d1452a41bd992a8c7922473b35: No bootstrap required, opened a new log
I20260709 13:12:11.231868  2393 ts_tablet_manager.cc:1403] T 0bd8fc2d57c14adeaeae16583eef7c84 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent bootstrapping tablet: real 0.101s	user 0.012s	sys 0.002s
I20260709 13:12:11.234483  2393 raft_consensus.cc:359] T 0bd8fc2d57c14adeaeae16583eef7c84 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:11.235154  2393 raft_consensus.cc:385] T 0bd8fc2d57c14adeaeae16583eef7c84 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:11.235397  2393 raft_consensus.cc:740] T 0bd8fc2d57c14adeaeae16583eef7c84 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.236035  2393 consensus_queue.cc:260] T 0bd8fc2d57c14adeaeae16583eef7c84 P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:11.237565  2393 ts_tablet_manager.cc:1434] T 0bd8fc2d57c14adeaeae16583eef7c84 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
W20260709 13:12:11.214100  2310 consensus_peers.cc:597] T 36b22aafe7104cec82607dab40b4aed8 P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:11.239194  2391 tablet_bootstrap.cc:654] T 427b10072083419c89d5a4bf5d6413fc P 2ac5c5682f914ed9b9982b5a080d5472: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:11.240097  2393 tablet_bootstrap.cc:492] T 7e3782f3d54b4a19bacbd125c31127a9 P 0ec6a5d1452a41bd992a8c7922473b35: Bootstrap starting.
I20260709 13:12:11.240585  2402 tablet_bootstrap.cc:492] T ddf48e4f6be64627a0ed06d6198ca054 P 79b6e57d59e4468ebe4423d871a31b39: No bootstrap required, opened a new log
I20260709 13:12:11.249147  2402 ts_tablet_manager.cc:1403] T ddf48e4f6be64627a0ed06d6198ca054 P 79b6e57d59e4468ebe4423d871a31b39: Time spent bootstrapping tablet: real 0.165s	user 0.012s	sys 0.010s
I20260709 13:12:11.251955  2402 raft_consensus.cc:359] T ddf48e4f6be64627a0ed06d6198ca054 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:11.260442  2402 raft_consensus.cc:385] T ddf48e4f6be64627a0ed06d6198ca054 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:11.259195  2590 raft_consensus.cc:493] T a4a5ce298d24406ea94fb68aba5b37ae P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.261327  2344 raft_consensus.cc:1275] T 2993800f8e7e4c09bfe0b2be13e4394c P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Refusing update from remote peer 79b6e57d59e4468ebe4423d871a31b39: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:12:11.261524  2590 raft_consensus.cc:515] T a4a5ce298d24406ea94fb68aba5b37ae P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:11.262552  2402 raft_consensus.cc:740] T ddf48e4f6be64627a0ed06d6198ca054 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.263315  2402 consensus_queue.cc:260] T ddf48e4f6be64627a0ed06d6198ca054 P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:11.263657  2590 leader_election.cc:290] T a4a5ce298d24406ea94fb68aba5b37ae P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:11.264099  2451 consensus_queue.cc:1048] T b3b82132c31545aab274c7cf3f77c277 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:11.264700  2193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a5ce298d24406ea94fb68aba5b37ae" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:11.268349  2402 ts_tablet_manager.cc:1434] T ddf48e4f6be64627a0ed06d6198ca054 P 79b6e57d59e4468ebe4423d871a31b39: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.005s
W20260709 13:12:11.268322  2311 leader_election.cc:343] T a4a5ce298d24406ea94fb68aba5b37ae P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.268989  2518 raft_consensus.cc:493] T ddf48e4f6be64627a0ed06d6198ca054 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.269436  2402 tablet_bootstrap.cc:492] T 78734884e0a441759b51d258ad2697aa P 79b6e57d59e4468ebe4423d871a31b39: Bootstrap starting.
I20260709 13:12:11.269738  2393 tablet_bootstrap.cc:654] T 7e3782f3d54b4a19bacbd125c31127a9 P 0ec6a5d1452a41bd992a8c7922473b35: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:11.269459  2518 raft_consensus.cc:515] T ddf48e4f6be64627a0ed06d6198ca054 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:11.272123  2518 leader_election.cc:290] T ddf48e4f6be64627a0ed06d6198ca054 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:11.268275  2448 consensus_queue.cc:1048] T 2993800f8e7e4c09bfe0b2be13e4394c P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:12:11.281467  2392 tablet_bootstrap.cc:492] T f9934bcaed6743b2a30104e13b8cf18b P 66e9a8fffd4b4e5a81ca4fa2762773ea: No bootstrap required, opened a new log
I20260709 13:12:11.282056  2392 ts_tablet_manager.cc:1403] T f9934bcaed6743b2a30104e13b8cf18b P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent bootstrapping tablet: real 0.101s	user 0.017s	sys 0.008s
I20260709 13:12:11.299134  2120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a5ce298d24406ea94fb68aba5b37ae" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:11.292853  2119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddf48e4f6be64627a0ed06d6198ca054" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:11.298540  2198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddf48e4f6be64627a0ed06d6198ca054" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:11.304916  2593 raft_consensus.cc:493] T 7e3782f3d54b4a19bacbd125c31127a9 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:11.304989  2310 leader_election.cc:343] T a4a5ce298d24406ea94fb68aba5b37ae P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.311396  2310 leader_election.cc:304] T a4a5ce298d24406ea94fb68aba5b37ae P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:11.312345  2590 raft_consensus.cc:2749] T a4a5ce298d24406ea94fb68aba5b37ae P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:11.313952  2451 raft_consensus.cc:493] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.314450  2451 raft_consensus.cc:515] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:11.305428  2593 raft_consensus.cc:515] T 7e3782f3d54b4a19bacbd125c31127a9 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:11.328138  2401 raft_consensus.cc:493] T ee1baa7401cd48e48e7125dcd607f44f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.334659  2518 raft_consensus.cc:493] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.344118  2519 consensus_queue.cc:1048] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:11.346212  2451 leader_election.cc:290] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:11.339130  2401 raft_consensus.cc:515] T ee1baa7401cd48e48e7125dcd607f44f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:11.350390  2391 tablet_bootstrap.cc:492] T 427b10072083419c89d5a4bf5d6413fc P 2ac5c5682f914ed9b9982b5a080d5472: No bootstrap required, opened a new log
I20260709 13:12:11.350857  2391 ts_tablet_manager.cc:1403] T 427b10072083419c89d5a4bf5d6413fc P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.130s	user 0.016s	sys 0.012s
I20260709 13:12:11.352928  2451 raft_consensus.cc:493] T 12b5593f051548fea374da76afa08c3f P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.356739  2391 raft_consensus.cc:359] T 427b10072083419c89d5a4bf5d6413fc P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:11.357386  2391 raft_consensus.cc:385] T 427b10072083419c89d5a4bf5d6413fc P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:11.357692  2391 raft_consensus.cc:740] T 427b10072083419c89d5a4bf5d6413fc P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.358033  2197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc42d18a324e4f6d97f07cf770c5daa8" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:11.358357  2391 consensus_queue.cc:260] T 427b10072083419c89d5a4bf5d6413fc P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:11.357291  2451 raft_consensus.cc:515] T 12b5593f051548fea374da76afa08c3f P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
W20260709 13:12:11.359422  2088 leader_election.cc:343] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.361073  2391 ts_tablet_manager.cc:1434] T 427b10072083419c89d5a4bf5d6413fc P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
W20260709 13:12:11.355230  2237 leader_election.cc:343] T ddf48e4f6be64627a0ed06d6198ca054 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.362015  2391 tablet_bootstrap.cc:492] T d2f88787abb54ffea037f35cf48b22c4 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:11.362166  2197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b5593f051548fea374da76afa08c3f" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:11.353133  2518 raft_consensus.cc:515] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:11.364352  2518 leader_election.cc:290] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:11.365710  2593 leader_election.cc:290] T 7e3782f3d54b4a19bacbd125c31127a9 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:11.367108  2391 tablet_bootstrap.cc:654] T d2f88787abb54ffea037f35cf48b22c4 P 2ac5c5682f914ed9b9982b5a080d5472: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:11.367055  2197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3782f3d54b4a19bacbd125c31127a9" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:11.368480  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b5593f051548fea374da76afa08c3f" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
W20260709 13:12:11.368655  2088 leader_election.cc:343] T 7e3782f3d54b4a19bacbd125c31127a9 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.369653  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3782f3d54b4a19bacbd125c31127a9" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
W20260709 13:12:11.370714  2087 leader_election.cc:343] T 7e3782f3d54b4a19bacbd125c31127a9 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.371068  2087 leader_election.cc:304] T 7e3782f3d54b4a19bacbd125c31127a9 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:11.371644  2593 raft_consensus.cc:2749] T 7e3782f3d54b4a19bacbd125c31127a9 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:11.371894  2402 tablet_bootstrap.cc:654] T 78734884e0a441759b51d258ad2697aa P 79b6e57d59e4468ebe4423d871a31b39: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:11.374794  2236 leader_election.cc:343] T ddf48e4f6be64627a0ed06d6198ca054 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.375313  2236 leader_election.cc:304] T ddf48e4f6be64627a0ed06d6198ca054 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b6e57d59e4468ebe4423d871a31b39; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:11.377911  2518 raft_consensus.cc:2749] T ddf48e4f6be64627a0ed06d6198ca054 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:11.378535  2518 consensus_queue.cc:1048] T 86834d94d1d64596abfa609754b5d58a P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:11.385856  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f2272230d34efa880d5eeed8859669" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:11.386600  2342 raft_consensus.cc:2468] T 28f2272230d34efa880d5eeed8859669 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 0.
I20260709 13:12:11.388677  2120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f2272230d34efa880d5eeed8859669" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
W20260709 13:12:11.390596  2236 leader_election.cc:343] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:11.391685  2625 log.cc:927] Time spent T 5c3646d79bc840e9b4396f4351d1803d P 79b6e57d59e4468ebe4423d871a31b39: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 13:12:11.396458  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc42d18a324e4f6d97f07cf770c5daa8" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:11.361191  2451 leader_election.cc:290] T 12b5593f051548fea374da76afa08c3f P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:11.398032  2588 consensus_queue.cc:1048] T 5aac56f958fb4fe29fe46d2a9be60ffd P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:11.400008  2581 raft_consensus.cc:493] T 8b65903ab966485c9c65bdfbdf1e1054 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.408736  2087 leader_election.cc:304] T 12b5593f051548fea374da76afa08c3f P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea
I20260709 13:12:11.408912  2581 raft_consensus.cc:515] T 8b65903ab966485c9c65bdfbdf1e1054 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:11.411011  2581 leader_election.cc:290] T 8b65903ab966485c9c65bdfbdf1e1054 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:11.404970  2196 raft_consensus.cc:1275] T 2993800f8e7e4c09bfe0b2be13e4394c P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Refusing update from remote peer 79b6e57d59e4468ebe4423d871a31b39: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:12:11.397600  2198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee1baa7401cd48e48e7125dcd607f44f" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
W20260709 13:12:11.413455  2311 leader_election.cc:343] T ee1baa7401cd48e48e7125dcd607f44f P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.405968  2401 leader_election.cc:290] T ee1baa7401cd48e48e7125dcd607f44f P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:11.406570  2119 raft_consensus.cc:3060] T 12b5593f051548fea374da76afa08c3f P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:11.407389  2123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee1baa7401cd48e48e7125dcd607f44f" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:11.418077  2518 consensus_queue.cc:1048] T 86834d94d1d64596abfa609754b5d58a P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:11.418262  2236 leader_election.cc:304] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39; no voters: 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:11.407349  2343 raft_consensus.cc:2468] T bc42d18a324e4f6d97f07cf770c5daa8 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 0.
I20260709 13:12:11.419169  2617 raft_consensus.cc:2804] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:11.419554  2617 raft_consensus.cc:493] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:11.419886  2617 raft_consensus.cc:3060] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:11.430298  2087 leader_election.cc:304] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 0ec6a5d1452a41bd992a8c7922473b35
I20260709 13:12:11.431545  2593 raft_consensus.cc:2804] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:11.431914  2593 raft_consensus.cc:493] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:11.432307  2593 raft_consensus.cc:3060] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:11.433602  2626 log.cc:927] Time spent T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 13:12:11.437501  2392 raft_consensus.cc:359] T f9934bcaed6743b2a30104e13b8cf18b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:11.438275  2392 raft_consensus.cc:385] T f9934bcaed6743b2a30104e13b8cf18b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:11.438524  2392 raft_consensus.cc:740] T f9934bcaed6743b2a30104e13b8cf18b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.439185  2392 consensus_queue.cc:260] T f9934bcaed6743b2a30104e13b8cf18b P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:11.445202  2581 consensus_queue.cc:1048] T 5aac56f958fb4fe29fe46d2a9be60ffd P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:11.448895  2518 consensus_queue.cc:1048] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:11.456178  2393 tablet_bootstrap.cc:492] T 7e3782f3d54b4a19bacbd125c31127a9 P 0ec6a5d1452a41bd992a8c7922473b35: No bootstrap required, opened a new log
I20260709 13:12:11.456771  2393 ts_tablet_manager.cc:1403] T 7e3782f3d54b4a19bacbd125c31127a9 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent bootstrapping tablet: real 0.217s	user 0.038s	sys 0.036s
I20260709 13:12:11.461552  2402 tablet_bootstrap.cc:492] T 78734884e0a441759b51d258ad2697aa P 79b6e57d59e4468ebe4423d871a31b39: No bootstrap required, opened a new log
I20260709 13:12:11.464424  2391 tablet_bootstrap.cc:492] T d2f88787abb54ffea037f35cf48b22c4 P 2ac5c5682f914ed9b9982b5a080d5472: No bootstrap required, opened a new log
I20260709 13:12:11.506924  2402 ts_tablet_manager.cc:1403] T 78734884e0a441759b51d258ad2697aa P 79b6e57d59e4468ebe4423d871a31b39: Time spent bootstrapping tablet: real 0.238s	user 0.013s	sys 0.000s
I20260709 13:12:11.507047  2391 ts_tablet_manager.cc:1403] T d2f88787abb54ffea037f35cf48b22c4 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.145s	user 0.030s	sys 0.014s
I20260709 13:12:11.474522  2518 consensus_queue.cc:1048] T 2993800f8e7e4c09bfe0b2be13e4394c P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:11.509720  2391 raft_consensus.cc:359] T d2f88787abb54ffea037f35cf48b22c4 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:11.510514  2391 raft_consensus.cc:385] T d2f88787abb54ffea037f35cf48b22c4 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:11.510774  2391 raft_consensus.cc:740] T d2f88787abb54ffea037f35cf48b22c4 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.511394  2391 consensus_queue.cc:260] T d2f88787abb54ffea037f35cf48b22c4 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:11.513360  2391 ts_tablet_manager.cc:1434] T d2f88787abb54ffea037f35cf48b22c4 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:12:11.514297  2391 tablet_bootstrap.cc:492] T 36b22aafe7104cec82607dab40b4aed8 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:11.513972  2402 raft_consensus.cc:359] T 78734884e0a441759b51d258ad2697aa P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:11.517268  2402 raft_consensus.cc:385] T 78734884e0a441759b51d258ad2697aa P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:11.517539  2402 raft_consensus.cc:740] T 78734884e0a441759b51d258ad2697aa P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.518263  2402 consensus_queue.cc:260] T 78734884e0a441759b51d258ad2697aa P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:11.467154  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b65903ab966485c9c65bdfbdf1e1054" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
W20260709 13:12:11.483738  2310 leader_election.cc:343] T ee1baa7401cd48e48e7125dcd607f44f P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.520211  2402 ts_tablet_manager.cc:1434] T 78734884e0a441759b51d258ad2697aa P 79b6e57d59e4468ebe4423d871a31b39: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:12:11.520165  2310 leader_election.cc:304] T ee1baa7401cd48e48e7125dcd607f44f P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:11.520620  2391 tablet_bootstrap.cc:654] T 36b22aafe7104cec82607dab40b4aed8 P 2ac5c5682f914ed9b9982b5a080d5472: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:11.520964  2508 raft_consensus.cc:2749] T ee1baa7401cd48e48e7125dcd607f44f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:11.521118  2402 tablet_bootstrap.cc:492] T 8b65903ab966485c9c65bdfbdf1e1054 P 79b6e57d59e4468ebe4423d871a31b39: Bootstrap starting.
I20260709 13:12:11.529003  2402 tablet_bootstrap.cc:654] T 8b65903ab966485c9c65bdfbdf1e1054 P 79b6e57d59e4468ebe4423d871a31b39: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:11.461838  2627 raft_consensus.cc:2749] T 12b5593f051548fea374da76afa08c3f P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:11.465909  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b65903ab966485c9c65bdfbdf1e1054" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:11.500223  2401 raft_consensus.cc:493] T f9934bcaed6743b2a30104e13b8cf18b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.502754  2593 raft_consensus.cc:515] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:11.486272  2392 ts_tablet_manager.cc:1434] T f9934bcaed6743b2a30104e13b8cf18b P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent starting tablet: real 0.204s	user 0.007s	sys 0.000s
I20260709 13:12:11.540784  2392 tablet_bootstrap.cc:492] T e5bbfa12bce4430fa6e7e6abd281ded6 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Bootstrap starting.
I20260709 13:12:11.472837  2393 raft_consensus.cc:359] T 7e3782f3d54b4a19bacbd125c31127a9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:11.542444  2393 raft_consensus.cc:385] T 7e3782f3d54b4a19bacbd125c31127a9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:11.542724  2393 raft_consensus.cc:740] T 7e3782f3d54b4a19bacbd125c31127a9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.542833  2593 leader_election.cc:290] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 election: Requested vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:11.543838  2393 consensus_queue.cc:260] T 7e3782f3d54b4a19bacbd125c31127a9 P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:11.427848  2617 raft_consensus.cc:515] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:11.551548  2393 ts_tablet_manager.cc:1434] T 7e3782f3d54b4a19bacbd125c31127a9 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent starting tablet: real 0.094s	user 0.006s	sys 0.005s
I20260709 13:12:11.544462  2401 raft_consensus.cc:515] T f9934bcaed6743b2a30104e13b8cf18b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:11.552440  2393 tablet_bootstrap.cc:492] T ee1baa7401cd48e48e7125dcd607f44f P 0ec6a5d1452a41bd992a8c7922473b35: Bootstrap starting.
W20260709 13:12:11.554312  2162 leader_election.cc:343] T 8b65903ab966485c9c65bdfbdf1e1054 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.559757  2197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc42d18a324e4f6d97f07cf770c5daa8" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
W20260709 13:12:11.561637  2088 leader_election.cc:343] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.563716  2197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9934bcaed6743b2a30104e13b8cf18b" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:11.564601  2392 tablet_bootstrap.cc:654] T e5bbfa12bce4430fa6e7e6abd281ded6 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:11.565016  2311 leader_election.cc:343] T f9934bcaed6743b2a30104e13b8cf18b P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.542548  2345 raft_consensus.cc:2468] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 0.
I20260709 13:12:11.569199  2590 consensus_queue.cc:1048] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:11.571681  2393 tablet_bootstrap.cc:654] T ee1baa7401cd48e48e7125dcd607f44f P 0ec6a5d1452a41bd992a8c7922473b35: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:11.571514  2162 leader_election.cc:304] T 8b65903ab966485c9c65bdfbdf1e1054 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:11.572721  2407 raft_consensus.cc:2804] T 8b65903ab966485c9c65bdfbdf1e1054 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:11.573122  2407 raft_consensus.cc:493] T 8b65903ab966485c9c65bdfbdf1e1054 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:11.573449  2407 raft_consensus.cc:3060] T 8b65903ab966485c9c65bdfbdf1e1054 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:11.574801  2401 leader_election.cc:290] T f9934bcaed6743b2a30104e13b8cf18b P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:11.660581  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc42d18a324e4f6d97f07cf770c5daa8" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:11.661226  2342 raft_consensus.cc:3060] T bc42d18a324e4f6d97f07cf770c5daa8 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:11.654897  2527 raft_consensus.cc:493] T 0bd8fc2d57c14adeaeae16583eef7c84 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:11.668733  2638 log.cc:927] Time spent T 5aac56f958fb4fe29fe46d2a9be60ffd P 66e9a8fffd4b4e5a81ca4fa2762773ea: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 13:12:11.673646  2527 raft_consensus.cc:515] T 0bd8fc2d57c14adeaeae16583eef7c84 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:11.670953  2593 raft_consensus.cc:493] T d2f88787abb54ffea037f35cf48b22c4 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.675227  2593 raft_consensus.cc:515] T d2f88787abb54ffea037f35cf48b22c4 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:11.677207  2593 leader_election.cc:290] T d2f88787abb54ffea037f35cf48b22c4 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:11.677289  2123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bd8fc2d57c14adeaeae16583eef7c84" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:11.679091  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bd8fc2d57c14adeaeae16583eef7c84" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:11.680617  2195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f88787abb54ffea037f35cf48b22c4" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
W20260709 13:12:11.681988  2088 leader_election.cc:343] T d2f88787abb54ffea037f35cf48b22c4 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.673653  2391 tablet_bootstrap.cc:492] T 36b22aafe7104cec82607dab40b4aed8 P 2ac5c5682f914ed9b9982b5a080d5472: No bootstrap required, opened a new log
I20260709 13:12:11.685598  2391 ts_tablet_manager.cc:1403] T 36b22aafe7104cec82607dab40b4aed8 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.171s	user 0.028s	sys 0.046s
I20260709 13:12:11.687022  2402 tablet_bootstrap.cc:492] T 8b65903ab966485c9c65bdfbdf1e1054 P 79b6e57d59e4468ebe4423d871a31b39: No bootstrap required, opened a new log
I20260709 13:12:11.665056  2401 consensus_queue.cc:1048] T f2a1307186df4616a9759118c2e456a6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 13:12:11.691293  2392 tablet_bootstrap.cc:492] T e5bbfa12bce4430fa6e7e6abd281ded6 P 66e9a8fffd4b4e5a81ca4fa2762773ea: No bootstrap required, opened a new log
I20260709 13:12:11.691457  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9934bcaed6743b2a30104e13b8cf18b" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:11.691730  2392 ts_tablet_manager.cc:1403] T e5bbfa12bce4430fa6e7e6abd281ded6 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent bootstrapping tablet: real 0.151s	user 0.020s	sys 0.002s
W20260709 13:12:11.692852  2310 leader_election.cc:343] T f9934bcaed6743b2a30104e13b8cf18b P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.692998  2123 raft_consensus.cc:3060] T 427b10072083419c89d5a4bf5d6413fc P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:11.693588  2310 leader_election.cc:304] T f9934bcaed6743b2a30104e13b8cf18b P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:11.687475  2402 ts_tablet_manager.cc:1403] T 8b65903ab966485c9c65bdfbdf1e1054 P 79b6e57d59e4468ebe4423d871a31b39: Time spent bootstrapping tablet: real 0.167s	user 0.022s	sys 0.061s
I20260709 13:12:11.696408  2393 tablet_bootstrap.cc:492] T ee1baa7401cd48e48e7125dcd607f44f P 0ec6a5d1452a41bd992a8c7922473b35: No bootstrap required, opened a new log
I20260709 13:12:11.696856  2393 ts_tablet_manager.cc:1403] T ee1baa7401cd48e48e7125dcd607f44f P 0ec6a5d1452a41bd992a8c7922473b35: Time spent bootstrapping tablet: real 0.145s	user 0.029s	sys 0.021s
W20260709 13:12:11.694208  2162 leader_election.cc:343] T 0bd8fc2d57c14adeaeae16583eef7c84 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:11.699899  2162 leader_election.cc:343] T 0bd8fc2d57c14adeaeae16583eef7c84 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.700286  2162 leader_election.cc:304] T 0bd8fc2d57c14adeaeae16583eef7c84 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:11.701045  2588 raft_consensus.cc:2749] T 0bd8fc2d57c14adeaeae16583eef7c84 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:11.703392  2391 raft_consensus.cc:359] T 36b22aafe7104cec82607dab40b4aed8 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:11.704316  2391 raft_consensus.cc:385] T 36b22aafe7104cec82607dab40b4aed8 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:11.704568  2391 raft_consensus.cc:740] T 36b22aafe7104cec82607dab40b4aed8 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
W20260709 13:12:11.705056  2069 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:11.675697  2527 leader_election.cc:290] T 0bd8fc2d57c14adeaeae16583eef7c84 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:11.706632  2617 leader_election.cc:290] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 election: Requested vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:11.707906  2392 raft_consensus.cc:359] T e5bbfa12bce4430fa6e7e6abd281ded6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:11.708609  2392 raft_consensus.cc:385] T e5bbfa12bce4430fa6e7e6abd281ded6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:11.708863  2392 raft_consensus.cc:740] T e5bbfa12bce4430fa6e7e6abd281ded6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.712002  2407 raft_consensus.cc:515] T 8b65903ab966485c9c65bdfbdf1e1054 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:11.715035  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b65903ab966485c9c65bdfbdf1e1054" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:11.715967  2342 raft_consensus.cc:2468] T bc42d18a324e4f6d97f07cf770c5daa8 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 1.
I20260709 13:12:11.709501  2392 consensus_queue.cc:260] T e5bbfa12bce4430fa6e7e6abd281ded6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:11.705170  2391 consensus_queue.cc:260] T 36b22aafe7104cec82607dab40b4aed8 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:11.721536  2391 ts_tablet_manager.cc:1434] T 36b22aafe7104cec82607dab40b4aed8 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.036s	user 0.005s	sys 0.000s
I20260709 13:12:11.730499  2392 ts_tablet_manager.cc:1434] T e5bbfa12bce4430fa6e7e6abd281ded6 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent starting tablet: real 0.038s	user 0.008s	sys 0.000s
I20260709 13:12:11.730796  2391 tablet_bootstrap.cc:492] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:11.717355  2508 raft_consensus.cc:2749] T f9934bcaed6743b2a30104e13b8cf18b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:11.733146  2392 tablet_bootstrap.cc:492] T a9be6d55d1f348bcaf96405abc80244d P 66e9a8fffd4b4e5a81ca4fa2762773ea: Bootstrap starting.
I20260709 13:12:11.735419  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f88787abb54ffea037f35cf48b22c4" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:11.739300  2392 tablet_bootstrap.cc:654] T a9be6d55d1f348bcaf96405abc80244d P 66e9a8fffd4b4e5a81ca4fa2762773ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:11.741523  2087 leader_election.cc:304] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 0ec6a5d1452a41bd992a8c7922473b35
I20260709 13:12:11.742654  2593 raft_consensus.cc:2804] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:11.743120  2593 raft_consensus.cc:697] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 LEADER]: Becoming Leader. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Running, Role: LEADER
I20260709 13:12:11.728127  2527 raft_consensus.cc:493] T 7e3782f3d54b4a19bacbd125c31127a9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.743932  2527 raft_consensus.cc:515] T 7e3782f3d54b4a19bacbd125c31127a9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:11.743850  2593 consensus_queue.cc:237] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:11.741485  2391 tablet_bootstrap.cc:654] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:11.748383  2087 leader_election.cc:343] T d2f88787abb54ffea037f35cf48b22c4 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.748811  2087 leader_election.cc:304] T d2f88787abb54ffea037f35cf48b22c4 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:11.749807  2627 raft_consensus.cc:2749] T d2f88787abb54ffea037f35cf48b22c4 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:11.759380  2393 raft_consensus.cc:359] T ee1baa7401cd48e48e7125dcd607f44f P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:11.760305  2393 raft_consensus.cc:385] T ee1baa7401cd48e48e7125dcd607f44f P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:11.760645  2393 raft_consensus.cc:740] T ee1baa7401cd48e48e7125dcd607f44f P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.763002  2401 consensus_queue.cc:1048] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:11.772550  2123 raft_consensus.cc:3060] T 36b22aafe7104cec82607dab40b4aed8 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:11.774780  2407 leader_election.cc:290] T 8b65903ab966485c9c65bdfbdf1e1054 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 election: Requested vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:11.781746  2119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f2272230d34efa880d5eeed8859669" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:11.791760  2393 consensus_queue.cc:260] T ee1baa7401cd48e48e7125dcd607f44f P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:11.794231  2393 ts_tablet_manager.cc:1434] T ee1baa7401cd48e48e7125dcd607f44f P 0ec6a5d1452a41bd992a8c7922473b35: Time spent starting tablet: real 0.097s	user 0.009s	sys 0.001s
I20260709 13:12:11.795310  2393 tablet_bootstrap.cc:492] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 0ec6a5d1452a41bd992a8c7922473b35: Bootstrap starting.
I20260709 13:12:11.820062  2393 tablet_bootstrap.cc:654] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 0ec6a5d1452a41bd992a8c7922473b35: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:11.813328  2236 leader_election.cc:343] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.822275  2527 leader_election.cc:290] T 7e3782f3d54b4a19bacbd125c31127a9 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:11.824282  2122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3782f3d54b4a19bacbd125c31127a9" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:11.825428  2122 raft_consensus.cc:2468] T 7e3782f3d54b4a19bacbd125c31127a9 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 0.
I20260709 13:12:11.826453  2162 leader_election.cc:304] T 7e3782f3d54b4a19bacbd125c31127a9 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472; no voters: 
I20260709 13:12:11.826965  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3782f3d54b4a19bacbd125c31127a9" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:11.827662  2647 raft_consensus.cc:2804] T 7e3782f3d54b4a19bacbd125c31127a9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:11.828045  2647 raft_consensus.cc:493] T 7e3782f3d54b4a19bacbd125c31127a9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:11.828351  2647 raft_consensus.cc:3060] T 7e3782f3d54b4a19bacbd125c31127a9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:11.828898  2391 tablet_bootstrap.cc:492] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472: No bootstrap required, opened a new log
I20260709 13:12:11.829381  2391 ts_tablet_manager.cc:1403] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.099s	user 0.009s	sys 0.008s
I20260709 13:12:11.830976  2392 tablet_bootstrap.cc:492] T a9be6d55d1f348bcaf96405abc80244d P 66e9a8fffd4b4e5a81ca4fa2762773ea: No bootstrap required, opened a new log
W20260709 13:12:11.834015  2162 leader_election.cc:343] T 7e3782f3d54b4a19bacbd125c31127a9 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.836839  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f2272230d34efa880d5eeed8859669" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:11.837580  2343 raft_consensus.cc:3060] T 28f2272230d34efa880d5eeed8859669 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:11.845325  2343 raft_consensus.cc:2468] T 28f2272230d34efa880d5eeed8859669 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 1.
I20260709 13:12:11.848112  2402 raft_consensus.cc:359] T 8b65903ab966485c9c65bdfbdf1e1054 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:11.855406  2402 raft_consensus.cc:385] T 8b65903ab966485c9c65bdfbdf1e1054 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:11.855928  2391 raft_consensus.cc:359] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:11.856688  2391 raft_consensus.cc:385] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:11.856408  2402 raft_consensus.cc:740] T 8b65903ab966485c9c65bdfbdf1e1054 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.856961  2391 raft_consensus.cc:740] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.831442  2392 ts_tablet_manager.cc:1403] T a9be6d55d1f348bcaf96405abc80244d P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent bootstrapping tablet: real 0.100s	user 0.009s	sys 0.009s
I20260709 13:12:11.858062  2402 consensus_queue.cc:260] T 8b65903ab966485c9c65bdfbdf1e1054 P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:11.859671  2272 raft_consensus.cc:3060] T 8b65903ab966485c9c65bdfbdf1e1054 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:11.859784  2236 leader_election.cc:304] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39; no voters: 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:11.860633  2452 raft_consensus.cc:2804] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:11.861083  2452 raft_consensus.cc:697] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 LEADER]: Becoming Leader. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Running, Role: LEADER
I20260709 13:12:11.861840  2452 consensus_queue.cc:237] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:11.862083  2392 raft_consensus.cc:359] T a9be6d55d1f348bcaf96405abc80244d P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:11.862712  2392 raft_consensus.cc:385] T a9be6d55d1f348bcaf96405abc80244d P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:11.862982  2392 raft_consensus.cc:740] T a9be6d55d1f348bcaf96405abc80244d P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.863579  2392 consensus_queue.cc:260] T a9be6d55d1f348bcaf96405abc80244d P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:11.864482  2391 consensus_queue.cc:260] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:11.857697  2647 raft_consensus.cc:515] T 7e3782f3d54b4a19bacbd125c31127a9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:11.866915  2391 ts_tablet_manager.cc:1434] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.037s	user 0.001s	sys 0.005s
I20260709 13:12:11.867079  2272 raft_consensus.cc:2468] T 8b65903ab966485c9c65bdfbdf1e1054 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 1.
I20260709 13:12:11.871063  2647 leader_election.cc:290] T 7e3782f3d54b4a19bacbd125c31127a9 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 election: Requested vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:11.873410  2393 tablet_bootstrap.cc:492] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 0ec6a5d1452a41bd992a8c7922473b35: No bootstrap required, opened a new log
I20260709 13:12:11.874033  2649 consensus_queue.cc:1048] T f2a1307186df4616a9759118c2e456a6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:11.877440  2392 ts_tablet_manager.cc:1434] T a9be6d55d1f348bcaf96405abc80244d P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260709 13:12:11.877645  2393 ts_tablet_manager.cc:1403] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 0ec6a5d1452a41bd992a8c7922473b35: Time spent bootstrapping tablet: real 0.083s	user 0.011s	sys 0.002s
I20260709 13:12:11.880488  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b65903ab966485c9c65bdfbdf1e1054" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:11.881120  2343 raft_consensus.cc:3060] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:11.886127  2122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3782f3d54b4a19bacbd125c31127a9" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:11.886767  2122 raft_consensus.cc:3060] T 7e3782f3d54b4a19bacbd125c31127a9 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:11.888988  2343 raft_consensus.cc:2468] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 1.
I20260709 13:12:11.890698  2391 tablet_bootstrap.cc:492] T 28f2272230d34efa880d5eeed8859669 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:11.891819  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3782f3d54b4a19bacbd125c31127a9" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
W20260709 13:12:11.893402  2162 leader_election.cc:343] T 7e3782f3d54b4a19bacbd125c31127a9 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.895802  2162 leader_election.cc:304] T 8b65903ab966485c9c65bdfbdf1e1054 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:11.896596  2647 raft_consensus.cc:2804] T 8b65903ab966485c9c65bdfbdf1e1054 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:11.897048  2647 raft_consensus.cc:697] T 8b65903ab966485c9c65bdfbdf1e1054 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 LEADER]: Becoming Leader. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Running, Role: LEADER
I20260709 13:12:11.897809  2647 consensus_queue.cc:237] T 8b65903ab966485c9c65bdfbdf1e1054 P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:11.909166  2392 tablet_bootstrap.cc:492] T 78734884e0a441759b51d258ad2697aa P 66e9a8fffd4b4e5a81ca4fa2762773ea: Bootstrap starting.
I20260709 13:12:11.912482  2122 raft_consensus.cc:2468] T 7e3782f3d54b4a19bacbd125c31127a9 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 1.
I20260709 13:12:11.914345  2162 leader_election.cc:304] T 7e3782f3d54b4a19bacbd125c31127a9 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472; no voters: 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:11.915306  2581 raft_consensus.cc:2804] T 7e3782f3d54b4a19bacbd125c31127a9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:11.915741  2581 raft_consensus.cc:697] T 7e3782f3d54b4a19bacbd125c31127a9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 LEADER]: Becoming Leader. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Running, Role: LEADER
I20260709 13:12:11.916275  2391 tablet_bootstrap.cc:654] T 28f2272230d34efa880d5eeed8859669 P 2ac5c5682f914ed9b9982b5a080d5472: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:11.916522  2581 consensus_queue.cc:237] T 7e3782f3d54b4a19bacbd125c31127a9 P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:11.915819  2392 tablet_bootstrap.cc:654] T 78734884e0a441759b51d258ad2697aa P 66e9a8fffd4b4e5a81ca4fa2762773ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:11.880368  2393 raft_consensus.cc:359] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:11.920284  2393 raft_consensus.cc:385] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:11.921038  2393 raft_consensus.cc:740] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.921691  2393 consensus_queue.cc:260] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:11.924126  2402 ts_tablet_manager.cc:1434] T 8b65903ab966485c9c65bdfbdf1e1054 P 79b6e57d59e4468ebe4423d871a31b39: Time spent starting tablet: real 0.229s	user 0.004s	sys 0.002s
I20260709 13:12:11.925107  2402 tablet_bootstrap.cc:492] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39: Bootstrap starting.
I20260709 13:12:11.924818  2018 catalog_manager.cc:5697] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67). New cstate: current_term: 1 leader_uuid: "79b6e57d59e4468ebe4423d871a31b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:11.926237  2393 ts_tablet_manager.cc:1434] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 0ec6a5d1452a41bd992a8c7922473b35: Time spent starting tablet: real 0.048s	user 0.005s	sys 0.001s
I20260709 13:12:11.929046  2393 tablet_bootstrap.cc:492] T f9934bcaed6743b2a30104e13b8cf18b P 0ec6a5d1452a41bd992a8c7922473b35: Bootstrap starting.
I20260709 13:12:11.933193  2017 catalog_manager.cc:5697] T 8b65903ab966485c9c65bdfbdf1e1054 P 0ec6a5d1452a41bd992a8c7922473b35 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66). New cstate: current_term: 1 leader_uuid: "0ec6a5d1452a41bd992a8c7922473b35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:11.936914  2590 raft_consensus.cc:493] T e5bbfa12bce4430fa6e7e6abd281ded6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.938314  2393 tablet_bootstrap.cc:654] T f9934bcaed6743b2a30104e13b8cf18b P 0ec6a5d1452a41bd992a8c7922473b35: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:11.941111  2590 raft_consensus.cc:515] T e5bbfa12bce4430fa6e7e6abd281ded6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:11.954304  2452 raft_consensus.cc:493] T 78734884e0a441759b51d258ad2697aa P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:11.955031  2590 leader_election.cc:290] T e5bbfa12bce4430fa6e7e6abd281ded6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:11.954824  2452 raft_consensus.cc:515] T 78734884e0a441759b51d258ad2697aa P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:11.956784  2452 leader_election.cc:290] T 78734884e0a441759b51d258ad2697aa P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:11.957943  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bbfa12bce4430fa6e7e6abd281ded6" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:11.958457  2195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bbfa12bce4430fa6e7e6abd281ded6" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:11.959059  2195 raft_consensus.cc:2468] T e5bbfa12bce4430fa6e7e6abd281ded6 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 0.
I20260709 13:12:11.960395  2311 leader_election.cc:304] T e5bbfa12bce4430fa6e7e6abd281ded6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:11.958947  2122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78734884e0a441759b51d258ad2697aa" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
W20260709 13:12:11.963537  2310 leader_election.cc:343] T e5bbfa12bce4430fa6e7e6abd281ded6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.962477  2649 raft_consensus.cc:2804] T e5bbfa12bce4430fa6e7e6abd281ded6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:11.965246  2392 tablet_bootstrap.cc:492] T 78734884e0a441759b51d258ad2697aa P 66e9a8fffd4b4e5a81ca4fa2762773ea: No bootstrap required, opened a new log
I20260709 13:12:11.966972  2392 ts_tablet_manager.cc:1403] T 78734884e0a441759b51d258ad2697aa P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent bootstrapping tablet: real 0.058s	user 0.007s	sys 0.010s
I20260709 13:12:11.966602  2649 raft_consensus.cc:493] T e5bbfa12bce4430fa6e7e6abd281ded6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:11.967700  2649 raft_consensus.cc:3060] T e5bbfa12bce4430fa6e7e6abd281ded6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:11.968319  2236 leader_election.cc:343] T 78734884e0a441759b51d258ad2697aa P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.969190  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78734884e0a441759b51d258ad2697aa" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:11.970494  2391 tablet_bootstrap.cc:492] T 28f2272230d34efa880d5eeed8859669 P 2ac5c5682f914ed9b9982b5a080d5472: No bootstrap required, opened a new log
I20260709 13:12:11.970969  2391 ts_tablet_manager.cc:1403] T 28f2272230d34efa880d5eeed8859669 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.080s	user 0.013s	sys 0.010s
I20260709 13:12:11.973510  2649 raft_consensus.cc:515] T e5bbfa12bce4430fa6e7e6abd281ded6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:11.973838  2391 raft_consensus.cc:359] T 28f2272230d34efa880d5eeed8859669 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:11.974555  2391 raft_consensus.cc:385] T 28f2272230d34efa880d5eeed8859669 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:11.974857  2391 raft_consensus.cc:740] T 28f2272230d34efa880d5eeed8859669 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.975632  2391 consensus_queue.cc:260] T 28f2272230d34efa880d5eeed8859669 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:11.976032  2392 raft_consensus.cc:359] T 78734884e0a441759b51d258ad2697aa P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:11.976635  2392 raft_consensus.cc:385] T 78734884e0a441759b51d258ad2697aa P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:11.976867  2195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bbfa12bce4430fa6e7e6abd281ded6" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:11.975582  2649 leader_election.cc:290] T e5bbfa12bce4430fa6e7e6abd281ded6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 election: Requested vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:11.977486  2391 ts_tablet_manager.cc:1434] T 28f2272230d34efa880d5eeed8859669 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:12:11.977454  2195 raft_consensus.cc:3060] T e5bbfa12bce4430fa6e7e6abd281ded6 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:11.977954  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bbfa12bce4430fa6e7e6abd281ded6" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
W20260709 13:12:11.978010  2236 leader_election.cc:343] T 78734884e0a441759b51d258ad2697aa P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.978518  2391 tablet_bootstrap.cc:492] T a4a5ce298d24406ea94fb68aba5b37ae P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:11.978752  2236 leader_election.cc:304] T 78734884e0a441759b51d258ad2697aa P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b6e57d59e4468ebe4423d871a31b39; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea
W20260709 13:12:11.979337  2310 leader_election.cc:343] T e5bbfa12bce4430fa6e7e6abd281ded6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:11.979754  2452 raft_consensus.cc:2749] T 78734884e0a441759b51d258ad2697aa P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:11.983579  2402 tablet_bootstrap.cc:654] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:11.984257  2195 raft_consensus.cc:2468] T e5bbfa12bce4430fa6e7e6abd281ded6 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 1.
I20260709 13:12:11.976902  2392 raft_consensus.cc:740] T 78734884e0a441759b51d258ad2697aa P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:11.984766  2391 tablet_bootstrap.cc:654] T a4a5ce298d24406ea94fb68aba5b37ae P 2ac5c5682f914ed9b9982b5a080d5472: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:11.987267  2393 tablet_bootstrap.cc:492] T f9934bcaed6743b2a30104e13b8cf18b P 0ec6a5d1452a41bd992a8c7922473b35: No bootstrap required, opened a new log
I20260709 13:12:12.006402  2393 ts_tablet_manager.cc:1403] T f9934bcaed6743b2a30104e13b8cf18b P 0ec6a5d1452a41bd992a8c7922473b35: Time spent bootstrapping tablet: real 0.078s	user 0.012s	sys 0.008s
I20260709 13:12:12.006094  2019 catalog_manager.cc:5697] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "2ac5c5682f914ed9b9982b5a080d5472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:12.006910  2392 consensus_queue.cc:260] T 78734884e0a441759b51d258ad2697aa P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:12.010633  2393 raft_consensus.cc:359] T f9934bcaed6743b2a30104e13b8cf18b P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:12.011343  2393 raft_consensus.cc:385] T f9934bcaed6743b2a30104e13b8cf18b P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:12.011610  2393 raft_consensus.cc:740] T f9934bcaed6743b2a30104e13b8cf18b P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Initialized, Role: FOLLOWER
I20260709 13:12:12.012408  2393 consensus_queue.cc:260] T f9934bcaed6743b2a30104e13b8cf18b P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:12.017361  2392 ts_tablet_manager.cc:1434] T 78734884e0a441759b51d258ad2697aa P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent starting tablet: real 0.050s	user 0.005s	sys 0.002s
I20260709 13:12:12.011534  2311 leader_election.cc:304] T e5bbfa12bce4430fa6e7e6abd281ded6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:12.019979  2393 ts_tablet_manager.cc:1434] T f9934bcaed6743b2a30104e13b8cf18b P 0ec6a5d1452a41bd992a8c7922473b35: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 13:12:12.020339  2590 raft_consensus.cc:2804] T e5bbfa12bce4430fa6e7e6abd281ded6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:12.020834  2590 raft_consensus.cc:697] T e5bbfa12bce4430fa6e7e6abd281ded6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 LEADER]: Becoming Leader. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Running, Role: LEADER
I20260709 13:12:12.021350  2393 tablet_bootstrap.cc:492] T bc42d18a324e4f6d97f07cf770c5daa8 P 0ec6a5d1452a41bd992a8c7922473b35: Bootstrap starting.
I20260709 13:12:12.021606  2590 consensus_queue.cc:237] T e5bbfa12bce4430fa6e7e6abd281ded6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:12.028302  2649 raft_consensus.cc:493] T a9be6d55d1f348bcaf96405abc80244d P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.028806  2649 raft_consensus.cc:515] T a9be6d55d1f348bcaf96405abc80244d P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:12.030773  2649 leader_election.cc:290] T a9be6d55d1f348bcaf96405abc80244d P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:12.033378  2120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9be6d55d1f348bcaf96405abc80244d" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:12.035218  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9be6d55d1f348bcaf96405abc80244d" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
W20260709 13:12:12.035774  2310 leader_election.cc:343] T a9be6d55d1f348bcaf96405abc80244d P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:12.036809  2310 leader_election.cc:343] T a9be6d55d1f348bcaf96405abc80244d P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:12.037204  2310 leader_election.cc:304] T a9be6d55d1f348bcaf96405abc80244d P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:12.038450  2649 raft_consensus.cc:2749] T a9be6d55d1f348bcaf96405abc80244d P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:12.039443  2391 tablet_bootstrap.cc:492] T a4a5ce298d24406ea94fb68aba5b37ae P 2ac5c5682f914ed9b9982b5a080d5472: No bootstrap required, opened a new log
I20260709 13:12:12.039917  2391 ts_tablet_manager.cc:1403] T a4a5ce298d24406ea94fb68aba5b37ae P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.062s	user 0.015s	sys 0.008s
I20260709 13:12:12.042572  2391 raft_consensus.cc:359] T a4a5ce298d24406ea94fb68aba5b37ae P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:12.043206  2391 raft_consensus.cc:385] T a4a5ce298d24406ea94fb68aba5b37ae P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:12.029234  2393 tablet_bootstrap.cc:654] T bc42d18a324e4f6d97f07cf770c5daa8 P 0ec6a5d1452a41bd992a8c7922473b35: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:12.043251  2392 tablet_bootstrap.cc:492] T b206de895e36490688cb2c1c537774a5 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Bootstrap starting.
I20260709 13:12:12.046427  2402 tablet_bootstrap.cc:492] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39: No bootstrap required, opened a new log
I20260709 13:12:12.049117  2402 ts_tablet_manager.cc:1403] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39: Time spent bootstrapping tablet: real 0.124s	user 0.011s	sys 0.022s
I20260709 13:12:12.049391  2392 tablet_bootstrap.cc:654] T b206de895e36490688cb2c1c537774a5 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:12.054747  2402 raft_consensus.cc:359] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:12.043510  2391 raft_consensus.cc:740] T a4a5ce298d24406ea94fb68aba5b37ae P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:12.061950  2018 catalog_manager.cc:5697] T 7e3782f3d54b4a19bacbd125c31127a9 P 0ec6a5d1452a41bd992a8c7922473b35 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66). New cstate: current_term: 1 leader_uuid: "0ec6a5d1452a41bd992a8c7922473b35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:12.067898  2391 consensus_queue.cc:260] T a4a5ce298d24406ea94fb68aba5b37ae P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:12.066924  2392 tablet_bootstrap.cc:492] T b206de895e36490688cb2c1c537774a5 P 66e9a8fffd4b4e5a81ca4fa2762773ea: No bootstrap required, opened a new log
I20260709 13:12:12.069977  2391 ts_tablet_manager.cc:1434] T a4a5ce298d24406ea94fb68aba5b37ae P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.001s
I20260709 13:12:12.070187  2392 ts_tablet_manager.cc:1403] T b206de895e36490688cb2c1c537774a5 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.004s
I20260709 13:12:12.070837  2391 tablet_bootstrap.cc:492] T ddf48e4f6be64627a0ed06d6198ca054 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:12.072821  2392 raft_consensus.cc:359] T b206de895e36490688cb2c1c537774a5 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:12.073443  2392 raft_consensus.cc:385] T b206de895e36490688cb2c1c537774a5 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:12.073714  2392 raft_consensus.cc:740] T b206de895e36490688cb2c1c537774a5 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:12.074352  2392 consensus_queue.cc:260] T b206de895e36490688cb2c1c537774a5 P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:12.076826  2393 tablet_bootstrap.cc:492] T bc42d18a324e4f6d97f07cf770c5daa8 P 0ec6a5d1452a41bd992a8c7922473b35: No bootstrap required, opened a new log
I20260709 13:12:12.077221  2402 raft_consensus.cc:385] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:12.077008  2391 tablet_bootstrap.cc:654] T ddf48e4f6be64627a0ed06d6198ca054 P 2ac5c5682f914ed9b9982b5a080d5472: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:12.077517  2402 raft_consensus.cc:740] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Initialized, Role: FOLLOWER
I20260709 13:12:12.077346  2393 ts_tablet_manager.cc:1403] T bc42d18a324e4f6d97f07cf770c5daa8 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent bootstrapping tablet: real 0.056s	user 0.015s	sys 0.002s
I20260709 13:12:12.080592  2402 consensus_queue.cc:260] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:12.082674  2402 ts_tablet_manager.cc:1434] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.000s
I20260709 13:12:12.083552  2402 tablet_bootstrap.cc:492] T b206de895e36490688cb2c1c537774a5 P 79b6e57d59e4468ebe4423d871a31b39: Bootstrap starting.
I20260709 13:12:12.083278  2393 raft_consensus.cc:359] T bc42d18a324e4f6d97f07cf770c5daa8 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:12.084062  2393 raft_consensus.cc:385] T bc42d18a324e4f6d97f07cf770c5daa8 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:12.084439  2393 raft_consensus.cc:740] T bc42d18a324e4f6d97f07cf770c5daa8 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Initialized, Role: FOLLOWER
I20260709 13:12:12.085203  2393 consensus_queue.cc:260] T bc42d18a324e4f6d97f07cf770c5daa8 P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:12.089299  2402 tablet_bootstrap.cc:654] T b206de895e36490688cb2c1c537774a5 P 79b6e57d59e4468ebe4423d871a31b39: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:12.102524  2393 ts_tablet_manager.cc:1434] T bc42d18a324e4f6d97f07cf770c5daa8 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260709 13:12:12.103880  2020 catalog_manager.cc:5697] T e5bbfa12bce4430fa6e7e6abd281ded6 P 66e9a8fffd4b4e5a81ca4fa2762773ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68). New cstate: current_term: 1 leader_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:12.105306  2627 raft_consensus.cc:493] T a4a5ce298d24406ea94fb68aba5b37ae P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.107250  2627 raft_consensus.cc:515] T a4a5ce298d24406ea94fb68aba5b37ae P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:12.107805  2393 tablet_bootstrap.cc:492] T d2f88787abb54ffea037f35cf48b22c4 P 0ec6a5d1452a41bd992a8c7922473b35: Bootstrap starting.
I20260709 13:12:12.105786  2593 raft_consensus.cc:493] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.110014  2593 raft_consensus.cc:515] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:12.112046  2593 leader_election.cc:290] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:12.114197  2402 tablet_bootstrap.cc:492] T b206de895e36490688cb2c1c537774a5 P 79b6e57d59e4468ebe4423d871a31b39: No bootstrap required, opened a new log
I20260709 13:12:12.114686  2402 ts_tablet_manager.cc:1403] T b206de895e36490688cb2c1c537774a5 P 79b6e57d59e4468ebe4423d871a31b39: Time spent bootstrapping tablet: real 0.031s	user 0.010s	sys 0.007s
I20260709 13:12:12.115470  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a5ce298d24406ea94fb68aba5b37ae" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:12.115782  2393 tablet_bootstrap.cc:654] T d2f88787abb54ffea037f35cf48b22c4 P 0ec6a5d1452a41bd992a8c7922473b35: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:12.116135  2343 raft_consensus.cc:2468] T a4a5ce298d24406ea94fb68aba5b37ae P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 0.
I20260709 13:12:12.117098  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bd8fc2d57c14adeaeae16583eef7c84" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:12.117354  2402 raft_consensus.cc:359] T b206de895e36490688cb2c1c537774a5 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:12.118009  2402 raft_consensus.cc:385] T b206de895e36490688cb2c1c537774a5 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:12.118288  2402 raft_consensus.cc:740] T b206de895e36490688cb2c1c537774a5 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Initialized, Role: FOLLOWER
I20260709 13:12:12.118911  2402 consensus_queue.cc:260] T b206de895e36490688cb2c1c537774a5 P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:12.120451  2195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a5ce298d24406ea94fb68aba5b37ae" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:12.120819  2393 tablet_bootstrap.cc:492] T d2f88787abb54ffea037f35cf48b22c4 P 0ec6a5d1452a41bd992a8c7922473b35: No bootstrap required, opened a new log
I20260709 13:12:12.121521  2198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bd8fc2d57c14adeaeae16583eef7c84" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:12.122159  2198 raft_consensus.cc:2468] T 0bd8fc2d57c14adeaeae16583eef7c84 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 0.
I20260709 13:12:12.122629  2393 ts_tablet_manager.cc:1403] T d2f88787abb54ffea037f35cf48b22c4 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.003s
I20260709 13:12:12.125494  2393 raft_consensus.cc:359] T d2f88787abb54ffea037f35cf48b22c4 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:12.126251  2393 raft_consensus.cc:385] T d2f88787abb54ffea037f35cf48b22c4 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:12.126569  2393 raft_consensus.cc:740] T d2f88787abb54ffea037f35cf48b22c4 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Initialized, Role: FOLLOWER
I20260709 13:12:12.127414  2393 consensus_queue.cc:260] T d2f88787abb54ffea037f35cf48b22c4 P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:12.129467  2393 ts_tablet_manager.cc:1434] T d2f88787abb54ffea037f35cf48b22c4 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:12:12.130373  2402 ts_tablet_manager.cc:1434] T b206de895e36490688cb2c1c537774a5 P 79b6e57d59e4468ebe4423d871a31b39: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 13:12:12.130555  2393 tablet_bootstrap.cc:492] T ddf48e4f6be64627a0ed06d6198ca054 P 0ec6a5d1452a41bd992a8c7922473b35: Bootstrap starting.
I20260709 13:12:12.131368  2402 tablet_bootstrap.cc:492] T e5bbfa12bce4430fa6e7e6abd281ded6 P 79b6e57d59e4468ebe4423d871a31b39: Bootstrap starting.
I20260709 13:12:12.134087  2270 raft_consensus.cc:2468] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 0.
I20260709 13:12:12.137439  2393 tablet_bootstrap.cc:654] T ddf48e4f6be64627a0ed06d6198ca054 P 0ec6a5d1452a41bd992a8c7922473b35: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:12.109485  2627 leader_election.cc:290] T a4a5ce298d24406ea94fb68aba5b37ae P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:12.126511  2087 leader_election.cc:304] T a4a5ce298d24406ea94fb68aba5b37ae P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:12.143649  2087 leader_election.cc:304] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:12.144475  2586 raft_consensus.cc:2804] T a4a5ce298d24406ea94fb68aba5b37ae P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:12.144855  2586 raft_consensus.cc:493] T a4a5ce298d24406ea94fb68aba5b37ae P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:12.145169  2586 raft_consensus.cc:3060] T a4a5ce298d24406ea94fb68aba5b37ae P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:12.146345  2088 leader_election.cc:343] T a4a5ce298d24406ea94fb68aba5b37ae P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:12.148005  2402 tablet_bootstrap.cc:654] T e5bbfa12bce4430fa6e7e6abd281ded6 P 79b6e57d59e4468ebe4423d871a31b39: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:12.150216  2451 raft_consensus.cc:2804] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:12.150621  2451 raft_consensus.cc:493] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:12.150966  2451 raft_consensus.cc:3060] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:12.154001  2402 tablet_bootstrap.cc:492] T e5bbfa12bce4430fa6e7e6abd281ded6 P 79b6e57d59e4468ebe4423d871a31b39: No bootstrap required, opened a new log
I20260709 13:12:12.154565  2402 ts_tablet_manager.cc:1403] T e5bbfa12bce4430fa6e7e6abd281ded6 P 79b6e57d59e4468ebe4423d871a31b39: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.000s
I20260709 13:12:12.157366  2402 raft_consensus.cc:359] T e5bbfa12bce4430fa6e7e6abd281ded6 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:12.106751  2392 ts_tablet_manager.cc:1434] T b206de895e36490688cb2c1c537774a5 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent starting tablet: real 0.036s	user 0.004s	sys 0.002s
I20260709 13:12:12.157711  2451 raft_consensus.cc:515] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:12.158115  2402 raft_consensus.cc:385] T e5bbfa12bce4430fa6e7e6abd281ded6 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:12.161172  2402 raft_consensus.cc:740] T e5bbfa12bce4430fa6e7e6abd281ded6 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Initialized, Role: FOLLOWER
I20260709 13:12:12.159572  2392 tablet_bootstrap.cc:492] T 10de08c2346d47dbbd720596cd7e02fd P 66e9a8fffd4b4e5a81ca4fa2762773ea: Bootstrap starting.
I20260709 13:12:12.163501  2451 leader_election.cc:290] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 election: Requested vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:12.160653  2581 raft_consensus.cc:493] T ee1baa7401cd48e48e7125dcd607f44f P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.164038  2581 raft_consensus.cc:515] T ee1baa7401cd48e48e7125dcd607f44f P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:12.164535  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bd8fc2d57c14adeaeae16583eef7c84" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:12.165156  2270 raft_consensus.cc:3060] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:12.160046  2586 raft_consensus.cc:515] T a4a5ce298d24406ea94fb68aba5b37ae P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:12.165979  2581 leader_election.cc:290] T ee1baa7401cd48e48e7125dcd607f44f P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:12.168150  2391 tablet_bootstrap.cc:492] T ddf48e4f6be64627a0ed06d6198ca054 P 2ac5c5682f914ed9b9982b5a080d5472: No bootstrap required, opened a new log
I20260709 13:12:12.168648  2391 ts_tablet_manager.cc:1403] T ddf48e4f6be64627a0ed06d6198ca054 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.098s	user 0.026s	sys 0.025s
I20260709 13:12:12.169679  2392 tablet_bootstrap.cc:654] T 10de08c2346d47dbbd720596cd7e02fd P 66e9a8fffd4b4e5a81ca4fa2762773ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:12.170814  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee1baa7401cd48e48e7125dcd607f44f" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:12.171456  2120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee1baa7401cd48e48e7125dcd607f44f" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:12.172646  2198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bd8fc2d57c14adeaeae16583eef7c84" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:12.173216  2198 raft_consensus.cc:3060] T 0bd8fc2d57c14adeaeae16583eef7c84 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:12.174404  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a5ce298d24406ea94fb68aba5b37ae" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
W20260709 13:12:12.174875  2162 leader_election.cc:343] T ee1baa7401cd48e48e7125dcd607f44f P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:12.175011  2343 raft_consensus.cc:3060] T a4a5ce298d24406ea94fb68aba5b37ae P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:12.178946  2195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a5ce298d24406ea94fb68aba5b37ae" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
W20260709 13:12:12.180691  2088 leader_election.cc:343] T a4a5ce298d24406ea94fb68aba5b37ae P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:12.181083  2198 raft_consensus.cc:2468] T 0bd8fc2d57c14adeaeae16583eef7c84 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 1.
I20260709 13:12:12.181427  2519 raft_consensus.cc:493] T b206de895e36490688cb2c1c537774a5 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.182004  2519 raft_consensus.cc:515] T b206de895e36490688cb2c1c537774a5 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:12.182802  2402 consensus_queue.cc:260] T e5bbfa12bce4430fa6e7e6abd281ded6 P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:12.183580  2391 raft_consensus.cc:359] T ddf48e4f6be64627a0ed06d6198ca054 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:12.184274  2391 raft_consensus.cc:385] T ddf48e4f6be64627a0ed06d6198ca054 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:12.184525  2391 raft_consensus.cc:740] T ddf48e4f6be64627a0ed06d6198ca054 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:12.187867  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b206de895e36490688cb2c1c537774a5" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:12.188503  2345 raft_consensus.cc:2468] T b206de895e36490688cb2c1c537774a5 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 0.
I20260709 13:12:12.189563  2519 leader_election.cc:290] T b206de895e36490688cb2c1c537774a5 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:12.190455  2343 raft_consensus.cc:2468] T a4a5ce298d24406ea94fb68aba5b37ae P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 1.
I20260709 13:12:12.192863  2402 ts_tablet_manager.cc:1434] T e5bbfa12bce4430fa6e7e6abd281ded6 P 79b6e57d59e4468ebe4423d871a31b39: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260709 13:12:12.198275  2391 consensus_queue.cc:260] T ddf48e4f6be64627a0ed06d6198ca054 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:12.198566  2402 tablet_bootstrap.cc:492] T df8d897471684531826528a5751d6246 P 79b6e57d59e4468ebe4423d871a31b39: Bootstrap starting.
I20260709 13:12:12.171476  2342 raft_consensus.cc:2468] T ee1baa7401cd48e48e7125dcd607f44f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 0.
I20260709 13:12:12.192757  2120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b206de895e36490688cb2c1c537774a5" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:12.173224  2586 leader_election.cc:290] T a4a5ce298d24406ea94fb68aba5b37ae P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 election: Requested vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:12.208329  2087 leader_election.cc:304] T a4a5ce298d24406ea94fb68aba5b37ae P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 0ec6a5d1452a41bd992a8c7922473b35
I20260709 13:12:12.209573  2270 raft_consensus.cc:2468] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 1.
I20260709 13:12:12.210157  2162 leader_election.cc:304] T ee1baa7401cd48e48e7125dcd607f44f P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:12.214141  2391 ts_tablet_manager.cc:1434] T ddf48e4f6be64627a0ed06d6198ca054 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.001s
I20260709 13:12:12.214594  2647 raft_consensus.cc:2804] T ee1baa7401cd48e48e7125dcd607f44f P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:12.214910  2392 tablet_bootstrap.cc:492] T 10de08c2346d47dbbd720596cd7e02fd P 66e9a8fffd4b4e5a81ca4fa2762773ea: No bootstrap required, opened a new log
I20260709 13:12:12.215019  2647 raft_consensus.cc:493] T ee1baa7401cd48e48e7125dcd607f44f P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:12.215456  2647 raft_consensus.cc:3060] T ee1baa7401cd48e48e7125dcd607f44f P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:12.215916  2195 raft_consensus.cc:3060] T bc42d18a324e4f6d97f07cf770c5daa8 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:12.217968  2391 tablet_bootstrap.cc:492] T ee1baa7401cd48e48e7125dcd607f44f P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:12.206475  2236 leader_election.cc:304] T b206de895e36490688cb2c1c537774a5 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:12.218837  2452 raft_consensus.cc:2804] T b206de895e36490688cb2c1c537774a5 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:12.214308  2627 raft_consensus.cc:2804] T a4a5ce298d24406ea94fb68aba5b37ae P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:12.219199  2452 raft_consensus.cc:493] T b206de895e36490688cb2c1c537774a5 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:12.220096  2452 raft_consensus.cc:3060] T b206de895e36490688cb2c1c537774a5 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:12.221414  2088 leader_election.cc:304] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472; no voters: 
I20260709 13:12:12.222215  2593 raft_consensus.cc:2804] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:12.224417  2647 raft_consensus.cc:515] T ee1baa7401cd48e48e7125dcd607f44f P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
W20260709 13:12:12.219262  2236 leader_election.cc:343] T b206de895e36490688cb2c1c537774a5 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:12.219619  2392 ts_tablet_manager.cc:1403] T 10de08c2346d47dbbd720596cd7e02fd P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent bootstrapping tablet: real 0.060s	user 0.017s	sys 0.001s
I20260709 13:12:12.232158  2392 raft_consensus.cc:359] T 10de08c2346d47dbbd720596cd7e02fd P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:12.232769  2392 raft_consensus.cc:385] T 10de08c2346d47dbbd720596cd7e02fd P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:12.232999  2392 raft_consensus.cc:740] T 10de08c2346d47dbbd720596cd7e02fd P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:12.233608  2392 consensus_queue.cc:260] T 10de08c2346d47dbbd720596cd7e02fd P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:12.235870  2392 ts_tablet_manager.cc:1434] T 10de08c2346d47dbbd720596cd7e02fd P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:12:12.238418  2392 tablet_bootstrap.cc:492] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 66e9a8fffd4b4e5a81ca4fa2762773ea: Bootstrap starting.
I20260709 13:12:12.239902  2581 raft_consensus.cc:493] T bc42d18a324e4f6d97f07cf770c5daa8 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.244153  2581 raft_consensus.cc:515] T bc42d18a324e4f6d97f07cf770c5daa8 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:12.244938  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee1baa7401cd48e48e7125dcd607f44f" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:12.237140  2452 raft_consensus.cc:515] T b206de895e36490688cb2c1c537774a5 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:12.245539  2345 raft_consensus.cc:3060] T ee1baa7401cd48e48e7125dcd607f44f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:12.247644  2581 leader_election.cc:290] T bc42d18a324e4f6d97f07cf770c5daa8 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:12.248268  2590 raft_consensus.cc:493] T 78734884e0a441759b51d258ad2697aa P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.248735  2590 raft_consensus.cc:515] T 78734884e0a441759b51d258ad2697aa P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:12.249027  2120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee1baa7401cd48e48e7125dcd607f44f" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:12.249363  2401 raft_consensus.cc:493] T 10de08c2346d47dbbd720596cd7e02fd P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.250073  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc42d18a324e4f6d97f07cf770c5daa8" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:12.243791  2451 consensus_queue.cc:1048] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 13:12:12.250736  2590 leader_election.cc:290] T 78734884e0a441759b51d258ad2697aa P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:12.249845  2401 raft_consensus.cc:515] T 10de08c2346d47dbbd720596cd7e02fd P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:12.250698  2342 raft_consensus.cc:2468] T bc42d18a324e4f6d97f07cf770c5daa8 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 1.
I20260709 13:12:12.252843  2401 leader_election.cc:290] T 10de08c2346d47dbbd720596cd7e02fd P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
W20260709 13:12:12.253679  2162 leader_election.cc:343] T ee1baa7401cd48e48e7125dcd607f44f P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:12.256167  2162 leader_election.cc:304] T bc42d18a324e4f6d97f07cf770c5daa8 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:12.256378  2196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10de08c2346d47dbbd720596cd7e02fd" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:12.258167  2120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc42d18a324e4f6d97f07cf770c5daa8" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
W20260709 13:12:12.258178  2311 leader_election.cc:343] T 10de08c2346d47dbbd720596cd7e02fd P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:12.259485  2452 leader_election.cc:290] T b206de895e36490688cb2c1c537774a5 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 election: Requested vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:12.256510  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b206de895e36490688cb2c1c537774a5" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:12.260942  2122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b206de895e36490688cb2c1c537774a5" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:12.261334  2343 raft_consensus.cc:3060] T b206de895e36490688cb2c1c537774a5 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:12.262430  2236 leader_election.cc:343] T b206de895e36490688cb2c1c537774a5 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:12.263543  2392 tablet_bootstrap.cc:654] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 66e9a8fffd4b4e5a81ca4fa2762773ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:12.268055  2586 consensus_queue.cc:1048] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:12.268491  2391 tablet_bootstrap.cc:654] T ee1baa7401cd48e48e7125dcd607f44f P 2ac5c5682f914ed9b9982b5a080d5472: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:12.268821  2647 leader_election.cc:290] T ee1baa7401cd48e48e7125dcd607f44f P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 election: Requested vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:12.246126  2393 tablet_bootstrap.cc:492] T ddf48e4f6be64627a0ed06d6198ca054 P 0ec6a5d1452a41bd992a8c7922473b35: No bootstrap required, opened a new log
I20260709 13:12:12.243263  2402 tablet_bootstrap.cc:654] T df8d897471684531826528a5751d6246 P 79b6e57d59e4468ebe4423d871a31b39: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:12.270303  2393 ts_tablet_manager.cc:1403] T ddf48e4f6be64627a0ed06d6198ca054 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent bootstrapping tablet: real 0.140s	user 0.004s	sys 0.031s
I20260709 13:12:12.272569  2120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78734884e0a441759b51d258ad2697aa" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:12.274818  2627 raft_consensus.cc:697] T a4a5ce298d24406ea94fb68aba5b37ae P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 LEADER]: Becoming Leader. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Running, Role: LEADER
W20260709 13:12:12.274971  2310 leader_election.cc:343] T 78734884e0a441759b51d258ad2697aa P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:12.276099  2120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10de08c2346d47dbbd720596cd7e02fd" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:12.276904  2627 consensus_queue.cc:237] T a4a5ce298d24406ea94fb68aba5b37ae P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
W20260709 13:12:12.277941  2310 leader_election.cc:343] T 10de08c2346d47dbbd720596cd7e02fd P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:12.278376  2310 leader_election.cc:304] T 10de08c2346d47dbbd720596cd7e02fd P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:12.279347  2401 raft_consensus.cc:2749] T 10de08c2346d47dbbd720596cd7e02fd P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:12.282246  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78734884e0a441759b51d258ad2697aa" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:12.282867  2270 raft_consensus.cc:2468] T 78734884e0a441759b51d258ad2697aa P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 0.
I20260709 13:12:12.283752  2310 leader_election.cc:304] T 78734884e0a441759b51d258ad2697aa P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39; no voters: 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:12.285334  2401 raft_consensus.cc:2804] T 78734884e0a441759b51d258ad2697aa P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:12.285734  2401 raft_consensus.cc:493] T 78734884e0a441759b51d258ad2697aa P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:12.286144  2401 raft_consensus.cc:3060] T 78734884e0a441759b51d258ad2697aa P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:12.288419  2343 raft_consensus.cc:2468] T b206de895e36490688cb2c1c537774a5 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 1.
I20260709 13:12:12.289117  2345 raft_consensus.cc:2468] T ee1baa7401cd48e48e7125dcd607f44f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 1.
I20260709 13:12:12.290155  2162 leader_election.cc:304] T ee1baa7401cd48e48e7125dcd607f44f P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:12.290938  2581 raft_consensus.cc:2804] T ee1baa7401cd48e48e7125dcd607f44f P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:12.291404  2581 raft_consensus.cc:697] T ee1baa7401cd48e48e7125dcd607f44f P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 LEADER]: Becoming Leader. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Running, Role: LEADER
I20260709 13:12:12.292186  2581 consensus_queue.cc:237] T ee1baa7401cd48e48e7125dcd607f44f P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:12.294144  2236 leader_election.cc:304] T b206de895e36490688cb2c1c537774a5 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39; no voters: 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:12.296103  2391 tablet_bootstrap.cc:492] T ee1baa7401cd48e48e7125dcd607f44f P 2ac5c5682f914ed9b9982b5a080d5472: No bootstrap required, opened a new log
I20260709 13:12:12.296761  2391 ts_tablet_manager.cc:1403] T ee1baa7401cd48e48e7125dcd607f44f P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.079s	user 0.005s	sys 0.009s
I20260709 13:12:12.297355  2519 raft_consensus.cc:2804] T b206de895e36490688cb2c1c537774a5 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:12.297897  2519 raft_consensus.cc:697] T b206de895e36490688cb2c1c537774a5 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 LEADER]: Becoming Leader. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Running, Role: LEADER
I20260709 13:12:12.298682  2519 consensus_queue.cc:237] T b206de895e36490688cb2c1c537774a5 P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:12.299479  2391 raft_consensus.cc:359] T ee1baa7401cd48e48e7125dcd607f44f P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:12.301007  2391 raft_consensus.cc:385] T ee1baa7401cd48e48e7125dcd607f44f P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:12.301297  2391 raft_consensus.cc:740] T ee1baa7401cd48e48e7125dcd607f44f P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:12.281527  2393 raft_consensus.cc:359] T ddf48e4f6be64627a0ed06d6198ca054 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:12.302101  2393 raft_consensus.cc:385] T ddf48e4f6be64627a0ed06d6198ca054 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:12.302455  2393 raft_consensus.cc:740] T ddf48e4f6be64627a0ed06d6198ca054 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Initialized, Role: FOLLOWER
I20260709 13:12:12.303145  2391 consensus_queue.cc:260] T ee1baa7401cd48e48e7125dcd607f44f P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:12.307750  2391 ts_tablet_manager.cc:1434] T ee1baa7401cd48e48e7125dcd607f44f P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:12:12.303299  2393 consensus_queue.cc:260] T ddf48e4f6be64627a0ed06d6198ca054 P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:12.310195  2391 tablet_bootstrap.cc:492] T 78734884e0a441759b51d258ad2697aa P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:12.306561  2647 raft_consensus.cc:493] T d2f88787abb54ffea037f35cf48b22c4 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.314647  2393 ts_tablet_manager.cc:1434] T ddf48e4f6be64627a0ed06d6198ca054 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260709 13:12:12.316422  2393 tablet_bootstrap.cc:492] T 38d5e9a8f42c4a2993d25a8a341fddbf P 0ec6a5d1452a41bd992a8c7922473b35: Bootstrap starting.
I20260709 13:12:12.310820  2527 raft_consensus.cc:2804] T bc42d18a324e4f6d97f07cf770c5daa8 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:12.318763  2647 raft_consensus.cc:515] T d2f88787abb54ffea037f35cf48b22c4 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:12.326121  2588 raft_consensus.cc:493] T f9934bcaed6743b2a30104e13b8cf18b P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.332755  2392 tablet_bootstrap.cc:492] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 66e9a8fffd4b4e5a81ca4fa2762773ea: No bootstrap required, opened a new log
I20260709 13:12:12.333364  2392 ts_tablet_manager.cc:1403] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent bootstrapping tablet: real 0.095s	user 0.009s	sys 0.006s
I20260709 13:12:12.334360  2593 raft_consensus.cc:697] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 LEADER]: Becoming Leader. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Running, Role: LEADER
I20260709 13:12:12.334906  2588 raft_consensus.cc:515] T f9934bcaed6743b2a30104e13b8cf18b P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:12.354830  2452 consensus_queue.cc:1048] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:12.346980  2593 consensus_queue.cc:237] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:12.356390  2527 raft_consensus.cc:493] T bc42d18a324e4f6d97f07cf770c5daa8 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:12.356848  2527 raft_consensus.cc:3060] T bc42d18a324e4f6d97f07cf770c5daa8 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:12.359877  2581 raft_consensus.cc:493] T ddf48e4f6be64627a0ed06d6198ca054 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.360601  2581 raft_consensus.cc:515] T ddf48e4f6be64627a0ed06d6198ca054 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:12.364951  2581 leader_election.cc:290] T ddf48e4f6be64627a0ed06d6198ca054 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:12.366761  2120 raft_consensus.cc:3060] T 28f2272230d34efa880d5eeed8859669 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:12.367128  2581 consensus_queue.cc:1048] T 8b65903ab966485c9c65bdfbdf1e1054 P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:12.364765  2020 catalog_manager.cc:5697] T b206de895e36490688cb2c1c537774a5 P 79b6e57d59e4468ebe4423d871a31b39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67). New cstate: current_term: 1 leader_uuid: "79b6e57d59e4468ebe4423d871a31b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:12.370150  2402 tablet_bootstrap.cc:492] T df8d897471684531826528a5751d6246 P 79b6e57d59e4468ebe4423d871a31b39: No bootstrap required, opened a new log
I20260709 13:12:12.370707  2402 ts_tablet_manager.cc:1403] T df8d897471684531826528a5751d6246 P 79b6e57d59e4468ebe4423d871a31b39: Time spent bootstrapping tablet: real 0.172s	user 0.015s	sys 0.006s
I20260709 13:12:12.375674  2402 raft_consensus.cc:359] T df8d897471684531826528a5751d6246 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:12.355527  2588 leader_election.cc:290] T f9934bcaed6743b2a30104e13b8cf18b P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:12.377123  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9934bcaed6743b2a30104e13b8cf18b" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:12.379297  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9934bcaed6743b2a30104e13b8cf18b" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:12.381102  2122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddf48e4f6be64627a0ed06d6198ca054" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:12.378916  2392 raft_consensus.cc:359] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:12.383306  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddf48e4f6be64627a0ed06d6198ca054" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:12.392127  2392 raft_consensus.cc:385] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:12.393002  2392 raft_consensus.cc:740] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:12.392529  2402 raft_consensus.cc:385] T df8d897471684531826528a5751d6246 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:12.394202  2402 raft_consensus.cc:740] T df8d897471684531826528a5751d6246 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Initialized, Role: FOLLOWER
W20260709 13:12:12.394797  2162 leader_election.cc:343] T f9934bcaed6743b2a30104e13b8cf18b P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:12.399914  2272 raft_consensus.cc:2468] T ddf48e4f6be64627a0ed06d6198ca054 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 0.
I20260709 13:12:12.395546  2392 consensus_queue.cc:260] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:12.396435  2402 consensus_queue.cc:260] T df8d897471684531826528a5751d6246 P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
W20260709 13:12:12.403276  2088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:38859, user_credentials={real_user=slave}} blocked reactor thread for 49534.4us
I20260709 13:12:12.403465  2122 raft_consensus.cc:2468] T ddf48e4f6be64627a0ed06d6198ca054 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 0.
I20260709 13:12:12.391526  2343 raft_consensus.cc:2468] T f9934bcaed6743b2a30104e13b8cf18b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 0.
I20260709 13:12:12.409292  2647 leader_election.cc:290] T d2f88787abb54ffea037f35cf48b22c4 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:12.410742  2527 raft_consensus.cc:515] T bc42d18a324e4f6d97f07cf770c5daa8 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:12.414290  2162 leader_election.cc:304] T ddf48e4f6be64627a0ed06d6198ca054 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472; no voters: 
I20260709 13:12:12.415356  2162 leader_election.cc:304] T f9934bcaed6743b2a30104e13b8cf18b P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:12.428480  2527 leader_election.cc:290] T bc42d18a324e4f6d97f07cf770c5daa8 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 election: Requested vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:12.416599  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f88787abb54ffea037f35cf48b22c4" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:12.422190  2647 raft_consensus.cc:2804] T ddf48e4f6be64627a0ed06d6198ca054 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:12.417392  2122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f88787abb54ffea037f35cf48b22c4" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:12.421388  2452 consensus_queue.cc:1048] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:12:12.430450  2393 tablet_bootstrap.cc:654] T 38d5e9a8f42c4a2993d25a8a341fddbf P 0ec6a5d1452a41bd992a8c7922473b35: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:12.429593  2198 raft_consensus.cc:1240] T bc42d18a324e4f6d97f07cf770c5daa8 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Rejecting Update request from peer 2ac5c5682f914ed9b9982b5a080d5472 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:12.434747  2392 ts_tablet_manager.cc:1434] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent starting tablet: real 0.101s	user 0.007s	sys 0.001s
I20260709 13:12:12.437696  2392 tablet_bootstrap.cc:492] T 583390912c6d4daca2df9b5534fb8dca P 66e9a8fffd4b4e5a81ca4fa2762773ea: Bootstrap starting.
I20260709 13:12:12.438107  2402 ts_tablet_manager.cc:1434] T df8d897471684531826528a5751d6246 P 79b6e57d59e4468ebe4423d871a31b39: Time spent starting tablet: real 0.067s	user 0.005s	sys 0.002s
I20260709 13:12:12.439123  2402 tablet_bootstrap.cc:492] T a9be6d55d1f348bcaf96405abc80244d P 79b6e57d59e4468ebe4423d871a31b39: Bootstrap starting.
I20260709 13:12:12.433305  2588 raft_consensus.cc:2804] T f9934bcaed6743b2a30104e13b8cf18b P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:12.441807  2588 raft_consensus.cc:493] T f9934bcaed6743b2a30104e13b8cf18b P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:12.443497  2588 raft_consensus.cc:3060] T f9934bcaed6743b2a30104e13b8cf18b P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:12.446753  2162 leader_election.cc:343] T d2f88787abb54ffea037f35cf48b22c4 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:12.435484  2647 raft_consensus.cc:493] T ddf48e4f6be64627a0ed06d6198ca054 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:12.456554  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc42d18a324e4f6d97f07cf770c5daa8" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:12.438653  2122 raft_consensus.cc:2468] T d2f88787abb54ffea037f35cf48b22c4 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 0.
I20260709 13:12:12.450141  2581 raft_consensus.cc:493] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.453552  2593 raft_consensus.cc:493] T 28f2272230d34efa880d5eeed8859669 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.453322  2647 raft_consensus.cc:3060] T ddf48e4f6be64627a0ed06d6198ca054 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:12.442886  2401 raft_consensus.cc:515] T 78734884e0a441759b51d258ad2697aa P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:12.458794  2120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc42d18a324e4f6d97f07cf770c5daa8" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:12.469930  2162 leader_election.cc:304] T d2f88787abb54ffea037f35cf48b22c4 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472; no voters: 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:12.470292  2020 catalog_manager.cc:5697] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "2ac5c5682f914ed9b9982b5a080d5472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:12.471874  2020 catalog_manager.cc:5697] T a4a5ce298d24406ea94fb68aba5b37ae P 2ac5c5682f914ed9b9982b5a080d5472 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "2ac5c5682f914ed9b9982b5a080d5472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:12.466704  2581 raft_consensus.cc:515] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:12.472548  2678 consensus_queue.cc:1059] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:12.473323  2586 raft_consensus.cc:3055] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:12.473663  2586 raft_consensus.cc:740] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Running, Role: LEADER
I20260709 13:12:12.474428  2586 consensus_queue.cc:260] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:12.475476  2586 raft_consensus.cc:3060] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:12.476833  2452 raft_consensus.cc:493] T df8d897471684531826528a5751d6246 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.477772  2452 raft_consensus.cc:515] T df8d897471684531826528a5751d6246 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:12.472456  2691 raft_consensus.cc:2804] T d2f88787abb54ffea037f35cf48b22c4 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:12.478664  2691 raft_consensus.cc:493] T d2f88787abb54ffea037f35cf48b22c4 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:12.478981  2691 raft_consensus.cc:3060] T d2f88787abb54ffea037f35cf48b22c4 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:12.479632  2452 leader_election.cc:290] T df8d897471684531826528a5751d6246 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:12.481384  2581 leader_election.cc:290] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:12.485460  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df8d897471684531826528a5751d6246" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
W20260709 13:12:12.486779  2236 leader_election.cc:343] T df8d897471684531826528a5751d6246 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:12.487859  2401 leader_election.cc:290] T 78734884e0a441759b51d258ad2697aa P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 election: Requested vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:12.490449  2391 tablet_bootstrap.cc:654] T 78734884e0a441759b51d258ad2697aa P 2ac5c5682f914ed9b9982b5a080d5472: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:12.491590  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc33c7c3cfd14ab7a99e39cfd971fc3c" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:12.493680  2344 raft_consensus.cc:2468] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 0.
I20260709 13:12:12.494145  2120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78734884e0a441759b51d258ad2697aa" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:12.495630  2119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df8d897471684531826528a5751d6246" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
W20260709 13:12:12.496773  2236 leader_election.cc:343] T df8d897471684531826528a5751d6246 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:12.497174  2118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc33c7c3cfd14ab7a99e39cfd971fc3c" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:12.497203  2236 leader_election.cc:304] T df8d897471684531826528a5751d6246 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b6e57d59e4468ebe4423d871a31b39; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea
W20260709 13:12:12.499804  2310 leader_election.cc:343] T 78734884e0a441759b51d258ad2697aa P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:12.497215  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78734884e0a441759b51d258ad2697aa" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:12.500900  2617 raft_consensus.cc:2749] T df8d897471684531826528a5751d6246 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:12.500862  2270 raft_consensus.cc:3060] T 78734884e0a441759b51d258ad2697aa P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:12.503350  2162 leader_election.cc:304] T bc42d18a324e4f6d97f07cf770c5daa8 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea
I20260709 13:12:12.504132  2688 raft_consensus.cc:2749] T bc42d18a324e4f6d97f07cf770c5daa8 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:12:12.503628  2581 consensus_queue.cc:1048] T 8b65903ab966485c9c65bdfbdf1e1054 P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
W20260709 13:12:12.506546  2162 leader_election.cc:343] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:12.508064  2162 consensus_peers.cc:597] T 7e3782f3d54b4a19bacbd125c31127a9 P 0ec6a5d1452a41bd992a8c7922473b35 -> Peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Couldn't send request to peer 79b6e57d59e4468ebe4423d871a31b39. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:12.509169  2581 consensus_queue.cc:1048] T 7e3782f3d54b4a19bacbd125c31127a9 P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:12.510304  2588 raft_consensus.cc:515] T f9934bcaed6743b2a30104e13b8cf18b P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:12.512275  2588 leader_election.cc:290] T f9934bcaed6743b2a30104e13b8cf18b P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 election: Requested vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:12.467476  2593 raft_consensus.cc:515] T 28f2272230d34efa880d5eeed8859669 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:12.508926  2162 leader_election.cc:304] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:12.534636  2593 leader_election.cc:290] T 28f2272230d34efa880d5eeed8859669 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:12.528311  2588 raft_consensus.cc:2804] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:12.535475  2691 raft_consensus.cc:515] T d2f88787abb54ffea037f35cf48b22c4 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:12.536021  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f2272230d34efa880d5eeed8859669" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:12.536098  2588 raft_consensus.cc:493] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:12.537354  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9934bcaed6743b2a30104e13b8cf18b" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:12.536963  2270 raft_consensus.cc:2468] T 78734884e0a441759b51d258ad2697aa P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 1.
I20260709 13:12:12.528198  2519 raft_consensus.cc:493] T e5bbfa12bce4430fa6e7e6abd281ded6 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.543715  2588 raft_consensus.cc:3060] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:12.572235  2162 leader_election.cc:343] T f9934bcaed6743b2a30104e13b8cf18b P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:12.585212  2393 tablet_bootstrap.cc:492] T 38d5e9a8f42c4a2993d25a8a341fddbf P 0ec6a5d1452a41bd992a8c7922473b35: No bootstrap required, opened a new log
I20260709 13:12:12.562122  2519 raft_consensus.cc:515] T e5bbfa12bce4430fa6e7e6abd281ded6 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:12.585739  2393 ts_tablet_manager.cc:1403] T 38d5e9a8f42c4a2993d25a8a341fddbf P 0ec6a5d1452a41bd992a8c7922473b35: Time spent bootstrapping tablet: real 0.270s	user 0.020s	sys 0.027s
I20260709 13:12:12.603385  2310 leader_election.cc:304] T 78734884e0a441759b51d258ad2697aa P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39; no voters: 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:12.606508  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f2272230d34efa880d5eeed8859669" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:12.608711  2392 tablet_bootstrap.cc:654] T 583390912c6d4daca2df9b5534fb8dca P 66e9a8fffd4b4e5a81ca4fa2762773ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:12.597404  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9934bcaed6743b2a30104e13b8cf18b" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:12.621438  2391 tablet_bootstrap.cc:492] T 78734884e0a441759b51d258ad2697aa P 2ac5c5682f914ed9b9982b5a080d5472: No bootstrap required, opened a new log
I20260709 13:12:12.621971  2391 ts_tablet_manager.cc:1403] T 78734884e0a441759b51d258ad2697aa P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.312s	user 0.022s	sys 0.008s
I20260709 13:12:12.618289  2649 raft_consensus.cc:2804] T 78734884e0a441759b51d258ad2697aa P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:12.627157  2649 raft_consensus.cc:697] T 78734884e0a441759b51d258ad2697aa P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 LEADER]: Becoming Leader. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Running, Role: LEADER
I20260709 13:12:12.628054  2649 consensus_queue.cc:237] T 78734884e0a441759b51d258ad2697aa P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:12.638211  2402 tablet_bootstrap.cc:654] T a9be6d55d1f348bcaf96405abc80244d P 79b6e57d59e4468ebe4423d871a31b39: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:12.624670  2346 raft_consensus.cc:3060] T f9934bcaed6743b2a30104e13b8cf18b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:12.645263  2391 raft_consensus.cc:359] T 78734884e0a441759b51d258ad2697aa P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:12.646322  2391 raft_consensus.cc:385] T 78734884e0a441759b51d258ad2697aa P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:12.646649  2391 raft_consensus.cc:740] T 78734884e0a441759b51d258ad2697aa P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:12.647380  2391 consensus_queue.cc:260] T 78734884e0a441759b51d258ad2697aa P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:12.649478  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f88787abb54ffea037f35cf48b22c4" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:12.654244  2118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f88787abb54ffea037f35cf48b22c4" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:12.655007  2118 raft_consensus.cc:3060] T d2f88787abb54ffea037f35cf48b22c4 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:12.660490  2586 raft_consensus.cc:493] T ee1baa7401cd48e48e7125dcd607f44f P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.662758  2586 raft_consensus.cc:515] T ee1baa7401cd48e48e7125dcd607f44f P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:12.637272  2691 leader_election.cc:290] T d2f88787abb54ffea037f35cf48b22c4 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 election: Requested vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:12.664876  2401 consensus_queue.cc:1048] T e5bbfa12bce4430fa6e7e6abd281ded6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:12.666249  2118 raft_consensus.cc:2468] T d2f88787abb54ffea037f35cf48b22c4 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 1.
I20260709 13:12:12.644416  2087 leader_election.cc:304] T 28f2272230d34efa880d5eeed8859669 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472; no voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:12.669463  2647 raft_consensus.cc:515] T ddf48e4f6be64627a0ed06d6198ca054 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:12.675707  2588 raft_consensus.cc:515] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:12.678839  2593 raft_consensus.cc:2749] T 28f2272230d34efa880d5eeed8859669 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:12.736526  2162 leader_election.cc:343] T d2f88787abb54ffea037f35cf48b22c4 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:12.742976  2647 leader_election.cc:290] T ddf48e4f6be64627a0ed06d6198ca054 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 election: Requested vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:12.744093  2391 ts_tablet_manager.cc:1434] T 78734884e0a441759b51d258ad2697aa P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.122s	user 0.015s	sys 0.006s
I20260709 13:12:12.745112  2391 tablet_bootstrap.cc:492] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:12.745810  2588 leader_election.cc:290] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 election: Requested vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:12.747306  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc33c7c3cfd14ab7a99e39cfd971fc3c" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:12.747829  2162 leader_election.cc:304] T d2f88787abb54ffea037f35cf48b22c4 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472; no voters: 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:12.747900  2343 raft_consensus.cc:3060] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:12.749660  2122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddf48e4f6be64627a0ed06d6198ca054" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:12.750250  2122 raft_consensus.cc:3060] T ddf48e4f6be64627a0ed06d6198ca054 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:12.750339  2647 raft_consensus.cc:2804] T d2f88787abb54ffea037f35cf48b22c4 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:12.750953  2647 raft_consensus.cc:697] T d2f88787abb54ffea037f35cf48b22c4 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 LEADER]: Becoming Leader. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Running, Role: LEADER
I20260709 13:12:12.751478  2519 leader_election.cc:290] T e5bbfa12bce4430fa6e7e6abd281ded6 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:12.751726  2647 consensus_queue.cc:237] T d2f88787abb54ffea037f35cf48b22c4 P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:12.753880  2586 leader_election.cc:290] T ee1baa7401cd48e48e7125dcd607f44f P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:12.758005  2195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee1baa7401cd48e48e7125dcd607f44f" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:12.759307  2393 raft_consensus.cc:359] T 38d5e9a8f42c4a2993d25a8a341fddbf P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:12.759965  2393 raft_consensus.cc:385] T 38d5e9a8f42c4a2993d25a8a341fddbf P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:12.760592  2393 raft_consensus.cc:740] T 38d5e9a8f42c4a2993d25a8a341fddbf P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Initialized, Role: FOLLOWER
I20260709 13:12:12.761775  2271 raft_consensus.cc:3060] T e5bbfa12bce4430fa6e7e6abd281ded6 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:12.761250  2393 consensus_queue.cc:260] T 38d5e9a8f42c4a2993d25a8a341fddbf P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:12.803646  2393 ts_tablet_manager.cc:1434] T 38d5e9a8f42c4a2993d25a8a341fddbf P 0ec6a5d1452a41bd992a8c7922473b35: Time spent starting tablet: real 0.217s	user 0.006s	sys 0.000s
I20260709 13:12:12.805060  2346 raft_consensus.cc:2468] T f9934bcaed6743b2a30104e13b8cf18b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 1.
I20260709 13:12:12.808413  2392 tablet_bootstrap.cc:492] T 583390912c6d4daca2df9b5534fb8dca P 66e9a8fffd4b4e5a81ca4fa2762773ea: No bootstrap required, opened a new log
I20260709 13:12:12.808972  2392 ts_tablet_manager.cc:1403] T 583390912c6d4daca2df9b5534fb8dca P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent bootstrapping tablet: real 0.371s	user 0.009s	sys 0.028s
I20260709 13:12:12.809968  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddf48e4f6be64627a0ed06d6198ca054" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:12.810566  2272 raft_consensus.cc:3060] T ddf48e4f6be64627a0ed06d6198ca054 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:12.815536  2588 raft_consensus.cc:493] T 38d5e9a8f42c4a2993d25a8a341fddbf P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:12.816206  2588 raft_consensus.cc:515] T 38d5e9a8f42c4a2993d25a8a341fddbf P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:12.839970  2402 tablet_bootstrap.cc:492] T a9be6d55d1f348bcaf96405abc80244d P 79b6e57d59e4468ebe4423d871a31b39: No bootstrap required, opened a new log
I20260709 13:12:12.840498  2402 ts_tablet_manager.cc:1403] T a9be6d55d1f348bcaf96405abc80244d P 79b6e57d59e4468ebe4423d871a31b39: Time spent bootstrapping tablet: real 0.402s	user 0.013s	sys 0.012s
I20260709 13:12:12.842891  2588 leader_election.cc:290] T 38d5e9a8f42c4a2993d25a8a341fddbf P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:12.843724  2402 raft_consensus.cc:359] T a9be6d55d1f348bcaf96405abc80244d P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:12.844233  2402 raft_consensus.cc:385] T a9be6d55d1f348bcaf96405abc80244d P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:12.844441  2402 raft_consensus.cc:740] T a9be6d55d1f348bcaf96405abc80244d P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Initialized, Role: FOLLOWER
I20260709 13:12:12.844919  2402 consensus_queue.cc:260] T a9be6d55d1f348bcaf96405abc80244d P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:12.847071  2392 raft_consensus.cc:359] T 583390912c6d4daca2df9b5534fb8dca P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:12.848615  2343 raft_consensus.cc:2468] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 1.
I20260709 13:12:12.852746  2392 raft_consensus.cc:385] T 583390912c6d4daca2df9b5534fb8dca P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:12.853091  2392 raft_consensus.cc:740] T 583390912c6d4daca2df9b5534fb8dca P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:12.852415  2391 tablet_bootstrap.cc:654] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:12.853716  2392 consensus_queue.cc:260] T 583390912c6d4daca2df9b5534fb8dca P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:12.855571  2392 ts_tablet_manager.cc:1434] T 583390912c6d4daca2df9b5534fb8dca P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.000s
I20260709 13:12:12.856535  2392 tablet_bootstrap.cc:492] T a332070dcdff450b939e74ef5b68425a P 66e9a8fffd4b4e5a81ca4fa2762773ea: Bootstrap starting.
I20260709 13:12:12.857174  2402 ts_tablet_manager.cc:1434] T a9be6d55d1f348bcaf96405abc80244d P 79b6e57d59e4468ebe4423d871a31b39: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:12:12.858115  2402 tablet_bootstrap.cc:492] T 7e3782f3d54b4a19bacbd125c31127a9 P 79b6e57d59e4468ebe4423d871a31b39: Bootstrap starting.
I20260709 13:12:12.865844  2391 tablet_bootstrap.cc:492] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472: No bootstrap required, opened a new log
I20260709 13:12:12.866169  2402 tablet_bootstrap.cc:654] T 7e3782f3d54b4a19bacbd125c31127a9 P 79b6e57d59e4468ebe4423d871a31b39: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:12.866389  2391 ts_tablet_manager.cc:1403] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.121s	user 0.007s	sys 0.009s
I20260709 13:12:12.885047  2391 raft_consensus.cc:359] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:12.885737  2391 raft_consensus.cc:385] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:12.886020  2391 raft_consensus.cc:740] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:12.886716  2392 tablet_bootstrap.cc:654] T a332070dcdff450b939e74ef5b68425a P 66e9a8fffd4b4e5a81ca4fa2762773ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:12.886632  2391 consensus_queue.cc:260] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:12.898882  2391 ts_tablet_manager.cc:1434] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.032s	user 0.003s	sys 0.004s
I20260709 13:12:12.899991  2391 tablet_bootstrap.cc:492] T 6bf4f728eedf41bdb027f554c3a5ae1f P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:13.239459  2593 raft_consensus.cc:493] T 78734884e0a441759b51d258ad2697aa P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:13.240135  2593 raft_consensus.cc:515] T 78734884e0a441759b51d258ad2697aa P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:13.297134  2593 leader_election.cc:290] T 78734884e0a441759b51d258ad2697aa P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
W20260709 13:12:14.300423  2293 debug-util.cc:398] Leaking SignalData structure 0x7b08003478a0 after lost signal to thread 28892
I20260709 13:12:14.339289  2714 raft_consensus.cc:493] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b6e57d59e4468ebe4423d871a31b39)
I20260709 13:12:14.340040  2714 raft_consensus.cc:515] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:14.342221  2714 leader_election.cc:290] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:14.486120  2714 raft_consensus.cc:493] T a0394490f6984f028daa10be921e242b P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b6e57d59e4468ebe4423d871a31b39)
I20260709 13:12:14.486776  2714 raft_consensus.cc:515] T a0394490f6984f028daa10be921e242b P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:14.429930  2715 raft_consensus.cc:493] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b6e57d59e4468ebe4423d871a31b39)
I20260709 13:12:14.490134  2715 raft_consensus.cc:515] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:14.492359  2715 leader_election.cc:290] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:14.492930  2715 raft_consensus.cc:493] T 36b22aafe7104cec82607dab40b4aed8 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66e9a8fffd4b4e5a81ca4fa2762773ea)
I20260709 13:12:14.493867  2715 raft_consensus.cc:515] T 36b22aafe7104cec82607dab40b4aed8 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:14.610213  2715 leader_election.cc:290] T 36b22aafe7104cec82607dab40b4aed8 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
W20260709 13:12:14.548744  2238 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.741s	user 0.000s	sys 0.049s
W20260709 13:12:14.612250  2238 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.804s	user 0.000s	sys 0.049s
I20260709 13:12:14.612254  2718 raft_consensus.cc:493] T 7e716da7cd3d4ad390e049dc845b8004 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66e9a8fffd4b4e5a81ca4fa2762773ea)
I20260709 13:12:14.637580  2718 raft_consensus.cc:515] T 7e716da7cd3d4ad390e049dc845b8004 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:14.639933  2718 leader_election.cc:290] T 7e716da7cd3d4ad390e049dc845b8004 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:14.650322  2718 raft_consensus.cc:493] T 8a672ef15abf47e4b650405c29044d3e P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66e9a8fffd4b4e5a81ca4fa2762773ea)
I20260709 13:12:14.592187  2714 leader_election.cc:290] T a0394490f6984f028daa10be921e242b P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:14.680341  2586 raft_consensus.cc:493] T 7e3782f3d54b4a19bacbd125c31127a9 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec6a5d1452a41bd992a8c7922473b35)
I20260709 13:12:14.680764  2714 raft_consensus.cc:493] T 2e178ff57d964223aca095ceff76b339 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66e9a8fffd4b4e5a81ca4fa2762773ea)
I20260709 13:12:14.658969  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78734884e0a441759b51d258ad2697aa" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:14.680428  2617 raft_consensus.cc:493] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.661135  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e259bf23e7904d9fb8b2345bb5b667f3" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:14.681560  2617 raft_consensus.cc:515] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:14.662052  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0394490f6984f028daa10be921e242b" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:14.581635  2451 raft_consensus.cc:493] T 427b10072083419c89d5a4bf5d6413fc P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66e9a8fffd4b4e5a81ca4fa2762773ea)
I20260709 13:12:14.683763  2617 leader_election.cc:290] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:14.681703  2269 raft_consensus.cc:2393] T 78734884e0a441759b51d258ad2697aa P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ac5c5682f914ed9b9982b5a080d5472 in current term 1: Already voted for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in this term.
I20260709 13:12:14.684443  2617 raft_consensus.cc:493] T 427b10072083419c89d5a4bf5d6413fc P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66e9a8fffd4b4e5a81ca4fa2762773ea)
I20260709 13:12:14.683797  2451 raft_consensus.cc:515] T 427b10072083419c89d5a4bf5d6413fc P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
W20260709 13:12:14.517665  2087 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.28.54.68:38869 timed out after 1.737s (SENT)
I20260709 13:12:14.678311  2720 raft_consensus.cc:493] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66e9a8fffd4b4e5a81ca4fa2762773ea)
I20260709 13:12:14.685161  2617 raft_consensus.cc:515] T 427b10072083419c89d5a4bf5d6413fc P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:14.686884  2720 raft_consensus.cc:515] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:14.688064  2451 leader_election.cc:290] T 427b10072083419c89d5a4bf5d6413fc P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:14.681241  2586 raft_consensus.cc:515] T 7e3782f3d54b4a19bacbd125c31127a9 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:14.691107  2718 raft_consensus.cc:515] T 8a672ef15abf47e4b650405c29044d3e P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:14.689167  2720 leader_election.cc:290] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:14.679970  2198 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:47488 (request call id 61) took 2012 ms. Trace:
I20260709 13:12:14.695282  2198 rpcz_store.cc:276] 0709 13:12:12.667653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:12.667797 (+   144us) service_pool.cc:224] Handling call
0709 13:12:12.668084 (+   287us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 13:12:12.668423 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 13:12:12.668453 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 13:12:12.668872 (+   419us) log.cc:844] Serialized 26 byte log entry
0709 13:12:12.766578 (+ 97706us) raft_consensus.cc:1645] Marking committed up to 0
0709 13:12:12.766602 (+    24us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:12.766645 (+    43us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 13:12:14.679717 (+1913072us) raft_consensus.cc:1685] finished
0709 13:12:14.679739 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 13:12:14.679907 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":978,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"thread_start_us":97443,"threads_started":1,"wal-append.queue_time_us":160286,"wal-append.run_cpu_time_us":1680,"wal-append.run_wall_time_us":1008398}
I20260709 13:12:14.688148  2617 leader_election.cc:290] T 427b10072083419c89d5a4bf5d6413fc P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:14.685113  2714 raft_consensus.cc:515] T 2e178ff57d964223aca095ceff76b339 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:14.698938  2718 leader_election.cc:290] T 8a672ef15abf47e4b650405c29044d3e P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:14.702010  2715 raft_consensus.cc:493] T 12b5593f051548fea374da76afa08c3f P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec6a5d1452a41bd992a8c7922473b35)
I20260709 13:12:14.698850  2714 leader_election.cc:290] T 2e178ff57d964223aca095ceff76b339 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:14.711292  2715 raft_consensus.cc:515] T 12b5593f051548fea374da76afa08c3f P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:14.713565  2715 leader_election.cc:290] T 12b5593f051548fea374da76afa08c3f P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:14.696539  2391 tablet_bootstrap.cc:654] T 6bf4f728eedf41bdb027f554c3a5ae1f P 2ac5c5682f914ed9b9982b5a080d5472: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:14.721478  2120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc33c7c3cfd14ab7a99e39cfd971fc3c" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:14.722748  2714 raft_consensus.cc:493] T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b6e57d59e4468ebe4423d871a31b39)
I20260709 13:12:14.723311  2714 raft_consensus.cc:515] T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:14.725214  2714 leader_election.cc:290] T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:14.725716  2714 raft_consensus.cc:493] T d3370eb67fff4896b1f8e3ce56eceb9b P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec6a5d1452a41bd992a8c7922473b35)
I20260709 13:12:14.725968  2391 tablet_bootstrap.cc:492] T 6bf4f728eedf41bdb027f554c3a5ae1f P 2ac5c5682f914ed9b9982b5a080d5472: No bootstrap required, opened a new log
I20260709 13:12:14.726534  2391 ts_tablet_manager.cc:1403] T 6bf4f728eedf41bdb027f554c3a5ae1f P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 1.827s	user 0.017s	sys 0.015s
I20260709 13:12:14.726276  2714 raft_consensus.cc:515] T d3370eb67fff4896b1f8e3ce56eceb9b P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:14.728300  2714 leader_election.cc:290] T d3370eb67fff4896b1f8e3ce56eceb9b P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:14.728807  2714 raft_consensus.cc:493] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.729260  2714 raft_consensus.cc:515] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:14.729390  2391 raft_consensus.cc:359] T 6bf4f728eedf41bdb027f554c3a5ae1f P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:14.729952  2590 raft_consensus.cc:493] T 28f2272230d34efa880d5eeed8859669 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b6e57d59e4468ebe4423d871a31b39)
I20260709 13:12:14.730171  2391 raft_consensus.cc:385] T 6bf4f728eedf41bdb027f554c3a5ae1f P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:14.730510  2391 raft_consensus.cc:740] T 6bf4f728eedf41bdb027f554c3a5ae1f P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:14.730594  2590 raft_consensus.cc:515] T 28f2272230d34efa880d5eeed8859669 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:14.731159  2714 leader_election.cc:290] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:14.731184  2391 consensus_queue.cc:260] T 6bf4f728eedf41bdb027f554c3a5ae1f P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:14.692045  2586 leader_election.cc:290] T 7e3782f3d54b4a19bacbd125c31127a9 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:14.738564  2391 ts_tablet_manager.cc:1434] T 6bf4f728eedf41bdb027f554c3a5ae1f P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 13:12:14.740605  2391 tablet_bootstrap.cc:492] T 622b6cfd76ff495ea6692a1ec0faefc4 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:14.746731  2726 raft_consensus.cc:493] T 7475d672f7b3489393d6202c8b31e47f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b6e57d59e4468ebe4423d871a31b39)
I20260709 13:12:14.747169  2726 raft_consensus.cc:515] T 7475d672f7b3489393d6202c8b31e47f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:14.748598  2726 leader_election.cc:290] T 7475d672f7b3489393d6202c8b31e47f P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:14.748950  2726 raft_consensus.cc:493] T 01a3c95e54104a998cdf16d06db2800a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b6e57d59e4468ebe4423d871a31b39)
I20260709 13:12:14.749377  2726 raft_consensus.cc:515] T 01a3c95e54104a998cdf16d06db2800a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:14.753629  2727 raft_consensus.cc:493] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b6e57d59e4468ebe4423d871a31b39)
I20260709 13:12:14.755617  2727 raft_consensus.cc:515] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
W20260709 13:12:14.787297  2087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:38869, user_credentials={real_user=slave}} blocked reactor thread for 269502us
W20260709 13:12:14.795141  2237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:38859, user_credentials={real_user=slave}} blocked reactor thread for 62507.7us
I20260709 13:12:14.795729  2162 leader_election.cc:304] T f9934bcaed6743b2a30104e13b8cf18b P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:14.804783  2590 leader_election.cc:290] T 28f2272230d34efa880d5eeed8859669 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:14.809134  2725 raft_consensus.cc:493] T 583390912c6d4daca2df9b5534fb8dca P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.819301  2720 raft_consensus.cc:493] T 2e178ff57d964223aca095ceff76b339 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66e9a8fffd4b4e5a81ca4fa2762773ea)
I20260709 13:12:14.817826  2730 raft_consensus.cc:493] T 28f2272230d34efa880d5eeed8859669 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b6e57d59e4468ebe4423d871a31b39)
I20260709 13:12:14.824020  2586 consensus_queue.cc:1048] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 13:12:14.825124  2720 raft_consensus.cc:515] T 2e178ff57d964223aca095ceff76b339 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:14.817924  2590 raft_consensus.cc:493] T 2993800f8e7e4c09bfe0b2be13e4394c P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79b6e57d59e4468ebe4423d871a31b39)
I20260709 13:12:14.829043  2720 leader_election.cc:290] T 2e178ff57d964223aca095ceff76b339 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:14.828657  2590 raft_consensus.cc:515] T 2993800f8e7e4c09bfe0b2be13e4394c P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:14.830596  2727 leader_election.cc:290] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:14.832729  2617 raft_consensus.cc:493] T a9be6d55d1f348bcaf96405abc80244d P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.830399  2725 raft_consensus.cc:515] T 583390912c6d4daca2df9b5534fb8dca P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:14.833947  2617 raft_consensus.cc:515] T a9be6d55d1f348bcaf96405abc80244d P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:14.835068  2718 raft_consensus.cc:493] T 5c3646d79bc840e9b4396f4351d1803d P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:14.833477  2727 raft_consensus.cc:493] T 2993800f8e7e4c09bfe0b2be13e4394c P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 79b6e57d59e4468ebe4423d871a31b39)
I20260709 13:12:14.836830  2617 leader_election.cc:290] T a9be6d55d1f348bcaf96405abc80244d P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:14.835824  2725 leader_election.cc:290] T 583390912c6d4daca2df9b5534fb8dca P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:14.831560  2730 raft_consensus.cc:515] T 28f2272230d34efa880d5eeed8859669 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:14.832711  2722 raft_consensus.cc:493] T 8b65903ab966485c9c65bdfbdf1e1054 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec6a5d1452a41bd992a8c7922473b35)
I20260709 13:12:14.836553  2727 raft_consensus.cc:515] T 2993800f8e7e4c09bfe0b2be13e4394c P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:14.831995  2590 leader_election.cc:290] T 2993800f8e7e4c09bfe0b2be13e4394c P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:14.756053  2726 leader_election.cc:290] T 01a3c95e54104a998cdf16d06db2800a P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:14.837656  2725 raft_consensus.cc:493] T 10de08c2346d47dbbd720596cd7e02fd P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.842274  2725 raft_consensus.cc:515] T 10de08c2346d47dbbd720596cd7e02fd P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:14.851650  2727 leader_election.cc:290] T 2993800f8e7e4c09bfe0b2be13e4394c P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:14.853888  2726 raft_consensus.cc:493] T b206de895e36490688cb2c1c537774a5 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.854765  2726 raft_consensus.cc:515] T b206de895e36490688cb2c1c537774a5 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:14.856544  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b10072083419c89d5a4bf5d6413fc" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:14.857892  2269 raft_consensus.cc:2468] T 427b10072083419c89d5a4bf5d6413fc P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 1.
I20260709 13:12:14.860378  2730 leader_election.cc:290] T 28f2272230d34efa880d5eeed8859669 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:14.861002  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e178ff57d964223aca095ceff76b339" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:14.861938  2268 raft_consensus.cc:2468] T 2e178ff57d964223aca095ceff76b339 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 1.
I20260709 13:12:14.862021  2722 raft_consensus.cc:515] T 8b65903ab966485c9c65bdfbdf1e1054 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:14.860407  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3782f3d54b4a19bacbd125c31127a9" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:14.865837  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86834d94d1d64596abfa609754b5d58a" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:14.867077  2725 leader_election.cc:290] T 10de08c2346d47dbbd720596cd7e02fd P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:14.867671  2725 raft_consensus.cc:493] T 765b8df93039426e925b94637a061cc2 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec6a5d1452a41bd992a8c7922473b35)
I20260709 13:12:14.868093  2722 leader_election.cc:290] T 8b65903ab966485c9c65bdfbdf1e1054 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:14.868299  2725 raft_consensus.cc:515] T 765b8df93039426e925b94637a061cc2 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:14.869117  2734 raft_consensus.cc:2804] T f9934bcaed6743b2a30104e13b8cf18b P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:14.869788  2734 raft_consensus.cc:697] T f9934bcaed6743b2a30104e13b8cf18b P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 LEADER]: Becoming Leader. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Running, Role: LEADER
I20260709 13:12:14.869840  2649 raft_consensus.cc:493] T bc42d18a324e4f6d97f07cf770c5daa8 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:14.871636  2734 consensus_queue.cc:237] T f9934bcaed6743b2a30104e13b8cf18b P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:14.872215  2649 raft_consensus.cc:515] T bc42d18a324e4f6d97f07cf770c5daa8 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:14.857532  2726 leader_election.cc:290] T b206de895e36490688cb2c1c537774a5 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:14.880043  2726 raft_consensus.cc:493] T a4a5ce298d24406ea94fb68aba5b37ae P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.844462  2590 raft_consensus.cc:493] T 12b5593f051548fea374da76afa08c3f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec6a5d1452a41bd992a8c7922473b35)
I20260709 13:12:14.882759  2590 raft_consensus.cc:515] T 12b5593f051548fea374da76afa08c3f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:14.881048  2726 raft_consensus.cc:515] T a4a5ce298d24406ea94fb68aba5b37ae P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:14.888713  2735 raft_consensus.cc:493] T 0668be6a554b4c5f8bf93d0588a6bfcc P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b6e57d59e4468ebe4423d871a31b39)
I20260709 13:12:14.896582  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f2272230d34efa880d5eeed8859669" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:14.897853  2120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7475d672f7b3489393d6202c8b31e47f" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:14.898872  2120 raft_consensus.cc:2468] T 7475d672f7b3489393d6202c8b31e47f P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 1.
I20260709 13:12:14.890837  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67db2f978ea64fbd9a32274d4ad374c9" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:14.866282  2732 raft_consensus.cc:493] T e259bf23e7904d9fb8b2345bb5b667f3 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b6e57d59e4468ebe4423d871a31b39)
I20260709 13:12:14.894989  2725 leader_election.cc:290] T 765b8df93039426e925b94637a061cc2 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:14.895923  2123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f2272230d34efa880d5eeed8859669" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:14.885707  2590 leader_election.cc:290] T 12b5593f051548fea374da76afa08c3f P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:14.835929  2718 raft_consensus.cc:515] T 5c3646d79bc840e9b4396f4351d1803d P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:14.896479  2118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583390912c6d4daca2df9b5534fb8dca" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:14.906442  2725 raft_consensus.cc:493] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:14.910293  2123 raft_consensus.cc:2468] T 28f2272230d34efa880d5eeed8859669 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 1.
I20260709 13:12:14.911635  2617 raft_consensus.cc:493] T 56bba8336a054d969e18859a84f180d6 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:14.911484  2725 raft_consensus.cc:515] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:14.912755  2617 raft_consensus.cc:515] T 56bba8336a054d969e18859a84f180d6 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:14.914498  2725 leader_election.cc:290] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:14.915125  2725 raft_consensus.cc:493] T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:14.915410  2617 leader_election.cc:290] T 56bba8336a054d969e18859a84f180d6 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:14.916088  2617 raft_consensus.cc:493] T 5aac56f958fb4fe29fe46d2a9be60ffd P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec6a5d1452a41bd992a8c7922473b35)
I20260709 13:12:14.915938  2725 raft_consensus.cc:515] T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:14.916747  2726 leader_election.cc:290] T a4a5ce298d24406ea94fb68aba5b37ae P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:14.916822  2617 raft_consensus.cc:515] T 5aac56f958fb4fe29fe46d2a9be60ffd P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:14.917392  2726 raft_consensus.cc:493] T a0394490f6984f028daa10be921e242b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b6e57d59e4468ebe4423d871a31b39)
I20260709 13:12:14.918306  2725 leader_election.cc:290] T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:14.918139  2726 raft_consensus.cc:515] T a0394490f6984f028daa10be921e242b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
W20260709 13:12:14.919939  2162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:38869, user_credentials={real_user=slave}} blocked reactor thread for 124767us
I20260709 13:12:14.923151  2617 leader_election.cc:290] T 5aac56f958fb4fe29fe46d2a9be60ffd P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:14.945864  2391 tablet_bootstrap.cc:654] T 622b6cfd76ff495ea6692a1ec0faefc4 P 2ac5c5682f914ed9b9982b5a080d5472: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:14.930137  2087 leader_election.cc:304] T 427b10072083419c89d5a4bf5d6413fc P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:14.919780  2590 raft_consensus.cc:493] T 86834d94d1d64596abfa609754b5d58a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b6e57d59e4468ebe4423d871a31b39)
I20260709 13:12:14.900588  2735 raft_consensus.cc:515] T 0668be6a554b4c5f8bf93d0588a6bfcc P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
W20260709 13:12:14.945541  2271 consensus_meta.cc:287] T e5bbfa12bce4430fa6e7e6abd281ded6 P 79b6e57d59e4468ebe4423d871a31b39: Time spent flushing consensus metadata: real 2.183s	user 0.015s	sys 0.019s
I20260709 13:12:14.957901  2271 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:40692 (request call id 59) took 2220 ms. Trace:
I20260709 13:12:14.952219  2118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b206de895e36490688cb2c1c537774a5" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:14.955226  2162 leader_election.cc:304] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:14.958581  2649 leader_election.cc:290] T bc42d18a324e4f6d97f07cf770c5daa8 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:14.960646  2271 rpcz_store.cc:276] 0709 13:12:12.760518 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:12.761294 (+   776us) service_pool.cc:224] Handling call
0709 13:12:12.761629 (+   335us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 13:12:14.957488 (+2195859us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 13:12:14.957819 (+   331us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:14.962050  2590 raft_consensus.cc:515] T 86834d94d1d64596abfa609754b5d58a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:14.962538  2743 raft_consensus.cc:493] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66e9a8fffd4b4e5a81ca4fa2762773ea)
I20260709 13:12:14.972743  2649 raft_consensus.cc:493] T 56bba8336a054d969e18859a84f180d6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:14.962641  2740 raft_consensus.cc:493] T 8a672ef15abf47e4b650405c29044d3e P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66e9a8fffd4b4e5a81ca4fa2762773ea)
I20260709 13:12:14.979466  2087 leader_election.cc:304] T 2e178ff57d964223aca095ceff76b339 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:14.980453  2725 raft_consensus.cc:493] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.925134  2732 raft_consensus.cc:515] T e259bf23e7904d9fb8b2345bb5b667f3 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:14.982862  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7475d672f7b3489393d6202c8b31e47f" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:14.983767  2738 raft_consensus.cc:493] T 0bd8fc2d57c14adeaeae16583eef7c84 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.984916  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f2272230d34efa880d5eeed8859669" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:14.985767  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2993800f8e7e4c09bfe0b2be13e4394c" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:14.986460  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b206de895e36490688cb2c1c537774a5" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:14.986694  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a3c95e54104a998cdf16d06db2800a" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:14.962342  2737 raft_consensus.cc:493] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:14.962442  2744 raft_consensus.cc:493] T 1478f883c539464bb54fe9bff44148d5 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b6e57d59e4468ebe4423d871a31b39)
I20260709 13:12:14.991904  2734 raft_consensus.cc:493] T bdee3fd7553a47afae3ec9dbdce6d829 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b6e57d59e4468ebe4423d871a31b39)
I20260709 13:12:14.992086  2725 raft_consensus.cc:515] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:14.992632  2734 raft_consensus.cc:515] T bdee3fd7553a47afae3ec9dbdce6d829 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:14.993175  2744 raft_consensus.cc:515] T 1478f883c539464bb54fe9bff44148d5 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
W20260709 13:12:14.994511  2122 consensus_meta.cc:287] T ddf48e4f6be64627a0ed06d6198ca054 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent flushing consensus metadata: real 2.244s	user 0.022s	sys 0.039s
I20260709 13:12:14.994977  2122 raft_consensus.cc:2468] T ddf48e4f6be64627a0ed06d6198ca054 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 1.
I20260709 13:12:14.995464  2726 leader_election.cc:290] T a0394490f6984f028daa10be921e242b P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
W20260709 13:12:14.995707  2122 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:54038 (request call id 45) took 2246 ms (client timeout 2003 ms). Trace:
W20260709 13:12:14.996201  2122 rpcz_store.cc:269] 0709 13:12:12.749340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:12.749445 (+   105us) service_pool.cc:224] Handling call
0709 13:12:14.995617 (+2246172us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:14.996701  2737 raft_consensus.cc:515] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:14.985580  2736 raft_consensus.cc:493] T f9934bcaed6743b2a30104e13b8cf18b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:14.998940  2736 raft_consensus.cc:515] T f9934bcaed6743b2a30104e13b8cf18b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:14.999387  2737 leader_election.cc:290] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:15.000098  2737 raft_consensus.cc:493] T d7a50365dcc843f4a4f6bfb29a736f26 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:15.000712  2737 raft_consensus.cc:515] T d7a50365dcc843f4a4f6bfb29a736f26 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:15.001077  2581 raft_consensus.cc:2804] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:14.989766  2746 raft_consensus.cc:493] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec6a5d1452a41bd992a8c7922473b35)
I20260709 13:12:15.001976  2688 raft_consensus.cc:493] T bc42d18a324e4f6d97f07cf770c5daa8 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.002168  2730 raft_consensus.cc:2804] T 427b10072083419c89d5a4bf5d6413fc P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:15.002602  2730 raft_consensus.cc:493] T 427b10072083419c89d5a4bf5d6413fc P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 66e9a8fffd4b4e5a81ca4fa2762773ea)
I20260709 13:12:15.003026  2730 raft_consensus.cc:3060] T 427b10072083419c89d5a4bf5d6413fc P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:14.994783  2734 leader_election.cc:290] T bdee3fd7553a47afae3ec9dbdce6d829 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:15.010617  2747 raft_consensus.cc:493] T b3b82132c31545aab274c7cf3f77c277 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:14.994419  2725 leader_election.cc:290] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:15.010907  2743 raft_consensus.cc:515] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:15.007085  2746 raft_consensus.cc:515] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:15.012101  2740 raft_consensus.cc:515] T 8a672ef15abf47e4b650405c29044d3e P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:14.985507  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583390912c6d4daca2df9b5534fb8dca" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:15.012964  2742 raft_consensus.cc:493] T a9be6d55d1f348bcaf96405abc80244d P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.012822  2649 raft_consensus.cc:515] T 56bba8336a054d969e18859a84f180d6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:15.013857  2735 leader_election.cc:290] T 0668be6a554b4c5f8bf93d0588a6bfcc P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:15.008693  2737 leader_election.cc:290] T d7a50365dcc843f4a4f6bfb29a736f26 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:15.001667  2581 raft_consensus.cc:697] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 LEADER]: Becoming Leader. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Running, Role: LEADER
I20260709 13:12:15.011701  2726 raft_consensus.cc:493] T bdee3fd7553a47afae3ec9dbdce6d829 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b6e57d59e4468ebe4423d871a31b39)
I20260709 13:12:14.995652  2744 leader_election.cc:290] T 1478f883c539464bb54fe9bff44148d5 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:15.001250  2736 leader_election.cc:290] T f9934bcaed6743b2a30104e13b8cf18b P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:15.037964  2737 raft_consensus.cc:493] T f2a1307186df4616a9759118c2e456a6 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66e9a8fffd4b4e5a81ca4fa2762773ea)
I20260709 13:12:15.038785  2737 raft_consensus.cc:515] T f2a1307186df4616a9759118c2e456a6 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:15.041196  2737 leader_election.cc:290] T f2a1307186df4616a9759118c2e456a6 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:15.041793  2451 raft_consensus.cc:2804] T 2e178ff57d964223aca095ceff76b339 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:15.002619  2688 raft_consensus.cc:515] T bc42d18a324e4f6d97f07cf770c5daa8 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:15.042307  2451 raft_consensus.cc:493] T 2e178ff57d964223aca095ceff76b339 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 66e9a8fffd4b4e5a81ca4fa2762773ea)
I20260709 13:12:15.042778  2451 raft_consensus.cc:3060] T 2e178ff57d964223aca095ceff76b339 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.043282  2743 leader_election.cc:290] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:15.043813  2743 raft_consensus.cc:493] T 67db2f978ea64fbd9a32274d4ad374c9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b6e57d59e4468ebe4423d871a31b39)
I20260709 13:12:15.044160  2688 leader_election.cc:290] T bc42d18a324e4f6d97f07cf770c5daa8 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:15.044399  2743 raft_consensus.cc:515] T 67db2f978ea64fbd9a32274d4ad374c9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:15.047324  2746 leader_election.cc:290] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
W20260709 13:12:15.049064  2272 consensus_meta.cc:287] T ddf48e4f6be64627a0ed06d6198ca054 P 79b6e57d59e4468ebe4423d871a31b39: Time spent flushing consensus metadata: real 2.238s	user 0.013s	sys 0.023s
I20260709 13:12:15.036744  2735 raft_consensus.cc:493] T 5aac56f958fb4fe29fe46d2a9be60ffd P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec6a5d1452a41bd992a8c7922473b35)
W20260709 13:12:15.050208  2310 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:34303, user_credentials={real_user=slave}} blocked reactor thread for 95204.8us
I20260709 13:12:15.051847  2310 leader_election.cc:304] T 28f2272230d34efa880d5eeed8859669 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
W20260709 13:12:15.052924  2310 leader_election.cc:343] T 583390912c6d4daca2df9b5534fb8dca P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:15.025964  2748 raft_consensus.cc:493] T d3370eb67fff4896b1f8e3ce56eceb9b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec6a5d1452a41bd992a8c7922473b35)
I20260709 13:12:15.037806  2744 raft_consensus.cc:493] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b6e57d59e4468ebe4423d871a31b39)
I20260709 13:12:15.055881  2744 raft_consensus.cc:515] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:15.056643  2581 consensus_queue.cc:237] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:15.054355  2748 raft_consensus.cc:515] T d3370eb67fff4896b1f8e3ce56eceb9b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
W20260709 13:12:15.061061  2162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:38869, user_credentials={real_user=slave}} blocked reactor thread for 110310us
I20260709 13:12:15.023540  2725 raft_consensus.cc:493] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:15.064656  2757 raft_consensus.cc:2804] T 28f2272230d34efa880d5eeed8859669 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:15.065018  2757 raft_consensus.cc:493] T 28f2272230d34efa880d5eeed8859669 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79b6e57d59e4468ebe4423d871a31b39)
I20260709 13:12:15.065294  2757 raft_consensus.cc:3060] T 28f2272230d34efa880d5eeed8859669 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.053714  2310 leader_election.cc:304] T 7475d672f7b3489393d6202c8b31e47f P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:15.049386  2740 leader_election.cc:290] T 8a672ef15abf47e4b650405c29044d3e P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:15.010684  2738 raft_consensus.cc:515] T 0bd8fc2d57c14adeaeae16583eef7c84 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:15.049480  2272 raft_consensus.cc:2468] T ddf48e4f6be64627a0ed06d6198ca054 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 1.
I20260709 13:12:15.070536  2726 raft_consensus.cc:515] T bdee3fd7553a47afae3ec9dbdce6d829 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:15.071103  2720 raft_consensus.cc:493] T ddf48e4f6be64627a0ed06d6198ca054 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.071636  2720 raft_consensus.cc:515] T ddf48e4f6be64627a0ed06d6198ca054 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:15.050050  2747 raft_consensus.cc:515] T b3b82132c31545aab274c7cf3f77c277 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:15.075722  2586 raft_consensus.cc:493] T d2f88787abb54ffea037f35cf48b22c4 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.075887  2738 leader_election.cc:290] T 0bd8fc2d57c14adeaeae16583eef7c84 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:15.076483  2586 raft_consensus.cc:515] T d2f88787abb54ffea037f35cf48b22c4 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:15.077989  2747 leader_election.cc:290] T b3b82132c31545aab274c7cf3f77c277 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:15.078680  2735 raft_consensus.cc:515] T 5aac56f958fb4fe29fe46d2a9be60ffd P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:15.081228  2735 leader_election.cc:290] T 5aac56f958fb4fe29fe46d2a9be60ffd P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
W20260709 13:12:15.076817  2272 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:40674 (request call id 33) took 2305 ms (client timeout 2003 ms). Trace:
W20260709 13:12:15.066182  2087 leader_election.cc:343] T 7e3782f3d54b4a19bacbd125c31127a9 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:15.082096  2732 leader_election.cc:290] T e259bf23e7904d9fb8b2345bb5b667f3 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:15.083036  2714 raft_consensus.cc:493] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.083606  2726 leader_election.cc:290] T bdee3fd7553a47afae3ec9dbdce6d829 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
W20260709 13:12:15.081925  2272 rpcz_store.cc:269] 0709 13:12:12.771675 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:12.775424 (+  3749us) service_pool.cc:224] Handling call
0709 13:12:15.076667 (+2301243us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 13:12:15.083767  2714 raft_consensus.cc:515] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:15.083813  2586 leader_election.cc:290] T d2f88787abb54ffea037f35cf48b22c4 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:15.086310  2743 leader_election.cc:290] T 67db2f978ea64fbd9a32274d4ad374c9 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
W20260709 13:12:15.086643  2087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:34303, user_credentials={real_user=slave}} blocked reactor thread for 52504.6us
I20260709 13:12:15.086959  2714 leader_election.cc:290] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
W20260709 13:12:15.089071  2293 debug-util.cc:398] Leaking SignalData structure 0x7b08000ff800 after lost signal to thread 2055
I20260709 13:12:15.086020  2742 raft_consensus.cc:515] T a9be6d55d1f348bcaf96405abc80244d P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:15.090787  2017 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50244 (request call id 72) took 2426 ms. Trace:
I20260709 13:12:15.091187  2017 rpcz_store.cc:276] 0709 13:12:12.663917 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:12.700767 (+ 36850us) service_pool.cc:224] Handling call
0709 13:12:15.090585 (+2389818us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17005,"reported_tablets":1}
I20260709 13:12:15.092171  2742 leader_election.cc:290] T a9be6d55d1f348bcaf96405abc80244d P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:15.094554  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f88787abb54ffea037f35cf48b22c4" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:15.096212  2720 leader_election.cc:290] T ddf48e4f6be64627a0ed06d6198ca054 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
W20260709 13:12:15.096454  2392 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 2.207s	user 0.007s	sys 0.013s
I20260709 13:12:15.066327  2748 leader_election.cc:290] T d3370eb67fff4896b1f8e3ce56eceb9b P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:15.061081  2734 raft_consensus.cc:493] T 01a3c95e54104a998cdf16d06db2800a P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b6e57d59e4468ebe4423d871a31b39)
I20260709 13:12:15.098220  2734 raft_consensus.cc:515] T 01a3c95e54104a998cdf16d06db2800a P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:15.099718  2195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67db2f978ea64fbd9a32274d4ad374c9" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:15.100396  2195 raft_consensus.cc:2468] T 67db2f978ea64fbd9a32274d4ad374c9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 1.
W20260709 13:12:15.100548  2402 thread.cc:641] log-alloc [worker] (thread pool) Time spent creating pthread: real 2.211s	user 0.008s	sys 0.019s
I20260709 13:12:15.100848  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d5e9a8f42c4a2993d25a8a341fddbf" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:15.101675  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d5e9a8f42c4a2993d25a8a341fddbf" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:15.104729  2744 leader_election.cc:290] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:15.106760  2196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e259bf23e7904d9fb8b2345bb5b667f3" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:15.107476  2196 raft_consensus.cc:2468] T e259bf23e7904d9fb8b2345bb5b667f3 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 1.
I20260709 13:12:15.108594  2730 raft_consensus.cc:515] T 427b10072083419c89d5a4bf5d6413fc P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
W20260709 13:12:15.109985  2310 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:36557, user_credentials={real_user=slave}} blocked reactor thread for 56389.8us
W20260709 13:12:15.110692  2310 leader_election.cc:343] T b206de895e36490688cb2c1c537774a5 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:15.112478  2196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b22aafe7104cec82607dab40b4aed8" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:15.114156  2588 raft_consensus.cc:493] T 93d627aa01fd4aefbbae482eb2fb2453 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:15.114500  2725 raft_consensus.cc:515] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:15.115128  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0fb3f7bf85419cbf7ecda4727ccb89" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:15.115573  2198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a3c95e54104a998cdf16d06db2800a" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:15.116132  2198 raft_consensus.cc:2468] T 01a3c95e54104a998cdf16d06db2800a P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 1.
I20260709 13:12:15.116696  2122 raft_consensus.cc:3060] T ee1baa7401cd48e48e7125dcd607f44f P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:15.117405  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee1baa7401cd48e48e7125dcd607f44f" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:15.118424  2195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10de08c2346d47dbbd720596cd7e02fd" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:15.119707  2192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d627aa01fd4aefbbae482eb2fb2453" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:15.121701  2198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2993800f8e7e4c09bfe0b2be13e4394c" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:15.122120  2195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a5ce298d24406ea94fb68aba5b37ae" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:15.122357  2198 raft_consensus.cc:2468] T 2993800f8e7e4c09bfe0b2be13e4394c P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 2.
I20260709 13:12:15.078720  2649 leader_election.cc:290] T 56bba8336a054d969e18859a84f180d6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:15.123526  2649 raft_consensus.cc:2804] T 7475d672f7b3489393d6202c8b31e47f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:15.123863  2649 raft_consensus.cc:493] T 7475d672f7b3489393d6202c8b31e47f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79b6e57d59e4468ebe4423d871a31b39)
I20260709 13:12:15.124024  2193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b5593f051548fea374da76afa08c3f" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:15.124230  2649 raft_consensus.cc:3060] T 7475d672f7b3489393d6202c8b31e47f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.125584  2194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "765b8df93039426e925b94637a061cc2" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:15.126104  2196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3370eb67fff4896b1f8e3ce56eceb9b" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:15.126623  2189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f88787abb54ffea037f35cf48b22c4" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:15.127027  2191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc42d18a324e4f6d97f07cf770c5daa8" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:15.127632  2191 raft_consensus.cc:2468] T bc42d18a324e4f6d97f07cf770c5daa8 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 2.
I20260709 13:12:15.128183  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2993800f8e7e4c09bfe0b2be13e4394c" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:15.128444  2198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3782f3d54b4a19bacbd125c31127a9" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:15.123543  2120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0fb3f7bf85419cbf7ecda4727ccb89" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:15.129573  2120 raft_consensus.cc:2468] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 1.
I20260709 13:12:15.129730  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2993800f8e7e4c09bfe0b2be13e4394c" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:15.130805  2344 raft_consensus.cc:2468] T 2993800f8e7e4c09bfe0b2be13e4394c P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 2.
W20260709 13:12:15.096858  2392 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 2.207s	user 0.007s	sys 0.013s
I20260709 13:12:15.132395  2195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b5593f051548fea374da76afa08c3f" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:15.133644  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdee3fd7553a47afae3ec9dbdce6d829" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:15.134492  2392 tablet_bootstrap.cc:492] T a332070dcdff450b939e74ef5b68425a P 66e9a8fffd4b4e5a81ca4fa2762773ea: No bootstrap required, opened a new log
I20260709 13:12:15.134433  2342 raft_consensus.cc:2468] T bdee3fd7553a47afae3ec9dbdce6d829 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 1.
I20260709 13:12:15.135200  2392 ts_tablet_manager.cc:1403] T a332070dcdff450b939e74ef5b68425a P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent bootstrapping tablet: real 2.279s	user 0.018s	sys 0.013s
I20260709 13:12:15.133615  2752 raft_consensus.cc:493] T e5bbfa12bce4430fa6e7e6abd281ded6 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66e9a8fffd4b4e5a81ca4fa2762773ea)
I20260709 13:12:15.102885  2734 leader_election.cc:290] T 01a3c95e54104a998cdf16d06db2800a P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:15.136190  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdee3fd7553a47afae3ec9dbdce6d829" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:15.136993  2088 leader_election.cc:304] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472; no voters: 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:15.135679  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1478f883c539464bb54fe9bff44148d5" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:15.138628  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78734884e0a441759b51d258ad2697aa" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:15.135702  2343 raft_consensus.cc:2393] T ee1baa7401cd48e48e7125dcd607f44f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ac5c5682f914ed9b9982b5a080d5472 in current term 1: Already voted for candidate 0ec6a5d1452a41bd992a8c7922473b35 in this term.
W20260709 13:12:15.100988  2402 thread.cc:608] log-alloc [worker] (thread pool) Time spent starting thread: real 2.212s	user 0.008s	sys 0.019s
I20260709 13:12:15.140142  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0394490f6984f028daa10be921e242b" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:15.140607  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc02522cf9704f58a9d2bfd5326e3625" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:15.140807  2346 raft_consensus.cc:2468] T a0394490f6984f028daa10be921e242b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 1.
I20260709 13:12:15.141811  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a50365dcc843f4a4f6bfb29a736f26" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:15.143203  2195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a332070dcdff450b939e74ef5b68425a" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:15.143798  2120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1478f883c539464bb54fe9bff44148d5" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:15.144218  2088 leader_election.cc:304] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472; no voters: 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:15.144477  2120 raft_consensus.cc:2468] T 1478f883c539464bb54fe9bff44148d5 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 1.
I20260709 13:12:15.145259  2586 raft_consensus.cc:2804] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:15.128643  2588 raft_consensus.cc:515] T 93d627aa01fd4aefbbae482eb2fb2453 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:15.145880  2586 raft_consensus.cc:493] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79b6e57d59e4468ebe4423d871a31b39)
I20260709 13:12:15.146196  2586 raft_consensus.cc:3060] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.146428  2192 raft_consensus.cc:2468] T 93d627aa01fd4aefbbae482eb2fb2453 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 1.
I20260709 13:12:15.147465  2588 leader_election.cc:290] T 93d627aa01fd4aefbbae482eb2fb2453 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:15.138581  2714 raft_consensus.cc:2804] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:15.148965  2402 tablet_bootstrap.cc:492] T 7e3782f3d54b4a19bacbd125c31127a9 P 79b6e57d59e4468ebe4423d871a31b39: No bootstrap required, opened a new log
I20260709 13:12:15.154173  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f0f1b0143c4363a9b900eae4ac3ea9" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:15.154506  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc42d18a324e4f6d97f07cf770c5daa8" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:15.154698  2123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc42d18a324e4f6d97f07cf770c5daa8" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:15.154924  2266 raft_consensus.cc:2468] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 1.
I20260709 13:12:15.155530  2123 raft_consensus.cc:2468] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 2.
I20260709 13:12:15.155978  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a1307186df4616a9759118c2e456a6" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:15.155146  2346 raft_consensus.cc:2468] T bc42d18a324e4f6d97f07cf770c5daa8 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 1.
I20260709 13:12:15.157387  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f0f1b0143c4363a9b900eae4ac3ea9" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:15.143262  2118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc02522cf9704f58a9d2bfd5326e3625" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:15.155781  2718 leader_election.cc:290] T 5c3646d79bc840e9b4396f4351d1803d P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:15.145412  2725 leader_election.cc:290] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:15.166215  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "36b22aafe7104cec82607dab40b4aed8" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:15.152134  2714 raft_consensus.cc:493] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79b6e57d59e4468ebe4423d871a31b39)
I20260709 13:12:15.161545  2193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b82132c31545aab274c7cf3f77c277" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:15.148973  2451 raft_consensus.cc:515] T 2e178ff57d964223aca095ceff76b339 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:15.139145  2752 raft_consensus.cc:515] T e5bbfa12bce4430fa6e7e6abd281ded6 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:15.173720  2402 ts_tablet_manager.cc:1403] T 7e3782f3d54b4a19bacbd125c31127a9 P 79b6e57d59e4468ebe4423d871a31b39: Time spent bootstrapping tablet: real 2.316s	user 0.018s	sys 0.021s
I20260709 13:12:15.168814  2590 leader_election.cc:290] T 86834d94d1d64596abfa609754b5d58a P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:15.167971  2195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc42d18a324e4f6d97f07cf770c5daa8" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:15.170850  2714 raft_consensus.cc:3060] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.180380  2391 tablet_bootstrap.cc:492] T 622b6cfd76ff495ea6692a1ec0faefc4 P 2ac5c5682f914ed9b9982b5a080d5472: No bootstrap required, opened a new log
I20260709 13:12:15.180840  2715 consensus_queue.cc:1048] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:12:15.182370  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a672ef15abf47e4b650405c29044d3e" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:15.176920  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b10072083419c89d5a4bf5d6413fc" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:15.183384  2392 raft_consensus.cc:359] T a332070dcdff450b939e74ef5b68425a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:15.185510  2392 raft_consensus.cc:385] T a332070dcdff450b939e74ef5b68425a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:15.185856  2392 raft_consensus.cc:740] T a332070dcdff450b939e74ef5b68425a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:15.186832  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bd8fc2d57c14adeaeae16583eef7c84" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:15.187769  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67db2f978ea64fbd9a32274d4ad374c9" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:15.174168  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a1307186df4616a9759118c2e456a6" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:15.187687  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e259bf23e7904d9fb8b2345bb5b667f3" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:15.188804  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a672ef15abf47e4b650405c29044d3e" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
W20260709 13:12:15.189333  2236 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.389s	user 0.017s	sys 0.030s
I20260709 13:12:15.189702  2197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc33c7c3cfd14ab7a99e39cfd971fc3c" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
W20260709 13:12:15.190246  2236 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.390s	user 0.017s	sys 0.031s
W20260709 13:12:15.190630  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:36557, user_credentials={real_user=slave}} blocked reactor thread for 2.39118e+06us
I20260709 13:12:15.184773  2391 ts_tablet_manager.cc:1403] T 622b6cfd76ff495ea6692a1ec0faefc4 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.444s	user 0.008s	sys 0.020s
W20260709 13:12:15.192441  2236 consensus_peers.cc:597] T b206de895e36490688cb2c1c537774a5 P 79b6e57d59e4468ebe4423d871a31b39 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:15.195513  2123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67db2f978ea64fbd9a32274d4ad374c9" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:15.195995  2119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4edf26b74c5d4e5d9a33d2b1fc1bb0ae" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:15.196743  2119 raft_consensus.cc:2468] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 1.
I20260709 13:12:15.200587  2119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e259bf23e7904d9fb8b2345bb5b667f3" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:15.202039  2195 raft_consensus.cc:2393] T bc42d18a324e4f6d97f07cf770c5daa8 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in current term 2: Already voted for candidate 0ec6a5d1452a41bd992a8c7922473b35 in this term.
I20260709 13:12:15.202649  2451 leader_election.cc:290] T 2e178ff57d964223aca095ceff76b339 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 election: Requested vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
W20260709 13:12:15.203079  2087 leader_election.cc:343] T d2f88787abb54ffea037f35cf48b22c4 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:15.206380  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b10072083419c89d5a4bf5d6413fc" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:15.206774  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e178ff57d964223aca095ceff76b339" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:15.207427  2266 raft_consensus.cc:3060] T 2e178ff57d964223aca095ceff76b339 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.201923  2121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bd8fc2d57c14adeaeae16583eef7c84" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:15.175875  2120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a50365dcc843f4a4f6bfb29a736f26" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:15.213548  2117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b82132c31545aab274c7cf3f77c277" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
W20260709 13:12:15.219337  2293 debug-util.cc:398] Leaking SignalData structure 0x7b0800224300 after lost signal to thread 2147
I20260709 13:12:15.223466  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b82132c31545aab274c7cf3f77c277" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:15.224215  2342 raft_consensus.cc:2468] T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 1.
I20260709 13:12:15.226603  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e178ff57d964223aca095ceff76b339" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:15.214272  2649 raft_consensus.cc:515] T 7475d672f7b3489393d6202c8b31e47f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
W20260709 13:12:15.235003  2293 debug-util.cc:398] Leaking SignalData structure 0x7b08000a6060 after lost signal to thread 2222
W20260709 13:12:15.236392  2293 debug-util.cc:398] Leaking SignalData structure 0x7b080030a5c0 after lost signal to thread 2296
W20260709 13:12:15.240805  2293 debug-util.cc:398] Leaking SignalData structure 0x7b08002b0ca0 after lost signal to thread 2370
I20260709 13:12:15.243718  2193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b65903ab966485c9c65bdfbdf1e1054" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:15.244694  2393 tablet_bootstrap.cc:492] T 421302a9721e4cc9a86e52a183469a70 P 0ec6a5d1452a41bd992a8c7922473b35: Bootstrap starting.
I20260709 13:12:15.246640  2198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3370eb67fff4896b1f8e3ce56eceb9b" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:15.246141  2196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a50365dcc843f4a4f6bfb29a736f26" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:15.245995  2191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aac56f958fb4fe29fe46d2a9be60ffd" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:15.239423  2391 raft_consensus.cc:359] T 622b6cfd76ff495ea6692a1ec0faefc4 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:15.252460  2391 raft_consensus.cc:385] T 622b6cfd76ff495ea6692a1ec0faefc4 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:15.253080  2391 raft_consensus.cc:740] T 622b6cfd76ff495ea6692a1ec0faefc4 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:15.236305  2649 leader_election.cc:290] T 7475d672f7b3489393d6202c8b31e47f P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 election: Requested vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:15.245942  2189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdee3fd7553a47afae3ec9dbdce6d829" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:15.249286  2197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9934bcaed6743b2a30104e13b8cf18b" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:15.256310  2752 leader_election.cc:290] T e5bbfa12bce4430fa6e7e6abd281ded6 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:15.259022  2402 raft_consensus.cc:359] T 7e3782f3d54b4a19bacbd125c31127a9 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:15.258481  2392 consensus_queue.cc:260] T a332070dcdff450b939e74ef5b68425a P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:15.261116  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee1baa7401cd48e48e7125dcd607f44f" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:15.261219  2730 leader_election.cc:290] T 427b10072083419c89d5a4bf5d6413fc P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 election: Requested vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:15.262609  2017 catalog_manager.cc:5697] T ee1baa7401cd48e48e7125dcd607f44f P 0ec6a5d1452a41bd992a8c7922473b35 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66). New cstate: current_term: 1 leader_uuid: "0ec6a5d1452a41bd992a8c7922473b35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:15.269533  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86834d94d1d64596abfa609754b5d58a" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:15.269946  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3370eb67fff4896b1f8e3ce56eceb9b" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:15.270869  2311 leader_election.cc:304] T 01a3c95e54104a998cdf16d06db2800a P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:15.271198  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b5593f051548fea374da76afa08c3f" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:15.272063  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc42d18a324e4f6d97f07cf770c5daa8" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:15.286474  2345 raft_consensus.cc:2468] T bc42d18a324e4f6d97f07cf770c5daa8 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 1.
I20260709 13:12:15.273401  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f2272230d34efa880d5eeed8859669" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:15.286747  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78734884e0a441759b51d258ad2697aa" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:15.287295  2344 raft_consensus.cc:2468] T 86834d94d1d64596abfa609754b5d58a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 1.
I20260709 13:12:15.274848  2391 consensus_queue.cc:260] T 622b6cfd76ff495ea6692a1ec0faefc4 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:15.288435  2590 raft_consensus.cc:2804] T 01a3c95e54104a998cdf16d06db2800a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:15.288854  2590 raft_consensus.cc:493] T 01a3c95e54104a998cdf16d06db2800a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79b6e57d59e4468ebe4423d871a31b39)
I20260709 13:12:15.289340  2590 raft_consensus.cc:3060] T 01a3c95e54104a998cdf16d06db2800a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:15.278220  2162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:36557, user_credentials={real_user=slave}} blocked reactor thread for 68690.7us
I20260709 13:12:15.212327  2586 raft_consensus.cc:515] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:15.279958  2402 raft_consensus.cc:385] T 7e3782f3d54b4a19bacbd125c31127a9 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:15.281288  2346 raft_consensus.cc:2393] T ee1baa7401cd48e48e7125dcd607f44f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ac5c5682f914ed9b9982b5a080d5472 in current term 1: Already voted for candidate 0ec6a5d1452a41bd992a8c7922473b35 in this term.
W20260709 13:12:15.251240  2088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:38859, user_credentials={real_user=slave}} blocked reactor thread for 71353.4us
I20260709 13:12:15.319090  2088 leader_election.cc:304] T d2f88787abb54ffea037f35cf48b22c4 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:15.291692  2402 raft_consensus.cc:740] T 7e3782f3d54b4a19bacbd125c31127a9 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Initialized, Role: FOLLOWER
I20260709 13:12:15.292798  2719 raft_consensus.cc:493] T df8d897471684531826528a5751d6246 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.280385  2189 raft_consensus.cc:2468] T bdee3fd7553a47afae3ec9dbdce6d829 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 1.
I20260709 13:12:15.320359  2402 consensus_queue.cc:260] T 7e3782f3d54b4a19bacbd125c31127a9 P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:15.327140  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e259bf23e7904d9fb8b2345bb5b667f3" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:15.327854  2719 raft_consensus.cc:515] T df8d897471684531826528a5751d6246 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:15.329984  2088 leader_election.cc:304] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472; no voters: 
I20260709 13:12:15.299597  2119 raft_consensus.cc:2393] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec6a5d1452a41bd992a8c7922473b35 in current term 2: Already voted for candidate 2ac5c5682f914ed9b9982b5a080d5472 in this term.
I20260709 13:12:15.330734  2402 ts_tablet_manager.cc:1434] T 7e3782f3d54b4a19bacbd125c31127a9 P 79b6e57d59e4468ebe4423d871a31b39: Time spent starting tablet: real 0.157s	user 0.005s	sys 0.003s
I20260709 13:12:15.332041  2402 tablet_bootstrap.cc:492] T d0d102459578474fbe77af94f3986a84 P 79b6e57d59e4468ebe4423d871a31b39: Bootstrap starting.
I20260709 13:12:15.333683  2114 raft_consensus.cc:1240] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Rejecting Update request from peer 79b6e57d59e4468ebe4423d871a31b39 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:15.336906  2339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a332070dcdff450b939e74ef5b68425a" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:15.299979  2019 catalog_manager.cc:5697] T 78734884e0a441759b51d258ad2697aa P 79b6e57d59e4468ebe4423d871a31b39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68). New cstate: current_term: 1 leader_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } }
I20260709 13:12:15.302403  2590 raft_consensus.cc:515] T 01a3c95e54104a998cdf16d06db2800a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:15.303776  2118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bd8fc2d57c14adeaeae16583eef7c84" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:15.305099  2120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b10072083419c89d5a4bf5d6413fc" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:15.306104  2121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e178ff57d964223aca095ceff76b339" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:15.307106  2116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9be6d55d1f348bcaf96405abc80244d" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:15.307888  2122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56bba8336a054d969e18859a84f180d6" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:15.311920  2117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddf48e4f6be64627a0ed06d6198ca054" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:15.309336  2115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3646d79bc840e9b4396f4351d1803d" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:15.314306  2391 ts_tablet_manager.cc:1434] T 622b6cfd76ff495ea6692a1ec0faefc4 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.123s	user 0.007s	sys 0.001s
I20260709 13:12:15.315191  2392 ts_tablet_manager.cc:1434] T a332070dcdff450b939e74ef5b68425a P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent starting tablet: real 0.180s	user 0.004s	sys 0.007s
I20260709 13:12:15.354707  2392 tablet_bootstrap.cc:492] T df8d897471684531826528a5751d6246 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Bootstrap starting.
I20260709 13:12:15.356714  2590 leader_election.cc:290] T 01a3c95e54104a998cdf16d06db2800a P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 election: Requested vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
W20260709 13:12:15.315690  2311 leader_election.cc:343] T 10de08c2346d47dbbd720596cd7e02fd P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:15.300102  2586 leader_election.cc:290] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 election: Requested vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:15.342437  2162 leader_election.cc:304] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472; no voters: 
I20260709 13:12:15.297271  2393 tablet_bootstrap.cc:654] T 421302a9721e4cc9a86e52a183469a70 P 0ec6a5d1452a41bd992a8c7922473b35: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:15.351285  2730 raft_consensus.cc:2749] T d2f88787abb54ffea037f35cf48b22c4 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:15.351897  2120 raft_consensus.cc:2393] T 427b10072083419c89d5a4bf5d6413fc P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79b6e57d59e4468ebe4423d871a31b39 in current term 2: Already voted for candidate 2ac5c5682f914ed9b9982b5a080d5472 in this term.
I20260709 13:12:15.346272  2339 raft_consensus.cc:2468] T a332070dcdff450b939e74ef5b68425a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 0.
I20260709 13:12:15.352525  2757 raft_consensus.cc:515] T 28f2272230d34efa880d5eeed8859669 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:15.366367  2762 raft_consensus.cc:2804] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:15.366859  2762 raft_consensus.cc:493] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:15.354562  2266 raft_consensus.cc:2468] T 2e178ff57d964223aca095ceff76b339 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 2.
I20260709 13:12:15.367228  2762 raft_consensus.cc:3060] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:15.330101  2719 leader_election.cc:290] T df8d897471684531826528a5751d6246 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:15.368290  2341 raft_consensus.cc:2393] T 28f2272230d34efa880d5eeed8859669 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ac5c5682f914ed9b9982b5a080d5472 in current term 2: Already voted for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in this term.
I20260709 13:12:15.368826  2088 leader_election.cc:304] T 7e3782f3d54b4a19bacbd125c31127a9 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:15.284109  2714 raft_consensus.cc:515] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:15.370915  2123 raft_consensus.cc:2393] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec6a5d1452a41bd992a8c7922473b35 in current term 2: Already voted for candidate 2ac5c5682f914ed9b9982b5a080d5472 in this term.
I20260709 13:12:15.371203  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b10072083419c89d5a4bf5d6413fc" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:15.372337  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e178ff57d964223aca095ceff76b339" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:15.373495  2714 leader_election.cc:290] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 election: Requested vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
W20260709 13:12:15.365550  2311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:38859, user_credentials={real_user=slave}} blocked reactor thread for 49889.9us
I20260709 13:12:15.374281  2730 raft_consensus.cc:2749] T 7e3782f3d54b4a19bacbd125c31127a9 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:15.375406  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0394490f6984f028daa10be921e242b" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:15.376507  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56bba8336a054d969e18859a84f180d6" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:15.376679  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b65903ab966485c9c65bdfbdf1e1054" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:15.377444  2272 raft_consensus.cc:2468] T 8b65903ab966485c9c65bdfbdf1e1054 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 1.
I20260709 13:12:15.377748  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9934bcaed6743b2a30104e13b8cf18b" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:15.365160  2758 raft_consensus.cc:493] T 0668be6a554b4c5f8bf93d0588a6bfcc P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b6e57d59e4468ebe4423d871a31b39)
I20260709 13:12:15.378881  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0668be6a554b4c5f8bf93d0588a6bfcc" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
W20260709 13:12:15.379983  2311 leader_election.cc:343] T a4a5ce298d24406ea94fb68aba5b37ae P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:15.380746  2311 leader_election.cc:304] T 2993800f8e7e4c09bfe0b2be13e4394c P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:15.369644  2087 leader_election.cc:304] T 2e178ff57d964223aca095ceff76b339 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:15.365166  2402 tablet_bootstrap.cc:654] T d0d102459578474fbe77af94f3986a84 P 79b6e57d59e4468ebe4423d871a31b39: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:15.384425  2119 raft_consensus.cc:1240] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Rejecting Update request from peer 79b6e57d59e4468ebe4423d871a31b39 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:15.378849  2758 raft_consensus.cc:515] T 0668be6a554b4c5f8bf93d0588a6bfcc P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:15.367103  2757 leader_election.cc:290] T 28f2272230d34efa880d5eeed8859669 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 election: Requested vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
W20260709 13:12:15.388870  2162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:36557, user_credentials={real_user=slave}} blocked reactor thread for 46492.4us
I20260709 13:12:15.382117  2649 raft_consensus.cc:2804] T 2993800f8e7e4c09bfe0b2be13e4394c P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:15.382644  2719 consensus_queue.cc:1059] T e259bf23e7904d9fb8b2345bb5b667f3 P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:15.402438  2721 raft_consensus.cc:3055] T e259bf23e7904d9fb8b2345bb5b667f3 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:15.402809  2721 raft_consensus.cc:740] T e259bf23e7904d9fb8b2345bb5b667f3 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Running, Role: LEADER
W20260709 13:12:15.403317  2088 consensus_peers.cc:597] T a4a5ce298d24406ea94fb68aba5b37ae P 2ac5c5682f914ed9b9982b5a080d5472 -> Peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Couldn't send request to peer 0ec6a5d1452a41bd992a8c7922473b35. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:15.341718  2118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df8d897471684531826528a5751d6246" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:15.389508  2162 leader_election.cc:304] T 1478f883c539464bb54fe9bff44148d5 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472; no voters: 
I20260709 13:12:15.391072  2649 raft_consensus.cc:493] T 2993800f8e7e4c09bfe0b2be13e4394c P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Starting leader election (detected failure of leader 79b6e57d59e4468ebe4423d871a31b39)
I20260709 13:12:15.398028  2391 tablet_bootstrap.cc:492] T a9be6d55d1f348bcaf96405abc80244d P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:15.399569  2311 leader_election.cc:304] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:15.399893  2392 tablet_bootstrap.cc:654] T df8d897471684531826528a5751d6246 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:15.400130  2714 raft_consensus.cc:2804] T 2e178ff57d964223aca095ceff76b339 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:15.401350  2758 leader_election.cc:290] T 0668be6a554b4c5f8bf93d0588a6bfcc P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:15.418289  2714 raft_consensus.cc:697] T 2e178ff57d964223aca095ceff76b339 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 LEADER]: Becoming Leader. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Running, Role: LEADER
I20260709 13:12:15.419400  2714 consensus_queue.cc:237] T 2e178ff57d964223aca095ceff76b339 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:15.387042  2117 raft_consensus.cc:2468] T ddf48e4f6be64627a0ed06d6198ca054 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 1.
I20260709 13:12:15.426101  2162 leader_election.cc:304] T bc42d18a324e4f6d97f07cf770c5daa8 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472; no voters: 
I20260709 13:12:15.432734  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b10072083419c89d5a4bf5d6413fc" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
W20260709 13:12:15.407889  2088 leader_election.cc:343] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:15.412379  2649 raft_consensus.cc:3060] T 2993800f8e7e4c09bfe0b2be13e4394c P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:15.439039  2527 raft_consensus.cc:2804] T bc42d18a324e4f6d97f07cf770c5daa8 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:15.439437  2527 raft_consensus.cc:493] T bc42d18a324e4f6d97f07cf770c5daa8 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:15.439730  2527 raft_consensus.cc:3060] T bc42d18a324e4f6d97f07cf770c5daa8 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:15.403746  2721 consensus_queue.cc:260] T e259bf23e7904d9fb8b2345bb5b667f3 P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:15.441779  2346 raft_consensus.cc:1240] T 7475d672f7b3489393d6202c8b31e47f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Rejecting Update request from peer 79b6e57d59e4468ebe4423d871a31b39 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:15.433743  2581 raft_consensus.cc:2804] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:15.446486  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67db2f978ea64fbd9a32274d4ad374c9" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:15.447402  2337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b65903ab966485c9c65bdfbdf1e1054" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:15.450675  2087 leader_election.cc:304] T a0394490f6984f028daa10be921e242b P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:15.452131  2087 leader_election.cc:304] T 36b22aafe7104cec82607dab40b4aed8 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea
I20260709 13:12:15.454205  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f0f1b0143c4363a9b900eae4ac3ea9" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:15.454381  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e178ff57d964223aca095ceff76b339" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:15.455312  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bbfa12bce4430fa6e7e6abd281ded6" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:15.456547  2586 raft_consensus.cc:2749] T 36b22aafe7104cec82607dab40b4aed8 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:15.437000  2736 raft_consensus.cc:2804] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:15.463549  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86834d94d1d64596abfa609754b5d58a" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:15.464848  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7475d672f7b3489393d6202c8b31e47f" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:15.445782  2581 raft_consensus.cc:493] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79b6e57d59e4468ebe4423d871a31b39)
I20260709 13:12:15.465533  2581 raft_consensus.cc:3060] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.466572  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0668be6a554b4c5f8bf93d0588a6bfcc" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:15.469008  2191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67db2f978ea64fbd9a32274d4ad374c9" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:15.469502  2118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "765b8df93039426e925b94637a061cc2" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:15.471909  2121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d627aa01fd4aefbbae482eb2fb2453" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:15.471136  2117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b5593f051548fea374da76afa08c3f" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:15.473099  2122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a5ce298d24406ea94fb68aba5b37ae" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:15.454155  2451 raft_consensus.cc:2804] T a0394490f6984f028daa10be921e242b P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:15.474161  2451 raft_consensus.cc:493] T a0394490f6984f028daa10be921e242b P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79b6e57d59e4468ebe4423d871a31b39)
I20260709 13:12:15.464390  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aac56f958fb4fe29fe46d2a9be60ffd" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:15.474403  2119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b82132c31545aab274c7cf3f77c277" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:15.469564  2191 raft_consensus.cc:3060] T 67db2f978ea64fbd9a32274d4ad374c9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.475380  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a672ef15abf47e4b650405c29044d3e" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:15.464287  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9be6d55d1f348bcaf96405abc80244d" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:15.476333  2269 raft_consensus.cc:2468] T a9be6d55d1f348bcaf96405abc80244d P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 0.
I20260709 13:12:15.470504  2114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10de08c2346d47dbbd720596cd7e02fd" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:15.462893  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdee3fd7553a47afae3ec9dbdce6d829" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:15.470600  2736 raft_consensus.cc:493] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:15.478506  2736 raft_consensus.cc:3060] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.434573  2744 raft_consensus.cc:2804] T 1478f883c539464bb54fe9bff44148d5 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:15.470711  2197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e259bf23e7904d9fb8b2345bb5b667f3" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:15.479812  2197 raft_consensus.cc:3060] T e259bf23e7904d9fb8b2345bb5b667f3 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.479090  2744 raft_consensus.cc:493] T 1478f883c539464bb54fe9bff44148d5 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79b6e57d59e4468ebe4423d871a31b39)
I20260709 13:12:15.479903  2519 consensus_queue.cc:1059] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:15.480393  2744 raft_consensus.cc:3060] T 1478f883c539464bb54fe9bff44148d5 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.481562  2519 raft_consensus.cc:3055] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:15.481904  2519 raft_consensus.cc:740] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Running, Role: LEADER
I20260709 13:12:15.482895  2191 raft_consensus.cc:2468] T 67db2f978ea64fbd9a32274d4ad374c9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 2.
I20260709 13:12:15.482738  2519 consensus_queue.cc:260] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:15.482947  2339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9be6d55d1f348bcaf96405abc80244d" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:15.456255  2758 raft_consensus.cc:493] T 622b6cfd76ff495ea6692a1ec0faefc4 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.460883  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e716da7cd3d4ad390e049dc845b8004" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:15.484310  2339 raft_consensus.cc:2468] T a9be6d55d1f348bcaf96405abc80244d P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 0.
I20260709 13:12:15.484108  2758 raft_consensus.cc:515] T 622b6cfd76ff495ea6692a1ec0faefc4 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
W20260709 13:12:15.479135  2236 leader_election.cc:343] T a9be6d55d1f348bcaf96405abc80244d P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:15.485791  2236 leader_election.cc:343] T df8d897471684531826528a5751d6246 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:15.486193  2758 leader_election.cc:290] T 622b6cfd76ff495ea6692a1ec0faefc4 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:15.486349  2236 leader_election.cc:304] T ddf48e4f6be64627a0ed06d6198ca054 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:15.446520  2721 raft_consensus.cc:3060] T e259bf23e7904d9fb8b2345bb5b667f3 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.488032  2719 raft_consensus.cc:2804] T ddf48e4f6be64627a0ed06d6198ca054 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:15.488435  2719 raft_consensus.cc:493] T ddf48e4f6be64627a0ed06d6198ca054 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:15.488780  2719 raft_consensus.cc:3060] T ddf48e4f6be64627a0ed06d6198ca054 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.480939  2451 raft_consensus.cc:3060] T a0394490f6984f028daa10be921e242b P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.490468  2311 leader_election.cc:304] T bdee3fd7553a47afae3ec9dbdce6d829 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:15.493511  2191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a3c95e54104a998cdf16d06db2800a" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:15.494315  2191 raft_consensus.cc:3060] T 01a3c95e54104a998cdf16d06db2800a P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.496811  2527 raft_consensus.cc:515] T bc42d18a324e4f6d97f07cf770c5daa8 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:15.498013  2590 raft_consensus.cc:2804] T bdee3fd7553a47afae3ec9dbdce6d829 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:15.502738  2191 raft_consensus.cc:2468] T 01a3c95e54104a998cdf16d06db2800a P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 2.
I20260709 13:12:15.502940  2162 leader_election.cc:304] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472; no voters: 
I20260709 13:12:15.503227  2114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc42d18a324e4f6d97f07cf770c5daa8" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
W20260709 13:12:15.503770  2087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:38869, user_credentials={real_user=slave}} blocked reactor thread for 50477.5us
I20260709 13:12:15.504421  2119 raft_consensus.cc:3060] T 78734884e0a441759b51d258ad2697aa P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:15.505355  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aac56f958fb4fe29fe46d2a9be60ffd" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:15.505510  2122 raft_consensus.cc:1240] T 427b10072083419c89d5a4bf5d6413fc P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Rejecting Update request from peer 66e9a8fffd4b4e5a81ca4fa2762773ea for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:15.484100  2519 raft_consensus.cc:3060] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.506875  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df8d897471684531826528a5751d6246" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:15.507655  2343 raft_consensus.cc:1240] T 28f2272230d34efa880d5eeed8859669 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Rejecting Update request from peer 79b6e57d59e4468ebe4423d871a31b39 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:15.508704  2762 raft_consensus.cc:515] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:15.488617  2391 tablet_bootstrap.cc:654] T a9be6d55d1f348bcaf96405abc80244d P 2ac5c5682f914ed9b9982b5a080d5472: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:15.510596  2345 raft_consensus.cc:1240] T 01a3c95e54104a998cdf16d06db2800a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Rejecting Update request from peer 79b6e57d59e4468ebe4423d871a31b39 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:15.507655  2508 consensus_queue.cc:1048] T e5bbfa12bce4430fa6e7e6abd281ded6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:12:15.541642  2755 consensus_queue.cc:1048] T ee1baa7401cd48e48e7125dcd607f44f P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:15.508631  2339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56bba8336a054d969e18859a84f180d6" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:15.546612  2762 leader_election.cc:290] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 3 election: Requested vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:15.548940  2198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bbfa12bce4430fa6e7e6abd281ded6" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:15.514950  2581 raft_consensus.cc:515] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:15.550715  2087 leader_election.cc:304] T 78734884e0a441759b51d258ad2697aa P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472; no voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:15.551188  2581 leader_election.cc:290] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 election: Requested vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:15.552079  2087 leader_election.cc:304] T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:15.515966  2116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc33c7c3cfd14ab7a99e39cfd971fc3c" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:15.552989  2196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e716da7cd3d4ad390e049dc845b8004" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:15.530745  2590 raft_consensus.cc:493] T bdee3fd7553a47afae3ec9dbdce6d829 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79b6e57d59e4468ebe4423d871a31b39)
I20260709 13:12:15.518573  2121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0668be6a554b4c5f8bf93d0588a6bfcc" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:15.553632  2116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86834d94d1d64596abfa609754b5d58a" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:15.520370  2120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56bba8336a054d969e18859a84f180d6" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:15.521404  2123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9be6d55d1f348bcaf96405abc80244d" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:15.522037  2649 raft_consensus.cc:515] T 2993800f8e7e4c09bfe0b2be13e4394c P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:15.522540  2115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a50365dcc843f4a4f6bfb29a736f26" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:15.523186  2744 raft_consensus.cc:515] T 1478f883c539464bb54fe9bff44148d5 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:15.525044  2193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622b6cfd76ff495ea6692a1ec0faefc4" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:15.525542  2451 raft_consensus.cc:515] T a0394490f6984f028daa10be921e242b P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:15.529269  2310 leader_election.cc:304] T b206de895e36490688cb2c1c537774a5 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:15.519335  2393 tablet_bootstrap.cc:492] T 421302a9721e4cc9a86e52a183469a70 P 0ec6a5d1452a41bd992a8c7922473b35: No bootstrap required, opened a new log
I20260709 13:12:15.513826  2197 raft_consensus.cc:2468] T e259bf23e7904d9fb8b2345bb5b667f3 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 2.
I20260709 13:12:15.540815  2311 leader_election.cc:304] T 01a3c95e54104a998cdf16d06db2800a P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:15.517482  2117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0394490f6984f028daa10be921e242b" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:15.519310  2118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3370eb67fff4896b1f8e3ce56eceb9b" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:15.535719  2752 raft_consensus.cc:2804] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:15.530108  2736 raft_consensus.cc:515] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:15.557107  2590 raft_consensus.cc:3060] T bdee3fd7553a47afae3ec9dbdce6d829 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.565672  2393 ts_tablet_manager.cc:1403] T 421302a9721e4cc9a86e52a183469a70 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent bootstrapping tablet: real 0.321s	user 0.012s	sys 0.007s
I20260709 13:12:15.558720  2758 raft_consensus.cc:2804] T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:12:15.566560  2310 leader_election.cc:343] T 583390912c6d4daca2df9b5534fb8dca P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:15.572611  2310 leader_election.cc:304] T 583390912c6d4daca2df9b5534fb8dca P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:15.539726  2719 raft_consensus.cc:515] T ddf48e4f6be64627a0ed06d6198ca054 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:15.561775  2527 leader_election.cc:290] T bc42d18a324e4f6d97f07cf770c5daa8 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 3 election: Requested vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:15.565591  2114 raft_consensus.cc:2368] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66e9a8fffd4b4e5a81ca4fa2762773ea for earlier term 2. Current term is 3.
I20260709 13:12:15.556645  2730 consensus_queue.cc:1048] T a4a5ce298d24406ea94fb68aba5b37ae P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 13:12:15.566193  2121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7475d672f7b3489393d6202c8b31e47f" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:15.568553  2508 raft_consensus.cc:2749] T b206de895e36490688cb2c1c537774a5 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:15.583617  2310 leader_election.cc:304] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39; no voters: 0ec6a5d1452a41bd992a8c7922473b35
I20260709 13:12:15.582943  2196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bd8fc2d57c14adeaeae16583eef7c84" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
W20260709 13:12:15.586529  2310 leader_election.cc:343] T f9934bcaed6743b2a30104e13b8cf18b P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:15.563596  2088 leader_election.cc:304] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472; no voters: 
I20260709 13:12:15.572453  2342 raft_consensus.cc:1240] T 2993800f8e7e4c09bfe0b2be13e4394c P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Rejecting Update request from peer 79b6e57d59e4468ebe4423d871a31b39 for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:15.572376  2758 raft_consensus.cc:493] T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79b6e57d59e4468ebe4423d871a31b39)
I20260709 13:12:15.573279  2191 raft_consensus.cc:1240] T 1478f883c539464bb54fe9bff44148d5 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Rejecting Update request from peer 79b6e57d59e4468ebe4423d871a31b39 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:15.583084  2757 raft_consensus.cc:2749] T 583390912c6d4daca2df9b5534fb8dca P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:15.595480  2310 leader_election.cc:304] T f9934bcaed6743b2a30104e13b8cf18b P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:15.582918  2725 raft_consensus.cc:2804] T 01a3c95e54104a998cdf16d06db2800a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:15.584873  2752 raft_consensus.cc:493] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79b6e57d59e4468ebe4423d871a31b39)
I20260709 13:12:15.586738  2742 raft_consensus.cc:2804] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:15.595151  2197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f0f1b0143c4363a9b900eae4ac3ea9" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:15.600502  2310 leader_election.cc:304] T 5aac56f958fb4fe29fe46d2a9be60ffd P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:15.599848  2757 raft_consensus.cc:2749] T f9934bcaed6743b2a30104e13b8cf18b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:15.602514  2402 tablet_bootstrap.cc:492] T d0d102459578474fbe77af94f3986a84 P 79b6e57d59e4468ebe4423d871a31b39: No bootstrap required, opened a new log
I20260709 13:12:15.603896  2402 ts_tablet_manager.cc:1403] T d0d102459578474fbe77af94f3986a84 P 79b6e57d59e4468ebe4423d871a31b39: Time spent bootstrapping tablet: real 0.272s	user 0.013s	sys 0.019s
I20260709 13:12:15.602970  2310 leader_election.cc:304] T a9be6d55d1f348bcaf96405abc80244d P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:15.596698  2758 raft_consensus.cc:3060] T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.607501  2196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a672ef15abf47e4b650405c29044d3e" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:15.607658  2401 raft_consensus.cc:2804] T a9be6d55d1f348bcaf96405abc80244d P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:15.608599  2401 raft_consensus.cc:493] T a9be6d55d1f348bcaf96405abc80244d P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:15.608882  2391 tablet_bootstrap.cc:492] T a9be6d55d1f348bcaf96405abc80244d P 2ac5c5682f914ed9b9982b5a080d5472: No bootstrap required, opened a new log
I20260709 13:12:15.608934  2401 raft_consensus.cc:3060] T a9be6d55d1f348bcaf96405abc80244d P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:15.609303  2391 ts_tablet_manager.cc:1403] T a9be6d55d1f348bcaf96405abc80244d P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.212s	user 0.003s	sys 0.013s
I20260709 13:12:15.601348  2730 raft_consensus.cc:2804] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:15.593209  2087 leader_election.cc:304] T 12b5593f051548fea374da76afa08c3f P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea
I20260709 13:12:15.601351  2752 raft_consensus.cc:3060] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.604568  2508 raft_consensus.cc:2749] T 5aac56f958fb4fe29fe46d2a9be60ffd P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:15.603142  2742 raft_consensus.cc:493] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0ec6a5d1452a41bd992a8c7922473b35)
I20260709 13:12:15.606674  2725 raft_consensus.cc:697] T 01a3c95e54104a998cdf16d06db2800a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 LEADER]: Becoming Leader. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Running, Role: LEADER
I20260709 13:12:15.622416  2193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc42d18a324e4f6d97f07cf770c5daa8" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:15.622591  2744 leader_election.cc:290] T 1478f883c539464bb54fe9bff44148d5 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 election: Requested vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
W20260709 13:12:15.624822  2069 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:15.625923  2649 leader_election.cc:290] T 2993800f8e7e4c09bfe0b2be13e4394c P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 3 election: Requested vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:15.620384  2736 leader_election.cc:290] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 election: Requested vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:15.613619  2730 raft_consensus.cc:697] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 LEADER]: Becoming Leader. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Running, Role: LEADER
W20260709 13:12:15.641440  2087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:38869, user_credentials={real_user=slave}} blocked reactor thread for 56297.6us
I20260709 13:12:15.618778  2195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bbfa12bce4430fa6e7e6abd281ded6" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
W20260709 13:12:15.674005  2311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:38859, user_credentials={real_user=slave}} blocked reactor thread for 56754.4us
I20260709 13:12:15.616081  2742 raft_consensus.cc:3060] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.727751  2088 leader_election.cc:304] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472; no voters: 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:15.728410  2193 raft_consensus.cc:2393] T bc42d18a324e4f6d97f07cf770c5daa8 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ac5c5682f914ed9b9982b5a080d5472 in current term 3: Already voted for candidate 0ec6a5d1452a41bd992a8c7922473b35 in this term.
I20260709 13:12:15.729135  2393 raft_consensus.cc:359] T 421302a9721e4cc9a86e52a183469a70 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:15.729846  2393 raft_consensus.cc:385] T 421302a9721e4cc9a86e52a183469a70 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:15.729300  2714 raft_consensus.cc:2804] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:15.730829  2393 raft_consensus.cc:740] T 421302a9721e4cc9a86e52a183469a70 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Initialized, Role: FOLLOWER
I20260709 13:12:15.732196  2198 raft_consensus.cc:1240] T 67db2f978ea64fbd9a32274d4ad374c9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Rejecting Update request from peer 79b6e57d59e4468ebe4423d871a31b39 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:15.730609  2401 raft_consensus.cc:515] T a9be6d55d1f348bcaf96405abc80244d P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:15.741317  2121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddf48e4f6be64627a0ed06d6198ca054" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:15.742532  2121 raft_consensus.cc:3060] T ddf48e4f6be64627a0ed06d6198ca054 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.734663  2714 raft_consensus.cc:697] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 LEADER]: Becoming Leader. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Running, Role: LEADER
I20260709 13:12:15.742682  2195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d627aa01fd4aefbbae482eb2fb2453" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:15.746467  2714 consensus_queue.cc:237] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:15.750223  2730 consensus_queue.cc:237] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:15.750605  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a3c95e54104a998cdf16d06db2800a" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:15.751492  2266 raft_consensus.cc:1240] T 2e178ff57d964223aca095ceff76b339 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Rejecting Update request from peer 66e9a8fffd4b4e5a81ca4fa2762773ea for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:15.751856  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f2272230d34efa880d5eeed8859669" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:15.749640  2725 consensus_queue.cc:237] T 01a3c95e54104a998cdf16d06db2800a P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:15.737134  2087 leader_election.cc:304] T ee1baa7401cd48e48e7125dcd607f44f P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea
I20260709 13:12:15.756660  2762 raft_consensus.cc:2749] T ee1baa7401cd48e48e7125dcd607f44f P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:15.739152  2451 leader_election.cc:290] T a0394490f6984f028daa10be921e242b P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 election: Requested vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:15.758004  2087 leader_election.cc:304] T d3370eb67fff4896b1f8e3ce56eceb9b P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea
I20260709 13:12:15.759338  2451 raft_consensus.cc:2749] T d3370eb67fff4896b1f8e3ce56eceb9b P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:15.761580  2715 raft_consensus.cc:2749] T 78734884e0a441759b51d258ad2697aa P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:12:15.737490  2777 log.cc:927] Time spent T 0bd8fc2d57c14adeaeae16583eef7c84 P 0ec6a5d1452a41bd992a8c7922473b35: Append to log took a long time: real 0.065s	user 0.000s	sys 0.003s
I20260709 13:12:15.731212  2586 raft_consensus.cc:2749] T 12b5593f051548fea374da76afa08c3f P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:15.764756  2121 raft_consensus.cc:2468] T ddf48e4f6be64627a0ed06d6198ca054 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 2.
I20260709 13:12:15.766525  2392 tablet_bootstrap.cc:492] T df8d897471684531826528a5751d6246 P 66e9a8fffd4b4e5a81ca4fa2762773ea: No bootstrap required, opened a new log
I20260709 13:12:15.767998  2195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aac56f958fb4fe29fe46d2a9be60ffd" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:15.768421  2189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2993800f8e7e4c09bfe0b2be13e4394c" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
W20260709 13:12:15.778914  2238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 13:12:15.756120  2774 log.cc:927] Time spent T 00000000000000000000000000000000 P bab1ceb4d36d4793a27161880e6a7bf7: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
I20260709 13:12:15.768642  2736 raft_consensus.cc:493] T ee1baa7401cd48e48e7125dcd607f44f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.781774  2736 raft_consensus.cc:515] T ee1baa7401cd48e48e7125dcd607f44f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:15.782698  2198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddf48e4f6be64627a0ed06d6198ca054" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:15.783331  2198 raft_consensus.cc:3060] T ddf48e4f6be64627a0ed06d6198ca054 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.783733  2196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddf48e4f6be64627a0ed06d6198ca054" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:15.784740  2191 raft_consensus.cc:1240] T e259bf23e7904d9fb8b2345bb5b667f3 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Rejecting Update request from peer 79b6e57d59e4468ebe4423d871a31b39 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:15.785339  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2993800f8e7e4c09bfe0b2be13e4394c" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:15.786294  2195 raft_consensus.cc:1240] T 01a3c95e54104a998cdf16d06db2800a P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Rejecting Update request from peer 79b6e57d59e4468ebe4423d871a31b39 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:15.786867  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4edf26b74c5d4e5d9a33d2b1fc1bb0ae" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:15.787322  2189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3646d79bc840e9b4396f4351d1803d" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:15.770103  2401 leader_election.cc:290] T a9be6d55d1f348bcaf96405abc80244d P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 election: Requested vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:15.749564  2391 raft_consensus.cc:359] T a9be6d55d1f348bcaf96405abc80244d P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:15.788678  2391 raft_consensus.cc:385] T a9be6d55d1f348bcaf96405abc80244d P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:15.789119  2391 raft_consensus.cc:740] T a9be6d55d1f348bcaf96405abc80244d P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:15.773705  2310 leader_election.cc:304] T 765b8df93039426e925b94637a061cc2 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:15.776906  2236 leader_election.cc:304] T 427b10072083419c89d5a4bf5d6413fc P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b6e57d59e4468ebe4423d871a31b39; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea
I20260709 13:12:15.777979  2118 raft_consensus.cc:1240] T a0394490f6984f028daa10be921e242b P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Rejecting Update request from peer 79b6e57d59e4468ebe4423d871a31b39 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:15.783893  2736 leader_election.cc:290] T ee1baa7401cd48e48e7125dcd607f44f P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:15.791216  2310 leader_election.cc:304] T 12b5593f051548fea374da76afa08c3f P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:15.799132  2310 leader_election.cc:304] T a4a5ce298d24406ea94fb68aba5b37ae P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:15.769706  2392 ts_tablet_manager.cc:1403] T df8d897471684531826528a5751d6246 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent bootstrapping tablet: real 0.415s	user 0.010s	sys 0.033s
I20260709 13:12:15.794062  2198 raft_consensus.cc:2468] T ddf48e4f6be64627a0ed06d6198ca054 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 2.
I20260709 13:12:15.767057  2393 consensus_queue.cc:260] T 421302a9721e4cc9a86e52a183469a70 P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:15.800369  2310 leader_election.cc:304] T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:15.778242  2719 leader_election.cc:290] T ddf48e4f6be64627a0ed06d6198ca054 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 election: Requested vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:15.810338  2519 raft_consensus.cc:3060] T 427b10072083419c89d5a4bf5d6413fc P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.808213  2267 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1478f883c539464bb54fe9bff44148d5" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:15.812271  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a3c95e54104a998cdf16d06db2800a" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:15.814127  2198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee1baa7401cd48e48e7125dcd607f44f" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:15.814813  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bbfa12bce4430fa6e7e6abd281ded6" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:15.815457  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc42d18a324e4f6d97f07cf770c5daa8" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:15.815697  2116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc33c7c3cfd14ab7a99e39cfd971fc3c" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:15.816037  2346 raft_consensus.cc:3060] T bc42d18a324e4f6d97f07cf770c5daa8 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:12:15.816402  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e5bbfa12bce4430fa6e7e6abd281ded6" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:15.824878  2346 raft_consensus.cc:2468] T bc42d18a324e4f6d97f07cf770c5daa8 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 3.
I20260709 13:12:15.804258  2757 raft_consensus.cc:2749] T 12b5593f051548fea374da76afa08c3f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:15.818060  2721 raft_consensus.cc:493] T 7e3782f3d54b4a19bacbd125c31127a9 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.829923  2519 raft_consensus.cc:2749] T 427b10072083419c89d5a4bf5d6413fc P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:15.808563  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0fb3f7bf85419cbf7ecda4727ccb89" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:15.805212  2123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0fb3f7bf85419cbf7ecda4727ccb89" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:15.810634  2508 raft_consensus.cc:2749] T a4a5ce298d24406ea94fb68aba5b37ae P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:15.810505  2717 consensus_queue.cc:1059] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:12:15.832728  2590 raft_consensus.cc:515] T bdee3fd7553a47afae3ec9dbdce6d829 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:15.799611  2121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1478f883c539464bb54fe9bff44148d5" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:15.833674  2519 raft_consensus.cc:3055] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:15.834100  2519 raft_consensus.cc:740] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Running, Role: LEADER
I20260709 13:12:15.812198  2197 raft_consensus.cc:1240] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Rejecting Update request from peer 79b6e57d59e4468ebe4423d871a31b39 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:15.822494  2114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d627aa01fd4aefbbae482eb2fb2453" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:15.834986  2451 raft_consensus.cc:493] T 6bf4f728eedf41bdb027f554c3a5ae1f P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.807080  2120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddf48e4f6be64627a0ed06d6198ca054" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:15.788196  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a3c95e54104a998cdf16d06db2800a" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:15.835866  2120 raft_consensus.cc:2368] T ddf48e4f6be64627a0ed06d6198ca054 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec6a5d1452a41bd992a8c7922473b35 for earlier term 1. Current term is 2.
I20260709 13:12:15.798002  2649 raft_consensus.cc:2749] T 765b8df93039426e925b94637a061cc2 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:15.807819  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddf48e4f6be64627a0ed06d6198ca054" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:15.836695  2272 raft_consensus.cc:2368] T ddf48e4f6be64627a0ed06d6198ca054 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec6a5d1452a41bd992a8c7922473b35 for earlier term 1. Current term is 2.
I20260709 13:12:15.835450  2451 raft_consensus.cc:515] T 6bf4f728eedf41bdb027f554c3a5ae1f P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:15.814064  2339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d627aa01fd4aefbbae482eb2fb2453" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:15.821194  2391 consensus_queue.cc:260] T a9be6d55d1f348bcaf96405abc80244d P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:15.836846  2519 consensus_queue.cc:260] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:15.838724  2451 leader_election.cc:290] T 6bf4f728eedf41bdb027f554c3a5ae1f P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:15.839757  2391 ts_tablet_manager.cc:1434] T a9be6d55d1f348bcaf96405abc80244d P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.230s	user 0.009s	sys 0.001s
I20260709 13:12:15.840881  2391 tablet_bootstrap.cc:492] T b206de895e36490688cb2c1c537774a5 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:15.842757  2717 consensus_queue.cc:1048] T b206de895e36490688cb2c1c537774a5 P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:15.843583  2236 leader_election.cc:304] T 2e178ff57d964223aca095ceff76b339 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b6e57d59e4468ebe4423d871a31b39; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea
I20260709 13:12:15.844378  2717 raft_consensus.cc:2749] T 2e178ff57d964223aca095ceff76b339 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:15.831105  2721 raft_consensus.cc:515] T 7e3782f3d54b4a19bacbd125c31127a9 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:15.809661  2237 leader_election.cc:304] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b6e57d59e4468ebe4423d871a31b39; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:15.807399  2115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc42d18a324e4f6d97f07cf770c5daa8" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:15.846961  2115 raft_consensus.cc:2393] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec6a5d1452a41bd992a8c7922473b35 in current term 3: Already voted for candidate 2ac5c5682f914ed9b9982b5a080d5472 in this term.
I20260709 13:12:15.847083  2402 raft_consensus.cc:359] T d0d102459578474fbe77af94f3986a84 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:15.847779  2402 raft_consensus.cc:385] T d0d102459578474fbe77af94f3986a84 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:15.848043  2402 raft_consensus.cc:740] T d0d102459578474fbe77af94f3986a84 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Initialized, Role: FOLLOWER
I20260709 13:12:15.850665  2717 raft_consensus.cc:2749] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:15.857607  2238 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:15.862327  2755 raft_consensus.cc:493] T 421302a9721e4cc9a86e52a183469a70 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:15.862897  2755 raft_consensus.cc:515] T 421302a9721e4cc9a86e52a183469a70 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:15.803025  2193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b65903ab966485c9c65bdfbdf1e1054" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:15.829691  2393 ts_tablet_manager.cc:1434] T 421302a9721e4cc9a86e52a183469a70 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent starting tablet: real 0.258s	user 0.016s	sys 0.010s
I20260709 13:12:15.866492  2393 tablet_bootstrap.cc:492] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35: Bootstrap starting.
I20260709 13:12:15.827417  2758 raft_consensus.cc:515] T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:15.869234  2649 raft_consensus.cc:2749] T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:15.766656  2088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:38859, user_credentials={real_user=slave}} blocked reactor thread for 140752us
W20260709 13:12:15.874286  2088 leader_election.cc:343] T 622b6cfd76ff495ea6692a1ec0faefc4 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:15.844830  2590 leader_election.cc:290] T bdee3fd7553a47afae3ec9dbdce6d829 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 election: Requested vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:15.882695  2236 leader_election.cc:304] T 7e716da7cd3d4ad390e049dc845b8004 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b6e57d59e4468ebe4423d871a31b39; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea
W20260709 13:12:15.884194  2310 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:36557, user_credentials={real_user=slave}} blocked reactor thread for 83911.3us
W20260709 13:12:15.884904  2310 leader_election.cc:343] T 10de08c2346d47dbbd720596cd7e02fd P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:15.885290  2310 leader_election.cc:304] T 10de08c2346d47dbbd720596cd7e02fd P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:15.883276  2402 consensus_queue.cc:260] T d0d102459578474fbe77af94f3986a84 P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:15.890869  2392 raft_consensus.cc:359] T df8d897471684531826528a5751d6246 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:15.889355  2197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdee3fd7553a47afae3ec9dbdce6d829" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
W20260709 13:12:15.894701  2310 leader_election.cc:343] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:15.895215  2310 leader_election.cc:304] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:15.892305  2742 raft_consensus.cc:515] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
W20260709 13:12:15.887806  2237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:38859, user_credentials={real_user=slave}} blocked reactor thread for 78223us
I20260709 13:12:15.893571  2392 raft_consensus.cc:385] T df8d897471684531826528a5751d6246 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:12:15.899093  2162 leader_election.cc:343] T 38d5e9a8f42c4a2993d25a8a341fddbf P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:15.900242  2757 consensus_queue.cc:1059] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:15.901163  2310 leader_election.cc:304] T 0668be6a554b4c5f8bf93d0588a6bfcc P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:15.893093  2758 leader_election.cc:290] T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 election: Requested vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:15.893316  2519 raft_consensus.cc:3060] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.920735  2752 raft_consensus.cc:515] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:15.922221  2236 leader_election.cc:304] T a9be6d55d1f348bcaf96405abc80244d P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39; no voters: 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:15.914927  2392 raft_consensus.cc:740] T df8d897471684531826528a5751d6246 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:15.925328  2392 consensus_queue.cc:260] T df8d897471684531826528a5751d6246 P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:15.926220  2162 leader_election.cc:304] T 2993800f8e7e4c09bfe0b2be13e4394c P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:15.898799  2508 raft_consensus.cc:2749] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:15.897346  2649 raft_consensus.cc:2749] T 10de08c2346d47dbbd720596cd7e02fd P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:15.928974  2401 raft_consensus.cc:2749] T 0668be6a554b4c5f8bf93d0588a6bfcc P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:15.931674  2581 raft_consensus.cc:2804] T 2993800f8e7e4c09bfe0b2be13e4394c P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:15.932119  2581 raft_consensus.cc:493] T 2993800f8e7e4c09bfe0b2be13e4394c P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 79b6e57d59e4468ebe4423d871a31b39)
I20260709 13:12:15.932483  2581 raft_consensus.cc:3060] T 2993800f8e7e4c09bfe0b2be13e4394c P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:15.928400  2719 raft_consensus.cc:2804] T a9be6d55d1f348bcaf96405abc80244d P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:15.938743  2719 raft_consensus.cc:493] T a9be6d55d1f348bcaf96405abc80244d P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:15.939109  2719 raft_consensus.cc:3060] T a9be6d55d1f348bcaf96405abc80244d P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:15.929433  2310 leader_election.cc:304] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:15.930016  2402 ts_tablet_manager.cc:1434] T d0d102459578474fbe77af94f3986a84 P 79b6e57d59e4468ebe4423d871a31b39: Time spent starting tablet: real 0.326s	user 0.011s	sys 0.018s
I20260709 13:12:15.917471  2717 raft_consensus.cc:2749] T 7e716da7cd3d4ad390e049dc845b8004 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:15.942909  2310 leader_election.cc:343] T a9be6d55d1f348bcaf96405abc80244d P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:15.944383  2310 leader_election.cc:304] T 56bba8336a054d969e18859a84f180d6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:15.945660  2310 leader_election.cc:304] T 86834d94d1d64596abfa609754b5d58a P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:15.947001  2310 leader_election.cc:304] T a0394490f6984f028daa10be921e242b P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:15.951059  2721 leader_election.cc:290] T 7e3782f3d54b4a19bacbd125c31127a9 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:15.953102  2393 tablet_bootstrap.cc:654] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:15.955417  2391 tablet_bootstrap.cc:654] T b206de895e36490688cb2c1c537774a5 P 2ac5c5682f914ed9b9982b5a080d5472: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:15.948702  2726 raft_consensus.cc:2749] T 86834d94d1d64596abfa609754b5d58a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:15.958353  2392 ts_tablet_manager.cc:1434] T df8d897471684531826528a5751d6246 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent starting tablet: real 0.158s	user 0.008s	sys 0.000s
I20260709 13:12:15.959233  2755 leader_election.cc:290] T 421302a9721e4cc9a86e52a183469a70 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:15.944860  2649 raft_consensus.cc:2749] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:15.917079  2087 leader_election.cc:304] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 0ec6a5d1452a41bd992a8c7922473b35
W20260709 13:12:15.960986  2087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:38869, user_credentials={real_user=slave}} blocked reactor thread for 61865.2us
I20260709 13:12:15.959501  2392 tablet_bootstrap.cc:492] T 6bf4f728eedf41bdb027f554c3a5ae1f P 66e9a8fffd4b4e5a81ca4fa2762773ea: Bootstrap starting.
I20260709 13:12:15.963421  2310 leader_election.cc:304] T d3370eb67fff4896b1f8e3ce56eceb9b P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:15.964355  2310 leader_election.cc:304] T 7475d672f7b3489393d6202c8b31e47f P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:15.947721  2508 raft_consensus.cc:2749] T 56bba8336a054d969e18859a84f180d6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:15.966686  2649 raft_consensus.cc:2749] T a0394490f6984f028daa10be921e242b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:15.966209  2726 raft_consensus.cc:2749] T d3370eb67fff4896b1f8e3ce56eceb9b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:15.970485  2736 raft_consensus.cc:3055] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:15.970850  2736 raft_consensus.cc:740] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Running, Role: LEADER
I20260709 13:12:15.971477  2581 raft_consensus.cc:515] T 2993800f8e7e4c09bfe0b2be13e4394c P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:15.971596  2736 consensus_queue.cc:260] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:15.966044  2117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f2272230d34efa880d5eeed8859669" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:15.972735  2736 raft_consensus.cc:3060] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.975492  2752 leader_election.cc:290] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 election: Requested vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:15.947160  2237 leader_election.cc:304] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b6e57d59e4468ebe4423d871a31b39; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea
I20260709 13:12:15.978379  2717 raft_consensus.cc:2749] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:15.965641  2730 raft_consensus.cc:2804] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:15.979786  2237 leader_election.cc:304] T 8a672ef15abf47e4b650405c29044d3e P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b6e57d59e4468ebe4423d871a31b39; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea
I20260709 13:12:15.973512  2581 leader_election.cc:290] T 2993800f8e7e4c09bfe0b2be13e4394c P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 3 election: Requested vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:15.980003  2730 raft_consensus.cc:493] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:15.980734  2730 raft_consensus.cc:3060] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:15.977828  2115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d627aa01fd4aefbbae482eb2fb2453" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:15.966809  2757 raft_consensus.cc:2749] T 7475d672f7b3489393d6202c8b31e47f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:12:15.983282  2402 tablet_bootstrap.cc:492] T f9934bcaed6743b2a30104e13b8cf18b P 79b6e57d59e4468ebe4423d871a31b39: Bootstrap starting.
I20260709 13:12:15.984463  2122 raft_consensus.cc:1240] T 2e178ff57d964223aca095ceff76b339 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 LEADER]: Rejecting Update request from peer 66e9a8fffd4b4e5a81ca4fa2762773ea for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:15.961794  2087 leader_election.cc:304] T 28f2272230d34efa880d5eeed8859669 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472; no voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:15.985766  2586 raft_consensus.cc:3060] T 28f2272230d34efa880d5eeed8859669 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:15.986220  2087 leader_election.cc:304] T 427b10072083419c89d5a4bf5d6413fc P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472; no voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:15.986513  2742 leader_election.cc:290] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 election: Requested vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:15.988034  2189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b65903ab966485c9c65bdfbdf1e1054" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:15.988407  2730 raft_consensus.cc:515] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:15.989796  2758 raft_consensus.cc:2749] T 427b10072083419c89d5a4bf5d6413fc P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:12:15.994268  2717 raft_consensus.cc:2749] T 8a672ef15abf47e4b650405c29044d3e P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:16.006327  2719 raft_consensus.cc:515] T a9be6d55d1f348bcaf96405abc80244d P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:16.008342  2719 leader_election.cc:290] T a9be6d55d1f348bcaf96405abc80244d P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 election: Requested vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:16.009344  2310 leader_election.cc:400] T bc42d18a324e4f6d97f07cf770c5daa8 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Vote denied by peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557) with higher term. Message: Invalid argument: T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66e9a8fffd4b4e5a81ca4fa2762773ea for earlier term 2. Current term is 3.
I20260709 13:12:16.011045  2310 leader_election.cc:403] T bc42d18a324e4f6d97f07cf770c5daa8 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:16.011709  2742 raft_consensus.cc:2749] T bc42d18a324e4f6d97f07cf770c5daa8 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557) with higher term. Message: Invalid argument: T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66e9a8fffd4b4e5a81ca4fa2762773ea for earlier term 2. Current term is 3.
I20260709 13:12:16.012279  2586 raft_consensus.cc:2749] T 28f2272230d34efa880d5eeed8859669 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:16.013424  2310 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:36557, user_credentials={real_user=slave}} blocked reactor thread for 48336.3us
I20260709 13:12:16.014322  2742 consensus_queue.cc:1048] T 78734884e0a441759b51d258ad2697aa P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:16.016271  2730 leader_election.cc:290] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 election: Requested vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:16.017076  2310 leader_election.cc:304] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:16.018095  2189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a332070dcdff450b939e74ef5b68425a" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:16.018213  2237 leader_election.cc:304] T e5bbfa12bce4430fa6e7e6abd281ded6 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b6e57d59e4468ebe4423d871a31b39; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea
I20260709 13:12:16.018399  2742 raft_consensus.cc:2749] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:12:16.019640  2402 tablet_bootstrap.cc:654] T f9934bcaed6743b2a30104e13b8cf18b P 79b6e57d59e4468ebe4423d871a31b39: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:16.020135  2519 consensus_queue.cc:1059] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:16.020596  2339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0668be6a554b4c5f8bf93d0588a6bfcc" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:16.020689  2736 consensus_queue.cc:1059] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:16.021605  2519 raft_consensus.cc:3055] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:16.022003  2519 raft_consensus.cc:740] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Running, Role: LEADER
I20260709 13:12:16.022785  2519 consensus_queue.cc:260] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:16.023864  2519 raft_consensus.cc:3060] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:16.019698  2088 leader_election.cc:343] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:16.026108  2391 tablet_bootstrap.cc:492] T b206de895e36490688cb2c1c537774a5 P 2ac5c5682f914ed9b9982b5a080d5472: No bootstrap required, opened a new log
I20260709 13:12:16.026612  2391 ts_tablet_manager.cc:1403] T b206de895e36490688cb2c1c537774a5 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.186s	user 0.015s	sys 0.001s
I20260709 13:12:16.029170  2391 raft_consensus.cc:359] T b206de895e36490688cb2c1c537774a5 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:16.030016  2391 raft_consensus.cc:385] T b206de895e36490688cb2c1c537774a5 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:16.030426  2391 raft_consensus.cc:740] T b206de895e36490688cb2c1c537774a5 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:16.031919  2717 raft_consensus.cc:2749] T e5bbfa12bce4430fa6e7e6abd281ded6 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 13:12:16.035851  2162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:38869, user_credentials={real_user=slave}} blocked reactor thread for 108372us
W20260709 13:12:16.030516  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:38869, user_credentials={real_user=slave}} blocked reactor thread for 105212us
I20260709 13:12:16.037995  2236 leader_election.cc:304] T 5aac56f958fb4fe29fe46d2a9be60ffd P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b6e57d59e4468ebe4423d871a31b39; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea
I20260709 13:12:16.044706  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc42d18a324e4f6d97f07cf770c5daa8" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:16.045460  2346 raft_consensus.cc:2393] T bc42d18a324e4f6d97f07cf770c5daa8 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ac5c5682f914ed9b9982b5a080d5472 in current term 3: Already voted for candidate 0ec6a5d1452a41bd992a8c7922473b35 in this term.
I20260709 13:12:16.046587  2162 leader_election.cc:304] T bdee3fd7553a47afae3ec9dbdce6d829 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:16.047748  2162 leader_election.cc:304] T d7a50365dcc843f4a4f6bfb29a736f26 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea
I20260709 13:12:16.048491  2391 consensus_queue.cc:260] T b206de895e36490688cb2c1c537774a5 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
W20260709 13:12:16.051546  2236 leader_election.cc:343] T df8d897471684531826528a5751d6246 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:16.044085  2721 raft_consensus.cc:2749] T 5aac56f958fb4fe29fe46d2a9be60ffd P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:16.052381  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0394490f6984f028daa10be921e242b" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:16.054268  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9be6d55d1f348bcaf96405abc80244d" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:16.050606  2752 raft_consensus.cc:2804] T bdee3fd7553a47afae3ec9dbdce6d829 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:16.047137  2736 consensus_queue.cc:1243] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Peer 2ac5c5682f914ed9b9982b5a080d5472 log is divergent from this leader: its last log entry 2.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:12:16.055626  2272 raft_consensus.cc:1240] T 427b10072083419c89d5a4bf5d6413fc P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Rejecting Update request from peer 66e9a8fffd4b4e5a81ca4fa2762773ea for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:16.075954  2392 tablet_bootstrap.cc:654] T 6bf4f728eedf41bdb027f554c3a5ae1f P 66e9a8fffd4b4e5a81ca4fa2762773ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:16.054904  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdee3fd7553a47afae3ec9dbdce6d829" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:16.056595  2755 raft_consensus.cc:2749] T d7a50365dcc843f4a4f6bfb29a736f26 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:16.055099  2269 raft_consensus.cc:2393] T a9be6d55d1f348bcaf96405abc80244d P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in current term 1: Already voted for candidate 79b6e57d59e4468ebe4423d871a31b39 in this term.
I20260709 13:12:16.058152  2717 raft_consensus.cc:493] T d0d102459578474fbe77af94f3986a84 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.079018  2717 raft_consensus.cc:515] T d0d102459578474fbe77af94f3986a84 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:16.081005  2717 leader_election.cc:290] T d0d102459578474fbe77af94f3986a84 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:16.058420  2393 tablet_bootstrap.cc:492] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35: No bootstrap required, opened a new log
I20260709 13:12:16.052018  2236 leader_election.cc:304] T df8d897471684531826528a5751d6246 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b6e57d59e4468ebe4423d871a31b39; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea
I20260709 13:12:16.064384  2391 ts_tablet_manager.cc:1434] T b206de895e36490688cb2c1c537774a5 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260709 13:12:16.081848  2393 ts_tablet_manager.cc:1403] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent bootstrapping tablet: real 0.216s	user 0.011s	sys 0.016s
I20260709 13:12:16.083160  2162 leader_election.cc:304] T b3b82132c31545aab274c7cf3f77c277 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:16.060899  2115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee1baa7401cd48e48e7125dcd607f44f" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:16.061913  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86834d94d1d64596abfa609754b5d58a" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:16.056521  2752 raft_consensus.cc:493] T bdee3fd7553a47afae3ec9dbdce6d829 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79b6e57d59e4468ebe4423d871a31b39)
I20260709 13:12:16.084726  2752 raft_consensus.cc:3060] T bdee3fd7553a47afae3ec9dbdce6d829 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.083645  2717 raft_consensus.cc:2749] T df8d897471684531826528a5751d6246 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:16.086215  2391 tablet_bootstrap.cc:492] T d0d102459578474fbe77af94f3986a84 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:16.070012  2742 raft_consensus.cc:3055] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:16.088222  2742 raft_consensus.cc:740] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Running, Role: LEADER
I20260709 13:12:16.072743  2730 raft_consensus.cc:493] T a9be6d55d1f348bcaf96405abc80244d P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.089576  2730 raft_consensus.cc:515] T a9be6d55d1f348bcaf96405abc80244d P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:16.065625  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf4f728eedf41bdb027f554c3a5ae1f" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:16.089072  2393 raft_consensus.cc:359] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:16.091077  2393 raft_consensus.cc:385] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:16.091358  2393 raft_consensus.cc:740] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Initialized, Role: FOLLOWER
I20260709 13:12:16.091591  2730 leader_election.cc:290] T a9be6d55d1f348bcaf96405abc80244d P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:16.092100  2393 consensus_queue.cc:260] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:16.063151  2122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9be6d55d1f348bcaf96405abc80244d" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:16.089017  2742 consensus_queue.cc:260] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:16.096818  2310 leader_election.cc:304] T 28f2272230d34efa880d5eeed8859669 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:16.093837  2122 raft_consensus.cc:3060] T a9be6d55d1f348bcaf96405abc80244d P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:16.099442  2726 raft_consensus.cc:2749] T 28f2272230d34efa880d5eeed8859669 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:12:16.100904  2755 consensus_queue.cc:1048] T ee1baa7401cd48e48e7125dcd607f44f P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:16.101310  2310 leader_election.cc:304] T 2993800f8e7e4c09bfe0b2be13e4394c P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:16.102115  2757 raft_consensus.cc:2749] T 2993800f8e7e4c09bfe0b2be13e4394c P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:12:16.102396  2647 raft_consensus.cc:2804] T b3b82132c31545aab274c7cf3f77c277 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:16.102811  2647 raft_consensus.cc:493] T b3b82132c31545aab274c7cf3f77c277 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:16.103178  2647 raft_consensus.cc:3060] T b3b82132c31545aab274c7cf3f77c277 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.108417  2755 consensus_queue.cc:1048] T f9934bcaed6743b2a30104e13b8cf18b P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:16.110394  2310 leader_election.cc:304] T bdee3fd7553a47afae3ec9dbdce6d829 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:16.109980  2392 tablet_bootstrap.cc:492] T 6bf4f728eedf41bdb027f554c3a5ae1f P 66e9a8fffd4b4e5a81ca4fa2762773ea: No bootstrap required, opened a new log
I20260709 13:12:16.111514  2392 ts_tablet_manager.cc:1403] T 6bf4f728eedf41bdb027f554c3a5ae1f P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent bootstrapping tablet: real 0.152s	user 0.017s	sys 0.000s
I20260709 13:12:16.112924  2162 leader_election.cc:304] T bc42d18a324e4f6d97f07cf770c5daa8 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:16.113207  2310 leader_election.cc:304] T ee1baa7401cd48e48e7125dcd607f44f P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:16.102177  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b65903ab966485c9c65bdfbdf1e1054" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:16.111575  2236 leader_election.cc:304] T 56bba8336a054d969e18859a84f180d6 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b6e57d59e4468ebe4423d871a31b39; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea
I20260709 13:12:16.121850  2755 raft_consensus.cc:2804] T bc42d18a324e4f6d97f07cf770c5daa8 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:16.111863  2789 consensus_queue.cc:1048] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 13:12:16.118134  2721 consensus_queue.cc:1059] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.008s
I20260709 13:12:16.098965  2736 consensus_queue.cc:1059] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 13:12:16.126478  2721 raft_consensus.cc:3055] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:16.126819  2721 raft_consensus.cc:740] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Running, Role: LEADER
I20260709 13:12:16.111873  2726 raft_consensus.cc:2749] T bdee3fd7553a47afae3ec9dbdce6d829 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:12:16.128052  2393 ts_tablet_manager.cc:1434] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.000s
I20260709 13:12:16.127676  2721 consensus_queue.cc:260] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:16.128917  2721 raft_consensus.cc:3060] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.129343  2393 tablet_bootstrap.cc:492] T a4a5ce298d24406ea94fb68aba5b37ae P 0ec6a5d1452a41bd992a8c7922473b35: Bootstrap starting.
I20260709 13:12:16.121362  2788 raft_consensus.cc:2749] T 56bba8336a054d969e18859a84f180d6 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:16.108510  2717 consensus_queue.cc:1059] T 01a3c95e54104a998cdf16d06db2800a P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 13:12:16.132184  2717 raft_consensus.cc:3055] T 01a3c95e54104a998cdf16d06db2800a P 79b6e57d59e4468ebe4423d871a31b39 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:16.132544  2717 raft_consensus.cc:740] T 01a3c95e54104a998cdf16d06db2800a P 79b6e57d59e4468ebe4423d871a31b39 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Running, Role: LEADER
I20260709 13:12:16.127705  2391 tablet_bootstrap.cc:654] T d0d102459578474fbe77af94f3986a84 P 2ac5c5682f914ed9b9982b5a080d5472: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:16.136746  2788 consensus_queue.cc:1059] T 2993800f8e7e4c09bfe0b2be13e4394c P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:16.137607  2122 raft_consensus.cc:2468] T a9be6d55d1f348bcaf96405abc80244d P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 1.
I20260709 13:12:16.137854  2519 raft_consensus.cc:3055] T 2993800f8e7e4c09bfe0b2be13e4394c P 79b6e57d59e4468ebe4423d871a31b39 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:16.153995  2519 raft_consensus.cc:740] T 2993800f8e7e4c09bfe0b2be13e4394c P 79b6e57d59e4468ebe4423d871a31b39 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Running, Role: LEADER
I20260709 13:12:16.133405  2717 consensus_queue.cc:260] T 01a3c95e54104a998cdf16d06db2800a P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:16.154686  2519 consensus_queue.cc:260] T 2993800f8e7e4c09bfe0b2be13e4394c P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
W20260709 13:12:16.138612  2162 leader_election.cc:343] T 38d5e9a8f42c4a2993d25a8a341fddbf P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:16.139016  2120 raft_consensus.cc:1240] T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Rejecting Update request from peer 79b6e57d59e4468ebe4423d871a31b39 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:16.133811  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a332070dcdff450b939e74ef5b68425a" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:16.156036  2162 leader_election.cc:304] T 38d5e9a8f42c4a2993d25a8a341fddbf P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35; no voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:16.156392  2345 raft_consensus.cc:3060] T a332070dcdff450b939e74ef5b68425a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:16.156688  2392 raft_consensus.cc:359] T 6bf4f728eedf41bdb027f554c3a5ae1f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:16.157305  2392 raft_consensus.cc:385] T 6bf4f728eedf41bdb027f554c3a5ae1f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:16.157580  2392 raft_consensus.cc:740] T 6bf4f728eedf41bdb027f554c3a5ae1f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:16.157932  2519 raft_consensus.cc:3060] T 2993800f8e7e4c09bfe0b2be13e4394c P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:16.155036  2717 raft_consensus.cc:3060] T 01a3c95e54104a998cdf16d06db2800a P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.139840  2119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d102459578474fbe77af94f3986a84" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:16.162696  2116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9be6d55d1f348bcaf96405abc80244d" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:16.162853  2162 leader_election.cc:304] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:16.163219  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9be6d55d1f348bcaf96405abc80244d" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:16.141613  2742 raft_consensus.cc:3060] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.163612  2789 raft_consensus.cc:2749] T 38d5e9a8f42c4a2993d25a8a341fddbf P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:16.164011  2268 raft_consensus.cc:2393] T a9be6d55d1f348bcaf96405abc80244d P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ac5c5682f914ed9b9982b5a080d5472 in current term 1: Already voted for candidate 79b6e57d59e4468ebe4423d871a31b39 in this term.
W20260709 13:12:16.141716  2236 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:16.142195  2647 raft_consensus.cc:515] T b3b82132c31545aab274c7cf3f77c277 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:16.111630  2752 raft_consensus.cc:515] T bdee3fd7553a47afae3ec9dbdce6d829 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:16.121068  2508 raft_consensus.cc:2749] T ee1baa7401cd48e48e7125dcd607f44f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:16.143805  2402 tablet_bootstrap.cc:492] T f9934bcaed6743b2a30104e13b8cf18b P 79b6e57d59e4468ebe4423d871a31b39: No bootstrap required, opened a new log
I20260709 13:12:16.166828  2647 leader_election.cc:290] T b3b82132c31545aab274c7cf3f77c277 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 election: Requested vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:16.143574  2087 leader_election.cc:304] T 0668be6a554b4c5f8bf93d0588a6bfcc P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472; no voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:16.144553  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0394490f6984f028daa10be921e242b" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:16.167309  2402 ts_tablet_manager.cc:1403] T f9934bcaed6743b2a30104e13b8cf18b P 79b6e57d59e4468ebe4423d871a31b39: Time spent bootstrapping tablet: real 0.184s	user 0.012s	sys 0.013s
I20260709 13:12:16.144944  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622b6cfd76ff495ea6692a1ec0faefc4" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:16.145725  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf4f728eedf41bdb027f554c3a5ae1f" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:16.146229  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86834d94d1d64596abfa609754b5d58a" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:16.168377  2236 leader_election.cc:304] T ddf48e4f6be64627a0ed06d6198ca054 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:16.169364  2752 leader_election.cc:290] T bdee3fd7553a47afae3ec9dbdce6d829 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 election: Requested vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:16.122429  2755 raft_consensus.cc:697] T bc42d18a324e4f6d97f07cf770c5daa8 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 LEADER]: Becoming Leader. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Running, Role: LEADER
I20260709 13:12:16.144078  2018 catalog_manager.cc:5697] T d2f88787abb54ffea037f35cf48b22c4 P 0ec6a5d1452a41bd992a8c7922473b35 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66). New cstate: current_term: 1 leader_uuid: "0ec6a5d1452a41bd992a8c7922473b35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:16.152426  2310 leader_election.cc:304] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:16.158169  2392 consensus_queue.cc:260] T 6bf4f728eedf41bdb027f554c3a5ae1f P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:16.169588  2114 raft_consensus.cc:1240] T 28f2272230d34efa880d5eeed8859669 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Rejecting Update request from peer 79b6e57d59e4468ebe4423d871a31b39 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:16.183267  2018 catalog_manager.cc:5697] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 0ec6a5d1452a41bd992a8c7922473b35 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66). New cstate: current_term: 1 leader_uuid: "0ec6a5d1452a41bd992a8c7922473b35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:16.180975  2647 raft_consensus.cc:2749] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:16.184549  2730 raft_consensus.cc:2749] T 0668be6a554b4c5f8bf93d0588a6bfcc P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:16.154950  2393 tablet_bootstrap.cc:654] T a4a5ce298d24406ea94fb68aba5b37ae P 0ec6a5d1452a41bd992a8c7922473b35: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:16.169484  2719 raft_consensus.cc:2804] T ddf48e4f6be64627a0ed06d6198ca054 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:16.185449  2719 raft_consensus.cc:697] T ddf48e4f6be64627a0ed06d6198ca054 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 LEADER]: Becoming Leader. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Running, Role: LEADER
I20260709 13:12:16.167514  2123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3782f3d54b4a19bacbd125c31127a9" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:16.182363  2755 consensus_queue.cc:237] T bc42d18a324e4f6d97f07cf770c5daa8 P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:16.163451  2116 raft_consensus.cc:2393] T a9be6d55d1f348bcaf96405abc80244d P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 79b6e57d59e4468ebe4423d871a31b39 in current term 1: Already voted for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in this term.
I20260709 13:12:16.186362  2719 consensus_queue.cc:237] T ddf48e4f6be64627a0ed06d6198ca054 P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:16.169703  2795 consensus_queue.cc:1059] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
W20260709 13:12:16.163401  2237 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:16.182329  2649 raft_consensus.cc:2749] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:12:16.172923  2162 leader_election.cc:304] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39; no voters: 66e9a8fffd4b4e5a81ca4fa2762773ea
I20260709 13:12:16.196485  2162 leader_election.cc:304] T 0bd8fc2d57c14adeaeae16583eef7c84 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:16.167830  2197 raft_consensus.cc:1275] T 01a3c95e54104a998cdf16d06db2800a P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Refusing update from remote peer 66e9a8fffd4b4e5a81ca4fa2762773ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:16.197659  2392 ts_tablet_manager.cc:1434] T 6bf4f728eedf41bdb027f554c3a5ae1f P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent starting tablet: real 0.085s	user 0.011s	sys 0.002s
I20260709 13:12:16.197443  2310 leader_election.cc:304] T a9be6d55d1f348bcaf96405abc80244d P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:16.197544  2162 leader_election.cc:304] T 67db2f978ea64fbd9a32274d4ad374c9 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:16.197727  2018 catalog_manager.cc:5697] T f9934bcaed6743b2a30104e13b8cf18b P 0ec6a5d1452a41bd992a8c7922473b35 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66). New cstate: current_term: 1 leader_uuid: "0ec6a5d1452a41bd992a8c7922473b35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:16.198146  2647 raft_consensus.cc:2804] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:16.198843  2752 raft_consensus.cc:2749] T 0bd8fc2d57c14adeaeae16583eef7c84 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:16.199883  2647 raft_consensus.cc:493] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 66e9a8fffd4b4e5a81ca4fa2762773ea)
I20260709 13:12:16.201771  2647 raft_consensus.cc:3060] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.162883  2269 raft_consensus.cc:1275] T 2e178ff57d964223aca095ceff76b339 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Refusing update from remote peer 2ac5c5682f914ed9b9982b5a080d5472: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:12:16.202046  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:16.199836  2725 raft_consensus.cc:2804] T a9be6d55d1f348bcaf96405abc80244d P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:16.203490  2339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9be6d55d1f348bcaf96405abc80244d" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:16.204243  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a9be6d55d1f348bcaf96405abc80244d" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:16.205044  2162 leader_election.cc:304] T e259bf23e7904d9fb8b2345bb5b667f3 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:16.170018  2087 leader_election.cc:304] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea
I20260709 13:12:16.203408  2752 raft_consensus.cc:2749] T 67db2f978ea64fbd9a32274d4ad374c9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:16.206750  2162 leader_election.cc:304] T 8a672ef15abf47e4b650405c29044d3e P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35; no voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:16.208341  2789 raft_consensus.cc:2749] T 8a672ef15abf47e4b650405c29044d3e P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:16.208704  2392 tablet_bootstrap.cc:492] T bad0fdea1e3a409aab372c59eaa33767 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Bootstrap starting.
I20260709 13:12:16.208703  2162 leader_election.cc:304] T f2a1307186df4616a9759118c2e456a6 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35; no voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:16.209599  2789 raft_consensus.cc:2749] T f2a1307186df4616a9759118c2e456a6 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:16.210481  2162 consensus_peers.cc:597] T d2f88787abb54ffea037f35cf48b22c4 P 0ec6a5d1452a41bd992a8c7922473b35 -> Peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Couldn't send request to peer 79b6e57d59e4468ebe4423d871a31b39. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:16.207207  2402 raft_consensus.cc:359] T f9934bcaed6743b2a30104e13b8cf18b P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:16.211562  2162 leader_election.cc:304] T e5bbfa12bce4430fa6e7e6abd281ded6 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35; no voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:16.211930  2402 raft_consensus.cc:385] T f9934bcaed6743b2a30104e13b8cf18b P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:16.206931  2581 raft_consensus.cc:2749] T e259bf23e7904d9fb8b2345bb5b667f3 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:16.211104  2725 raft_consensus.cc:697] T a9be6d55d1f348bcaf96405abc80244d P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 LEADER]: Becoming Leader. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Running, Role: LEADER
I20260709 13:12:16.216233  2725 consensus_queue.cc:237] T a9be6d55d1f348bcaf96405abc80244d P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:16.217935  2649 consensus_queue.cc:1048] T 01a3c95e54104a998cdf16d06db2800a P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:16.221457  2162 leader_election.cc:304] T 01a3c95e54104a998cdf16d06db2800a P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35; no voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:16.212226  2402 raft_consensus.cc:740] T f9934bcaed6743b2a30104e13b8cf18b P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Initialized, Role: FOLLOWER
I20260709 13:12:16.226759  2402 consensus_queue.cc:260] T f9934bcaed6743b2a30104e13b8cf18b P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:16.227734  2162 leader_election.cc:400] T ddf48e4f6be64627a0ed06d6198ca054 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 election: Vote denied by peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303) with higher term. Message: Invalid argument: T ddf48e4f6be64627a0ed06d6198ca054 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec6a5d1452a41bd992a8c7922473b35 for earlier term 1. Current term is 2.
I20260709 13:12:16.229066  2162 leader_election.cc:403] T ddf48e4f6be64627a0ed06d6198ca054 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 election: Cancelling election due to peer responding with higher term
W20260709 13:12:16.230558  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:36557, user_credentials={real_user=slave}} blocked reactor thread for 60568.8us
I20260709 13:12:16.226711  2752 raft_consensus.cc:2749] T e5bbfa12bce4430fa6e7e6abd281ded6 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:16.228602  2730 raft_consensus.cc:2749] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 13:12:16.234894  2236 leader_election.cc:343] T d0d102459578474fbe77af94f3986a84 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:16.239033  2402 ts_tablet_manager.cc:1434] T f9934bcaed6743b2a30104e13b8cf18b P 79b6e57d59e4468ebe4423d871a31b39: Time spent starting tablet: real 0.071s	user 0.005s	sys 0.003s
I20260709 13:12:16.229723  2527 raft_consensus.cc:2749] T 01a3c95e54104a998cdf16d06db2800a P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:16.243744  2198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7e3782f3d54b4a19bacbd125c31127a9" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
W20260709 13:12:16.246892  2162 leader_election.cc:343] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:16.247079  2519 raft_consensus.cc:3055] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:16.247402  2519 raft_consensus.cc:740] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Running, Role: LEADER
I20260709 13:12:16.238200  2752 raft_consensus.cc:2749] T ddf48e4f6be64627a0ed06d6198ca054 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader election lost for term 1. Reason: Vote denied by peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303) with higher term. Message: Invalid argument: T ddf48e4f6be64627a0ed06d6198ca054 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec6a5d1452a41bd992a8c7922473b35 for earlier term 1. Current term is 2.
W20260709 13:12:16.236795  2087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:38869, user_credentials={real_user=slave}} blocked reactor thread for 66867.8us
I20260709 13:12:16.248986  2527 consensus_queue.cc:1048] T d2f88787abb54ffea037f35cf48b22c4 P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 13:12:16.252954  2120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b82132c31545aab274c7cf3f77c277" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:16.254611  2197 raft_consensus.cc:1275] T e259bf23e7904d9fb8b2345bb5b667f3 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Refusing update from remote peer 2ac5c5682f914ed9b9982b5a080d5472: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:16.263489  2391 tablet_bootstrap.cc:492] T d0d102459578474fbe77af94f3986a84 P 2ac5c5682f914ed9b9982b5a080d5472: No bootstrap required, opened a new log
I20260709 13:12:16.263911  2391 ts_tablet_manager.cc:1403] T d0d102459578474fbe77af94f3986a84 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.178s	user 0.016s	sys 0.010s
I20260709 13:12:16.264405  2519 consensus_queue.cc:260] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
W20260709 13:12:16.296684  2162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.65:36557, user_credentials={real_user=slave}} blocked reactor thread for 49809.9us
I20260709 13:12:16.259333  2193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d102459578474fbe77af94f3986a84" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:16.265264  2118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4edf26b74c5d4e5d9a33d2b1fc1bb0ae" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
W20260709 13:12:16.332017  2801 log.cc:927] Time spent T 78734884e0a441759b51d258ad2697aa P 66e9a8fffd4b4e5a81ca4fa2762773ea: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 13:12:16.346745  2519 raft_consensus.cc:3060] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.347572  2162 leader_election.cc:304] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:16.248746  2719 consensus_queue.cc:1059] T 86834d94d1d64596abfa609754b5d58a P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:12:16.250530  2789 raft_consensus.cc:493] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.350265  2266 raft_consensus.cc:3060] T f9934bcaed6743b2a30104e13b8cf18b P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:16.350140  2789 raft_consensus.cc:515] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:16.352357  2795 raft_consensus.cc:3055] T 86834d94d1d64596abfa609754b5d58a P 79b6e57d59e4468ebe4423d871a31b39 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:16.352728  2795 raft_consensus.cc:740] T 86834d94d1d64596abfa609754b5d58a P 79b6e57d59e4468ebe4423d871a31b39 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Running, Role: LEADER
I20260709 13:12:16.353567  2795 consensus_queue.cc:260] T 86834d94d1d64596abfa609754b5d58a P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:16.356076  2341 raft_consensus.cc:1275] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Refusing update from remote peer 2ac5c5682f914ed9b9982b5a080d5472: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:16.350417  2123 raft_consensus.cc:3060] T b206de895e36490688cb2c1c537774a5 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:16.341044  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "421302a9721e4cc9a86e52a183469a70" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:16.349422  2744 raft_consensus.cc:2749] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:12:16.343175  2339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "421302a9721e4cc9a86e52a183469a70" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:16.365933  2789 leader_election.cc:290] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:16.366343  2339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b82132c31545aab274c7cf3f77c277" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:16.366987  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4edf26b74c5d4e5d9a33d2b1fc1bb0ae" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:16.367786  2339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdee3fd7553a47afae3ec9dbdce6d829" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:16.345780  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2993800f8e7e4c09bfe0b2be13e4394c" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:16.368168  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdee3fd7553a47afae3ec9dbdce6d829" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:16.346946  2757 raft_consensus.cc:493] T df8d897471684531826528a5751d6246 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.369565  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2993800f8e7e4c09bfe0b2be13e4394c" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:16.370060  2757 raft_consensus.cc:515] T df8d897471684531826528a5751d6246 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
W20260709 13:12:16.368057  2087 leader_election.cc:343] T 6bf4f728eedf41bdb027f554c3a5ae1f P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:16.349620  2647 raft_consensus.cc:515] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:16.374248  2343 raft_consensus.cc:2393] T 2993800f8e7e4c09bfe0b2be13e4394c P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec6a5d1452a41bd992a8c7922473b35 in current term 3: Already voted for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in this term.
I20260709 13:12:16.362973  2162 leader_election.cc:304] T 1478f883c539464bb54fe9bff44148d5 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:16.344539  2345 raft_consensus.cc:2468] T a332070dcdff450b939e74ef5b68425a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 1.
I20260709 13:12:16.376103  2162 leader_election.cc:304] T 93d627aa01fd4aefbbae482eb2fb2453 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea
I20260709 13:12:16.369956  2391 raft_consensus.cc:359] T d0d102459578474fbe77af94f3986a84 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:16.377964  2391 raft_consensus.cc:385] T d0d102459578474fbe77af94f3986a84 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:16.378258  2391 raft_consensus.cc:740] T d0d102459578474fbe77af94f3986a84 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:16.379748  2162 leader_election.cc:400] T ddf48e4f6be64627a0ed06d6198ca054 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 election: Vote denied by peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557) with higher term. Message: Invalid argument: T ddf48e4f6be64627a0ed06d6198ca054 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec6a5d1452a41bd992a8c7922473b35 for earlier term 1. Current term is 2.
I20260709 13:12:16.380086  2402 tablet_bootstrap.cc:492] T 38d5e9a8f42c4a2993d25a8a341fddbf P 79b6e57d59e4468ebe4423d871a31b39: Bootstrap starting.
I20260709 13:12:16.386000  2237 leader_election.cc:304] T 5c3646d79bc840e9b4396f4351d1803d P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b6e57d59e4468ebe4423d871a31b39; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:16.386667  2719 raft_consensus.cc:2749] T 5c3646d79bc840e9b4396f4351d1803d P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:16.379963  2527 raft_consensus.cc:2749] T 1478f883c539464bb54fe9bff44148d5 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:12:16.395527  2391 consensus_queue.cc:260] T d0d102459578474fbe77af94f3986a84 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:16.382128  2789 raft_consensus.cc:2749] T 93d627aa01fd4aefbbae482eb2fb2453 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:16.398077  2162 consensus_peers.cc:597] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 0ec6a5d1452a41bd992a8c7922473b35 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:16.400872  2162 leader_election.cc:343] T 421302a9721e4cc9a86e52a183469a70 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:16.401695  2162 leader_election.cc:304] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:16.403854  2752 raft_consensus.cc:2749] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 13:12:16.405421  2235 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:16.406167  2120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ad60fa3bce47daac74b01143b54132" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:16.408344  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ad60fa3bce47daac74b01143b54132" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:16.410064  2811 consensus_queue.cc:1059] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:16.403944  2337 raft_consensus.cc:1240] T bdee3fd7553a47afae3ec9dbdce6d829 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Rejecting Update request from peer 79b6e57d59e4468ebe4423d871a31b39 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:16.411999  2757 leader_election.cc:290] T df8d897471684531826528a5751d6246 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:16.411155  2811 raft_consensus.cc:3055] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:16.418206  2811 raft_consensus.cc:740] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Running, Role: LEADER
W20260709 13:12:16.457273  2162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:34303, user_credentials={real_user=slave}} blocked reactor thread for 55397.6us
W20260709 13:12:16.458416  2162 leader_election.cc:343] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:16.459678  2162 leader_election.cc:343] T 421302a9721e4cc9a86e52a183469a70 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:16.460201  2162 leader_election.cc:304] T 421302a9721e4cc9a86e52a183469a70 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35; no voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:16.460260  2393 tablet_bootstrap.cc:492] T a4a5ce298d24406ea94fb68aba5b37ae P 0ec6a5d1452a41bd992a8c7922473b35: No bootstrap required, opened a new log
I20260709 13:12:16.461211  2393 ts_tablet_manager.cc:1403] T a4a5ce298d24406ea94fb68aba5b37ae P 0ec6a5d1452a41bd992a8c7922473b35: Time spent bootstrapping tablet: real 0.332s	user 0.010s	sys 0.015s
I20260709 13:12:16.461418  2162 leader_election.cc:304] T b3b82132c31545aab274c7cf3f77c277 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea
I20260709 13:12:16.452829  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df8d897471684531826528a5751d6246" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
W20260709 13:12:16.467406  2162 leader_election.cc:343] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:16.467873  2162 leader_election.cc:304] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:16.462637  2744 raft_consensus.cc:2749] T 421302a9721e4cc9a86e52a183469a70 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:16.464473  2581 raft_consensus.cc:2749] T b3b82132c31545aab274c7cf3f77c277 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:12:16.451864  2237 leader_election.cc:304] T 8b65903ab966485c9c65bdfbdf1e1054 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b6e57d59e4468ebe4423d871a31b39; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea
I20260709 13:12:16.471702  2337 raft_consensus.cc:1240] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Rejecting Update request from peer 0ec6a5d1452a41bd992a8c7922473b35 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:16.475786  2391 ts_tablet_manager.cc:1434] T d0d102459578474fbe77af94f3986a84 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.212s	user 0.026s	sys 0.006s
I20260709 13:12:16.471868  2752 raft_consensus.cc:2749] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:16.472853  2647 leader_election.cc:290] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 election: Requested vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
W20260709 13:12:16.473481  2803 log.cc:927] Time spent T b206de895e36490688cb2c1c537774a5 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 13:12:16.480054  2519 raft_consensus.cc:2749] T 8b65903ab966485c9c65bdfbdf1e1054 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:16.482336  2237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:38859, user_credentials={real_user=slave}} blocked reactor thread for 60566.1us
I20260709 13:12:16.483134  2237 leader_election.cc:304] T 7e3782f3d54b4a19bacbd125c31127a9 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b6e57d59e4468ebe4423d871a31b39; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472
W20260709 13:12:16.484279  2237 leader_election.cc:343] T d0d102459578474fbe77af94f3986a84 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:16.484697  2237 leader_election.cc:304] T d0d102459578474fbe77af94f3986a84 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b6e57d59e4468ebe4423d871a31b39; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:16.466755  2265 raft_consensus.cc:2468] T df8d897471684531826528a5751d6246 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 0.
I20260709 13:12:16.486249  2719 raft_consensus.cc:2749] T 7e3782f3d54b4a19bacbd125c31127a9 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:16.486943  2719 raft_consensus.cc:2749] T d0d102459578474fbe77af94f3986a84 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:16.485489  2343 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f0f1b0143c4363a9b900eae4ac3ea9" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:16.487788  2310 leader_election.cc:304] T df8d897471684531826528a5751d6246 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:16.488438  2343 raft_consensus.cc:1240] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Rejecting Update request from peer 2ac5c5682f914ed9b9982b5a080d5472 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:16.489303  2508 raft_consensus.cc:2804] T df8d897471684531826528a5751d6246 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:16.489679  2508 raft_consensus.cc:493] T df8d897471684531826528a5751d6246 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:16.489871  2795 raft_consensus.cc:3060] T 86834d94d1d64596abfa609754b5d58a P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.491605  2271 raft_consensus.cc:1275] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Refusing update from remote peer 2ac5c5682f914ed9b9982b5a080d5472: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:16.492879  2811 consensus_queue.cc:260] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:16.489789  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f0f1b0143c4363a9b900eae4ac3ea9" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:16.495394  2811 raft_consensus.cc:3060] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:16.496347  2810 log.cc:927] Time spent T bc42d18a324e4f6d97f07cf770c5daa8 P 0ec6a5d1452a41bd992a8c7922473b35: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260709 13:12:16.496585  2392 tablet_bootstrap.cc:654] T bad0fdea1e3a409aab372c59eaa33767 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:16.493858  2508 raft_consensus.cc:3060] T df8d897471684531826528a5751d6246 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:16.493592  2402 tablet_bootstrap.cc:654] T 38d5e9a8f42c4a2993d25a8a341fddbf P 79b6e57d59e4468ebe4423d871a31b39: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:16.457012  2088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:38859, user_credentials={real_user=slave}} blocked reactor thread for 80710.1us
I20260709 13:12:16.493264  2269 raft_consensus.cc:2468] T 2993800f8e7e4c09bfe0b2be13e4394c P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 3.
I20260709 13:12:16.518932  2162 leader_election.cc:304] T 2993800f8e7e4c09bfe0b2be13e4394c P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39; no voters: 66e9a8fffd4b4e5a81ca4fa2762773ea
I20260709 13:12:16.520262  2236 leader_election.cc:304] T a9be6d55d1f348bcaf96405abc80244d P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b6e57d59e4468ebe4423d871a31b39; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea
I20260709 13:12:16.507273  2391 tablet_bootstrap.cc:492] T 10de08c2346d47dbbd720596cd7e02fd P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:16.509608  2193 raft_consensus.cc:1240] T bdee3fd7553a47afae3ec9dbdce6d829 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Rejecting Update request from peer 79b6e57d59e4468ebe4423d871a31b39 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:16.500769  2717 raft_consensus.cc:493] T f9934bcaed6743b2a30104e13b8cf18b P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.525188  2519 raft_consensus.cc:2749] T a9be6d55d1f348bcaf96405abc80244d P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:16.506656  2757 raft_consensus.cc:493] T 6bf4f728eedf41bdb027f554c3a5ae1f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.529063  2744 raft_consensus.cc:2804] T 2993800f8e7e4c09bfe0b2be13e4394c P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:12:16.538201  2813 log.cc:927] Time spent T a4a5ce298d24406ea94fb68aba5b37ae P 2ac5c5682f914ed9b9982b5a080d5472: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 13:12:16.538589  2087 leader_election.cc:304] T a9be6d55d1f348bcaf96405abc80244d P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472; no voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39
W20260709 13:12:16.539011  2809 log.cc:927] Time spent T a9be6d55d1f348bcaf96405abc80244d P 66e9a8fffd4b4e5a81ca4fa2762773ea: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:12:16.540289  2162 leader_election.cc:304] T bdee3fd7553a47afae3ec9dbdce6d829 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35; no voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:16.547008  2162 leader_election.cc:304] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35; no voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:16.528096  2717 raft_consensus.cc:515] T f9934bcaed6743b2a30104e13b8cf18b P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:16.531090  2805 consensus_queue.cc:1059] T bdee3fd7553a47afae3ec9dbdce6d829 P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 13:12:16.546319  2197 raft_consensus.cc:1240] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Rejecting Update request from peer 79b6e57d59e4468ebe4423d871a31b39 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:16.554278  2816 raft_consensus.cc:493] T b206de895e36490688cb2c1c537774a5 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b6e57d59e4468ebe4423d871a31b39)
I20260709 13:12:16.560246  2816 raft_consensus.cc:515] T b206de895e36490688cb2c1c537774a5 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:16.560644  2266 raft_consensus.cc:1275] T 01a3c95e54104a998cdf16d06db2800a P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Refusing update from remote peer 66e9a8fffd4b4e5a81ca4fa2762773ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:16.562017  2118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df8d897471684531826528a5751d6246" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:16.546701  2744 raft_consensus.cc:697] T 2993800f8e7e4c09bfe0b2be13e4394c P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 LEADER]: Becoming Leader. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Running, Role: LEADER
I20260709 13:12:16.563410  2744 consensus_queue.cc:237] T 2993800f8e7e4c09bfe0b2be13e4394c P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:16.556357  2393 raft_consensus.cc:359] T a4a5ce298d24406ea94fb68aba5b37ae P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:16.566066  2393 raft_consensus.cc:385] T a4a5ce298d24406ea94fb68aba5b37ae P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:16.547870  2714 raft_consensus.cc:2749] T a9be6d55d1f348bcaf96405abc80244d P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:16.551106  2815 consensus_queue.cc:1048] T f9934bcaed6743b2a30104e13b8cf18b P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.019s
I20260709 13:12:16.549739  2647 raft_consensus.cc:2749] T bdee3fd7553a47afae3ec9dbdce6d829 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:12:16.553115  2527 raft_consensus.cc:2749] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:12:16.559593  2581 consensus_queue.cc:1059] T 8b65903ab966485c9c65bdfbdf1e1054 P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:16.536271  2757 raft_consensus.cc:515] T 6bf4f728eedf41bdb027f554c3a5ae1f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:16.568028  2789 raft_consensus.cc:3055] T 8b65903ab966485c9c65bdfbdf1e1054 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:16.568408  2789 raft_consensus.cc:740] T 8b65903ab966485c9c65bdfbdf1e1054 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Running, Role: LEADER
I20260709 13:12:16.568919  2757 leader_election.cc:290] T 6bf4f728eedf41bdb027f554c3a5ae1f P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:16.566383  2393 raft_consensus.cc:740] T a4a5ce298d24406ea94fb68aba5b37ae P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Initialized, Role: FOLLOWER
I20260709 13:12:16.569571  2195 raft_consensus.cc:1240] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Rejecting Update request from peer 66e9a8fffd4b4e5a81ca4fa2762773ea for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:16.569165  2789 consensus_queue.cc:260] T 8b65903ab966485c9c65bdfbdf1e1054 P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:16.565976  2087 leader_election.cc:304] T a0394490f6984f028daa10be921e242b P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472; no voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39
W20260709 13:12:16.571920  2087 leader_election.cc:343] T 6bf4f728eedf41bdb027f554c3a5ae1f P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:16.572346  2087 leader_election.cc:304] T 6bf4f728eedf41bdb027f554c3a5ae1f P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472; no voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:16.569744  2393 consensus_queue.cc:260] T a4a5ce298d24406ea94fb68aba5b37ae P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
W20260709 13:12:16.570739  2808 log.cc:927] Time spent T ee1baa7401cd48e48e7125dcd607f44f P 66e9a8fffd4b4e5a81ca4fa2762773ea: Append to log took a long time: real 0.216s	user 0.002s	sys 0.000s
W20260709 13:12:16.578866  2310 leader_election.cc:343] T df8d897471684531826528a5751d6246 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:16.576459  2649 consensus_queue.cc:1059] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:12:16.580744  2757 consensus_queue.cc:1048] T 01a3c95e54104a998cdf16d06db2800a P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:16.581976  2726 raft_consensus.cc:3055] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:16.582409  2726 raft_consensus.cc:740] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Running, Role: LEADER
I20260709 13:12:16.583246  2726 consensus_queue.cc:260] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:16.584451  2726 raft_consensus.cc:3060] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.566438  2191 raft_consensus.cc:1275] T 67db2f978ea64fbd9a32274d4ad374c9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Refusing update from remote peer 2ac5c5682f914ed9b9982b5a080d5472: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:12:16.575690  2812 log.cc:927] Time spent T dc33c7c3cfd14ab7a99e39cfd971fc3c P 66e9a8fffd4b4e5a81ca4fa2762773ea: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 13:12:16.576749  2714 raft_consensus.cc:2749] T a0394490f6984f028daa10be921e242b P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:12:16.589453  2717 leader_election.cc:290] T f9934bcaed6743b2a30104e13b8cf18b P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:16.590457  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9934bcaed6743b2a30104e13b8cf18b" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:16.590592  2816 leader_election.cc:290] T b206de895e36490688cb2c1c537774a5 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:16.562767  2586 consensus_queue.cc:1048] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 13:12:16.601732  2087 leader_election.cc:304] T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472; no voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:16.592320  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf4f728eedf41bdb027f554c3a5ae1f" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
W20260709 13:12:16.602917  2087 leader_election.cc:343] T 622b6cfd76ff495ea6692a1ec0faefc4 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:16.603353  2087 leader_election.cc:304] T 622b6cfd76ff495ea6692a1ec0faefc4 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:16.594038  2818 raft_consensus.cc:2749] T 6bf4f728eedf41bdb027f554c3a5ae1f P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:16.595809  2392 tablet_bootstrap.cc:492] T bad0fdea1e3a409aab372c59eaa33767 P 66e9a8fffd4b4e5a81ca4fa2762773ea: No bootstrap required, opened a new log
I20260709 13:12:16.602939  2586 raft_consensus.cc:2749] T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:12:16.604231  2392 ts_tablet_manager.cc:1403] T bad0fdea1e3a409aab372c59eaa33767 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent bootstrapping tablet: real 0.396s	user 0.020s	sys 0.003s
I20260709 13:12:16.551000  2508 raft_consensus.cc:515] T df8d897471684531826528a5751d6246 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:16.598150  2393 ts_tablet_manager.cc:1434] T a4a5ce298d24406ea94fb68aba5b37ae P 0ec6a5d1452a41bd992a8c7922473b35: Time spent starting tablet: real 0.137s	user 0.007s	sys 0.000s
W20260709 13:12:16.604761  2310 leader_election.cc:343] T 6bf4f728eedf41bdb027f554c3a5ae1f P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:16.598904  2118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf4f728eedf41bdb027f554c3a5ae1f" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:16.600457  2451 consensus_queue.cc:1048] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:16.596386  2795 raft_consensus.cc:3055] T bdee3fd7553a47afae3ec9dbdce6d829 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:16.607301  2795 raft_consensus.cc:740] T bdee3fd7553a47afae3ec9dbdce6d829 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Running, Role: LEADER
I20260709 13:12:16.610415  2795 consensus_queue.cc:260] T bdee3fd7553a47afae3ec9dbdce6d829 P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:16.609531  2118 raft_consensus.cc:2468] T 6bf4f728eedf41bdb027f554c3a5ae1f P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 0.
I20260709 13:12:16.618511  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df8d897471684531826528a5751d6246" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:16.618712  2795 raft_consensus.cc:3060] T bdee3fd7553a47afae3ec9dbdce6d829 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.619593  2310 leader_election.cc:304] T 6bf4f728eedf41bdb027f554c3a5ae1f P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:16.619305  2269 raft_consensus.cc:3060] T df8d897471684531826528a5751d6246 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:16.619598  2393 tablet_bootstrap.cc:492] T 622b6cfd76ff495ea6692a1ec0faefc4 P 0ec6a5d1452a41bd992a8c7922473b35: Bootstrap starting.
I20260709 13:12:16.625269  2391 tablet_bootstrap.cc:654] T 10de08c2346d47dbbd720596cd7e02fd P 2ac5c5682f914ed9b9982b5a080d5472: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:16.625872  2649 raft_consensus.cc:2804] T 6bf4f728eedf41bdb027f554c3a5ae1f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:16.626273  2649 raft_consensus.cc:493] T 6bf4f728eedf41bdb027f554c3a5ae1f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:16.626596  2649 raft_consensus.cc:3060] T 6bf4f728eedf41bdb027f554c3a5ae1f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:16.613013  2816 raft_consensus.cc:2749] T 622b6cfd76ff495ea6692a1ec0faefc4 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:16.637650  2402 tablet_bootstrap.cc:492] T 38d5e9a8f42c4a2993d25a8a341fddbf P 79b6e57d59e4468ebe4423d871a31b39: No bootstrap required, opened a new log
I20260709 13:12:16.638178  2402 ts_tablet_manager.cc:1403] T 38d5e9a8f42c4a2993d25a8a341fddbf P 79b6e57d59e4468ebe4423d871a31b39: Time spent bootstrapping tablet: real 0.281s	user 0.017s	sys 0.006s
W20260709 13:12:16.639003  2162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:38869, user_credentials={real_user=slave}} blocked reactor thread for 90737.4us
I20260709 13:12:16.642936  2118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df8d897471684531826528a5751d6246" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:16.635128  2508 leader_election.cc:290] T df8d897471684531826528a5751d6246 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 election: Requested vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
W20260709 13:12:16.645035  2310 leader_election.cc:343] T df8d897471684531826528a5751d6246 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:16.646224  2451 consensus_queue.cc:1048] T 2e178ff57d964223aca095ceff76b339 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260709 13:12:16.651069  2789 raft_consensus.cc:3060] T 8b65903ab966485c9c65bdfbdf1e1054 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.652933  2717 consensus_queue.cc:1059] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:16.654337  2719 raft_consensus.cc:3055] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 79b6e57d59e4468ebe4423d871a31b39 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:16.654703  2719 raft_consensus.cc:740] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 79b6e57d59e4468ebe4423d871a31b39 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Running, Role: LEADER
I20260709 13:12:16.655532  2719 consensus_queue.cc:260] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:16.656848  2719 raft_consensus.cc:3060] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:16.674541  2393 tablet_bootstrap.cc:654] T 622b6cfd76ff495ea6692a1ec0faefc4 P 0ec6a5d1452a41bd992a8c7922473b35: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:16.676005  2195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f9934bcaed6743b2a30104e13b8cf18b" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:16.677181  2120 raft_consensus.cc:1275] T ddf48e4f6be64627a0ed06d6198ca054 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Refusing update from remote peer 79b6e57d59e4468ebe4423d871a31b39: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:12:16.664822  2265 raft_consensus.cc:3060] T 7e3782f3d54b4a19bacbd125c31127a9 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:16.680859  2392 raft_consensus.cc:359] T bad0fdea1e3a409aab372c59eaa33767 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:16.688019  2017 catalog_manager.cc:5697] T 01a3c95e54104a998cdf16d06db2800a P 66e9a8fffd4b4e5a81ca4fa2762773ea reported cstate change: term changed from 1 to 2, leader changed from 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67) to 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68). New cstate: current_term: 2 leader_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:16.689451  2586 consensus_queue.cc:1048] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:16.692240  2337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b206de895e36490688cb2c1c537774a5" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:16.675872  2508 consensus_queue.cc:1048] T a9be6d55d1f348bcaf96405abc80244d P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:16.705286  2392 raft_consensus.cc:385] T bad0fdea1e3a409aab372c59eaa33767 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:16.710155  2392 raft_consensus.cc:740] T bad0fdea1e3a409aab372c59eaa33767 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:16.697098  2266 raft_consensus.cc:1275] T e259bf23e7904d9fb8b2345bb5b667f3 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Refusing update from remote peer 2ac5c5682f914ed9b9982b5a080d5472: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:16.696427  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b206de895e36490688cb2c1c537774a5" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:16.694518  2195 raft_consensus.cc:1240] T b3b82132c31545aab274c7cf3f77c277 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Rejecting Update request from peer 2ac5c5682f914ed9b9982b5a080d5472 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:16.722020  2392 consensus_queue.cc:260] T bad0fdea1e3a409aab372c59eaa33767 P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:16.748294  2811 consensus_queue.cc:1048] T ddf48e4f6be64627a0ed06d6198ca054 P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 13:12:16.694458  2087 leader_election.cc:304] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 0ec6a5d1452a41bd992a8c7922473b35
I20260709 13:12:16.766002  2392 ts_tablet_manager.cc:1434] T bad0fdea1e3a409aab372c59eaa33767 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent starting tablet: real 0.161s	user 0.007s	sys 0.001s
W20260709 13:12:16.770452  2823 log.cc:927] Time spent T f9934bcaed6743b2a30104e13b8cf18b P 66e9a8fffd4b4e5a81ca4fa2762773ea: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 13:12:16.772902  2649 raft_consensus.cc:515] T 6bf4f728eedf41bdb027f554c3a5ae1f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:16.775089  2649 leader_election.cc:290] T 6bf4f728eedf41bdb027f554c3a5ae1f P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 election: Requested vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:16.775626  2714 raft_consensus.cc:2804] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:16.776187  2714 raft_consensus.cc:697] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 LEADER]: Becoming Leader. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Running, Role: LEADER
I20260709 13:12:16.777012  2714 consensus_queue.cc:237] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:16.778997  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf4f728eedf41bdb027f554c3a5ae1f" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
W20260709 13:12:16.781209  2310 leader_election.cc:343] T 6bf4f728eedf41bdb027f554c3a5ae1f P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:16.782492  2114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf4f728eedf41bdb027f554c3a5ae1f" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:16.783052  2114 raft_consensus.cc:3060] T 6bf4f728eedf41bdb027f554c3a5ae1f P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:16.784574  2340 raft_consensus.cc:1275] T bc42d18a324e4f6d97f07cf770c5daa8 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Refusing update from remote peer 0ec6a5d1452a41bd992a8c7922473b35: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:16.787596  2730 raft_consensus.cc:493] T d0d102459578474fbe77af94f3986a84 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.788095  2730 raft_consensus.cc:515] T d0d102459578474fbe77af94f3986a84 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:16.767550  2402 raft_consensus.cc:359] T 38d5e9a8f42c4a2993d25a8a341fddbf P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:16.797571  2402 raft_consensus.cc:385] T 38d5e9a8f42c4a2993d25a8a341fddbf P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:16.797909  2402 raft_consensus.cc:740] T 38d5e9a8f42c4a2993d25a8a341fddbf P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Initialized, Role: FOLLOWER
I20260709 13:12:16.807397  2402 consensus_queue.cc:260] T 38d5e9a8f42c4a2993d25a8a341fddbf P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:16.740787  2237 leader_election.cc:304] T f9934bcaed6743b2a30104e13b8cf18b P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b6e57d59e4468ebe4423d871a31b39; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea
I20260709 13:12:16.832409  2392 tablet_bootstrap.cc:492] T d4e943e5bbd7402da6bcc00db70cec14 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Bootstrap starting.
I20260709 13:12:16.811146  2269 raft_consensus.cc:2468] T df8d897471684531826528a5751d6246 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 1.
W20260709 13:12:16.813611  2087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:38869, user_credentials={real_user=slave}} blocked reactor thread for 119234us
I20260709 13:12:16.827422  2811 raft_consensus.cc:2749] T f9934bcaed6743b2a30104e13b8cf18b P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:16.861792  2310 leader_election.cc:304] T df8d897471684531826528a5751d6246 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39; no voters: 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:16.825609  2755 consensus_queue.cc:1048] T bc42d18a324e4f6d97f07cf770c5daa8 P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
W20260709 13:12:16.842381  2237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:38859, user_credentials={real_user=slave}} blocked reactor thread for 132457us
I20260709 13:12:16.856971  2730 leader_election.cc:290] T d0d102459578474fbe77af94f3986a84 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:16.861946  2581 raft_consensus.cc:493] T a4a5ce298d24406ea94fb68aba5b37ae P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.876356  2402 ts_tablet_manager.cc:1434] T 38d5e9a8f42c4a2993d25a8a341fddbf P 79b6e57d59e4468ebe4423d871a31b39: Time spent starting tablet: real 0.238s	user 0.008s	sys 0.000s
I20260709 13:12:16.859117  2816 consensus_queue.cc:1059] T b3b82132c31545aab274c7cf3f77c277 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.015s
I20260709 13:12:16.882568  2391 tablet_bootstrap.cc:492] T 10de08c2346d47dbbd720596cd7e02fd P 2ac5c5682f914ed9b9982b5a080d5472: No bootstrap required, opened a new log
I20260709 13:12:16.882946  2391 ts_tablet_manager.cc:1403] T 10de08c2346d47dbbd720596cd7e02fd P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.378s	user 0.036s	sys 0.025s
I20260709 13:12:16.878669  2839 raft_consensus.cc:2804] T df8d897471684531826528a5751d6246 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:16.884214  2839 raft_consensus.cc:697] T df8d897471684531826528a5751d6246 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 LEADER]: Becoming Leader. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Running, Role: LEADER
I20260709 13:12:16.884996  2839 consensus_queue.cc:237] T df8d897471684531826528a5751d6246 P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:16.872573  2195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d102459578474fbe77af94f3986a84" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:16.873881  2114 raft_consensus.cc:2468] T 6bf4f728eedf41bdb027f554c3a5ae1f P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 1.
I20260709 13:12:16.901897  2451 consensus_queue.cc:1048] T 2e178ff57d964223aca095ceff76b339 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:16.905486  2402 tablet_bootstrap.cc:492] T d1ddcfd4d0914e40ae0a684fd8726d24 P 79b6e57d59e4468ebe4423d871a31b39: Bootstrap starting.
I20260709 13:12:16.875623  2820 consensus_queue.cc:1059] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:12:16.879545  2581 raft_consensus.cc:515] T a4a5ce298d24406ea94fb68aba5b37ae P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
W20260709 13:12:16.901904  2833 log.cc:927] Time spent T 2993800f8e7e4c09bfe0b2be13e4394c P 0ec6a5d1452a41bd992a8c7922473b35: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 13:12:16.912968  2391 raft_consensus.cc:359] T 10de08c2346d47dbbd720596cd7e02fd P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:16.913647  2391 raft_consensus.cc:385] T 10de08c2346d47dbbd720596cd7e02fd P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:16.914031  2391 raft_consensus.cc:740] T 10de08c2346d47dbbd720596cd7e02fd P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:16.919632  2310 leader_election.cc:304] T 6bf4f728eedf41bdb027f554c3a5ae1f P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 79b6e57d59e4468ebe4423d871a31b39
W20260709 13:12:16.920096  2162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:36557, user_credentials={real_user=slave}} blocked reactor thread for 123306us
I20260709 13:12:16.934530  2114 raft_consensus.cc:1275] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Refusing update from remote peer 0ec6a5d1452a41bd992a8c7922473b35: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:16.935978  2757 raft_consensus.cc:493] T bad0fdea1e3a409aab372c59eaa33767 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.921953  2508 raft_consensus.cc:2804] T 6bf4f728eedf41bdb027f554c3a5ae1f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:12:16.936305  2837 log.cc:927] Time spent T 2e178ff57d964223aca095ceff76b339 P 79b6e57d59e4468ebe4423d871a31b39: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 13:12:16.937889  2508 raft_consensus.cc:697] T 6bf4f728eedf41bdb027f554c3a5ae1f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 LEADER]: Becoming Leader. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Running, Role: LEADER
I20260709 13:12:16.937472  2391 consensus_queue.cc:260] T 10de08c2346d47dbbd720596cd7e02fd P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:16.937414  2195 raft_consensus.cc:1275] T ddf48e4f6be64627a0ed06d6198ca054 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Refusing update from remote peer 79b6e57d59e4468ebe4423d871a31b39: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:12:16.937487  2757 raft_consensus.cc:515] T bad0fdea1e3a409aab372c59eaa33767 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:16.986783  2391 ts_tablet_manager.cc:1434] T 10de08c2346d47dbbd720596cd7e02fd P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.104s	user 0.005s	sys 0.008s
I20260709 13:12:16.969535  2805 raft_consensus.cc:493] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:16.984949  2649 consensus_queue.cc:1048] T a9be6d55d1f348bcaf96405abc80244d P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
W20260709 13:12:16.981565  2088 leader_election.cc:343] T d0d102459578474fbe77af94f3986a84 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:16.999343  2393 tablet_bootstrap.cc:492] T 622b6cfd76ff495ea6692a1ec0faefc4 P 0ec6a5d1452a41bd992a8c7922473b35: No bootstrap required, opened a new log
I20260709 13:12:16.999754  2393 ts_tablet_manager.cc:1403] T 622b6cfd76ff495ea6692a1ec0faefc4 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent bootstrapping tablet: real 0.380s	user 0.005s	sys 0.016s
I20260709 13:12:17.000809  2195 raft_consensus.cc:3060] T a4a5ce298d24406ea94fb68aba5b37ae P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:17.003440  2392 tablet_bootstrap.cc:654] T d4e943e5bbd7402da6bcc00db70cec14 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:17.006956  2581 leader_election.cc:290] T a4a5ce298d24406ea94fb68aba5b37ae P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:17.008240  2123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a5ce298d24406ea94fb68aba5b37ae" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:17.008807  2757 leader_election.cc:290] T bad0fdea1e3a409aab372c59eaa33767 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:17.009809  2338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a5ce298d24406ea94fb68aba5b37ae" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:17.010581  2391 tablet_bootstrap.cc:492] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:17.012256  2198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bad0fdea1e3a409aab372c59eaa33767" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:16.961652  2508 consensus_queue.cc:237] T 6bf4f728eedf41bdb027f554c3a5ae1f P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:17.015270  2087 leader_election.cc:304] T b206de895e36490688cb2c1c537774a5 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472; no voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:17.015319  2820 consensus_queue.cc:1048] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:17.017552  2162 leader_election.cc:304] T a4a5ce298d24406ea94fb68aba5b37ae P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea
I20260709 13:12:17.018756  2451 raft_consensus.cc:2749] T b206de895e36490688cb2c1c537774a5 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:17.019636  2311 leader_election.cc:343] T bad0fdea1e3a409aab372c59eaa33767 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:16.990051  2845 consensus_queue.cc:1048] T bc42d18a324e4f6d97f07cf770c5daa8 P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 13:12:16.995066  2805 raft_consensus.cc:515] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:17.058665  2817 raft_consensus.cc:3055] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:17.059106  2817 raft_consensus.cc:740] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Running, Role: LEADER
W20260709 13:12:17.063009  2310 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:34303, user_credentials={real_user=slave}} blocked reactor thread for 100125us
I20260709 13:12:17.070892  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bad0fdea1e3a409aab372c59eaa33767" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:17.072829  2402 tablet_bootstrap.cc:654] T d1ddcfd4d0914e40ae0a684fd8726d24 P 79b6e57d59e4468ebe4423d871a31b39: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:17.054565  2795 raft_consensus.cc:493] T e259bf23e7904d9fb8b2345bb5b667f3 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:17.083985  2310 leader_election.cc:343] T bad0fdea1e3a409aab372c59eaa33767 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:17.084481  2310 leader_election.cc:304] T bad0fdea1e3a409aab372c59eaa33767 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:17.089373  2393 raft_consensus.cc:359] T 622b6cfd76ff495ea6692a1ec0faefc4 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:17.090430  2393 raft_consensus.cc:385] T 622b6cfd76ff495ea6692a1ec0faefc4 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:17.090694  2393 raft_consensus.cc:740] T 622b6cfd76ff495ea6692a1ec0faefc4 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Initialized, Role: FOLLOWER
I20260709 13:12:17.093605  2855 raft_consensus.cc:2749] T bad0fdea1e3a409aab372c59eaa33767 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:17.096146  2391 tablet_bootstrap.cc:654] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 2ac5c5682f914ed9b9982b5a080d5472: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:17.097854  2804 consensus_queue.cc:1048] T ddf48e4f6be64627a0ed06d6198ca054 P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.051s
I20260709 13:12:17.128338  2393 consensus_queue.cc:260] T 622b6cfd76ff495ea6692a1ec0faefc4 P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:17.127584  2820 raft_consensus.cc:493] T 10de08c2346d47dbbd720596cd7e02fd P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.128327  2730 raft_consensus.cc:3055] T b3b82132c31545aab274c7cf3f77c277 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:17.138034  2392 tablet_bootstrap.cc:492] T d4e943e5bbd7402da6bcc00db70cec14 P 66e9a8fffd4b4e5a81ca4fa2762773ea: No bootstrap required, opened a new log
I20260709 13:12:17.102180  2795 raft_consensus.cc:515] T e259bf23e7904d9fb8b2345bb5b667f3 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:17.140926  2392 ts_tablet_manager.cc:1403] T d4e943e5bbd7402da6bcc00db70cec14 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent bootstrapping tablet: real 0.330s	user 0.019s	sys 0.016s
I20260709 13:12:17.140298  2730 raft_consensus.cc:740] T b3b82132c31545aab274c7cf3f77c277 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Running, Role: LEADER
I20260709 13:12:17.144001  2647 raft_consensus.cc:2749] T a4a5ce298d24406ea94fb68aba5b37ae P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:17.145958  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d102459578474fbe77af94f3986a84" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:17.154919  2393 ts_tablet_manager.cc:1434] T 622b6cfd76ff495ea6692a1ec0faefc4 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent starting tablet: real 0.155s	user 0.008s	sys 0.000s
I20260709 13:12:17.101867  2817 consensus_queue.cc:260] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
W20260709 13:12:17.139199  2851 log.cc:927] Time spent T df8d897471684531826528a5751d6246 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260709 13:12:17.173715  2730 consensus_queue.cc:260] T b3b82132c31545aab274c7cf3f77c277 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:17.175143  2730 raft_consensus.cc:3060] T b3b82132c31545aab274c7cf3f77c277 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.145778  2820 raft_consensus.cc:515] T 10de08c2346d47dbbd720596cd7e02fd P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:17.184230  2820 leader_election.cc:290] T 10de08c2346d47dbbd720596cd7e02fd P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:17.160569  2271 raft_consensus.cc:2468] T d0d102459578474fbe77af94f3986a84 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 0.
I20260709 13:12:17.191560  2392 raft_consensus.cc:359] T d4e943e5bbd7402da6bcc00db70cec14 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:17.192348  2392 raft_consensus.cc:385] T d4e943e5bbd7402da6bcc00db70cec14 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:17.192612  2392 raft_consensus.cc:740] T d4e943e5bbd7402da6bcc00db70cec14 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:17.194131  2337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10de08c2346d47dbbd720596cd7e02fd" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:17.194687  2805 leader_election.cc:290] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:17.195757  2114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67db2f978ea64fbd9a32274d4ad374c9" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:17.196053  2020 catalog_manager.cc:5697] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472 reported cstate change: term changed from 1 to 2, leader changed from 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67) to 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65). New cstate: current_term: 2 leader_uuid: "2ac5c5682f914ed9b9982b5a080d5472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:17.198237  2019 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50244 (request call id 74) took 1097 ms. Trace:
I20260709 13:12:17.198939  2087 leader_election.cc:304] T d0d102459578474fbe77af94f3986a84 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39; no voters: 0ec6a5d1452a41bd992a8c7922473b35
I20260709 13:12:17.194839  2337 raft_consensus.cc:2468] T 10de08c2346d47dbbd720596cd7e02fd P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 0.
I20260709 13:12:17.199824  2198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67db2f978ea64fbd9a32274d4ad374c9" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:17.200533  2087 leader_election.cc:304] T 10de08c2346d47dbbd720596cd7e02fd P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:17.201289  2818 raft_consensus.cc:2804] T 10de08c2346d47dbbd720596cd7e02fd P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:17.201675  2818 raft_consensus.cc:493] T 10de08c2346d47dbbd720596cd7e02fd P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.202039  2818 raft_consensus.cc:3060] T 10de08c2346d47dbbd720596cd7e02fd P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:17.203994  2795 leader_election.cc:290] T e259bf23e7904d9fb8b2345bb5b667f3 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:17.201206  2816 raft_consensus.cc:2804] T d0d102459578474fbe77af94f3986a84 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:17.204721  2816 raft_consensus.cc:493] T d0d102459578474fbe77af94f3986a84 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.205070  2816 raft_consensus.cc:3060] T d0d102459578474fbe77af94f3986a84 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:17.193269  2392 consensus_queue.cc:260] T d4e943e5bbd7402da6bcc00db70cec14 P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:17.198693  2019 rpcz_store.cc:276] 0709 13:12:16.090698 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:16.090848 (+   150us) service_pool.cc:224] Handling call
0709 13:12:17.187913 (+1097065us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":80098,"reported_tablets":4}
I20260709 13:12:17.216725  2393 tablet_bootstrap.cc:492] T a332070dcdff450b939e74ef5b68425a P 0ec6a5d1452a41bd992a8c7922473b35: Bootstrap starting.
I20260709 13:12:17.228925  2271 raft_consensus.cc:1275] T 2993800f8e7e4c09bfe0b2be13e4394c P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Refusing update from remote peer 0ec6a5d1452a41bd992a8c7922473b35: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:17.205538  2118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e259bf23e7904d9fb8b2345bb5b667f3" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:17.244947  2340 raft_consensus.cc:1275] T 2993800f8e7e4c09bfe0b2be13e4394c P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Refusing update from remote peer 0ec6a5d1452a41bd992a8c7922473b35: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:17.246899  2392 ts_tablet_manager.cc:1434] T d4e943e5bbd7402da6bcc00db70cec14 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent starting tablet: real 0.097s	user 0.005s	sys 0.001s
I20260709 13:12:17.256928  2392 tablet_bootstrap.cc:492] T 421302a9721e4cc9a86e52a183469a70 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Bootstrap starting.
I20260709 13:12:17.260869  2719 raft_consensus.cc:493] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.261463  2719 raft_consensus.cc:515] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:17.263129  2719 leader_election.cc:290] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:17.264122  2714 consensus_queue.cc:1048] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:17.264827  2123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1478f883c539464bb54fe9bff44148d5" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:17.267436  2818 raft_consensus.cc:515] T 10de08c2346d47dbbd720596cd7e02fd P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:17.270467  2818 leader_election.cc:290] T 10de08c2346d47dbbd720596cd7e02fd P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 election: Requested vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:17.270023  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10de08c2346d47dbbd720596cd7e02fd" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:17.271703  2340 raft_consensus.cc:3060] T 10de08c2346d47dbbd720596cd7e02fd P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:17.271122  2198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e259bf23e7904d9fb8b2345bb5b667f3" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:17.265501  2817 raft_consensus.cc:3060] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.247090  2647 consensus_queue.cc:1048] T 2993800f8e7e4c09bfe0b2be13e4394c P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 13:12:17.289686  2391 tablet_bootstrap.cc:492] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 2ac5c5682f914ed9b9982b5a080d5472: No bootstrap required, opened a new log
I20260709 13:12:17.290181  2391 ts_tablet_manager.cc:1403] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.294s	user 0.031s	sys 0.030s
I20260709 13:12:17.292670  2391 raft_consensus.cc:359] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:17.293296  2391 raft_consensus.cc:385] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:12:17.294879  2069 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:17.296135  2402 tablet_bootstrap.cc:492] T d1ddcfd4d0914e40ae0a684fd8726d24 P 79b6e57d59e4468ebe4423d871a31b39: No bootstrap required, opened a new log
I20260709 13:12:17.296607  2402 ts_tablet_manager.cc:1403] T d1ddcfd4d0914e40ae0a684fd8726d24 P 79b6e57d59e4468ebe4423d871a31b39: Time spent bootstrapping tablet: real 0.392s	user 0.017s	sys 0.006s
I20260709 13:12:17.294567  2020 catalog_manager.cc:5697] T 2e178ff57d964223aca095ceff76b339 P 2ac5c5682f914ed9b9982b5a080d5472 reported cstate change: term changed from 1 to 2, leader changed from 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68) to 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65). New cstate: current_term: 2 leader_uuid: "2ac5c5682f914ed9b9982b5a080d5472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:17.293562  2391 raft_consensus.cc:740] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:17.293737  2017 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:45096 (request call id 75) took 1110 ms. Trace:
I20260709 13:12:17.304291  2726 raft_consensus.cc:493] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.304778  2726 raft_consensus.cc:515] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:17.306672  2726 leader_election.cc:290] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:17.309661  2811 raft_consensus.cc:493] T 38d5e9a8f42c4a2993d25a8a341fddbf P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.310379  2811 raft_consensus.cc:515] T 38d5e9a8f42c4a2993d25a8a341fddbf P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:17.287894  2237 leader_election.cc:304] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b6e57d59e4468ebe4423d871a31b39; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:17.312093  2402 raft_consensus.cc:359] T d1ddcfd4d0914e40ae0a684fd8726d24 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:17.284307  2581 consensus_queue.cc:1048] T 2993800f8e7e4c09bfe0b2be13e4394c P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:12:17.312440  2811 leader_election.cc:290] T 38d5e9a8f42c4a2993d25a8a341fddbf P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:17.312770  2237 leader_election.cc:304] T e259bf23e7904d9fb8b2345bb5b667f3 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b6e57d59e4468ebe4423d871a31b39; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:17.313393  2811 raft_consensus.cc:2749] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:17.313647  2795 raft_consensus.cc:2749] T e259bf23e7904d9fb8b2345bb5b667f3 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:17.309715  2340 raft_consensus.cc:2468] T 10de08c2346d47dbbd720596cd7e02fd P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 1.
I20260709 13:12:17.309876  2017 rpcz_store.cc:276] 0709 13:12:16.183499 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:16.183664 (+   165us) service_pool.cc:224] Handling call
0709 13:12:17.293686 (+1110022us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:16.752323 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:16.752854 (+   531us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:16.752886 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:12:16.752900 (+    14us) tablet.cc:662] Decoding operations
0709 13:12:16.753223 (+   323us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:16.753278 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:16.753305 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0709 13:12:16.753487 (+   182us) tablet.cc:701] Row locks acquired
0709 13:12:16.753501 (+    14us) write_op.cc:260] PREPARE: finished
0709 13:12:16.753638 (+   137us) write_op.cc:270] Start()
0709 13:12:16.753740 (+   102us) write_op.cc:276] Timestamp: P: 1783602736753597 usec, L: 0
0709 13:12:16.753772 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 13:12:16.754358 (+   586us) log.cc:844] Serialized 537 byte log entry
0709 13:12:16.756172 (+  1814us) op_driver.cc:464] REPLICATION: finished
0709 13:12:16.756670 (+   498us) write_op.cc:301] APPLY: starting
0709 13:12:16.756804 (+   134us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:16.768734 (+ 11930us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:16.779519 (+ 10785us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:16.779778 (+   259us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:16.779937 (+   159us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 13:12:16.779983 (+    46us) write_op.cc:312] APPLY: finished
0709 13:12:16.780160 (+   177us) log.cc:844] Serialized 22 byte log entry
0709 13:12:16.780329 (+   169us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:16.780428 (+    99us) write_op.cc:454] Released schema lock
0709 13:12:16.780468 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:16.780832 (+   364us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:16.780859 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":62193,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":230,"apply.run_cpu_time_us":1641,"apply.run_wall_time_us":24139,"num_ops":1,"prepare.queue_time_us":133,"prepare.run_cpu_time_us":2313,"prepare.run_wall_time_us":2313,"replication_time_us":2274}]]}
I20260709 13:12:17.312821  2402 raft_consensus.cc:385] T d1ddcfd4d0914e40ae0a684fd8726d24 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:17.303220  2020 catalog_manager.cc:5697] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472 reported cstate change: term changed from 1 to 2, leader changed from 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67) to 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65). New cstate: current_term: 2 leader_uuid: "2ac5c5682f914ed9b9982b5a080d5472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:17.320775  2402 raft_consensus.cc:740] T d1ddcfd4d0914e40ae0a684fd8726d24 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Initialized, Role: FOLLOWER
I20260709 13:12:17.320188  2087 leader_election.cc:304] T 10de08c2346d47dbbd720596cd7e02fd P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:17.322132  2402 consensus_queue.cc:260] T d1ddcfd4d0914e40ae0a684fd8726d24 P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:17.329234  2818 raft_consensus.cc:2804] T 10de08c2346d47dbbd720596cd7e02fd P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:17.329779  2818 raft_consensus.cc:697] T 10de08c2346d47dbbd720596cd7e02fd P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 LEADER]: Becoming Leader. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Running, Role: LEADER
I20260709 13:12:17.330651  2818 consensus_queue.cc:237] T 10de08c2346d47dbbd720596cd7e02fd P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:17.334411  2393 tablet_bootstrap.cc:654] T a332070dcdff450b939e74ef5b68425a P 0ec6a5d1452a41bd992a8c7922473b35: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:17.334532  2191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1478f883c539464bb54fe9bff44148d5" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:17.337733  2191 raft_consensus.cc:2468] T 1478f883c539464bb54fe9bff44148d5 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 2.
I20260709 13:12:17.340602  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d5e9a8f42c4a2993d25a8a341fddbf" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:17.340404  2391 consensus_queue.cc:260] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
W20260709 13:12:17.343353  2236 leader_election.cc:343] T 38d5e9a8f42c4a2993d25a8a341fddbf P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:17.343509  2391 ts_tablet_manager.cc:1434] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.000s
I20260709 13:12:17.344336  2198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10de08c2346d47dbbd720596cd7e02fd" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:17.345155  2795 raft_consensus.cc:493] T d1ddcfd4d0914e40ae0a684fd8726d24 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.347419  2795 raft_consensus.cc:515] T d1ddcfd4d0914e40ae0a684fd8726d24 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:17.349473  2795 leader_election.cc:290] T d1ddcfd4d0914e40ae0a684fd8726d24 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:17.344552  2451 raft_consensus.cc:493] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b6e57d59e4468ebe4423d871a31b39)
I20260709 13:12:17.350044  2120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ddcfd4d0914e40ae0a684fd8726d24" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:17.370280  2391 tablet_bootstrap.cc:492] T 1588358a9e7542dfbd8b5d2f65212aec P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:17.317618  2816 raft_consensus.cc:515] T d0d102459578474fbe77af94f3986a84 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:17.372773  2402 ts_tablet_manager.cc:1434] T d1ddcfd4d0914e40ae0a684fd8726d24 P 79b6e57d59e4468ebe4423d871a31b39: Time spent starting tablet: real 0.076s	user 0.010s	sys 0.000s
I20260709 13:12:17.381824  2198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d5e9a8f42c4a2993d25a8a341fddbf" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:17.383829  2123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b10072083419c89d5a4bf5d6413fc" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:17.384495  2123 raft_consensus.cc:2468] T 427b10072083419c89d5a4bf5d6413fc P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 2.
I20260709 13:12:17.382448  2198 raft_consensus.cc:2468] T 38d5e9a8f42c4a2993d25a8a341fddbf P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 0.
I20260709 13:12:17.370653  2795 raft_consensus.cc:493] T 427b10072083419c89d5a4bf5d6413fc P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.399010  2816 leader_election.cc:290] T d0d102459578474fbe77af94f3986a84 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 election: Requested vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:17.399539  2392 tablet_bootstrap.cc:654] T 421302a9721e4cc9a86e52a183469a70 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Neither blocks nor log segments found. Creating new log.
W20260709 13:12:17.389269  2236 leader_election.cc:343] T d1ddcfd4d0914e40ae0a684fd8726d24 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:17.392572  2391 tablet_bootstrap.cc:654] T 1588358a9e7542dfbd8b5d2f65212aec P 2ac5c5682f914ed9b9982b5a080d5472: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:17.394862  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b10072083419c89d5a4bf5d6413fc" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:17.396095  2237 leader_election.cc:304] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39; no voters: 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:17.371701  2191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10de08c2346d47dbbd720596cd7e02fd" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:17.404999  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d102459578474fbe77af94f3986a84" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:17.410579  2264 raft_consensus.cc:3060] T d0d102459578474fbe77af94f3986a84 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:17.379967  2451 raft_consensus.cc:515] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:17.407240  2237 leader_election.cc:304] T 38d5e9a8f42c4a2993d25a8a341fddbf P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39; no voters: 66e9a8fffd4b4e5a81ca4fa2762773ea
W20260709 13:12:17.387251  2870 log.cc:927] Time spent T ddf48e4f6be64627a0ed06d6198ca054 P 0ec6a5d1452a41bd992a8c7922473b35: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 13:12:17.397449  2795 raft_consensus.cc:515] T 427b10072083419c89d5a4bf5d6413fc P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:17.420770  2198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ddcfd4d0914e40ae0a684fd8726d24" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
W20260709 13:12:17.422300  2237 leader_election.cc:343] T d1ddcfd4d0914e40ae0a684fd8726d24 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:17.422696  2237 leader_election.cc:304] T d1ddcfd4d0914e40ae0a684fd8726d24 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b6e57d59e4468ebe4423d871a31b39; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:17.414480  2811 raft_consensus.cc:2804] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:17.425537  2865 raft_consensus.cc:2804] T 38d5e9a8f42c4a2993d25a8a341fddbf P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:17.425994  2865 raft_consensus.cc:493] T 38d5e9a8f42c4a2993d25a8a341fddbf P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.426291  2865 raft_consensus.cc:3060] T 38d5e9a8f42c4a2993d25a8a341fddbf P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:17.426910  2795 leader_election.cc:290] T 427b10072083419c89d5a4bf5d6413fc P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:17.425535  2805 raft_consensus.cc:2749] T d1ddcfd4d0914e40ae0a684fd8726d24 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:17.415971  2719 raft_consensus.cc:493] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.428352  2719 raft_consensus.cc:515] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:17.431558  2451 leader_election.cc:290] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:17.433060  2719 leader_election.cc:290] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:17.424230  2811 raft_consensus.cc:493] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.434772  2811 raft_consensus.cc:3060] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:17.438869  2265 raft_consensus.cc:2468] T 427b10072083419c89d5a4bf5d6413fc P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 2.
I20260709 13:12:17.441303  2195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d102459578474fbe77af94f3986a84" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:17.441905  2196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0fb3f7bf85419cbf7ecda4727ccb89" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:17.442166  2264 raft_consensus.cc:2468] T d0d102459578474fbe77af94f3986a84 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 1.
I20260709 13:12:17.442678  2196 raft_consensus.cc:2393] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ac5c5682f914ed9b9982b5a080d5472 in current term 2: Already voted for candidate 0ec6a5d1452a41bd992a8c7922473b35 in this term.
I20260709 13:12:17.443936  2116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b10072083419c89d5a4bf5d6413fc" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:17.444576  2116 raft_consensus.cc:2468] T 427b10072083419c89d5a4bf5d6413fc P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 2.
I20260709 13:12:17.446461  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0fb3f7bf85419cbf7ecda4727ccb89" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:17.447129  2264 raft_consensus.cc:2468] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 2.
I20260709 13:12:17.447256  2087 leader_election.cc:304] T d0d102459578474fbe77af94f3986a84 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:17.448029  2811 raft_consensus.cc:515] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:17.438778  2123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7475d672f7b3489393d6202c8b31e47f" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:17.449076  2730 raft_consensus.cc:2804] T d0d102459578474fbe77af94f3986a84 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:17.442147  2310 leader_election.cc:304] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:17.453173  2337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7475d672f7b3489393d6202c8b31e47f" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:17.454702  2508 raft_consensus.cc:2804] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:17.455134  2508 raft_consensus.cc:493] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.455480  2508 raft_consensus.cc:3060] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:17.458101  2402 tablet_bootstrap.cc:492] T 1588358a9e7542dfbd8b5d2f65212aec P 79b6e57d59e4468ebe4423d871a31b39: Bootstrap starting.
I20260709 13:12:17.458556  2087 leader_election.cc:304] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:17.459031  2236 leader_election.cc:304] T 427b10072083419c89d5a4bf5d6413fc P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:17.449599  2730 raft_consensus.cc:697] T d0d102459578474fbe77af94f3986a84 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 LEADER]: Becoming Leader. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Running, Role: LEADER
I20260709 13:12:17.453104  2123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1478f883c539464bb54fe9bff44148d5" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:17.462112  2805 raft_consensus.cc:2804] T 427b10072083419c89d5a4bf5d6413fc P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:17.465579  2805 raft_consensus.cc:493] T 427b10072083419c89d5a4bf5d6413fc P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.465935  2805 raft_consensus.cc:3060] T 427b10072083419c89d5a4bf5d6413fc P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:17.462888  2337 raft_consensus.cc:2468] T 7475d672f7b3489393d6202c8b31e47f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 2.
I20260709 13:12:17.474107  2391 tablet_bootstrap.cc:492] T 1588358a9e7542dfbd8b5d2f65212aec P 2ac5c5682f914ed9b9982b5a080d5472: No bootstrap required, opened a new log
I20260709 13:12:17.476100  2391 ts_tablet_manager.cc:1403] T 1588358a9e7542dfbd8b5d2f65212aec P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.106s	user 0.014s	sys 0.006s
I20260709 13:12:17.462147  2817 raft_consensus.cc:2804] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:17.476509  2817 raft_consensus.cc:493] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79b6e57d59e4468ebe4423d871a31b39)
I20260709 13:12:17.476910  2817 raft_consensus.cc:3060] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.478404  2839 consensus_queue.cc:1048] T df8d897471684531826528a5751d6246 P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:17.478989  2391 raft_consensus.cc:359] T 1588358a9e7542dfbd8b5d2f65212aec P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:17.479637  2391 raft_consensus.cc:385] T 1588358a9e7542dfbd8b5d2f65212aec P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:17.479888  2391 raft_consensus.cc:740] T 1588358a9e7542dfbd8b5d2f65212aec P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:17.480484  2391 consensus_queue.cc:260] T 1588358a9e7542dfbd8b5d2f65212aec P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:17.476626  2236 leader_election.cc:304] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39; no voters: 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:17.482167  2730 consensus_queue.cc:237] T d0d102459578474fbe77af94f3986a84 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:17.484715  2391 ts_tablet_manager.cc:1434] T 1588358a9e7542dfbd8b5d2f65212aec P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:12:17.484624  2393 tablet_bootstrap.cc:492] T a332070dcdff450b939e74ef5b68425a P 0ec6a5d1452a41bd992a8c7922473b35: No bootstrap required, opened a new log
I20260709 13:12:17.485656  2393 ts_tablet_manager.cc:1403] T a332070dcdff450b939e74ef5b68425a P 0ec6a5d1452a41bd992a8c7922473b35: Time spent bootstrapping tablet: real 0.269s	user 0.032s	sys 0.020s
W20260709 13:12:17.443958  2088 leader_election.cc:343] T 10de08c2346d47dbbd720596cd7e02fd P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:17.486474  2519 raft_consensus.cc:2804] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:17.486840  2519 raft_consensus.cc:493] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.487141  2519 raft_consensus.cc:3060] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:17.499832  2392 tablet_bootstrap.cc:492] T 421302a9721e4cc9a86e52a183469a70 P 66e9a8fffd4b4e5a81ca4fa2762773ea: No bootstrap required, opened a new log
I20260709 13:12:17.504844  2392 ts_tablet_manager.cc:1403] T 421302a9721e4cc9a86e52a183469a70 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent bootstrapping tablet: real 0.251s	user 0.010s	sys 0.008s
I20260709 13:12:17.500872  2744 raft_consensus.cc:493] T 622b6cfd76ff495ea6692a1ec0faefc4 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 13:12:17.502171  2088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:38859, user_credentials={real_user=slave}} blocked reactor thread for 58244.8us
I20260709 13:12:17.502776  2865 raft_consensus.cc:515] T 38d5e9a8f42c4a2993d25a8a341fddbf P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:17.508934  2391 tablet_bootstrap.cc:492] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:17.505275  2191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1478f883c539464bb54fe9bff44148d5" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:17.504253  2811 leader_election.cc:290] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 election: Requested vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:17.500087  2519 raft_consensus.cc:515] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:17.510721  2191 raft_consensus.cc:3060] T 1478f883c539464bb54fe9bff44148d5 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:17.511200  2744 raft_consensus.cc:515] T 622b6cfd76ff495ea6692a1ec0faefc4 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:17.486516  2338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b10072083419c89d5a4bf5d6413fc" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:17.515466  2519 leader_election.cc:290] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 election: Requested vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:17.516261  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7475d672f7b3489393d6202c8b31e47f" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:17.517769  2744 leader_election.cc:290] T 622b6cfd76ff495ea6692a1ec0faefc4 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:17.518253  2392 raft_consensus.cc:359] T 421302a9721e4cc9a86e52a183469a70 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:17.522450  2392 raft_consensus.cc:385] T 421302a9721e4cc9a86e52a183469a70 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:17.523311  2120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622b6cfd76ff495ea6692a1ec0faefc4" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:17.525066  2392 raft_consensus.cc:740] T 421302a9721e4cc9a86e52a183469a70 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:17.525969  2392 consensus_queue.cc:260] T 421302a9721e4cc9a86e52a183469a70 P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
W20260709 13:12:17.521232  2088 leader_election.cc:343] T 10de08c2346d47dbbd720596cd7e02fd P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:17.521283  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622b6cfd76ff495ea6692a1ec0faefc4" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
W20260709 13:12:17.528486  2088 leader_election.cc:343] T d0d102459578474fbe77af94f3986a84 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:17.528841  2162 leader_election.cc:343] T 622b6cfd76ff495ea6692a1ec0faefc4 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:17.528975  2120 raft_consensus.cc:2468] T 622b6cfd76ff495ea6692a1ec0faefc4 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 0.
W20260709 13:12:17.529409  2088 consensus_peers.cc:597] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472 -> Peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Couldn't send request to peer 0ec6a5d1452a41bd992a8c7922473b35. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:17.530253  2162 leader_election.cc:304] T 622b6cfd76ff495ea6692a1ec0faefc4 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472; no voters: 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:17.530725  2123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7475d672f7b3489393d6202c8b31e47f" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:17.531345  2744 raft_consensus.cc:2804] T 622b6cfd76ff495ea6692a1ec0faefc4 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:17.531790  2744 raft_consensus.cc:493] T 622b6cfd76ff495ea6692a1ec0faefc4 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.532871  2744 raft_consensus.cc:3060] T 622b6cfd76ff495ea6692a1ec0faefc4 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:17.532794  2508 raft_consensus.cc:515] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:17.535764  2338 raft_consensus.cc:2393] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79b6e57d59e4468ebe4423d871a31b39 in current term 3: Already voted for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in this term.
I20260709 13:12:17.543044  2198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d5e9a8f42c4a2993d25a8a341fddbf" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:17.543578  2198 raft_consensus.cc:3060] T 38d5e9a8f42c4a2993d25a8a341fddbf P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:17.547755  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b10072083419c89d5a4bf5d6413fc" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:17.524003  2340 raft_consensus.cc:3060] T 7475d672f7b3489393d6202c8b31e47f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:17.550825  2198 raft_consensus.cc:2468] T 38d5e9a8f42c4a2993d25a8a341fddbf P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 1.
I20260709 13:12:17.505188  2805 raft_consensus.cc:515] T 427b10072083419c89d5a4bf5d6413fc P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
W20260709 13:12:17.554960  2310 consensus_peers.cc:597] T df8d897471684531826528a5751d6246 P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:17.555393  2237 leader_election.cc:304] T 38d5e9a8f42c4a2993d25a8a341fddbf P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:17.550393  2519 raft_consensus.cc:493] T 86834d94d1d64596abfa609754b5d58a P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.556334  2519 raft_consensus.cc:515] T 86834d94d1d64596abfa609754b5d58a P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:17.558089  2519 leader_election.cc:290] T 86834d94d1d64596abfa609754b5d58a P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:17.551359  2393 raft_consensus.cc:359] T a332070dcdff450b939e74ef5b68425a P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:17.559206  2393 raft_consensus.cc:385] T a332070dcdff450b939e74ef5b68425a P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:17.559674  2393 raft_consensus.cc:740] T a332070dcdff450b939e74ef5b68425a P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Initialized, Role: FOLLOWER
I20260709 13:12:17.561115  2393 consensus_queue.cc:260] T a332070dcdff450b939e74ef5b68425a P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:17.561692  2392 ts_tablet_manager.cc:1434] T 421302a9721e4cc9a86e52a183469a70 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent starting tablet: real 0.054s	user 0.007s	sys 0.000s
I20260709 13:12:17.562700  2392 tablet_bootstrap.cc:492] T 1588358a9e7542dfbd8b5d2f65212aec P 66e9a8fffd4b4e5a81ca4fa2762773ea: Bootstrap starting.
I20260709 13:12:17.550868  2865 leader_election.cc:290] T 38d5e9a8f42c4a2993d25a8a341fddbf P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 election: Requested vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:17.559182  2817 raft_consensus.cc:515] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:17.564918  2116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86834d94d1d64596abfa609754b5d58a" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:17.558784  2719 raft_consensus.cc:2804] T 38d5e9a8f42c4a2993d25a8a341fddbf P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:17.557323  2191 raft_consensus.cc:2468] T 1478f883c539464bb54fe9bff44148d5 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 3.
I20260709 13:12:17.570745  2393 ts_tablet_manager.cc:1434] T a332070dcdff450b939e74ef5b68425a P 0ec6a5d1452a41bd992a8c7922473b35: Time spent starting tablet: real 0.085s	user 0.006s	sys 0.000s
W20260709 13:12:17.568941  2310 consensus_peers.cc:597] T 6bf4f728eedf41bdb027f554c3a5ae1f P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Couldn't send request to peer 79b6e57d59e4468ebe4423d871a31b39. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:17.571928  2338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d5e9a8f42c4a2993d25a8a341fddbf" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:17.561913  2508 leader_election.cc:290] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 3 election: Requested vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:17.575403  2719 raft_consensus.cc:697] T 38d5e9a8f42c4a2993d25a8a341fddbf P 79b6e57d59e4468ebe4423d871a31b39 [term 1 LEADER]: Becoming Leader. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Running, Role: LEADER
I20260709 13:12:17.574452  2116 raft_consensus.cc:2468] T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 2.
I20260709 13:12:17.578783  2266 raft_consensus.cc:2393] T 427b10072083419c89d5a4bf5d6413fc P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in current term 3: Already voted for candidate 79b6e57d59e4468ebe4423d871a31b39 in this term.
I20260709 13:12:17.582049  2237 leader_election.cc:304] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39; no voters: 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:17.589493  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b10072083419c89d5a4bf5d6413fc" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:17.588693  2337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86834d94d1d64596abfa609754b5d58a" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:17.591313  2236 leader_election.cc:304] T 86834d94d1d64596abfa609754b5d58a P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:17.593698  2865 raft_consensus.cc:2804] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:17.592023  2719 consensus_queue.cc:237] T 38d5e9a8f42c4a2993d25a8a341fddbf P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:17.596004  2865 raft_consensus.cc:697] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 LEADER]: Becoming Leader. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Running, Role: LEADER
I20260709 13:12:17.596125  2811 raft_consensus.cc:2804] T 86834d94d1d64596abfa609754b5d58a P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:17.596530  2811 raft_consensus.cc:493] T 86834d94d1d64596abfa609754b5d58a P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.593642  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0fb3f7bf85419cbf7ecda4727ccb89" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:17.596875  2865 consensus_queue.cc:237] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:17.593603  2116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b10072083419c89d5a4bf5d6413fc" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:17.596879  2811 raft_consensus.cc:3060] T 86834d94d1d64596abfa609754b5d58a P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:17.599371  2344 raft_consensus.cc:2393] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 79b6e57d59e4468ebe4423d871a31b39 in current term 3: Already voted for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in this term.
I20260709 13:12:17.601958  2116 raft_consensus.cc:3060] T 427b10072083419c89d5a4bf5d6413fc P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:17.606676  2123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b10072083419c89d5a4bf5d6413fc" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:17.595266  2198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0fb3f7bf85419cbf7ecda4727ccb89" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:17.607622  2198 raft_consensus.cc:2393] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ac5c5682f914ed9b9982b5a080d5472 in current term 2: Already voted for candidate 0ec6a5d1452a41bd992a8c7922473b35 in this term.
I20260709 13:12:17.604890  2508 raft_consensus.cc:493] T d4e943e5bbd7402da6bcc00db70cec14 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.609063  2508 raft_consensus.cc:515] T d4e943e5bbd7402da6bcc00db70cec14 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:17.612578  2191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e943e5bbd7402da6bcc00db70cec14" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
W20260709 13:12:17.617794  2311 leader_election.cc:343] T d4e943e5bbd7402da6bcc00db70cec14 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:17.623085  2519 raft_consensus.cc:493] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.618597  2508 leader_election.cc:290] T d4e943e5bbd7402da6bcc00db70cec14 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:17.623600  2519 raft_consensus.cc:515] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:17.625406  2519 leader_election.cc:290] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:17.626857  2236 leader_election.cc:304] T 427b10072083419c89d5a4bf5d6413fc P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b6e57d59e4468ebe4423d871a31b39; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea
I20260709 13:12:17.627327  2123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0394490f6984f028daa10be921e242b" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:17.627660  2519 raft_consensus.cc:2749] T 427b10072083419c89d5a4bf5d6413fc P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:12:17.628648  2519 raft_consensus.cc:493] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.595232  2744 raft_consensus.cc:515] T 622b6cfd76ff495ea6692a1ec0faefc4 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:17.629185  2519 raft_consensus.cc:515] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
W20260709 13:12:17.630079  2236 leader_election.cc:343] T 38d5e9a8f42c4a2993d25a8a341fddbf P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:17.630286  2123 raft_consensus.cc:2468] T a0394490f6984f028daa10be921e242b P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 2.
I20260709 13:12:17.631628  2236 leader_election.cc:304] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:17.632302  2795 raft_consensus.cc:2804] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:17.632722  2795 raft_consensus.cc:493] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.633057  2795 raft_consensus.cc:3060] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:17.628732  2820 raft_consensus.cc:493] T 1588358a9e7542dfbd8b5d2f65212aec P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.633998  2820 raft_consensus.cc:515] T 1588358a9e7542dfbd8b5d2f65212aec P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:17.635912  2820 leader_election.cc:290] T 1588358a9e7542dfbd8b5d2f65212aec P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:17.637599  2123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f2272230d34efa880d5eeed8859669" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:17.638223  2123 raft_consensus.cc:2468] T 28f2272230d34efa880d5eeed8859669 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 2.
I20260709 13:12:17.640146  2820 raft_consensus.cc:493] T 1478f883c539464bb54fe9bff44148d5 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b6e57d59e4468ebe4423d871a31b39)
I20260709 13:12:17.632172  2519 leader_election.cc:290] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:17.640760  2236 leader_election.cc:304] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:17.642586  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1588358a9e7542dfbd8b5d2f65212aec" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:17.643307  2873 raft_consensus.cc:493] T 7475d672f7b3489393d6202c8b31e47f P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b6e57d59e4468ebe4423d871a31b39)
I20260709 13:12:17.643882  2519 raft_consensus.cc:2804] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:17.643839  2873 raft_consensus.cc:515] T 7475d672f7b3489393d6202c8b31e47f P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
W20260709 13:12:17.644158  2087 leader_election.cc:343] T 1588358a9e7542dfbd8b5d2f65212aec P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:17.607482  2805 leader_election.cc:290] T 427b10072083419c89d5a4bf5d6413fc P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 election: Requested vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:17.645922  2873 leader_election.cc:290] T 7475d672f7b3489393d6202c8b31e47f P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:17.641863  2820 raft_consensus.cc:515] T 1478f883c539464bb54fe9bff44148d5 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:17.651463  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7475d672f7b3489393d6202c8b31e47f" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:17.657354  2393 tablet_bootstrap.cc:492] T 10de08c2346d47dbbd720596cd7e02fd P 0ec6a5d1452a41bd992a8c7922473b35: Bootstrap starting.
I20260709 13:12:17.580439  2817 leader_election.cc:290] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 election: Requested vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:17.644503  2519 raft_consensus.cc:493] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.659488  2519 raft_consensus.cc:3060] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:17.663102  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0394490f6984f028daa10be921e242b" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:17.663793  2345 raft_consensus.cc:2468] T a0394490f6984f028daa10be921e242b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 1.
I20260709 13:12:17.663810  2339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f2272230d34efa880d5eeed8859669" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:17.643543  2811 raft_consensus.cc:515] T 86834d94d1d64596abfa609754b5d58a P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:17.665591  2339 raft_consensus.cc:2468] T 28f2272230d34efa880d5eeed8859669 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 2.
I20260709 13:12:17.661324  2820 leader_election.cc:290] T 1478f883c539464bb54fe9bff44148d5 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:17.640224  2795 raft_consensus.cc:515] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:17.664050  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1478f883c539464bb54fe9bff44148d5" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:17.684041  2391 tablet_bootstrap.cc:654] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:17.675395  2268 raft_consensus.cc:2368] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ac5c5682f914ed9b9982b5a080d5472 for earlier term 2. Current term is 3.
I20260709 13:12:17.692888  2393 tablet_bootstrap.cc:654] T 10de08c2346d47dbbd720596cd7e02fd P 0ec6a5d1452a41bd992a8c7922473b35: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:17.695659  2873 raft_consensus.cc:493] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.696271  2873 raft_consensus.cc:515] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:17.697551  2116 raft_consensus.cc:2468] T 427b10072083419c89d5a4bf5d6413fc P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 3.
I20260709 13:12:17.698040  2795 leader_election.cc:290] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 election: Requested vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:17.698575  2873 leader_election.cc:290] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:17.681622  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1588358a9e7542dfbd8b5d2f65212aec" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:17.676250  2338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7475d672f7b3489393d6202c8b31e47f" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:17.704001  2519 raft_consensus.cc:515] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:17.675309  2817 raft_consensus.cc:493] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b6e57d59e4468ebe4423d871a31b39)
I20260709 13:12:17.669531  2508 consensus_queue.cc:1048] T 6bf4f728eedf41bdb027f554c3a5ae1f P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.016s
W20260709 13:12:17.702368  2087 leader_election.cc:343] T 1588358a9e7542dfbd8b5d2f65212aec P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:17.706843  2087 leader_election.cc:304] T 1588358a9e7542dfbd8b5d2f65212aec P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472; no voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:17.711196  2339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f2272230d34efa880d5eeed8859669" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:17.711768  2339 raft_consensus.cc:3060] T 28f2272230d34efa880d5eeed8859669 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:17.686475  2742 raft_consensus.cc:493] T 421302a9721e4cc9a86e52a183469a70 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.714632  2265 raft_consensus.cc:2468] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 2.
I20260709 13:12:17.715016  2742 raft_consensus.cc:515] T 421302a9721e4cc9a86e52a183469a70 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:17.716221  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0394490f6984f028daa10be921e242b" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:17.716765  2344 raft_consensus.cc:3060] T a0394490f6984f028daa10be921e242b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:12:17.717063  2742 leader_election.cc:290] T 421302a9721e4cc9a86e52a183469a70 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:17.708825  2451 raft_consensus.cc:2749] T 1588358a9e7542dfbd8b5d2f65212aec P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:17.718376  2402 tablet_bootstrap.cc:654] T 1588358a9e7542dfbd8b5d2f65212aec P 79b6e57d59e4468ebe4423d871a31b39: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:17.720144  2191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "421302a9721e4cc9a86e52a183469a70" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:17.720758  2191 raft_consensus.cc:2468] T 421302a9721e4cc9a86e52a183469a70 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 0.
I20260709 13:12:17.723950  2744 leader_election.cc:290] T 622b6cfd76ff495ea6692a1ec0faefc4 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 election: Requested vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:17.726050  2311 leader_election.cc:304] T 421302a9721e4cc9a86e52a183469a70 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:17.708779  2817 raft_consensus.cc:515] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:17.726761  2310 leader_election.cc:304] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:17.728775  2519 leader_election.cc:290] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 election: Requested vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:17.727384  2392 tablet_bootstrap.cc:654] T 1588358a9e7542dfbd8b5d2f65212aec P 66e9a8fffd4b4e5a81ca4fa2762773ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:17.708478  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc33c7c3cfd14ab7a99e39cfd971fc3c" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:17.728523  2116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0394490f6984f028daa10be921e242b" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:17.731973  2857 raft_consensus.cc:2804] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:17.732443  2857 raft_consensus.cc:697] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 LEADER]: Becoming Leader. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Running, Role: LEADER
I20260709 13:12:17.734663  2087 leader_election.cc:400] T 7475d672f7b3489393d6202c8b31e47f P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303) with higher term. Message: Invalid argument: T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ac5c5682f914ed9b9982b5a080d5472 for earlier term 2. Current term is 3.
I20260709 13:12:17.735023  2087 leader_election.cc:403] T 7475d672f7b3489393d6202c8b31e47f P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:17.736156  2857 consensus_queue.cc:237] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:17.736598  2087 leader_election.cc:304] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39; no voters: 0ec6a5d1452a41bd992a8c7922473b35
I20260709 13:12:17.737154  2114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622b6cfd76ff495ea6692a1ec0faefc4" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:17.732086  2116 raft_consensus.cc:3060] T a0394490f6984f028daa10be921e242b P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:17.737906  2730 raft_consensus.cc:3060] T 7475d672f7b3489393d6202c8b31e47f P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:12:17.737993  2115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f2272230d34efa880d5eeed8859669" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:17.738660  2115 raft_consensus.cc:3060] T 28f2272230d34efa880d5eeed8859669 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:17.739277  2198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1478f883c539464bb54fe9bff44148d5" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:17.739902  2198 raft_consensus.cc:2368] T 1478f883c539464bb54fe9bff44148d5 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ac5c5682f914ed9b9982b5a080d5472 for earlier term 2. Current term is 3.
I20260709 13:12:17.740090  2873 raft_consensus.cc:2804] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:17.740546  2873 raft_consensus.cc:697] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 LEADER]: Becoming Leader. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Running, Role: LEADER
I20260709 13:12:17.740823  2189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc33c7c3cfd14ab7a99e39cfd971fc3c" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:17.737782  2114 raft_consensus.cc:3060] T 622b6cfd76ff495ea6692a1ec0faefc4 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:17.748059  2340 raft_consensus.cc:2468] T 7475d672f7b3489393d6202c8b31e47f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 3.
I20260709 13:12:17.750149  2120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86834d94d1d64596abfa609754b5d58a" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:17.750727  2120 raft_consensus.cc:3060] T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:17.751102  2088 leader_election.cc:400] T 1478f883c539464bb54fe9bff44148d5 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859) with higher term. Message: Invalid argument: T 1478f883c539464bb54fe9bff44148d5 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ac5c5682f914ed9b9982b5a080d5472 for earlier term 2. Current term is 3.
I20260709 13:12:17.751408  2088 leader_election.cc:403] T 1478f883c539464bb54fe9bff44148d5 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:17.751950  2339 raft_consensus.cc:2468] T 28f2272230d34efa880d5eeed8859669 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 3.
I20260709 13:12:17.752400  2088 leader_election.cc:304] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea
I20260709 13:12:17.753214  2820 raft_consensus.cc:3060] T 1478f883c539464bb54fe9bff44148d5 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:12:17.753364  2816 raft_consensus.cc:2749] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:17.732585  2123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e943e5bbd7402da6bcc00db70cec14" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:17.755800  2855 raft_consensus.cc:493] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.756281  2855 raft_consensus.cc:515] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:17.758396  2855 leader_election.cc:290] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:17.733090  2839 raft_consensus.cc:2804] T 421302a9721e4cc9a86e52a183469a70 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:17.762749  2236 leader_election.cc:304] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39; no voters: 2ac5c5682f914ed9b9982b5a080d5472
W20260709 13:12:17.770390  2310 leader_election.cc:343] T d4e943e5bbd7402da6bcc00db70cec14 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:17.770843  2310 leader_election.cc:304] T d4e943e5bbd7402da6bcc00db70cec14 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:17.736917  2811 leader_election.cc:290] T 86834d94d1d64596abfa609754b5d58a P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 election: Requested vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:17.778080  2519 raft_consensus.cc:2804] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:17.780165  2519 raft_consensus.cc:697] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39 [term 3 LEADER]: Becoming Leader. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Running, Role: LEADER
I20260709 13:12:17.741328  2873 consensus_queue.cc:237] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:17.777472  2236 leader_election.cc:304] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:17.750634  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86834d94d1d64596abfa609754b5d58a" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:17.763326  2508 raft_consensus.cc:493] T 583390912c6d4daca2df9b5534fb8dca P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.780887  2519 consensus_queue.cc:237] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:17.766213  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622b6cfd76ff495ea6692a1ec0faefc4" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:17.766989  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "421302a9721e4cc9a86e52a183469a70" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:17.769398  2839 raft_consensus.cc:493] T 421302a9721e4cc9a86e52a183469a70 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.786541  2119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d627aa01fd4aefbbae482eb2fb2453" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:17.772274  2726 raft_consensus.cc:2749] T d4e943e5bbd7402da6bcc00db70cec14 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:17.759509  2115 raft_consensus.cc:2468] T 28f2272230d34efa880d5eeed8859669 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 3.
I20260709 13:12:17.783900  2719 raft_consensus.cc:2804] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:17.791271  2119 raft_consensus.cc:2468] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 2.
I20260709 13:12:17.796466  2344 raft_consensus.cc:2468] T a0394490f6984f028daa10be921e242b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 3.
I20260709 13:12:17.785027  2120 raft_consensus.cc:2468] T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 3.
I20260709 13:12:17.790823  2839 raft_consensus.cc:3060] T 421302a9721e4cc9a86e52a183469a70 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:17.800267  2162 leader_election.cc:343] T 622b6cfd76ff495ea6692a1ec0faefc4 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:17.787604  2508 raft_consensus.cc:515] T 583390912c6d4daca2df9b5534fb8dca P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:17.812153  2236 leader_election.cc:304] T 86834d94d1d64596abfa609754b5d58a P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39; no voters: 66e9a8fffd4b4e5a81ca4fa2762773ea
I20260709 13:12:17.812908  2811 raft_consensus.cc:2804] T 86834d94d1d64596abfa609754b5d58a P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:17.813387  2811 raft_consensus.cc:697] T 86834d94d1d64596abfa609754b5d58a P 79b6e57d59e4468ebe4423d871a31b39 [term 3 LEADER]: Becoming Leader. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Running, Role: LEADER
I20260709 13:12:17.810141  2805 raft_consensus.cc:493] T bdee3fd7553a47afae3ec9dbdce6d829 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.816260  2805 raft_consensus.cc:515] T bdee3fd7553a47afae3ec9dbdce6d829 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:17.816366  2811 consensus_queue.cc:237] T 86834d94d1d64596abfa609754b5d58a P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:17.813460  2114 raft_consensus.cc:2468] T 622b6cfd76ff495ea6692a1ec0faefc4 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 1.
I20260709 13:12:17.818446  2805 leader_election.cc:290] T bdee3fd7553a47afae3ec9dbdce6d829 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:17.825659  2817 leader_election.cc:290] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:17.828163  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4edf26b74c5d4e5d9a33d2b1fc1bb0ae" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:17.828761  2116 raft_consensus.cc:2468] T a0394490f6984f028daa10be921e242b P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 3.
I20260709 13:12:17.830036  2236 leader_election.cc:304] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:17.830165  2508 leader_election.cc:290] T 583390912c6d4daca2df9b5534fb8dca P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:17.801208  2191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d627aa01fd4aefbbae482eb2fb2453" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:17.830786  2865 raft_consensus.cc:2804] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:17.831252  2865 raft_consensus.cc:697] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39 [term 3 LEADER]: Becoming Leader. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Running, Role: LEADER
I20260709 13:12:17.831616  2730 raft_consensus.cc:2749] T 7475d672f7b3489393d6202c8b31e47f P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303) with higher term. Message: Invalid argument: T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ac5c5682f914ed9b9982b5a080d5472 for earlier term 2. Current term is 3.
I20260709 13:12:17.832049  2865 consensus_queue.cc:237] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:17.805874  2719 raft_consensus.cc:697] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 LEADER]: Becoming Leader. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Running, Role: LEADER
I20260709 13:12:17.804757  2820 raft_consensus.cc:2749] T 1478f883c539464bb54fe9bff44148d5 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859) with higher term. Message: Invalid argument: T 1478f883c539464bb54fe9bff44148d5 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ac5c5682f914ed9b9982b5a080d5472 for earlier term 2. Current term is 3.
I20260709 13:12:17.832536  2815 raft_consensus.cc:493] T a332070dcdff450b939e74ef5b68425a P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.835678  2815 raft_consensus.cc:515] T a332070dcdff450b939e74ef5b68425a P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:17.836298  2162 leader_election.cc:304] T 622b6cfd76ff495ea6692a1ec0faefc4 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472; no voters: 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:17.837853  2744 raft_consensus.cc:2804] T 622b6cfd76ff495ea6692a1ec0faefc4 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:17.837669  2815 leader_election.cc:290] T a332070dcdff450b939e74ef5b68425a P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:17.842103  2189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdee3fd7553a47afae3ec9dbdce6d829" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:17.842743  2189 raft_consensus.cc:2468] T bdee3fd7553a47afae3ec9dbdce6d829 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 2.
I20260709 13:12:17.828778  2265 raft_consensus.cc:2468] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 2.
I20260709 13:12:17.846980  2087 leader_election.cc:304] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:17.847851  2820 raft_consensus.cc:2804] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:17.848228  2820 raft_consensus.cc:493] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79b6e57d59e4468ebe4423d871a31b39)
I20260709 13:12:17.848542  2820 raft_consensus.cc:3060] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:17.854017  2191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4edf26b74c5d4e5d9a33d2b1fc1bb0ae" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:17.854844  2191 raft_consensus.cc:2393] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ac5c5682f914ed9b9982b5a080d5472 in current term 2: Already voted for candidate 0ec6a5d1452a41bd992a8c7922473b35 in this term.
I20260709 13:12:17.845472  2719 consensus_queue.cc:237] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:17.863837  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a332070dcdff450b939e74ef5b68425a" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:17.838392  2744 raft_consensus.cc:697] T 622b6cfd76ff495ea6692a1ec0faefc4 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 LEADER]: Becoming Leader. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Running, Role: LEADER
I20260709 13:12:17.865911  2744 consensus_queue.cc:237] T 622b6cfd76ff495ea6692a1ec0faefc4 P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:17.864800  2114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a332070dcdff450b939e74ef5b68425a" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:17.868388  2198 raft_consensus.cc:3060] T a332070dcdff450b939e74ef5b68425a P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:17.864715  2237 leader_election.cc:304] T bdee3fd7553a47afae3ec9dbdce6d829 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:17.874951  2805 raft_consensus.cc:2804] T bdee3fd7553a47afae3ec9dbdce6d829 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:17.875324  2805 raft_consensus.cc:493] T bdee3fd7553a47afae3ec9dbdce6d829 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.875644  2805 raft_consensus.cc:3060] T bdee3fd7553a47afae3ec9dbdce6d829 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:17.878505  2162 leader_election.cc:304] T a332070dcdff450b939e74ef5b68425a P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea
I20260709 13:12:17.847168  2393 tablet_bootstrap.cc:492] T 10de08c2346d47dbbd720596cd7e02fd P 0ec6a5d1452a41bd992a8c7922473b35: No bootstrap required, opened a new log
I20260709 13:12:17.883749  2393 ts_tablet_manager.cc:1403] T 10de08c2346d47dbbd720596cd7e02fd P 0ec6a5d1452a41bd992a8c7922473b35: Time spent bootstrapping tablet: real 0.297s	user 0.020s	sys 0.008s
I20260709 13:12:17.884179  2508 raft_consensus.cc:493] T bdee3fd7553a47afae3ec9dbdce6d829 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.884667  2508 raft_consensus.cc:515] T bdee3fd7553a47afae3ec9dbdce6d829 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:17.887290  2191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdee3fd7553a47afae3ec9dbdce6d829" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:17.887933  2191 raft_consensus.cc:2468] T bdee3fd7553a47afae3ec9dbdce6d829 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 2.
I20260709 13:12:17.889717  2311 leader_election.cc:304] T bdee3fd7553a47afae3ec9dbdce6d829 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:17.889904  2730 consensus_queue.cc:1048] T d0d102459578474fbe77af94f3986a84 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:17.890511  2855 raft_consensus.cc:2804] T bdee3fd7553a47afae3ec9dbdce6d829 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:17.890842  2855 raft_consensus.cc:493] T bdee3fd7553a47afae3ec9dbdce6d829 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.891160  2855 raft_consensus.cc:3060] T bdee3fd7553a47afae3ec9dbdce6d829 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:17.888697  2508 leader_election.cc:290] T bdee3fd7553a47afae3ec9dbdce6d829 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:17.899085  2855 raft_consensus.cc:515] T bdee3fd7553a47afae3ec9dbdce6d829 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:17.900002  2839 raft_consensus.cc:515] T 421302a9721e4cc9a86e52a183469a70 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:17.902033  2191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdee3fd7553a47afae3ec9dbdce6d829" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:17.902673  2191 raft_consensus.cc:3060] T bdee3fd7553a47afae3ec9dbdce6d829 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:17.902616  2189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "421302a9721e4cc9a86e52a183469a70" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:17.903376  2189 raft_consensus.cc:3060] T 421302a9721e4cc9a86e52a183469a70 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:17.908197  2820 raft_consensus.cc:515] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:17.910197  2189 raft_consensus.cc:2468] T 421302a9721e4cc9a86e52a183469a70 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 1.
I20260709 13:12:17.910337  2018 catalog_manager.cc:5697] T 2993800f8e7e4c09bfe0b2be13e4394c P 0ec6a5d1452a41bd992a8c7922473b35 reported cstate change: term changed from 2 to 3, leader changed from 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67) to 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66). New cstate: current_term: 3 leader_uuid: "0ec6a5d1452a41bd992a8c7922473b35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:17.911453  2311 leader_election.cc:304] T 421302a9721e4cc9a86e52a183469a70 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:17.911473  2581 raft_consensus.cc:493] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:17.912528  2581 raft_consensus.cc:515] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:17.913041  2018 catalog_manager.cc:5697] T bc42d18a324e4f6d97f07cf770c5daa8 P 0ec6a5d1452a41bd992a8c7922473b35 reported cstate change: term changed from 1 to 3, leader changed from 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65) to 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66). New cstate: current_term: 3 leader_uuid: "0ec6a5d1452a41bd992a8c7922473b35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:17.914438  2581 leader_election.cc:290] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:17.915160  2508 raft_consensus.cc:2804] T 421302a9721e4cc9a86e52a183469a70 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:17.915807  2508 raft_consensus.cc:697] T 421302a9721e4cc9a86e52a183469a70 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 LEADER]: Becoming Leader. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Running, Role: LEADER
I20260709 13:12:17.916795  2508 consensus_queue.cc:237] T 421302a9721e4cc9a86e52a183469a70 P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:17.919473  2020 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50228 (request call id 66) took 1832 ms. Trace:
I20260709 13:12:17.924708  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0fb3f7bf85419cbf7ecda4727ccb89" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:17.925318  2268 raft_consensus.cc:2468] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 2.
I20260709 13:12:17.926689  2855 leader_election.cc:290] T bdee3fd7553a47afae3ec9dbdce6d829 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 3 election: Requested vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:17.927767  2116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0fb3f7bf85419cbf7ecda4727ccb89" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:17.931437  2191 raft_consensus.cc:2468] T bdee3fd7553a47afae3ec9dbdce6d829 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 3.
I20260709 13:12:17.939333  2311 leader_election.cc:304] T bdee3fd7553a47afae3ec9dbdce6d829 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:17.940181  2855 raft_consensus.cc:2804] T bdee3fd7553a47afae3ec9dbdce6d829 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:17.940866  2855 raft_consensus.cc:697] T bdee3fd7553a47afae3ec9dbdce6d829 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 LEADER]: Becoming Leader. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Running, Role: LEADER
I20260709 13:12:17.941732  2855 consensus_queue.cc:237] T bdee3fd7553a47afae3ec9dbdce6d829 P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:17.947573  2393 raft_consensus.cc:359] T 10de08c2346d47dbbd720596cd7e02fd P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:17.948378  2393 raft_consensus.cc:385] T 10de08c2346d47dbbd720596cd7e02fd P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:17.948648  2393 raft_consensus.cc:740] T 10de08c2346d47dbbd720596cd7e02fd P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Initialized, Role: FOLLOWER
I20260709 13:12:17.949306  2393 consensus_queue.cc:260] T 10de08c2346d47dbbd720596cd7e02fd P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:17.951486  2393 ts_tablet_manager.cc:1434] T 10de08c2346d47dbbd720596cd7e02fd P 0ec6a5d1452a41bd992a8c7922473b35: Time spent starting tablet: real 0.067s	user 0.005s	sys 0.000s
I20260709 13:12:17.952489  2393 tablet_bootstrap.cc:492] T d0d102459578474fbe77af94f3986a84 P 0ec6a5d1452a41bd992a8c7922473b35: Bootstrap starting.
I20260709 13:12:17.929482  2162 leader_election.cc:304] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39; no voters: 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:17.954597  2581 raft_consensus.cc:2804] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:17.954960  2581 raft_consensus.cc:493] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:17.955269  2581 raft_consensus.cc:3060] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:17.961445  2189 raft_consensus.cc:3060] T 10de08c2346d47dbbd720596cd7e02fd P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:17.964112  2581 raft_consensus.cc:515] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:17.966174  2581 leader_election.cc:290] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 3 election: Requested vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:17.982395  2017 catalog_manager.cc:5697] T a9be6d55d1f348bcaf96405abc80244d P 79b6e57d59e4468ebe4423d871a31b39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68). New cstate: current_term: 1 leader_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } }
I20260709 13:12:17.984082  2017 catalog_manager.cc:5697] T ddf48e4f6be64627a0ed06d6198ca054 P 79b6e57d59e4468ebe4423d871a31b39 reported cstate change: term changed from 0 to 2, leader changed from <none> to 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67). New cstate: current_term: 2 leader_uuid: "79b6e57d59e4468ebe4423d871a31b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:17.996619  2839 leader_election.cc:290] T 421302a9721e4cc9a86e52a183469a70 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 election: Requested vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:17.897392  2805 raft_consensus.cc:515] T bdee3fd7553a47afae3ec9dbdce6d829 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:17.999692  2805 leader_election.cc:290] T bdee3fd7553a47afae3ec9dbdce6d829 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 election: Requested vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:18.006083  2392 tablet_bootstrap.cc:492] T 1588358a9e7542dfbd8b5d2f65212aec P 66e9a8fffd4b4e5a81ca4fa2762773ea: No bootstrap required, opened a new log
I20260709 13:12:18.006629  2392 ts_tablet_manager.cc:1403] T 1588358a9e7542dfbd8b5d2f65212aec P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent bootstrapping tablet: real 0.444s	user 0.011s	sys 0.008s
W20260709 13:12:18.011883  2162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:38869, user_credentials={real_user=slave}} blocked reactor thread for 52710.7us
I20260709 13:12:18.013803  2116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0fb3f7bf85419cbf7ecda4727ccb89" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:17.919909  2020 rpcz_store.cc:276] 0709 13:12:16.087047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:16.087188 (+   141us) service_pool.cc:224] Handling call
0709 13:12:17.919417 (+1832229us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:17.538180 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:17.538683 (+   503us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:17.538714 (+    31us) write_op.cc:435] Acquired schema lock
0709 13:12:17.538732 (+    18us) tablet.cc:662] Decoding operations
0709 13:12:17.539252 (+   520us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:17.539321 (+    69us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:17.539344 (+    23us) tablet.cc:685] Acquiring locks for 3 operations
0709 13:12:17.539631 (+   287us) tablet.cc:701] Row locks acquired
0709 13:12:17.539648 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:12:17.539771 (+   123us) write_op.cc:270] Start()
0709 13:12:17.539866 (+    95us) write_op.cc:276] Timestamp: P: 1783602737539731 usec, L: 0
0709 13:12:17.539885 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 13:12:17.540465 (+   580us) log.cc:844] Serialized 1307 byte log entry
0709 13:12:17.584339 (+ 43874us) op_driver.cc:464] REPLICATION: finished
0709 13:12:17.799326 (+214987us) write_op.cc:301] APPLY: starting
0709 13:12:17.802991 (+  3665us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:17.810232 (+  7241us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:17.816037 (+  5805us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:17.816526 (+   489us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:17.816714 (+   188us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 13:12:17.816762 (+    48us) write_op.cc:312] APPLY: finished
0709 13:12:17.816955 (+   193us) log.cc:844] Serialized 34 byte log entry
0709 13:12:17.817122 (+   167us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:17.817210 (+    88us) write_op.cc:454] Released schema lock
0709 13:12:17.817249 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:17.817578 (+   329us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:17.817605 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":172760,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":203860,"apply.run_cpu_time_us":1967,"apply.run_wall_time_us":24164,"num_ops":3,"prepare.queue_time_us":151311,"prepare.run_cpu_time_us":2659,"prepare.run_wall_time_us":29556,"replication_time_us":44312,"thread_start_us":169823,"threads_started":2}]]}
I20260709 13:12:18.018976  2196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4edf26b74c5d4e5d9a33d2b1fc1bb0ae" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:18.019820  2196 raft_consensus.cc:2393] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ac5c5682f914ed9b9982b5a080d5472 in current term 2: Already voted for candidate 0ec6a5d1452a41bd992a8c7922473b35 in this term.
I20260709 13:12:18.009298  2392 raft_consensus.cc:359] T 1588358a9e7542dfbd8b5d2f65212aec P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:18.024026  2392 raft_consensus.cc:385] T 1588358a9e7542dfbd8b5d2f65212aec P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:18.024374  2392 raft_consensus.cc:740] T 1588358a9e7542dfbd8b5d2f65212aec P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:18.030426  2018 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50236 (request call id 76) took 1151 ms. Trace:
I20260709 13:12:18.045950  2392 consensus_queue.cc:260] T 1588358a9e7542dfbd8b5d2f65212aec P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
W20260709 13:12:18.052757  2310 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:34303, user_credentials={real_user=slave}} blocked reactor thread for 255132us
W20260709 13:12:18.059952  2310 leader_election.cc:343] T 421302a9721e4cc9a86e52a183469a70 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:18.062798  2392 ts_tablet_manager.cc:1434] T 1588358a9e7542dfbd8b5d2f65212aec P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.000s
I20260709 13:12:18.070334  2402 tablet_bootstrap.cc:492] T 1588358a9e7542dfbd8b5d2f65212aec P 79b6e57d59e4468ebe4423d871a31b39: No bootstrap required, opened a new log
I20260709 13:12:18.070809  2402 ts_tablet_manager.cc:1403] T 1588358a9e7542dfbd8b5d2f65212aec P 79b6e57d59e4468ebe4423d871a31b39: Time spent bootstrapping tablet: real 0.653s	user 0.040s	sys 0.029s
I20260709 13:12:18.044152  2805 raft_consensus.cc:493] T 8b65903ab966485c9c65bdfbdf1e1054 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec6a5d1452a41bd992a8c7922473b35)
I20260709 13:12:18.038640  2018 rpcz_store.cc:276] 0709 13:12:16.878687 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:16.878802 (+   115us) service_pool.cc:224] Handling call
0709 13:12:17.976129 (+1097327us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:17.976157 (+    28us) write_op.cc:454] Released schema lock
0709 13:12:18.030358 (+ 54201us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:17.966587 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:17.967080 (+   493us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:17.967111 (+    31us) write_op.cc:435] Acquired schema lock
0709 13:12:17.967126 (+    15us) tablet.cc:662] Decoding operations
0709 13:12:17.967495 (+   369us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:17.967546 (+    51us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:17.967585 (+    39us) tablet.cc:685] Acquiring locks for 2 operations
0709 13:12:17.967897 (+   312us) tablet.cc:701] Row locks acquired
0709 13:12:17.967912 (+    15us) write_op.cc:260] PREPARE: finished
0709 13:12:17.968036 (+   124us) write_op.cc:270] Start()
0709 13:12:17.968135 (+    99us) write_op.cc:276] Timestamp: P: 1783602737967997 usec, L: 0
0709 13:12:17.968153 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 13:12:17.968712 (+   559us) log.cc:844] Serialized 922 byte log entry
0709 13:12:17.970632 (+  1920us) op_driver.cc:464] REPLICATION: finished
0709 13:12:17.973697 (+  3065us) write_op.cc:301] APPLY: starting
0709 13:12:17.973809 (+   112us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:17.973917 (+   108us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:17.973997 (+    80us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:17.974311 (+   314us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:17.974463 (+   152us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 13:12:17.974505 (+    42us) write_op.cc:312] APPLY: finished
0709 13:12:17.974680 (+   175us) log.cc:844] Serialized 28 byte log entry
0709 13:12:17.974825 (+   145us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:17.974928 (+   103us) write_op.cc:454] Released schema lock
0709 13:12:17.974968 (+    40us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":101323,"reported_tablets":9,"child_traces":[["op",{"apply.queue_time_us":2861,"apply.run_cpu_time_us":1536,"apply.run_wall_time_us":1548,"num_ops":2,"prepare.queue_time_us":49537,"prepare.run_cpu_time_us":2378,"prepare.run_wall_time_us":2377,"replication_time_us":2358}]]}
I20260709 13:12:18.067317  2019 catalog_manager.cc:5697] T a332070dcdff450b939e74ef5b68425a P 66e9a8fffd4b4e5a81ca4fa2762773ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "2ac5c5682f914ed9b9982b5a080d5472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } }
I20260709 13:12:18.062080  2649 raft_consensus.cc:493] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.072928  2019 catalog_manager.cc:5697] T df8d897471684531826528a5751d6246 P 66e9a8fffd4b4e5a81ca4fa2762773ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68). New cstate: current_term: 1 leader_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:18.066928  2196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdee3fd7553a47afae3ec9dbdce6d829" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:18.093191  2019 catalog_manager.cc:5697] T 6bf4f728eedf41bdb027f554c3a5ae1f P 66e9a8fffd4b4e5a81ca4fa2762773ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68). New cstate: current_term: 1 leader_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:18.077345  2820 leader_election.cc:290] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 election: Requested vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:18.082460  2116 raft_consensus.cc:3060] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:18.101792  2196 raft_consensus.cc:2393] T bdee3fd7553a47afae3ec9dbdce6d829 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 79b6e57d59e4468ebe4423d871a31b39 in current term 3: Already voted for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in this term.
I20260709 13:12:18.104441  2391 tablet_bootstrap.cc:492] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472: No bootstrap required, opened a new log
I20260709 13:12:18.081136  2649 raft_consensus.cc:515] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:18.104948  2391 ts_tablet_manager.cc:1403] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.599s	user 0.018s	sys 0.004s
I20260709 13:12:18.086393  2815 raft_consensus.cc:2749] T a332070dcdff450b939e74ef5b68425a P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:18.077816  2805 raft_consensus.cc:515] T 8b65903ab966485c9c65bdfbdf1e1054 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:18.089105  2123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583390912c6d4daca2df9b5534fb8dca" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:18.115092  2310 leader_election.cc:304] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 0ec6a5d1452a41bd992a8c7922473b35
I20260709 13:12:18.093065  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4edf26b74c5d4e5d9a33d2b1fc1bb0ae" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:18.121335  2338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdee3fd7553a47afae3ec9dbdce6d829" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:18.121977  2730 consensus_queue.cc:1048] T 10de08c2346d47dbbd720596cd7e02fd P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:18.113775  2855 raft_consensus.cc:493] T 86834d94d1d64596abfa609754b5d58a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 79b6e57d59e4468ebe4423d871a31b39)
I20260709 13:12:18.124567  2855 raft_consensus.cc:515] T 86834d94d1d64596abfa609754b5d58a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:18.126461  2855 leader_election.cc:290] T 86834d94d1d64596abfa609754b5d58a P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:18.128265  2805 leader_election.cc:290] T 8b65903ab966485c9c65bdfbdf1e1054 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
W20260709 13:12:18.134954  2310 leader_election.cc:343] T 583390912c6d4daca2df9b5534fb8dca P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:18.140895  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583390912c6d4daca2df9b5534fb8dca" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:18.118472  2581 raft_consensus.cc:493] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.144415  2193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b65903ab966485c9c65bdfbdf1e1054" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:18.145510  2195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b65903ab966485c9c65bdfbdf1e1054" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:18.145974  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdee3fd7553a47afae3ec9dbdce6d829" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:18.139261  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdee3fd7553a47afae3ec9dbdce6d829" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:18.153035  2195 raft_consensus.cc:2468] T 8b65903ab966485c9c65bdfbdf1e1054 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 2.
I20260709 13:12:18.125034  2649 leader_election.cc:290] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:18.129966  2894 raft_consensus.cc:2804] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:18.154320  2894 raft_consensus.cc:493] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:18.154675  2894 raft_consensus.cc:3060] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:18.155083  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86834d94d1d64596abfa609754b5d58a" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:18.156106  2272 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b65903ab966485c9c65bdfbdf1e1054" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:18.156602  2272 raft_consensus.cc:2468] T 8b65903ab966485c9c65bdfbdf1e1054 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 1.
I20260709 13:12:18.128763  2805 raft_consensus.cc:493] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 66e9a8fffd4b4e5a81ca4fa2762773ea)
I20260709 13:12:18.158792  2805 raft_consensus.cc:515] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:18.160208  2115 raft_consensus.cc:1275] T 427b10072083419c89d5a4bf5d6413fc P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Refusing update from remote peer 66e9a8fffd4b4e5a81ca4fa2762773ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:18.160460  2191 raft_consensus.cc:1275] T 1478f883c539464bb54fe9bff44148d5 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Refusing update from remote peer 79b6e57d59e4468ebe4423d871a31b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:18.160748  2805 leader_election.cc:290] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:18.164160  2236 leader_election.cc:304] T bdee3fd7553a47afae3ec9dbdce6d829 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b6e57d59e4468ebe4423d871a31b39; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea
I20260709 13:12:18.148170  2391 raft_consensus.cc:359] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:18.152720  2271 raft_consensus.cc:2393] T bdee3fd7553a47afae3ec9dbdce6d829 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in current term 3: Already voted for candidate 79b6e57d59e4468ebe4423d871a31b39 in this term.
I20260709 13:12:18.152356  2581 raft_consensus.cc:515] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:18.199807  2311 leader_election.cc:304] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:18.207316  2391 raft_consensus.cc:385] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:18.209509  2392 tablet_bootstrap.cc:492] T 38d5e9a8f42c4a2993d25a8a341fddbf P 66e9a8fffd4b4e5a81ca4fa2762773ea: Bootstrap starting.
I20260709 13:12:18.215199  2581 leader_election.cc:290] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:18.218719  2264 raft_consensus.cc:2468] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 2.
I20260709 13:12:18.210916  2393 tablet_bootstrap.cc:654] T d0d102459578474fbe77af94f3986a84 P 0ec6a5d1452a41bd992a8c7922473b35: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:18.219578  2391 raft_consensus.cc:740] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
W20260709 13:12:18.220260  2311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:38859, user_credentials={real_user=slave}} blocked reactor thread for 54085.4us
I20260709 13:12:18.222018  2391 consensus_queue.cc:260] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:18.224756  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f0f1b0143c4363a9b900eae4ac3ea9" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:18.225437  2341 raft_consensus.cc:2468] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 2.
I20260709 13:12:18.231500  2402 raft_consensus.cc:359] T 1588358a9e7542dfbd8b5d2f65212aec P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:18.232033  2402 raft_consensus.cc:385] T 1588358a9e7542dfbd8b5d2f65212aec P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:18.232208  2402 raft_consensus.cc:740] T 1588358a9e7542dfbd8b5d2f65212aec P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Initialized, Role: FOLLOWER
I20260709 13:12:18.230613  2162 leader_election.cc:304] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:18.222114  2805 raft_consensus.cc:2749] T bdee3fd7553a47afae3ec9dbdce6d829 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:12:18.261363  2845 raft_consensus.cc:2804] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:18.265579  2087 leader_election.cc:304] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39; no voters: 0ec6a5d1452a41bd992a8c7922473b35
I20260709 13:12:18.234714  2649 consensus_queue.cc:1048] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 13:12:18.270136  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f0f1b0143c4363a9b900eae4ac3ea9" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
W20260709 13:12:18.269567  2310 leader_election.cc:343] T 583390912c6d4daca2df9b5534fb8dca P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:18.271449  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "421302a9721e4cc9a86e52a183469a70" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:18.272818  2340 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b65903ab966485c9c65bdfbdf1e1054" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:18.233042  2907 raft_consensus.cc:2804] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:18.222486  2811 consensus_queue.cc:1048] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.049s
I20260709 13:12:18.280165  2402 consensus_queue.cc:260] T 1588358a9e7542dfbd8b5d2f65212aec P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:18.233665  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f0f1b0143c4363a9b900eae4ac3ea9" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:18.283272  2392 tablet_bootstrap.cc:654] T 38d5e9a8f42c4a2993d25a8a341fddbf P 66e9a8fffd4b4e5a81ca4fa2762773ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:18.285488  2123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86834d94d1d64596abfa609754b5d58a" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:18.228706  2189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f0f1b0143c4363a9b900eae4ac3ea9" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:18.287336  2198 raft_consensus.cc:1240] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Rejecting Update request from peer 2ac5c5682f914ed9b9982b5a080d5472 for earlier term 2. Current term is 3. Ops: []
W20260709 13:12:18.287688  2088 consensus_peers.cc:597] T d0d102459578474fbe77af94f3986a84 P 2ac5c5682f914ed9b9982b5a080d5472 -> Peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Couldn't send request to peer 0ec6a5d1452a41bd992a8c7922473b35. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:18.293705  2730 consensus_queue.cc:1048] T 10de08c2346d47dbbd720596cd7e02fd P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.033s
I20260709 13:12:18.290197  2310 leader_election.cc:304] T 583390912c6d4daca2df9b5534fb8dca P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:18.291860  2391 ts_tablet_manager.cc:1434] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.186s	user 0.011s	sys 0.006s
I20260709 13:12:18.260025  2855 raft_consensus.cc:493] T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:18.287271  2845 raft_consensus.cc:493] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:18.313211  2265 raft_consensus.cc:1275] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Refusing update from remote peer 2ac5c5682f914ed9b9982b5a080d5472: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:18.304975  2264 raft_consensus.cc:2468] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 1.
I20260709 13:12:18.318989  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bdee3fd7553a47afae3ec9dbdce6d829" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:18.319772  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0fb3f7bf85419cbf7ecda4727ccb89" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
W20260709 13:12:18.326840  2310 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:34303, user_credentials={real_user=slave}} blocked reactor thread for 57305.1us
I20260709 13:12:18.327534  2402 ts_tablet_manager.cc:1434] T 1588358a9e7542dfbd8b5d2f65212aec P 79b6e57d59e4468ebe4423d871a31b39: Time spent starting tablet: real 0.256s	user 0.007s	sys 0.001s
I20260709 13:12:18.294402  2907 raft_consensus.cc:493] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:18.350261  2123 raft_consensus.cc:2368] T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66e9a8fffd4b4e5a81ca4fa2762773ea for earlier term 2. Current term is 3.
I20260709 13:12:18.343566  2815 raft_consensus.cc:493] T 10de08c2346d47dbbd720596cd7e02fd P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.354723  2266 raft_consensus.cc:2393] T bdee3fd7553a47afae3ec9dbdce6d829 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in current term 3: Already voted for candidate 79b6e57d59e4468ebe4423d871a31b39 in this term.
I20260709 13:12:18.330871  2818 raft_consensus.cc:2804] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:18.356686  2818 raft_consensus.cc:697] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 LEADER]: Becoming Leader. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Running, Role: LEADER
I20260709 13:12:18.348264  2907 raft_consensus.cc:3060] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:18.357600  2818 consensus_queue.cc:237] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:18.331820  2845 raft_consensus.cc:3060] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:18.328264  2857 raft_consensus.cc:2749] T 583390912c6d4daca2df9b5534fb8dca P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:18.362800  2391 tablet_bootstrap.cc:492] T d1ddcfd4d0914e40ae0a684fd8726d24 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:18.328876  2345 raft_consensus.cc:2468] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 2.
W20260709 13:12:18.360177  2310 leader_election.cc:343] T 421302a9721e4cc9a86e52a183469a70 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:18.346823  2730 consensus_queue.cc:1059] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:12:18.331804  2855 raft_consensus.cc:515] T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:18.401201  2402 tablet_bootstrap.cc:492] T bad0fdea1e3a409aab372c59eaa33767 P 79b6e57d59e4468ebe4423d871a31b39: Bootstrap starting.
I20260709 13:12:18.402380  2310 leader_election.cc:400] T 86834d94d1d64596abfa609754b5d58a P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Vote denied by peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557) with higher term. Message: Invalid argument: T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66e9a8fffd4b4e5a81ca4fa2762773ea for earlier term 2. Current term is 3.
I20260709 13:12:18.354861  2815 raft_consensus.cc:515] T 10de08c2346d47dbbd720596cd7e02fd P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:18.408174  2855 leader_election.cc:290] T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:18.402720  2310 leader_election.cc:403] T 86834d94d1d64596abfa609754b5d58a P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:18.416211  2855 raft_consensus.cc:3060] T 86834d94d1d64596abfa609754b5d58a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:12:18.421609  2119 raft_consensus.cc:1275] T 7475d672f7b3489393d6202c8b31e47f P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Refusing update from remote peer 79b6e57d59e4468ebe4423d871a31b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:18.401885  2451 consensus_queue.cc:1048] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:12:18.420542  2236 leader_election.cc:304] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:18.425460  2916 raft_consensus.cc:2804] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:18.425860  2916 raft_consensus.cc:493] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 66e9a8fffd4b4e5a81ca4fa2762773ea)
I20260709 13:12:18.426417  2916 raft_consensus.cc:3060] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:18.427541  2341 raft_consensus.cc:1275] T 7475d672f7b3489393d6202c8b31e47f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Refusing update from remote peer 79b6e57d59e4468ebe4423d871a31b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:18.425836  2344 raft_consensus.cc:1275] T a0394490f6984f028daa10be921e242b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Refusing update from remote peer 79b6e57d59e4468ebe4423d871a31b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:18.450311  2392 tablet_bootstrap.cc:492] T 38d5e9a8f42c4a2993d25a8a341fddbf P 66e9a8fffd4b4e5a81ca4fa2762773ea: No bootstrap required, opened a new log
I20260709 13:12:18.450793  2392 ts_tablet_manager.cc:1403] T 38d5e9a8f42c4a2993d25a8a341fddbf P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent bootstrapping tablet: real 0.242s	user 0.008s	sys 0.006s
I20260709 13:12:18.453804  2815 leader_election.cc:290] T 10de08c2346d47dbbd720596cd7e02fd P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:18.448750  2719 consensus_queue.cc:1048] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:12:18.448890  2839 raft_consensus.cc:493] T 1588358a9e7542dfbd8b5d2f65212aec P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.490697  2120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10de08c2346d47dbbd720596cd7e02fd" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:18.455265  2115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b82132c31545aab274c7cf3f77c277" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:18.526638  2118 raft_consensus.cc:1275] T 1478f883c539464bb54fe9bff44148d5 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Refusing update from remote peer 79b6e57d59e4468ebe4423d871a31b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:18.528141  2197 raft_consensus.cc:1275] T bdee3fd7553a47afae3ec9dbdce6d829 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Refusing update from remote peer 66e9a8fffd4b4e5a81ca4fa2762773ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:18.529412  2391 tablet_bootstrap.cc:654] T d1ddcfd4d0914e40ae0a684fd8726d24 P 2ac5c5682f914ed9b9982b5a080d5472: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:18.414402  2894 raft_consensus.cc:515] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:18.535374  2264 raft_consensus.cc:1275] T 427b10072083419c89d5a4bf5d6413fc P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Refusing update from remote peer 66e9a8fffd4b4e5a81ca4fa2762773ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:18.536496  2393 tablet_bootstrap.cc:492] T d0d102459578474fbe77af94f3986a84 P 0ec6a5d1452a41bd992a8c7922473b35: No bootstrap required, opened a new log
I20260709 13:12:18.536993  2393 ts_tablet_manager.cc:1403] T d0d102459578474fbe77af94f3986a84 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent bootstrapping tablet: real 0.585s	user 0.009s	sys 0.004s
W20260709 13:12:18.539237  2087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:38869, user_credentials={real_user=slave}} blocked reactor thread for 92475.2us
I20260709 13:12:18.538069  2338 raft_consensus.cc:1275] T 28f2272230d34efa880d5eeed8859669 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Refusing update from remote peer 79b6e57d59e4468ebe4423d871a31b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:18.466959  2795 consensus_queue.cc:1048] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.081s
I20260709 13:12:18.541930  2115 raft_consensus.cc:2468] T b3b82132c31545aab274c7cf3f77c277 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 2.
I20260709 13:12:18.570606  2118 raft_consensus.cc:1275] T 28f2272230d34efa880d5eeed8859669 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Refusing update from remote peer 79b6e57d59e4468ebe4423d871a31b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:18.530681  2839 raft_consensus.cc:515] T 1588358a9e7542dfbd8b5d2f65212aec P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:18.569476  2392 raft_consensus.cc:359] T 38d5e9a8f42c4a2993d25a8a341fddbf P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:18.584995  2392 raft_consensus.cc:385] T 38d5e9a8f42c4a2993d25a8a341fddbf P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:18.585335  2392 raft_consensus.cc:740] T 38d5e9a8f42c4a2993d25a8a341fddbf P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:18.542459  2805 consensus_queue.cc:1048] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:12:18.592448  2392 consensus_queue.cc:260] T 38d5e9a8f42c4a2993d25a8a341fddbf P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:18.596390  2393 raft_consensus.cc:359] T d0d102459578474fbe77af94f3986a84 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:18.597095  2393 raft_consensus.cc:385] T d0d102459578474fbe77af94f3986a84 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:18.597360  2393 raft_consensus.cc:740] T d0d102459578474fbe77af94f3986a84 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Initialized, Role: FOLLOWER
I20260709 13:12:18.585878  2865 consensus_queue.cc:1048] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:12:18.599123  2817 raft_consensus.cc:3055] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:18.599993  2817 raft_consensus.cc:740] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Running, Role: LEADER
I20260709 13:12:18.605561  2393 consensus_queue.cc:260] T d0d102459578474fbe77af94f3986a84 P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:18.626422  2392 ts_tablet_manager.cc:1434] T 38d5e9a8f42c4a2993d25a8a341fddbf P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent starting tablet: real 0.175s	user 0.006s	sys 0.001s
I20260709 13:12:18.594995  2815 raft_consensus.cc:493] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.634649  2393 ts_tablet_manager.cc:1434] T d0d102459578474fbe77af94f3986a84 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent starting tablet: real 0.097s	user 0.007s	sys 0.000s
I20260709 13:12:18.595412  2845 raft_consensus.cc:515] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:18.632350  2855 raft_consensus.cc:2749] T 86834d94d1d64596abfa609754b5d58a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557) with higher term. Message: Invalid argument: T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66e9a8fffd4b4e5a81ca4fa2762773ea for earlier term 2. Current term is 3.
I20260709 13:12:18.644099  2393 tablet_bootstrap.cc:492] T bad0fdea1e3a409aab372c59eaa33767 P 0ec6a5d1452a41bd992a8c7922473b35: Bootstrap starting.
W20260709 13:12:18.645083  2087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:38869, user_credentials={real_user=slave}} blocked reactor thread for 94146.2us
I20260709 13:12:18.632741  2815 raft_consensus.cc:515] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:18.652184  2195 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b82132c31545aab274c7cf3f77c277" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:18.657189  2195 raft_consensus.cc:2393] T b3b82132c31545aab274c7cf3f77c277 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in current term 2: Already voted for candidate 0ec6a5d1452a41bd992a8c7922473b35 in this term.
I20260709 13:12:18.657689  2815 leader_election.cc:290] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:18.658105  2839 leader_election.cc:290] T 1588358a9e7542dfbd8b5d2f65212aec P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:18.660818  2894 leader_election.cc:290] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 3 election: Requested vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:18.665042  2402 tablet_bootstrap.cc:654] T bad0fdea1e3a409aab372c59eaa33767 P 79b6e57d59e4468ebe4423d871a31b39: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:18.633644  2916 raft_consensus.cc:515] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:18.667541  2916 leader_election.cc:290] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 election: Requested vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:18.678535  2337 raft_consensus.cc:3060] T 38d5e9a8f42c4a2993d25a8a341fddbf P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:18.686326  2189 raft_consensus.cc:2368] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79b6e57d59e4468ebe4423d871a31b39 for earlier term 2. Current term is 3.
I20260709 13:12:18.648036  2907 raft_consensus.cc:515] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:18.692878  2907 leader_election.cc:290] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 3 election: Requested vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:18.693535  2339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10de08c2346d47dbbd720596cd7e02fd" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
W20260709 13:12:18.698016  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:36557, user_credentials={real_user=slave}} blocked reactor thread for 58811.2us
I20260709 13:12:18.708504  2310 leader_election.cc:304] T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:18.714993  2914 consensus_queue.cc:1048] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:18.715350  2117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d627aa01fd4aefbbae482eb2fb2453" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:18.715850  2195 raft_consensus.cc:3060] T d0d102459578474fbe77af94f3986a84 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:18.712599  2649 raft_consensus.cc:2804] T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:18.716784  2649 raft_consensus.cc:493] T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:18.717123  2649 raft_consensus.cc:3060] T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:18.718122  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f0f1b0143c4363a9b900eae4ac3ea9" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:18.721838  2916 consensus_queue.cc:1048] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:18.722335  2339 raft_consensus.cc:1275] T 86834d94d1d64596abfa609754b5d58a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Refusing update from remote peer 79b6e57d59e4468ebe4423d871a31b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:18.724342  2845 leader_election.cc:290] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 3 election: Requested vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:18.707340  2921 raft_consensus.cc:493] T b3b82132c31545aab274c7cf3f77c277 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.727385  2921 raft_consensus.cc:515] T b3b82132c31545aab274c7cf3f77c277 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:18.728524  2340 raft_consensus.cc:2368] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79b6e57d59e4468ebe4423d871a31b39 for earlier term 2. Current term is 3.
I20260709 13:12:18.729390  2921 leader_election.cc:290] T b3b82132c31545aab274c7cf3f77c277 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:18.715952  2117 raft_consensus.cc:3060] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:18.748478  2194 raft_consensus.cc:1240] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Rejecting Update request from peer 2ac5c5682f914ed9b9982b5a080d5472 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:12:18.731951  2392 tablet_bootstrap.cc:492] T 46887c40373b4aca811c6382c97cb9bf P 66e9a8fffd4b4e5a81ca4fa2762773ea: Bootstrap starting.
I20260709 13:12:18.736199  2264 raft_consensus.cc:1275] T bdee3fd7553a47afae3ec9dbdce6d829 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Refusing update from remote peer 66e9a8fffd4b4e5a81ca4fa2762773ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:18.737149  2393 tablet_bootstrap.cc:654] T bad0fdea1e3a409aab372c59eaa33767 P 0ec6a5d1452a41bd992a8c7922473b35: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:18.695173  2855 consensus_queue.cc:1048] T bdee3fd7553a47afae3ec9dbdce6d829 P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.042s
I20260709 13:12:18.737867  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1588358a9e7542dfbd8b5d2f65212aec" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:18.753572  2270 raft_consensus.cc:2468] T 1588358a9e7542dfbd8b5d2f65212aec P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 0.
I20260709 13:12:18.738200  2914 consensus_queue.cc:1048] T 86834d94d1d64596abfa609754b5d58a P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:18.693717  2907 consensus_queue.cc:1048] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.061s
I20260709 13:12:18.740234  2191 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d627aa01fd4aefbbae482eb2fb2453" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:18.740674  2817 consensus_queue.cc:260] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:18.741225  2581 raft_consensus.cc:493] T 93d627aa01fd4aefbbae482eb2fb2453 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:18.742147  2197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b65903ab966485c9c65bdfbdf1e1054" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:18.756536  2197 raft_consensus.cc:3060] T 8b65903ab966485c9c65bdfbdf1e1054 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:18.756347  2581 raft_consensus.cc:515] T 93d627aa01fd4aefbbae482eb2fb2453 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:18.743290  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8b65903ab966485c9c65bdfbdf1e1054" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:18.758040  2269 raft_consensus.cc:3060] T 8b65903ab966485c9c65bdfbdf1e1054 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:12:18.758486  2581 leader_election.cc:290] T 93d627aa01fd4aefbbae482eb2fb2453 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:18.759442  2191 raft_consensus.cc:3060] T 93d627aa01fd4aefbbae482eb2fb2453 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:12:18.715101  2122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1588358a9e7542dfbd8b5d2f65212aec" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:18.760093  2392 tablet_bootstrap.cc:654] T 46887c40373b4aca811c6382c97cb9bf P 66e9a8fffd4b4e5a81ca4fa2762773ea: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:18.760288  2122 raft_consensus.cc:2468] T 1588358a9e7542dfbd8b5d2f65212aec P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 0.
W20260709 13:12:18.766346  2310 consensus_peers.cc:597] T 421302a9721e4cc9a86e52a183469a70 P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Couldn't send request to peer 79b6e57d59e4468ebe4423d871a31b39. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:18.770586  2310 leader_election.cc:304] T 1588358a9e7542dfbd8b5d2f65212aec P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
W20260709 13:12:18.791666  2087 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:34303, user_credentials={real_user=slave}} blocked reactor thread for 144077us
I20260709 13:12:18.774962  2925 consensus_queue.cc:1048] T bdee3fd7553a47afae3ec9dbdce6d829 P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 13:12:18.777956  2726 consensus_queue.cc:1048] T 421302a9721e4cc9a86e52a183469a70 P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 13:12:18.789963  2816 consensus_queue.cc:1059] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:12:18.778174  2742 raft_consensus.cc:2804] T 1588358a9e7542dfbd8b5d2f65212aec P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 13:12:18.808316  2069 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:18.820525  2117 raft_consensus.cc:2468] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 3.
I20260709 13:12:18.820895  2816 raft_consensus.cc:493] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.821434  2816 raft_consensus.cc:515] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:18.823621  2816 leader_election.cc:290] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:18.824517  2649 raft_consensus.cc:515] T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:18.825393  2191 raft_consensus.cc:2468] T 93d627aa01fd4aefbbae482eb2fb2453 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 3.
I20260709 13:12:18.826541  2649 leader_election.cc:290] T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 election: Requested vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
W20260709 13:12:18.829648  2310 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:36557, user_credentials={real_user=slave}} blocked reactor thread for 55382.8us
I20260709 13:12:18.806720  2742 raft_consensus.cc:493] T 1588358a9e7542dfbd8b5d2f65212aec P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:18.840490  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ad60fa3bce47daac74b01143b54132" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:18.845264  2344 raft_consensus.cc:2468] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 2.
I20260709 13:12:18.848346  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4edf26b74c5d4e5d9a33d2b1fc1bb0ae" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:18.849015  2266 raft_consensus.cc:2468] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 2.
I20260709 13:12:18.849900  2265 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f0f1b0143c4363a9b900eae4ac3ea9" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:18.850494  2265 raft_consensus.cc:3060] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:18.853998  2310 leader_election.cc:304] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
W20260709 13:12:18.856235  2087 leader_election.cc:343] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:18.871577  2237 leader_election.cc:400] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859) with higher term. Message: Invalid argument: T f3f0f1b0143c4363a9b900eae4ac3ea9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79b6e57d59e4468ebe4423d871a31b39 for earlier term 2. Current term is 3.
I20260709 13:12:18.881637  2120 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d627aa01fd4aefbbae482eb2fb2453" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:18.882452  2120 raft_consensus.cc:2368] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec6a5d1452a41bd992a8c7922473b35 for earlier term 2. Current term is 3.
I20260709 13:12:18.853626  2742 raft_consensus.cc:3060] T 1588358a9e7542dfbd8b5d2f65212aec P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:18.885731  2117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4edf26b74c5d4e5d9a33d2b1fc1bb0ae" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:18.866394  2744 raft_consensus.cc:493] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:18.892135  2162 leader_election.cc:304] T 10de08c2346d47dbbd720596cd7e02fd P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea
I20260709 13:12:18.871901  2123 raft_consensus.cc:1275] T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Refusing update from remote peer 79b6e57d59e4468ebe4423d871a31b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:18.911650  2391 tablet_bootstrap.cc:492] T d1ddcfd4d0914e40ae0a684fd8726d24 P 2ac5c5682f914ed9b9982b5a080d5472: No bootstrap required, opened a new log
I20260709 13:12:18.912352  2391 ts_tablet_manager.cc:1403] T d1ddcfd4d0914e40ae0a684fd8726d24 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.563s	user 0.027s	sys 0.042s
I20260709 13:12:18.878158  2805 consensus_queue.cc:1048] T 38d5e9a8f42c4a2993d25a8a341fddbf P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260709 13:12:18.892902  2339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b82132c31545aab274c7cf3f77c277" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:18.897248  2122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b82132c31545aab274c7cf3f77c277" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:18.928253  2811 consensus_queue.cc:1048] T 38d5e9a8f42c4a2993d25a8a341fddbf P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:18.915925  2194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b82132c31545aab274c7cf3f77c277" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:18.930433  2194 raft_consensus.cc:2393] T b3b82132c31545aab274c7cf3f77c277 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in current term 2: Already voted for candidate 0ec6a5d1452a41bd992a8c7922473b35 in this term.
I20260709 13:12:18.899171  2942 raft_consensus.cc:2804] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Leader election won for term 3
W20260709 13:12:18.932858  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:36557, user_credentials={real_user=slave}} blocked reactor thread for 48918.8us
I20260709 13:12:18.918510  2190 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ad60fa3bce47daac74b01143b54132" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:18.968925  2392 tablet_bootstrap.cc:492] T 46887c40373b4aca811c6382c97cb9bf P 66e9a8fffd4b4e5a81ca4fa2762773ea: No bootstrap required, opened a new log
I20260709 13:12:18.969480  2392 ts_tablet_manager.cc:1403] T 46887c40373b4aca811c6382c97cb9bf P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent bootstrapping tablet: real 0.238s	user 0.014s	sys 0.000s
I20260709 13:12:18.926554  2263 raft_consensus.cc:1275] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Refusing update from remote peer 2ac5c5682f914ed9b9982b5a080d5472: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:18.897505  2744 raft_consensus.cc:515] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:18.934139  2921 raft_consensus.cc:2749] T 10de08c2346d47dbbd720596cd7e02fd P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:18.935343  2339 raft_consensus.cc:2468] T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 2.
I20260709 13:12:18.973438  2402 tablet_bootstrap.cc:492] T bad0fdea1e3a409aab372c59eaa33767 P 79b6e57d59e4468ebe4423d871a31b39: No bootstrap required, opened a new log
I20260709 13:12:18.978682  2402 ts_tablet_manager.cc:1403] T bad0fdea1e3a409aab372c59eaa33767 P 79b6e57d59e4468ebe4423d871a31b39: Time spent bootstrapping tablet: real 0.578s	user 0.010s	sys 0.011s
I20260709 13:12:18.970738  2337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d627aa01fd4aefbbae482eb2fb2453" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
W20260709 13:12:19.001042  2087 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 13:12:19.004215  2265 raft_consensus.cc:2468] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 3.
I20260709 13:12:18.987504  2190 raft_consensus.cc:2468] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 0.
I20260709 13:12:19.005111  2197 raft_consensus.cc:2468] T 8b65903ab966485c9c65bdfbdf1e1054 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 3.
I20260709 13:12:19.026018  2311 leader_election.cc:304] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:19.027921  2269 raft_consensus.cc:2468] T 8b65903ab966485c9c65bdfbdf1e1054 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 3.
I20260709 13:12:19.045500  2393 tablet_bootstrap.cc:492] T bad0fdea1e3a409aab372c59eaa33767 P 0ec6a5d1452a41bd992a8c7922473b35: No bootstrap required, opened a new log
I20260709 13:12:19.046051  2393 ts_tablet_manager.cc:1403] T bad0fdea1e3a409aab372c59eaa33767 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent bootstrapping tablet: real 0.404s	user 0.010s	sys 0.017s
I20260709 13:12:19.049520  2197 raft_consensus.cc:1275] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Refusing update from remote peer 2ac5c5682f914ed9b9982b5a080d5472: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:12:19.052346  2937 log.cc:927] Time spent T 10de08c2346d47dbbd720596cd7e02fd P 66e9a8fffd4b4e5a81ca4fa2762773ea: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 13:12:19.055753  2122 raft_consensus.cc:2468] T b3b82132c31545aab274c7cf3f77c277 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 2.
I20260709 13:12:19.032745  2942 raft_consensus.cc:697] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 LEADER]: Becoming Leader. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Running, Role: LEADER
I20260709 13:12:19.057850  2942 consensus_queue.cc:237] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:19.058939  2744 leader_election.cc:290] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:19.059224  2018 catalog_manager.cc:5697] T 38d5e9a8f42c4a2993d25a8a341fddbf P 79b6e57d59e4468ebe4423d871a31b39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67). New cstate: current_term: 1 leader_uuid: "79b6e57d59e4468ebe4423d871a31b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:19.061172  2162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:38869, user_credentials={real_user=slave}} blocked reactor thread for 169106us
I20260709 13:12:19.062480  2162 leader_election.cc:304] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:19.062410  2018 catalog_manager.cc:5697] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "79b6e57d59e4468ebe4423d871a31b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:19.067993  2162 consensus_peers.cc:597] T 622b6cfd76ff495ea6692a1ec0faefc4 P 0ec6a5d1452a41bd992a8c7922473b35 -> Peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Couldn't send request to peer 79b6e57d59e4468ebe4423d871a31b39. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:19.069881  2018 catalog_manager.cc:5697] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "79b6e57d59e4468ebe4423d871a31b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:19.070966  2310 leader_election.cc:304] T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 0ec6a5d1452a41bd992a8c7922473b35
I20260709 13:12:19.072183  2402 raft_consensus.cc:359] T bad0fdea1e3a409aab372c59eaa33767 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:19.069119  2393 raft_consensus.cc:359] T bad0fdea1e3a409aab372c59eaa33767 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:19.073303  2393 raft_consensus.cc:385] T bad0fdea1e3a409aab372c59eaa33767 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:19.073884  2402 raft_consensus.cc:385] T bad0fdea1e3a409aab372c59eaa33767 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:19.074172  2402 raft_consensus.cc:740] T bad0fdea1e3a409aab372c59eaa33767 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Initialized, Role: FOLLOWER
I20260709 13:12:19.071449  2018 catalog_manager.cc:5697] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "79b6e57d59e4468ebe4423d871a31b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:19.076068  2018 catalog_manager.cc:5697] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "79b6e57d59e4468ebe4423d871a31b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:19.072597  2162 leader_election.cc:304] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:19.078481  2391 raft_consensus.cc:359] T d1ddcfd4d0914e40ae0a684fd8726d24 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
W20260709 13:12:19.078890  2162 consensus_peers.cc:597] T d2f88787abb54ffea037f35cf48b22c4 P 0ec6a5d1452a41bd992a8c7922473b35 -> Peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Couldn't send request to peer 79b6e57d59e4468ebe4423d871a31b39. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:19.079818  2162 leader_election.cc:304] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:19.079135  2391 raft_consensus.cc:385] T d1ddcfd4d0914e40ae0a684fd8726d24 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:19.080418  2391 raft_consensus.cc:740] T d1ddcfd4d0914e40ae0a684fd8726d24 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:19.073593  2393 raft_consensus.cc:740] T bad0fdea1e3a409aab372c59eaa33767 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Initialized, Role: FOLLOWER
I20260709 13:12:19.079193  2018 catalog_manager.cc:5697] T 86834d94d1d64596abfa609754b5d58a P 79b6e57d59e4468ebe4423d871a31b39 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "79b6e57d59e4468ebe4423d871a31b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:19.081040  2393 consensus_queue.cc:260] T bad0fdea1e3a409aab372c59eaa33767 P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:19.081714  2018 catalog_manager.cc:5697] T d0d102459578474fbe77af94f3986a84 P 79b6e57d59e4468ebe4423d871a31b39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "2ac5c5682f914ed9b9982b5a080d5472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } }
I20260709 13:12:19.078245  2402 consensus_queue.cc:260] T bad0fdea1e3a409aab372c59eaa33767 P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:19.091229  2392 raft_consensus.cc:359] T 46887c40373b4aca811c6382c97cb9bf P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:19.092096  2392 raft_consensus.cc:385] T 46887c40373b4aca811c6382c97cb9bf P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:19.092396  2392 raft_consensus.cc:740] T 46887c40373b4aca811c6382c97cb9bf P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Initialized, Role: FOLLOWER
I20260709 13:12:19.068536  2744 raft_consensus.cc:2749] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 13:12:19.094689  2391 consensus_queue.cc:260] T d1ddcfd4d0914e40ae0a684fd8726d24 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:19.096187  2392 consensus_queue.cc:260] T 46887c40373b4aca811c6382c97cb9bf P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:19.083381  2941 raft_consensus.cc:2804] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:19.098100  2402 ts_tablet_manager.cc:1434] T bad0fdea1e3a409aab372c59eaa33767 P 79b6e57d59e4468ebe4423d871a31b39: Time spent starting tablet: real 0.119s	user 0.006s	sys 0.001s
I20260709 13:12:19.084710  2845 raft_consensus.cc:2804] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:12:19.100625  2311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:38859, user_credentials={real_user=slave}} blocked reactor thread for 74708.7us
I20260709 13:12:19.110769  2391 ts_tablet_manager.cc:1434] T d1ddcfd4d0914e40ae0a684fd8726d24 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.198s	user 0.006s	sys 0.001s
I20260709 13:12:19.116775  2393 ts_tablet_manager.cc:1434] T bad0fdea1e3a409aab372c59eaa33767 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent starting tablet: real 0.070s	user 0.009s	sys 0.003s
I20260709 13:12:19.117094  2925 raft_consensus.cc:493] T 38d5e9a8f42c4a2993d25a8a341fddbf P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.117796  2393 tablet_bootstrap.cc:492] T d4e943e5bbd7402da6bcc00db70cec14 P 0ec6a5d1452a41bd992a8c7922473b35: Bootstrap starting.
I20260709 13:12:19.117574  2925 raft_consensus.cc:515] T 38d5e9a8f42c4a2993d25a8a341fddbf P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
W20260709 13:12:19.119580  2961 log.cc:927] Time spent T 7475d672f7b3489393d6202c8b31e47f P 2ac5c5682f914ed9b9982b5a080d5472: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 13:12:19.101591  2845 raft_consensus.cc:493] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:19.122170  2845 raft_consensus.cc:3060] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:19.123517  2402 tablet_bootstrap.cc:492] T 583390912c6d4daca2df9b5534fb8dca P 79b6e57d59e4468ebe4423d871a31b39: Bootstrap starting.
I20260709 13:12:19.102456  2956 raft_consensus.cc:2804] T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:19.134954  2392 ts_tablet_manager.cc:1434] T 46887c40373b4aca811c6382c97cb9bf P 66e9a8fffd4b4e5a81ca4fa2762773ea: Time spent starting tablet: real 0.165s	user 0.004s	sys 0.011s
W20260709 13:12:19.138803  2162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.67:34303, user_credentials={real_user=slave}} blocked reactor thread for 59049.6us
I20260709 13:12:19.140290  2192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f0f1b0143c4363a9b900eae4ac3ea9" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:19.115787  2951 raft_consensus.cc:2804] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:19.104626  2742 raft_consensus.cc:515] T 1588358a9e7542dfbd8b5d2f65212aec P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:19.122121  2925 leader_election.cc:290] T 38d5e9a8f42c4a2993d25a8a341fddbf P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:19.147069  2162 leader_election.cc:400] T 93d627aa01fd4aefbbae482eb2fb2453 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557) with higher term. Message: Invalid argument: T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec6a5d1452a41bd992a8c7922473b35 for earlier term 2. Current term is 3.
I20260709 13:12:19.148262  2162 leader_election.cc:403] T 93d627aa01fd4aefbbae482eb2fb2453 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:19.151398  2921 raft_consensus.cc:2749] T 93d627aa01fd4aefbbae482eb2fb2453 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557) with higher term. Message: Invalid argument: T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec6a5d1452a41bd992a8c7922473b35 for earlier term 2. Current term is 3.
I20260709 13:12:19.153827  2118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ad60fa3bce47daac74b01143b54132" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:19.154492  2118 raft_consensus.cc:2468] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 0.
I20260709 13:12:19.148360  2647 consensus_queue.cc:1048] T 622b6cfd76ff495ea6692a1ec0faefc4 P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 13:12:19.162547  2742 leader_election.cc:290] T 1588358a9e7542dfbd8b5d2f65212aec P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 election: Requested vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:19.145399  2956 raft_consensus.cc:697] T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 LEADER]: Becoming Leader. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Running, Role: LEADER
I20260709 13:12:19.163643  2116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b82132c31545aab274c7cf3f77c277" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:19.164299  2116 raft_consensus.cc:2468] T b3b82132c31545aab274c7cf3f77c277 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 2.
I20260709 13:12:19.164124  2956 consensus_queue.cc:237] T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:19.164918  2402 tablet_bootstrap.cc:654] T 583390912c6d4daca2df9b5534fb8dca P 79b6e57d59e4468ebe4423d871a31b39: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:19.151935  2951 raft_consensus.cc:697] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 LEADER]: Becoming Leader. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Running, Role: LEADER
I20260709 13:12:19.166836  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ad60fa3bce47daac74b01143b54132" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:19.166638  2951 consensus_queue.cc:237] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
W20260709 13:12:19.177909  2310 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:34303, user_credentials={real_user=slave}} blocked reactor thread for 72600.9us
I20260709 13:12:19.183193  2121 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1588358a9e7542dfbd8b5d2f65212aec" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:19.183884  2121 raft_consensus.cc:3060] T 1588358a9e7542dfbd8b5d2f65212aec P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:19.184474  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d5e9a8f42c4a2993d25a8a341fddbf" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:19.192335  2121 raft_consensus.cc:2468] T 1588358a9e7542dfbd8b5d2f65212aec P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 1.
I20260709 13:12:19.199455  2338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f3f0f1b0143c4363a9b900eae4ac3ea9" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:19.200091  2338 raft_consensus.cc:3060] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:19.201203  2189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d5e9a8f42c4a2993d25a8a341fddbf" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:19.194638  2795 raft_consensus.cc:493] T d1ddcfd4d0914e40ae0a684fd8726d24 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.203284  2795 raft_consensus.cc:515] T d1ddcfd4d0914e40ae0a684fd8726d24 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:19.205260  2795 leader_election.cc:290] T d1ddcfd4d0914e40ae0a684fd8726d24 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:19.184032  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1588358a9e7542dfbd8b5d2f65212aec" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:19.206139  2268 raft_consensus.cc:3060] T 1588358a9e7542dfbd8b5d2f65212aec P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:19.209529  2236 leader_election.cc:304] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:19.219617  2795 raft_consensus.cc:2764] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Leader election decision vote started in defunct term 2: won
I20260709 13:12:19.178757  2941 raft_consensus.cc:697] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 LEADER]: Becoming Leader. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Running, Role: LEADER
I20260709 13:12:19.226970  2236 leader_election.cc:400] T 8b65903ab966485c9c65bdfbdf1e1054 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869) with higher term. Message: Invalid argument: T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79b6e57d59e4468ebe4423d871a31b39 for earlier term 2. Current term is 3.
I20260709 13:12:19.227285  2236 leader_election.cc:403] T 8b65903ab966485c9c65bdfbdf1e1054 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 13:12:19.233346  2162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:38869, user_credentials={real_user=slave}} blocked reactor thread for 64962.3us
I20260709 13:12:19.234077  2162 leader_election.cc:304] T b3b82132c31545aab274c7cf3f77c277 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:19.234793  2817 raft_consensus.cc:3060] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:19.236624  2310 leader_election.cc:304] T 1588358a9e7542dfbd8b5d2f65212aec P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:19.239890  2121 raft_consensus.cc:1275] T a0394490f6984f028daa10be921e242b P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Refusing update from remote peer 79b6e57d59e4468ebe4423d871a31b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:19.235181  2795 consensus_queue.cc:1048] T 86834d94d1d64596abfa609754b5d58a P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 13:12:19.241392  2393 tablet_bootstrap.cc:654] T d4e943e5bbd7402da6bcc00db70cec14 P 0ec6a5d1452a41bd992a8c7922473b35: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:19.243152  2979 raft_consensus.cc:493] T 46887c40373b4aca811c6382c97cb9bf P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.224737  2189 raft_consensus.cc:2468] T 38d5e9a8f42c4a2993d25a8a341fddbf P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 1.
I20260709 13:12:19.254343  2519 raft_consensus.cc:493] T bad0fdea1e3a409aab372c59eaa33767 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.233439  2811 raft_consensus.cc:2749] T 8b65903ab966485c9c65bdfbdf1e1054 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869) with higher term. Message: Invalid argument: T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79b6e57d59e4468ebe4423d871a31b39 for earlier term 2. Current term is 3.
I20260709 13:12:19.262531  2519 raft_consensus.cc:515] T bad0fdea1e3a409aab372c59eaa33767 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
W20260709 13:12:19.253648  2162 leader_election.cc:343] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:19.243819  2815 raft_consensus.cc:2804] T b3b82132c31545aab274c7cf3f77c277 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:19.274914  2519 leader_election.cc:290] T bad0fdea1e3a409aab372c59eaa33767 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:19.262351  2931 raft_consensus.cc:493] T d1ddcfd4d0914e40ae0a684fd8726d24 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.271659  2815 raft_consensus.cc:493] T b3b82132c31545aab274c7cf3f77c277 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:19.274652  2122 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ddcfd4d0914e40ae0a684fd8726d24" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:19.262933  2979 raft_consensus.cc:515] T 46887c40373b4aca811c6382c97cb9bf P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:19.292279  2815 raft_consensus.cc:3060] T b3b82132c31545aab274c7cf3f77c277 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:12:19.337841  2983 log.cc:927] Time spent T bdee3fd7553a47afae3ec9dbdce6d829 P 0ec6a5d1452a41bd992a8c7922473b35: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 13:12:19.281277  2931 raft_consensus.cc:515] T d1ddcfd4d0914e40ae0a684fd8726d24 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:19.275925  2962 raft_consensus.cc:2804] T 1588358a9e7542dfbd8b5d2f65212aec P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:19.355001  2931 leader_election.cc:290] T d1ddcfd4d0914e40ae0a684fd8726d24 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:19.356873  2979 leader_election.cc:290] T 46887c40373b4aca811c6382c97cb9bf P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
W20260709 13:12:19.357798  2927 log.cc:927] Time spent T 427b10072083419c89d5a4bf5d6413fc P 2ac5c5682f914ed9b9982b5a080d5472: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 13:12:19.342391  2963 raft_consensus.cc:493] T bad0fdea1e3a409aab372c59eaa33767 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.358738  2963 raft_consensus.cc:515] T bad0fdea1e3a409aab372c59eaa33767 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:19.360752  2963 leader_election.cc:290] T bad0fdea1e3a409aab372c59eaa33767 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:19.361166  2338 raft_consensus.cc:2468] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 3.
I20260709 13:12:19.278129  2941 consensus_queue.cc:237] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:19.373595  2962 raft_consensus.cc:697] T 1588358a9e7542dfbd8b5d2f65212aec P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 LEADER]: Becoming Leader. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Running, Role: LEADER
I20260709 13:12:19.378163  2962 consensus_queue.cc:237] T 1588358a9e7542dfbd8b5d2f65212aec P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:19.369355  2122 raft_consensus.cc:2468] T d1ddcfd4d0914e40ae0a684fd8726d24 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 0.
I20260709 13:12:19.383018  2119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46887c40373b4aca811c6382c97cb9bf" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:19.385912  2270 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bad0fdea1e3a409aab372c59eaa33767" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:19.386427  2270 raft_consensus.cc:2468] T bad0fdea1e3a409aab372c59eaa33767 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 0.
I20260709 13:12:19.387055  2402 tablet_bootstrap.cc:492] T 583390912c6d4daca2df9b5534fb8dca P 79b6e57d59e4468ebe4423d871a31b39: No bootstrap required, opened a new log
I20260709 13:12:19.382112  2815 raft_consensus.cc:515] T b3b82132c31545aab274c7cf3f77c277 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:19.387509  2402 ts_tablet_manager.cc:1403] T 583390912c6d4daca2df9b5534fb8dca P 79b6e57d59e4468ebe4423d871a31b39: Time spent bootstrapping tablet: real 0.273s	user 0.007s	sys 0.009s
W20260709 13:12:19.390378  2310 leader_election.cc:343] T 46887c40373b4aca811c6382c97cb9bf P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:19.391105  2310 leader_election.cc:304] T bad0fdea1e3a409aab372c59eaa33767 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:19.407251  2972 raft_consensus.cc:2804] T bad0fdea1e3a409aab372c59eaa33767 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:19.407666  2972 raft_consensus.cc:493] T bad0fdea1e3a409aab372c59eaa33767 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:19.407977  2972 raft_consensus.cc:3060] T bad0fdea1e3a409aab372c59eaa33767 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:19.410544  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ddcfd4d0914e40ae0a684fd8726d24" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:19.411302  2271 raft_consensus.cc:2468] T d1ddcfd4d0914e40ae0a684fd8726d24 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 0.
I20260709 13:12:19.361438  2845 raft_consensus.cc:515] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:19.423188  2845 leader_election.cc:290] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 3 election: Requested vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:19.428926  2972 raft_consensus.cc:515] T bad0fdea1e3a409aab372c59eaa33767 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:19.433506  2402 raft_consensus.cc:359] T 583390912c6d4daca2df9b5534fb8dca P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:19.435894  2402 raft_consensus.cc:385] T 583390912c6d4daca2df9b5534fb8dca P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:19.436190  2402 raft_consensus.cc:740] T 583390912c6d4daca2df9b5534fb8dca P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Initialized, Role: FOLLOWER
I20260709 13:12:19.441483  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4edf26b74c5d4e5d9a33d2b1fc1bb0ae" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:19.442090  2263 raft_consensus.cc:3060] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:19.445506  2402 consensus_queue.cc:260] T 583390912c6d4daca2df9b5534fb8dca P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:19.454021  2114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4edf26b74c5d4e5d9a33d2b1fc1bb0ae" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:19.455852  2268 raft_consensus.cc:2468] T 1588358a9e7542dfbd8b5d2f65212aec P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 1.
I20260709 13:12:19.432651  2815 leader_election.cc:290] T b3b82132c31545aab274c7cf3f77c277 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 3 election: Requested vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:19.472039  2263 raft_consensus.cc:2468] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 3.
I20260709 13:12:19.473407  2162 leader_election.cc:304] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:19.474232  2920 raft_consensus.cc:2804] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:19.474695  2920 raft_consensus.cc:697] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 LEADER]: Becoming Leader. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Running, Role: LEADER
I20260709 13:12:19.475003  2972 leader_election.cc:290] T bad0fdea1e3a409aab372c59eaa33767 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 election: Requested vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:19.475524  2920 consensus_queue.cc:237] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:19.473591  2402 ts_tablet_manager.cc:1434] T 583390912c6d4daca2df9b5534fb8dca P 79b6e57d59e4468ebe4423d871a31b39: Time spent starting tablet: real 0.086s	user 0.008s	sys 0.000s
I20260709 13:12:19.479439  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bad0fdea1e3a409aab372c59eaa33767" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:19.479660  2402 tablet_bootstrap.cc:492] T 622b6cfd76ff495ea6692a1ec0faefc4 P 79b6e57d59e4468ebe4423d871a31b39: Bootstrap starting.
I20260709 13:12:19.453926  2119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b82132c31545aab274c7cf3f77c277" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:19.482475  2119 raft_consensus.cc:3060] T b3b82132c31545aab274c7cf3f77c277 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:19.490108  2402 tablet_bootstrap.cc:654] T 622b6cfd76ff495ea6692a1ec0faefc4 P 79b6e57d59e4468ebe4423d871a31b39: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:19.480072  2263 raft_consensus.cc:3060] T bad0fdea1e3a409aab372c59eaa33767 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:19.502436  2393 tablet_bootstrap.cc:492] T d4e943e5bbd7402da6bcc00db70cec14 P 0ec6a5d1452a41bd992a8c7922473b35: No bootstrap required, opened a new log
I20260709 13:12:19.505167  2197 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ddcfd4d0914e40ae0a684fd8726d24" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:19.505625  2087 leader_election.cc:304] T d1ddcfd4d0914e40ae0a684fd8726d24 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:19.506454  2196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bad0fdea1e3a409aab372c59eaa33767" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:19.507058  2196 raft_consensus.cc:2468] T bad0fdea1e3a409aab372c59eaa33767 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 0.
I20260709 13:12:19.507097  2817 consensus_queue.cc:1048] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:19.507519  2393 ts_tablet_manager.cc:1403] T d4e943e5bbd7402da6bcc00db70cec14 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent bootstrapping tablet: real 0.390s	user 0.015s	sys 0.005s
I20260709 13:12:19.509014  2926 raft_consensus.cc:2804] T d1ddcfd4d0914e40ae0a684fd8726d24 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:19.509418  2926 raft_consensus.cc:493] T d1ddcfd4d0914e40ae0a684fd8726d24 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:19.510311  2393 raft_consensus.cc:359] T d4e943e5bbd7402da6bcc00db70cec14 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:19.511431  2393 raft_consensus.cc:385] T d4e943e5bbd7402da6bcc00db70cec14 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:19.511919  2393 raft_consensus.cc:740] T d4e943e5bbd7402da6bcc00db70cec14 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Initialized, Role: FOLLOWER
I20260709 13:12:19.512759  2393 consensus_queue.cc:260] T d4e943e5bbd7402da6bcc00db70cec14 P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:19.514660  2393 ts_tablet_manager.cc:1434] T d4e943e5bbd7402da6bcc00db70cec14 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:12:19.515693  2393 tablet_bootstrap.cc:492] T d1ddcfd4d0914e40ae0a684fd8726d24 P 0ec6a5d1452a41bd992a8c7922473b35: Bootstrap starting.
I20260709 13:12:19.519692  2088 leader_election.cc:304] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472; no voters: 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:19.521884  2393 tablet_bootstrap.cc:654] T d1ddcfd4d0914e40ae0a684fd8726d24 P 0ec6a5d1452a41bd992a8c7922473b35: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:19.525930  2873 raft_consensus.cc:2804] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:19.526321  2873 raft_consensus.cc:493] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:19.526623  2873 raft_consensus.cc:3060] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:19.529412  2237 leader_election.cc:343] T d1ddcfd4d0914e40ae0a684fd8726d24 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:19.535175  2237 leader_election.cc:304] T bad0fdea1e3a409aab372c59eaa33767 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:19.509711  2926 raft_consensus.cc:3060] T d1ddcfd4d0914e40ae0a684fd8726d24 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:19.537822  2818 raft_consensus.cc:493] T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.553829  2337 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bad0fdea1e3a409aab372c59eaa33767" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:19.569260  2198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ddcfd4d0914e40ae0a684fd8726d24" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:19.570946  2918 consensus_queue.cc:1048] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260709 13:12:19.575512  2402 tablet_bootstrap.cc:492] T 622b6cfd76ff495ea6692a1ec0faefc4 P 79b6e57d59e4468ebe4423d871a31b39: No bootstrap required, opened a new log
I20260709 13:12:19.576056  2402 ts_tablet_manager.cc:1403] T 622b6cfd76ff495ea6692a1ec0faefc4 P 79b6e57d59e4468ebe4423d871a31b39: Time spent bootstrapping tablet: real 0.097s	user 0.015s	sys 0.009s
I20260709 13:12:19.579516  2337 raft_consensus.cc:2393] T bad0fdea1e3a409aab372c59eaa33767 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79b6e57d59e4468ebe4423d871a31b39 in current term 1: Already voted for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in this term.
I20260709 13:12:19.559799  2818 raft_consensus.cc:515] T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:19.588145  2818 leader_election.cc:290] T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:19.589548  2263 raft_consensus.cc:2468] T bad0fdea1e3a409aab372c59eaa33767 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 1.
I20260709 13:12:19.590505  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86834d94d1d64596abfa609754b5d58a" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:19.591428  2873 raft_consensus.cc:515] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:19.598752  2196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46887c40373b4aca811c6382c97cb9bf" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:19.601449  2194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bad0fdea1e3a409aab372c59eaa33767" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:19.605002  2194 raft_consensus.cc:3060] T bad0fdea1e3a409aab372c59eaa33767 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:19.605827  2119 raft_consensus.cc:2468] T b3b82132c31545aab274c7cf3f77c277 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 3.
I20260709 13:12:19.602592  2193 raft_consensus.cc:1275] T 93d627aa01fd4aefbbae482eb2fb2453 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Refusing update from remote peer 66e9a8fffd4b4e5a81ca4fa2762773ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:19.610234  2932 raft_consensus.cc:2764] T bad0fdea1e3a409aab372c59eaa33767 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 13:12:19.612210  2873 leader_election.cc:290] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 election: Requested vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:19.613204  2194 raft_consensus.cc:2468] T bad0fdea1e3a409aab372c59eaa33767 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 1.
W20260709 13:12:19.613955  2975 log.cc:927] Time spent T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Append to log took a long time: real 0.276s	user 0.000s	sys 0.003s
I20260709 13:12:19.615062  2926 raft_consensus.cc:515] T d1ddcfd4d0914e40ae0a684fd8726d24 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:19.615655  2508 raft_consensus.cc:493] T 2993800f8e7e4c09bfe0b2be13e4394c P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0ec6a5d1452a41bd992a8c7922473b35)
I20260709 13:12:19.616214  2508 raft_consensus.cc:515] T 2993800f8e7e4c09bfe0b2be13e4394c P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:19.617292  2310 leader_election.cc:304] T bad0fdea1e3a409aab372c59eaa33767 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:19.618119  2508 leader_election.cc:290] T 2993800f8e7e4c09bfe0b2be13e4394c P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:19.618719  2508 raft_consensus.cc:2804] T bad0fdea1e3a409aab372c59eaa33767 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:19.619189  2508 raft_consensus.cc:697] T bad0fdea1e3a409aab372c59eaa33767 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 LEADER]: Becoming Leader. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Running, Role: LEADER
I20260709 13:12:19.622031  2391 tablet_bootstrap.cc:492] T d4e943e5bbd7402da6bcc00db70cec14 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:19.622846  2198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bad0fdea1e3a409aab372c59eaa33767" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:19.623422  2198 raft_consensus.cc:2376] T bad0fdea1e3a409aab372c59eaa33767 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 1. Re-sending same reply.
I20260709 13:12:19.601491  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86834d94d1d64596abfa609754b5d58a" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:19.624368  2508 consensus_queue.cc:237] T bad0fdea1e3a409aab372c59eaa33767 P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:19.622061  2162 leader_election.cc:304] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472; no voters: 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:19.628132  2973 raft_consensus.cc:2804] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:19.628495  2973 raft_consensus.cc:493] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:19.628793  2973 raft_consensus.cc:3060] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:19.629607  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2993800f8e7e4c09bfe0b2be13e4394c" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:19.620468  2926 leader_election.cc:290] T d1ddcfd4d0914e40ae0a684fd8726d24 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 election: Requested vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:19.633406  2402 raft_consensus.cc:359] T 622b6cfd76ff495ea6692a1ec0faefc4 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:19.649098  2402 raft_consensus.cc:385] T 622b6cfd76ff495ea6692a1ec0faefc4 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:19.641359  2087 leader_election.cc:304] T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472; no voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:19.642015  2162 leader_election.cc:304] T b3b82132c31545aab274c7cf3f77c277 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472; no voters: 
I20260709 13:12:19.649412  2402 raft_consensus.cc:740] T 622b6cfd76ff495ea6692a1ec0faefc4 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Initialized, Role: FOLLOWER
I20260709 13:12:19.643146  2391 tablet_bootstrap.cc:654] T d4e943e5bbd7402da6bcc00db70cec14 P 2ac5c5682f914ed9b9982b5a080d5472: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:19.646365  2193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ddcfd4d0914e40ae0a684fd8726d24" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:19.650233  2402 consensus_queue.cc:260] T 622b6cfd76ff495ea6692a1ec0faefc4 P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:19.649348  2198 raft_consensus.cc:1240] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 LEADER]: Rejecting Update request from peer 2ac5c5682f914ed9b9982b5a080d5472 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:12:19.610275  2311 leader_election.cc:304] T 38d5e9a8f42c4a2993d25a8a341fddbf P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 79b6e57d59e4468ebe4423d871a31b39
W20260709 13:12:19.656306  2311 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:38859, user_credentials={real_user=slave}} blocked reactor thread for 46110.1us
W20260709 13:12:19.648448  2088 leader_election.cc:343] T d1ddcfd4d0914e40ae0a684fd8726d24 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:19.653338  2236 leader_election.cc:304] T d1ddcfd4d0914e40ae0a684fd8726d24 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39; no voters: 0ec6a5d1452a41bd992a8c7922473b35
I20260709 13:12:19.656085  2018 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50244 (request call id 76) took 1300 ms. Trace:
I20260709 13:12:19.652547  2815 raft_consensus.cc:2804] T b3b82132c31545aab274c7cf3f77c277 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:19.666980  2815 raft_consensus.cc:697] T b3b82132c31545aab274c7cf3f77c277 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 LEADER]: Becoming Leader. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Running, Role: LEADER
I20260709 13:12:19.667667  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ddcfd4d0914e40ae0a684fd8726d24" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:19.667819  2815 consensus_queue.cc:237] T b3b82132c31545aab274c7cf3f77c277 P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:19.668879  2194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ad60fa3bce47daac74b01143b54132" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:19.669669  2913 raft_consensus.cc:2804] T d1ddcfd4d0914e40ae0a684fd8726d24 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:19.670118  2913 raft_consensus.cc:493] T d1ddcfd4d0914e40ae0a684fd8726d24 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:19.670428  2913 raft_consensus.cc:3060] T d1ddcfd4d0914e40ae0a684fd8726d24 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:19.671325  2393 tablet_bootstrap.cc:492] T d1ddcfd4d0914e40ae0a684fd8726d24 P 0ec6a5d1452a41bd992a8c7922473b35: No bootstrap required, opened a new log
I20260709 13:12:19.671777  2393 ts_tablet_manager.cc:1403] T d1ddcfd4d0914e40ae0a684fd8726d24 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent bootstrapping tablet: real 0.156s	user 0.016s	sys 0.008s
I20260709 13:12:19.668812  2268 raft_consensus.cc:1240] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Rejecting Update request from peer 2ac5c5682f914ed9b9982b5a080d5472 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 13:12:19.662892  2019 catalog_manager.cc:5697] T 10de08c2346d47dbbd720596cd7e02fd P 66e9a8fffd4b4e5a81ca4fa2762773ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "2ac5c5682f914ed9b9982b5a080d5472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } }
W20260709 13:12:19.680660  2311 leader_election.cc:343] T 46887c40373b4aca811c6382c97cb9bf P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:19.682021  2019 catalog_manager.cc:5697] T 421302a9721e4cc9a86e52a183469a70 P 66e9a8fffd4b4e5a81ca4fa2762773ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68). New cstate: current_term: 1 leader_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:19.682557  2311 leader_election.cc:304] T 46887c40373b4aca811c6382c97cb9bf P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:19.665500  2018 rpcz_store.cc:276] 0709 13:12:18.355720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 13:12:18.356309 (+   589us) service_pool.cc:224] Handling call
0709 13:12:19.656013 (+1299704us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 13:12:19.103305 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 13:12:19.103798 (+   493us) write_op.cc:432] Acquiring schema lock in shared mode
0709 13:12:19.103830 (+    32us) write_op.cc:435] Acquired schema lock
0709 13:12:19.103843 (+    13us) tablet.cc:662] Decoding operations
0709 13:12:19.153925 (+ 50082us) write_op.cc:620] Acquiring the partition lock for write op
0709 13:12:19.154004 (+    79us) write_op.cc:641] Partition lock acquired for write op
0709 13:12:19.154036 (+    32us) tablet.cc:685] Acquiring locks for 7 operations
0709 13:12:19.154575 (+   539us) tablet.cc:701] Row locks acquired
0709 13:12:19.154592 (+    17us) write_op.cc:260] PREPARE: finished
0709 13:12:19.154731 (+   139us) write_op.cc:270] Start()
0709 13:12:19.154827 (+    96us) write_op.cc:276] Timestamp: P: 1783602739154693 usec, L: 0
0709 13:12:19.154847 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 13:12:19.155477 (+   630us) log.cc:844] Serialized 2848 byte log entry
0709 13:12:19.264158 (+108681us) op_driver.cc:464] REPLICATION: finished
0709 13:12:19.440074 (+175916us) write_op.cc:301] APPLY: starting
0709 13:12:19.440149 (+    75us) tablet.cc:1367] starting BulkCheckPresence
0709 13:12:19.440343 (+   194us) tablet.cc:1370] finished BulkCheckPresence
0709 13:12:19.440457 (+   114us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 13:12:19.441188 (+   731us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 13:12:19.441366 (+   178us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 13:12:19.441404 (+    38us) write_op.cc:312] APPLY: finished
0709 13:12:19.441619 (+   215us) log.cc:844] Serialized 58 byte log entry
0709 13:12:19.441803 (+   184us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:19.441916 (+   113us) write_op.cc:454] Released schema lock
0709 13:12:19.441954 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 13:12:19.442248 (+   294us) write_op.cc:489] Releasing partition, row and schema locks
0709 13:12:19.442273 (+    25us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":77994,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":171570,"apply.run_cpu_time_us":2182,"apply.run_wall_time_us":2182,"num_ops":7,"prepare.queue_time_us":3334,"prepare.run_cpu_time_us":3733,"prepare.run_wall_time_us":52444,"replication_time_us":89937,"thread_start_us":93176,"threads_started":2}]]}
I20260709 13:12:19.683682  2019 catalog_manager.cc:5697] T bdee3fd7553a47afae3ec9dbdce6d829 P 66e9a8fffd4b4e5a81ca4fa2762773ea reported cstate change: term changed from 1 to 3, leader changed from 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67) to 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68). New cstate: current_term: 3 leader_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:19.690328  2393 raft_consensus.cc:359] T d1ddcfd4d0914e40ae0a684fd8726d24 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:19.691005  2393 raft_consensus.cc:385] T d1ddcfd4d0914e40ae0a684fd8726d24 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:19.691249  2393 raft_consensus.cc:740] T d1ddcfd4d0914e40ae0a684fd8726d24 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Initialized, Role: FOLLOWER
I20260709 13:12:19.689730  2019 catalog_manager.cc:5697] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:19.702740  2402 ts_tablet_manager.cc:1434] T 622b6cfd76ff495ea6692a1ec0faefc4 P 79b6e57d59e4468ebe4423d871a31b39: Time spent starting tablet: real 0.126s	user 0.010s	sys 0.001s
I20260709 13:12:19.694664  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ad60fa3bce47daac74b01143b54132" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:19.708750  2393 consensus_queue.cc:260] T d1ddcfd4d0914e40ae0a684fd8726d24 P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
W20260709 13:12:19.706746  2088 leader_election.cc:343] T d1ddcfd4d0914e40ae0a684fd8726d24 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:19.667863  2949 consensus_queue.cc:1048] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260709 13:12:19.696462  2894 raft_consensus.cc:2749] T 46887c40373b4aca811c6382c97cb9bf P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:19.716348  2393 ts_tablet_manager.cc:1434] T d1ddcfd4d0914e40ae0a684fd8726d24 P 0ec6a5d1452a41bd992a8c7922473b35: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.001s
I20260709 13:12:19.717000  2962 raft_consensus.cc:2804] T 38d5e9a8f42c4a2993d25a8a341fddbf P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:19.692111  2873 consensus_queue.cc:1059] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 13:12:19.717525  2943 consensus_queue.cc:1048] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:19.718423  2873 raft_consensus.cc:3055] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:19.718782  2873 raft_consensus.cc:740] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Running, Role: LEADER
I20260709 13:12:19.719576  2873 consensus_queue.cc:260] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:19.720597  2402 tablet_bootstrap.cc:492] T d2f88787abb54ffea037f35cf48b22c4 P 79b6e57d59e4468ebe4423d871a31b39: Bootstrap starting.
I20260709 13:12:19.720808  2873 raft_consensus.cc:3060] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:19.730084  2341 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b3b82132c31545aab274c7cf3f77c277" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
W20260709 13:12:19.730700  2087 leader_election.cc:343] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:19.732806  2117 raft_consensus.cc:1275] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Refusing update from remote peer 66e9a8fffd4b4e5a81ca4fa2762773ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:19.717466  2393 tablet_bootstrap.cc:492] T 46887c40373b4aca811c6382c97cb9bf P 0ec6a5d1452a41bd992a8c7922473b35: Bootstrap starting.
I20260709 13:12:19.739432  2726 consensus_queue.cc:1048] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 13:12:19.750526  2268 raft_consensus.cc:3060] T 622b6cfd76ff495ea6692a1ec0faefc4 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:19.756199  2930 consensus_queue.cc:1175] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0ec6a5d1452a41bd992a8c7922473b35" responder_term: 3 status { last_received { term: 3 index: 2 } last_committed_idx: 1 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 2ac5c5682f914ed9b9982b5a080d5472 for earlier term 2. Current term is 3. Ops: [2.2-2.2]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 13:12:19.738726  2929 raft_consensus.cc:493] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0ec6a5d1452a41bd992a8c7922473b35)
I20260709 13:12:19.758296  2929 raft_consensus.cc:515] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:19.759075  2962 raft_consensus.cc:493] T 38d5e9a8f42c4a2993d25a8a341fddbf P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting leader election (detected failure of leader 79b6e57d59e4468ebe4423d871a31b39)
I20260709 13:12:19.759529  2962 raft_consensus.cc:3060] T 38d5e9a8f42c4a2993d25a8a341fddbf P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:19.760272  2929 leader_election.cc:290] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:19.761787  2192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc33c7c3cfd14ab7a99e39cfd971fc3c" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
W20260709 13:12:19.764431  3005 log.cc:927] Time spent T 622b6cfd76ff495ea6692a1ec0faefc4 P 0ec6a5d1452a41bd992a8c7922473b35: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 13:12:19.720134  2973 raft_consensus.cc:515] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:19.782169  2402 tablet_bootstrap.cc:654] T d2f88787abb54ffea037f35cf48b22c4 P 79b6e57d59e4468ebe4423d871a31b39: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:19.795156  2194 raft_consensus.cc:2393] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ac5c5682f914ed9b9982b5a080d5472 in current term 1: Already voted for candidate 0ec6a5d1452a41bd992a8c7922473b35 in this term.
I20260709 13:12:19.798775  2088 leader_election.cc:304] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:19.815081  2973 leader_election.cc:290] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 election: Requested vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:19.818739  2726 consensus_queue.cc:1048] T 1588358a9e7542dfbd8b5d2f65212aec P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:19.757789  2817 raft_consensus.cc:2749] T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:19.820128  2918 raft_consensus.cc:2749] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:19.824149  2346 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc33c7c3cfd14ab7a99e39cfd971fc3c" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:19.834491  2087 leader_election.cc:304] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea
I20260709 13:12:19.858594  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ad60fa3bce47daac74b01143b54132" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:19.859292  2266 raft_consensus.cc:1275] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Refusing update from remote peer 0ec6a5d1452a41bd992a8c7922473b35: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:19.854156  2930 raft_consensus.cc:2749] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:19.848023  2115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ad60fa3bce47daac74b01143b54132" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:19.869935  2873 raft_consensus.cc:493] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.870440  2873 raft_consensus.cc:515] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:19.872486  2193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2993800f8e7e4c09bfe0b2be13e4394c" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:19.873373  2873 leader_election.cc:290] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:19.873503  2264 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0fb3f7bf85419cbf7ecda4727ccb89" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:19.875033  2193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0fb3f7bf85419cbf7ecda4727ccb89" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
W20260709 13:12:19.864952  2162 leader_election.cc:343] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:19.878688  2069 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:19.875350  2115 raft_consensus.cc:2393] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec6a5d1452a41bd992a8c7922473b35 in current term 1: Already voted for candidate 2ac5c5682f914ed9b9982b5a080d5472 in this term.
I20260709 13:12:19.878698  2193 raft_consensus.cc:2468] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 3.
I20260709 13:12:19.891487  2198 raft_consensus.cc:1240] T b3b82132c31545aab274c7cf3f77c277 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 LEADER]: Rejecting Update request from peer 66e9a8fffd4b4e5a81ca4fa2762773ea for earlier term 2. Current term is 3. Ops: []
I20260709 13:12:19.881527  2920 consensus_queue.cc:1048] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:12:19.899080  2162 leader_election.cc:304] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:19.909874  2391 tablet_bootstrap.cc:492] T d4e943e5bbd7402da6bcc00db70cec14 P 2ac5c5682f914ed9b9982b5a080d5472: No bootstrap required, opened a new log
I20260709 13:12:19.910405  2391 ts_tablet_manager.cc:1403] T d4e943e5bbd7402da6bcc00db70cec14 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.289s	user 0.031s	sys 0.017s
I20260709 13:12:19.909011  2088 leader_election.cc:304] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472; no voters: 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:19.908874  2581 raft_consensus.cc:2749] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:19.919940  2818 raft_consensus.cc:2804] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 13:12:19.933195  2311 leader_election.cc:304] T 2993800f8e7e4c09bfe0b2be13e4394c P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:19.896368  2913 raft_consensus.cc:515] T d1ddcfd4d0914e40ae0a684fd8726d24 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
W20260709 13:12:19.925316  3001 log.cc:927] Time spent T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260709 13:12:19.924156  2805 raft_consensus.cc:493] T 583390912c6d4daca2df9b5534fb8dca P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.935345  2818 raft_consensus.cc:493] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:19.938287  2940 raft_consensus.cc:2749] T 2993800f8e7e4c09bfe0b2be13e4394c P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:19.952755  2345 raft_consensus.cc:1275] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Refusing update from remote peer 0ec6a5d1452a41bd992a8c7922473b35: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:19.957095  2263 raft_consensus.cc:2393] T d1ddcfd4d0914e40ae0a684fd8726d24 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2ac5c5682f914ed9b9982b5a080d5472 in current term 1: Already voted for candidate 79b6e57d59e4468ebe4423d871a31b39 in this term.
I20260709 13:12:19.957513  2949 raft_consensus.cc:493] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:19.959029  2087 leader_election.cc:304] T d1ddcfd4d0914e40ae0a684fd8726d24 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:19.955695  2920 consensus_queue.cc:1048] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 13:12:19.947949  2508 raft_consensus.cc:493] T d4e943e5bbd7402da6bcc00db70cec14 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:19.962278  2508 raft_consensus.cc:515] T d4e943e5bbd7402da6bcc00db70cec14 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:19.960168  2817 raft_consensus.cc:2749] T d1ddcfd4d0914e40ae0a684fd8726d24 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:19.954448  2941 consensus_queue.cc:1059] T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 13:12:19.963380  2941 consensus_queue.cc:1243] T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Peer 0ec6a5d1452a41bd992a8c7922473b35 log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20260709 13:12:19.963764  2855 raft_consensus.cc:3055] T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:19.964107  2855 raft_consensus.cc:740] T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Running, Role: LEADER
I20260709 13:12:19.958053  2949 raft_consensus.cc:515] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:19.964839  2855 consensus_queue.cc:260] T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:19.947113  2805 raft_consensus.cc:515] T 583390912c6d4daca2df9b5534fb8dca P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:19.971426  2855 raft_consensus.cc:3060] T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:19.970335  2949 leader_election.cc:290] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:19.952244  2818 raft_consensus.cc:3060] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:19.972044  2805 leader_election.cc:290] T 583390912c6d4daca2df9b5534fb8dca P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:19.978561  2123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583390912c6d4daca2df9b5534fb8dca" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
W20260709 13:12:19.981058  3010 log.cc:927] Time spent T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:12:19.982203  2115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0fb3f7bf85419cbf7ecda4727ccb89" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:19.982668  2391 raft_consensus.cc:359] T d4e943e5bbd7402da6bcc00db70cec14 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:19.983279  2391 raft_consensus.cc:385] T d4e943e5bbd7402da6bcc00db70cec14 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:19.983479  2391 raft_consensus.cc:740] T d4e943e5bbd7402da6bcc00db70cec14 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
W20260709 13:12:19.984169  2236 leader_election.cc:343] T 583390912c6d4daca2df9b5534fb8dca P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:19.984279  2391 consensus_queue.cc:260] T d4e943e5bbd7402da6bcc00db70cec14 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:19.985514  2508 leader_election.cc:290] T d4e943e5bbd7402da6bcc00db70cec14 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:19.987033  2391 ts_tablet_manager.cc:1434] T d4e943e5bbd7402da6bcc00db70cec14 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.076s	user 0.002s	sys 0.004s
I20260709 13:12:19.987789  2391 tablet_bootstrap.cc:492] T 583390912c6d4daca2df9b5534fb8dca P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:19.987577  2118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e943e5bbd7402da6bcc00db70cec14" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:19.988252  2118 raft_consensus.cc:2468] T d4e943e5bbd7402da6bcc00db70cec14 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 0.
I20260709 13:12:19.991161  2508 consensus_queue.cc:1048] T 1588358a9e7542dfbd8b5d2f65212aec P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:19.990501  2310 leader_election.cc:304] T d4e943e5bbd7402da6bcc00db70cec14 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:19.992580  2941 raft_consensus.cc:2804] T d4e943e5bbd7402da6bcc00db70cec14 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:19.992941  2941 raft_consensus.cc:493] T d4e943e5bbd7402da6bcc00db70cec14 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:19.993264  2941 raft_consensus.cc:3060] T d4e943e5bbd7402da6bcc00db70cec14 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:19.994700  2345 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583390912c6d4daca2df9b5534fb8dca" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:19.995375  2345 raft_consensus.cc:2468] T 583390912c6d4daca2df9b5534fb8dca P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 0.
W20260709 13:12:19.998775  3000 log.cc:927] Time spent T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
I20260709 13:12:20.003054  2236 leader_election.cc:304] T 583390912c6d4daca2df9b5534fb8dca P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39; no voters: 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:20.004086  2980 raft_consensus.cc:493] T d1ddcfd4d0914e40ae0a684fd8726d24 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.004820  2805 raft_consensus.cc:2804] T 583390912c6d4daca2df9b5534fb8dca P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:20.004613  2980 raft_consensus.cc:515] T d1ddcfd4d0914e40ae0a684fd8726d24 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:20.005236  2805 raft_consensus.cc:493] T 583390912c6d4daca2df9b5534fb8dca P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.005659  2805 raft_consensus.cc:3060] T 583390912c6d4daca2df9b5534fb8dca P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:20.011046  2951 raft_consensus.cc:493] T d4e943e5bbd7402da6bcc00db70cec14 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.011548  2951 raft_consensus.cc:515] T d4e943e5bbd7402da6bcc00db70cec14 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:20.012015  2980 leader_election.cc:290] T d1ddcfd4d0914e40ae0a684fd8726d24 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:20.013800  2951 leader_election.cc:290] T d4e943e5bbd7402da6bcc00db70cec14 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:20.018404  2198 raft_consensus.cc:1275] T 8b65903ab966485c9c65bdfbdf1e1054 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Refusing update from remote peer 66e9a8fffd4b4e5a81ca4fa2762773ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:20.019387  2393 tablet_bootstrap.cc:654] T 46887c40373b4aca811c6382c97cb9bf P 0ec6a5d1452a41bd992a8c7922473b35: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.027878  2941 raft_consensus.cc:515] T d4e943e5bbd7402da6bcc00db70cec14 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
W20260709 13:12:20.034389  2162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:36557, user_credentials={real_user=slave}} blocked reactor thread for 53771.5us
W20260709 13:12:20.041464  3013 log.cc:927] Time spent T 38d5e9a8f42c4a2993d25a8a341fddbf P 79b6e57d59e4468ebe4423d871a31b39: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260709 13:12:20.042646  2117 raft_consensus.cc:1275] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Refusing update from remote peer 0ec6a5d1452a41bd992a8c7922473b35: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:12:20.043030  2117 pending_rounds.cc:85] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472: Aborting all ops after (but not including) 1
I20260709 13:12:20.043269  2117 pending_rounds.cc:107] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:12:20.043601  2117 raft_consensus.cc:2889] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:20.052199  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ddcfd4d0914e40ae0a684fd8726d24" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:20.053059  2271 raft_consensus.cc:2393] T d1ddcfd4d0914e40ae0a684fd8726d24 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec6a5d1452a41bd992a8c7922473b35 in current term 1: Already voted for candidate 79b6e57d59e4468ebe4423d871a31b39 in this term.
I20260709 13:12:20.023124  2805 raft_consensus.cc:515] T 583390912c6d4daca2df9b5534fb8dca P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:20.056466  2805 leader_election.cc:290] T 583390912c6d4daca2df9b5534fb8dca P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 election: Requested vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:20.058418  2818 raft_consensus.cc:515] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:20.059214  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e943e5bbd7402da6bcc00db70cec14" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:20.060191  2119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e943e5bbd7402da6bcc00db70cec14" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:20.060916  2119 raft_consensus.cc:2468] T d4e943e5bbd7402da6bcc00db70cec14 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 0.
I20260709 13:12:20.061463  2189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0fb3f7bf85419cbf7ecda4727ccb89" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:20.062251  2189 raft_consensus.cc:2393] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79b6e57d59e4468ebe4423d871a31b39 in current term 3: Already voted for candidate 0ec6a5d1452a41bd992a8c7922473b35 in this term.
I20260709 13:12:20.063630  2391 tablet_bootstrap.cc:654] T 583390912c6d4daca2df9b5534fb8dca P 2ac5c5682f914ed9b9982b5a080d5472: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.063946  2189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0fb3f7bf85419cbf7ecda4727ccb89" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:20.064468  2189 raft_consensus.cc:3060] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:20.065802  2402 tablet_bootstrap.cc:492] T d2f88787abb54ffea037f35cf48b22c4 P 79b6e57d59e4468ebe4423d871a31b39: No bootstrap required, opened a new log
I20260709 13:12:20.066289  2402 ts_tablet_manager.cc:1403] T d2f88787abb54ffea037f35cf48b22c4 P 79b6e57d59e4468ebe4423d871a31b39: Time spent bootstrapping tablet: real 0.359s	user 0.017s	sys 0.009s
I20260709 13:12:20.063971  2117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ddcfd4d0914e40ae0a684fd8726d24" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:20.074913  2162 leader_election.cc:304] T d4e943e5bbd7402da6bcc00db70cec14 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472; no voters: 
I20260709 13:12:20.077587  2115 raft_consensus.cc:2368] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79b6e57d59e4468ebe4423d871a31b39 for earlier term 3. Current term is 4.
I20260709 13:12:20.081045  2342 raft_consensus.cc:2393] T d4e943e5bbd7402da6bcc00db70cec14 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec6a5d1452a41bd992a8c7922473b35 in current term 1: Already voted for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in this term.
I20260709 13:12:20.082609  2117 raft_consensus.cc:2393] T d1ddcfd4d0914e40ae0a684fd8726d24 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0ec6a5d1452a41bd992a8c7922473b35 in current term 1: Already voted for candidate 2ac5c5682f914ed9b9982b5a080d5472 in this term.
I20260709 13:12:20.072547  2508 consensus_queue.cc:1048] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:12:20.077906  2845 consensus_queue.cc:1048] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 13:12:20.088492  2402 raft_consensus.cc:359] T d2f88787abb54ffea037f35cf48b22c4 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:20.097136  2402 raft_consensus.cc:385] T d2f88787abb54ffea037f35cf48b22c4 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.097435  2402 raft_consensus.cc:740] T d2f88787abb54ffea037f35cf48b22c4 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.089854  2338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583390912c6d4daca2df9b5534fb8dca" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:20.098366  2338 raft_consensus.cc:3060] T 583390912c6d4daca2df9b5534fb8dca P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:20.098636  2266 raft_consensus.cc:1275] T 8b65903ab966485c9c65bdfbdf1e1054 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Refusing update from remote peer 66e9a8fffd4b4e5a81ca4fa2762773ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:20.059259  2962 raft_consensus.cc:515] T 38d5e9a8f42c4a2993d25a8a341fddbf P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:20.099686  2339 raft_consensus.cc:1240] T 38d5e9a8f42c4a2993d25a8a341fddbf P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Rejecting Update request from peer 79b6e57d59e4468ebe4423d871a31b39 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:20.101069  2972 consensus_queue.cc:1048] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:20.090890  2264 raft_consensus.cc:1275] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Refusing update from remote peer 0ec6a5d1452a41bd992a8c7922473b35: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:20.102000  2117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e943e5bbd7402da6bcc00db70cec14" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:20.080106  2966 raft_consensus.cc:2804] T d4e943e5bbd7402da6bcc00db70cec14 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:20.102927  2966 raft_consensus.cc:493] T d4e943e5bbd7402da6bcc00db70cec14 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.103282  2966 raft_consensus.cc:3060] T d4e943e5bbd7402da6bcc00db70cec14 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:20.103679  2916 consensus_queue.cc:1059] T 38d5e9a8f42c4a2993d25a8a341fddbf P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:20.104445  2916 raft_consensus.cc:3055] T 38d5e9a8f42c4a2993d25a8a341fddbf P 79b6e57d59e4468ebe4423d871a31b39 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:20.104753  2916 raft_consensus.cc:740] T 38d5e9a8f42c4a2993d25a8a341fddbf P 79b6e57d59e4468ebe4423d871a31b39 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Running, Role: LEADER
I20260709 13:12:20.071138  2192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e943e5bbd7402da6bcc00db70cec14" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:20.089738  2119 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "583390912c6d4daca2df9b5534fb8dca" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:20.102558  2117 raft_consensus.cc:3060] T d4e943e5bbd7402da6bcc00db70cec14 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:20.108137  2118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ddcfd4d0914e40ae0a684fd8726d24" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:20.108913  2118 raft_consensus.cc:2393] T d1ddcfd4d0914e40ae0a684fd8726d24 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 79b6e57d59e4468ebe4423d871a31b39 in current term 1: Already voted for candidate 2ac5c5682f914ed9b9982b5a080d5472 in this term.
I20260709 13:12:20.109856  2962 leader_election.cc:290] T 38d5e9a8f42c4a2993d25a8a341fddbf P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 election: Requested vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
W20260709 13:12:20.111471  2236 leader_election.cc:343] T 583390912c6d4daca2df9b5534fb8dca P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:20.105520  2916 consensus_queue.cc:260] T 38d5e9a8f42c4a2993d25a8a341fddbf P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:20.111881  2402 consensus_queue.cc:260] T d2f88787abb54ffea037f35cf48b22c4 P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:20.114387  2916 raft_consensus.cc:3060] T 38d5e9a8f42c4a2993d25a8a341fddbf P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:20.121445  2196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e943e5bbd7402da6bcc00db70cec14" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:20.123098  2402 ts_tablet_manager.cc:1434] T d2f88787abb54ffea037f35cf48b22c4 P 79b6e57d59e4468ebe4423d871a31b39: Time spent starting tablet: real 0.057s	user 0.006s	sys 0.000s
I20260709 13:12:20.123281  2196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d5e9a8f42c4a2993d25a8a341fddbf" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:20.098925  2941 leader_election.cc:290] T d4e943e5bbd7402da6bcc00db70cec14 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 election: Requested vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:20.124155  2402 tablet_bootstrap.cc:492] T 6bf4f728eedf41bdb027f554c3a5ae1f P 79b6e57d59e4468ebe4423d871a31b39: Bootstrap starting.
I20260709 13:12:20.128126  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0fb3f7bf85419cbf7ecda4727ccb89" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:20.128734  2263 raft_consensus.cc:3060] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Advancing to term 4
I20260709 13:12:20.121694  2338 raft_consensus.cc:2468] T 583390912c6d4daca2df9b5534fb8dca P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 1.
I20260709 13:12:20.124085  2189 raft_consensus.cc:2468] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 4.
I20260709 13:12:20.133260  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38d5e9a8f42c4a2993d25a8a341fddbf" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:20.133424  2088 leader_election.cc:304] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472; no voters: 
I20260709 13:12:20.134366  2817 raft_consensus.cc:2804] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:20.136852  2817 raft_consensus.cc:697] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [term 4 LEADER]: Becoming Leader. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Running, Role: LEADER
I20260709 13:12:20.137686  2817 consensus_queue.cc:237] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:20.140533  2266 raft_consensus.cc:2468] T 38d5e9a8f42c4a2993d25a8a341fddbf P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 2.
I20260709 13:12:20.144992  2236 leader_election.cc:304] T 583390912c6d4daca2df9b5534fb8dca P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39; no voters: 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:20.146651  2018 catalog_manager.cc:5697] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 reported cstate change: term changed from 1 to 2, leader changed from 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67) to 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65). New cstate: current_term: 2 leader_uuid: "2ac5c5682f914ed9b9982b5a080d5472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } }
I20260709 13:12:20.153726  2973 consensus_queue.cc:1048] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:20.154155  2966 raft_consensus.cc:515] T d4e943e5bbd7402da6bcc00db70cec14 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:20.155630  2192 raft_consensus.cc:2393] T d4e943e5bbd7402da6bcc00db70cec14 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in current term 1: Already voted for candidate 0ec6a5d1452a41bd992a8c7922473b35 in this term.
I20260709 13:12:20.157634  2966 leader_election.cc:290] T d4e943e5bbd7402da6bcc00db70cec14 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 election: Requested vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:20.159593  2649 consensus_queue.cc:1048] T bad0fdea1e3a409aab372c59eaa33767 P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:20.157819  2805 raft_consensus.cc:2804] T 583390912c6d4daca2df9b5534fb8dca P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:20.164615  2805 raft_consensus.cc:697] T 583390912c6d4daca2df9b5534fb8dca P 79b6e57d59e4468ebe4423d871a31b39 [term 1 LEADER]: Becoming Leader. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Running, Role: LEADER
I20260709 13:12:20.165385  2805 consensus_queue.cc:237] T 583390912c6d4daca2df9b5534fb8dca P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:20.161203  2310 leader_election.cc:304] T 38d5e9a8f42c4a2993d25a8a341fddbf P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39; no voters: 0ec6a5d1452a41bd992a8c7922473b35
I20260709 13:12:20.145236  2818 leader_election.cc:290] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 4 election: Requested vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:20.190142  2162 leader_election.cc:304] T d1ddcfd4d0914e40ae0a684fd8726d24 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:20.191773  2393 tablet_bootstrap.cc:492] T 46887c40373b4aca811c6382c97cb9bf P 0ec6a5d1452a41bd992a8c7922473b35: No bootstrap required, opened a new log
I20260709 13:12:20.194312  2393 ts_tablet_manager.cc:1403] T 46887c40373b4aca811c6382c97cb9bf P 0ec6a5d1452a41bd992a8c7922473b35: Time spent bootstrapping tablet: real 0.477s	user 0.008s	sys 0.006s
I20260709 13:12:20.197206  2649 raft_consensus.cc:2804] T 38d5e9a8f42c4a2993d25a8a341fddbf P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:20.204329  2649 raft_consensus.cc:697] T 38d5e9a8f42c4a2993d25a8a341fddbf P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 LEADER]: Becoming Leader. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Running, Role: LEADER
I20260709 13:12:20.205212  2649 consensus_queue.cc:237] T 38d5e9a8f42c4a2993d25a8a341fddbf P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:20.199046  2845 raft_consensus.cc:3060] T d1ddcfd4d0914e40ae0a684fd8726d24 P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:20.190948  2913 leader_election.cc:290] T d1ddcfd4d0914e40ae0a684fd8726d24 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 election: Requested vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:20.214855  2118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e943e5bbd7402da6bcc00db70cec14" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:20.251688  2845 raft_consensus.cc:2749] T d1ddcfd4d0914e40ae0a684fd8726d24 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:20.259336  2236 leader_election.cc:400] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557) with higher term. Message: Invalid argument: T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79b6e57d59e4468ebe4423d871a31b39 for earlier term 3. Current term is 4.
I20260709 13:12:20.259694  2236 leader_election.cc:403] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 13:12:20.226444  2117 raft_consensus.cc:2468] T d4e943e5bbd7402da6bcc00db70cec14 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 1.
I20260709 13:12:20.235332  2338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e943e5bbd7402da6bcc00db70cec14" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:20.257120  2196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d1ddcfd4d0914e40ae0a684fd8726d24" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:20.276721  2338 raft_consensus.cc:2393] T d4e943e5bbd7402da6bcc00db70cec14 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec6a5d1452a41bd992a8c7922473b35 in current term 1: Already voted for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in this term.
I20260709 13:12:20.272163  2114 raft_consensus.cc:1275] T b3b82132c31545aab274c7cf3f77c277 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Refusing update from remote peer 0ec6a5d1452a41bd992a8c7922473b35: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:20.280408  2402 tablet_bootstrap.cc:654] T 6bf4f728eedf41bdb027f554c3a5ae1f P 79b6e57d59e4468ebe4423d871a31b39: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.289937  2310 leader_election.cc:304] T d4e943e5bbd7402da6bcc00db70cec14 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 0ec6a5d1452a41bd992a8c7922473b35
I20260709 13:12:20.293918  2508 raft_consensus.cc:2804] T d4e943e5bbd7402da6bcc00db70cec14 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:20.294360  2508 raft_consensus.cc:697] T d4e943e5bbd7402da6bcc00db70cec14 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 LEADER]: Becoming Leader. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Running, Role: LEADER
I20260709 13:12:20.295023  2263 raft_consensus.cc:2468] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 4.
I20260709 13:12:20.295595  2805 raft_consensus.cc:2749] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557) with higher term. Message: Invalid argument: T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79b6e57d59e4468ebe4423d871a31b39 for earlier term 3. Current term is 4.
I20260709 13:12:20.296053  2196 raft_consensus.cc:2468] T d1ddcfd4d0914e40ae0a684fd8726d24 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 1.
I20260709 13:12:20.295076  2508 consensus_queue.cc:237] T d4e943e5bbd7402da6bcc00db70cec14 P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
W20260709 13:12:20.303975  2162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:38869, user_credentials={real_user=slave}} blocked reactor thread for 43595.6us
I20260709 13:12:20.302624  2393 raft_consensus.cc:359] T 46887c40373b4aca811c6382c97cb9bf P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:20.307457  2393 raft_consensus.cc:385] T 46887c40373b4aca811c6382c97cb9bf P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.307737  2393 raft_consensus.cc:740] T 46887c40373b4aca811c6382c97cb9bf P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.274722  2941 consensus_queue.cc:1048] T bad0fdea1e3a409aab372c59eaa33767 P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.031s
I20260709 13:12:20.310673  2391 tablet_bootstrap.cc:492] T 583390912c6d4daca2df9b5534fb8dca P 2ac5c5682f914ed9b9982b5a080d5472: No bootstrap required, opened a new log
I20260709 13:12:20.311200  2391 ts_tablet_manager.cc:1403] T 583390912c6d4daca2df9b5534fb8dca P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.324s	user 0.004s	sys 0.019s
I20260709 13:12:20.314172  2237 leader_election.cc:304] T d1ddcfd4d0914e40ae0a684fd8726d24 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39; no voters: 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:20.313122  2393 consensus_queue.cc:260] T 46887c40373b4aca811c6382c97cb9bf P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:20.318063  2342 raft_consensus.cc:1275] T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Refusing update from remote peer 0ec6a5d1452a41bd992a8c7922473b35: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260709 13:12:20.318437  2342 pending_rounds.cc:85] T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Aborting all ops after (but not including) 1
I20260709 13:12:20.318666  2342 pending_rounds.cc:107] T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260709 13:12:20.318910  2342 raft_consensus.cc:2889] T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:20.320497  2913 raft_consensus.cc:2804] T d1ddcfd4d0914e40ae0a684fd8726d24 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:20.332646  2017 catalog_manager.cc:5697] T 622b6cfd76ff495ea6692a1ec0faefc4 P 0ec6a5d1452a41bd992a8c7922473b35 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66). New cstate: current_term: 1 leader_uuid: "0ec6a5d1452a41bd992a8c7922473b35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:20.335759  2017 catalog_manager.cc:5697] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 0ec6a5d1452a41bd992a8c7922473b35 reported cstate change: term changed from 1 to 3, leader changed from 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68) to 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66). New cstate: current_term: 3 leader_uuid: "0ec6a5d1452a41bd992a8c7922473b35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:20.346367  2744 raft_consensus.cc:493] T 46887c40373b4aca811c6382c97cb9bf P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.346910  2744 raft_consensus.cc:515] T 46887c40373b4aca811c6382c97cb9bf P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:20.348743  2744 leader_election.cc:290] T 46887c40373b4aca811c6382c97cb9bf P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:20.321770  2913 raft_consensus.cc:697] T d1ddcfd4d0914e40ae0a684fd8726d24 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 LEADER]: Becoming Leader. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Running, Role: LEADER
I20260709 13:12:20.352731  2913 consensus_queue.cc:237] T d1ddcfd4d0914e40ae0a684fd8726d24 P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:20.356419  2162 leader_election.cc:304] T d4e943e5bbd7402da6bcc00db70cec14 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea
I20260709 13:12:20.357281  2744 raft_consensus.cc:2749] T d4e943e5bbd7402da6bcc00db70cec14 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:20.358022  2744 consensus_queue.cc:1048] T b3b82132c31545aab274c7cf3f77c277 P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:20.360819  2391 raft_consensus.cc:359] T 583390912c6d4daca2df9b5534fb8dca P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:20.363981  2402 tablet_bootstrap.cc:492] T 6bf4f728eedf41bdb027f554c3a5ae1f P 79b6e57d59e4468ebe4423d871a31b39: No bootstrap required, opened a new log
I20260709 13:12:20.365337  2391 raft_consensus.cc:385] T 583390912c6d4daca2df9b5534fb8dca P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.365003  2393 ts_tablet_manager.cc:1434] T 46887c40373b4aca811c6382c97cb9bf P 0ec6a5d1452a41bd992a8c7922473b35: Time spent starting tablet: real 0.170s	user 0.008s	sys 0.000s
I20260709 13:12:20.365645  2402 ts_tablet_manager.cc:1403] T 6bf4f728eedf41bdb027f554c3a5ae1f P 79b6e57d59e4468ebe4423d871a31b39: Time spent bootstrapping tablet: real 0.242s	user 0.008s	sys 0.009s
I20260709 13:12:20.365899  2391 raft_consensus.cc:740] T 583390912c6d4daca2df9b5534fb8dca P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.367223  2391 consensus_queue.cc:260] T 583390912c6d4daca2df9b5534fb8dca P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
W20260709 13:12:20.372026  2310 consensus_peers.cc:597] T df8d897471684531826528a5751d6246 P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:20.373582  3031 consensus_queue.cc:1048] T b3b82132c31545aab274c7cf3f77c277 P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:20.376765  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46887c40373b4aca811c6382c97cb9bf" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:20.377460  2342 raft_consensus.cc:2468] T 46887c40373b4aca811c6382c97cb9bf P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 0.
W20260709 13:12:20.366277  3024 log.cc:927] Time spent T 8b65903ab966485c9c65bdfbdf1e1054 P 0ec6a5d1452a41bd992a8c7922473b35: Append to log took a long time: real 0.101s	user 0.003s	sys 0.000s
I20260709 13:12:20.384747  2402 raft_consensus.cc:359] T 6bf4f728eedf41bdb027f554c3a5ae1f P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:20.385644  2402 raft_consensus.cc:385] T 6bf4f728eedf41bdb027f554c3a5ae1f P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.385914  2402 raft_consensus.cc:740] T 6bf4f728eedf41bdb027f554c3a5ae1f P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.387635  2123 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46887c40373b4aca811c6382c97cb9bf" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:20.390053  2402 consensus_queue.cc:260] T 6bf4f728eedf41bdb027f554c3a5ae1f P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:20.395563  2162 leader_election.cc:304] T 46887c40373b4aca811c6382c97cb9bf P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
W20260709 13:12:20.396871  2310 consensus_peers.cc:597] T 6bf4f728eedf41bdb027f554c3a5ae1f P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Couldn't send request to peer 79b6e57d59e4468ebe4423d871a31b39. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:20.401929  2744 raft_consensus.cc:2804] T 46887c40373b4aca811c6382c97cb9bf P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:20.403558  2744 raft_consensus.cc:493] T 46887c40373b4aca811c6382c97cb9bf P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:20.403895  2744 raft_consensus.cc:3060] T 46887c40373b4aca811c6382c97cb9bf P 0ec6a5d1452a41bd992a8c7922473b35 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:20.404963  2402 ts_tablet_manager.cc:1434] T 6bf4f728eedf41bdb027f554c3a5ae1f P 79b6e57d59e4468ebe4423d871a31b39: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.000s
W20260709 13:12:20.404001  2162 leader_election.cc:343] T 46887c40373b4aca811c6382c97cb9bf P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:20.407763  2402 tablet_bootstrap.cc:492] T 421302a9721e4cc9a86e52a183469a70 P 79b6e57d59e4468ebe4423d871a31b39: Bootstrap starting.
I20260709 13:12:20.403329  2391 ts_tablet_manager.cc:1434] T 583390912c6d4daca2df9b5534fb8dca P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.091s	user 0.006s	sys 0.000s
I20260709 13:12:20.412240  2391 tablet_bootstrap.cc:492] T df8d897471684531826528a5751d6246 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:20.421350  2402 tablet_bootstrap.cc:654] T 421302a9721e4cc9a86e52a183469a70 P 79b6e57d59e4468ebe4423d871a31b39: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.450299  2949 raft_consensus.cc:493] T d2f88787abb54ffea037f35cf48b22c4 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.450798  2949 raft_consensus.cc:515] T d2f88787abb54ffea037f35cf48b22c4 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:20.456486  2189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f88787abb54ffea037f35cf48b22c4" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:20.456699  2117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f88787abb54ffea037f35cf48b22c4" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:20.452775  2949 leader_election.cc:290] T d2f88787abb54ffea037f35cf48b22c4 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:20.477464  2236 leader_election.cc:304] T d2f88787abb54ffea037f35cf48b22c4 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b6e57d59e4468ebe4423d871a31b39; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:20.479166  2914 raft_consensus.cc:2749] T d2f88787abb54ffea037f35cf48b22c4 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:20.478274  2019 catalog_manager.cc:5697] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea reported cstate change: term changed from 1 to 3, leader changed from 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65) to 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68). New cstate: current_term: 3 leader_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:20.481012  2019 catalog_manager.cc:5697] T bad0fdea1e3a409aab372c59eaa33767 P 66e9a8fffd4b4e5a81ca4fa2762773ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68). New cstate: current_term: 1 leader_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:20.482226  2019 catalog_manager.cc:5697] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea reported cstate change: term changed from 1 to 3, leader changed from 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66) to 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68). New cstate: current_term: 3 leader_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:20.483318  2019 catalog_manager.cc:5697] T 1588358a9e7542dfbd8b5d2f65212aec P 66e9a8fffd4b4e5a81ca4fa2762773ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68). New cstate: current_term: 1 leader_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:20.490991  2391 tablet_bootstrap.cc:654] T df8d897471684531826528a5751d6246 P 2ac5c5682f914ed9b9982b5a080d5472: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.480912  2744 raft_consensus.cc:515] T 46887c40373b4aca811c6382c97cb9bf P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:20.512508  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46887c40373b4aca811c6382c97cb9bf" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:20.513165  2342 raft_consensus.cc:3060] T 46887c40373b4aca811c6382c97cb9bf P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:20.514777  2744 leader_election.cc:290] T 46887c40373b4aca811c6382c97cb9bf P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 election: Requested vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:20.515195  2402 tablet_bootstrap.cc:492] T 421302a9721e4cc9a86e52a183469a70 P 79b6e57d59e4468ebe4423d871a31b39: No bootstrap required, opened a new log
I20260709 13:12:20.515642  2402 ts_tablet_manager.cc:1403] T 421302a9721e4cc9a86e52a183469a70 P 79b6e57d59e4468ebe4423d871a31b39: Time spent bootstrapping tablet: real 0.110s	user 0.012s	sys 0.009s
I20260709 13:12:20.516399  2117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46887c40373b4aca811c6382c97cb9bf" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
W20260709 13:12:20.518033  2162 leader_election.cc:343] T 46887c40373b4aca811c6382c97cb9bf P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:20.518266  2402 raft_consensus.cc:359] T 421302a9721e4cc9a86e52a183469a70 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:20.518929  2402 raft_consensus.cc:385] T 421302a9721e4cc9a86e52a183469a70 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.519335  2402 raft_consensus.cc:740] T 421302a9721e4cc9a86e52a183469a70 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.519937  2402 consensus_queue.cc:260] T 421302a9721e4cc9a86e52a183469a70 P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:20.521386  2342 raft_consensus.cc:2468] T 46887c40373b4aca811c6382c97cb9bf P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 1.
I20260709 13:12:20.521965  2402 ts_tablet_manager.cc:1434] T 421302a9721e4cc9a86e52a183469a70 P 79b6e57d59e4468ebe4423d871a31b39: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 13:12:20.522909  2162 leader_election.cc:304] T 46887c40373b4aca811c6382c97cb9bf P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:20.523703  2973 raft_consensus.cc:2804] T 46887c40373b4aca811c6382c97cb9bf P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:20.522909  2402 tablet_bootstrap.cc:492] T e1ad60fa3bce47daac74b01143b54132 P 79b6e57d59e4468ebe4423d871a31b39: Bootstrap starting.
I20260709 13:12:20.524163  2973 raft_consensus.cc:697] T 46887c40373b4aca811c6382c97cb9bf P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 LEADER]: Becoming Leader. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Running, Role: LEADER
I20260709 13:12:20.525100  2973 consensus_queue.cc:237] T 46887c40373b4aca811c6382c97cb9bf P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:20.518908  2263 raft_consensus.cc:3060] T d2f88787abb54ffea037f35cf48b22c4 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:20.530467  2402 tablet_bootstrap.cc:654] T e1ad60fa3bce47daac74b01143b54132 P 79b6e57d59e4468ebe4423d871a31b39: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.540920  2268 raft_consensus.cc:3060] T 421302a9721e4cc9a86e52a183469a70 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:20.549103  2391 tablet_bootstrap.cc:492] T df8d897471684531826528a5751d6246 P 2ac5c5682f914ed9b9982b5a080d5472: No bootstrap required, opened a new log
I20260709 13:12:20.549696  2391 ts_tablet_manager.cc:1403] T df8d897471684531826528a5751d6246 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.138s	user 0.008s	sys 0.003s
I20260709 13:12:20.550220  2018 catalog_manager.cc:5697] T d1ddcfd4d0914e40ae0a684fd8726d24 P 79b6e57d59e4468ebe4423d871a31b39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67). New cstate: current_term: 1 leader_uuid: "79b6e57d59e4468ebe4423d871a31b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:20.552541  2391 raft_consensus.cc:359] T df8d897471684531826528a5751d6246 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:20.553326  2391 raft_consensus.cc:385] T df8d897471684531826528a5751d6246 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.553591  2391 raft_consensus.cc:740] T df8d897471684531826528a5751d6246 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.554340  2391 consensus_queue.cc:260] T df8d897471684531826528a5751d6246 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:20.556706  2391 ts_tablet_manager.cc:1434] T df8d897471684531826528a5751d6246 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:12:20.559301  2117 raft_consensus.cc:3060] T 583390912c6d4daca2df9b5534fb8dca P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:20.561288  2018 catalog_manager.cc:5697] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 79b6e57d59e4468ebe4423d871a31b39 reported cstate change: term changed from 1 to 3, leader changed from 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67) to 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66). New cstate: current_term: 3 leader_uuid: "0ec6a5d1452a41bd992a8c7922473b35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } }
I20260709 13:12:20.574671  2402 tablet_bootstrap.cc:492] T e1ad60fa3bce47daac74b01143b54132 P 79b6e57d59e4468ebe4423d871a31b39: No bootstrap required, opened a new log
I20260709 13:12:20.575255  2402 ts_tablet_manager.cc:1403] T e1ad60fa3bce47daac74b01143b54132 P 79b6e57d59e4468ebe4423d871a31b39: Time spent bootstrapping tablet: real 0.053s	user 0.026s	sys 0.016s
I20260709 13:12:20.578274  2402 raft_consensus.cc:359] T e1ad60fa3bce47daac74b01143b54132 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:20.578902  2402 raft_consensus.cc:385] T e1ad60fa3bce47daac74b01143b54132 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.579185  2402 raft_consensus.cc:740] T e1ad60fa3bce47daac74b01143b54132 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.579867  2402 consensus_queue.cc:260] T e1ad60fa3bce47daac74b01143b54132 P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:20.583945  2402 ts_tablet_manager.cc:1434] T e1ad60fa3bce47daac74b01143b54132 P 79b6e57d59e4468ebe4423d871a31b39: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:12:20.583859  2949 consensus_queue.cc:1048] T 583390912c6d4daca2df9b5534fb8dca P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:20.585402  2391 tablet_bootstrap.cc:492] T 46887c40373b4aca811c6382c97cb9bf P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:20.597647  2913 consensus_queue.cc:1048] T 583390912c6d4daca2df9b5534fb8dca P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:20.600569  2391 tablet_bootstrap.cc:654] T 46887c40373b4aca811c6382c97cb9bf P 2ac5c5682f914ed9b9982b5a080d5472: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:20.575135  2018 catalog_manager.cc:5697] T 583390912c6d4daca2df9b5534fb8dca P 79b6e57d59e4468ebe4423d871a31b39 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67). New cstate: current_term: 1 leader_uuid: "79b6e57d59e4468ebe4423d871a31b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:20.611353  2391 tablet_bootstrap.cc:492] T 46887c40373b4aca811c6382c97cb9bf P 2ac5c5682f914ed9b9982b5a080d5472: No bootstrap required, opened a new log
I20260709 13:12:20.611793  2391 ts_tablet_manager.cc:1403] T 46887c40373b4aca811c6382c97cb9bf P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.003s
I20260709 13:12:20.614348  2391 raft_consensus.cc:359] T 46887c40373b4aca811c6382c97cb9bf P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:20.614995  2391 raft_consensus.cc:385] T 46887c40373b4aca811c6382c97cb9bf P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:20.615260  2391 raft_consensus.cc:740] T 46887c40373b4aca811c6382c97cb9bf P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:20.616074  2391 consensus_queue.cc:260] T 46887c40373b4aca811c6382c97cb9bf P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:20.618108  2391 ts_tablet_manager.cc:1434] T 46887c40373b4aca811c6382c97cb9bf P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 13:12:20.627079  2189 raft_consensus.cc:1275] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [term 4 FOLLOWER]: Refusing update from remote peer 2ac5c5682f914ed9b9982b5a080d5472: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:20.628644  2818 consensus_queue.cc:1048] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:20.639314  2268 raft_consensus.cc:1275] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [term 4 FOLLOWER]: Refusing update from remote peer 2ac5c5682f914ed9b9982b5a080d5472: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:20.641004  2931 consensus_queue.cc:1048] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:20.654081  2021 catalog_manager.cc:5697] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "2ac5c5682f914ed9b9982b5a080d5472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:20.657112  2931 raft_consensus.cc:493] T 46887c40373b4aca811c6382c97cb9bf P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.657624  2931 raft_consensus.cc:515] T 46887c40373b4aca811c6382c97cb9bf P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:20.659601  2931 leader_election.cc:290] T 46887c40373b4aca811c6382c97cb9bf P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:20.659651  2021 catalog_manager.cc:5697] T b3b82132c31545aab274c7cf3f77c277 P 2ac5c5682f914ed9b9982b5a080d5472 reported cstate change: term changed from 1 to 3, leader changed from 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65) to 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66). New cstate: current_term: 3 leader_uuid: "0ec6a5d1452a41bd992a8c7922473b35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } }
I20260709 13:12:20.663924  2189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46887c40373b4aca811c6382c97cb9bf" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:20.664150  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "46887c40373b4aca811c6382c97cb9bf" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:20.664956  2342 raft_consensus.cc:2393] T 46887c40373b4aca811c6382c97cb9bf P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ac5c5682f914ed9b9982b5a080d5472 in current term 1: Already voted for candidate 0ec6a5d1452a41bd992a8c7922473b35 in this term.
I20260709 13:12:20.666271  2087 leader_election.cc:304] T 46887c40373b4aca811c6382c97cb9bf P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea
I20260709 13:12:20.671783  2931 raft_consensus.cc:3060] T 46887c40373b4aca811c6382c97cb9bf P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:20.678278  2931 raft_consensus.cc:2749] T 46887c40373b4aca811c6382c97cb9bf P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:20.699571  2018 catalog_manager.cc:5697] T 38d5e9a8f42c4a2993d25a8a341fddbf P 66e9a8fffd4b4e5a81ca4fa2762773ea reported cstate change: term changed from 1 to 2, leader changed from 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67) to 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68). New cstate: current_term: 2 leader_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:20.701653  2018 catalog_manager.cc:5697] T d4e943e5bbd7402da6bcc00db70cec14 P 66e9a8fffd4b4e5a81ca4fa2762773ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68). New cstate: current_term: 1 leader_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:20.742962  2914 consensus_queue.cc:1048] T d1ddcfd4d0914e40ae0a684fd8726d24 P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:20.747318  2020 catalog_manager.cc:5697] T 46887c40373b4aca811c6382c97cb9bf P 0ec6a5d1452a41bd992a8c7922473b35 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66). New cstate: current_term: 1 leader_uuid: "0ec6a5d1452a41bd992a8c7922473b35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:20.760633  2914 consensus_queue.cc:1048] T d1ddcfd4d0914e40ae0a684fd8726d24 P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:20.806423  2189 raft_consensus.cc:3060] T 38d5e9a8f42c4a2993d25a8a341fddbf P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:20.813582  2189 raft_consensus.cc:1275] T 38d5e9a8f42c4a2993d25a8a341fddbf P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Refusing update from remote peer 66e9a8fffd4b4e5a81ca4fa2762773ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:20.814960  2972 consensus_queue.cc:1048] T 38d5e9a8f42c4a2993d25a8a341fddbf P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:20.824452  2972 consensus_queue.cc:1048] T d4e943e5bbd7402da6bcc00db70cec14 P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:20.830221  2263 raft_consensus.cc:1275] T 38d5e9a8f42c4a2993d25a8a341fddbf P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Refusing update from remote peer 66e9a8fffd4b4e5a81ca4fa2762773ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:20.832826  2972 consensus_queue.cc:1048] T 38d5e9a8f42c4a2993d25a8a341fddbf P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:20.851250  2931 raft_consensus.cc:493] T df8d897471684531826528a5751d6246 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.851785  2931 raft_consensus.cc:515] T df8d897471684531826528a5751d6246 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:20.854437  2931 leader_election.cc:290] T df8d897471684531826528a5751d6246 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:20.854549  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df8d897471684531826528a5751d6246" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:20.858415  2339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df8d897471684531826528a5751d6246" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:20.861238  2087 leader_election.cc:304] T df8d897471684531826528a5751d6246 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472; no voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:20.862371  2931 raft_consensus.cc:2749] T df8d897471684531826528a5751d6246 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:20.881349  2907 consensus_queue.cc:1048] T d4e943e5bbd7402da6bcc00db70cec14 P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:20.889299  2914 raft_consensus.cc:493] T 6bf4f728eedf41bdb027f554c3a5ae1f P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.889909  2914 raft_consensus.cc:515] T 6bf4f728eedf41bdb027f554c3a5ae1f P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:20.891775  2914 leader_election.cc:290] T 6bf4f728eedf41bdb027f554c3a5ae1f P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:20.894268  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf4f728eedf41bdb027f554c3a5ae1f" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:20.894268  2114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6bf4f728eedf41bdb027f554c3a5ae1f" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:20.899258  2236 leader_election.cc:304] T 6bf4f728eedf41bdb027f554c3a5ae1f P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b6e57d59e4468ebe4423d871a31b39; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea
I20260709 13:12:20.900270  2914 raft_consensus.cc:2749] T 6bf4f728eedf41bdb027f554c3a5ae1f P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:20.927423  2263 raft_consensus.cc:3060] T 6bf4f728eedf41bdb027f554c3a5ae1f P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:20.931442  2069 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:20.934162  2114 raft_consensus.cc:3060] T df8d897471684531826528a5751d6246 P 2ac5c5682f914ed9b9982b5a080d5472 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:20.996073  2914 raft_consensus.cc:493] T e1ad60fa3bce47daac74b01143b54132 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:20.996577  2914 raft_consensus.cc:515] T e1ad60fa3bce47daac74b01143b54132 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:20.998247  2914 leader_election.cc:290] T e1ad60fa3bce47daac74b01143b54132 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:20.998745  2114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ad60fa3bce47daac74b01143b54132" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:20.999111  2189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ad60fa3bce47daac74b01143b54132" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:20.999594  2114 raft_consensus.cc:2393] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79b6e57d59e4468ebe4423d871a31b39 in current term 1: Already voted for candidate 2ac5c5682f914ed9b9982b5a080d5472 in this term.
I20260709 13:12:20.999827  2189 raft_consensus.cc:2393] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 79b6e57d59e4468ebe4423d871a31b39 in current term 1: Already voted for candidate 0ec6a5d1452a41bd992a8c7922473b35 in this term.
I20260709 13:12:21.000960  2237 leader_election.cc:304] T e1ad60fa3bce47daac74b01143b54132 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b6e57d59e4468ebe4423d871a31b39; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:21.001538  2914 raft_consensus.cc:3060] T e1ad60fa3bce47daac74b01143b54132 P 79b6e57d59e4468ebe4423d871a31b39 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:21.006215  2914 raft_consensus.cc:2749] T e1ad60fa3bce47daac74b01143b54132 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:21.021123  2744 consensus_queue.cc:1048] T 46887c40373b4aca811c6382c97cb9bf P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:21.080364  2951 consensus_queue.cc:1048] T 46887c40373b4aca811c6382c97cb9bf P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:21.492729  2931 raft_consensus.cc:493] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:21.493203  2931 raft_consensus.cc:515] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:21.495199  2931 leader_election.cc:290] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:21.496089  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ad60fa3bce47daac74b01143b54132" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:21.496927  2263 raft_consensus.cc:2468] T e1ad60fa3bce47daac74b01143b54132 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 1.
I20260709 13:12:21.497885  2087 leader_election.cc:304] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:21.496193  2193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ad60fa3bce47daac74b01143b54132" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:21.498499  2193 raft_consensus.cc:2468] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 1.
I20260709 13:12:21.498625  3058 raft_consensus.cc:2804] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:21.499002  3058 raft_consensus.cc:493] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:21.499363  3058 raft_consensus.cc:3060] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:21.504827  3058 raft_consensus.cc:515] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:21.507300  2193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ad60fa3bce47daac74b01143b54132" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:21.507843  2193 raft_consensus.cc:3060] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:21.510388  3058 leader_election.cc:290] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 election: Requested vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:21.511358  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ad60fa3bce47daac74b01143b54132" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:21.511941  2263 raft_consensus.cc:3060] T e1ad60fa3bce47daac74b01143b54132 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:21.515388  2193 raft_consensus.cc:2468] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 2.
I20260709 13:12:21.516423  2088 leader_election.cc:304] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472; no voters: 
I20260709 13:12:21.517135  3058 raft_consensus.cc:2804] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:21.517563  3058 raft_consensus.cc:697] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 LEADER]: Becoming Leader. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Running, Role: LEADER
I20260709 13:12:21.518291  3058 consensus_queue.cc:237] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:21.522641  2263 raft_consensus.cc:2468] T e1ad60fa3bce47daac74b01143b54132 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 2.
I20260709 13:12:21.532123  2018 catalog_manager.cc:5697] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472 reported cstate change: term changed from 0 to 2, leader changed from <none> to 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65). New cstate: current_term: 2 leader_uuid: "2ac5c5682f914ed9b9982b5a080d5472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:21.969004  2193 raft_consensus.cc:1275] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Refusing update from remote peer 2ac5c5682f914ed9b9982b5a080d5472: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:12:21.972028  3058 consensus_queue.cc:1048] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:21.984108  2268 raft_consensus.cc:1275] T e1ad60fa3bce47daac74b01143b54132 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Refusing update from remote peer 2ac5c5682f914ed9b9982b5a080d5472: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:12:21.995239  3066 consensus_queue.cc:1048] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:23.202713 28889 tablet_server.cc:179] TabletServer@127.28.54.65:0 shutting down...
W20260709 13:12:23.204447  2310 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 5 similar messages]
W20260709 13:12:23.207798  2310 consensus_peers.cc:597] T d4e943e5bbd7402da6bcc00db70cec14 P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:23.224642  2236 consensus_peers.cc:597] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:23.250413  2162 consensus_peers.cc:597] T b3b82132c31545aab274c7cf3f77c277 P 0ec6a5d1452a41bd992a8c7922473b35 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:23.252449  2162 consensus_peers.cc:597] T 765b8df93039426e925b94637a061cc2 P 0ec6a5d1452a41bd992a8c7922473b35 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:23.258316  2236 consensus_peers.cc:597] T d1ddcfd4d0914e40ae0a684fd8726d24 P 79b6e57d59e4468ebe4423d871a31b39 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:23.272850  2162 consensus_peers.cc:597] T d3370eb67fff4896b1f8e3ce56eceb9b P 0ec6a5d1452a41bd992a8c7922473b35 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:23.285830  2236 consensus_peers.cc:597] T ddf48e4f6be64627a0ed06d6198ca054 P 79b6e57d59e4468ebe4423d871a31b39 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:23.286521  2088 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:38859, user_credentials={real_user=slave}} blocked reactor thread for 66126.1us
W20260709 13:12:23.289513  2236 consensus_peers.cc:597] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:23.292685  2310 consensus_peers.cc:597] T 1588358a9e7542dfbd8b5d2f65212aec P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:23.293279  2310 consensus_peers.cc:597] T 36b22aafe7104cec82607dab40b4aed8 P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:23.299840 28889 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:23.300983 28889 tablet_replica.cc:333] T 46887c40373b4aca811c6382c97cb9bf P 2ac5c5682f914ed9b9982b5a080d5472: stopping tablet replica
I20260709 13:12:23.301972 28889 raft_consensus.cc:2243] T 46887c40373b4aca811c6382c97cb9bf P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:12:23.302223  2236 consensus_peers.cc:597] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:23.302554 28889 raft_consensus.cc:2272] T 46887c40373b4aca811c6382c97cb9bf P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:23.303753  2236 consensus_peers.cc:597] T 583390912c6d4daca2df9b5534fb8dca P 79b6e57d59e4468ebe4423d871a31b39 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:23.304878 28889 tablet_replica.cc:333] T df8d897471684531826528a5751d6246 P 2ac5c5682f914ed9b9982b5a080d5472: stopping tablet replica
I20260709 13:12:23.305531 28889 raft_consensus.cc:2243] T df8d897471684531826528a5751d6246 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:23.306052 28889 raft_consensus.cc:2272] T df8d897471684531826528a5751d6246 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:23.308344 28889 tablet_replica.cc:333] T 583390912c6d4daca2df9b5534fb8dca P 2ac5c5682f914ed9b9982b5a080d5472: stopping tablet replica
I20260709 13:12:23.308859 28889 raft_consensus.cc:2243] T 583390912c6d4daca2df9b5534fb8dca P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:23.309218 28889 raft_consensus.cc:2272] T 583390912c6d4daca2df9b5534fb8dca P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:23.311021 28889 tablet_replica.cc:333] T 1588358a9e7542dfbd8b5d2f65212aec P 2ac5c5682f914ed9b9982b5a080d5472: stopping tablet replica
I20260709 13:12:23.311789 28889 raft_consensus.cc:2243] T 1588358a9e7542dfbd8b5d2f65212aec P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:23.312573 28889 raft_consensus.cc:2272] T 1588358a9e7542dfbd8b5d2f65212aec P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:23.314795 28889 tablet_replica.cc:333] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 2ac5c5682f914ed9b9982b5a080d5472: stopping tablet replica
I20260709 13:12:23.315567 28889 raft_consensus.cc:2243] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:12:23.315400  2162 consensus_peers.cc:597] T bc42d18a324e4f6d97f07cf770c5daa8 P 0ec6a5d1452a41bd992a8c7922473b35 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:23.316279 28889 raft_consensus.cc:2272] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:23.318488 28889 tablet_replica.cc:333] T 10de08c2346d47dbbd720596cd7e02fd P 2ac5c5682f914ed9b9982b5a080d5472: stopping tablet replica
I20260709 13:12:23.319238 28889 raft_consensus.cc:2243] T 10de08c2346d47dbbd720596cd7e02fd P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 LEADER]: Raft consensus shutting down.
W20260709 13:12:23.331261  2162 consensus_peers.cc:597] T 12b5593f051548fea374da76afa08c3f P 0ec6a5d1452a41bd992a8c7922473b35 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:23.320124 28889 raft_consensus.cc:2272] T 10de08c2346d47dbbd720596cd7e02fd P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:23.335839  2310 consensus_peers.cc:597] T df8d897471684531826528a5751d6246 P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:23.336999 28889 tablet_replica.cc:333] T d0d102459578474fbe77af94f3986a84 P 2ac5c5682f914ed9b9982b5a080d5472: stopping tablet replica
I20260709 13:12:23.337623 28889 raft_consensus.cc:2243] T d0d102459578474fbe77af94f3986a84 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:23.338440 28889 raft_consensus.cc:2272] T d0d102459578474fbe77af94f3986a84 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:23.340531 28889 tablet_replica.cc:333] T b206de895e36490688cb2c1c537774a5 P 2ac5c5682f914ed9b9982b5a080d5472: stopping tablet replica
I20260709 13:12:23.341329 28889 raft_consensus.cc:2243] T b206de895e36490688cb2c1c537774a5 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:23.341863 28889 raft_consensus.cc:2272] T b206de895e36490688cb2c1c537774a5 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:23.343737 28889 tablet_replica.cc:333] T 622b6cfd76ff495ea6692a1ec0faefc4 P 2ac5c5682f914ed9b9982b5a080d5472: stopping tablet replica
I20260709 13:12:23.344321 28889 raft_consensus.cc:2243] T 622b6cfd76ff495ea6692a1ec0faefc4 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:23.344693 28889 raft_consensus.cc:2272] T 622b6cfd76ff495ea6692a1ec0faefc4 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:23.346623 28889 tablet_replica.cc:333] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472: stopping tablet replica
I20260709 13:12:23.347319 28889 raft_consensus.cc:2243] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:23.348037 28889 raft_consensus.cc:2272] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:23.349858 28889 tablet_replica.cc:333] T a4a5ce298d24406ea94fb68aba5b37ae P 2ac5c5682f914ed9b9982b5a080d5472: stopping tablet replica
I20260709 13:12:23.350346 28889 raft_consensus.cc:2243] T a4a5ce298d24406ea94fb68aba5b37ae P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:23.351027 28889 raft_consensus.cc:2272] T a4a5ce298d24406ea94fb68aba5b37ae P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:23.353091 28889 tablet_replica.cc:333] T 36b22aafe7104cec82607dab40b4aed8 P 2ac5c5682f914ed9b9982b5a080d5472: stopping tablet replica
I20260709 13:12:23.353806 28889 raft_consensus.cc:2243] T 36b22aafe7104cec82607dab40b4aed8 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:23.354296 28889 raft_consensus.cc:2272] T 36b22aafe7104cec82607dab40b4aed8 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:23.356045 28889 tablet_replica.cc:333] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472: stopping tablet replica
I20260709 13:12:23.356526 28889 raft_consensus.cc:2243] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:23.357172 28889 raft_consensus.cc:2272] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:23.358798 28889 tablet_replica.cc:333] T a9be6d55d1f348bcaf96405abc80244d P 2ac5c5682f914ed9b9982b5a080d5472: stopping tablet replica
I20260709 13:12:23.359315 28889 raft_consensus.cc:2243] T a9be6d55d1f348bcaf96405abc80244d P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:23.359676 28889 raft_consensus.cc:2272] T a9be6d55d1f348bcaf96405abc80244d P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:23.361186 28889 tablet_replica.cc:333] T 5c3646d79bc840e9b4396f4351d1803d P 2ac5c5682f914ed9b9982b5a080d5472: stopping tablet replica
I20260709 13:12:23.361663 28889 raft_consensus.cc:2243] T 5c3646d79bc840e9b4396f4351d1803d P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:23.362466 28889 raft_consensus.cc:2272] T 5c3646d79bc840e9b4396f4351d1803d P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:23.364256 28889 tablet_replica.cc:333] T d2f88787abb54ffea037f35cf48b22c4 P 2ac5c5682f914ed9b9982b5a080d5472: stopping tablet replica
I20260709 13:12:23.364768 28889 raft_consensus.cc:2243] T d2f88787abb54ffea037f35cf48b22c4 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:23.365115 28889 raft_consensus.cc:2272] T d2f88787abb54ffea037f35cf48b22c4 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:23.366757 28889 tablet_replica.cc:333] T 765b8df93039426e925b94637a061cc2 P 2ac5c5682f914ed9b9982b5a080d5472: stopping tablet replica
I20260709 13:12:23.367242 28889 raft_consensus.cc:2243] T 765b8df93039426e925b94637a061cc2 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:23.367697 28889 raft_consensus.cc:2272] T 765b8df93039426e925b94637a061cc2 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:23.369663 28889 tablet_replica.cc:333] T 12b5593f051548fea374da76afa08c3f P 2ac5c5682f914ed9b9982b5a080d5472: stopping tablet replica
I20260709 13:12:23.370296 28889 raft_consensus.cc:2243] T 12b5593f051548fea374da76afa08c3f P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:23.370810 28889 raft_consensus.cc:2272] T 12b5593f051548fea374da76afa08c3f P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:23.372831 28889 tablet_replica.cc:333] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472: stopping tablet replica
I20260709 13:12:23.373337 28889 raft_consensus.cc:2243] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:23.374046 28889 raft_consensus.cc:2272] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:23.375880 28889 tablet_replica.cc:333] T 1478f883c539464bb54fe9bff44148d5 P 2ac5c5682f914ed9b9982b5a080d5472: stopping tablet replica
I20260709 13:12:23.376396 28889 raft_consensus.cc:2243] T 1478f883c539464bb54fe9bff44148d5 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:23.376856 28889 raft_consensus.cc:2272] T 1478f883c539464bb54fe9bff44148d5 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:23.379132 28889 tablet_replica.cc:333] T a0394490f6984f028daa10be921e242b P 2ac5c5682f914ed9b9982b5a080d5472: stopping tablet replica
I20260709 13:12:23.379769 28889 raft_consensus.cc:2243] T a0394490f6984f028daa10be921e242b P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:23.380308 28889 raft_consensus.cc:2272] T a0394490f6984f028daa10be921e242b P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:23.383539 28889 tablet_replica.cc:333] T b3b82132c31545aab274c7cf3f77c277 P 2ac5c5682f914ed9b9982b5a080d5472: stopping tablet replica
I20260709 13:12:23.384338 28889 raft_consensus.cc:2243] T b3b82132c31545aab274c7cf3f77c277 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:23.384846 28889 raft_consensus.cc:2272] T b3b82132c31545aab274c7cf3f77c277 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:23.387486 28889 tablet_replica.cc:333] T 2e178ff57d964223aca095ceff76b339 P 2ac5c5682f914ed9b9982b5a080d5472: stopping tablet replica
I20260709 13:12:23.388197 28889 raft_consensus.cc:2243] T 2e178ff57d964223aca095ceff76b339 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:23.389110 28889 raft_consensus.cc:2272] T 2e178ff57d964223aca095ceff76b339 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:23.390304  2162 consensus_peers.cc:597] T ee1baa7401cd48e48e7125dcd607f44f P 0ec6a5d1452a41bd992a8c7922473b35 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:23.391718 28889 tablet_replica.cc:333] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472: stopping tablet replica
W20260709 13:12:23.392186  2236 consensus_peers.cc:597] T 0668be6a554b4c5f8bf93d0588a6bfcc P 79b6e57d59e4468ebe4423d871a31b39 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:23.392570 28889 raft_consensus.cc:2243] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:12:23.393504 28889 raft_consensus.cc:2272] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:23.394541  2162 consensus_peers.cc:597] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 0ec6a5d1452a41bd992a8c7922473b35 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:23.395927 28889 tablet_replica.cc:333] T d4e943e5bbd7402da6bcc00db70cec14 P 2ac5c5682f914ed9b9982b5a080d5472: stopping tablet replica
I20260709 13:12:23.396775 28889 raft_consensus.cc:2243] T d4e943e5bbd7402da6bcc00db70cec14 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:23.397289 28889 raft_consensus.cc:2272] T d4e943e5bbd7402da6bcc00db70cec14 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:23.399561 28889 tablet_replica.cc:333] T 6bf4f728eedf41bdb027f554c3a5ae1f P 2ac5c5682f914ed9b9982b5a080d5472: stopping tablet replica
I20260709 13:12:23.400381 28889 raft_consensus.cc:2243] T 6bf4f728eedf41bdb027f554c3a5ae1f P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:23.400895 28889 raft_consensus.cc:2272] T 6bf4f728eedf41bdb027f554c3a5ae1f P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:23.403280 28889 tablet_replica.cc:333] T 7e3782f3d54b4a19bacbd125c31127a9 P 2ac5c5682f914ed9b9982b5a080d5472: stopping tablet replica
I20260709 13:12:23.403993 28889 raft_consensus.cc:2243] T 7e3782f3d54b4a19bacbd125c31127a9 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:23.404485 28889 raft_consensus.cc:2272] T 7e3782f3d54b4a19bacbd125c31127a9 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:23.406929 28889 tablet_replica.cc:333] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472: stopping tablet replica
I20260709 13:12:23.407642 28889 raft_consensus.cc:2243] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:23.408159 28889 raft_consensus.cc:2272] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:23.408581  2236 consensus_peers.cc:597] T b206de895e36490688cb2c1c537774a5 P 79b6e57d59e4468ebe4423d871a31b39 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:23.408980  2310 consensus_peers.cc:597] T a9be6d55d1f348bcaf96405abc80244d P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:23.410552 28889 tablet_replica.cc:333] T 28f2272230d34efa880d5eeed8859669 P 2ac5c5682f914ed9b9982b5a080d5472: stopping tablet replica
I20260709 13:12:23.411351 28889 raft_consensus.cc:2243] T 28f2272230d34efa880d5eeed8859669 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:23.411954 28889 raft_consensus.cc:2272] T 28f2272230d34efa880d5eeed8859669 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:23.412770  2162 consensus_peers.cc:597] T 46887c40373b4aca811c6382c97cb9bf P 0ec6a5d1452a41bd992a8c7922473b35 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:23.414022 28889 tablet_replica.cc:333] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472: stopping tablet replica
I20260709 13:12:23.414635 28889 raft_consensus.cc:2243] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:23.415068 28889 raft_consensus.cc:2272] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:23.417124 28889 tablet_replica.cc:333] T cc02522cf9704f58a9d2bfd5326e3625 P 2ac5c5682f914ed9b9982b5a080d5472: stopping tablet replica
I20260709 13:12:23.417639 28889 raft_consensus.cc:2243] T cc02522cf9704f58a9d2bfd5326e3625 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:23.418581 28889 raft_consensus.cc:2272] T cc02522cf9704f58a9d2bfd5326e3625 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:23.421064 28889 tablet_replica.cc:333] T d1ddcfd4d0914e40ae0a684fd8726d24 P 2ac5c5682f914ed9b9982b5a080d5472: stopping tablet replica
I20260709 13:12:23.421768 28889 raft_consensus.cc:2243] T d1ddcfd4d0914e40ae0a684fd8726d24 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:23.422284 28889 raft_consensus.cc:2272] T d1ddcfd4d0914e40ae0a684fd8726d24 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:23.424173 28889 tablet_replica.cc:333] T 7475d672f7b3489393d6202c8b31e47f P 2ac5c5682f914ed9b9982b5a080d5472: stopping tablet replica
I20260709 13:12:23.424680 28889 raft_consensus.cc:2243] T 7475d672f7b3489393d6202c8b31e47f P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:23.425077 28889 raft_consensus.cc:2272] T 7475d672f7b3489393d6202c8b31e47f P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:23.426863 28889 tablet_replica.cc:333] T 78734884e0a441759b51d258ad2697aa P 2ac5c5682f914ed9b9982b5a080d5472: stopping tablet replica
I20260709 13:12:23.427332 28889 raft_consensus.cc:2243] T 78734884e0a441759b51d258ad2697aa P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:23.427681 28889 raft_consensus.cc:2272] T 78734884e0a441759b51d258ad2697aa P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:23.429487 28889 tablet_replica.cc:333] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472: stopping tablet replica
I20260709 13:12:23.430007 28889 raft_consensus.cc:2243] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:23.430845 28889 raft_consensus.cc:2272] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:23.433032 28889 tablet_replica.cc:333] T ddf48e4f6be64627a0ed06d6198ca054 P 2ac5c5682f914ed9b9982b5a080d5472: stopping tablet replica
I20260709 13:12:23.433665 28889 raft_consensus.cc:2243] T ddf48e4f6be64627a0ed06d6198ca054 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:23.434139 28889 raft_consensus.cc:2272] T ddf48e4f6be64627a0ed06d6198ca054 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:23.436249 28889 tablet_replica.cc:333] T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472: stopping tablet replica
I20260709 13:12:23.436791 28889 raft_consensus.cc:2243] T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:23.437171 28889 raft_consensus.cc:2272] T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:23.438861 28889 tablet_replica.cc:333] T 0668be6a554b4c5f8bf93d0588a6bfcc P 2ac5c5682f914ed9b9982b5a080d5472: stopping tablet replica
I20260709 13:12:23.439303 28889 raft_consensus.cc:2243] T 0668be6a554b4c5f8bf93d0588a6bfcc P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:23.439675 28889 raft_consensus.cc:2272] T 0668be6a554b4c5f8bf93d0588a6bfcc P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:23.441519 28889 tablet_replica.cc:333] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472: stopping tablet replica
I20260709 13:12:23.442092 28889 raft_consensus.cc:2243] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:23.442991 28889 raft_consensus.cc:2272] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:23.445235 28889 tablet_replica.cc:333] T ee1baa7401cd48e48e7125dcd607f44f P 2ac5c5682f914ed9b9982b5a080d5472: stopping tablet replica
I20260709 13:12:23.445746 28889 raft_consensus.cc:2243] T ee1baa7401cd48e48e7125dcd607f44f P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:23.446156 28889 raft_consensus.cc:2272] T ee1baa7401cd48e48e7125dcd607f44f P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:23.447921 28889 tablet_replica.cc:333] T 427b10072083419c89d5a4bf5d6413fc P 2ac5c5682f914ed9b9982b5a080d5472: stopping tablet replica
I20260709 13:12:23.448447 28889 raft_consensus.cc:2243] T 427b10072083419c89d5a4bf5d6413fc P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:23.448835 28889 raft_consensus.cc:2272] T 427b10072083419c89d5a4bf5d6413fc P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:23.450757 28889 tablet_replica.cc:333] T d3370eb67fff4896b1f8e3ce56eceb9b P 2ac5c5682f914ed9b9982b5a080d5472: stopping tablet replica
I20260709 13:12:23.451326 28889 raft_consensus.cc:2243] T d3370eb67fff4896b1f8e3ce56eceb9b P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:23.451717 28889 raft_consensus.cc:2272] T d3370eb67fff4896b1f8e3ce56eceb9b P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:23.453838 28889 tablet_replica.cc:333] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472: stopping tablet replica
I20260709 13:12:23.454459 28889 raft_consensus.cc:2243] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:23.455345 28889 raft_consensus.cc:2272] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:23.457870 28889 tablet_replica.cc:333] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472: stopping tablet replica
I20260709 13:12:23.458487 28889 raft_consensus.cc:2243] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:23.458964 28889 raft_consensus.cc:2272] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:23.461231 28889 tablet_replica.cc:333] T 56bba8336a054d969e18859a84f180d6 P 2ac5c5682f914ed9b9982b5a080d5472: stopping tablet replica
I20260709 13:12:23.461669 28889 raft_consensus.cc:2243] T 56bba8336a054d969e18859a84f180d6 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:23.462427 28889 raft_consensus.cc:2272] T 56bba8336a054d969e18859a84f180d6 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:23.483999  2310 consensus_peers.cc:597] T 78734884e0a441759b51d258ad2697aa P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:23.522836  2310 consensus_peers.cc:597] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:23.531263 28889 tablet_server.cc:196] TabletServer@127.28.54.65:0 shutdown complete.
W20260709 13:12:23.536692  2310 consensus_peers.cc:597] T 6bf4f728eedf41bdb027f554c3a5ae1f P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:23.540846  2162 consensus_peers.cc:597] T d2f88787abb54ffea037f35cf48b22c4 P 0ec6a5d1452a41bd992a8c7922473b35 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:23.549180  2236 consensus_peers.cc:597] T 86834d94d1d64596abfa609754b5d58a P 79b6e57d59e4468ebe4423d871a31b39 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:23.549743  2236 consensus_peers.cc:597] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:23.568197  2310 consensus_peers.cc:597] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:23.576531  2162 consensus_peers.cc:597] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:23.615196 28889 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:23.623027  3082 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:23.625820  3083 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:23.625820  3085 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:23.627713 28889 server_base.cc:1061] running on GCE node
I20260709 13:12:23.632520 28889 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:23.632814 28889 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:23.633047 28889 hybrid_clock.cc:648] HybridClock initialized: now 1783602743633011 us; error 0 us; skew 500 ppm
I20260709 13:12:23.633741 28889 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260709 13:12:23.639503  2162 consensus_peers.cc:597] T 622b6cfd76ff495ea6692a1ec0faefc4 P 0ec6a5d1452a41bd992a8c7922473b35 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:23.645823 28889 webserver.cc:533] Webserver started at http://127.28.54.65:45623/ using document root <none> and password file <none>
I20260709 13:12:23.646544 28889 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:23.646786 28889 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:12:23.673882 28889 fs_manager.cc:714] Time spent opening directory manager: real 0.026s	user 0.016s	sys 0.012s
W20260709 13:12:23.679852  2162 consensus_peers.cc:597] T 7e3782f3d54b4a19bacbd125c31127a9 P 0ec6a5d1452a41bd992a8c7922473b35 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:23.683754  3092 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:23.684656 28889 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.005s	sys 0.000s
I20260709 13:12:23.685032 28889 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602558744475-28889-0/minicluster-data/ts-0-root
uuid: "2ac5c5682f914ed9b9982b5a080d5472"
format_stamp: "Formatted at 2026-07-09 13:12:06 on dist-test-slave-vpdx"
I20260709 13:12:23.685520 28889 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602558744475-28889-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602558744475-28889-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783602558744475-28889-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:23.704017 28889 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:23.705220 28889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:23.707557 28889 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:23.737483  3100 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
I20260709 13:12:24.029254 28889 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 13:12:24.029554 28889 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.293s	user 0.008s	sys 0.001s
I20260709 13:12:24.029863 28889 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 13:12:24.035225  3100 tablet_bootstrap.cc:492] T a4a5ce298d24406ea94fb68aba5b37ae P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:24.057050  3100 tablet_bootstrap.cc:492] T a4a5ce298d24406ea94fb68aba5b37ae P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:24.057982  3100 tablet_bootstrap.cc:492] T a4a5ce298d24406ea94fb68aba5b37ae P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap complete.
I20260709 13:12:24.058601  3100 ts_tablet_manager.cc:1403] T a4a5ce298d24406ea94fb68aba5b37ae P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.024s	user 0.014s	sys 0.008s
I20260709 13:12:24.060998  3100 raft_consensus.cc:359] T a4a5ce298d24406ea94fb68aba5b37ae P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:24.061628  3100 raft_consensus.cc:740] T a4a5ce298d24406ea94fb68aba5b37ae P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.062489  3100 consensus_queue.cc:260] T a4a5ce298d24406ea94fb68aba5b37ae P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:24.083695  3100 ts_tablet_manager.cc:1434] T a4a5ce298d24406ea94fb68aba5b37ae P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.025s	user 0.013s	sys 0.012s
I20260709 13:12:24.084504  3100 tablet_bootstrap.cc:492] T 622b6cfd76ff495ea6692a1ec0faefc4 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:24.105188  3100 tablet_bootstrap.cc:492] T 622b6cfd76ff495ea6692a1ec0faefc4 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:24.106106  3100 tablet_bootstrap.cc:492] T 622b6cfd76ff495ea6692a1ec0faefc4 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap complete.
I20260709 13:12:24.106730  3100 ts_tablet_manager.cc:1403] T 622b6cfd76ff495ea6692a1ec0faefc4 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.022s	user 0.020s	sys 0.000s
I20260709 13:12:24.108986  3100 raft_consensus.cc:359] T 622b6cfd76ff495ea6692a1ec0faefc4 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:24.109628  3100 raft_consensus.cc:740] T 622b6cfd76ff495ea6692a1ec0faefc4 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.110456  3100 consensus_queue.cc:260] T 622b6cfd76ff495ea6692a1ec0faefc4 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:24.112221  3100 ts_tablet_manager.cc:1434] T 622b6cfd76ff495ea6692a1ec0faefc4 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:12:24.112950  3100 tablet_bootstrap.cc:492] T ddf48e4f6be64627a0ed06d6198ca054 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:24.132952  3100 tablet_bootstrap.cc:492] T ddf48e4f6be64627a0ed06d6198ca054 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:24.133849  3100 tablet_bootstrap.cc:492] T ddf48e4f6be64627a0ed06d6198ca054 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap complete.
I20260709 13:12:24.134425  3100 ts_tablet_manager.cc:1403] T ddf48e4f6be64627a0ed06d6198ca054 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.022s	user 0.017s	sys 0.004s
I20260709 13:12:24.136726  3100 raft_consensus.cc:359] T ddf48e4f6be64627a0ed06d6198ca054 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:24.137342  3100 raft_consensus.cc:740] T ddf48e4f6be64627a0ed06d6198ca054 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.138222  3100 consensus_queue.cc:260] T ddf48e4f6be64627a0ed06d6198ca054 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:24.139983  3100 ts_tablet_manager.cc:1434] T ddf48e4f6be64627a0ed06d6198ca054 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:12:24.140720  3100 tablet_bootstrap.cc:492] T 5c3646d79bc840e9b4396f4351d1803d P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:24.182327  3100 tablet_bootstrap.cc:492] T 5c3646d79bc840e9b4396f4351d1803d P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:24.183295  3100 tablet_bootstrap.cc:492] T 5c3646d79bc840e9b4396f4351d1803d P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap complete.
I20260709 13:12:24.198264  3100 ts_tablet_manager.cc:1403] T 5c3646d79bc840e9b4396f4351d1803d P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.058s	user 0.027s	sys 0.016s
I20260709 13:12:24.200692  3100 raft_consensus.cc:359] T 5c3646d79bc840e9b4396f4351d1803d P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:24.201402  3100 raft_consensus.cc:740] T 5c3646d79bc840e9b4396f4351d1803d P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.202122  3100 consensus_queue.cc:260] T 5c3646d79bc840e9b4396f4351d1803d P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:24.204145  3100 ts_tablet_manager.cc:1434] T 5c3646d79bc840e9b4396f4351d1803d P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:12:24.204907  3100 tablet_bootstrap.cc:492] T 28f2272230d34efa880d5eeed8859669 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:24.269677  3100 tablet_bootstrap.cc:492] T 28f2272230d34efa880d5eeed8859669 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:24.270803  3100 tablet_bootstrap.cc:492] T 28f2272230d34efa880d5eeed8859669 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap complete.
I20260709 13:12:24.271395  3100 ts_tablet_manager.cc:1403] T 28f2272230d34efa880d5eeed8859669 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.067s	user 0.036s	sys 0.028s
I20260709 13:12:24.279201  3100 raft_consensus.cc:359] T 28f2272230d34efa880d5eeed8859669 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:24.279903  3100 raft_consensus.cc:740] T 28f2272230d34efa880d5eeed8859669 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.280612  3100 consensus_queue.cc:260] T 28f2272230d34efa880d5eeed8859669 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:24.282670  3100 ts_tablet_manager.cc:1434] T 28f2272230d34efa880d5eeed8859669 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:12:24.283432  3100 tablet_bootstrap.cc:492] T ee1baa7401cd48e48e7125dcd607f44f P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:24.297111  3100 tablet_bootstrap.cc:492] T ee1baa7401cd48e48e7125dcd607f44f P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:24.298084  3100 tablet_bootstrap.cc:492] T ee1baa7401cd48e48e7125dcd607f44f P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap complete.
I20260709 13:12:24.298666  3100 ts_tablet_manager.cc:1403] T ee1baa7401cd48e48e7125dcd607f44f P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.015s	user 0.006s	sys 0.008s
I20260709 13:12:24.300930  3100 raft_consensus.cc:359] T ee1baa7401cd48e48e7125dcd607f44f P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:24.301546  3100 raft_consensus.cc:740] T ee1baa7401cd48e48e7125dcd607f44f P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.302186  3100 consensus_queue.cc:260] T ee1baa7401cd48e48e7125dcd607f44f P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:24.304471  3100 ts_tablet_manager.cc:1434] T ee1baa7401cd48e48e7125dcd607f44f P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:12:24.305189  3100 tablet_bootstrap.cc:492] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:24.318781  3100 tablet_bootstrap.cc:492] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:24.319598  3100 tablet_bootstrap.cc:492] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap complete.
I20260709 13:12:24.320159  3100 ts_tablet_manager.cc:1403] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 13:12:24.322373  3100 raft_consensus.cc:359] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:24.322989  3100 raft_consensus.cc:740] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.323570  3100 consensus_queue.cc:260] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:24.325519  3100 ts_tablet_manager.cc:1434] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:12:24.326234  3100 tablet_bootstrap.cc:492] T 427b10072083419c89d5a4bf5d6413fc P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:24.354355  3100 tablet_bootstrap.cc:492] T 427b10072083419c89d5a4bf5d6413fc P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:24.355257  3100 tablet_bootstrap.cc:492] T 427b10072083419c89d5a4bf5d6413fc P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap complete.
I20260709 13:12:24.355867  3100 ts_tablet_manager.cc:1403] T 427b10072083419c89d5a4bf5d6413fc P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.030s	user 0.019s	sys 0.008s
I20260709 13:12:24.358201  3100 raft_consensus.cc:359] T 427b10072083419c89d5a4bf5d6413fc P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:24.358837  3100 raft_consensus.cc:740] T 427b10072083419c89d5a4bf5d6413fc P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.359485  3100 consensus_queue.cc:260] T 427b10072083419c89d5a4bf5d6413fc P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:24.361279  3100 ts_tablet_manager.cc:1434] T 427b10072083419c89d5a4bf5d6413fc P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:12:24.362012  3100 tablet_bootstrap.cc:492] T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:24.364593  3088 raft_consensus.cc:493] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:24.365123  3088 raft_consensus.cc:515] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:24.365466 28889 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 13:12:24.365871 28889 ts_tablet_manager.cc:595] Time spent register tablets: real 0.336s	user 0.215s	sys 0.000s
I20260709 13:12:24.367153  3088 leader_election.cc:290] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:24.370908  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0fb3f7bf85419cbf7ecda4727ccb89" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:24.388077  3102 raft_consensus.cc:493] T a332070dcdff450b939e74ef5b68425a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
W20260709 13:12:24.389081  2162 leader_election.cc:336] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111)
I20260709 13:12:24.401574  3102 raft_consensus.cc:515] T a332070dcdff450b939e74ef5b68425a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:24.402041  2162 leader_election.cc:304] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:24.402777  3088 raft_consensus.cc:2749] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 13:12:24.387600  3100 tablet_bootstrap.cc:492] T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:24.409291  2193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a332070dcdff450b939e74ef5b68425a" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:24.409446  3102 leader_election.cc:290] T a332070dcdff450b939e74ef5b68425a P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:24.412601  3100 tablet_bootstrap.cc:492] T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap complete.
I20260709 13:12:24.415906  3100 ts_tablet_manager.cc:1403] T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.054s	user 0.019s	sys 0.008s
W20260709 13:12:24.415081  2310 leader_election.cc:336] T a332070dcdff450b939e74ef5b68425a P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111)
I20260709 13:12:24.416888  2310 leader_election.cc:304] T a332070dcdff450b939e74ef5b68425a P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:24.419013  3103 raft_consensus.cc:2749] T a332070dcdff450b939e74ef5b68425a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:24.422948  3100 raft_consensus.cc:359] T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:24.423635  3100 raft_consensus.cc:740] T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.424294  3100 consensus_queue.cc:260] T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:24.425639  3100 ts_tablet_manager.cc:1434] T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.000s
I20260709 13:12:24.426362  3100 tablet_bootstrap.cc:492] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:24.430296  3097 raft_consensus.cc:493] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:24.430846  3097 raft_consensus.cc:515] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:24.432914  3097 leader_election.cc:290] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:24.435298  2193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0fb3f7bf85419cbf7ecda4727ccb89" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:24.435902  2193 raft_consensus.cc:2468] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 4.
I20260709 13:12:24.436952  2237 leader_election.cc:304] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:24.437768  3073 raft_consensus.cc:493] T cc02522cf9704f58a9d2bfd5326e3625 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:24.438202  3073 raft_consensus.cc:515] T cc02522cf9704f58a9d2bfd5326e3625 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:24.440188  3073 leader_election.cc:290] T cc02522cf9704f58a9d2bfd5326e3625 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:24.440673  3073 raft_consensus.cc:2804] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 13:12:24.440968  3073 raft_consensus.cc:493] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:24.441287  3073 raft_consensus.cc:3060] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:24.443488  2916 raft_consensus.cc:493] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:24.443979  2916 raft_consensus.cc:515] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:24.445827  2916 leader_election.cc:290] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:24.448719  2189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc02522cf9704f58a9d2bfd5326e3625" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:24.449898  2193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67db2f978ea64fbd9a32274d4ad374c9" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
W20260709 13:12:24.455142  2236 leader_election.cc:336] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111)
I20260709 13:12:24.458236  3073 raft_consensus.cc:515] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:24.462692  2193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a0fb3f7bf85419cbf7ecda4727ccb89" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:24.462837  3073 leader_election.cc:290] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 5 election: Requested vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:24.463250  2193 raft_consensus.cc:3060] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:24.463820  3073 raft_consensus.cc:493] T 5c3646d79bc840e9b4396f4351d1803d P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:24.464298  3073 raft_consensus.cc:515] T 5c3646d79bc840e9b4396f4351d1803d P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:24.468550  3073 leader_election.cc:290] T 5c3646d79bc840e9b4396f4351d1803d P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:24.472203  2189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3646d79bc840e9b4396f4351d1803d" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:24.478647  3100 tablet_bootstrap.cc:492] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:24.479796  3100 tablet_bootstrap.cc:492] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap complete.
I20260709 13:12:24.481446  3100 ts_tablet_manager.cc:1403] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.055s	user 0.017s	sys 0.000s
W20260709 13:12:24.483723  2236 leader_election.cc:336] T cc02522cf9704f58a9d2bfd5326e3625 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111)
I20260709 13:12:24.484282  2236 leader_election.cc:304] T cc02522cf9704f58a9d2bfd5326e3625 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b6e57d59e4468ebe4423d871a31b39; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:24.484974  3073 raft_consensus.cc:2749] T cc02522cf9704f58a9d2bfd5326e3625 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:24.485790  3100 raft_consensus.cc:359] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
W20260709 13:12:24.486166  2236 leader_election.cc:336] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111)
I20260709 13:12:24.486508  3100 raft_consensus.cc:740] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.478564  2193 raft_consensus.cc:2468] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 5.
I20260709 13:12:24.488466  2237 leader_election.cc:304] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:24.488725  3102 raft_consensus.cc:493] T a4a5ce298d24406ea94fb68aba5b37ae P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:24.489295  3073 raft_consensus.cc:2804] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:24.489320  3102 raft_consensus.cc:515] T a4a5ce298d24406ea94fb68aba5b37ae P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:24.489923  3073 raft_consensus.cc:697] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [term 5 LEADER]: Becoming Leader. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Running, Role: LEADER
I20260709 13:12:24.491389  3073 consensus_queue.cc:237] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:24.488097  3100 consensus_queue.cc:260] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:24.496821  3100 ts_tablet_manager.cc:1434] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.003s
I20260709 13:12:24.497928  3100 tablet_bootstrap.cc:492] T 12b5593f051548fea374da76afa08c3f P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:24.498732  3102 leader_election.cc:290] T a4a5ce298d24406ea94fb68aba5b37ae P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:24.501060  2236 leader_election.cc:304] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b6e57d59e4468ebe4423d871a31b39; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:24.502435  3097 raft_consensus.cc:2749] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:24.503300  3097 raft_consensus.cc:493] T e1ad60fa3bce47daac74b01143b54132 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:24.503758  3097 raft_consensus.cc:515] T e1ad60fa3bce47daac74b01143b54132 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:24.506678  3097 leader_election.cc:290] T e1ad60fa3bce47daac74b01143b54132 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:24.507193  2189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ad60fa3bce47daac74b01143b54132" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:24.508811  2193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a5ce298d24406ea94fb68aba5b37ae" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
W20260709 13:12:24.514345  2236 leader_election.cc:336] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111)
I20260709 13:12:24.515779  3088 raft_consensus.cc:493] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:24.517163  3088 raft_consensus.cc:515] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:24.518608  3070 raft_consensus.cc:493] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:24.519052  3088 leader_election.cc:290] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:24.519212  3070 raft_consensus.cc:515] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:24.519544  2018 catalog_manager.cc:5697] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 reported cstate change: term changed from 4 to 5, leader changed from 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65) to 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67). New cstate: current_term: 5 leader_uuid: "79b6e57d59e4468ebe4423d871a31b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:24.521381  3070 leader_election.cc:290] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
W20260709 13:12:24.516601  2310 leader_election.cc:336] T a4a5ce298d24406ea94fb68aba5b37ae P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111)
W20260709 13:12:24.522248  2236 leader_election.cc:336] T 5c3646d79bc840e9b4396f4351d1803d P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111)
I20260709 13:12:24.522843  2236 leader_election.cc:304] T 5c3646d79bc840e9b4396f4351d1803d P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b6e57d59e4468ebe4423d871a31b39; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:24.523308  2310 leader_election.cc:304] T a4a5ce298d24406ea94fb68aba5b37ae P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:24.523937  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc02522cf9704f58a9d2bfd5326e3625" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:24.524576  2263 raft_consensus.cc:2468] T cc02522cf9704f58a9d2bfd5326e3625 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 1.
I20260709 13:12:24.526245  2916 raft_consensus.cc:2749] T 5c3646d79bc840e9b4396f4351d1803d P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:24.527092  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ad60fa3bce47daac74b01143b54132" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
W20260709 13:12:24.527379  2236 leader_election.cc:336] T e1ad60fa3bce47daac74b01143b54132 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111)
I20260709 13:12:24.527889  2236 leader_election.cc:304] T e1ad60fa3bce47daac74b01143b54132 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b6e57d59e4468ebe4423d871a31b39; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:24.528800  2916 raft_consensus.cc:2749] T e1ad60fa3bce47daac74b01143b54132 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:24.524050  3102 raft_consensus.cc:2749] T a4a5ce298d24406ea94fb68aba5b37ae P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:24.527993  2162 leader_election.cc:336] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111)
I20260709 13:12:24.529894  2268 raft_consensus.cc:2468] T e1ad60fa3bce47daac74b01143b54132 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 2.
W20260709 13:12:24.530230  2162 leader_election.cc:336] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111)
I20260709 13:12:24.531328  2162 leader_election.cc:304] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39; no voters: 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:24.531976  3070 raft_consensus.cc:2804] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:24.532305  3070 raft_consensus.cc:493] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:24.532614  3070 raft_consensus.cc:3060] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:24.538380  2162 leader_election.cc:304] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39; no voters: 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:24.541167  3070 raft_consensus.cc:515] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:24.543279  3070 leader_election.cc:290] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 election: Requested vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:24.543889  3088 raft_consensus.cc:2804] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:24.544351  3088 raft_consensus.cc:493] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:24.544725  3088 raft_consensus.cc:3060] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:24.548915  3097 raft_consensus.cc:493] T 56bba8336a054d969e18859a84f180d6 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:24.549445  3097 raft_consensus.cc:515] T 56bba8336a054d969e18859a84f180d6 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:24.551819  3097 leader_election.cc:290] T 56bba8336a054d969e18859a84f180d6 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:24.554179  3088 raft_consensus.cc:515] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:24.556336  3088 leader_election.cc:290] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 3 election: Requested vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:24.560039  3100 tablet_bootstrap.cc:492] T 12b5593f051548fea374da76afa08c3f P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:24.560901  3100 tablet_bootstrap.cc:492] T 12b5593f051548fea374da76afa08c3f P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap complete.
I20260709 13:12:24.561728  2339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56bba8336a054d969e18859a84f180d6" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:24.562937  3100 ts_tablet_manager.cc:1403] T 12b5593f051548fea374da76afa08c3f P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.065s	user 0.011s	sys 0.005s
I20260709 13:12:24.566442  3100 raft_consensus.cc:359] T 12b5593f051548fea374da76afa08c3f P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:24.567304  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc02522cf9704f58a9d2bfd5326e3625" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:24.571247  2268 raft_consensus.cc:3060] T cc02522cf9704f58a9d2bfd5326e3625 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:24.567314  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ad60fa3bce47daac74b01143b54132" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:24.574374  2263 raft_consensus.cc:3060] T e1ad60fa3bce47daac74b01143b54132 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:24.578763  3070 raft_consensus.cc:493] T 5c3646d79bc840e9b4396f4351d1803d P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:24.579346  3070 raft_consensus.cc:515] T 5c3646d79bc840e9b4396f4351d1803d P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:24.581400  3070 leader_election.cc:290] T 5c3646d79bc840e9b4396f4351d1803d P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
W20260709 13:12:24.578096  2162 leader_election.cc:336] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111)
W20260709 13:12:24.583153  2162 leader_election.cc:336] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111)
I20260709 13:12:24.583295  2263 raft_consensus.cc:2468] T e1ad60fa3bce47daac74b01143b54132 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 3.
I20260709 13:12:24.585098  2268 raft_consensus.cc:2468] T cc02522cf9704f58a9d2bfd5326e3625 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 2.
I20260709 13:12:24.586655  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3646d79bc840e9b4396f4351d1803d" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:24.587213  2263 raft_consensus.cc:2468] T 5c3646d79bc840e9b4396f4351d1803d P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 1.
W20260709 13:12:24.569684  2236 leader_election.cc:336] T 56bba8336a054d969e18859a84f180d6 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111)
I20260709 13:12:24.588338  2236 leader_election.cc:304] T 56bba8336a054d969e18859a84f180d6 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b6e57d59e4468ebe4423d871a31b39; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea
I20260709 13:12:24.588405  2162 leader_election.cc:304] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39; no voters: 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:24.589932  3100 raft_consensus.cc:740] T 12b5593f051548fea374da76afa08c3f P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.589824  3097 raft_consensus.cc:2749] T 56bba8336a054d969e18859a84f180d6 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:24.594375  2162 leader_election.cc:304] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39; no voters: 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:24.594553  3100 consensus_queue.cc:260] T 12b5593f051548fea374da76afa08c3f P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:24.595280  3087 raft_consensus.cc:2804] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:24.595790  3087 raft_consensus.cc:697] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 LEADER]: Becoming Leader. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Running, Role: LEADER
I20260709 13:12:24.596745  3100 ts_tablet_manager.cc:1434] T 12b5593f051548fea374da76afa08c3f P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.000s
I20260709 13:12:24.596661  3087 consensus_queue.cc:237] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:24.598001  3100 tablet_bootstrap.cc:492] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:24.603493  2162 leader_election.cc:304] T 5c3646d79bc840e9b4396f4351d1803d P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:24.594262  3088 raft_consensus.cc:2804] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:24.605655  3070 raft_consensus.cc:2804] T 5c3646d79bc840e9b4396f4351d1803d P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:24.606104  3070 raft_consensus.cc:493] T 5c3646d79bc840e9b4396f4351d1803d P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:24.606807  3070 raft_consensus.cc:3060] T 5c3646d79bc840e9b4396f4351d1803d P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:24.610921  2162 leader_election.cc:336] T 5c3646d79bc840e9b4396f4351d1803d P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111)
I20260709 13:12:24.625993  2018 catalog_manager.cc:5697] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35 reported cstate change: term changed from 1 to 2, leader changed from 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65) to 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66). New cstate: current_term: 2 leader_uuid: "0ec6a5d1452a41bd992a8c7922473b35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:24.626137  2973 raft_consensus.cc:493] T d0d102459578474fbe77af94f3986a84 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:24.633548  2973 raft_consensus.cc:515] T d0d102459578474fbe77af94f3986a84 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:24.635728  2973 leader_election.cc:290] T d0d102459578474fbe77af94f3986a84 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:24.621686  3088 raft_consensus.cc:697] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 LEADER]: Becoming Leader. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Running, Role: LEADER
I20260709 13:12:24.637144  3088 consensus_queue.cc:237] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:24.646266  2973 raft_consensus.cc:493] T a332070dcdff450b939e74ef5b68425a P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:24.646895  2973 raft_consensus.cc:515] T a332070dcdff450b939e74ef5b68425a P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:24.647593  3070 raft_consensus.cc:515] T 5c3646d79bc840e9b4396f4351d1803d P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:24.650270  3070 leader_election.cc:290] T 5c3646d79bc840e9b4396f4351d1803d P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 election: Requested vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:24.650851  2973 leader_election.cc:290] T a332070dcdff450b939e74ef5b68425a P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:24.663645  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d102459578474fbe77af94f3986a84" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:24.667739  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3646d79bc840e9b4396f4351d1803d" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:24.668367  2263 raft_consensus.cc:3060] T 5c3646d79bc840e9b4396f4351d1803d P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:24.670050  3087 raft_consensus.cc:493] T a4a5ce298d24406ea94fb68aba5b37ae P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:24.671533  3087 raft_consensus.cc:515] T a4a5ce298d24406ea94fb68aba5b37ae P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:24.675634  2263 raft_consensus.cc:2468] T 5c3646d79bc840e9b4396f4351d1803d P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 2.
I20260709 13:12:24.676770  3073 raft_consensus.cc:493] T 2e178ff57d964223aca095ceff76b339 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:24.677348  3073 raft_consensus.cc:515] T 2e178ff57d964223aca095ceff76b339 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:24.683161  3073 leader_election.cc:290] T 2e178ff57d964223aca095ceff76b339 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:24.683414  3102 raft_consensus.cc:493] T 56bba8336a054d969e18859a84f180d6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:24.683941  3102 raft_consensus.cc:515] T 56bba8336a054d969e18859a84f180d6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:24.684746  2339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e178ff57d964223aca095ceff76b339" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:24.686138  3102 leader_election.cc:290] T 56bba8336a054d969e18859a84f180d6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
W20260709 13:12:24.693395  2310 leader_election.cc:336] T 56bba8336a054d969e18859a84f180d6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111)
I20260709 13:12:24.695283  2339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a332070dcdff450b939e74ef5b68425a" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:24.696270  2339 raft_consensus.cc:2468] T a332070dcdff450b939e74ef5b68425a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 1.
I20260709 13:12:24.700179  3087 leader_election.cc:290] T a4a5ce298d24406ea94fb68aba5b37ae P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:24.704469  2973 raft_consensus.cc:493] T d7a50365dcc843f4a4f6bfb29a736f26 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:24.712359  2973 raft_consensus.cc:515] T d7a50365dcc843f4a4f6bfb29a736f26 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:24.714447  2018 catalog_manager.cc:5697] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35 reported cstate change: term changed from 2 to 3, leader changed from 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65) to 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66). New cstate: current_term: 3 leader_uuid: "0ec6a5d1452a41bd992a8c7922473b35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:24.709270  2236 leader_election.cc:336] T 2e178ff57d964223aca095ceff76b339 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111)
I20260709 13:12:24.715847  2236 leader_election.cc:304] T 2e178ff57d964223aca095ceff76b339 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b6e57d59e4468ebe4423d871a31b39; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea
I20260709 13:12:24.718432  3073 raft_consensus.cc:2749] T 2e178ff57d964223aca095ceff76b339 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:24.714480  2973 leader_election.cc:290] T d7a50365dcc843f4a4f6bfb29a736f26 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:24.719581  3102 raft_consensus.cc:493] T 10de08c2346d47dbbd720596cd7e02fd P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:24.720196  3102 raft_consensus.cc:515] T 10de08c2346d47dbbd720596cd7e02fd P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:24.722581  3102 leader_election.cc:290] T 10de08c2346d47dbbd720596cd7e02fd P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:24.723656  2193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10de08c2346d47dbbd720596cd7e02fd" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:24.724308  2193 raft_consensus.cc:2468] T 10de08c2346d47dbbd720596cd7e02fd P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 1.
I20260709 13:12:24.725531  2311 leader_election.cc:304] T 10de08c2346d47dbbd720596cd7e02fd P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:24.725930  3136 raft_consensus.cc:493] T 67db2f978ea64fbd9a32274d4ad374c9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:24.726377  3102 raft_consensus.cc:2804] T 10de08c2346d47dbbd720596cd7e02fd P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:24.726877  3102 raft_consensus.cc:493] T 10de08c2346d47dbbd720596cd7e02fd P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:24.727326  3102 raft_consensus.cc:3060] T 10de08c2346d47dbbd720596cd7e02fd P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:24.726544  3136 raft_consensus.cc:515] T 67db2f978ea64fbd9a32274d4ad374c9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:24.731454  3136 leader_election.cc:290] T 67db2f978ea64fbd9a32274d4ad374c9 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:24.735617  3102 raft_consensus.cc:515] T 10de08c2346d47dbbd720596cd7e02fd P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:24.716612  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56bba8336a054d969e18859a84f180d6" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:24.738534  2263 raft_consensus.cc:2468] T 56bba8336a054d969e18859a84f180d6 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 1.
I20260709 13:12:24.738634  3100 tablet_bootstrap.cc:492] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:24.739674  3100 tablet_bootstrap.cc:492] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap complete.
I20260709 13:12:24.740334  3100 ts_tablet_manager.cc:1403] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.143s	user 0.050s	sys 0.058s
I20260709 13:12:24.742846  2193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "10de08c2346d47dbbd720596cd7e02fd" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:24.743424  2193 raft_consensus.cc:3060] T 10de08c2346d47dbbd720596cd7e02fd P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:24.747116  2310 leader_election.cc:304] T 56bba8336a054d969e18859a84f180d6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39; no voters: 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:24.747872  3103 raft_consensus.cc:2804] T 56bba8336a054d969e18859a84f180d6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:12:24.748147  2310 leader_election.cc:336] T 10de08c2346d47dbbd720596cd7e02fd P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111)
I20260709 13:12:24.748242  3103 raft_consensus.cc:493] T 56bba8336a054d969e18859a84f180d6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:24.748664  3103 raft_consensus.cc:3060] T 56bba8336a054d969e18859a84f180d6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:24.749091  2162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:38869, user_credentials={real_user=slave}} blocked reactor thread for 43791us
I20260709 13:12:24.749835  2162 leader_election.cc:304] T a332070dcdff450b939e74ef5b68425a P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:24.750869  3087 raft_consensus.cc:2804] T a332070dcdff450b939e74ef5b68425a P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:24.751204  3087 raft_consensus.cc:493] T a332070dcdff450b939e74ef5b68425a P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:24.751535  3087 raft_consensus.cc:3060] T a332070dcdff450b939e74ef5b68425a P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:24.753543  3100 raft_consensus.cc:359] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:24.754289  3100 raft_consensus.cc:740] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.755012  3100 consensus_queue.cc:260] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:24.751530  2162 leader_election.cc:304] T 5c3646d79bc840e9b4396f4351d1803d P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:24.756956  3136 raft_consensus.cc:2804] T 5c3646d79bc840e9b4396f4351d1803d P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:24.757123  3100 ts_tablet_manager.cc:1434] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:12:24.757449  3136 raft_consensus.cc:697] T 5c3646d79bc840e9b4396f4351d1803d P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 LEADER]: Becoming Leader. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Running, Role: LEADER
I20260709 13:12:24.758270  3136 consensus_queue.cc:237] T 5c3646d79bc840e9b4396f4351d1803d P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:24.762652  3100 tablet_bootstrap.cc:492] T d1ddcfd4d0914e40ae0a684fd8726d24 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:24.763588  3103 raft_consensus.cc:515] T 56bba8336a054d969e18859a84f180d6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:24.765296  3073 raft_consensus.cc:493] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:24.765810  3073 raft_consensus.cc:515] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:24.767745  3073 leader_election.cc:290] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:24.770041  2193 raft_consensus.cc:2468] T 10de08c2346d47dbbd720596cd7e02fd P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 2.
I20260709 13:12:24.771090  2311 leader_election.cc:304] T 10de08c2346d47dbbd720596cd7e02fd P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:24.772253  3101 raft_consensus.cc:2804] T 10de08c2346d47dbbd720596cd7e02fd P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:24.772691  3101 raft_consensus.cc:697] T 10de08c2346d47dbbd720596cd7e02fd P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 LEADER]: Becoming Leader. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Running, Role: LEADER
I20260709 13:12:24.773455  3101 consensus_queue.cc:237] T 10de08c2346d47dbbd720596cd7e02fd P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
W20260709 13:12:24.773962  2310 leader_election.cc:336] T 10de08c2346d47dbbd720596cd7e02fd P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111)
I20260709 13:12:24.779016  2339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a5ce298d24406ea94fb68aba5b37ae" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:24.779655  2339 raft_consensus.cc:2468] T a4a5ce298d24406ea94fb68aba5b37ae P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 1.
I20260709 13:12:24.780475  3073 raft_consensus.cc:493] T e259bf23e7904d9fb8b2345bb5b667f3 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:24.781076  3073 raft_consensus.cc:515] T e259bf23e7904d9fb8b2345bb5b667f3 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:24.783603  3073 leader_election.cc:290] T e259bf23e7904d9fb8b2345bb5b667f3 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:24.792778  3102 leader_election.cc:290] T 10de08c2346d47dbbd720596cd7e02fd P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 election: Requested vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:24.796298  3103 leader_election.cc:290] T 56bba8336a054d969e18859a84f180d6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 election: Requested vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:24.800529  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67db2f978ea64fbd9a32274d4ad374c9" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:24.801225  2263 raft_consensus.cc:2468] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 2.
I20260709 13:12:24.802320  3087 raft_consensus.cc:515] T a332070dcdff450b939e74ef5b68425a P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:24.804283  3087 leader_election.cc:290] T a332070dcdff450b939e74ef5b68425a P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 election: Requested vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
W20260709 13:12:24.806509  2162 leader_election.cc:336] T d0d102459578474fbe77af94f3986a84 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111)
I20260709 13:12:24.806941  2162 leader_election.cc:304] T d0d102459578474fbe77af94f3986a84 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39
W20260709 13:12:24.807134  2236 leader_election.cc:336] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111)
I20260709 13:12:24.807835  3073 raft_consensus.cc:493] T d0d102459578474fbe77af94f3986a84 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:24.813310  3073 raft_consensus.cc:515] T d0d102459578474fbe77af94f3986a84 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:24.815335  3073 leader_election.cc:290] T d0d102459578474fbe77af94f3986a84 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
W20260709 13:12:24.809343  2162 leader_election.cc:336] T 5c3646d79bc840e9b4396f4351d1803d P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111)
W20260709 13:12:24.816602  2162 leader_election.cc:336] T a332070dcdff450b939e74ef5b68425a P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111)
I20260709 13:12:24.822219  2018 catalog_manager.cc:5697] T 10de08c2346d47dbbd720596cd7e02fd P 66e9a8fffd4b4e5a81ca4fa2762773ea reported cstate change: term changed from 1 to 2, leader changed from 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65) to 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68). New cstate: current_term: 2 leader_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:24.829213  2339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a332070dcdff450b939e74ef5b68425a" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:24.829879  2339 raft_consensus.cc:3060] T a332070dcdff450b939e74ef5b68425a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:24.809828  3087 raft_consensus.cc:2749] T d0d102459578474fbe77af94f3986a84 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:24.812322  2342 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a50365dcc843f4a4f6bfb29a736f26" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:24.840902  3087 raft_consensus.cc:493] T 0bd8fc2d57c14adeaeae16583eef7c84 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:24.842784  2339 raft_consensus.cc:2468] T a332070dcdff450b939e74ef5b68425a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 2.
I20260709 13:12:24.844202  3087 raft_consensus.cc:515] T 0bd8fc2d57c14adeaeae16583eef7c84 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
W20260709 13:12:24.850812  2310 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:34303, user_credentials={real_user=slave}} blocked reactor thread for 76101.3us
I20260709 13:12:24.850741  3087 leader_election.cc:290] T 0bd8fc2d57c14adeaeae16583eef7c84 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:24.853423  2162 leader_election.cc:304] T 67db2f978ea64fbd9a32274d4ad374c9 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:24.856446  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56bba8336a054d969e18859a84f180d6" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:24.856037  2018 catalog_manager.cc:5697] T 5c3646d79bc840e9b4396f4351d1803d P 0ec6a5d1452a41bd992a8c7922473b35 reported cstate change: term changed from 1 to 2, leader changed from 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65) to 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66). New cstate: current_term: 2 leader_uuid: "0ec6a5d1452a41bd992a8c7922473b35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:24.857014  2263 raft_consensus.cc:3060] T 56bba8336a054d969e18859a84f180d6 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:24.857875  3140 raft_consensus.cc:2804] T 67db2f978ea64fbd9a32274d4ad374c9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:24.858279  3140 raft_consensus.cc:493] T 67db2f978ea64fbd9a32274d4ad374c9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:24.858642  3140 raft_consensus.cc:3060] T 67db2f978ea64fbd9a32274d4ad374c9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:24.863248  2263 raft_consensus.cc:2468] T 56bba8336a054d969e18859a84f180d6 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 2.
I20260709 13:12:24.869063  2310 leader_election.cc:304] T 56bba8336a054d969e18859a84f180d6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:24.869340  3140 raft_consensus.cc:515] T 67db2f978ea64fbd9a32274d4ad374c9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:24.870617  3142 raft_consensus.cc:2804] T 56bba8336a054d969e18859a84f180d6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:24.871078  3142 raft_consensus.cc:697] T 56bba8336a054d969e18859a84f180d6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 LEADER]: Becoming Leader. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Running, Role: LEADER
I20260709 13:12:24.871320  3140 leader_election.cc:290] T 67db2f978ea64fbd9a32274d4ad374c9 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 3 election: Requested vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:24.871811  3142 consensus_queue.cc:237] T 56bba8336a054d969e18859a84f180d6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:24.873152  2193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bd8fc2d57c14adeaeae16583eef7c84" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:24.873719  2193 raft_consensus.cc:2468] T 0bd8fc2d57c14adeaeae16583eef7c84 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 1.
I20260709 13:12:24.873814  2194 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d102459578474fbe77af94f3986a84" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:24.874478  2194 raft_consensus.cc:2468] T d0d102459578474fbe77af94f3986a84 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 1.
I20260709 13:12:24.874544  2189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e259bf23e7904d9fb8b2345bb5b667f3" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
W20260709 13:12:24.878093  2310 leader_election.cc:336] T 56bba8336a054d969e18859a84f180d6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111)
I20260709 13:12:24.878108  3101 raft_consensus.cc:493] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:24.878757  3101 raft_consensus.cc:515] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:24.880862  3101 leader_election.cc:290] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:24.881232  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e178ff57d964223aca095ceff76b339" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:24.881834  2268 raft_consensus.cc:2468] T 2e178ff57d964223aca095ceff76b339 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 2.
W20260709 13:12:24.882745  2236 leader_election.cc:336] T e259bf23e7904d9fb8b2345bb5b667f3 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111)
I20260709 13:12:24.886044  3140 raft_consensus.cc:493] T e259bf23e7904d9fb8b2345bb5b667f3 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:24.886622  3140 raft_consensus.cc:515] T e259bf23e7904d9fb8b2345bb5b667f3 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:24.887712  2162 leader_election.cc:304] T a4a5ce298d24406ea94fb68aba5b37ae P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:24.888458  3136 raft_consensus.cc:2804] T a4a5ce298d24406ea94fb68aba5b37ae P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:24.888736  3140 leader_election.cc:290] T e259bf23e7904d9fb8b2345bb5b667f3 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:24.888912  3136 raft_consensus.cc:493] T a4a5ce298d24406ea94fb68aba5b37ae P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:24.889593  3136 raft_consensus.cc:3060] T a4a5ce298d24406ea94fb68aba5b37ae P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:24.892689  2236 leader_election.cc:336] T d0d102459578474fbe77af94f3986a84 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111)
I20260709 13:12:24.897080  3136 raft_consensus.cc:515] T a4a5ce298d24406ea94fb68aba5b37ae P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:24.899219  3136 leader_election.cc:290] T a4a5ce298d24406ea94fb68aba5b37ae P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 election: Requested vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:24.899794  3100 tablet_bootstrap.cc:492] T d1ddcfd4d0914e40ae0a684fd8726d24 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:24.900732  3100 tablet_bootstrap.cc:492] T d1ddcfd4d0914e40ae0a684fd8726d24 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap complete.
I20260709 13:12:24.901345  3100 ts_tablet_manager.cc:1403] T d1ddcfd4d0914e40ae0a684fd8726d24 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.139s	user 0.024s	sys 0.006s
I20260709 13:12:24.901788  2310 leader_election.cc:304] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
W20260709 13:12:24.902573  2310 leader_election.cc:336] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111)
I20260709 13:12:24.903620  3142 raft_consensus.cc:2804] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:24.904052  3142 raft_consensus.cc:493] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:24.903795  3100 raft_consensus.cc:359] T d1ddcfd4d0914e40ae0a684fd8726d24 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:24.904461  3142 raft_consensus.cc:3060] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:24.904542  3100 raft_consensus.cc:740] T d1ddcfd4d0914e40ae0a684fd8726d24 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:24.905299  3100 consensus_queue.cc:260] T d1ddcfd4d0914e40ae0a684fd8726d24 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
W20260709 13:12:24.936362  2162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:38869, user_credentials={real_user=slave}} blocked reactor thread for 46370.6us
I20260709 13:12:24.938822  2162 leader_election.cc:304] T a332070dcdff450b939e74ef5b68425a P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:24.959048  3100 ts_tablet_manager.cc:1434] T d1ddcfd4d0914e40ae0a684fd8726d24 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.057s	user 0.005s	sys 0.005s
W20260709 13:12:24.966837  2162 leader_election.cc:336] T a4a5ce298d24406ea94fb68aba5b37ae P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111)
I20260709 13:12:24.967484  3100 tablet_bootstrap.cc:492] T 7475d672f7b3489393d6202c8b31e47f P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
W20260709 13:12:24.969170  2162 leader_election.cc:336] T d7a50365dcc843f4a4f6bfb29a736f26 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111)
I20260709 13:12:24.969774  2162 leader_election.cc:304] T d7a50365dcc843f4a4f6bfb29a736f26 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea
I20260709 13:12:24.973711  2973 raft_consensus.cc:2804] T a332070dcdff450b939e74ef5b68425a P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:24.978523  2973 raft_consensus.cc:697] T a332070dcdff450b939e74ef5b68425a P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 LEADER]: Becoming Leader. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Running, Role: LEADER
I20260709 13:12:24.982312  3103 raft_consensus.cc:493] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:24.983456  3103 raft_consensus.cc:515] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
W20260709 13:12:24.985332  2162 leader_election.cc:336] T 67db2f978ea64fbd9a32274d4ad374c9 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111)
I20260709 13:12:24.991883  3070 raft_consensus.cc:2749] T d7a50365dcc843f4a4f6bfb29a736f26 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:24.981079  2973 consensus_queue.cc:237] T a332070dcdff450b939e74ef5b68425a P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:25.013299  3103 leader_election.cc:290] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:25.024044  2189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a50365dcc843f4a4f6bfb29a736f26" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:25.024999  2189 raft_consensus.cc:2468] T d7a50365dcc843f4a4f6bfb29a736f26 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 1.
W20260709 13:12:25.033629  2310 leader_election.cc:336] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111)
I20260709 13:12:25.039810  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67db2f978ea64fbd9a32274d4ad374c9" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:25.040679  2263 raft_consensus.cc:3060] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:25.043346  2311 leader_election.cc:304] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:25.044917  3146 raft_consensus.cc:2804] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:25.045540  3146 raft_consensus.cc:493] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:25.046095  3146 raft_consensus.cc:3060] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:25.040807  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e259bf23e7904d9fb8b2345bb5b667f3" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:25.048316  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bd8fc2d57c14adeaeae16583eef7c84" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:25.048885  2268 raft_consensus.cc:2468] T e259bf23e7904d9fb8b2345bb5b667f3 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 2.
I20260709 13:12:25.049285  2271 raft_consensus.cc:2468] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 1.
W20260709 13:12:25.056665  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.68:38869, user_credentials={real_user=slave}} blocked reactor thread for 65371.5us
I20260709 13:12:25.065629  2018 catalog_manager.cc:5697] T 56bba8336a054d969e18859a84f180d6 P 66e9a8fffd4b4e5a81ca4fa2762773ea reported cstate change: term changed from 1 to 2, leader changed from 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65) to 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68). New cstate: current_term: 2 leader_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:25.067797  2339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a5ce298d24406ea94fb68aba5b37ae" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:25.068727  2339 raft_consensus.cc:3060] T a4a5ce298d24406ea94fb68aba5b37ae P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:25.093197  2237 leader_election.cc:304] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39; no voters: 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:25.106585  2237 leader_election.cc:304] T d0d102459578474fbe77af94f3986a84 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39; no voters: 2ac5c5682f914ed9b9982b5a080d5472
W20260709 13:12:25.107234  2162 leader_election.cc:336] T a332070dcdff450b939e74ef5b68425a P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111)
I20260709 13:12:25.108361  2237 leader_election.cc:304] T e259bf23e7904d9fb8b2345bb5b667f3 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b6e57d59e4468ebe4423d871a31b39; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:25.111490  3073 raft_consensus.cc:2804] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:25.111891  3073 raft_consensus.cc:493] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:25.112270  3073 raft_consensus.cc:3060] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:25.114097  3151 raft_consensus.cc:2804] T d0d102459578474fbe77af94f3986a84 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:25.114504  3151 raft_consensus.cc:493] T d0d102459578474fbe77af94f3986a84 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:25.114835  3151 raft_consensus.cc:3060] T d0d102459578474fbe77af94f3986a84 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:25.118376  2916 raft_consensus.cc:2749] T e259bf23e7904d9fb8b2345bb5b667f3 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:25.093672  3142 raft_consensus.cc:515] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:25.122879  2020 catalog_manager.cc:5697] T a332070dcdff450b939e74ef5b68425a P 0ec6a5d1452a41bd992a8c7922473b35 reported cstate change: term changed from 1 to 2, leader changed from 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65) to 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66). New cstate: current_term: 2 leader_uuid: "0ec6a5d1452a41bd992a8c7922473b35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:25.124251  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e178ff57d964223aca095ceff76b339" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:25.125658  2271 raft_consensus.cc:3060] T 2e178ff57d964223aca095ceff76b339 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:25.125027  3142 leader_election.cc:290] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 3 election: Requested vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
W20260709 13:12:25.136992  2310 leader_election.cc:336] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111)
I20260709 13:12:25.139199  2339 raft_consensus.cc:2468] T a4a5ce298d24406ea94fb68aba5b37ae P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 2.
I20260709 13:12:25.150063  3073 raft_consensus.cc:515] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
W20260709 13:12:25.153488  2237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.66:38859, user_credentials={real_user=slave}} blocked reactor thread for 45310.4us
I20260709 13:12:25.153723  2263 raft_consensus.cc:2468] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 3.
I20260709 13:12:25.145612  3146 raft_consensus.cc:515] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:25.167132  2271 raft_consensus.cc:2468] T 2e178ff57d964223aca095ceff76b339 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 3.
I20260709 13:12:25.175630  2271 raft_consensus.cc:1275] T cc02522cf9704f58a9d2bfd5326e3625 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Refusing update from remote peer 0ec6a5d1452a41bd992a8c7922473b35: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:25.176550  2162 leader_election.cc:304] T a4a5ce298d24406ea94fb68aba5b37ae P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:25.177747  3087 raft_consensus.cc:2804] T a4a5ce298d24406ea94fb68aba5b37ae P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:25.178289  3087 raft_consensus.cc:697] T a4a5ce298d24406ea94fb68aba5b37ae P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 LEADER]: Becoming Leader. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Running, Role: LEADER
I20260709 13:12:25.179337  3087 consensus_queue.cc:237] T a4a5ce298d24406ea94fb68aba5b37ae P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:25.180337  3100 tablet_bootstrap.cc:492] T 7475d672f7b3489393d6202c8b31e47f P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:25.181483  3100 tablet_bootstrap.cc:492] T 7475d672f7b3489393d6202c8b31e47f P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap complete.
I20260709 13:12:25.181847  2310 leader_election.cc:304] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39; no voters: 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:25.186223  3100 ts_tablet_manager.cc:1403] T 7475d672f7b3489393d6202c8b31e47f P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.219s	user 0.023s	sys 0.017s
I20260709 13:12:25.190704  3105 raft_consensus.cc:493] T a4a5ce298d24406ea94fb68aba5b37ae P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.189627  3146 leader_election.cc:290] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 election: Requested vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:25.191239  3105 raft_consensus.cc:515] T a4a5ce298d24406ea94fb68aba5b37ae P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:25.185170  3142 raft_consensus.cc:2804] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:25.192351  3142 raft_consensus.cc:697] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 LEADER]: Becoming Leader. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Running, Role: LEADER
I20260709 13:12:25.193410  3142 consensus_queue.cc:237] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
W20260709 13:12:25.201027  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:36557, user_credentials={real_user=slave}} blocked reactor thread for 45469.4us
I20260709 13:12:25.201642  3151 raft_consensus.cc:515] T d0d102459578474fbe77af94f3986a84 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:25.205999  3073 leader_election.cc:290] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 election: Requested vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:25.207501  3100 raft_consensus.cc:359] T 7475d672f7b3489393d6202c8b31e47f P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:25.208274  3100 raft_consensus.cc:740] T 7475d672f7b3489393d6202c8b31e47f P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:25.208658  2162 leader_election.cc:304] T e259bf23e7904d9fb8b2345bb5b667f3 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
W20260709 13:12:25.201617  2236 consensus_peers.cc:597] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:25.209615  2162 leader_election.cc:304] T 0bd8fc2d57c14adeaeae16583eef7c84 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:25.208997  3100 consensus_queue.cc:260] T 7475d672f7b3489393d6202c8b31e47f P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:25.195331  3105 leader_election.cc:290] T a4a5ce298d24406ea94fb68aba5b37ae P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:25.209964  3136 raft_consensus.cc:2804] T e259bf23e7904d9fb8b2345bb5b667f3 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:25.225914  3136 raft_consensus.cc:493] T e259bf23e7904d9fb8b2345bb5b667f3 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:25.228188  3136 raft_consensus.cc:3060] T e259bf23e7904d9fb8b2345bb5b667f3 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:25.229180  2973 raft_consensus.cc:2804] T 0bd8fc2d57c14adeaeae16583eef7c84 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:25.229640  2973 raft_consensus.cc:493] T 0bd8fc2d57c14adeaeae16583eef7c84 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:25.230017  2973 raft_consensus.cc:3060] T 0bd8fc2d57c14adeaeae16583eef7c84 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:25.239655  2236 leader_election.cc:336] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111)
I20260709 13:12:25.246868  2162 leader_election.cc:304] T 67db2f978ea64fbd9a32274d4ad374c9 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:25.263100  3070 raft_consensus.cc:2804] T 67db2f978ea64fbd9a32274d4ad374c9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:25.263710  3070 raft_consensus.cc:697] T 67db2f978ea64fbd9a32274d4ad374c9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 LEADER]: Becoming Leader. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Running, Role: LEADER
I20260709 13:12:25.263922  3088 consensus_queue.cc:1048] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:25.264786  3070 consensus_queue.cc:237] T 67db2f978ea64fbd9a32274d4ad374c9 P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:25.268649  2271 raft_consensus.cc:1275] T e1ad60fa3bce47daac74b01143b54132 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Refusing update from remote peer 0ec6a5d1452a41bd992a8c7922473b35: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:25.271049  3151 leader_election.cc:290] T d0d102459578474fbe77af94f3986a84 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 election: Requested vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:25.272229  2973 raft_consensus.cc:515] T 0bd8fc2d57c14adeaeae16583eef7c84 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
W20260709 13:12:25.273033  2310 leader_election.cc:336] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111)
I20260709 13:12:25.277858  2973 leader_election.cc:290] T 0bd8fc2d57c14adeaeae16583eef7c84 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 election: Requested vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:25.279973  2018 catalog_manager.cc:5697] T a4a5ce298d24406ea94fb68aba5b37ae P 0ec6a5d1452a41bd992a8c7922473b35 reported cstate change: term changed from 1 to 2, leader changed from 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65) to 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66). New cstate: current_term: 2 leader_uuid: "0ec6a5d1452a41bd992a8c7922473b35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:25.283311  2162 leader_election.cc:336] T 0bd8fc2d57c14adeaeae16583eef7c84 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111)
W20260709 13:12:25.284283  2162 leader_election.cc:336] T 67db2f978ea64fbd9a32274d4ad374c9 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111)
W20260709 13:12:25.284986  2162 leader_election.cc:336] T e259bf23e7904d9fb8b2345bb5b667f3 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111)
I20260709 13:12:25.291744  3136 raft_consensus.cc:515] T e259bf23e7904d9fb8b2345bb5b667f3 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
W20260709 13:12:25.293886  2236 leader_election.cc:336] T d0d102459578474fbe77af94f3986a84 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111)
W20260709 13:12:25.285645  2162 leader_election.cc:336] T a4a5ce298d24406ea94fb68aba5b37ae P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111)
I20260709 13:12:25.296092  2196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a50365dcc843f4a4f6bfb29a736f26" candidate_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:25.298454  2196 raft_consensus.cc:3060] T d7a50365dcc843f4a4f6bfb29a736f26 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:25.302712  3136 leader_election.cc:290] T e259bf23e7904d9fb8b2345bb5b667f3 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 3 election: Requested vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
W20260709 13:12:25.316375  2310 consensus_peers.cc:597] T 10de08c2346d47dbbd720596cd7e02fd P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:25.321352  2018 catalog_manager.cc:5697] T 67db2f978ea64fbd9a32274d4ad374c9 P 0ec6a5d1452a41bd992a8c7922473b35 reported cstate change: term changed from 2 to 3, leader changed from 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65) to 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66). New cstate: current_term: 3 leader_uuid: "0ec6a5d1452a41bd992a8c7922473b35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:25.319844  2196 raft_consensus.cc:2468] T d7a50365dcc843f4a4f6bfb29a736f26 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 66e9a8fffd4b4e5a81ca4fa2762773ea in term 2.
I20260709 13:12:25.328367  2020 catalog_manager.cc:5697] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea reported cstate change: term changed from 2 to 3, leader changed from 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65) to 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68). New cstate: current_term: 3 leader_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:25.331203  2311 leader_election.cc:304] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:25.332248  3146 raft_consensus.cc:2804] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:25.332716  3146 raft_consensus.cc:697] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 LEADER]: Becoming Leader. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Running, Role: LEADER
I20260709 13:12:25.333636  3146 consensus_queue.cc:237] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:25.343519  3171 raft_consensus.cc:493] T 622b6cfd76ff495ea6692a1ec0faefc4 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.348831  3171 raft_consensus.cc:515] T 622b6cfd76ff495ea6692a1ec0faefc4 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:25.350670  2196 raft_consensus.cc:1275] T 10de08c2346d47dbbd720596cd7e02fd P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Refusing update from remote peer 66e9a8fffd4b4e5a81ca4fa2762773ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:25.353026  2194 raft_consensus.cc:1275] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [term 5 FOLLOWER]: Refusing update from remote peer 79b6e57d59e4468ebe4423d871a31b39: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 13:12:25.354225  2198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0d102459578474fbe77af94f3986a84" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:25.355782  2198 raft_consensus.cc:3060] T d0d102459578474fbe77af94f3986a84 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:25.357328  3100 ts_tablet_manager.cc:1434] T 7475d672f7b3489393d6202c8b31e47f P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.161s	user 0.019s	sys 0.001s
I20260709 13:12:25.358922  3171 leader_election.cc:290] T 622b6cfd76ff495ea6692a1ec0faefc4 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:25.358316  3100 tablet_bootstrap.cc:492] T 2e178ff57d964223aca095ceff76b339 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:25.361478  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bd8fc2d57c14adeaeae16583eef7c84" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:25.362468  2268 raft_consensus.cc:2393] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0ec6a5d1452a41bd992a8c7922473b35 in current term 2: Already voted for candidate 79b6e57d59e4468ebe4423d871a31b39 in this term.
I20260709 13:12:25.354743  2193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bd8fc2d57c14adeaeae16583eef7c84" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:25.364585  2193 raft_consensus.cc:2393] T 0bd8fc2d57c14adeaeae16583eef7c84 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 79b6e57d59e4468ebe4423d871a31b39 in current term 2: Already voted for candidate 0ec6a5d1452a41bd992a8c7922473b35 in this term.
I20260709 13:12:25.371145  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e259bf23e7904d9fb8b2345bb5b667f3" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:25.371887  2268 raft_consensus.cc:3060] T e259bf23e7904d9fb8b2345bb5b667f3 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:25.372761  2198 raft_consensus.cc:2468] T d0d102459578474fbe77af94f3986a84 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 2.
W20260709 13:12:25.374900  2162 consensus_peers.cc:597] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:25.376291  2162 consensus_peers.cc:597] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:25.381579  3142 consensus_queue.cc:1048] T 10de08c2346d47dbbd720596cd7e02fd P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:25.382514  3171 raft_consensus.cc:493] T ddf48e4f6be64627a0ed06d6198ca054 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.386719  2339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a5ce298d24406ea94fb68aba5b37ae" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:25.386967  2268 raft_consensus.cc:2468] T e259bf23e7904d9fb8b2345bb5b667f3 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 3.
I20260709 13:12:25.387477  2339 raft_consensus.cc:2393] T a4a5ce298d24406ea94fb68aba5b37ae P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2ac5c5682f914ed9b9982b5a080d5472 in current term 2: Already voted for candidate 0ec6a5d1452a41bd992a8c7922473b35 in this term.
I20260709 13:12:25.390985  3171 raft_consensus.cc:515] T ddf48e4f6be64627a0ed06d6198ca054 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:25.394865  2266 raft_consensus.cc:1275] T 5c3646d79bc840e9b4396f4351d1803d P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Refusing update from remote peer 0ec6a5d1452a41bd992a8c7922473b35: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:25.397805  3070 consensus_queue.cc:1048] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:25.405551  2162 leader_election.cc:304] T e259bf23e7904d9fb8b2345bb5b667f3 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:25.411353  3136 raft_consensus.cc:2804] T e259bf23e7904d9fb8b2345bb5b667f3 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:25.411923  3136 raft_consensus.cc:697] T e259bf23e7904d9fb8b2345bb5b667f3 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 LEADER]: Becoming Leader. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Running, Role: LEADER
I20260709 13:12:25.418047  2020 catalog_manager.cc:5697] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea reported cstate change: term changed from 1 to 2, leader changed from 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65) to 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68). New cstate: current_term: 2 leader_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:25.413028  3136 consensus_queue.cc:237] T e259bf23e7904d9fb8b2345bb5b667f3 P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
W20260709 13:12:25.427235  2310 consensus_peers.cc:597] T 56bba8336a054d969e18859a84f180d6 P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:25.404996  3171 leader_election.cc:290] T ddf48e4f6be64627a0ed06d6198ca054 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:25.431921  2198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a5ce298d24406ea94fb68aba5b37ae" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:25.433373  2193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622b6cfd76ff495ea6692a1ec0faefc4" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:25.433588  3070 consensus_queue.cc:1048] T 5c3646d79bc840e9b4396f4351d1803d P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:25.434084  3095 leader_election.cc:304] T a4a5ce298d24406ea94fb68aba5b37ae P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea
I20260709 13:12:25.434640  2189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddf48e4f6be64627a0ed06d6198ca054" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:25.436522  3171 raft_consensus.cc:3060] T a4a5ce298d24406ea94fb68aba5b37ae P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:25.456979  3171 raft_consensus.cc:2749] T a4a5ce298d24406ea94fb68aba5b37ae P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:25.462369  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "622b6cfd76ff495ea6692a1ec0faefc4" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:25.463829  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ddf48e4f6be64627a0ed06d6198ca054" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:25.464906  3094 leader_election.cc:304] T 622b6cfd76ff495ea6692a1ec0faefc4 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:25.467684  3171 raft_consensus.cc:2749] T 622b6cfd76ff495ea6692a1ec0faefc4 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:25.477393  2339 raft_consensus.cc:1275] T a332070dcdff450b939e74ef5b68425a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Refusing update from remote peer 0ec6a5d1452a41bd992a8c7922473b35: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:25.479166  2237 leader_election.cc:304] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79b6e57d59e4468ebe4423d871a31b39; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:25.478762  2020 catalog_manager.cc:5697] T e259bf23e7904d9fb8b2345bb5b667f3 P 0ec6a5d1452a41bd992a8c7922473b35 reported cstate change: term changed from 2 to 3, leader changed from 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65) to 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66). New cstate: current_term: 3 leader_uuid: "0ec6a5d1452a41bd992a8c7922473b35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:25.480261  2237 leader_election.cc:304] T d0d102459578474fbe77af94f3986a84 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39; no voters: 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:25.481900  3150 raft_consensus.cc:2749] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:12:25.482579  3150 raft_consensus.cc:2804] T d0d102459578474fbe77af94f3986a84 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:25.482997  3150 raft_consensus.cc:697] T d0d102459578474fbe77af94f3986a84 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 LEADER]: Becoming Leader. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Running, Role: LEADER
I20260709 13:12:25.483932  3150 consensus_queue.cc:237] T d0d102459578474fbe77af94f3986a84 P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:25.491171  2268 raft_consensus.cc:1275] T 56bba8336a054d969e18859a84f180d6 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Refusing update from remote peer 66e9a8fffd4b4e5a81ca4fa2762773ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:12:25.508912  2162 leader_election.cc:336] T 0bd8fc2d57c14adeaeae16583eef7c84 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111)
I20260709 13:12:25.504546  3094 leader_election.cc:304] T ddf48e4f6be64627a0ed06d6198ca054 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:25.497164  2972 consensus_queue.cc:1048] T 56bba8336a054d969e18859a84f180d6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 13:12:25.511292  2162 leader_election.cc:304] T 0bd8fc2d57c14adeaeae16583eef7c84 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35; no voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39
W20260709 13:12:25.519764  2162 leader_election.cc:336] T e259bf23e7904d9fb8b2345bb5b667f3 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111)
I20260709 13:12:25.518810  3136 raft_consensus.cc:2749] T 0bd8fc2d57c14adeaeae16583eef7c84 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 13:12:25.515254  3171 raft_consensus.cc:2749] T ddf48e4f6be64627a0ed06d6198ca054 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:25.492233  3151 consensus_queue.cc:1048] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 13:12:25.554522  3100 tablet_bootstrap.cc:492] T 2e178ff57d964223aca095ceff76b339 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:25.555657  3100 tablet_bootstrap.cc:492] T 2e178ff57d964223aca095ceff76b339 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap complete.
I20260709 13:12:25.559547  3100 ts_tablet_manager.cc:1403] T 2e178ff57d964223aca095ceff76b339 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.201s	user 0.018s	sys 0.004s
I20260709 13:12:25.546264  3171 raft_consensus.cc:493] T ee1baa7401cd48e48e7125dcd607f44f P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.562876  3171 raft_consensus.cc:515] T ee1baa7401cd48e48e7125dcd607f44f P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:25.565524  3171 leader_election.cc:290] T ee1baa7401cd48e48e7125dcd607f44f P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:25.566447  2189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee1baa7401cd48e48e7125dcd607f44f" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:25.566536  2338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee1baa7401cd48e48e7125dcd607f44f" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:25.568274  3094 leader_election.cc:304] T ee1baa7401cd48e48e7125dcd607f44f P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea
I20260709 13:12:25.540822  3087 consensus_queue.cc:1048] T a332070dcdff450b939e74ef5b68425a P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:12:25.573673  3100 raft_consensus.cc:359] T 2e178ff57d964223aca095ceff76b339 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:25.574361  3100 raft_consensus.cc:740] T 2e178ff57d964223aca095ceff76b339 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:25.575279  3100 consensus_queue.cc:260] T 2e178ff57d964223aca095ceff76b339 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:25.571033  3171 raft_consensus.cc:2749] T ee1baa7401cd48e48e7125dcd607f44f P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 13:12:25.605664  2237 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.66:38859, user_credentials={real_user=slave}} blocked reactor thread for 59629.8us
I20260709 13:12:25.639030  2268 raft_consensus.cc:1275] T 2e178ff57d964223aca095ceff76b339 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Refusing update from remote peer 66e9a8fffd4b4e5a81ca4fa2762773ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:25.639513  3100 ts_tablet_manager.cc:1434] T 2e178ff57d964223aca095ceff76b339 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.080s	user 0.006s	sys 0.000s
I20260709 13:12:25.640545  3100 tablet_bootstrap.cc:492] T 36b22aafe7104cec82607dab40b4aed8 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:25.665026  2020 catalog_manager.cc:5697] T d0d102459578474fbe77af94f3986a84 P 79b6e57d59e4468ebe4423d871a31b39 reported cstate change: term changed from 1 to 2, leader changed from 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65) to 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67). New cstate: current_term: 2 leader_uuid: "79b6e57d59e4468ebe4423d871a31b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:25.681610  2162 consensus_peers.cc:597] T 5c3646d79bc840e9b4396f4351d1803d P 0ec6a5d1452a41bd992a8c7922473b35 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:25.694509  3153 consensus_queue.cc:1048] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.009s
W20260709 13:12:25.736773  2236 consensus_peers.cc:597] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:25.739189  2162 consensus_peers.cc:597] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 0ec6a5d1452a41bd992a8c7922473b35 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:25.739811  2162 consensus_peers.cc:597] T d3370eb67fff4896b1f8e3ce56eceb9b P 0ec6a5d1452a41bd992a8c7922473b35 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:25.754408  2196 raft_consensus.cc:1275] T d7a50365dcc843f4a4f6bfb29a736f26 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Refusing update from remote peer 66e9a8fffd4b4e5a81ca4fa2762773ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:12:25.755692  2236 consensus_peers.cc:597] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:25.761464  3204 consensus_queue.cc:1048] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:25.764341  3100 tablet_bootstrap.cc:492] T 36b22aafe7104cec82607dab40b4aed8 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:25.765477  3100 tablet_bootstrap.cc:492] T 36b22aafe7104cec82607dab40b4aed8 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap complete.
I20260709 13:12:25.766127  3100 ts_tablet_manager.cc:1403] T 36b22aafe7104cec82607dab40b4aed8 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.126s	user 0.010s	sys 0.030s
I20260709 13:12:25.768633  3100 raft_consensus.cc:359] T 36b22aafe7104cec82607dab40b4aed8 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:25.770872  3100 raft_consensus.cc:740] T 36b22aafe7104cec82607dab40b4aed8 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:25.771679  3100 consensus_queue.cc:260] T 36b22aafe7104cec82607dab40b4aed8 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
W20260709 13:12:25.780514  2236 consensus_peers.cc:597] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:25.788313  2162 consensus_peers.cc:597] T a4a5ce298d24406ea94fb68aba5b37ae P 0ec6a5d1452a41bd992a8c7922473b35 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:25.788949  2162 consensus_peers.cc:597] T a332070dcdff450b939e74ef5b68425a P 0ec6a5d1452a41bd992a8c7922473b35 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:25.789625  3171 raft_consensus.cc:493] T 5c3646d79bc840e9b4396f4351d1803d P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.790210  3171 raft_consensus.cc:515] T 5c3646d79bc840e9b4396f4351d1803d P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:25.792294  3171 leader_election.cc:290] T 5c3646d79bc840e9b4396f4351d1803d P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:25.793690  2263 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3646d79bc840e9b4396f4351d1803d" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:25.798496  2196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5c3646d79bc840e9b4396f4351d1803d" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:25.809942  2268 raft_consensus.cc:1275] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Refusing update from remote peer 0ec6a5d1452a41bd992a8c7922473b35: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:25.810330  3100 ts_tablet_manager.cc:1434] T 36b22aafe7104cec82607dab40b4aed8 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.001s
I20260709 13:12:25.816331  3100 tablet_bootstrap.cc:492] T 46887c40373b4aca811c6382c97cb9bf P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:25.818204  2339 raft_consensus.cc:1275] T a4a5ce298d24406ea94fb68aba5b37ae P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Refusing update from remote peer 0ec6a5d1452a41bd992a8c7922473b35: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 13:12:25.823173  2162 consensus_peers.cc:597] T bc42d18a324e4f6d97f07cf770c5daa8 P 0ec6a5d1452a41bd992a8c7922473b35 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:25.822069  2310 consensus_peers.cc:597] T df8d897471684531826528a5751d6246 P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:25.825248  2268 raft_consensus.cc:1275] T e259bf23e7904d9fb8b2345bb5b667f3 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Refusing update from remote peer 0ec6a5d1452a41bd992a8c7922473b35: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 13:12:25.825397  2310 consensus_peers.cc:597] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:25.828413  3095 leader_election.cc:304] T 5c3646d79bc840e9b4396f4351d1803d P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:25.829581  3171 raft_consensus.cc:2749] T 5c3646d79bc840e9b4396f4351d1803d P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:25.832420  3195 consensus_queue.cc:1048] T 67db2f978ea64fbd9a32274d4ad374c9 P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:25.843510  3195 consensus_queue.cc:1048] T a4a5ce298d24406ea94fb68aba5b37ae P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:25.845989  3195 consensus_queue.cc:1048] T e259bf23e7904d9fb8b2345bb5b667f3 P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:12:25.847554  2162 consensus_peers.cc:597] T b3b82132c31545aab274c7cf3f77c277 P 0ec6a5d1452a41bd992a8c7922473b35 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:25.851610  2162 consensus_peers.cc:597] T 67db2f978ea64fbd9a32274d4ad374c9 P 0ec6a5d1452a41bd992a8c7922473b35 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:25.854424  3171 raft_consensus.cc:493] T 28f2272230d34efa880d5eeed8859669 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.855052  3171 raft_consensus.cc:515] T 28f2272230d34efa880d5eeed8859669 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
W20260709 13:12:25.857563  2310 consensus_peers.cc:597] T d4e943e5bbd7402da6bcc00db70cec14 P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:25.858139  2310 consensus_peers.cc:597] T 36b22aafe7104cec82607dab40b4aed8 P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:25.866762  2338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f2272230d34efa880d5eeed8859669" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:25.857133  3171 leader_election.cc:290] T 28f2272230d34efa880d5eeed8859669 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:25.897109  2271 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28f2272230d34efa880d5eeed8859669" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
W20260709 13:12:25.920006  2310 consensus_peers.cc:597] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:25.921888  3094 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.28.54.68:38869, user_credentials={real_user=slave}} blocked reactor thread for 49074.4us
W20260709 13:12:25.927356  3212 log.cc:927] Time spent T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 13:12:25.952006  3171 raft_consensus.cc:493] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:25.952793  3171 raft_consensus.cc:515] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:25.955103  3171 leader_election.cc:290] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
W20260709 13:12:25.983124  2162 consensus_peers.cc:597] T 12b5593f051548fea374da76afa08c3f P 0ec6a5d1452a41bd992a8c7922473b35 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:25.983624  2162 consensus_peers.cc:597] T e259bf23e7904d9fb8b2345bb5b667f3 P 0ec6a5d1452a41bd992a8c7922473b35 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:25.983944  2162 consensus_peers.cc:597] T 46887c40373b4aca811c6382c97cb9bf P 0ec6a5d1452a41bd992a8c7922473b35 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:25.990154  2196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ad60fa3bce47daac74b01143b54132" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
W20260709 13:12:25.952611  2236 consensus_peers.cc:597] T d1ddcfd4d0914e40ae0a684fd8726d24 P 79b6e57d59e4468ebe4423d871a31b39 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:25.996378  2162 consensus_peers.cc:597] T 765b8df93039426e925b94637a061cc2 P 0ec6a5d1452a41bd992a8c7922473b35 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:26.002349  2236 consensus_peers.cc:597] T 0668be6a554b4c5f8bf93d0588a6bfcc P 79b6e57d59e4468ebe4423d871a31b39 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:26.011013  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e1ad60fa3bce47daac74b01143b54132" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:26.013029  3094 leader_election.cc:304] T 28f2272230d34efa880d5eeed8859669 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472; no voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:26.029891  3094 leader_election.cc:304] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39
W20260709 13:12:26.033381  2236 consensus_peers.cc:597] T d0d102459578474fbe77af94f3986a84 P 79b6e57d59e4468ebe4423d871a31b39 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:26.034335  2236 consensus_peers.cc:597] T 583390912c6d4daca2df9b5534fb8dca P 79b6e57d59e4468ebe4423d871a31b39 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:26.039508  3171 raft_consensus.cc:2749] T 28f2272230d34efa880d5eeed8859669 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:26.040269  3171 raft_consensus.cc:2749] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 13:12:26.046669  2310 consensus_peers.cc:597] T 1588358a9e7542dfbd8b5d2f65212aec P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:26.051666  2236 consensus_peers.cc:597] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:26.056329  2236 consensus_peers.cc:597] T 86834d94d1d64596abfa609754b5d58a P 79b6e57d59e4468ebe4423d871a31b39 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:26.056404  2310 consensus_peers.cc:597] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:26.058601  2236 consensus_peers.cc:597] T ddf48e4f6be64627a0ed06d6198ca054 P 79b6e57d59e4468ebe4423d871a31b39 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:26.063730  3100 tablet_bootstrap.cc:492] T 46887c40373b4aca811c6382c97cb9bf P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:26.064661  3100 tablet_bootstrap.cc:492] T 46887c40373b4aca811c6382c97cb9bf P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap complete.
I20260709 13:12:26.065250  3100 ts_tablet_manager.cc:1403] T 46887c40373b4aca811c6382c97cb9bf P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.249s	user 0.021s	sys 0.015s
I20260709 13:12:26.067646  3100 raft_consensus.cc:359] T 46887c40373b4aca811c6382c97cb9bf P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:26.068254  3100 raft_consensus.cc:740] T 46887c40373b4aca811c6382c97cb9bf P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.068881  3100 consensus_queue.cc:260] T 46887c40373b4aca811c6382c97cb9bf P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:26.071048  3100 ts_tablet_manager.cc:1434] T 46887c40373b4aca811c6382c97cb9bf P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260709 13:12:26.071849  3100 tablet_bootstrap.cc:492] T 6bf4f728eedf41bdb027f554c3a5ae1f P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:26.086745  2193 raft_consensus.cc:1275] T d0d102459578474fbe77af94f3986a84 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Refusing update from remote peer 79b6e57d59e4468ebe4423d871a31b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:26.097899  2916 consensus_queue.cc:1048] T d0d102459578474fbe77af94f3986a84 P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:26.101531  3100 tablet_bootstrap.cc:492] T 6bf4f728eedf41bdb027f554c3a5ae1f P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:26.102456  3100 tablet_bootstrap.cc:492] T 6bf4f728eedf41bdb027f554c3a5ae1f P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap complete.
I20260709 13:12:26.103055  3100 ts_tablet_manager.cc:1403] T 6bf4f728eedf41bdb027f554c3a5ae1f P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.008s
W20260709 13:12:26.103837  2236 consensus_peers.cc:597] T b206de895e36490688cb2c1c537774a5 P 79b6e57d59e4468ebe4423d871a31b39 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:26.105669  3100 raft_consensus.cc:359] T 6bf4f728eedf41bdb027f554c3a5ae1f P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:26.106391  3100 raft_consensus.cc:740] T 6bf4f728eedf41bdb027f554c3a5ae1f P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.107170  3100 consensus_queue.cc:260] T 6bf4f728eedf41bdb027f554c3a5ae1f P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:26.113189  3100 ts_tablet_manager.cc:1434] T 6bf4f728eedf41bdb027f554c3a5ae1f P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:12:26.115325  3100 tablet_bootstrap.cc:492] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:26.122012  3105 raft_consensus.cc:493] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.122570  3105 raft_consensus.cc:515] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:26.124802  3105 leader_election.cc:290] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:26.126448  2193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a332070dcdff450b939e74ef5b68425a" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:26.127969  2338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a332070dcdff450b939e74ef5b68425a" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:26.128098  3105 raft_consensus.cc:493] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.128609  3105 raft_consensus.cc:515] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:26.129597  3094 leader_election.cc:304] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea
I20260709 13:12:26.130493  3171 raft_consensus.cc:2749] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:26.131548  3105 leader_election.cc:290] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:26.131776  2338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a50365dcc843f4a4f6bfb29a736f26" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:26.132741  2193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a50365dcc843f4a4f6bfb29a736f26" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:26.135295  3095 leader_election.cc:304] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea
W20260709 13:12:26.136474  2310 consensus_peers.cc:597] T 78734884e0a441759b51d258ad2697aa P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:26.138805  3105 raft_consensus.cc:2749] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:26.139780  3171 raft_consensus.cc:493] T 12b5593f051548fea374da76afa08c3f P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.140321  3171 raft_consensus.cc:515] T 12b5593f051548fea374da76afa08c3f P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:26.142527  3171 leader_election.cc:290] T 12b5593f051548fea374da76afa08c3f P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:26.143195  2338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b5593f051548fea374da76afa08c3f" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:26.144712  2193 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12b5593f051548fea374da76afa08c3f" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:26.148440  3095 leader_election.cc:304] T 12b5593f051548fea374da76afa08c3f P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 66e9a8fffd4b4e5a81ca4fa2762773ea
I20260709 13:12:26.151002  3171 raft_consensus.cc:2749] T 12b5593f051548fea374da76afa08c3f P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:26.153631  3171 raft_consensus.cc:493] T 427b10072083419c89d5a4bf5d6413fc P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.154141  3171 raft_consensus.cc:515] T 427b10072083419c89d5a4bf5d6413fc P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:26.156948  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b10072083419c89d5a4bf5d6413fc" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:26.160701  3171 leader_election.cc:290] T 427b10072083419c89d5a4bf5d6413fc P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
W20260709 13:12:26.148629  2310 consensus_peers.cc:597] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:26.162884  2338 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "427b10072083419c89d5a4bf5d6413fc" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
W20260709 13:12:26.164057  2310 consensus_peers.cc:597] T a9be6d55d1f348bcaf96405abc80244d P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:26.165293  3094 leader_election.cc:304] T 427b10072083419c89d5a4bf5d6413fc P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472; no voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:26.167671  3100 tablet_bootstrap.cc:492] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:26.168685  3100 tablet_bootstrap.cc:492] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap complete.
I20260709 13:12:26.169356  3100 ts_tablet_manager.cc:1403] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.055s	user 0.014s	sys 0.009s
I20260709 13:12:26.171907  3100 raft_consensus.cc:359] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:26.172590  3100 raft_consensus.cc:740] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.173355  3100 consensus_queue.cc:260] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:26.174320  3105 raft_consensus.cc:2749] T 427b10072083419c89d5a4bf5d6413fc P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:26.175585  3100 ts_tablet_manager.cc:1434] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:12:26.177338  3100 tablet_bootstrap.cc:492] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
W20260709 13:12:26.161298  2162 consensus_peers.cc:597] T 622b6cfd76ff495ea6692a1ec0faefc4 P 0ec6a5d1452a41bd992a8c7922473b35 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:26.187348  2162 consensus_peers.cc:597] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:26.196487  2310 consensus_peers.cc:597] T 6bf4f728eedf41bdb027f554c3a5ae1f P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:26.203922  2162 consensus_peers.cc:597] T ee1baa7401cd48e48e7125dcd607f44f P 0ec6a5d1452a41bd992a8c7922473b35 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:26.220033  3100 tablet_bootstrap.cc:492] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:26.221227  3100 tablet_bootstrap.cc:492] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap complete.
I20260709 13:12:26.221973  3100 ts_tablet_manager.cc:1403] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.045s	user 0.017s	sys 0.014s
I20260709 13:12:26.224742  3100 raft_consensus.cc:359] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [term 4 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:26.225409  3100 raft_consensus.cc:740] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [term 4 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.226254  3100 consensus_queue.cc:260] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:26.228698  3100 ts_tablet_manager.cc:1434] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:12:26.229650  3100 tablet_bootstrap.cc:492] T b206de895e36490688cb2c1c537774a5 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:26.254410  3171 raft_consensus.cc:493] T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:26.255091  3171 raft_consensus.cc:515] T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:26.260274  3100 tablet_bootstrap.cc:492] T b206de895e36490688cb2c1c537774a5 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:26.261194  3100 tablet_bootstrap.cc:492] T b206de895e36490688cb2c1c537774a5 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap complete.
I20260709 13:12:26.261508  2266 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86834d94d1d64596abfa609754b5d58a" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "79b6e57d59e4468ebe4423d871a31b39" is_pre_election: true
I20260709 13:12:26.261852  3100 ts_tablet_manager.cc:1403] T b206de895e36490688cb2c1c537774a5 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.032s	user 0.014s	sys 0.003s
I20260709 13:12:26.262455  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "86834d94d1d64596abfa609754b5d58a" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" is_pre_election: true
I20260709 13:12:26.264554  3100 raft_consensus.cc:359] T b206de895e36490688cb2c1c537774a5 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:26.265220  3100 raft_consensus.cc:740] T b206de895e36490688cb2c1c537774a5 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.265920  3100 consensus_queue.cc:260] T b206de895e36490688cb2c1c537774a5 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:26.268934  3100 ts_tablet_manager.cc:1434] T b206de895e36490688cb2c1c537774a5 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 13:12:26.269718  3100 tablet_bootstrap.cc:492] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
W20260709 13:12:26.271911  2162 consensus_peers.cc:597] T d2f88787abb54ffea037f35cf48b22c4 P 0ec6a5d1452a41bd992a8c7922473b35 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:26.257251  3171 leader_election.cc:290] T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:26.273721  3094 leader_election.cc:304] T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472; no voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:26.274775  3171 raft_consensus.cc:2749] T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 13:12:26.290086  3245 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.54.65:36557 every 8 connection(s)
I20260709 13:12:26.290679 28889 rpc_server.cc:307] RPC server started. Bound to: 127.28.54.65:36557
I20260709 13:12:26.297202  3100 tablet_bootstrap.cc:492] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:26.298237  3100 tablet_bootstrap.cc:492] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap complete.
I20260709 13:12:26.298861  3100 ts_tablet_manager.cc:1403] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.004s
I20260709 13:12:26.301465  3100 raft_consensus.cc:359] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:26.302120  3100 raft_consensus.cc:740] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.302822  3100 consensus_queue.cc:260] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:26.305089  3100 ts_tablet_manager.cc:1434] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:12:26.305850  3100 tablet_bootstrap.cc:492] T 765b8df93039426e925b94637a061cc2 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:26.361779  3100 tablet_bootstrap.cc:492] T 765b8df93039426e925b94637a061cc2 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:26.362671  3100 tablet_bootstrap.cc:492] T 765b8df93039426e925b94637a061cc2 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap complete.
I20260709 13:12:26.363319  3100 ts_tablet_manager.cc:1403] T 765b8df93039426e925b94637a061cc2 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.058s	user 0.017s	sys 0.030s
I20260709 13:12:26.367156  3100 raft_consensus.cc:359] T 765b8df93039426e925b94637a061cc2 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:26.367828  3100 raft_consensus.cc:740] T 765b8df93039426e925b94637a061cc2 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.368940  3100 consensus_queue.cc:260] T 765b8df93039426e925b94637a061cc2 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:26.370998  3100 ts_tablet_manager.cc:1434] T 765b8df93039426e925b94637a061cc2 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:12:26.371937  3100 tablet_bootstrap.cc:492] T df8d897471684531826528a5751d6246 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:26.373008  3211 raft_consensus.cc:3060] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:26.383392  3187 raft_consensus.cc:3060] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:26.411051  3246 heartbeater.cc:344] Connected to a master server at 127.28.54.126:35419
I20260709 13:12:26.411531  3246 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:26.412424  3246 heartbeater.cc:507] Master 127.28.54.126:35419 requested a full tablet report, sending...
I20260709 13:12:26.414565  3100 tablet_bootstrap.cc:492] T df8d897471684531826528a5751d6246 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:26.415570  3100 tablet_bootstrap.cc:492] T df8d897471684531826528a5751d6246 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap complete.
I20260709 13:12:26.416183  3100 ts_tablet_manager.cc:1403] T df8d897471684531826528a5751d6246 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.044s	user 0.019s	sys 0.004s
I20260709 13:12:26.424456  3100 raft_consensus.cc:359] T df8d897471684531826528a5751d6246 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:26.425599  3100 raft_consensus.cc:740] T df8d897471684531826528a5751d6246 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.426321  3100 consensus_queue.cc:260] T df8d897471684531826528a5751d6246 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:26.428664  3100 ts_tablet_manager.cc:1434] T df8d897471684531826528a5751d6246 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 13:12:26.429312  3100 tablet_bootstrap.cc:492] T 56bba8336a054d969e18859a84f180d6 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:26.438696  3211 raft_consensus.cc:3060] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:26.445919  2020 ts_manager.cc:194] Re-registered known tserver with Master: 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557)
I20260709 13:12:26.450506  3187 raft_consensus.cc:3060] T 5c3646d79bc840e9b4396f4351d1803d P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:26.479228  3100 tablet_bootstrap.cc:492] T 56bba8336a054d969e18859a84f180d6 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:26.480149  3100 tablet_bootstrap.cc:492] T 56bba8336a054d969e18859a84f180d6 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap complete.
I20260709 13:12:26.480799  3100 ts_tablet_manager.cc:1403] T 56bba8336a054d969e18859a84f180d6 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.052s	user 0.015s	sys 0.003s
I20260709 13:12:26.486404  3100 raft_consensus.cc:359] T 56bba8336a054d969e18859a84f180d6 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:26.487082  3100 raft_consensus.cc:740] T 56bba8336a054d969e18859a84f180d6 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.487905  3100 consensus_queue.cc:260] T 56bba8336a054d969e18859a84f180d6 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:26.490378  3100 ts_tablet_manager.cc:1434] T 56bba8336a054d969e18859a84f180d6 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.002s
I20260709 13:12:26.491114  3100 tablet_bootstrap.cc:492] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:26.513075  2020 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:39156
I20260709 13:12:26.518040  3246 heartbeater.cc:499] Master 127.28.54.126:35419 was elected leader, sending a full tablet report...
I20260709 13:12:26.526371  3211 raft_consensus.cc:3060] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:26.528306  3100 tablet_bootstrap.cc:492] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:26.529326  3100 tablet_bootstrap.cc:492] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap complete.
I20260709 13:12:26.529897  3100 ts_tablet_manager.cc:1403] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.039s	user 0.018s	sys 0.005s
I20260709 13:12:26.538935  3100 raft_consensus.cc:359] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:26.539620  3100 raft_consensus.cc:740] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.540539  3100 consensus_queue.cc:260] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:26.543076  3100 ts_tablet_manager.cc:1434] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.013s	user 0.000s	sys 0.007s
I20260709 13:12:26.543833  3100 tablet_bootstrap.cc:492] T d4e943e5bbd7402da6bcc00db70cec14 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:26.556747  3100 tablet_bootstrap.cc:492] T d4e943e5bbd7402da6bcc00db70cec14 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:26.557556  3100 tablet_bootstrap.cc:492] T d4e943e5bbd7402da6bcc00db70cec14 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap complete.
I20260709 13:12:26.558184  3100 ts_tablet_manager.cc:1403] T d4e943e5bbd7402da6bcc00db70cec14 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 13:12:26.560806  3100 raft_consensus.cc:359] T d4e943e5bbd7402da6bcc00db70cec14 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:26.561458  3100 raft_consensus.cc:740] T d4e943e5bbd7402da6bcc00db70cec14 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.562309  3100 consensus_queue.cc:260] T d4e943e5bbd7402da6bcc00db70cec14 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:26.564201  3100 ts_tablet_manager.cc:1434] T d4e943e5bbd7402da6bcc00db70cec14 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:12:26.564906  3100 tablet_bootstrap.cc:492] T 78734884e0a441759b51d258ad2697aa P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:26.584648  3100 tablet_bootstrap.cc:492] T 78734884e0a441759b51d258ad2697aa P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:26.585542  3100 tablet_bootstrap.cc:492] T 78734884e0a441759b51d258ad2697aa P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap complete.
I20260709 13:12:26.586169  3100 ts_tablet_manager.cc:1403] T 78734884e0a441759b51d258ad2697aa P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.004s
I20260709 13:12:26.588639  3100 raft_consensus.cc:359] T 78734884e0a441759b51d258ad2697aa P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:26.589090  3100 raft_consensus.cc:740] T 78734884e0a441759b51d258ad2697aa P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
W20260709 13:12:26.589366  2162 consensus_peers.cc:597] T 7e3782f3d54b4a19bacbd125c31127a9 P 0ec6a5d1452a41bd992a8c7922473b35 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 13:12:26.589815  3100 consensus_queue.cc:260] T 78734884e0a441759b51d258ad2697aa P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:26.591496  3100 ts_tablet_manager.cc:1434] T 78734884e0a441759b51d258ad2697aa P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:12:26.592064  3100 tablet_bootstrap.cc:492] T d2f88787abb54ffea037f35cf48b22c4 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:26.609831  3100 tablet_bootstrap.cc:492] T d2f88787abb54ffea037f35cf48b22c4 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:26.611234  3100 tablet_bootstrap.cc:492] T d2f88787abb54ffea037f35cf48b22c4 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap complete.
I20260709 13:12:26.612203  3100 ts_tablet_manager.cc:1403] T d2f88787abb54ffea037f35cf48b22c4 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.020s	user 0.015s	sys 0.000s
I20260709 13:12:26.614589  3100 raft_consensus.cc:359] T d2f88787abb54ffea037f35cf48b22c4 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:26.615247  3100 raft_consensus.cc:740] T d2f88787abb54ffea037f35cf48b22c4 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.615890  3100 consensus_queue.cc:260] T d2f88787abb54ffea037f35cf48b22c4 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:26.618950  3100 ts_tablet_manager.cc:1434] T d2f88787abb54ffea037f35cf48b22c4 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:12:26.619995  3100 tablet_bootstrap.cc:492] T d0d102459578474fbe77af94f3986a84 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:26.634369  3187 raft_consensus.cc:3060] T 2e178ff57d964223aca095ceff76b339 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:26.697947  3185 raft_consensus.cc:3060] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:26.744160  3211 raft_consensus.cc:3060] T 56bba8336a054d969e18859a84f180d6 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:26.770577  2162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:34303, user_credentials={real_user=slave}} blocked reactor thread for 44608.6us
I20260709 13:12:26.865103  3100 tablet_bootstrap.cc:492] T d0d102459578474fbe77af94f3986a84 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:26.870597  3100 tablet_bootstrap.cc:492] T d0d102459578474fbe77af94f3986a84 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap complete.
I20260709 13:12:26.871248  3100 ts_tablet_manager.cc:1403] T d0d102459578474fbe77af94f3986a84 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.251s	user 0.072s	sys 0.094s
I20260709 13:12:26.871156  3177 raft_consensus.cc:3060] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:12:26.918577  3270 log.cc:927] Time spent T 2e178ff57d964223aca095ceff76b339 P 2ac5c5682f914ed9b9982b5a080d5472: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 13:12:26.969216  3100 raft_consensus.cc:359] T d0d102459578474fbe77af94f3986a84 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:26.970093  3100 raft_consensus.cc:740] T d0d102459578474fbe77af94f3986a84 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:26.972616  3100 consensus_queue.cc:260] T d0d102459578474fbe77af94f3986a84 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:26.981897  3100 ts_tablet_manager.cc:1434] T d0d102459578474fbe77af94f3986a84 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.110s	user 0.007s	sys 0.001s
I20260709 13:12:26.982754  3100 tablet_bootstrap.cc:492] T 1478f883c539464bb54fe9bff44148d5 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:27.044801  3100 tablet_bootstrap.cc:492] T 1478f883c539464bb54fe9bff44148d5 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:27.050782  3100 tablet_bootstrap.cc:492] T 1478f883c539464bb54fe9bff44148d5 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap complete.
I20260709 13:12:27.051456  3100 ts_tablet_manager.cc:1403] T 1478f883c539464bb54fe9bff44148d5 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.069s	user 0.009s	sys 0.017s
I20260709 13:12:27.058552  3100 raft_consensus.cc:359] T 1478f883c539464bb54fe9bff44148d5 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:27.059623  3100 raft_consensus.cc:740] T 1478f883c539464bb54fe9bff44148d5 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.060261  3100 consensus_queue.cc:260] T 1478f883c539464bb54fe9bff44148d5 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:27.062613  3100 ts_tablet_manager.cc:1434] T 1478f883c539464bb54fe9bff44148d5 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:12:27.063544  3100 tablet_bootstrap.cc:492] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:27.101542  3100 tablet_bootstrap.cc:492] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:27.102252  3100 tablet_bootstrap.cc:492] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap complete.
I20260709 13:12:27.102742  3100 ts_tablet_manager.cc:1403] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.039s	user 0.022s	sys 0.007s
I20260709 13:12:27.104501  3100 raft_consensus.cc:359] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:27.104959  3100 raft_consensus.cc:740] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.105520  3100 consensus_queue.cc:260] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:27.107223  3100 ts_tablet_manager.cc:1434] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:12:27.108376  3100 tablet_bootstrap.cc:492] T 1588358a9e7542dfbd8b5d2f65212aec P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:27.137359  3100 tablet_bootstrap.cc:492] T 1588358a9e7542dfbd8b5d2f65212aec P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:27.138321  3100 tablet_bootstrap.cc:492] T 1588358a9e7542dfbd8b5d2f65212aec P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap complete.
I20260709 13:12:27.138967  3100 ts_tablet_manager.cc:1403] T 1588358a9e7542dfbd8b5d2f65212aec P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.007s
I20260709 13:12:27.141317  3100 raft_consensus.cc:359] T 1588358a9e7542dfbd8b5d2f65212aec P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:27.141978  3100 raft_consensus.cc:740] T 1588358a9e7542dfbd8b5d2f65212aec P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.142611  3100 consensus_queue.cc:260] T 1588358a9e7542dfbd8b5d2f65212aec P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:27.144418  3100 ts_tablet_manager.cc:1434] T 1588358a9e7542dfbd8b5d2f65212aec P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:12:27.145164  3100 tablet_bootstrap.cc:492] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:27.162602  3100 tablet_bootstrap.cc:492] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=1 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:27.163465  3100 tablet_bootstrap.cc:492] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap complete.
I20260709 13:12:27.164080  3100 ts_tablet_manager.cc:1403] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260709 13:12:27.166335  3100 raft_consensus.cc:359] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:27.166972  3100 raft_consensus.cc:740] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.167722  3100 consensus_queue.cc:260] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:27.169697  3100 ts_tablet_manager.cc:1434] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:12:27.172370  3100 tablet_bootstrap.cc:492] T a9be6d55d1f348bcaf96405abc80244d P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:27.192552  3100 tablet_bootstrap.cc:492] T a9be6d55d1f348bcaf96405abc80244d P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:27.193425  3100 tablet_bootstrap.cc:492] T a9be6d55d1f348bcaf96405abc80244d P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap complete.
I20260709 13:12:27.194043  3100 ts_tablet_manager.cc:1403] T a9be6d55d1f348bcaf96405abc80244d P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.022s	user 0.014s	sys 0.003s
I20260709 13:12:27.200707  3100 raft_consensus.cc:359] T a9be6d55d1f348bcaf96405abc80244d P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:27.201177  3100 raft_consensus.cc:740] T a9be6d55d1f348bcaf96405abc80244d P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.201864  3100 consensus_queue.cc:260] T a9be6d55d1f348bcaf96405abc80244d P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:27.203451  3100 ts_tablet_manager.cc:1434] T a9be6d55d1f348bcaf96405abc80244d P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.000s
I20260709 13:12:27.204226  3100 tablet_bootstrap.cc:492] T 0668be6a554b4c5f8bf93d0588a6bfcc P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:27.241976  3100 tablet_bootstrap.cc:492] T 0668be6a554b4c5f8bf93d0588a6bfcc P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:27.242619  3100 tablet_bootstrap.cc:492] T 0668be6a554b4c5f8bf93d0588a6bfcc P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap complete.
I20260709 13:12:27.243075  3100 ts_tablet_manager.cc:1403] T 0668be6a554b4c5f8bf93d0588a6bfcc P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.005s
I20260709 13:12:27.245239  3100 raft_consensus.cc:359] T 0668be6a554b4c5f8bf93d0588a6bfcc P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:27.245858  3100 raft_consensus.cc:740] T 0668be6a554b4c5f8bf93d0588a6bfcc P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.246488  3100 consensus_queue.cc:260] T 0668be6a554b4c5f8bf93d0588a6bfcc P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:27.248458  3100 ts_tablet_manager.cc:1434] T 0668be6a554b4c5f8bf93d0588a6bfcc P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.005s
I20260709 13:12:27.251541  3100 tablet_bootstrap.cc:492] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:27.272261  3100 tablet_bootstrap.cc:492] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:27.273141  3100 tablet_bootstrap.cc:492] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap complete.
I20260709 13:12:27.273978  3100 ts_tablet_manager.cc:1403] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.004s
I20260709 13:12:27.276337  3100 raft_consensus.cc:359] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:27.276953  3100 raft_consensus.cc:740] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.277575  3100 consensus_queue.cc:260] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:27.279587  3100 ts_tablet_manager.cc:1434] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:12:27.280536  3100 tablet_bootstrap.cc:492] T a0394490f6984f028daa10be921e242b P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:27.305233  3100 tablet_bootstrap.cc:492] T a0394490f6984f028daa10be921e242b P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:27.306135  3100 tablet_bootstrap.cc:492] T a0394490f6984f028daa10be921e242b P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap complete.
I20260709 13:12:27.306788  3100 ts_tablet_manager.cc:1403] T a0394490f6984f028daa10be921e242b P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.007s
I20260709 13:12:27.309154  3100 raft_consensus.cc:359] T a0394490f6984f028daa10be921e242b P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:27.309792  3100 raft_consensus.cc:740] T a0394490f6984f028daa10be921e242b P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.310403  3100 consensus_queue.cc:260] T a0394490f6984f028daa10be921e242b P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:27.312366  3100 ts_tablet_manager.cc:1434] T a0394490f6984f028daa10be921e242b P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260709 13:12:27.313282  3100 tablet_bootstrap.cc:492] T b3b82132c31545aab274c7cf3f77c277 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:27.354280  2916 raft_consensus.cc:493] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:27.354804  2916 raft_consensus.cc:515] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:27.356544  2916 leader_election.cc:290] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:27.357370  2198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bd8fc2d57c14adeaeae16583eef7c84" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35" is_pre_election: true
I20260709 13:12:27.358024  2198 raft_consensus.cc:2468] T 0bd8fc2d57c14adeaeae16583eef7c84 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 2.
I20260709 13:12:27.359270  2237 leader_election.cc:304] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:27.362850  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bd8fc2d57c14adeaeae16583eef7c84" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472" is_pre_election: true
I20260709 13:12:27.364581  3200 raft_consensus.cc:2468] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 1.
I20260709 13:12:27.375490  2916 raft_consensus.cc:2804] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 13:12:27.375910  2916 raft_consensus.cc:493] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:27.376207  2916 raft_consensus.cc:3060] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:27.403512  2916 raft_consensus.cc:515] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:27.407055  2916 leader_election.cc:290] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 election: Requested vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:27.404924  3100 tablet_bootstrap.cc:492] T b3b82132c31545aab274c7cf3f77c277 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:27.408201  3100 tablet_bootstrap.cc:492] T b3b82132c31545aab274c7cf3f77c277 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap complete.
I20260709 13:12:27.408193  2189 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bd8fc2d57c14adeaeae16583eef7c84" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:27.408957  2189 raft_consensus.cc:3060] T 0bd8fc2d57c14adeaeae16583eef7c84 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:27.409072  3100 ts_tablet_manager.cc:1403] T b3b82132c31545aab274c7cf3f77c277 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.096s	user 0.044s	sys 0.024s
I20260709 13:12:27.410305  3200 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bd8fc2d57c14adeaeae16583eef7c84" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
I20260709 13:12:27.410917  3200 raft_consensus.cc:3060] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:12:27.411942  3100 raft_consensus.cc:359] T b3b82132c31545aab274c7cf3f77c277 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:27.412828  3100 raft_consensus.cc:740] T b3b82132c31545aab274c7cf3f77c277 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.413480  3100 consensus_queue.cc:260] T b3b82132c31545aab274c7cf3f77c277 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:27.415402  3100 ts_tablet_manager.cc:1434] T b3b82132c31545aab274c7cf3f77c277 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.004s
I20260709 13:12:27.416602  3100 tablet_bootstrap.cc:492] T d3370eb67fff4896b1f8e3ce56eceb9b P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:27.425576  2189 raft_consensus.cc:2468] T 0bd8fc2d57c14adeaeae16583eef7c84 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 3.
I20260709 13:12:27.426822  2237 leader_election.cc:304] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:27.427562  2916 raft_consensus.cc:2804] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:27.427976  2916 raft_consensus.cc:697] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 LEADER]: Becoming Leader. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Running, Role: LEADER
I20260709 13:12:27.428524  3200 raft_consensus.cc:2468] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 3.
I20260709 13:12:27.428735  2916 consensus_queue.cc:237] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:27.441550  3100 tablet_bootstrap.cc:492] T d3370eb67fff4896b1f8e3ce56eceb9b P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:27.442543  3100 tablet_bootstrap.cc:492] T d3370eb67fff4896b1f8e3ce56eceb9b P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap complete.
I20260709 13:12:27.443164  3100 ts_tablet_manager.cc:1403] T d3370eb67fff4896b1f8e3ce56eceb9b P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.027s	user 0.014s	sys 0.005s
I20260709 13:12:27.445446  3100 raft_consensus.cc:359] T d3370eb67fff4896b1f8e3ce56eceb9b P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:27.446102  3100 raft_consensus.cc:740] T d3370eb67fff4896b1f8e3ce56eceb9b P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.452716  3100 consensus_queue.cc:260] T d3370eb67fff4896b1f8e3ce56eceb9b P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:27.454857  3100 ts_tablet_manager.cc:1434] T d3370eb67fff4896b1f8e3ce56eceb9b P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:12:27.455611  3100 tablet_bootstrap.cc:492] T 10de08c2346d47dbbd720596cd7e02fd P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:27.467885  3211 raft_consensus.cc:3060] T d0d102459578474fbe77af94f3986a84 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.488626  3100 tablet_bootstrap.cc:492] T 10de08c2346d47dbbd720596cd7e02fd P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:27.489606  3100 tablet_bootstrap.cc:492] T 10de08c2346d47dbbd720596cd7e02fd P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap complete.
I20260709 13:12:27.490272  3100 ts_tablet_manager.cc:1403] T 10de08c2346d47dbbd720596cd7e02fd P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.035s	user 0.015s	sys 0.011s
I20260709 13:12:27.492694  3100 raft_consensus.cc:359] T 10de08c2346d47dbbd720596cd7e02fd P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:27.493333  3100 raft_consensus.cc:740] T 10de08c2346d47dbbd720596cd7e02fd P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.493999  3100 consensus_queue.cc:260] T 10de08c2346d47dbbd720596cd7e02fd P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:27.495780  3100 ts_tablet_manager.cc:1434] T 10de08c2346d47dbbd720596cd7e02fd P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:12:27.496549  3100 tablet_bootstrap.cc:492] T cc02522cf9704f58a9d2bfd5326e3625 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:27.525246  2018 catalog_manager.cc:5697] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 reported cstate change: term changed from 1 to 3, leader changed from 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65) to 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67). New cstate: current_term: 3 leader_uuid: "79b6e57d59e4468ebe4423d871a31b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:27.542825  3100 tablet_bootstrap.cc:492] T cc02522cf9704f58a9d2bfd5326e3625 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:27.543716  3100 tablet_bootstrap.cc:492] T cc02522cf9704f58a9d2bfd5326e3625 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap complete.
I20260709 13:12:27.544370  3100 ts_tablet_manager.cc:1403] T cc02522cf9704f58a9d2bfd5326e3625 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.048s	user 0.018s	sys 0.008s
I20260709 13:12:27.546996  3100 raft_consensus.cc:359] T cc02522cf9704f58a9d2bfd5326e3625 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:27.547677  3100 raft_consensus.cc:740] T cc02522cf9704f58a9d2bfd5326e3625 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.548460  3100 consensus_queue.cc:260] T cc02522cf9704f58a9d2bfd5326e3625 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:27.550685  3100 ts_tablet_manager.cc:1434] T cc02522cf9704f58a9d2bfd5326e3625 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:12:27.551720  3100 tablet_bootstrap.cc:492] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:27.571238  3100 tablet_bootstrap.cc:492] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:27.572103  3100 tablet_bootstrap.cc:492] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap complete.
I20260709 13:12:27.572746  3100 ts_tablet_manager.cc:1403] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.021s	user 0.011s	sys 0.003s
I20260709 13:12:27.577184  3100 raft_consensus.cc:359] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:27.577973  3100 raft_consensus.cc:740] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.580379  3100 consensus_queue.cc:260] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:27.583973  3100 ts_tablet_manager.cc:1434] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 13:12:27.584699  3211 raft_consensus.cc:3060] T cc02522cf9704f58a9d2bfd5326e3625 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:27.584992  3100 tablet_bootstrap.cc:492] T 583390912c6d4daca2df9b5534fb8dca P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:27.616888  3100 tablet_bootstrap.cc:492] T 583390912c6d4daca2df9b5534fb8dca P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:27.618219  3100 tablet_bootstrap.cc:492] T 583390912c6d4daca2df9b5534fb8dca P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap complete.
I20260709 13:12:27.618847  3100 ts_tablet_manager.cc:1403] T 583390912c6d4daca2df9b5534fb8dca P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.034s	user 0.016s	sys 0.010s
I20260709 13:12:27.626637  3100 raft_consensus.cc:359] T 583390912c6d4daca2df9b5534fb8dca P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:27.630422  3100 raft_consensus.cc:740] T 583390912c6d4daca2df9b5534fb8dca P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.631804  3100 consensus_queue.cc:260] T 583390912c6d4daca2df9b5534fb8dca P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:27.633834  3100 ts_tablet_manager.cc:1434] T 583390912c6d4daca2df9b5534fb8dca P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.002s
I20260709 13:12:27.634598  3100 tablet_bootstrap.cc:492] T 7e3782f3d54b4a19bacbd125c31127a9 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap starting.
I20260709 13:12:27.649294  3100 tablet_bootstrap.cc:492] T 7e3782f3d54b4a19bacbd125c31127a9 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:27.650171  3100 tablet_bootstrap.cc:492] T 7e3782f3d54b4a19bacbd125c31127a9 P 2ac5c5682f914ed9b9982b5a080d5472: Bootstrap complete.
I20260709 13:12:27.650760  3100 ts_tablet_manager.cc:1403] T 7e3782f3d54b4a19bacbd125c31127a9 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.003s
I20260709 13:12:27.653141  3100 raft_consensus.cc:359] T 7e3782f3d54b4a19bacbd125c31127a9 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:27.653779  3100 raft_consensus.cc:740] T 7e3782f3d54b4a19bacbd125c31127a9 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Initialized, Role: FOLLOWER
I20260709 13:12:27.654501  3100 consensus_queue.cc:260] T 7e3782f3d54b4a19bacbd125c31127a9 P 2ac5c5682f914ed9b9982b5a080d5472 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:27.655895  3100 ts_tablet_manager.cc:1434] T 7e3782f3d54b4a19bacbd125c31127a9 P 2ac5c5682f914ed9b9982b5a080d5472: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:12:27.849253  2198 raft_consensus.cc:1275] T 0bd8fc2d57c14adeaeae16583eef7c84 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Refusing update from remote peer 79b6e57d59e4468ebe4423d871a31b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:27.850296  2916 consensus_queue.cc:1048] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:27.863602  3211 raft_consensus.cc:1275] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Refusing update from remote peer 79b6e57d59e4468ebe4423d871a31b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:27.865091  2916 consensus_queue.cc:1048] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:27.942806  3211 raft_consensus.cc:3060] T 10de08c2346d47dbbd720596cd7e02fd P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:30.070896  2310 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:36557, user_credentials={real_user=slave}} blocked reactor thread for 165765us
W20260709 13:12:30.571385  2236 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.65:36557, user_credentials={real_user=slave}} blocked reactor thread for 218421us
W20260709 13:12:30.721170  2162 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:34303, user_credentials={real_user=slave}} blocked reactor thread for 147527us
W20260709 13:12:31.394554  2293 debug-util.cc:398] Leaking SignalData structure 0x7b08000b7a20 after lost signal to thread 28892
W20260709 13:12:31.395578  2293 debug-util.cc:398] Leaking SignalData structure 0x7b08003e8dc0 after lost signal to thread 2055
W20260709 13:12:31.396770  2293 debug-util.cc:398] Leaking SignalData structure 0x7b080015f420 after lost signal to thread 2222
W20260709 13:12:31.397833  2293 debug-util.cc:398] Leaking SignalData structure 0x7b08000ff6a0 after lost signal to thread 2296
W20260709 13:12:31.398892  2293 debug-util.cc:398] Leaking SignalData structure 0x7b08001d6cc0 after lost signal to thread 2370
W20260709 13:12:31.399794  2293 debug-util.cc:398] Leaking SignalData structure 0x7b0800110960 after lost signal to thread 3245
I20260709 13:12:36.861626 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:36.921675  2196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "67db2f978ea64fbd9a32274d4ad374c9"
dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
mode: GRACEFUL
new_leader_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
 from {username='slave'} at 127.0.0.1:59830
I20260709 13:12:36.922314  2196 raft_consensus.cc:606] T 67db2f978ea64fbd9a32274d4ad374c9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 LEADER]: Received request to transfer leadership to TS 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:36.924499  2196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d2f88787abb54ffea037f35cf48b22c4"
dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
mode: GRACEFUL
new_leader_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
 from {username='slave'} at 127.0.0.1:59830
I20260709 13:12:36.924891  2196 raft_consensus.cc:606] T d2f88787abb54ffea037f35cf48b22c4 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 LEADER]: Received request to transfer leadership to TS 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:36.926954  2196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3370eb67fff4896b1f8e3ce56eceb9b"
dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
mode: GRACEFUL
new_leader_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
 from {username='slave'} at 127.0.0.1:59830
I20260709 13:12:36.927345  2196 raft_consensus.cc:606] T d3370eb67fff4896b1f8e3ce56eceb9b P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 LEADER]: Received request to transfer leadership to TS 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:36.937404  2339 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7a50365dcc843f4a4f6bfb29a736f26"
dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
mode: GRACEFUL
new_leader_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
 from {username='slave'} at 127.0.0.1:47418
I20260709 13:12:36.937855  2339 raft_consensus.cc:606] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 LEADER]: Received request to transfer leadership to TS 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:36.939921  2196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dc33c7c3cfd14ab7a99e39cfd971fc3c"
dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
mode: GRACEFUL
new_leader_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
 from {username='slave'} at 127.0.0.1:59830
I20260709 13:12:36.940421  2196 raft_consensus.cc:606] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 LEADER]: Received request to transfer leadership to TS 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:36.942464  2196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e259bf23e7904d9fb8b2345bb5b667f3"
dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
mode: GRACEFUL
new_leader_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
 from {username='slave'} at 127.0.0.1:59830
I20260709 13:12:36.942836  2196 raft_consensus.cc:606] T e259bf23e7904d9fb8b2345bb5b667f3 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 LEADER]: Received request to transfer leadership to TS 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:36.943841 28889 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 13:12:36.945387 28889 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:37.044600  3342 raft_consensus.cc:993] T d3370eb67fff4896b1f8e3ce56eceb9b P 0ec6a5d1452a41bd992a8c7922473b35: : Instructing follower 2ac5c5682f914ed9b9982b5a080d5472 to start an election
I20260709 13:12:37.045181  3321 raft_consensus.cc:1081] T d3370eb67fff4896b1f8e3ce56eceb9b P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 LEADER]: Signalling peer 2ac5c5682f914ed9b9982b5a080d5472 to start an election
I20260709 13:12:37.046592  3181 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3370eb67fff4896b1f8e3ce56eceb9b"
dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
 from {username='slave'} at 127.0.0.1:50832
I20260709 13:12:37.047178  3181 raft_consensus.cc:493] T d3370eb67fff4896b1f8e3ce56eceb9b P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:37.047595  3181 raft_consensus.cc:3060] T d3370eb67fff4896b1f8e3ce56eceb9b P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:37.056551  3181 raft_consensus.cc:515] T d3370eb67fff4896b1f8e3ce56eceb9b P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:37.059789  3181 leader_election.cc:290] T d3370eb67fff4896b1f8e3ce56eceb9b P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 election: Requested vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:37.059962  2196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3370eb67fff4896b1f8e3ce56eceb9b" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:37.059872  2339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3370eb67fff4896b1f8e3ce56eceb9b" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:37.060910  2196 raft_consensus.cc:3055] T d3370eb67fff4896b1f8e3ce56eceb9b P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:37.061230  2196 raft_consensus.cc:740] T d3370eb67fff4896b1f8e3ce56eceb9b P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Running, Role: LEADER
I20260709 13:12:37.061178  2339 raft_consensus.cc:3060] T d3370eb67fff4896b1f8e3ce56eceb9b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:37.061944  3342 raft_consensus.cc:993] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 0ec6a5d1452a41bd992a8c7922473b35: : Instructing follower 2ac5c5682f914ed9b9982b5a080d5472 to start an election
I20260709 13:12:37.062585  3342 raft_consensus.cc:1081] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 LEADER]: Signalling peer 2ac5c5682f914ed9b9982b5a080d5472 to start an election
I20260709 13:12:37.062403  2196 consensus_queue.cc:260] T d3370eb67fff4896b1f8e3ce56eceb9b P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:37.063771  2196 raft_consensus.cc:3060] T d3370eb67fff4896b1f8e3ce56eceb9b P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:37.065039  3181 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dc33c7c3cfd14ab7a99e39cfd971fc3c"
dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
 from {username='slave'} at 127.0.0.1:50832
I20260709 13:12:37.065610  3181 raft_consensus.cc:493] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:37.065996  3181 raft_consensus.cc:3060] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:37.070490  2339 raft_consensus.cc:2468] T d3370eb67fff4896b1f8e3ce56eceb9b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 2.
I20260709 13:12:37.071766  3094 leader_election.cc:304] T d3370eb67fff4896b1f8e3ce56eceb9b P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:37.073314  2196 raft_consensus.cc:2468] T d3370eb67fff4896b1f8e3ce56eceb9b P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 2.
I20260709 13:12:37.074604  3181 raft_consensus.cc:515] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:37.075016  3348 raft_consensus.cc:2804] T d3370eb67fff4896b1f8e3ce56eceb9b P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:37.077258  3181 leader_election.cc:290] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 election: Requested vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:37.078862  2196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc33c7c3cfd14ab7a99e39cfd971fc3c" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:37.079411  2196 raft_consensus.cc:3055] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:37.079694  2196 raft_consensus.cc:740] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Running, Role: LEADER
I20260709 13:12:37.080408  2196 consensus_queue.cc:260] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:37.081450  2196 raft_consensus.cc:3060] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:37.089140  2196 raft_consensus.cc:2468] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 2.
I20260709 13:12:37.090332  3095 leader_election.cc:304] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472; no voters: 
I20260709 13:12:37.102195  3350 raft_consensus.cc:2804] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:37.102742  3350 raft_consensus.cc:697] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 LEADER]: Becoming Leader. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Running, Role: LEADER
I20260709 13:12:37.105641  3350 consensus_queue.cc:237] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:37.106913  2339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dc33c7c3cfd14ab7a99e39cfd971fc3c" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:37.107491  2339 raft_consensus.cc:3060] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:37.122201  3348 raft_consensus.cc:697] T d3370eb67fff4896b1f8e3ce56eceb9b P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 LEADER]: Becoming Leader. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Running, Role: LEADER
I20260709 13:12:37.123340  3348 consensus_queue.cc:237] T d3370eb67fff4896b1f8e3ce56eceb9b P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:37.141422  2339 raft_consensus.cc:2468] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 2.
I20260709 13:12:37.152158  2020 catalog_manager.cc:5697] T d3370eb67fff4896b1f8e3ce56eceb9b P 2ac5c5682f914ed9b9982b5a080d5472 reported cstate change: term changed from 1 to 2, leader changed from 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66) to 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65). New cstate: current_term: 2 leader_uuid: "2ac5c5682f914ed9b9982b5a080d5472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:37.173913  2020 catalog_manager.cc:5697] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 2ac5c5682f914ed9b9982b5a080d5472 reported cstate change: term changed from 1 to 2, leader changed from 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66) to 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65). New cstate: current_term: 2 leader_uuid: "2ac5c5682f914ed9b9982b5a080d5472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:37.226250  3342 raft_consensus.cc:993] T 67db2f978ea64fbd9a32274d4ad374c9 P 0ec6a5d1452a41bd992a8c7922473b35: : Instructing follower 2ac5c5682f914ed9b9982b5a080d5472 to start an election
I20260709 13:12:37.226735  3351 raft_consensus.cc:1081] T 67db2f978ea64fbd9a32274d4ad374c9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 LEADER]: Signalling peer 2ac5c5682f914ed9b9982b5a080d5472 to start an election
I20260709 13:12:37.228055  3181 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "67db2f978ea64fbd9a32274d4ad374c9"
dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
 from {username='slave'} at 127.0.0.1:50832
I20260709 13:12:37.228456  3181 raft_consensus.cc:493] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:37.228706  3181 raft_consensus.cc:3060] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:37.233507  3181 raft_consensus.cc:515] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:37.234928  3181 leader_election.cc:290] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 4 election: Requested vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:37.235555  2196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67db2f978ea64fbd9a32274d4ad374c9" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:37.236056  2196 raft_consensus.cc:3055] T 67db2f978ea64fbd9a32274d4ad374c9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:37.235975  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "67db2f978ea64fbd9a32274d4ad374c9" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:37.236362  2196 raft_consensus.cc:740] T 67db2f978ea64fbd9a32274d4ad374c9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Running, Role: LEADER
I20260709 13:12:37.236538  2269 raft_consensus.cc:3060] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:37.237089  2196 consensus_queue.cc:260] T 67db2f978ea64fbd9a32274d4ad374c9 P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:37.238044  2196 raft_consensus.cc:3060] T 67db2f978ea64fbd9a32274d4ad374c9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:37.241195  2269 raft_consensus.cc:2468] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 4.
I20260709 13:12:37.242340  3094 leader_election.cc:304] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:37.242872  2196 raft_consensus.cc:2468] T 67db2f978ea64fbd9a32274d4ad374c9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 4.
I20260709 13:12:37.243119  3348 raft_consensus.cc:2804] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:37.243680  3348 raft_consensus.cc:697] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472 [term 4 LEADER]: Becoming Leader. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Running, Role: LEADER
I20260709 13:12:37.244586  3348 consensus_queue.cc:237] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:37.253144  2020 catalog_manager.cc:5697] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472 reported cstate change: term changed from 3 to 4, leader changed from 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66) to 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65). New cstate: current_term: 4 leader_uuid: "2ac5c5682f914ed9b9982b5a080d5472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:37.365325  3343 raft_consensus.cc:993] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea: : Instructing follower 2ac5c5682f914ed9b9982b5a080d5472 to start an election
I20260709 13:12:37.365968  3353 raft_consensus.cc:1081] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 LEADER]: Signalling peer 2ac5c5682f914ed9b9982b5a080d5472 to start an election
I20260709 13:12:37.367475  3176 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d7a50365dcc843f4a4f6bfb29a736f26"
dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
 from {username='slave'} at 127.0.0.1:50844
I20260709 13:12:37.367887  3176 raft_consensus.cc:493] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:37.368214  3176 raft_consensus.cc:3060] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:37.374197  3176 raft_consensus.cc:515] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:37.376698  2339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a50365dcc843f4a4f6bfb29a736f26" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:37.377275  2339 raft_consensus.cc:3055] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:37.377539  2339 raft_consensus.cc:740] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Running, Role: LEADER
I20260709 13:12:37.378409  3321 raft_consensus.cc:993] T d2f88787abb54ffea037f35cf48b22c4 P 0ec6a5d1452a41bd992a8c7922473b35: : Instructing follower 2ac5c5682f914ed9b9982b5a080d5472 to start an election
I20260709 13:12:37.378299  2339 consensus_queue.cc:260] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:37.378775  3176 leader_election.cc:290] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 3 election: Requested vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:37.378938  3351 raft_consensus.cc:1081] T d2f88787abb54ffea037f35cf48b22c4 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 LEADER]: Signalling peer 2ac5c5682f914ed9b9982b5a080d5472 to start an election
I20260709 13:12:37.379885  2192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7a50365dcc843f4a4f6bfb29a736f26" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:37.379398  2339 raft_consensus.cc:3060] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:37.380429  2192 raft_consensus.cc:3060] T d7a50365dcc843f4a4f6bfb29a736f26 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:37.381203  3176 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d2f88787abb54ffea037f35cf48b22c4"
dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
 from {username='slave'} at 127.0.0.1:50832
I20260709 13:12:37.381698  3176 raft_consensus.cc:493] T d2f88787abb54ffea037f35cf48b22c4 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:37.382189  3176 raft_consensus.cc:3060] T d2f88787abb54ffea037f35cf48b22c4 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:37.386759  2339 raft_consensus.cc:2468] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 3.
I20260709 13:12:37.387557  2192 raft_consensus.cc:2468] T d7a50365dcc843f4a4f6bfb29a736f26 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 3.
I20260709 13:12:37.388625  3095 leader_election.cc:304] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472; no voters: 
I20260709 13:12:37.389129  3176 raft_consensus.cc:515] T d2f88787abb54ffea037f35cf48b22c4 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:37.389425  3348 raft_consensus.cc:2804] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:37.390015  3348 raft_consensus.cc:697] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 LEADER]: Becoming Leader. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Running, Role: LEADER
I20260709 13:12:37.391157  3176 leader_election.cc:290] T d2f88787abb54ffea037f35cf48b22c4 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 election: Requested vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:37.390910  3348 consensus_queue.cc:237] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:37.395148  2192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f88787abb54ffea037f35cf48b22c4" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:37.395764  2192 raft_consensus.cc:3055] T d2f88787abb54ffea037f35cf48b22c4 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:37.396100  2192 raft_consensus.cc:740] T d2f88787abb54ffea037f35cf48b22c4 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Running, Role: LEADER
I20260709 13:12:37.396941  2192 consensus_queue.cc:260] T d2f88787abb54ffea037f35cf48b22c4 P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:37.398084  2192 raft_consensus.cc:3060] T d2f88787abb54ffea037f35cf48b22c4 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:37.398514  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d2f88787abb54ffea037f35cf48b22c4" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:37.399310  2269 raft_consensus.cc:3060] T d2f88787abb54ffea037f35cf48b22c4 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:37.405083  2192 raft_consensus.cc:2468] T d2f88787abb54ffea037f35cf48b22c4 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 2.
I20260709 13:12:37.406534  3095 leader_election.cc:304] T d2f88787abb54ffea037f35cf48b22c4 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472; no voters: 
I20260709 13:12:37.407393  3349 raft_consensus.cc:2804] T d2f88787abb54ffea037f35cf48b22c4 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:37.407620  2269 raft_consensus.cc:2468] T d2f88787abb54ffea037f35cf48b22c4 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 2.
I20260709 13:12:37.407884  3349 raft_consensus.cc:697] T d2f88787abb54ffea037f35cf48b22c4 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 LEADER]: Becoming Leader. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Running, Role: LEADER
I20260709 13:12:37.408816  3349 consensus_queue.cc:237] T d2f88787abb54ffea037f35cf48b22c4 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:37.420428  2020 catalog_manager.cc:5697] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472 reported cstate change: term changed from 2 to 3, leader changed from 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68) to 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65). New cstate: current_term: 3 leader_uuid: "2ac5c5682f914ed9b9982b5a080d5472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:37.435305  2020 catalog_manager.cc:5697] T d2f88787abb54ffea037f35cf48b22c4 P 2ac5c5682f914ed9b9982b5a080d5472 reported cstate change: term changed from 1 to 2, leader changed from 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66) to 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65). New cstate: current_term: 2 leader_uuid: "2ac5c5682f914ed9b9982b5a080d5472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:37.483418  3342 raft_consensus.cc:993] T e259bf23e7904d9fb8b2345bb5b667f3 P 0ec6a5d1452a41bd992a8c7922473b35: : Instructing follower 2ac5c5682f914ed9b9982b5a080d5472 to start an election
I20260709 13:12:37.484005  3355 raft_consensus.cc:1081] T e259bf23e7904d9fb8b2345bb5b667f3 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 LEADER]: Signalling peer 2ac5c5682f914ed9b9982b5a080d5472 to start an election
I20260709 13:12:37.485430  3176 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e259bf23e7904d9fb8b2345bb5b667f3"
dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
 from {username='slave'} at 127.0.0.1:50832
I20260709 13:12:37.486387  3176 raft_consensus.cc:493] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:37.486789  3176 raft_consensus.cc:3060] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:37.492424  3176 raft_consensus.cc:515] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:37.494176  3176 leader_election.cc:290] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 4 election: Requested vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:37.494643  2269 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e259bf23e7904d9fb8b2345bb5b667f3" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:37.495236  2269 raft_consensus.cc:3060] T e259bf23e7904d9fb8b2345bb5b667f3 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:37.494637  2192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e259bf23e7904d9fb8b2345bb5b667f3" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:37.498255  2192 raft_consensus.cc:3055] T e259bf23e7904d9fb8b2345bb5b667f3 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:37.498456  2192 raft_consensus.cc:740] T e259bf23e7904d9fb8b2345bb5b667f3 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Running, Role: LEADER
I20260709 13:12:37.499073  2192 consensus_queue.cc:260] T e259bf23e7904d9fb8b2345bb5b667f3 P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:37.499545  2269 raft_consensus.cc:2468] T e259bf23e7904d9fb8b2345bb5b667f3 P 79b6e57d59e4468ebe4423d871a31b39 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 4.
I20260709 13:12:37.499898  2192 raft_consensus.cc:3060] T e259bf23e7904d9fb8b2345bb5b667f3 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:37.500345  3094 leader_election.cc:304] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:37.500970  3349 raft_consensus.cc:2804] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:37.501437  3349 raft_consensus.cc:697] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472 [term 4 LEADER]: Becoming Leader. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Running, Role: LEADER
I20260709 13:12:37.502276  3349 consensus_queue.cc:237] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:37.505731  2192 raft_consensus.cc:2468] T e259bf23e7904d9fb8b2345bb5b667f3 P 0ec6a5d1452a41bd992a8c7922473b35 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 4.
I20260709 13:12:37.511554  2020 catalog_manager.cc:5697] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472 reported cstate change: term changed from 3 to 4, leader changed from 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66) to 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65). New cstate: current_term: 4 leader_uuid: "2ac5c5682f914ed9b9982b5a080d5472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:37.650203  2339 raft_consensus.cc:1275] T d3370eb67fff4896b1f8e3ce56eceb9b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Refusing update from remote peer 2ac5c5682f914ed9b9982b5a080d5472: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:37.651392  3349 consensus_queue.cc:1048] T d3370eb67fff4896b1f8e3ce56eceb9b P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:37.654799  2192 raft_consensus.cc:1275] T 67db2f978ea64fbd9a32274d4ad374c9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 4 FOLLOWER]: Refusing update from remote peer 2ac5c5682f914ed9b9982b5a080d5472: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:37.656484  3349 consensus_queue.cc:1048] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:37.665366  2192 raft_consensus.cc:1275] T d3370eb67fff4896b1f8e3ce56eceb9b P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Refusing update from remote peer 2ac5c5682f914ed9b9982b5a080d5472: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:37.678807  2339 raft_consensus.cc:1275] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Refusing update from remote peer 2ac5c5682f914ed9b9982b5a080d5472: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:37.680644  3349 consensus_queue.cc:1048] T d3370eb67fff4896b1f8e3ce56eceb9b P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:37.684111  3348 consensus_queue.cc:1048] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:37.689881  2269 raft_consensus.cc:1275] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39 [term 4 FOLLOWER]: Refusing update from remote peer 2ac5c5682f914ed9b9982b5a080d5472: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:37.694538  3349 consensus_queue.cc:1048] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:37.711550  2198 raft_consensus.cc:1275] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Refusing update from remote peer 2ac5c5682f914ed9b9982b5a080d5472: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:37.713999  3349 consensus_queue.cc:1048] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:37.869027  2268 raft_consensus.cc:1275] T d2f88787abb54ffea037f35cf48b22c4 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Refusing update from remote peer 2ac5c5682f914ed9b9982b5a080d5472: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:37.869774  2198 raft_consensus.cc:1275] T d2f88787abb54ffea037f35cf48b22c4 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Refusing update from remote peer 2ac5c5682f914ed9b9982b5a080d5472: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:37.870790  3348 consensus_queue.cc:1048] T d2f88787abb54ffea037f35cf48b22c4 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:37.871754  3350 consensus_queue.cc:1048] T d2f88787abb54ffea037f35cf48b22c4 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:37.872625  2344 raft_consensus.cc:1275] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Refusing update from remote peer 2ac5c5682f914ed9b9982b5a080d5472: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:37.873836  3348 consensus_queue.cc:1048] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:37.920596  2198 raft_consensus.cc:1275] T d7a50365dcc843f4a4f6bfb29a736f26 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Refusing update from remote peer 2ac5c5682f914ed9b9982b5a080d5472: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:37.925698  3348 consensus_queue.cc:1048] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:37.946309 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:37.984464 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:38.017434  2344 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "01a3c95e54104a998cdf16d06db2800a"
dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
mode: GRACEFUL
new_leader_uuid: "79b6e57d59e4468ebe4423d871a31b39"
 from {username='slave'} at 127.0.0.1:47418
I20260709 13:12:38.017915  2344 raft_consensus.cc:606] T 01a3c95e54104a998cdf16d06db2800a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 LEADER]: Received request to transfer leadership to TS 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:38.019927  2344 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1588358a9e7542dfbd8b5d2f65212aec"
dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
mode: GRACEFUL
new_leader_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
 from {username='slave'} at 127.0.0.1:47418
I20260709 13:12:38.020309  2344 raft_consensus.cc:606] T 1588358a9e7542dfbd8b5d2f65212aec P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 LEADER]: Received request to transfer leadership to TS 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:38.022410  2196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5aac56f958fb4fe29fe46d2a9be60ffd"
dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
mode: GRACEFUL
new_leader_uuid: "79b6e57d59e4468ebe4423d871a31b39"
 from {username='slave'} at 127.0.0.1:59830
I20260709 13:12:38.022907  2196 raft_consensus.cc:606] T 5aac56f958fb4fe29fe46d2a9be60ffd P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 LEADER]: Received request to transfer leadership to TS 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:38.025166  2196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a332070dcdff450b939e74ef5b68425a"
dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
mode: GRACEFUL
new_leader_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
 from {username='slave'} at 127.0.0.1:59830
I20260709 13:12:38.025547  2196 raft_consensus.cc:606] T a332070dcdff450b939e74ef5b68425a P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 LEADER]: Received request to transfer leadership to TS 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:38.027458  2196 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ee1baa7401cd48e48e7125dcd607f44f"
dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
mode: GRACEFUL
new_leader_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
 from {username='slave'} at 127.0.0.1:59830
I20260709 13:12:38.027848  2196 raft_consensus.cc:606] T ee1baa7401cd48e48e7125dcd607f44f P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 LEADER]: Received request to transfer leadership to TS 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:38.028846 28889 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:12:38.030062 28889 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:38.044072  2196 raft_consensus.cc:1275] T e259bf23e7904d9fb8b2345bb5b667f3 P 0ec6a5d1452a41bd992a8c7922473b35 [term 4 FOLLOWER]: Refusing update from remote peer 2ac5c5682f914ed9b9982b5a080d5472: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:38.045324  3348 consensus_queue.cc:1048] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:38.056138  2268 raft_consensus.cc:1275] T e259bf23e7904d9fb8b2345bb5b667f3 P 79b6e57d59e4468ebe4423d871a31b39 [term 4 FOLLOWER]: Refusing update from remote peer 2ac5c5682f914ed9b9982b5a080d5472: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:38.057494  3348 consensus_queue.cc:1048] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:38.167354  3338 raft_consensus.cc:993] T 01a3c95e54104a998cdf16d06db2800a P 66e9a8fffd4b4e5a81ca4fa2762773ea: : Instructing follower 79b6e57d59e4468ebe4423d871a31b39 to start an election
I20260709 13:12:38.167824  3338 raft_consensus.cc:1081] T 01a3c95e54104a998cdf16d06db2800a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 LEADER]: Signalling peer 79b6e57d59e4468ebe4423d871a31b39 to start an election
I20260709 13:12:38.170933  2268 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "01a3c95e54104a998cdf16d06db2800a"
dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
 from {username='slave'} at 127.0.0.1:40692
I20260709 13:12:38.171490  2268 raft_consensus.cc:493] T 01a3c95e54104a998cdf16d06db2800a P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:38.171838  2268 raft_consensus.cc:3060] T 01a3c95e54104a998cdf16d06db2800a P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:38.178948  2268 raft_consensus.cc:515] T 01a3c95e54104a998cdf16d06db2800a P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:38.181149  2268 leader_election.cc:290] T 01a3c95e54104a998cdf16d06db2800a P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 election: Requested vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:38.182045  2339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a3c95e54104a998cdf16d06db2800a" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:38.182590  2339 raft_consensus.cc:3055] T 01a3c95e54104a998cdf16d06db2800a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:38.182879  2339 raft_consensus.cc:740] T 01a3c95e54104a998cdf16d06db2800a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Running, Role: LEADER
I20260709 13:12:38.181689  2196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01a3c95e54104a998cdf16d06db2800a" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:38.183542  2339 consensus_queue.cc:260] T 01a3c95e54104a998cdf16d06db2800a P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:38.184284  2196 raft_consensus.cc:3060] T 01a3c95e54104a998cdf16d06db2800a P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:38.184948  2339 raft_consensus.cc:3060] T 01a3c95e54104a998cdf16d06db2800a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:38.192713  2339 raft_consensus.cc:2468] T 01a3c95e54104a998cdf16d06db2800a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 3.
I20260709 13:12:38.192901  2196 raft_consensus.cc:2468] T 01a3c95e54104a998cdf16d06db2800a P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 3.
I20260709 13:12:38.194818  2236 leader_election.cc:304] T 01a3c95e54104a998cdf16d06db2800a P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:38.195822  3336 raft_consensus.cc:2804] T 01a3c95e54104a998cdf16d06db2800a P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:38.196245  3336 raft_consensus.cc:697] T 01a3c95e54104a998cdf16d06db2800a P 79b6e57d59e4468ebe4423d871a31b39 [term 3 LEADER]: Becoming Leader. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Running, Role: LEADER
I20260709 13:12:38.196985  3336 consensus_queue.cc:237] T 01a3c95e54104a998cdf16d06db2800a P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:38.224726  2019 catalog_manager.cc:5697] T 01a3c95e54104a998cdf16d06db2800a P 79b6e57d59e4468ebe4423d871a31b39 reported cstate change: term changed from 2 to 3, leader changed from 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68) to 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67). New cstate: current_term: 3 leader_uuid: "79b6e57d59e4468ebe4423d871a31b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:38.332389  3342 raft_consensus.cc:993] T 5aac56f958fb4fe29fe46d2a9be60ffd P 0ec6a5d1452a41bd992a8c7922473b35: : Instructing follower 79b6e57d59e4468ebe4423d871a31b39 to start an election
I20260709 13:12:38.332852  3342 raft_consensus.cc:1081] T 5aac56f958fb4fe29fe46d2a9be60ffd P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 LEADER]: Signalling peer 79b6e57d59e4468ebe4423d871a31b39 to start an election
I20260709 13:12:38.335361  2268 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5aac56f958fb4fe29fe46d2a9be60ffd"
dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
 from {username='slave'} at 127.0.0.1:40674
I20260709 13:12:38.335857  2268 raft_consensus.cc:493] T 5aac56f958fb4fe29fe46d2a9be60ffd P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:38.336221  2268 raft_consensus.cc:3060] T 5aac56f958fb4fe29fe46d2a9be60ffd P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:38.341922  2268 raft_consensus.cc:515] T 5aac56f958fb4fe29fe46d2a9be60ffd P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:38.343514  2268 leader_election.cc:290] T 5aac56f958fb4fe29fe46d2a9be60ffd P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 election: Requested vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:38.344071  2196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aac56f958fb4fe29fe46d2a9be60ffd" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:38.344597  2196 raft_consensus.cc:3055] T 5aac56f958fb4fe29fe46d2a9be60ffd P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:38.344537  2339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5aac56f958fb4fe29fe46d2a9be60ffd" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:38.344975  2196 raft_consensus.cc:740] T 5aac56f958fb4fe29fe46d2a9be60ffd P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Running, Role: LEADER
I20260709 13:12:38.345165  2339 raft_consensus.cc:3060] T 5aac56f958fb4fe29fe46d2a9be60ffd P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:38.345659  2196 consensus_queue.cc:260] T 5aac56f958fb4fe29fe46d2a9be60ffd P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:38.346534  2196 raft_consensus.cc:3060] T 5aac56f958fb4fe29fe46d2a9be60ffd P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:38.350189  2339 raft_consensus.cc:2468] T 5aac56f958fb4fe29fe46d2a9be60ffd P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 2.
I20260709 13:12:38.351933  2196 raft_consensus.cc:2468] T 5aac56f958fb4fe29fe46d2a9be60ffd P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 2.
I20260709 13:12:38.352131  2236 leader_election.cc:304] T 5aac56f958fb4fe29fe46d2a9be60ffd P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:38.352952  3336 raft_consensus.cc:2804] T 5aac56f958fb4fe29fe46d2a9be60ffd P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:38.353369  3336 raft_consensus.cc:697] T 5aac56f958fb4fe29fe46d2a9be60ffd P 79b6e57d59e4468ebe4423d871a31b39 [term 2 LEADER]: Becoming Leader. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Running, Role: LEADER
I20260709 13:12:38.354039  3336 consensus_queue.cc:237] T 5aac56f958fb4fe29fe46d2a9be60ffd P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:38.358464  3342 raft_consensus.cc:993] T ee1baa7401cd48e48e7125dcd607f44f P 0ec6a5d1452a41bd992a8c7922473b35: : Instructing follower 2ac5c5682f914ed9b9982b5a080d5472 to start an election
I20260709 13:12:38.359011  3382 raft_consensus.cc:1081] T ee1baa7401cd48e48e7125dcd607f44f P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 LEADER]: Signalling peer 2ac5c5682f914ed9b9982b5a080d5472 to start an election
I20260709 13:12:38.360368  3176 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ee1baa7401cd48e48e7125dcd607f44f"
dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
 from {username='slave'} at 127.0.0.1:50832
I20260709 13:12:38.360838  3176 raft_consensus.cc:493] T ee1baa7401cd48e48e7125dcd607f44f P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:38.361088  3176 raft_consensus.cc:3060] T ee1baa7401cd48e48e7125dcd607f44f P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:38.362854  2019 catalog_manager.cc:5697] T 5aac56f958fb4fe29fe46d2a9be60ffd P 79b6e57d59e4468ebe4423d871a31b39 reported cstate change: term changed from 1 to 2, leader changed from 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66) to 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67). New cstate: current_term: 2 leader_uuid: "79b6e57d59e4468ebe4423d871a31b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:38.366629  3176 raft_consensus.cc:515] T ee1baa7401cd48e48e7125dcd607f44f P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:38.368310  3176 leader_election.cc:290] T ee1baa7401cd48e48e7125dcd607f44f P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 election: Requested vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:38.368902  2339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee1baa7401cd48e48e7125dcd607f44f" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:38.369248  2196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ee1baa7401cd48e48e7125dcd607f44f" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:38.369669  2339 raft_consensus.cc:3060] T ee1baa7401cd48e48e7125dcd607f44f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:38.370371  2196 raft_consensus.cc:3055] T ee1baa7401cd48e48e7125dcd607f44f P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:38.370667  2196 raft_consensus.cc:740] T ee1baa7401cd48e48e7125dcd607f44f P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Running, Role: LEADER
I20260709 13:12:38.371405  2196 consensus_queue.cc:260] T ee1baa7401cd48e48e7125dcd607f44f P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:38.372409  2196 raft_consensus.cc:3060] T ee1baa7401cd48e48e7125dcd607f44f P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:38.376144  2339 raft_consensus.cc:2468] T ee1baa7401cd48e48e7125dcd607f44f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 2.
I20260709 13:12:38.376914  2196 raft_consensus.cc:2468] T ee1baa7401cd48e48e7125dcd607f44f P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 2.
I20260709 13:12:38.377020  3094 leader_election.cc:304] T ee1baa7401cd48e48e7125dcd607f44f P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:38.377776  3348 raft_consensus.cc:2804] T ee1baa7401cd48e48e7125dcd607f44f P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:38.378160  3348 raft_consensus.cc:697] T ee1baa7401cd48e48e7125dcd607f44f P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 LEADER]: Becoming Leader. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Running, Role: LEADER
I20260709 13:12:38.378906  3348 consensus_queue.cc:237] T ee1baa7401cd48e48e7125dcd607f44f P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:38.387414  2019 catalog_manager.cc:5697] T ee1baa7401cd48e48e7125dcd607f44f P 2ac5c5682f914ed9b9982b5a080d5472 reported cstate change: term changed from 1 to 2, leader changed from 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66) to 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65). New cstate: current_term: 2 leader_uuid: "2ac5c5682f914ed9b9982b5a080d5472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:38.431867  3338 raft_consensus.cc:993] T 1588358a9e7542dfbd8b5d2f65212aec P 66e9a8fffd4b4e5a81ca4fa2762773ea: : Instructing follower 2ac5c5682f914ed9b9982b5a080d5472 to start an election
I20260709 13:12:38.432350  3338 raft_consensus.cc:1081] T 1588358a9e7542dfbd8b5d2f65212aec P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 LEADER]: Signalling peer 2ac5c5682f914ed9b9982b5a080d5472 to start an election
I20260709 13:12:38.433712  3176 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1588358a9e7542dfbd8b5d2f65212aec"
dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
 from {username='slave'} at 127.0.0.1:50844
I20260709 13:12:38.434262  3176 raft_consensus.cc:493] T 1588358a9e7542dfbd8b5d2f65212aec P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:38.434585  3176 raft_consensus.cc:3060] T 1588358a9e7542dfbd8b5d2f65212aec P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:38.440122  3176 raft_consensus.cc:515] T 1588358a9e7542dfbd8b5d2f65212aec P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:38.441368  3176 leader_election.cc:290] T 1588358a9e7542dfbd8b5d2f65212aec P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 election: Requested vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:38.442013  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1588358a9e7542dfbd8b5d2f65212aec" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:38.442299  2339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1588358a9e7542dfbd8b5d2f65212aec" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:38.442556  2268 raft_consensus.cc:3060] T 1588358a9e7542dfbd8b5d2f65212aec P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:38.442822  2339 raft_consensus.cc:3055] T 1588358a9e7542dfbd8b5d2f65212aec P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:38.443074  2339 raft_consensus.cc:740] T 1588358a9e7542dfbd8b5d2f65212aec P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Running, Role: LEADER
I20260709 13:12:38.443611  2339 consensus_queue.cc:260] T 1588358a9e7542dfbd8b5d2f65212aec P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:38.444480  2339 raft_consensus.cc:3060] T 1588358a9e7542dfbd8b5d2f65212aec P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:38.449714  2339 raft_consensus.cc:2468] T 1588358a9e7542dfbd8b5d2f65212aec P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 2.
I20260709 13:12:38.450496  3094 leader_election.cc:304] T 1588358a9e7542dfbd8b5d2f65212aec P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:38.451164  3348 raft_consensus.cc:2804] T 1588358a9e7542dfbd8b5d2f65212aec P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:38.451646  3348 raft_consensus.cc:697] T 1588358a9e7542dfbd8b5d2f65212aec P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 LEADER]: Becoming Leader. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Running, Role: LEADER
I20260709 13:12:38.451689  2268 raft_consensus.cc:2468] T 1588358a9e7542dfbd8b5d2f65212aec P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 2.
I20260709 13:12:38.452543  3348 consensus_queue.cc:237] T 1588358a9e7542dfbd8b5d2f65212aec P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:38.461141  2019 catalog_manager.cc:5697] T 1588358a9e7542dfbd8b5d2f65212aec P 2ac5c5682f914ed9b9982b5a080d5472 reported cstate change: term changed from 1 to 2, leader changed from 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68) to 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65). New cstate: current_term: 2 leader_uuid: "2ac5c5682f914ed9b9982b5a080d5472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:38.565897  3382 raft_consensus.cc:993] T a332070dcdff450b939e74ef5b68425a P 0ec6a5d1452a41bd992a8c7922473b35: : Instructing follower 2ac5c5682f914ed9b9982b5a080d5472 to start an election
I20260709 13:12:38.566342  3342 raft_consensus.cc:1081] T a332070dcdff450b939e74ef5b68425a P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 LEADER]: Signalling peer 2ac5c5682f914ed9b9982b5a080d5472 to start an election
I20260709 13:12:38.567545  3176 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a332070dcdff450b939e74ef5b68425a"
dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
 from {username='slave'} at 127.0.0.1:50832
I20260709 13:12:38.568032  3176 raft_consensus.cc:493] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:38.568372  3176 raft_consensus.cc:3060] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:38.572947  3176 raft_consensus.cc:515] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:38.574344  3176 leader_election.cc:290] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 3 election: Requested vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:38.574926  2339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a332070dcdff450b939e74ef5b68425a" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:38.575212  2196 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a332070dcdff450b939e74ef5b68425a" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:38.575562  2339 raft_consensus.cc:3060] T a332070dcdff450b939e74ef5b68425a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:38.575841  2196 raft_consensus.cc:3055] T a332070dcdff450b939e74ef5b68425a P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:38.576150  2196 raft_consensus.cc:740] T a332070dcdff450b939e74ef5b68425a P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Running, Role: LEADER
I20260709 13:12:38.576905  2196 consensus_queue.cc:260] T a332070dcdff450b939e74ef5b68425a P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:38.578123  2196 raft_consensus.cc:3060] T a332070dcdff450b939e74ef5b68425a P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:38.584803  2339 raft_consensus.cc:2468] T a332070dcdff450b939e74ef5b68425a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 3.
I20260709 13:12:38.585942  3094 leader_election.cc:304] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 
I20260709 13:12:38.586601  3348 raft_consensus.cc:2804] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:38.587066  3348 raft_consensus.cc:697] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 LEADER]: Becoming Leader. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Running, Role: LEADER
I20260709 13:12:38.587589  2196 raft_consensus.cc:2468] T a332070dcdff450b939e74ef5b68425a P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 3.
I20260709 13:12:38.587920  3348 consensus_queue.cc:237] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:38.596582  2019 catalog_manager.cc:5697] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472 reported cstate change: term changed from 2 to 3, leader changed from 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66) to 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65). New cstate: current_term: 3 leader_uuid: "2ac5c5682f914ed9b9982b5a080d5472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:38.629878  2196 raft_consensus.cc:1275] T 01a3c95e54104a998cdf16d06db2800a P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Refusing update from remote peer 79b6e57d59e4468ebe4423d871a31b39: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:38.631100  3336 consensus_queue.cc:1048] T 01a3c95e54104a998cdf16d06db2800a P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:38.647372  2339 raft_consensus.cc:1275] T 01a3c95e54104a998cdf16d06db2800a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Refusing update from remote peer 79b6e57d59e4468ebe4423d871a31b39: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:38.648619  3336 consensus_queue.cc:1048] T 01a3c95e54104a998cdf16d06db2800a P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:38.767791  2339 raft_consensus.cc:1275] T ee1baa7401cd48e48e7125dcd607f44f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Refusing update from remote peer 2ac5c5682f914ed9b9982b5a080d5472: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:38.768790  3348 consensus_queue.cc:1048] T ee1baa7401cd48e48e7125dcd607f44f P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:38.780966  2196 raft_consensus.cc:1275] T ee1baa7401cd48e48e7125dcd607f44f P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Refusing update from remote peer 2ac5c5682f914ed9b9982b5a080d5472: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:38.782701  3348 consensus_queue.cc:1048] T ee1baa7401cd48e48e7125dcd607f44f P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:38.852088  2196 raft_consensus.cc:1275] T 5aac56f958fb4fe29fe46d2a9be60ffd P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Refusing update from remote peer 79b6e57d59e4468ebe4423d871a31b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:38.853304  3336 consensus_queue.cc:1048] T 5aac56f958fb4fe29fe46d2a9be60ffd P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:38.870414  2339 raft_consensus.cc:1275] T 5aac56f958fb4fe29fe46d2a9be60ffd P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Refusing update from remote peer 79b6e57d59e4468ebe4423d871a31b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:38.875046  3336 consensus_queue.cc:1048] T 5aac56f958fb4fe29fe46d2a9be60ffd P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:38.957435  2268 raft_consensus.cc:1275] T 1588358a9e7542dfbd8b5d2f65212aec P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Refusing update from remote peer 2ac5c5682f914ed9b9982b5a080d5472: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:38.958498  3348 consensus_queue.cc:1048] T 1588358a9e7542dfbd8b5d2f65212aec P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:38.966310  2344 raft_consensus.cc:1275] T 1588358a9e7542dfbd8b5d2f65212aec P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Refusing update from remote peer 2ac5c5682f914ed9b9982b5a080d5472: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:38.968233  3350 consensus_queue.cc:1048] T 1588358a9e7542dfbd8b5d2f65212aec P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:39.030977 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:39.067782 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:39.103845  2344 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78734884e0a441759b51d258ad2697aa"
dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
mode: GRACEFUL
new_leader_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
 from {username='slave'} at 127.0.0.1:47418
I20260709 13:12:39.104429  2344 raft_consensus.cc:606] T 78734884e0a441759b51d258ad2697aa P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 LEADER]: Received request to transfer leadership to TS 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:39.106984  2344 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8a672ef15abf47e4b650405c29044d3e"
dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
mode: GRACEFUL
new_leader_uuid: "79b6e57d59e4468ebe4423d871a31b39"
 from {username='slave'} at 127.0.0.1:47418
I20260709 13:12:39.107379  2344 raft_consensus.cc:606] T 8a672ef15abf47e4b650405c29044d3e P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 LEADER]: Received request to transfer leadership to TS 79b6e57d59e4468ebe4423d871a31b39
I20260709 13:12:39.109318  2344 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "93d627aa01fd4aefbbae482eb2fb2453"
dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
mode: GRACEFUL
new_leader_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
 from {username='slave'} at 127.0.0.1:47418
I20260709 13:12:39.109680  2344 raft_consensus.cc:606] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 LEADER]: Received request to transfer leadership to TS 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:39.111433  2344 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d4e943e5bbd7402da6bcc00db70cec14"
dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
mode: GRACEFUL
new_leader_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
 from {username='slave'} at 127.0.0.1:47418
I20260709 13:12:39.111814  2344 raft_consensus.cc:606] T d4e943e5bbd7402da6bcc00db70cec14 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 LEADER]: Received request to transfer leadership to TS 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:39.113691  2344 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f2a1307186df4616a9759118c2e456a6"
dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
mode: GRACEFUL
new_leader_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
 from {username='slave'} at 127.0.0.1:47418
I20260709 13:12:39.114100  2344 raft_consensus.cc:606] T f2a1307186df4616a9759118c2e456a6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 LEADER]: Received request to transfer leadership to TS 0ec6a5d1452a41bd992a8c7922473b35
I20260709 13:12:39.115087 28889 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 13:12:39.116098 28889 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:39.182723  2344 raft_consensus.cc:1275] T a332070dcdff450b939e74ef5b68425a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Refusing update from remote peer 2ac5c5682f914ed9b9982b5a080d5472: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:39.183878  3350 consensus_queue.cc:1048] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:39.194128  2198 raft_consensus.cc:1275] T a332070dcdff450b939e74ef5b68425a P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Refusing update from remote peer 2ac5c5682f914ed9b9982b5a080d5472: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:39.195227  3369 consensus_queue.cc:1048] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:39.324685  3343 raft_consensus.cc:993] T 8a672ef15abf47e4b650405c29044d3e P 66e9a8fffd4b4e5a81ca4fa2762773ea: : Instructing follower 79b6e57d59e4468ebe4423d871a31b39 to start an election
I20260709 13:12:39.325129  3338 raft_consensus.cc:1081] T 8a672ef15abf47e4b650405c29044d3e P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 LEADER]: Signalling peer 79b6e57d59e4468ebe4423d871a31b39 to start an election
I20260709 13:12:39.326853  2268 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8a672ef15abf47e4b650405c29044d3e"
dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
 from {username='slave'} at 127.0.0.1:40692
I20260709 13:12:39.327329  2268 raft_consensus.cc:493] T 8a672ef15abf47e4b650405c29044d3e P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:39.327567  2268 raft_consensus.cc:3060] T 8a672ef15abf47e4b650405c29044d3e P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:39.332595  2268 raft_consensus.cc:515] T 8a672ef15abf47e4b650405c29044d3e P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:39.334283  2268 leader_election.cc:290] T 8a672ef15abf47e4b650405c29044d3e P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 election: Requested vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:39.334849  2192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a672ef15abf47e4b650405c29044d3e" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:39.335407  2192 raft_consensus.cc:3060] T 8a672ef15abf47e4b650405c29044d3e P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:39.338886  2339 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8a672ef15abf47e4b650405c29044d3e" candidate_uuid: "79b6e57d59e4468ebe4423d871a31b39" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:39.339442  2339 raft_consensus.cc:3055] T 8a672ef15abf47e4b650405c29044d3e P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:39.339717  2339 raft_consensus.cc:740] T 8a672ef15abf47e4b650405c29044d3e P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Running, Role: LEADER
I20260709 13:12:39.340216  2192 raft_consensus.cc:2468] T 8a672ef15abf47e4b650405c29044d3e P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 2.
I20260709 13:12:39.340430  2339 consensus_queue.cc:260] T 8a672ef15abf47e4b650405c29044d3e P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:39.341193  2237 leader_election.cc:304] T 8a672ef15abf47e4b650405c29044d3e P 79b6e57d59e4468ebe4423d871a31b39 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:39.341636  2339 raft_consensus.cc:3060] T 8a672ef15abf47e4b650405c29044d3e P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:39.341784  3336 raft_consensus.cc:2804] T 8a672ef15abf47e4b650405c29044d3e P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:39.342293  3336 raft_consensus.cc:697] T 8a672ef15abf47e4b650405c29044d3e P 79b6e57d59e4468ebe4423d871a31b39 [term 2 LEADER]: Becoming Leader. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Running, Role: LEADER
I20260709 13:12:39.342998  3336 consensus_queue.cc:237] T 8a672ef15abf47e4b650405c29044d3e P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:39.347498  2339 raft_consensus.cc:2468] T 8a672ef15abf47e4b650405c29044d3e P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79b6e57d59e4468ebe4423d871a31b39 in term 2.
I20260709 13:12:39.351692  3343 raft_consensus.cc:993] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea: : Instructing follower 2ac5c5682f914ed9b9982b5a080d5472 to start an election
I20260709 13:12:39.352085  3343 raft_consensus.cc:1081] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 LEADER]: Signalling peer 2ac5c5682f914ed9b9982b5a080d5472 to start an election
I20260709 13:12:39.352654  2021 catalog_manager.cc:5697] T 8a672ef15abf47e4b650405c29044d3e P 79b6e57d59e4468ebe4423d871a31b39 reported cstate change: term changed from 1 to 2, leader changed from 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68) to 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67). New cstate: current_term: 2 leader_uuid: "79b6e57d59e4468ebe4423d871a31b39" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:39.354722  3187 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "93d627aa01fd4aefbbae482eb2fb2453"
dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
 from {username='slave'} at 127.0.0.1:50844
I20260709 13:12:39.355250  3187 raft_consensus.cc:493] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:39.355609  3187 raft_consensus.cc:3060] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:39.358295  3403 raft_consensus.cc:993] T d4e943e5bbd7402da6bcc00db70cec14 P 66e9a8fffd4b4e5a81ca4fa2762773ea: : Instructing follower 2ac5c5682f914ed9b9982b5a080d5472 to start an election
I20260709 13:12:39.358817  3403 raft_consensus.cc:1081] T d4e943e5bbd7402da6bcc00db70cec14 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 LEADER]: Signalling peer 2ac5c5682f914ed9b9982b5a080d5472 to start an election
I20260709 13:12:39.360880  3187 raft_consensus.cc:515] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:39.362812  3187 leader_election.cc:290] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 4 election: Requested vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:39.363868  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d627aa01fd4aefbbae482eb2fb2453" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:39.364394  2344 raft_consensus.cc:3055] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:39.364661  2344 raft_consensus.cc:740] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Running, Role: LEADER
I20260709 13:12:39.365337  2344 consensus_queue.cc:260] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:39.366117  2192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "93d627aa01fd4aefbbae482eb2fb2453" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:39.366562  2344 raft_consensus.cc:3060] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:39.367389  2192 raft_consensus.cc:3060] T 93d627aa01fd4aefbbae482eb2fb2453 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:39.366859  3176 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d4e943e5bbd7402da6bcc00db70cec14"
dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
 from {username='slave'} at 127.0.0.1:50844
I20260709 13:12:39.369581  3176 raft_consensus.cc:493] T d4e943e5bbd7402da6bcc00db70cec14 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:39.369927  3176 raft_consensus.cc:3060] T d4e943e5bbd7402da6bcc00db70cec14 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:39.373505  2192 raft_consensus.cc:2468] T 93d627aa01fd4aefbbae482eb2fb2453 P 0ec6a5d1452a41bd992a8c7922473b35 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 4.
I20260709 13:12:39.374676  3095 leader_election.cc:304] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472; no voters: 
I20260709 13:12:39.375798  3350 raft_consensus.cc:2804] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:39.376255  3350 raft_consensus.cc:697] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472 [term 4 LEADER]: Becoming Leader. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Running, Role: LEADER
I20260709 13:12:39.377107  3350 consensus_queue.cc:237] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:39.378845  2344 raft_consensus.cc:2468] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 4.
I20260709 13:12:39.383953  3176 raft_consensus.cc:515] T d4e943e5bbd7402da6bcc00db70cec14 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:39.385646  3176 leader_election.cc:290] T d4e943e5bbd7402da6bcc00db70cec14 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 election: Requested vote from peers 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:39.386548  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e943e5bbd7402da6bcc00db70cec14" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:39.387128  2344 raft_consensus.cc:3055] T d4e943e5bbd7402da6bcc00db70cec14 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:39.387401  2344 raft_consensus.cc:740] T d4e943e5bbd7402da6bcc00db70cec14 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Running, Role: LEADER
I20260709 13:12:39.387995  2344 consensus_queue.cc:260] T d4e943e5bbd7402da6bcc00db70cec14 P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:39.388707  2344 raft_consensus.cc:3060] T d4e943e5bbd7402da6bcc00db70cec14 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:39.388871  2019 catalog_manager.cc:5697] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472 reported cstate change: term changed from 3 to 4, leader changed from 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68) to 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65). New cstate: current_term: 4 leader_uuid: "2ac5c5682f914ed9b9982b5a080d5472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:39.390772  2192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4e943e5bbd7402da6bcc00db70cec14" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:39.391319  2192 raft_consensus.cc:3060] T d4e943e5bbd7402da6bcc00db70cec14 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:39.396991  2192 raft_consensus.cc:2468] T d4e943e5bbd7402da6bcc00db70cec14 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 2.
I20260709 13:12:39.397884  3095 leader_election.cc:304] T d4e943e5bbd7402da6bcc00db70cec14 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472; no voters: 
I20260709 13:12:39.398505  2344 raft_consensus.cc:2468] T d4e943e5bbd7402da6bcc00db70cec14 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 2.
I20260709 13:12:39.398618  3350 raft_consensus.cc:2804] T d4e943e5bbd7402da6bcc00db70cec14 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:39.399127  3350 raft_consensus.cc:697] T d4e943e5bbd7402da6bcc00db70cec14 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 LEADER]: Becoming Leader. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Running, Role: LEADER
I20260709 13:12:39.399937  3350 consensus_queue.cc:237] T d4e943e5bbd7402da6bcc00db70cec14 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:39.412941  2019 catalog_manager.cc:5697] T d4e943e5bbd7402da6bcc00db70cec14 P 2ac5c5682f914ed9b9982b5a080d5472 reported cstate change: term changed from 1 to 2, leader changed from 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68) to 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65). New cstate: current_term: 2 leader_uuid: "2ac5c5682f914ed9b9982b5a080d5472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:39.441293  3338 raft_consensus.cc:993] T f2a1307186df4616a9759118c2e456a6 P 66e9a8fffd4b4e5a81ca4fa2762773ea: : Instructing follower 0ec6a5d1452a41bd992a8c7922473b35 to start an election
I20260709 13:12:39.441677  3343 raft_consensus.cc:1081] T f2a1307186df4616a9759118c2e456a6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 LEADER]: Signalling peer 0ec6a5d1452a41bd992a8c7922473b35 to start an election
I20260709 13:12:39.442902  2192 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f2a1307186df4616a9759118c2e456a6"
dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
 from {username='slave'} at 127.0.0.1:47488
I20260709 13:12:39.443329  2192 raft_consensus.cc:493] T f2a1307186df4616a9759118c2e456a6 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:39.443553  2192 raft_consensus.cc:3060] T f2a1307186df4616a9759118c2e456a6 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:39.447742  2192 raft_consensus.cc:515] T f2a1307186df4616a9759118c2e456a6 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:39.449661  2192 leader_election.cc:290] T f2a1307186df4616a9759118c2e456a6 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 election: Requested vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:39.450322  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a1307186df4616a9759118c2e456a6" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:39.450858  2268 raft_consensus.cc:3060] T f2a1307186df4616a9759118c2e456a6 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:39.450882  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f2a1307186df4616a9759118c2e456a6" candidate_uuid: "0ec6a5d1452a41bd992a8c7922473b35" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:39.451545  2344 raft_consensus.cc:3055] T f2a1307186df4616a9759118c2e456a6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:39.451831  2344 raft_consensus.cc:740] T f2a1307186df4616a9759118c2e456a6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Running, Role: LEADER
I20260709 13:12:39.452534  2344 consensus_queue.cc:260] T f2a1307186df4616a9759118c2e456a6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:39.453672  2344 raft_consensus.cc:3060] T f2a1307186df4616a9759118c2e456a6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:39.457242  2268 raft_consensus.cc:2468] T f2a1307186df4616a9759118c2e456a6 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 2.
I20260709 13:12:39.458426  2162 leader_election.cc:304] T f2a1307186df4616a9759118c2e456a6 P 0ec6a5d1452a41bd992a8c7922473b35 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:39.459067  3382 raft_consensus.cc:2804] T f2a1307186df4616a9759118c2e456a6 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:39.459493  3382 raft_consensus.cc:697] T f2a1307186df4616a9759118c2e456a6 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 LEADER]: Becoming Leader. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Running, Role: LEADER
I20260709 13:12:39.459810  2344 raft_consensus.cc:2468] T f2a1307186df4616a9759118c2e456a6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0ec6a5d1452a41bd992a8c7922473b35 in term 2.
I20260709 13:12:39.460279  3382 consensus_queue.cc:237] T f2a1307186df4616a9759118c2e456a6 P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } }
I20260709 13:12:39.470105  2019 catalog_manager.cc:5697] T f2a1307186df4616a9759118c2e456a6 P 0ec6a5d1452a41bd992a8c7922473b35 reported cstate change: term changed from 1 to 2, leader changed from 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68) to 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66). New cstate: current_term: 2 leader_uuid: "0ec6a5d1452a41bd992a8c7922473b35" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:39.483831  3338 raft_consensus.cc:993] T 78734884e0a441759b51d258ad2697aa P 66e9a8fffd4b4e5a81ca4fa2762773ea: : Instructing follower 2ac5c5682f914ed9b9982b5a080d5472 to start an election
I20260709 13:12:39.484282  3343 raft_consensus.cc:1081] T 78734884e0a441759b51d258ad2697aa P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 LEADER]: Signalling peer 2ac5c5682f914ed9b9982b5a080d5472 to start an election
I20260709 13:12:39.485795  3181 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78734884e0a441759b51d258ad2697aa"
dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
 from {username='slave'} at 127.0.0.1:50844
I20260709 13:12:39.486295  3181 raft_consensus.cc:493] T 78734884e0a441759b51d258ad2697aa P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:39.486624  3181 raft_consensus.cc:3060] T 78734884e0a441759b51d258ad2697aa P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:39.493122  3181 raft_consensus.cc:515] T 78734884e0a441759b51d258ad2697aa P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:39.494858  3181 leader_election.cc:290] T 78734884e0a441759b51d258ad2697aa P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 election: Requested vote from peers 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303), 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68:38869)
I20260709 13:12:39.495450  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78734884e0a441759b51d258ad2697aa" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:39.496027  2268 raft_consensus.cc:3060] T 78734884e0a441759b51d258ad2697aa P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:39.496045  2344 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78734884e0a441759b51d258ad2697aa" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea"
I20260709 13:12:39.496622  2344 raft_consensus.cc:3055] T 78734884e0a441759b51d258ad2697aa P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:39.496824  2344 raft_consensus.cc:740] T 78734884e0a441759b51d258ad2697aa P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 66e9a8fffd4b4e5a81ca4fa2762773ea, State: Running, Role: LEADER
I20260709 13:12:39.497391  2344 consensus_queue.cc:260] T 78734884e0a441759b51d258ad2697aa P 66e9a8fffd4b4e5a81ca4fa2762773ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:39.498323  2344 raft_consensus.cc:3060] T 78734884e0a441759b51d258ad2697aa P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:39.501225  2268 raft_consensus.cc:2468] T 78734884e0a441759b51d258ad2697aa P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 2.
I20260709 13:12:39.502019  3094 leader_election.cc:304] T 78734884e0a441759b51d258ad2697aa P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:39.502667  3350 raft_consensus.cc:2804] T 78734884e0a441759b51d258ad2697aa P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:39.503129  3350 raft_consensus.cc:697] T 78734884e0a441759b51d258ad2697aa P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 LEADER]: Becoming Leader. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Running, Role: LEADER
I20260709 13:12:39.503334  2344 raft_consensus.cc:2468] T 78734884e0a441759b51d258ad2697aa P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 2.
I20260709 13:12:39.503974  3350 consensus_queue.cc:237] T 78734884e0a441759b51d258ad2697aa P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } }
I20260709 13:12:39.512063  2019 catalog_manager.cc:5697] T 78734884e0a441759b51d258ad2697aa P 2ac5c5682f914ed9b9982b5a080d5472 reported cstate change: term changed from 1 to 2, leader changed from 66e9a8fffd4b4e5a81ca4fa2762773ea (127.28.54.68) to 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65). New cstate: current_term: 2 leader_uuid: "2ac5c5682f914ed9b9982b5a080d5472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:39.834990  2198 raft_consensus.cc:1275] T 93d627aa01fd4aefbbae482eb2fb2453 P 0ec6a5d1452a41bd992a8c7922473b35 [term 4 FOLLOWER]: Refusing update from remote peer 2ac5c5682f914ed9b9982b5a080d5472: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:39.836422  3369 consensus_queue.cc:1048] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:39.850165  2339 raft_consensus.cc:1275] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 4 FOLLOWER]: Refusing update from remote peer 2ac5c5682f914ed9b9982b5a080d5472: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:39.851467  3350 consensus_queue.cc:1048] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:12:39.881181  2344 raft_consensus.cc:1275] T f2a1307186df4616a9759118c2e456a6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Refusing update from remote peer 0ec6a5d1452a41bd992a8c7922473b35: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:39.882272  3424 consensus_queue.cc:1048] T f2a1307186df4616a9759118c2e456a6 P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:39.890612  2268 raft_consensus.cc:1275] T f2a1307186df4616a9759118c2e456a6 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Refusing update from remote peer 0ec6a5d1452a41bd992a8c7922473b35: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:39.891935  3382 consensus_queue.cc:1048] T f2a1307186df4616a9759118c2e456a6 P 0ec6a5d1452a41bd992a8c7922473b35 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:39.896032  2198 raft_consensus.cc:1275] T 8a672ef15abf47e4b650405c29044d3e P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Refusing update from remote peer 79b6e57d59e4468ebe4423d871a31b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:39.897212  3336 consensus_queue.cc:1048] T 8a672ef15abf47e4b650405c29044d3e P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:39.921693  2344 raft_consensus.cc:1275] T 8a672ef15abf47e4b650405c29044d3e P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Refusing update from remote peer 79b6e57d59e4468ebe4423d871a31b39: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:39.924093  3402 consensus_queue.cc:1048] T 8a672ef15abf47e4b650405c29044d3e P 79b6e57d59e4468ebe4423d871a31b39 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:39.951556  2339 raft_consensus.cc:1275] T d4e943e5bbd7402da6bcc00db70cec14 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Refusing update from remote peer 2ac5c5682f914ed9b9982b5a080d5472: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:39.952636  3350 consensus_queue.cc:1048] T d4e943e5bbd7402da6bcc00db70cec14 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:39.962231  2198 raft_consensus.cc:1275] T d4e943e5bbd7402da6bcc00db70cec14 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Refusing update from remote peer 2ac5c5682f914ed9b9982b5a080d5472: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:39.963840  3348 consensus_queue.cc:1048] T d4e943e5bbd7402da6bcc00db70cec14 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:39.972241  2339 raft_consensus.cc:1275] T 78734884e0a441759b51d258ad2697aa P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Refusing update from remote peer 2ac5c5682f914ed9b9982b5a080d5472: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:39.973610  3433 consensus_queue.cc:1048] T 78734884e0a441759b51d258ad2697aa P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:12:39.986403  2268 raft_consensus.cc:1275] T 78734884e0a441759b51d258ad2697aa P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Refusing update from remote peer 2ac5c5682f914ed9b9982b5a080d5472: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:39.993427  3369 consensus_queue.cc:1048] T 78734884e0a441759b51d258ad2697aa P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:40.116809 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:40.154386 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:40.198621  2268 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0bd8fc2d57c14adeaeae16583eef7c84"
dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
mode: GRACEFUL
new_leader_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
 from {username='slave'} at 127.0.0.1:47704
I20260709 13:12:40.199150  2268 raft_consensus.cc:606] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 LEADER]: Received request to transfer leadership to TS 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:40.201521  2192 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc02522cf9704f58a9d2bfd5326e3625"
dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
mode: GRACEFUL
new_leader_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
 from {username='slave'} at 127.0.0.1:59830
I20260709 13:12:40.202071  2192 raft_consensus.cc:606] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 LEADER]: Received request to transfer leadership to TS 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:40.203259 28889 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:12:40.204836 28889 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:40.540341  3336 raft_consensus.cc:993] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39: : Instructing follower 2ac5c5682f914ed9b9982b5a080d5472 to start an election
I20260709 13:12:40.540730  3336 raft_consensus.cc:1081] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 LEADER]: Signalling peer 2ac5c5682f914ed9b9982b5a080d5472 to start an election
I20260709 13:12:40.543154  3181 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0bd8fc2d57c14adeaeae16583eef7c84"
dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
 from {username='slave'} at 127.0.0.1:50858
I20260709 13:12:40.543732  3181 raft_consensus.cc:493] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:40.544122  3181 raft_consensus.cc:3060] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:40.551052  3181 raft_consensus.cc:515] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:40.552855  3181 leader_election.cc:290] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 4 election: Requested vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:40.553411  2192 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bd8fc2d57c14adeaeae16583eef7c84" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:40.553862  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0bd8fc2d57c14adeaeae16583eef7c84" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:40.554102  2192 raft_consensus.cc:3060] T 0bd8fc2d57c14adeaeae16583eef7c84 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:40.554366  2268 raft_consensus.cc:3055] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:40.554669  2268 raft_consensus.cc:740] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 79b6e57d59e4468ebe4423d871a31b39, State: Running, Role: LEADER
I20260709 13:12:40.555236  2268 consensus_queue.cc:260] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:40.556450  2268 raft_consensus.cc:3060] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:40.559829  2192 raft_consensus.cc:2468] T 0bd8fc2d57c14adeaeae16583eef7c84 P 0ec6a5d1452a41bd992a8c7922473b35 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 4.
I20260709 13:12:40.560835  3095 leader_election.cc:304] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472; no voters: 
I20260709 13:12:40.561470  3369 raft_consensus.cc:2804] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:40.561900  2268 raft_consensus.cc:2468] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 4.
I20260709 13:12:40.561955  3369 raft_consensus.cc:697] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472 [term 4 LEADER]: Becoming Leader. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Running, Role: LEADER
I20260709 13:12:40.562930  3369 consensus_queue.cc:237] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:40.571103  2020 catalog_manager.cc:5697] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472 reported cstate change: term changed from 3 to 4, leader changed from 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67) to 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65). New cstate: current_term: 4 leader_uuid: "2ac5c5682f914ed9b9982b5a080d5472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:40.691151  3439 raft_consensus.cc:993] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35: : Instructing follower 2ac5c5682f914ed9b9982b5a080d5472 to start an election
I20260709 13:12:40.691628  3342 raft_consensus.cc:1081] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 LEADER]: Signalling peer 2ac5c5682f914ed9b9982b5a080d5472 to start an election
I20260709 13:12:40.693118  3181 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc02522cf9704f58a9d2bfd5326e3625"
dest_uuid: "2ac5c5682f914ed9b9982b5a080d5472"
 from {username='slave'} at 127.0.0.1:50832
I20260709 13:12:40.693537  3181 raft_consensus.cc:493] T cc02522cf9704f58a9d2bfd5326e3625 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:40.693819  3181 raft_consensus.cc:3060] T cc02522cf9704f58a9d2bfd5326e3625 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:40.698624  3181 raft_consensus.cc:515] T cc02522cf9704f58a9d2bfd5326e3625 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:40.700440  3181 leader_election.cc:290] T cc02522cf9704f58a9d2bfd5326e3625 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 3 election: Requested vote from peers 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859), 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303)
I20260709 13:12:40.700722  2198 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc02522cf9704f58a9d2bfd5326e3625" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0ec6a5d1452a41bd992a8c7922473b35"
I20260709 13:12:40.701315  2198 raft_consensus.cc:3055] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:40.701237  2268 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc02522cf9704f58a9d2bfd5326e3625" candidate_uuid: "2ac5c5682f914ed9b9982b5a080d5472" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "79b6e57d59e4468ebe4423d871a31b39"
I20260709 13:12:40.701740  2198 raft_consensus.cc:740] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0ec6a5d1452a41bd992a8c7922473b35, State: Running, Role: LEADER
I20260709 13:12:40.702032  2268 raft_consensus.cc:3060] T cc02522cf9704f58a9d2bfd5326e3625 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:40.702559  2198 consensus_queue.cc:260] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:40.703734  2198 raft_consensus.cc:3060] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:40.707679  2268 raft_consensus.cc:2468] T cc02522cf9704f58a9d2bfd5326e3625 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 3.
I20260709 13:12:40.708499  3094 leader_election.cc:304] T cc02522cf9704f58a9d2bfd5326e3625 P 2ac5c5682f914ed9b9982b5a080d5472 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2ac5c5682f914ed9b9982b5a080d5472, 79b6e57d59e4468ebe4423d871a31b39; no voters: 
I20260709 13:12:40.709082  3369 raft_consensus.cc:2804] T cc02522cf9704f58a9d2bfd5326e3625 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:40.709107  2198 raft_consensus.cc:2468] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2ac5c5682f914ed9b9982b5a080d5472 in term 3.
I20260709 13:12:40.709550  3369 raft_consensus.cc:697] T cc02522cf9704f58a9d2bfd5326e3625 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 LEADER]: Becoming Leader. State: Replica: 2ac5c5682f914ed9b9982b5a080d5472, State: Running, Role: LEADER
I20260709 13:12:40.710384  3369 consensus_queue.cc:237] T cc02522cf9704f58a9d2bfd5326e3625 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } }
I20260709 13:12:40.718227  2020 catalog_manager.cc:5697] T cc02522cf9704f58a9d2bfd5326e3625 P 2ac5c5682f914ed9b9982b5a080d5472 reported cstate change: term changed from 2 to 3, leader changed from 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66) to 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65). New cstate: current_term: 3 leader_uuid: "2ac5c5682f914ed9b9982b5a080d5472" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:41.055786  2268 raft_consensus.cc:1275] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 [term 4 FOLLOWER]: Refusing update from remote peer 2ac5c5682f914ed9b9982b5a080d5472: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:41.057031  3369 consensus_queue.cc:1048] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:41.067973  2192 raft_consensus.cc:1275] T 0bd8fc2d57c14adeaeae16583eef7c84 P 0ec6a5d1452a41bd992a8c7922473b35 [term 4 FOLLOWER]: Refusing update from remote peer 2ac5c5682f914ed9b9982b5a080d5472: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:41.069118  3369 consensus_queue.cc:1048] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:41.171963  2192 raft_consensus.cc:1275] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Refusing update from remote peer 2ac5c5682f914ed9b9982b5a080d5472: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:41.173012  3369 consensus_queue.cc:1048] T cc02522cf9704f58a9d2bfd5326e3625 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:41.180820  2268 raft_consensus.cc:1275] T cc02522cf9704f58a9d2bfd5326e3625 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Refusing update from remote peer 2ac5c5682f914ed9b9982b5a080d5472: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:41.184114  3454 consensus_queue.cc:1048] T cc02522cf9704f58a9d2bfd5326e3625 P 2ac5c5682f914ed9b9982b5a080d5472 [LEADER]: Connected to new peer: Peer: permanent_uuid: "79b6e57d59e4468ebe4423d871a31b39" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:41.205667 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:41.241267 28889 tablet_server.cc:179] TabletServer@127.28.54.65:36557 shutting down...
W20260709 13:12:41.250964  2310 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 258 similar messages]
W20260709 13:12:41.255246  2310 consensus_peers.cc:597] T 56bba8336a054d969e18859a84f180d6 P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:41.261781  2310 consensus_peers.cc:597] T 36b22aafe7104cec82607dab40b4aed8 P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:41.274327  2162 consensus_peers.cc:597] T 622b6cfd76ff495ea6692a1ec0faefc4 P 0ec6a5d1452a41bd992a8c7922473b35 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:41.277254  2162 consensus_peers.cc:597] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:41.279088 28889 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:41.279899 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:41.280490 28889 raft_consensus.cc:2243] T 583390912c6d4daca2df9b5534fb8dca P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.280884 28889 raft_consensus.cc:2272] T 583390912c6d4daca2df9b5534fb8dca P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.282882 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:41.283489 28889 raft_consensus.cc:2243] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:12:41.284168 28889 raft_consensus.cc:2272] T 93d627aa01fd4aefbbae482eb2fb2453 P 2ac5c5682f914ed9b9982b5a080d5472 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.286141 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:41.286693 28889 raft_consensus.cc:2243] T cc02522cf9704f58a9d2bfd5326e3625 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:41.287381 28889 raft_consensus.cc:2272] T cc02522cf9704f58a9d2bfd5326e3625 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.289542 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:41.290266 28889 raft_consensus.cc:2243] T 10de08c2346d47dbbd720596cd7e02fd P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.290668 28889 raft_consensus.cc:2272] T 10de08c2346d47dbbd720596cd7e02fd P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.292621 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:41.293154 28889 raft_consensus.cc:2243] T d3370eb67fff4896b1f8e3ce56eceb9b P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:41.293869 28889 raft_consensus.cc:2272] T d3370eb67fff4896b1f8e3ce56eceb9b P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.296303 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:41.296957 28889 raft_consensus.cc:2243] T b3b82132c31545aab274c7cf3f77c277 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.297431 28889 raft_consensus.cc:2272] T b3b82132c31545aab274c7cf3f77c277 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.299583 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:41.300125 28889 raft_consensus.cc:2243] T a0394490f6984f028daa10be921e242b P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.300557 28889 raft_consensus.cc:2272] T a0394490f6984f028daa10be921e242b P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.303006 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:41.303843 28889 raft_consensus.cc:2243] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:12:41.304155  2162 consensus_peers.cc:597] T bc42d18a324e4f6d97f07cf770c5daa8 P 0ec6a5d1452a41bd992a8c7922473b35 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:41.304584 28889 raft_consensus.cc:2272] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.307152 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:41.307821 28889 raft_consensus.cc:2243] T 0668be6a554b4c5f8bf93d0588a6bfcc P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.308197 28889 raft_consensus.cc:2272] T 0668be6a554b4c5f8bf93d0588a6bfcc P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.310808 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:41.311561 28889 raft_consensus.cc:2243] T 1588358a9e7542dfbd8b5d2f65212aec P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:41.312779 28889 raft_consensus.cc:2272] T 1588358a9e7542dfbd8b5d2f65212aec P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:41.313807  2310 consensus_peers.cc:597] T 6bf4f728eedf41bdb027f554c3a5ae1f P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:41.315338 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:41.316016 28889 raft_consensus.cc:2243] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:12:41.316979 28889 raft_consensus.cc:2272] T 0bd8fc2d57c14adeaeae16583eef7c84 P 2ac5c5682f914ed9b9982b5a080d5472 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:41.328670  2236 consensus_peers.cc:597] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:41.332857 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:41.333727 28889 raft_consensus.cc:2243] T 1478f883c539464bb54fe9bff44148d5 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.334240 28889 raft_consensus.cc:2272] T 1478f883c539464bb54fe9bff44148d5 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.336596 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:41.337091 28889 raft_consensus.cc:2243] T d0d102459578474fbe77af94f3986a84 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.337455 28889 raft_consensus.cc:2272] T d0d102459578474fbe77af94f3986a84 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.339540 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:41.340132 28889 raft_consensus.cc:2243] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:12:41.340907 28889 raft_consensus.cc:2272] T 67db2f978ea64fbd9a32274d4ad374c9 P 2ac5c5682f914ed9b9982b5a080d5472 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:41.342058  2236 consensus_peers.cc:597] T 86834d94d1d64596abfa609754b5d58a P 79b6e57d59e4468ebe4423d871a31b39 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:41.343130 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:41.343750 28889 raft_consensus.cc:2243] T 56bba8336a054d969e18859a84f180d6 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.344136 28889 raft_consensus.cc:2272] T 56bba8336a054d969e18859a84f180d6 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.346031 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:41.346570 28889 raft_consensus.cc:2243] T df8d897471684531826528a5751d6246 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.346925 28889 raft_consensus.cc:2272] T df8d897471684531826528a5751d6246 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.348634 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:41.349184 28889 raft_consensus.cc:2243] T b206de895e36490688cb2c1c537774a5 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.349610 28889 raft_consensus.cc:2272] T b206de895e36490688cb2c1c537774a5 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.351527 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:41.352031 28889 raft_consensus.cc:2243] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.352463 28889 raft_consensus.cc:2272] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 2ac5c5682f914ed9b9982b5a080d5472 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.354839 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:41.355609 28889 raft_consensus.cc:2243] T 46887c40373b4aca811c6382c97cb9bf P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.356011 28889 raft_consensus.cc:2272] T 46887c40373b4aca811c6382c97cb9bf P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.358371 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:41.359050 28889 raft_consensus.cc:2243] T 36b22aafe7104cec82607dab40b4aed8 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.359515 28889 raft_consensus.cc:2272] T 36b22aafe7104cec82607dab40b4aed8 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.362118 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:41.362607 28889 raft_consensus.cc:2243] T 2e178ff57d964223aca095ceff76b339 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.363091 28889 raft_consensus.cc:2272] T 2e178ff57d964223aca095ceff76b339 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.371695 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:41.372488 28889 raft_consensus.cc:2243] T 7475d672f7b3489393d6202c8b31e47f P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.373101 28889 raft_consensus.cc:2272] T 7475d672f7b3489393d6202c8b31e47f P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.375768 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:41.376457 28889 raft_consensus.cc:2243] T d1ddcfd4d0914e40ae0a684fd8726d24 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.376857 28889 raft_consensus.cc:2272] T d1ddcfd4d0914e40ae0a684fd8726d24 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.378837 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:41.379544 28889 raft_consensus.cc:2243] T a9be6d55d1f348bcaf96405abc80244d P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.379971 28889 raft_consensus.cc:2272] T a9be6d55d1f348bcaf96405abc80244d P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:41.381946  2310 consensus_peers.cc:597] T a9be6d55d1f348bcaf96405abc80244d P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:41.382706 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:41.383301 28889 raft_consensus.cc:2243] T d2f88787abb54ffea037f35cf48b22c4 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:41.384125 28889 raft_consensus.cc:2272] T d2f88787abb54ffea037f35cf48b22c4 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.386263 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:41.386854 28889 raft_consensus.cc:2243] T 5c3646d79bc840e9b4396f4351d1803d P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.387326 28889 raft_consensus.cc:2272] T 5c3646d79bc840e9b4396f4351d1803d P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:41.389657  2236 consensus_peers.cc:597] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:41.389829 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:41.390534 28889 raft_consensus.cc:2243] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.390937 28889 raft_consensus.cc:2272] T e1ad60fa3bce47daac74b01143b54132 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.392948 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:41.393450 28889 raft_consensus.cc:2243] T 12b5593f051548fea374da76afa08c3f P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.393894 28889 raft_consensus.cc:2272] T 12b5593f051548fea374da76afa08c3f P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.395846 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:41.396358 28889 raft_consensus.cc:2243] T 765b8df93039426e925b94637a061cc2 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.396733 28889 raft_consensus.cc:2272] T 765b8df93039426e925b94637a061cc2 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.399065 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:41.399804 28889 raft_consensus.cc:2243] T 7e3782f3d54b4a19bacbd125c31127a9 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.400242 28889 raft_consensus.cc:2272] T 7e3782f3d54b4a19bacbd125c31127a9 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.402539 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:41.403055 28889 raft_consensus.cc:2243] T d4e943e5bbd7402da6bcc00db70cec14 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:41.403733 28889 raft_consensus.cc:2272] T d4e943e5bbd7402da6bcc00db70cec14 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.405614 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:41.406152 28889 raft_consensus.cc:2243] T 6bf4f728eedf41bdb027f554c3a5ae1f P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.406492 28889 raft_consensus.cc:2272] T 6bf4f728eedf41bdb027f554c3a5ae1f P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.408295 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:41.408777 28889 raft_consensus.cc:2243] T ddf48e4f6be64627a0ed06d6198ca054 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.409139 28889 raft_consensus.cc:2272] T ddf48e4f6be64627a0ed06d6198ca054 P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.411147 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:41.411634 28889 raft_consensus.cc:2243] T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.412007 28889 raft_consensus.cc:2272] T 86834d94d1d64596abfa609754b5d58a P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.413748 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:41.414215 28889 raft_consensus.cc:2243] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.414551 28889 raft_consensus.cc:2272] T bc42d18a324e4f6d97f07cf770c5daa8 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.416306 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:41.416880 28889 raft_consensus.cc:2243] T 427b10072083419c89d5a4bf5d6413fc P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.417332 28889 raft_consensus.cc:2272] T 427b10072083419c89d5a4bf5d6413fc P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.419786 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:41.420495 28889 raft_consensus.cc:2243] T ee1baa7401cd48e48e7125dcd607f44f P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:41.421243 28889 raft_consensus.cc:2272] T ee1baa7401cd48e48e7125dcd607f44f P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.423560 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:41.424108 28889 raft_consensus.cc:2243] T 622b6cfd76ff495ea6692a1ec0faefc4 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.424495 28889 raft_consensus.cc:2272] T 622b6cfd76ff495ea6692a1ec0faefc4 P 2ac5c5682f914ed9b9982b5a080d5472 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:41.425367  2162 consensus_peers.cc:597] T b3b82132c31545aab274c7cf3f77c277 P 0ec6a5d1452a41bd992a8c7922473b35 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:41.426716 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:41.427278 28889 raft_consensus.cc:2243] T 78734884e0a441759b51d258ad2697aa P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:41.427934 28889 raft_consensus.cc:2272] T 78734884e0a441759b51d258ad2697aa P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.429904 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:41.430377 28889 raft_consensus.cc:2243] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472 [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:12:41.431007 28889 raft_consensus.cc:2272] T e259bf23e7904d9fb8b2345bb5b667f3 P 2ac5c5682f914ed9b9982b5a080d5472 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.432721 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:41.433149 28889 raft_consensus.cc:2243] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.433467 28889 raft_consensus.cc:2272] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.435276 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:41.435684 28889 raft_consensus.cc:2243] T 28f2272230d34efa880d5eeed8859669 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.436002 28889 raft_consensus.cc:2272] T 28f2272230d34efa880d5eeed8859669 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.437633 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:41.438125 28889 raft_consensus.cc:2243] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:41.438982 28889 raft_consensus.cc:2272] T a332070dcdff450b939e74ef5b68425a P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.441207 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:41.441748 28889 raft_consensus.cc:2243] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 LEADER]: Raft consensus shutting down.
W20260709 13:12:41.441744  2162 consensus_peers.cc:597] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:41.442770 28889 raft_consensus.cc:2272] T d7a50365dcc843f4a4f6bfb29a736f26 P 2ac5c5682f914ed9b9982b5a080d5472 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:41.443190  2310 consensus_peers.cc:597] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:41.445127 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:41.445773 28889 raft_consensus.cc:2243] T a4a5ce298d24406ea94fb68aba5b37ae P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.446133 28889 raft_consensus.cc:2272] T a4a5ce298d24406ea94fb68aba5b37ae P 2ac5c5682f914ed9b9982b5a080d5472 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:41.485519  2236 consensus_peers.cc:597] T b206de895e36490688cb2c1c537774a5 P 79b6e57d59e4468ebe4423d871a31b39 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:41.491075  2310 consensus_peers.cc:597] T 10de08c2346d47dbbd720596cd7e02fd P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:41.493451  2236 consensus_peers.cc:597] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:41.494851  2236 consensus_peers.cc:597] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:41.497149  2236 consensus_peers.cc:597] T d0d102459578474fbe77af94f3986a84 P 79b6e57d59e4468ebe4423d871a31b39 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:41.514106 28889 tablet_server.cc:196] TabletServer@127.28.54.65:36557 shutdown complete.
W20260709 13:12:41.541168  2310 consensus_peers.cc:597] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:41.560072  2162 consensus_peers.cc:597] T 7e3782f3d54b4a19bacbd125c31127a9 P 0ec6a5d1452a41bd992a8c7922473b35 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:41.563175  2236 consensus_peers.cc:597] T 583390912c6d4daca2df9b5534fb8dca P 79b6e57d59e4468ebe4423d871a31b39 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:41.584959  2162 consensus_peers.cc:597] T a4a5ce298d24406ea94fb68aba5b37ae P 0ec6a5d1452a41bd992a8c7922473b35 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:41.591883 28889 tablet_server.cc:179] TabletServer@127.28.54.66:0 shutting down...
W20260709 13:12:41.604466  2237 consensus_peers.cc:597] T d1ddcfd4d0914e40ae0a684fd8726d24 P 79b6e57d59e4468ebe4423d871a31b39 -> Peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Couldn't send request to peer 0ec6a5d1452a41bd992a8c7922473b35. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:41.620774  2236 consensus_peers.cc:597] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:41.628319 28889 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:41.629179 28889 tablet_replica.cc:333] T d1ddcfd4d0914e40ae0a684fd8726d24 P 0ec6a5d1452a41bd992a8c7922473b35: stopping tablet replica
I20260709 13:12:41.631086 28889 raft_consensus.cc:2243] T d1ddcfd4d0914e40ae0a684fd8726d24 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.631675 28889 raft_consensus.cc:2272] T d1ddcfd4d0914e40ae0a684fd8726d24 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.634622 28889 tablet_replica.cc:333] T bad0fdea1e3a409aab372c59eaa33767 P 0ec6a5d1452a41bd992a8c7922473b35: stopping tablet replica
I20260709 13:12:41.635479 28889 raft_consensus.cc:2243] T bad0fdea1e3a409aab372c59eaa33767 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.635984 28889 raft_consensus.cc:2272] T bad0fdea1e3a409aab372c59eaa33767 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.638813 28889 tablet_replica.cc:333] T d0d102459578474fbe77af94f3986a84 P 0ec6a5d1452a41bd992a8c7922473b35: stopping tablet replica
I20260709 13:12:41.639469 28889 raft_consensus.cc:2243] T d0d102459578474fbe77af94f3986a84 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.639822 28889 raft_consensus.cc:2272] T d0d102459578474fbe77af94f3986a84 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.641567 28889 tablet_replica.cc:333] T 10de08c2346d47dbbd720596cd7e02fd P 0ec6a5d1452a41bd992a8c7922473b35: stopping tablet replica
I20260709 13:12:41.642122 28889 raft_consensus.cc:2243] T 10de08c2346d47dbbd720596cd7e02fd P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.642489 28889 raft_consensus.cc:2272] T 10de08c2346d47dbbd720596cd7e02fd P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.644115 28889 tablet_replica.cc:333] T 622b6cfd76ff495ea6692a1ec0faefc4 P 0ec6a5d1452a41bd992a8c7922473b35: stopping tablet replica
I20260709 13:12:41.644567 28889 raft_consensus.cc:2243] T 622b6cfd76ff495ea6692a1ec0faefc4 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:41.645217 28889 raft_consensus.cc:2272] T 622b6cfd76ff495ea6692a1ec0faefc4 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.647006 28889 tablet_replica.cc:333] T 421302a9721e4cc9a86e52a183469a70 P 0ec6a5d1452a41bd992a8c7922473b35: stopping tablet replica
I20260709 13:12:41.647533 28889 raft_consensus.cc:2243] T 421302a9721e4cc9a86e52a183469a70 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.647895 28889 raft_consensus.cc:2272] T 421302a9721e4cc9a86e52a183469a70 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.649796 28889 tablet_replica.cc:333] T ddf48e4f6be64627a0ed06d6198ca054 P 0ec6a5d1452a41bd992a8c7922473b35: stopping tablet replica
I20260709 13:12:41.651119 28889 raft_consensus.cc:2243] T ddf48e4f6be64627a0ed06d6198ca054 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.651859 28889 raft_consensus.cc:2272] T ddf48e4f6be64627a0ed06d6198ca054 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:41.653311  2236 consensus_peers.cc:597] T d1ddcfd4d0914e40ae0a684fd8726d24 P 79b6e57d59e4468ebe4423d871a31b39 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:41.653895 28889 tablet_replica.cc:333] T bc42d18a324e4f6d97f07cf770c5daa8 P 0ec6a5d1452a41bd992a8c7922473b35: stopping tablet replica
I20260709 13:12:41.654764 28889 raft_consensus.cc:2243] T bc42d18a324e4f6d97f07cf770c5daa8 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:41.655575 28889 raft_consensus.cc:2272] T bc42d18a324e4f6d97f07cf770c5daa8 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.657416 28889 tablet_replica.cc:333] T b3b82132c31545aab274c7cf3f77c277 P 0ec6a5d1452a41bd992a8c7922473b35: stopping tablet replica
I20260709 13:12:41.657972 28889 raft_consensus.cc:2243] T b3b82132c31545aab274c7cf3f77c277 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:41.658716 28889 raft_consensus.cc:2272] T b3b82132c31545aab274c7cf3f77c277 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.661000 28889 tablet_replica.cc:333] T 36b22aafe7104cec82607dab40b4aed8 P 0ec6a5d1452a41bd992a8c7922473b35: stopping tablet replica
W20260709 13:12:41.661387  2237 consensus_peers.cc:597] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 -> Peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Couldn't send request to peer 0ec6a5d1452a41bd992a8c7922473b35. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:41.661664 28889 raft_consensus.cc:2243] T 36b22aafe7104cec82607dab40b4aed8 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.662134 28889 raft_consensus.cc:2272] T 36b22aafe7104cec82607dab40b4aed8 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.664224 28889 tablet_replica.cc:333] T 0bd8fc2d57c14adeaeae16583eef7c84 P 0ec6a5d1452a41bd992a8c7922473b35: stopping tablet replica
I20260709 13:12:41.664772 28889 raft_consensus.cc:2243] T 0bd8fc2d57c14adeaeae16583eef7c84 P 0ec6a5d1452a41bd992a8c7922473b35 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.665170 28889 raft_consensus.cc:2272] T 0bd8fc2d57c14adeaeae16583eef7c84 P 0ec6a5d1452a41bd992a8c7922473b35 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.667819 28889 tablet_replica.cc:333] T 1478f883c539464bb54fe9bff44148d5 P 0ec6a5d1452a41bd992a8c7922473b35: stopping tablet replica
I20260709 13:12:41.668350 28889 raft_consensus.cc:2243] T 1478f883c539464bb54fe9bff44148d5 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.668745 28889 raft_consensus.cc:2272] T 1478f883c539464bb54fe9bff44148d5 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.670413 28889 tablet_replica.cc:333] T 765b8df93039426e925b94637a061cc2 P 0ec6a5d1452a41bd992a8c7922473b35: stopping tablet replica
I20260709 13:12:41.670902 28889 raft_consensus.cc:2243] T 765b8df93039426e925b94637a061cc2 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:41.671852 28889 raft_consensus.cc:2272] T 765b8df93039426e925b94637a061cc2 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.673949 28889 tablet_replica.cc:333] T 12b5593f051548fea374da76afa08c3f P 0ec6a5d1452a41bd992a8c7922473b35: stopping tablet replica
I20260709 13:12:41.674569 28889 raft_consensus.cc:2243] T 12b5593f051548fea374da76afa08c3f P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:41.675467 28889 raft_consensus.cc:2272] T 12b5593f051548fea374da76afa08c3f P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:41.675549  2236 consensus_peers.cc:597] T ddf48e4f6be64627a0ed06d6198ca054 P 79b6e57d59e4468ebe4423d871a31b39 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:41.677556 28889 tablet_replica.cc:333] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35: stopping tablet replica
I20260709 13:12:41.678113 28889 raft_consensus.cc:2243] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:41.678929 28889 raft_consensus.cc:2272] T e1ad60fa3bce47daac74b01143b54132 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.681030 28889 tablet_replica.cc:333] T d2f88787abb54ffea037f35cf48b22c4 P 0ec6a5d1452a41bd992a8c7922473b35: stopping tablet replica
I20260709 13:12:41.681520 28889 raft_consensus.cc:2243] T d2f88787abb54ffea037f35cf48b22c4 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.681905 28889 raft_consensus.cc:2272] T d2f88787abb54ffea037f35cf48b22c4 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.684012 28889 tablet_replica.cc:333] T bdee3fd7553a47afae3ec9dbdce6d829 P 0ec6a5d1452a41bd992a8c7922473b35: stopping tablet replica
I20260709 13:12:41.684665 28889 raft_consensus.cc:2243] T bdee3fd7553a47afae3ec9dbdce6d829 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.685072 28889 raft_consensus.cc:2272] T bdee3fd7553a47afae3ec9dbdce6d829 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.686811 28889 tablet_replica.cc:333] T 5c3646d79bc840e9b4396f4351d1803d P 0ec6a5d1452a41bd992a8c7922473b35: stopping tablet replica
I20260709 13:12:41.687304 28889 raft_consensus.cc:2243] T 5c3646d79bc840e9b4396f4351d1803d P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:41.687990 28889 raft_consensus.cc:2272] T 5c3646d79bc840e9b4396f4351d1803d P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.689728 28889 tablet_replica.cc:333] T 2993800f8e7e4c09bfe0b2be13e4394c P 0ec6a5d1452a41bd992a8c7922473b35: stopping tablet replica
I20260709 13:12:41.690255 28889 raft_consensus.cc:2243] T 2993800f8e7e4c09bfe0b2be13e4394c P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:41.690953 28889 raft_consensus.cc:2272] T 2993800f8e7e4c09bfe0b2be13e4394c P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.692682 28889 tablet_replica.cc:333] T d3370eb67fff4896b1f8e3ce56eceb9b P 0ec6a5d1452a41bd992a8c7922473b35: stopping tablet replica
I20260709 13:12:41.693146 28889 raft_consensus.cc:2243] T d3370eb67fff4896b1f8e3ce56eceb9b P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.693506 28889 raft_consensus.cc:2272] T d3370eb67fff4896b1f8e3ce56eceb9b P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.695279 28889 tablet_replica.cc:333] T 46887c40373b4aca811c6382c97cb9bf P 0ec6a5d1452a41bd992a8c7922473b35: stopping tablet replica
I20260709 13:12:41.695742 28889 raft_consensus.cc:2243] T 46887c40373b4aca811c6382c97cb9bf P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:41.696455 28889 raft_consensus.cc:2272] T 46887c40373b4aca811c6382c97cb9bf P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.698300 28889 tablet_replica.cc:333] T 8a672ef15abf47e4b650405c29044d3e P 0ec6a5d1452a41bd992a8c7922473b35: stopping tablet replica
I20260709 13:12:41.699108 28889 raft_consensus.cc:2243] T 8a672ef15abf47e4b650405c29044d3e P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.699707 28889 raft_consensus.cc:2272] T 8a672ef15abf47e4b650405c29044d3e P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.701803 28889 tablet_replica.cc:333] T ee1baa7401cd48e48e7125dcd607f44f P 0ec6a5d1452a41bd992a8c7922473b35: stopping tablet replica
I20260709 13:12:41.702562 28889 raft_consensus.cc:2243] T ee1baa7401cd48e48e7125dcd607f44f P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.702955 28889 raft_consensus.cc:2272] T ee1baa7401cd48e48e7125dcd607f44f P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.704877 28889 tablet_replica.cc:333] T 7e716da7cd3d4ad390e049dc845b8004 P 0ec6a5d1452a41bd992a8c7922473b35: stopping tablet replica
I20260709 13:12:41.705371 28889 raft_consensus.cc:2243] T 7e716da7cd3d4ad390e049dc845b8004 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.705782 28889 raft_consensus.cc:2272] T 7e716da7cd3d4ad390e049dc845b8004 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.707659 28889 tablet_replica.cc:333] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35: stopping tablet replica
I20260709 13:12:41.708158 28889 raft_consensus.cc:2243] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.708518 28889 raft_consensus.cc:2272] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 0ec6a5d1452a41bd992a8c7922473b35 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.710256 28889 tablet_replica.cc:333] T 5aac56f958fb4fe29fe46d2a9be60ffd P 0ec6a5d1452a41bd992a8c7922473b35: stopping tablet replica
I20260709 13:12:41.710738 28889 raft_consensus.cc:2243] T 5aac56f958fb4fe29fe46d2a9be60ffd P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.711086 28889 raft_consensus.cc:2272] T 5aac56f958fb4fe29fe46d2a9be60ffd P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.712729 28889 tablet_replica.cc:333] T f9934bcaed6743b2a30104e13b8cf18b P 0ec6a5d1452a41bd992a8c7922473b35: stopping tablet replica
I20260709 13:12:41.713224 28889 raft_consensus.cc:2243] T f9934bcaed6743b2a30104e13b8cf18b P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:41.713964 28889 raft_consensus.cc:2272] T f9934bcaed6743b2a30104e13b8cf18b P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.715843 28889 tablet_replica.cc:333] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35: stopping tablet replica
I20260709 13:12:41.716310 28889 raft_consensus.cc:2243] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:41.717000 28889 raft_consensus.cc:2272] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.718699 28889 tablet_replica.cc:333] T d7a50365dcc843f4a4f6bfb29a736f26 P 0ec6a5d1452a41bd992a8c7922473b35: stopping tablet replica
I20260709 13:12:41.719182 28889 raft_consensus.cc:2243] T d7a50365dcc843f4a4f6bfb29a736f26 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.719558 28889 raft_consensus.cc:2272] T d7a50365dcc843f4a4f6bfb29a736f26 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.721122 28889 tablet_replica.cc:333] T a332070dcdff450b939e74ef5b68425a P 0ec6a5d1452a41bd992a8c7922473b35: stopping tablet replica
I20260709 13:12:41.721577 28889 raft_consensus.cc:2243] T a332070dcdff450b939e74ef5b68425a P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.721957 28889 raft_consensus.cc:2272] T a332070dcdff450b939e74ef5b68425a P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.724253 28889 tablet_replica.cc:333] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 0ec6a5d1452a41bd992a8c7922473b35: stopping tablet replica
I20260709 13:12:41.724951 28889 raft_consensus.cc:2243] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:41.725848 28889 raft_consensus.cc:2272] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.728083 28889 tablet_replica.cc:333] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35: stopping tablet replica
W20260709 13:12:41.728673  2311 consensus_peers.cc:597] T 421302a9721e4cc9a86e52a183469a70 P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Couldn't send request to peer 0ec6a5d1452a41bd992a8c7922473b35. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:41.728696 28889 raft_consensus.cc:2243] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.729472 28889 raft_consensus.cc:2272] T cc02522cf9704f58a9d2bfd5326e3625 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:41.731002  2237 consensus_peers.cc:597] T d0d102459578474fbe77af94f3986a84 P 79b6e57d59e4468ebe4423d871a31b39 -> Peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Couldn't send request to peer 0ec6a5d1452a41bd992a8c7922473b35. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:41.731941 28889 tablet_replica.cc:333] T a4a5ce298d24406ea94fb68aba5b37ae P 0ec6a5d1452a41bd992a8c7922473b35: stopping tablet replica
I20260709 13:12:41.732481 28889 raft_consensus.cc:2243] T a4a5ce298d24406ea94fb68aba5b37ae P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:41.733217 28889 raft_consensus.cc:2272] T a4a5ce298d24406ea94fb68aba5b37ae P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.734902 28889 tablet_replica.cc:333] T e5bbfa12bce4430fa6e7e6abd281ded6 P 0ec6a5d1452a41bd992a8c7922473b35: stopping tablet replica
I20260709 13:12:41.735384 28889 raft_consensus.cc:2243] T e5bbfa12bce4430fa6e7e6abd281ded6 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.735767 28889 raft_consensus.cc:2272] T e5bbfa12bce4430fa6e7e6abd281ded6 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.737552 28889 tablet_replica.cc:333] T 8b65903ab966485c9c65bdfbdf1e1054 P 0ec6a5d1452a41bd992a8c7922473b35: stopping tablet replica
I20260709 13:12:41.738042 28889 raft_consensus.cc:2243] T 8b65903ab966485c9c65bdfbdf1e1054 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.738543 28889 raft_consensus.cc:2272] T 8b65903ab966485c9c65bdfbdf1e1054 P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.740764 28889 tablet_replica.cc:333] T 67db2f978ea64fbd9a32274d4ad374c9 P 0ec6a5d1452a41bd992a8c7922473b35: stopping tablet replica
I20260709 13:12:41.741225 28889 raft_consensus.cc:2243] T 67db2f978ea64fbd9a32274d4ad374c9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.741639 28889 raft_consensus.cc:2272] T 67db2f978ea64fbd9a32274d4ad374c9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:41.742444  2310 consensus_peers.cc:597] T df8d897471684531826528a5751d6246 P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:41.743568 28889 tablet_replica.cc:333] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 0ec6a5d1452a41bd992a8c7922473b35: stopping tablet replica
I20260709 13:12:41.744110 28889 raft_consensus.cc:2243] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.744467 28889 raft_consensus.cc:2272] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.746690 28889 tablet_replica.cc:333] T f2a1307186df4616a9759118c2e456a6 P 0ec6a5d1452a41bd992a8c7922473b35: stopping tablet replica
W20260709 13:12:41.747007  2311 consensus_peers.cc:597] T e5bbfa12bce4430fa6e7e6abd281ded6 P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Couldn't send request to peer 0ec6a5d1452a41bd992a8c7922473b35. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:41.747193 28889 raft_consensus.cc:2243] T f2a1307186df4616a9759118c2e456a6 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:41.747941 28889 raft_consensus.cc:2272] T f2a1307186df4616a9759118c2e456a6 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.749580 28889 tablet_replica.cc:333] T d4e943e5bbd7402da6bcc00db70cec14 P 0ec6a5d1452a41bd992a8c7922473b35: stopping tablet replica
I20260709 13:12:41.750041 28889 raft_consensus.cc:2243] T d4e943e5bbd7402da6bcc00db70cec14 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.750433 28889 raft_consensus.cc:2272] T d4e943e5bbd7402da6bcc00db70cec14 P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.752348 28889 tablet_replica.cc:333] T 7e3782f3d54b4a19bacbd125c31127a9 P 0ec6a5d1452a41bd992a8c7922473b35: stopping tablet replica
I20260709 13:12:41.752897 28889 raft_consensus.cc:2243] T 7e3782f3d54b4a19bacbd125c31127a9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:41.753643 28889 raft_consensus.cc:2272] T 7e3782f3d54b4a19bacbd125c31127a9 P 0ec6a5d1452a41bd992a8c7922473b35 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.756397 28889 tablet_replica.cc:333] T 01a3c95e54104a998cdf16d06db2800a P 0ec6a5d1452a41bd992a8c7922473b35: stopping tablet replica
I20260709 13:12:41.756901 28889 raft_consensus.cc:2243] T 01a3c95e54104a998cdf16d06db2800a P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.757386 28889 raft_consensus.cc:2272] T 01a3c95e54104a998cdf16d06db2800a P 0ec6a5d1452a41bd992a8c7922473b35 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.759550 28889 tablet_replica.cc:333] T 93d627aa01fd4aefbbae482eb2fb2453 P 0ec6a5d1452a41bd992a8c7922473b35: stopping tablet replica
I20260709 13:12:41.760126 28889 raft_consensus.cc:2243] T 93d627aa01fd4aefbbae482eb2fb2453 P 0ec6a5d1452a41bd992a8c7922473b35 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.760625 28889 raft_consensus.cc:2272] T 93d627aa01fd4aefbbae482eb2fb2453 P 0ec6a5d1452a41bd992a8c7922473b35 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.762845 28889 tablet_replica.cc:333] T 38d5e9a8f42c4a2993d25a8a341fddbf P 0ec6a5d1452a41bd992a8c7922473b35: stopping tablet replica
W20260709 13:12:41.762288  2311 consensus_peers.cc:597] T 7e716da7cd3d4ad390e049dc845b8004 P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Couldn't send request to peer 0ec6a5d1452a41bd992a8c7922473b35. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:41.763527 28889 raft_consensus.cc:2243] T 38d5e9a8f42c4a2993d25a8a341fddbf P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.764024 28889 raft_consensus.cc:2272] T 38d5e9a8f42c4a2993d25a8a341fddbf P 0ec6a5d1452a41bd992a8c7922473b35 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.766454 28889 tablet_replica.cc:333] T e259bf23e7904d9fb8b2345bb5b667f3 P 0ec6a5d1452a41bd992a8c7922473b35: stopping tablet replica
I20260709 13:12:41.767019 28889 raft_consensus.cc:2243] T e259bf23e7904d9fb8b2345bb5b667f3 P 0ec6a5d1452a41bd992a8c7922473b35 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.767478 28889 raft_consensus.cc:2272] T e259bf23e7904d9fb8b2345bb5b667f3 P 0ec6a5d1452a41bd992a8c7922473b35 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:41.768573  2236 consensus_peers.cc:597] T 0668be6a554b4c5f8bf93d0588a6bfcc P 79b6e57d59e4468ebe4423d871a31b39 -> Peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Couldn't send request to peer 2ac5c5682f914ed9b9982b5a080d5472. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:41.774451  2311 consensus_peers.cc:597] T 10de08c2346d47dbbd720596cd7e02fd P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Couldn't send request to peer 0ec6a5d1452a41bd992a8c7922473b35. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:41.776213  2237 consensus_peers.cc:597] T ddf48e4f6be64627a0ed06d6198ca054 P 79b6e57d59e4468ebe4423d871a31b39 -> Peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Couldn't send request to peer 0ec6a5d1452a41bd992a8c7922473b35. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:41.776875  2237 consensus_peers.cc:597] T 8a672ef15abf47e4b650405c29044d3e P 79b6e57d59e4468ebe4423d871a31b39 -> Peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Couldn't send request to peer 0ec6a5d1452a41bd992a8c7922473b35. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:41.824028  2237 consensus_peers.cc:597] T 5aac56f958fb4fe29fe46d2a9be60ffd P 79b6e57d59e4468ebe4423d871a31b39 -> Peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Couldn't send request to peer 0ec6a5d1452a41bd992a8c7922473b35. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.66:38859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:41.834534 28889 tablet_server.cc:196] TabletServer@127.28.54.66:0 shutdown complete.
W20260709 13:12:41.851812  2311 consensus_peers.cc:597] T 36b22aafe7104cec82607dab40b4aed8 P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Couldn't send request to peer 0ec6a5d1452a41bd992a8c7922473b35. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.66:38859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:41.866693  2311 consensus_peers.cc:597] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Couldn't send request to peer 0ec6a5d1452a41bd992a8c7922473b35. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.66:38859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:41.873687  2311 consensus_peers.cc:597] T 38d5e9a8f42c4a2993d25a8a341fddbf P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Couldn't send request to peer 0ec6a5d1452a41bd992a8c7922473b35. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.66:38859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:41.894002  2237 consensus_peers.cc:597] T 01a3c95e54104a998cdf16d06db2800a P 79b6e57d59e4468ebe4423d871a31b39 -> Peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Couldn't send request to peer 0ec6a5d1452a41bd992a8c7922473b35. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.66:38859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:41.914783 28889 tablet_server.cc:179] TabletServer@127.28.54.67:0 shutting down...
W20260709 13:12:41.921661  2310 consensus_peers.cc:597] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Couldn't send request to peer 79b6e57d59e4468ebe4423d871a31b39. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:41.934690  2237 consensus_peers.cc:597] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39 -> Peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Couldn't send request to peer 0ec6a5d1452a41bd992a8c7922473b35. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.66:38859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:41.959472 28889 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:41.960237 28889 tablet_replica.cc:333] T 583390912c6d4daca2df9b5534fb8dca P 79b6e57d59e4468ebe4423d871a31b39: stopping tablet replica
I20260709 13:12:41.960842 28889 raft_consensus.cc:2243] T 583390912c6d4daca2df9b5534fb8dca P 79b6e57d59e4468ebe4423d871a31b39 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:41.961659 28889 raft_consensus.cc:2272] T 583390912c6d4daca2df9b5534fb8dca P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.963580 28889 tablet_replica.cc:333] T 622b6cfd76ff495ea6692a1ec0faefc4 P 79b6e57d59e4468ebe4423d871a31b39: stopping tablet replica
I20260709 13:12:41.964102 28889 raft_consensus.cc:2243] T 622b6cfd76ff495ea6692a1ec0faefc4 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.964512 28889 raft_consensus.cc:2272] T 622b6cfd76ff495ea6692a1ec0faefc4 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.966377 28889 tablet_replica.cc:333] T bad0fdea1e3a409aab372c59eaa33767 P 79b6e57d59e4468ebe4423d871a31b39: stopping tablet replica
I20260709 13:12:41.967051 28889 raft_consensus.cc:2243] T bad0fdea1e3a409aab372c59eaa33767 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.967561 28889 raft_consensus.cc:2272] T bad0fdea1e3a409aab372c59eaa33767 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.969707 28889 tablet_replica.cc:333] T 1588358a9e7542dfbd8b5d2f65212aec P 79b6e57d59e4468ebe4423d871a31b39: stopping tablet replica
I20260709 13:12:41.970258 28889 raft_consensus.cc:2243] T 1588358a9e7542dfbd8b5d2f65212aec P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.970639 28889 raft_consensus.cc:2272] T 1588358a9e7542dfbd8b5d2f65212aec P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.972402 28889 tablet_replica.cc:333] T d0d102459578474fbe77af94f3986a84 P 79b6e57d59e4468ebe4423d871a31b39: stopping tablet replica
I20260709 13:12:41.972918 28889 raft_consensus.cc:2243] T d0d102459578474fbe77af94f3986a84 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:41.973619 28889 raft_consensus.cc:2272] T d0d102459578474fbe77af94f3986a84 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.975373 28889 tablet_replica.cc:333] T 421302a9721e4cc9a86e52a183469a70 P 79b6e57d59e4468ebe4423d871a31b39: stopping tablet replica
I20260709 13:12:41.975871 28889 raft_consensus.cc:2243] T 421302a9721e4cc9a86e52a183469a70 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.976246 28889 raft_consensus.cc:2272] T 421302a9721e4cc9a86e52a183469a70 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.978000 28889 tablet_replica.cc:333] T df8d897471684531826528a5751d6246 P 79b6e57d59e4468ebe4423d871a31b39: stopping tablet replica
I20260709 13:12:41.978494 28889 raft_consensus.cc:2243] T df8d897471684531826528a5751d6246 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.978881 28889 raft_consensus.cc:2272] T df8d897471684531826528a5751d6246 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.980594 28889 tablet_replica.cc:333] T b206de895e36490688cb2c1c537774a5 P 79b6e57d59e4468ebe4423d871a31b39: stopping tablet replica
I20260709 13:12:41.981103 28889 raft_consensus.cc:2243] T b206de895e36490688cb2c1c537774a5 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:41.982013 28889 raft_consensus.cc:2272] T b206de895e36490688cb2c1c537774a5 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.983726 28889 tablet_replica.cc:333] T e5bbfa12bce4430fa6e7e6abd281ded6 P 79b6e57d59e4468ebe4423d871a31b39: stopping tablet replica
I20260709 13:12:41.984215 28889 raft_consensus.cc:2243] T e5bbfa12bce4430fa6e7e6abd281ded6 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.984568 28889 raft_consensus.cc:2272] T e5bbfa12bce4430fa6e7e6abd281ded6 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.986284 28889 tablet_replica.cc:333] T 8b65903ab966485c9c65bdfbdf1e1054 P 79b6e57d59e4468ebe4423d871a31b39: stopping tablet replica
I20260709 13:12:41.986804 28889 raft_consensus.cc:2243] T 8b65903ab966485c9c65bdfbdf1e1054 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.987179 28889 raft_consensus.cc:2272] T 8b65903ab966485c9c65bdfbdf1e1054 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.988881 28889 tablet_replica.cc:333] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39: stopping tablet replica
I20260709 13:12:41.989367 28889 raft_consensus.cc:2243] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.989723 28889 raft_consensus.cc:2272] T 0bd8fc2d57c14adeaeae16583eef7c84 P 79b6e57d59e4468ebe4423d871a31b39 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.992322 28889 tablet_replica.cc:333] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39: stopping tablet replica
I20260709 13:12:41.992818 28889 raft_consensus.cc:2243] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:41.993531 28889 raft_consensus.cc:2272] T 1478f883c539464bb54fe9bff44148d5 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.995318 28889 tablet_replica.cc:333] T e1ad60fa3bce47daac74b01143b54132 P 79b6e57d59e4468ebe4423d871a31b39: stopping tablet replica
I20260709 13:12:41.995826 28889 raft_consensus.cc:2243] T e1ad60fa3bce47daac74b01143b54132 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.996197 28889 raft_consensus.cc:2272] T e1ad60fa3bce47daac74b01143b54132 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:41.997903 28889 tablet_replica.cc:333] T d2f88787abb54ffea037f35cf48b22c4 P 79b6e57d59e4468ebe4423d871a31b39: stopping tablet replica
I20260709 13:12:41.998395 28889 raft_consensus.cc:2243] T d2f88787abb54ffea037f35cf48b22c4 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:41.998745 28889 raft_consensus.cc:2272] T d2f88787abb54ffea037f35cf48b22c4 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.000623 28889 tablet_replica.cc:333] T a9be6d55d1f348bcaf96405abc80244d P 79b6e57d59e4468ebe4423d871a31b39: stopping tablet replica
I20260709 13:12:42.001319 28889 raft_consensus.cc:2243] T a9be6d55d1f348bcaf96405abc80244d P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.001797 28889 raft_consensus.cc:2272] T a9be6d55d1f348bcaf96405abc80244d P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.004305 28889 tablet_replica.cc:333] T bdee3fd7553a47afae3ec9dbdce6d829 P 79b6e57d59e4468ebe4423d871a31b39: stopping tablet replica
W20260709 13:12:42.005152  2311 consensus_peers.cc:597] T bdee3fd7553a47afae3ec9dbdce6d829 P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Couldn't send request to peer 0ec6a5d1452a41bd992a8c7922473b35. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.66:38859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:42.004958 28889 raft_consensus.cc:2243] T bdee3fd7553a47afae3ec9dbdce6d829 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.005826 28889 raft_consensus.cc:2272] T bdee3fd7553a47afae3ec9dbdce6d829 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.007668 28889 tablet_replica.cc:333] T 5c3646d79bc840e9b4396f4351d1803d P 79b6e57d59e4468ebe4423d871a31b39: stopping tablet replica
I20260709 13:12:42.008183 28889 raft_consensus.cc:2243] T 5c3646d79bc840e9b4396f4351d1803d P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.008586 28889 raft_consensus.cc:2272] T 5c3646d79bc840e9b4396f4351d1803d P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.010341 28889 tablet_replica.cc:333] T 7e716da7cd3d4ad390e049dc845b8004 P 79b6e57d59e4468ebe4423d871a31b39: stopping tablet replica
I20260709 13:12:42.010860 28889 raft_consensus.cc:2243] T 7e716da7cd3d4ad390e049dc845b8004 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.011236 28889 raft_consensus.cc:2272] T 7e716da7cd3d4ad390e049dc845b8004 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.012948 28889 tablet_replica.cc:333] T 427b10072083419c89d5a4bf5d6413fc P 79b6e57d59e4468ebe4423d871a31b39: stopping tablet replica
I20260709 13:12:42.013438 28889 raft_consensus.cc:2243] T 427b10072083419c89d5a4bf5d6413fc P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.013835 28889 raft_consensus.cc:2272] T 427b10072083419c89d5a4bf5d6413fc P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.015579 28889 tablet_replica.cc:333] T f2a1307186df4616a9759118c2e456a6 P 79b6e57d59e4468ebe4423d871a31b39: stopping tablet replica
I20260709 13:12:42.016047 28889 raft_consensus.cc:2243] T f2a1307186df4616a9759118c2e456a6 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.016389 28889 raft_consensus.cc:2272] T f2a1307186df4616a9759118c2e456a6 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.018028 28889 tablet_replica.cc:333] T 6bf4f728eedf41bdb027f554c3a5ae1f P 79b6e57d59e4468ebe4423d871a31b39: stopping tablet replica
I20260709 13:12:42.018536 28889 raft_consensus.cc:2243] T 6bf4f728eedf41bdb027f554c3a5ae1f P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.018891 28889 raft_consensus.cc:2272] T 6bf4f728eedf41bdb027f554c3a5ae1f P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.020527 28889 tablet_replica.cc:333] T 7e3782f3d54b4a19bacbd125c31127a9 P 79b6e57d59e4468ebe4423d871a31b39: stopping tablet replica
I20260709 13:12:42.021005 28889 raft_consensus.cc:2243] T 7e3782f3d54b4a19bacbd125c31127a9 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.021360 28889 raft_consensus.cc:2272] T 7e3782f3d54b4a19bacbd125c31127a9 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.023113 28889 tablet_replica.cc:333] T 01a3c95e54104a998cdf16d06db2800a P 79b6e57d59e4468ebe4423d871a31b39: stopping tablet replica
I20260709 13:12:42.023620 28889 raft_consensus.cc:2243] T 01a3c95e54104a998cdf16d06db2800a P 79b6e57d59e4468ebe4423d871a31b39 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.024291 28889 raft_consensus.cc:2272] T 01a3c95e54104a998cdf16d06db2800a P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.026026 28889 tablet_replica.cc:333] T 5aac56f958fb4fe29fe46d2a9be60ffd P 79b6e57d59e4468ebe4423d871a31b39: stopping tablet replica
I20260709 13:12:42.026538 28889 raft_consensus.cc:2243] T 5aac56f958fb4fe29fe46d2a9be60ffd P 79b6e57d59e4468ebe4423d871a31b39 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.027199 28889 raft_consensus.cc:2272] T 5aac56f958fb4fe29fe46d2a9be60ffd P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.028793 28889 tablet_replica.cc:333] T f9934bcaed6743b2a30104e13b8cf18b P 79b6e57d59e4468ebe4423d871a31b39: stopping tablet replica
I20260709 13:12:42.029273 28889 raft_consensus.cc:2243] T f9934bcaed6743b2a30104e13b8cf18b P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.029634 28889 raft_consensus.cc:2272] T f9934bcaed6743b2a30104e13b8cf18b P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.031356 28889 tablet_replica.cc:333] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39: stopping tablet replica
I20260709 13:12:42.031827 28889 raft_consensus.cc:2243] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.032567 28889 raft_consensus.cc:2272] T 28f2272230d34efa880d5eeed8859669 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.034349 28889 tablet_replica.cc:333] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 79b6e57d59e4468ebe4423d871a31b39: stopping tablet replica
I20260709 13:12:42.034874 28889 raft_consensus.cc:2243] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.035296 28889 raft_consensus.cc:2272] T 4edf26b74c5d4e5d9a33d2b1fc1bb0ae P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.036876 28889 tablet_replica.cc:333] T 2e178ff57d964223aca095ceff76b339 P 79b6e57d59e4468ebe4423d871a31b39: stopping tablet replica
I20260709 13:12:42.037335 28889 raft_consensus.cc:2243] T 2e178ff57d964223aca095ceff76b339 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.037716 28889 raft_consensus.cc:2272] T 2e178ff57d964223aca095ceff76b339 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.039359 28889 tablet_replica.cc:333] T ddf48e4f6be64627a0ed06d6198ca054 P 79b6e57d59e4468ebe4423d871a31b39: stopping tablet replica
I20260709 13:12:42.039842 28889 raft_consensus.cc:2243] T ddf48e4f6be64627a0ed06d6198ca054 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.040824 28889 raft_consensus.cc:2272] T ddf48e4f6be64627a0ed06d6198ca054 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.043133 28889 tablet_replica.cc:333] T 86834d94d1d64596abfa609754b5d58a P 79b6e57d59e4468ebe4423d871a31b39: stopping tablet replica
I20260709 13:12:42.043752 28889 raft_consensus.cc:2243] T 86834d94d1d64596abfa609754b5d58a P 79b6e57d59e4468ebe4423d871a31b39 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.044648 28889 raft_consensus.cc:2272] T 86834d94d1d64596abfa609754b5d58a P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.046348 28889 tablet_replica.cc:333] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 79b6e57d59e4468ebe4423d871a31b39: stopping tablet replica
I20260709 13:12:42.046777 28889 raft_consensus.cc:2243] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.047156 28889 raft_consensus.cc:2272] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.048700 28889 tablet_replica.cc:333] T 38d5e9a8f42c4a2993d25a8a341fddbf P 79b6e57d59e4468ebe4423d871a31b39: stopping tablet replica
I20260709 13:12:42.049129 28889 raft_consensus.cc:2243] T 38d5e9a8f42c4a2993d25a8a341fddbf P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.049502 28889 raft_consensus.cc:2272] T 38d5e9a8f42c4a2993d25a8a341fddbf P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.051124 28889 tablet_replica.cc:333] T 78734884e0a441759b51d258ad2697aa P 79b6e57d59e4468ebe4423d871a31b39: stopping tablet replica
I20260709 13:12:42.051561 28889 raft_consensus.cc:2243] T 78734884e0a441759b51d258ad2697aa P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.051903 28889 raft_consensus.cc:2272] T 78734884e0a441759b51d258ad2697aa P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.053485 28889 tablet_replica.cc:333] T e259bf23e7904d9fb8b2345bb5b667f3 P 79b6e57d59e4468ebe4423d871a31b39: stopping tablet replica
I20260709 13:12:42.054032 28889 raft_consensus.cc:2243] T e259bf23e7904d9fb8b2345bb5b667f3 P 79b6e57d59e4468ebe4423d871a31b39 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.054456 28889 raft_consensus.cc:2272] T e259bf23e7904d9fb8b2345bb5b667f3 P 79b6e57d59e4468ebe4423d871a31b39 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.056005 28889 tablet_replica.cc:333] T 0668be6a554b4c5f8bf93d0588a6bfcc P 79b6e57d59e4468ebe4423d871a31b39: stopping tablet replica
I20260709 13:12:42.056437 28889 raft_consensus.cc:2243] T 0668be6a554b4c5f8bf93d0588a6bfcc P 79b6e57d59e4468ebe4423d871a31b39 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.057117 28889 raft_consensus.cc:2272] T 0668be6a554b4c5f8bf93d0588a6bfcc P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.058787 28889 tablet_replica.cc:333] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39: stopping tablet replica
I20260709 13:12:42.059231 28889 raft_consensus.cc:2243] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.059854 28889 raft_consensus.cc:2272] T a0394490f6984f028daa10be921e242b P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.061599 28889 tablet_replica.cc:333] T cc02522cf9704f58a9d2bfd5326e3625 P 79b6e57d59e4468ebe4423d871a31b39: stopping tablet replica
I20260709 13:12:42.062126 28889 raft_consensus.cc:2243] T cc02522cf9704f58a9d2bfd5326e3625 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.062597 28889 raft_consensus.cc:2272] T cc02522cf9704f58a9d2bfd5326e3625 P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:42.064507  2310 consensus_peers.cc:597] T bdee3fd7553a47afae3ec9dbdce6d829 P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Couldn't send request to peer 79b6e57d59e4468ebe4423d871a31b39. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:42.065084 28889 tablet_replica.cc:333] T d1ddcfd4d0914e40ae0a684fd8726d24 P 79b6e57d59e4468ebe4423d871a31b39: stopping tablet replica
I20260709 13:12:42.065583 28889 raft_consensus.cc:2243] T d1ddcfd4d0914e40ae0a684fd8726d24 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.066249 28889 raft_consensus.cc:2272] T d1ddcfd4d0914e40ae0a684fd8726d24 P 79b6e57d59e4468ebe4423d871a31b39 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.067942 28889 tablet_replica.cc:333] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39: stopping tablet replica
I20260709 13:12:42.068373 28889 raft_consensus.cc:2243] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.068980 28889 raft_consensus.cc:2272] T 7475d672f7b3489393d6202c8b31e47f P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.070659 28889 tablet_replica.cc:333] T 2993800f8e7e4c09bfe0b2be13e4394c P 79b6e57d59e4468ebe4423d871a31b39: stopping tablet replica
I20260709 13:12:42.071066 28889 raft_consensus.cc:2243] T 2993800f8e7e4c09bfe0b2be13e4394c P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.071409 28889 raft_consensus.cc:2272] T 2993800f8e7e4c09bfe0b2be13e4394c P 79b6e57d59e4468ebe4423d871a31b39 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.073084 28889 tablet_replica.cc:333] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39: stopping tablet replica
I20260709 13:12:42.073493 28889 raft_consensus.cc:2243] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.073839 28889 raft_consensus.cc:2272] T 67db2f978ea64fbd9a32274d4ad374c9 P 79b6e57d59e4468ebe4423d871a31b39 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.075472 28889 tablet_replica.cc:333] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39: stopping tablet replica
I20260709 13:12:42.075862 28889 raft_consensus.cc:2243] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.076490 28889 raft_consensus.cc:2272] T 8a0fb3f7bf85419cbf7ecda4727ccb89 P 79b6e57d59e4468ebe4423d871a31b39 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.078166 28889 tablet_replica.cc:333] T 8a672ef15abf47e4b650405c29044d3e P 79b6e57d59e4468ebe4423d871a31b39: stopping tablet replica
I20260709 13:12:42.078574 28889 raft_consensus.cc:2243] T 8a672ef15abf47e4b650405c29044d3e P 79b6e57d59e4468ebe4423d871a31b39 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.079216 28889 raft_consensus.cc:2272] T 8a672ef15abf47e4b650405c29044d3e P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.080731 28889 tablet_replica.cc:333] T 56bba8336a054d969e18859a84f180d6 P 79b6e57d59e4468ebe4423d871a31b39: stopping tablet replica
I20260709 13:12:42.081132 28889 raft_consensus.cc:2243] T 56bba8336a054d969e18859a84f180d6 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.081521 28889 raft_consensus.cc:2272] T 56bba8336a054d969e18859a84f180d6 P 79b6e57d59e4468ebe4423d871a31b39 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:42.099996  2310 consensus_peers.cc:597] T 56bba8336a054d969e18859a84f180d6 P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Couldn't send request to peer 79b6e57d59e4468ebe4423d871a31b39. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:42.162493  2310 consensus_peers.cc:597] T e5bbfa12bce4430fa6e7e6abd281ded6 P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Couldn't send request to peer 79b6e57d59e4468ebe4423d871a31b39. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.67:34303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:42.163986  2311 consensus_peers.cc:597] T bad0fdea1e3a409aab372c59eaa33767 P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Couldn't send request to peer 0ec6a5d1452a41bd992a8c7922473b35. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.66:38859: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:42.168195  2310 consensus_peers.cc:597] T 421302a9721e4cc9a86e52a183469a70 P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Couldn't send request to peer 79b6e57d59e4468ebe4423d871a31b39. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.67:34303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:42.180732  2310 consensus_peers.cc:597] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Couldn't send request to peer 79b6e57d59e4468ebe4423d871a31b39. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.67:34303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:42.187451 28889 tablet_server.cc:196] TabletServer@127.28.54.67:0 shutdown complete.
W20260709 13:12:42.188160  2310 consensus_peers.cc:597] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Couldn't send request to peer 79b6e57d59e4468ebe4423d871a31b39. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.67:34303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:42.244923  2310 consensus_peers.cc:597] T 38d5e9a8f42c4a2993d25a8a341fddbf P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Couldn't send request to peer 79b6e57d59e4468ebe4423d871a31b39. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.67:34303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:42.248107 28889 tablet_server.cc:179] TabletServer@127.28.54.68:0 shutting down...
I20260709 13:12:42.276932  3446 raft_consensus.cc:493] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:42.277374  3446 raft_consensus.cc:515] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:42.279124  3446 leader_election.cc:290] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
W20260709 13:12:42.283015  2310 leader_election.cc:336] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111)
W20260709 13:12:42.283926  2311 leader_election.cc:336] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Network error: Client connection negotiation failed: client connection to 127.28.54.66:38859: connect: Connection refused (error 111)
I20260709 13:12:42.284220  2311 leader_election.cc:304] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:42.284883  3446 raft_consensus.cc:2749] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:42.285617 28889 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:42.286454 28889 tablet_replica.cc:333] T 1588358a9e7542dfbd8b5d2f65212aec P 66e9a8fffd4b4e5a81ca4fa2762773ea: stopping tablet replica
I20260709 13:12:42.287262 28889 raft_consensus.cc:2243] T 1588358a9e7542dfbd8b5d2f65212aec P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.287746 28889 raft_consensus.cc:2272] T 1588358a9e7542dfbd8b5d2f65212aec P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.289638 28889 tablet_replica.cc:333] T bad0fdea1e3a409aab372c59eaa33767 P 66e9a8fffd4b4e5a81ca4fa2762773ea: stopping tablet replica
I20260709 13:12:42.290217 28889 raft_consensus.cc:2243] T bad0fdea1e3a409aab372c59eaa33767 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.290936 28889 raft_consensus.cc:2272] T bad0fdea1e3a409aab372c59eaa33767 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.292629 28889 tablet_replica.cc:333] T 421302a9721e4cc9a86e52a183469a70 P 66e9a8fffd4b4e5a81ca4fa2762773ea: stopping tablet replica
I20260709 13:12:42.293126 28889 raft_consensus.cc:2243] T 421302a9721e4cc9a86e52a183469a70 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.293871 28889 raft_consensus.cc:2272] T 421302a9721e4cc9a86e52a183469a70 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.295584 28889 tablet_replica.cc:333] T df8d897471684531826528a5751d6246 P 66e9a8fffd4b4e5a81ca4fa2762773ea: stopping tablet replica
I20260709 13:12:42.296100 28889 raft_consensus.cc:2243] T df8d897471684531826528a5751d6246 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.296772 28889 raft_consensus.cc:2272] T df8d897471684531826528a5751d6246 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.298595 28889 tablet_replica.cc:333] T 583390912c6d4daca2df9b5534fb8dca P 66e9a8fffd4b4e5a81ca4fa2762773ea: stopping tablet replica
I20260709 13:12:42.299099 28889 raft_consensus.cc:2243] T 583390912c6d4daca2df9b5534fb8dca P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.299503 28889 raft_consensus.cc:2272] T 583390912c6d4daca2df9b5534fb8dca P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.301293 28889 tablet_replica.cc:333] T 10de08c2346d47dbbd720596cd7e02fd P 66e9a8fffd4b4e5a81ca4fa2762773ea: stopping tablet replica
I20260709 13:12:42.301995 28889 raft_consensus.cc:2243] T 10de08c2346d47dbbd720596cd7e02fd P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.302795 28889 raft_consensus.cc:2272] T 10de08c2346d47dbbd720596cd7e02fd P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.304476 28889 tablet_replica.cc:333] T b206de895e36490688cb2c1c537774a5 P 66e9a8fffd4b4e5a81ca4fa2762773ea: stopping tablet replica
I20260709 13:12:42.304965 28889 raft_consensus.cc:2243] T b206de895e36490688cb2c1c537774a5 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.305336 28889 raft_consensus.cc:2272] T b206de895e36490688cb2c1c537774a5 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.306993 28889 tablet_replica.cc:333] T 38d5e9a8f42c4a2993d25a8a341fddbf P 66e9a8fffd4b4e5a81ca4fa2762773ea: stopping tablet replica
I20260709 13:12:42.307509 28889 raft_consensus.cc:2243] T 38d5e9a8f42c4a2993d25a8a341fddbf P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.308154 28889 raft_consensus.cc:2272] T 38d5e9a8f42c4a2993d25a8a341fddbf P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.309806 28889 tablet_replica.cc:333] T 78734884e0a441759b51d258ad2697aa P 66e9a8fffd4b4e5a81ca4fa2762773ea: stopping tablet replica
I20260709 13:12:42.310441 28889 raft_consensus.cc:2243] T 78734884e0a441759b51d258ad2697aa P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.310793 28889 raft_consensus.cc:2272] T 78734884e0a441759b51d258ad2697aa P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.312362 28889 tablet_replica.cc:333] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 66e9a8fffd4b4e5a81ca4fa2762773ea: stopping tablet replica
I20260709 13:12:42.312834 28889 raft_consensus.cc:2243] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.313200 28889 raft_consensus.cc:2272] T dc33c7c3cfd14ab7a99e39cfd971fc3c P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.314862 28889 tablet_replica.cc:333] T f2a1307186df4616a9759118c2e456a6 P 66e9a8fffd4b4e5a81ca4fa2762773ea: stopping tablet replica
I20260709 13:12:42.315366 28889 raft_consensus.cc:2243] T f2a1307186df4616a9759118c2e456a6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.315721 28889 raft_consensus.cc:2272] T f2a1307186df4616a9759118c2e456a6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.317368 28889 tablet_replica.cc:333] T e5bbfa12bce4430fa6e7e6abd281ded6 P 66e9a8fffd4b4e5a81ca4fa2762773ea: stopping tablet replica
I20260709 13:12:42.317847 28889 raft_consensus.cc:2243] T e5bbfa12bce4430fa6e7e6abd281ded6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.318526 28889 raft_consensus.cc:2272] T e5bbfa12bce4430fa6e7e6abd281ded6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.320201 28889 tablet_replica.cc:333] T a4a5ce298d24406ea94fb68aba5b37ae P 66e9a8fffd4b4e5a81ca4fa2762773ea: stopping tablet replica
I20260709 13:12:42.320706 28889 raft_consensus.cc:2243] T a4a5ce298d24406ea94fb68aba5b37ae P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.321077 28889 raft_consensus.cc:2272] T a4a5ce298d24406ea94fb68aba5b37ae P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.322656 28889 tablet_replica.cc:333] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea: stopping tablet replica
I20260709 13:12:42.323143 28889 raft_consensus.cc:2243] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.323825 28889 raft_consensus.cc:2272] T 8b65903ab966485c9c65bdfbdf1e1054 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.325376 28889 tablet_replica.cc:333] T f9934bcaed6743b2a30104e13b8cf18b P 66e9a8fffd4b4e5a81ca4fa2762773ea: stopping tablet replica
I20260709 13:12:42.325886 28889 raft_consensus.cc:2243] T f9934bcaed6743b2a30104e13b8cf18b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.326256 28889 raft_consensus.cc:2272] T f9934bcaed6743b2a30104e13b8cf18b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.327836 28889 tablet_replica.cc:333] T 28f2272230d34efa880d5eeed8859669 P 66e9a8fffd4b4e5a81ca4fa2762773ea: stopping tablet replica
I20260709 13:12:42.328323 28889 raft_consensus.cc:2243] T 28f2272230d34efa880d5eeed8859669 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.328734 28889 raft_consensus.cc:2272] T 28f2272230d34efa880d5eeed8859669 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.330372 28889 tablet_replica.cc:333] T bc42d18a324e4f6d97f07cf770c5daa8 P 66e9a8fffd4b4e5a81ca4fa2762773ea: stopping tablet replica
I20260709 13:12:42.330909 28889 raft_consensus.cc:2243] T bc42d18a324e4f6d97f07cf770c5daa8 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.331315 28889 raft_consensus.cc:2272] T bc42d18a324e4f6d97f07cf770c5daa8 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.332837  3446 raft_consensus.cc:493] T d3370eb67fff4896b1f8e3ce56eceb9b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 2ac5c5682f914ed9b9982b5a080d5472)
I20260709 13:12:42.332976 28889 tablet_replica.cc:333] T 5aac56f958fb4fe29fe46d2a9be60ffd P 66e9a8fffd4b4e5a81ca4fa2762773ea: stopping tablet replica
I20260709 13:12:42.333225  3446 raft_consensus.cc:515] T d3370eb67fff4896b1f8e3ce56eceb9b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66e9a8fffd4b4e5a81ca4fa2762773ea" member_type: VOTER last_known_addr { host: "127.28.54.68" port: 38869 } } peers { permanent_uuid: "2ac5c5682f914ed9b9982b5a080d5472" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36557 } } peers { permanent_uuid: "0ec6a5d1452a41bd992a8c7922473b35" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 38859 } }
I20260709 13:12:42.333653 28889 raft_consensus.cc:2243] T 5aac56f958fb4fe29fe46d2a9be60ffd P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.334144 28889 raft_consensus.cc:2272] T 5aac56f958fb4fe29fe46d2a9be60ffd P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.335029  3446 leader_election.cc:290] T d3370eb67fff4896b1f8e3ce56eceb9b P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557), 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859)
I20260709 13:12:42.336090 28889 tablet_replica.cc:333] T a0394490f6984f028daa10be921e242b P 66e9a8fffd4b4e5a81ca4fa2762773ea: stopping tablet replica
I20260709 13:12:42.336755 28889 raft_consensus.cc:2243] T a0394490f6984f028daa10be921e242b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.337253 28889 raft_consensus.cc:2272] T a0394490f6984f028daa10be921e242b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:42.338843  2311 leader_election.cc:336] T d3370eb67fff4896b1f8e3ce56eceb9b P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0ec6a5d1452a41bd992a8c7922473b35 (127.28.54.66:38859): Network error: Client connection negotiation failed: client connection to 127.28.54.66:38859: connect: Connection refused (error 111)
W20260709 13:12:42.339329  2310 leader_election.cc:336] T d3370eb67fff4896b1f8e3ce56eceb9b P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2ac5c5682f914ed9b9982b5a080d5472 (127.28.54.65:36557): Network error: Client connection negotiation failed: client connection to 127.28.54.65:36557: connect: Connection refused (error 111)
I20260709 13:12:42.339546 28889 tablet_replica.cc:333] T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea: stopping tablet replica
I20260709 13:12:42.339640  2310 leader_election.cc:304] T d3370eb67fff4896b1f8e3ce56eceb9b P 66e9a8fffd4b4e5a81ca4fa2762773ea [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 66e9a8fffd4b4e5a81ca4fa2762773ea; no voters: 0ec6a5d1452a41bd992a8c7922473b35, 2ac5c5682f914ed9b9982b5a080d5472
I20260709 13:12:42.340164 28889 raft_consensus.cc:2243] T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.340250  3446 raft_consensus.cc:2749] T d3370eb67fff4896b1f8e3ce56eceb9b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:12:42.340629 28889 raft_consensus.cc:2272] T b3b82132c31545aab274c7cf3f77c277 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.342391 28889 tablet_replica.cc:333] T 765b8df93039426e925b94637a061cc2 P 66e9a8fffd4b4e5a81ca4fa2762773ea: stopping tablet replica
I20260709 13:12:42.342868 28889 raft_consensus.cc:2243] T 765b8df93039426e925b94637a061cc2 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.343214 28889 raft_consensus.cc:2272] T 765b8df93039426e925b94637a061cc2 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.344903 28889 tablet_replica.cc:333] T 12b5593f051548fea374da76afa08c3f P 66e9a8fffd4b4e5a81ca4fa2762773ea: stopping tablet replica
I20260709 13:12:42.345345 28889 raft_consensus.cc:2243] T 12b5593f051548fea374da76afa08c3f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.345645 28889 raft_consensus.cc:2272] T 12b5593f051548fea374da76afa08c3f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.347270 28889 tablet_replica.cc:333] T 7475d672f7b3489393d6202c8b31e47f P 66e9a8fffd4b4e5a81ca4fa2762773ea: stopping tablet replica
I20260709 13:12:42.347702 28889 raft_consensus.cc:2243] T 7475d672f7b3489393d6202c8b31e47f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.348024 28889 raft_consensus.cc:2272] T 7475d672f7b3489393d6202c8b31e47f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.349542 28889 tablet_replica.cc:333] T 2993800f8e7e4c09bfe0b2be13e4394c P 66e9a8fffd4b4e5a81ca4fa2762773ea: stopping tablet replica
I20260709 13:12:42.350032 28889 raft_consensus.cc:2243] T 2993800f8e7e4c09bfe0b2be13e4394c P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.350462 28889 raft_consensus.cc:2272] T 2993800f8e7e4c09bfe0b2be13e4394c P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.352597 28889 tablet_replica.cc:333] T d3370eb67fff4896b1f8e3ce56eceb9b P 66e9a8fffd4b4e5a81ca4fa2762773ea: stopping tablet replica
I20260709 13:12:42.353171 28889 raft_consensus.cc:2243] T d3370eb67fff4896b1f8e3ce56eceb9b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 13:12:42.353544  2310 consensus_peers.cc:597] T 7e716da7cd3d4ad390e049dc845b8004 P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Couldn't send request to peer 79b6e57d59e4468ebe4423d871a31b39. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.67:34303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:42.353539 28889 raft_consensus.cc:2272] T d3370eb67fff4896b1f8e3ce56eceb9b P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.355489 28889 tablet_replica.cc:333] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea: stopping tablet replica
I20260709 13:12:42.356056 28889 raft_consensus.cc:2243] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.356758 28889 raft_consensus.cc:2272] T 2e178ff57d964223aca095ceff76b339 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.358539 28889 tablet_replica.cc:333] T 86834d94d1d64596abfa609754b5d58a P 66e9a8fffd4b4e5a81ca4fa2762773ea: stopping tablet replica
I20260709 13:12:42.359164 28889 raft_consensus.cc:2243] T 86834d94d1d64596abfa609754b5d58a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.359658 28889 raft_consensus.cc:2272] T 86834d94d1d64596abfa609754b5d58a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.362155 28889 tablet_replica.cc:333] T a332070dcdff450b939e74ef5b68425a P 66e9a8fffd4b4e5a81ca4fa2762773ea: stopping tablet replica
I20260709 13:12:42.362876 28889 raft_consensus.cc:2243] T a332070dcdff450b939e74ef5b68425a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.363369 28889 raft_consensus.cc:2272] T a332070dcdff450b939e74ef5b68425a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:42.363910  2310 consensus_peers.cc:597] T a9be6d55d1f348bcaf96405abc80244d P 66e9a8fffd4b4e5a81ca4fa2762773ea -> Peer 79b6e57d59e4468ebe4423d871a31b39 (127.28.54.67:34303): Couldn't send request to peer 79b6e57d59e4468ebe4423d871a31b39. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.67:34303: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:42.365069 28889 tablet_replica.cc:333] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 66e9a8fffd4b4e5a81ca4fa2762773ea: stopping tablet replica
I20260709 13:12:42.365603 28889 raft_consensus.cc:2243] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.366000 28889 raft_consensus.cc:2272] T f3f0f1b0143c4363a9b900eae4ac3ea9 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.367894 28889 tablet_replica.cc:333] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea: stopping tablet replica
I20260709 13:12:42.368391 28889 raft_consensus.cc:2243] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.368760 28889 raft_consensus.cc:2272] T 93d627aa01fd4aefbbae482eb2fb2453 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.370596 28889 tablet_replica.cc:333] T d4e943e5bbd7402da6bcc00db70cec14 P 66e9a8fffd4b4e5a81ca4fa2762773ea: stopping tablet replica
I20260709 13:12:42.371033 28889 raft_consensus.cc:2243] T d4e943e5bbd7402da6bcc00db70cec14 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.371382 28889 raft_consensus.cc:2272] T d4e943e5bbd7402da6bcc00db70cec14 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.372989 28889 tablet_replica.cc:333] T 6bf4f728eedf41bdb027f554c3a5ae1f P 66e9a8fffd4b4e5a81ca4fa2762773ea: stopping tablet replica
I20260709 13:12:42.373456 28889 raft_consensus.cc:2243] T 6bf4f728eedf41bdb027f554c3a5ae1f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.374152 28889 raft_consensus.cc:2272] T 6bf4f728eedf41bdb027f554c3a5ae1f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.375798 28889 tablet_replica.cc:333] T 01a3c95e54104a998cdf16d06db2800a P 66e9a8fffd4b4e5a81ca4fa2762773ea: stopping tablet replica
I20260709 13:12:42.376250 28889 raft_consensus.cc:2243] T 01a3c95e54104a998cdf16d06db2800a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.376591 28889 raft_consensus.cc:2272] T 01a3c95e54104a998cdf16d06db2800a P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.378206 28889 tablet_replica.cc:333] T a9be6d55d1f348bcaf96405abc80244d P 66e9a8fffd4b4e5a81ca4fa2762773ea: stopping tablet replica
I20260709 13:12:42.378667 28889 raft_consensus.cc:2243] T a9be6d55d1f348bcaf96405abc80244d P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.379323 28889 raft_consensus.cc:2272] T a9be6d55d1f348bcaf96405abc80244d P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.380888 28889 tablet_replica.cc:333] T bdee3fd7553a47afae3ec9dbdce6d829 P 66e9a8fffd4b4e5a81ca4fa2762773ea: stopping tablet replica
I20260709 13:12:42.381351 28889 raft_consensus.cc:2243] T bdee3fd7553a47afae3ec9dbdce6d829 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.382074 28889 raft_consensus.cc:2272] T bdee3fd7553a47afae3ec9dbdce6d829 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.383657 28889 tablet_replica.cc:333] T 0668be6a554b4c5f8bf93d0588a6bfcc P 66e9a8fffd4b4e5a81ca4fa2762773ea: stopping tablet replica
I20260709 13:12:42.384109 28889 raft_consensus.cc:2243] T 0668be6a554b4c5f8bf93d0588a6bfcc P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.384457 28889 raft_consensus.cc:2272] T 0668be6a554b4c5f8bf93d0588a6bfcc P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.386102 28889 tablet_replica.cc:333] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea: stopping tablet replica
I20260709 13:12:42.386574 28889 raft_consensus.cc:2243] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.386912 28889 raft_consensus.cc:2272] T d7a50365dcc843f4a4f6bfb29a736f26 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.388542 28889 tablet_replica.cc:333] T 46887c40373b4aca811c6382c97cb9bf P 66e9a8fffd4b4e5a81ca4fa2762773ea: stopping tablet replica
I20260709 13:12:42.388974 28889 raft_consensus.cc:2243] T 46887c40373b4aca811c6382c97cb9bf P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.389307 28889 raft_consensus.cc:2272] T 46887c40373b4aca811c6382c97cb9bf P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.390946 28889 tablet_replica.cc:333] T 8a672ef15abf47e4b650405c29044d3e P 66e9a8fffd4b4e5a81ca4fa2762773ea: stopping tablet replica
I20260709 13:12:42.391417 28889 raft_consensus.cc:2243] T 8a672ef15abf47e4b650405c29044d3e P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.391765 28889 raft_consensus.cc:2272] T 8a672ef15abf47e4b650405c29044d3e P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.393297 28889 tablet_replica.cc:333] T ee1baa7401cd48e48e7125dcd607f44f P 66e9a8fffd4b4e5a81ca4fa2762773ea: stopping tablet replica
I20260709 13:12:42.393723 28889 raft_consensus.cc:2243] T ee1baa7401cd48e48e7125dcd607f44f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:42.394124 28889 raft_consensus.cc:2272] T ee1baa7401cd48e48e7125dcd607f44f P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.395716 28889 tablet_replica.cc:333] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea: stopping tablet replica
I20260709 13:12:42.396137 28889 raft_consensus.cc:2243] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.396762 28889 raft_consensus.cc:2272] T 427b10072083419c89d5a4bf5d6413fc P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.398370 28889 tablet_replica.cc:333] T 7e716da7cd3d4ad390e049dc845b8004 P 66e9a8fffd4b4e5a81ca4fa2762773ea: stopping tablet replica
I20260709 13:12:42.398792 28889 raft_consensus.cc:2243] T 7e716da7cd3d4ad390e049dc845b8004 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.399422 28889 raft_consensus.cc:2272] T 7e716da7cd3d4ad390e049dc845b8004 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.401003 28889 tablet_replica.cc:333] T 36b22aafe7104cec82607dab40b4aed8 P 66e9a8fffd4b4e5a81ca4fa2762773ea: stopping tablet replica
I20260709 13:12:42.401409 28889 raft_consensus.cc:2243] T 36b22aafe7104cec82607dab40b4aed8 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.402087 28889 raft_consensus.cc:2272] T 36b22aafe7104cec82607dab40b4aed8 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.403692 28889 tablet_replica.cc:333] T 56bba8336a054d969e18859a84f180d6 P 66e9a8fffd4b4e5a81ca4fa2762773ea: stopping tablet replica
I20260709 13:12:42.404078 28889 raft_consensus.cc:2243] T 56bba8336a054d969e18859a84f180d6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.404714 28889 raft_consensus.cc:2272] T 56bba8336a054d969e18859a84f180d6 P 66e9a8fffd4b4e5a81ca4fa2762773ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.486088 28889 tablet_server.cc:196] TabletServer@127.28.54.68:0 shutdown complete.
I20260709 13:12:42.547422 28889 master.cc:562] Master@127.28.54.126:35419 shutting down...
I20260709 13:12:42.568511 28889 raft_consensus.cc:2243] T 00000000000000000000000000000000 P bab1ceb4d36d4793a27161880e6a7bf7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:42.569010 28889 raft_consensus.cc:2272] T 00000000000000000000000000000000 P bab1ceb4d36d4793a27161880e6a7bf7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:42.569315 28889 tablet_replica.cc:333] T 00000000000000000000000000000000 P bab1ceb4d36d4793a27161880e6a7bf7: stopping tablet replica
I20260709 13:12:42.589572 28889 master.cc:584] Master@127.28.54.126:35419 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (36282 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 13:12:42.667631 28889 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.28.54.126:45925
I20260709 13:12:42.668705 28889 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:42.673870  3468 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:42.674508  3467 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:42.675381  3470 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:42.675838 28889 server_base.cc:1061] running on GCE node
I20260709 13:12:42.676853 28889 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:42.677033 28889 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:42.677175 28889 hybrid_clock.cc:648] HybridClock initialized: now 1783602762677158 us; error 0 us; skew 500 ppm
I20260709 13:12:42.677661 28889 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:42.680105 28889 webserver.cc:533] Webserver started at http://127.28.54.126:33445/ using document root <none> and password file <none>
I20260709 13:12:42.680565 28889 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:42.680734 28889 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:42.680971 28889 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:42.682054 28889 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602558744475-28889-0/minicluster-data/master-0-root/instance:
uuid: "83e83c73e13844b2af44f0d082fc54e0"
format_stamp: "Formatted at 2026-07-09 13:12:42 on dist-test-slave-vpdx"
I20260709 13:12:42.686489 28889 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 13:12:42.689555  3475 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:42.690243 28889 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:12:42.690495 28889 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602558744475-28889-0/minicluster-data/master-0-root
uuid: "83e83c73e13844b2af44f0d082fc54e0"
format_stamp: "Formatted at 2026-07-09 13:12:42 on dist-test-slave-vpdx"
I20260709 13:12:42.690738 28889 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602558744475-28889-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602558744475-28889-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602558744475-28889-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:42.699785 28889 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:42.700901 28889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:42.738014 28889 rpc_server.cc:307] RPC server started. Bound to: 127.28.54.126:45925
I20260709 13:12:42.738135  3526 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.54.126:45925 every 8 connection(s)
I20260709 13:12:42.741604  3527 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:42.751379  3527 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83e83c73e13844b2af44f0d082fc54e0: Bootstrap starting.
I20260709 13:12:42.755915  3527 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 83e83c73e13844b2af44f0d082fc54e0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:42.759765  3527 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 83e83c73e13844b2af44f0d082fc54e0: No bootstrap required, opened a new log
I20260709 13:12:42.761862  3527 raft_consensus.cc:359] T 00000000000000000000000000000000 P 83e83c73e13844b2af44f0d082fc54e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83e83c73e13844b2af44f0d082fc54e0" member_type: VOTER }
I20260709 13:12:42.762213  3527 raft_consensus.cc:385] T 00000000000000000000000000000000 P 83e83c73e13844b2af44f0d082fc54e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:42.762426  3527 raft_consensus.cc:740] T 00000000000000000000000000000000 P 83e83c73e13844b2af44f0d082fc54e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 83e83c73e13844b2af44f0d082fc54e0, State: Initialized, Role: FOLLOWER
I20260709 13:12:42.763008  3527 consensus_queue.cc:260] T 00000000000000000000000000000000 P 83e83c73e13844b2af44f0d082fc54e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83e83c73e13844b2af44f0d082fc54e0" member_type: VOTER }
I20260709 13:12:42.763433  3527 raft_consensus.cc:399] T 00000000000000000000000000000000 P 83e83c73e13844b2af44f0d082fc54e0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:12:42.763648  3527 raft_consensus.cc:493] T 00000000000000000000000000000000 P 83e83c73e13844b2af44f0d082fc54e0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:12:42.763867  3527 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 83e83c73e13844b2af44f0d082fc54e0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:42.768216  3527 raft_consensus.cc:515] T 00000000000000000000000000000000 P 83e83c73e13844b2af44f0d082fc54e0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83e83c73e13844b2af44f0d082fc54e0" member_type: VOTER }
I20260709 13:12:42.768685  3527 leader_election.cc:304] T 00000000000000000000000000000000 P 83e83c73e13844b2af44f0d082fc54e0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 83e83c73e13844b2af44f0d082fc54e0; no voters: 
I20260709 13:12:42.769819  3527 leader_election.cc:290] T 00000000000000000000000000000000 P 83e83c73e13844b2af44f0d082fc54e0 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:12:42.770112  3530 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 83e83c73e13844b2af44f0d082fc54e0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:42.771410  3530 raft_consensus.cc:697] T 00000000000000000000000000000000 P 83e83c73e13844b2af44f0d082fc54e0 [term 1 LEADER]: Becoming Leader. State: Replica: 83e83c73e13844b2af44f0d082fc54e0, State: Running, Role: LEADER
I20260709 13:12:42.771950  3530 consensus_queue.cc:237] T 00000000000000000000000000000000 P 83e83c73e13844b2af44f0d082fc54e0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83e83c73e13844b2af44f0d082fc54e0" member_type: VOTER }
I20260709 13:12:42.772580  3527 sys_catalog.cc:565] T 00000000000000000000000000000000 P 83e83c73e13844b2af44f0d082fc54e0 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:12:42.776589  3531 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83e83c73e13844b2af44f0d082fc54e0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "83e83c73e13844b2af44f0d082fc54e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83e83c73e13844b2af44f0d082fc54e0" member_type: VOTER } }
I20260709 13:12:42.777161  3531 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83e83c73e13844b2af44f0d082fc54e0 [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:42.777233  3532 sys_catalog.cc:455] T 00000000000000000000000000000000 P 83e83c73e13844b2af44f0d082fc54e0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 83e83c73e13844b2af44f0d082fc54e0. Latest consensus state: current_term: 1 leader_uuid: "83e83c73e13844b2af44f0d082fc54e0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "83e83c73e13844b2af44f0d082fc54e0" member_type: VOTER } }
I20260709 13:12:42.777878  3532 sys_catalog.cc:458] T 00000000000000000000000000000000 P 83e83c73e13844b2af44f0d082fc54e0 [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:42.784221  3537 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:12:42.791191  3537 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:12:42.793675 28889 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:12:42.800954  3537 catalog_manager.cc:1383] Generated new cluster ID: 066f721eddfa461ab21f9522c5871370
I20260709 13:12:42.801240  3537 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:12:42.822328  3537 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:12:42.823879  3537 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:12:42.838869  3537 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 83e83c73e13844b2af44f0d082fc54e0: Generated new TSK 0
I20260709 13:12:42.839361  3537 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:12:42.859881 28889 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:42.865414  3548 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:42.866309  3549 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:42.868116 28889 server_base.cc:1061] running on GCE node
W20260709 13:12:42.868610  3551 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:42.869439 28889 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:42.869635 28889 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:42.869805 28889 hybrid_clock.cc:648] HybridClock initialized: now 1783602762869787 us; error 0 us; skew 500 ppm
I20260709 13:12:42.870285 28889 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:42.872330 28889 webserver.cc:533] Webserver started at http://127.28.54.65:34317/ using document root <none> and password file <none>
I20260709 13:12:42.872771 28889 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:42.872942 28889 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:42.873180 28889 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:42.874357 28889 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602558744475-28889-0/minicluster-data/ts-0-root/instance:
uuid: "563a1c63813642e591d31cf7936f81d0"
format_stamp: "Formatted at 2026-07-09 13:12:42 on dist-test-slave-vpdx"
I20260709 13:12:42.878458 28889 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:12:42.881428  3556 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:42.882246 28889 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:12:42.882511 28889 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602558744475-28889-0/minicluster-data/ts-0-root
uuid: "563a1c63813642e591d31cf7936f81d0"
format_stamp: "Formatted at 2026-07-09 13:12:42 on dist-test-slave-vpdx"
I20260709 13:12:42.882763 28889 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602558744475-28889-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602558744475-28889-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602558744475-28889-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:42.915766 28889 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:42.916927 28889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:42.918272 28889 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:42.920379 28889 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:42.920544 28889 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:42.920804 28889 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:42.920964 28889 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:42.958750 28889 rpc_server.cc:307] RPC server started. Bound to: 127.28.54.65:42995
I20260709 13:12:42.958891  3618 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.54.65:42995 every 8 connection(s)
I20260709 13:12:42.963452 28889 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:42.970108  3623 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:42.970911  3624 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:42.972529  3626 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:42.974854 28889 server_base.cc:1061] running on GCE node
I20260709 13:12:42.975569  3619 heartbeater.cc:344] Connected to a master server at 127.28.54.126:45925
I20260709 13:12:42.975930  3619 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:42.976089 28889 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:42.976332 28889 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:42.976480 28889 hybrid_clock.cc:648] HybridClock initialized: now 1783602762976461 us; error 0 us; skew 500 ppm
I20260709 13:12:42.976580  3619 heartbeater.cc:507] Master 127.28.54.126:45925 requested a full tablet report, sending...
I20260709 13:12:42.977025 28889 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:42.978719  3492 ts_manager.cc:194] Registered new tserver with Master: 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995)
I20260709 13:12:42.979372 28889 webserver.cc:533] Webserver started at http://127.28.54.66:42713/ using document root <none> and password file <none>
I20260709 13:12:42.979879 28889 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:42.980054 28889 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:42.980293 28889 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:42.980486  3492 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55748
I20260709 13:12:42.981329 28889 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602558744475-28889-0/minicluster-data/ts-1-root/instance:
uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56"
format_stamp: "Formatted at 2026-07-09 13:12:42 on dist-test-slave-vpdx"
I20260709 13:12:42.985641 28889 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 13:12:42.988587  3631 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:42.989243 28889 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:12:42.989497 28889 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602558744475-28889-0/minicluster-data/ts-1-root
uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56"
format_stamp: "Formatted at 2026-07-09 13:12:42 on dist-test-slave-vpdx"
I20260709 13:12:42.989784 28889 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602558744475-28889-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602558744475-28889-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602558744475-28889-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:43.002049 28889 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:43.003101 28889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:43.004441 28889 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:43.007490 28889 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:43.007687 28889 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:43.007912 28889 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:43.008056 28889 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:43.045076 28889 rpc_server.cc:307] RPC server started. Bound to: 127.28.54.66:39331
I20260709 13:12:43.045185  3693 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.54.66:39331 every 8 connection(s)
I20260709 13:12:43.049482 28889 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:43.055495  3697 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:43.056030  3698 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:43.058643  3700 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:43.058797 28889 server_base.cc:1061] running on GCE node
I20260709 13:12:43.060000 28889 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:12:43.060009  3694 heartbeater.cc:344] Connected to a master server at 127.28.54.126:45925
W20260709 13:12:43.060367 28889 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:43.060525  3694 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:43.060581 28889 hybrid_clock.cc:648] HybridClock initialized: now 1783602763060562 us; error 0 us; skew 500 ppm
I20260709 13:12:43.061537 28889 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:43.061576  3694 heartbeater.cc:507] Master 127.28.54.126:45925 requested a full tablet report, sending...
I20260709 13:12:43.063832  3492 ts_manager.cc:194] Registered new tserver with Master: 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66:39331)
I20260709 13:12:43.064185 28889 webserver.cc:533] Webserver started at http://127.28.54.67:44101/ using document root <none> and password file <none>
I20260709 13:12:43.064706 28889 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:43.064883 28889 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:43.065126 28889 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:43.065243  3492 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55760
I20260709 13:12:43.066371 28889 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602558744475-28889-0/minicluster-data/ts-2-root/instance:
uuid: "1e8299ce77aa4939877e6f90c5bd04aa"
format_stamp: "Formatted at 2026-07-09 13:12:43 on dist-test-slave-vpdx"
I20260709 13:12:43.070535 28889 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.004s
I20260709 13:12:43.073791  3705 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:43.074553 28889 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:12:43.074860 28889 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602558744475-28889-0/minicluster-data/ts-2-root
uuid: "1e8299ce77aa4939877e6f90c5bd04aa"
format_stamp: "Formatted at 2026-07-09 13:12:43 on dist-test-slave-vpdx"
I20260709 13:12:43.075166 28889 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602558744475-28889-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602558744475-28889-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602558744475-28889-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:43.088989 28889 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:43.090144 28889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:43.091571 28889 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:43.093735 28889 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:43.093926 28889 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:43.094153 28889 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:43.094311 28889 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:43.131091 28889 rpc_server.cc:307] RPC server started. Bound to: 127.28.54.67:33771
I20260709 13:12:43.131258  3767 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.54.67:33771 every 8 connection(s)
I20260709 13:12:43.144053  3768 heartbeater.cc:344] Connected to a master server at 127.28.54.126:45925
I20260709 13:12:43.144456  3768 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:43.145071  3768 heartbeater.cc:507] Master 127.28.54.126:45925 requested a full tablet report, sending...
I20260709 13:12:43.146831  3492 ts_manager.cc:194] Registered new tserver with Master: 1e8299ce77aa4939877e6f90c5bd04aa (127.28.54.67:33771)
I20260709 13:12:43.147248 28889 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013170407s
I20260709 13:12:43.148054  3492 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55774
I20260709 13:12:43.170665  3492 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55788:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:12:43.173420  3492 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:12:43.243784  3584 tablet_service.cc:1511] Processing CreateTablet for tablet 3077a0a5b9944af39dde06a7e84b9df9 (DEFAULT_TABLE table=test-workload [id=2babb5aebc6d4a47b47732bac6811e59]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:12:43.245208  3584 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3077a0a5b9944af39dde06a7e84b9df9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:43.246968  3733 tablet_service.cc:1511] Processing CreateTablet for tablet 3077a0a5b9944af39dde06a7e84b9df9 (DEFAULT_TABLE table=test-workload [id=2babb5aebc6d4a47b47732bac6811e59]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:12:43.248306  3733 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3077a0a5b9944af39dde06a7e84b9df9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:43.248391  3728 tablet_service.cc:1511] Processing CreateTablet for tablet fab01b4c92b34ed1aa888cc485d1c0e0 (DEFAULT_TABLE table=test-workload [id=2babb5aebc6d4a47b47732bac6811e59]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:12:43.249622  3732 tablet_service.cc:1511] Processing CreateTablet for tablet 28cf86f3998847ab92593600dbdb0d90 (DEFAULT_TABLE table=test-workload [id=2babb5aebc6d4a47b47732bac6811e59]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:12:43.251798  3731 tablet_service.cc:1511] Processing CreateTablet for tablet 92acdf60735749beb2a12618aff17cfd (DEFAULT_TABLE table=test-workload [id=2babb5aebc6d4a47b47732bac6811e59]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:12:43.252465  3659 tablet_service.cc:1511] Processing CreateTablet for tablet 3077a0a5b9944af39dde06a7e84b9df9 (DEFAULT_TABLE table=test-workload [id=2babb5aebc6d4a47b47732bac6811e59]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 13:12:43.253813  3659 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3077a0a5b9944af39dde06a7e84b9df9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:43.254016  3730 tablet_service.cc:1511] Processing CreateTablet for tablet 04d72e5e1a07401996c45a94f44bd659 (DEFAULT_TABLE table=test-workload [id=2babb5aebc6d4a47b47732bac6811e59]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:12:43.247053  3729 tablet_service.cc:1511] Processing CreateTablet for tablet ea26aa43a7c147bea7311233d455f8d5 (DEFAULT_TABLE table=test-workload [id=2babb5aebc6d4a47b47732bac6811e59]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:12:43.256028  3732 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28cf86f3998847ab92593600dbdb0d90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:43.257990  3731 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92acdf60735749beb2a12618aff17cfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:43.258683  3729 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea26aa43a7c147bea7311233d455f8d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:43.258850  3657 tablet_service.cc:1511] Processing CreateTablet for tablet 92acdf60735749beb2a12618aff17cfd (DEFAULT_TABLE table=test-workload [id=2babb5aebc6d4a47b47732bac6811e59]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:12:43.260203  3657 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92acdf60735749beb2a12618aff17cfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:43.262228  3727 tablet_service.cc:1511] Processing CreateTablet for tablet 0f5afe6645d14571bf8ff8a0ba86afb3 (DEFAULT_TABLE table=test-workload [id=2babb5aebc6d4a47b47732bac6811e59]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:12:43.262861  3656 tablet_service.cc:1511] Processing CreateTablet for tablet 04d72e5e1a07401996c45a94f44bd659 (DEFAULT_TABLE table=test-workload [id=2babb5aebc6d4a47b47732bac6811e59]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:12:43.263523  3727 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f5afe6645d14571bf8ff8a0ba86afb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:43.264231  3656 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04d72e5e1a07401996c45a94f44bd659. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:43.265304  3658 tablet_service.cc:1511] Processing CreateTablet for tablet 28cf86f3998847ab92593600dbdb0d90 (DEFAULT_TABLE table=test-workload [id=2babb5aebc6d4a47b47732bac6811e59]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:12:43.265484  3726 tablet_service.cc:1511] Processing CreateTablet for tablet 84ca4c013a24451388658395af3b8b78 (DEFAULT_TABLE table=test-workload [id=2babb5aebc6d4a47b47732bac6811e59]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:12:43.266835  3726 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84ca4c013a24451388658395af3b8b78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:43.268143  3655 tablet_service.cc:1511] Processing CreateTablet for tablet ea26aa43a7c147bea7311233d455f8d5 (DEFAULT_TABLE table=test-workload [id=2babb5aebc6d4a47b47732bac6811e59]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:12:43.268805  3725 tablet_service.cc:1511] Processing CreateTablet for tablet ba2c5f7a7dd946bc843001bcb47a202a (DEFAULT_TABLE table=test-workload [id=2babb5aebc6d4a47b47732bac6811e59]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:12:43.270183  3725 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba2c5f7a7dd946bc843001bcb47a202a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:43.271015  3654 tablet_service.cc:1511] Processing CreateTablet for tablet fab01b4c92b34ed1aa888cc485d1c0e0 (DEFAULT_TABLE table=test-workload [id=2babb5aebc6d4a47b47732bac6811e59]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:12:43.273849  3653 tablet_service.cc:1511] Processing CreateTablet for tablet 0f5afe6645d14571bf8ff8a0ba86afb3 (DEFAULT_TABLE table=test-workload [id=2babb5aebc6d4a47b47732bac6811e59]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:12:43.274305  3730 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04d72e5e1a07401996c45a94f44bd659. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:43.266763  3658 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28cf86f3998847ab92593600dbdb0d90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:43.275461  3728 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fab01b4c92b34ed1aa888cc485d1c0e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:43.276487  3655 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea26aa43a7c147bea7311233d455f8d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:43.277734  3654 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fab01b4c92b34ed1aa888cc485d1c0e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:43.278985  3653 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f5afe6645d14571bf8ff8a0ba86afb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:43.285581  3724 tablet_service.cc:1511] Processing CreateTablet for tablet f06a4d3121be4a6fa29269fcb15b1e57 (DEFAULT_TABLE table=test-workload [id=2babb5aebc6d4a47b47732bac6811e59]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:12:43.286895  3724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f06a4d3121be4a6fa29269fcb15b1e57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:43.295441  3652 tablet_service.cc:1511] Processing CreateTablet for tablet 84ca4c013a24451388658395af3b8b78 (DEFAULT_TABLE table=test-workload [id=2babb5aebc6d4a47b47732bac6811e59]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:12:43.296703  3652 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84ca4c013a24451388658395af3b8b78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:43.299207  3651 tablet_service.cc:1511] Processing CreateTablet for tablet ba2c5f7a7dd946bc843001bcb47a202a (DEFAULT_TABLE table=test-workload [id=2babb5aebc6d4a47b47732bac6811e59]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:12:43.299634  3650 tablet_service.cc:1511] Processing CreateTablet for tablet f06a4d3121be4a6fa29269fcb15b1e57 (DEFAULT_TABLE table=test-workload [id=2babb5aebc6d4a47b47732bac6811e59]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:12:43.300490  3651 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba2c5f7a7dd946bc843001bcb47a202a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:43.301081  3650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f06a4d3121be4a6fa29269fcb15b1e57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:43.307503  3583 tablet_service.cc:1511] Processing CreateTablet for tablet 28cf86f3998847ab92593600dbdb0d90 (DEFAULT_TABLE table=test-workload [id=2babb5aebc6d4a47b47732bac6811e59]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 13:12:43.309044  3583 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28cf86f3998847ab92593600dbdb0d90. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:43.311407  3582 tablet_service.cc:1511] Processing CreateTablet for tablet 92acdf60735749beb2a12618aff17cfd (DEFAULT_TABLE table=test-workload [id=2babb5aebc6d4a47b47732bac6811e59]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 13:12:43.312835  3582 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92acdf60735749beb2a12618aff17cfd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:43.318260  3581 tablet_service.cc:1511] Processing CreateTablet for tablet 04d72e5e1a07401996c45a94f44bd659 (DEFAULT_TABLE table=test-workload [id=2babb5aebc6d4a47b47732bac6811e59]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 13:12:43.319670  3581 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04d72e5e1a07401996c45a94f44bd659. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:43.324131  3580 tablet_service.cc:1511] Processing CreateTablet for tablet ea26aa43a7c147bea7311233d455f8d5 (DEFAULT_TABLE table=test-workload [id=2babb5aebc6d4a47b47732bac6811e59]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 13:12:43.325668  3580 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ea26aa43a7c147bea7311233d455f8d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:43.331348  3579 tablet_service.cc:1511] Processing CreateTablet for tablet fab01b4c92b34ed1aa888cc485d1c0e0 (DEFAULT_TABLE table=test-workload [id=2babb5aebc6d4a47b47732bac6811e59]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 13:12:43.332836  3579 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fab01b4c92b34ed1aa888cc485d1c0e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:43.367446  3578 tablet_service.cc:1511] Processing CreateTablet for tablet 0f5afe6645d14571bf8ff8a0ba86afb3 (DEFAULT_TABLE table=test-workload [id=2babb5aebc6d4a47b47732bac6811e59]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 13:12:43.369019  3578 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0f5afe6645d14571bf8ff8a0ba86afb3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:43.375551  3577 tablet_service.cc:1511] Processing CreateTablet for tablet 84ca4c013a24451388658395af3b8b78 (DEFAULT_TABLE table=test-workload [id=2babb5aebc6d4a47b47732bac6811e59]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 13:12:43.377099  3577 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 84ca4c013a24451388658395af3b8b78. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:43.407459  3576 tablet_service.cc:1511] Processing CreateTablet for tablet ba2c5f7a7dd946bc843001bcb47a202a (DEFAULT_TABLE table=test-workload [id=2babb5aebc6d4a47b47732bac6811e59]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 13:12:43.409032  3576 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba2c5f7a7dd946bc843001bcb47a202a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:43.415459  3575 tablet_service.cc:1511] Processing CreateTablet for tablet f06a4d3121be4a6fa29269fcb15b1e57 (DEFAULT_TABLE table=test-workload [id=2babb5aebc6d4a47b47732bac6811e59]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 13:12:43.416947  3575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f06a4d3121be4a6fa29269fcb15b1e57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:43.458088  3784 tablet_bootstrap.cc:492] T f06a4d3121be4a6fa29269fcb15b1e57 P 1e8299ce77aa4939877e6f90c5bd04aa: Bootstrap starting.
I20260709 13:12:43.464937  3784 tablet_bootstrap.cc:654] T f06a4d3121be4a6fa29269fcb15b1e57 P 1e8299ce77aa4939877e6f90c5bd04aa: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.481343  3783 tablet_bootstrap.cc:492] T fab01b4c92b34ed1aa888cc485d1c0e0 P 6dfa3a6e32584eddb9dd28eb4e71bd56: Bootstrap starting.
I20260709 13:12:43.487874  3783 tablet_bootstrap.cc:654] T fab01b4c92b34ed1aa888cc485d1c0e0 P 6dfa3a6e32584eddb9dd28eb4e71bd56: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.490739  3785 tablet_bootstrap.cc:492] T ea26aa43a7c147bea7311233d455f8d5 P 563a1c63813642e591d31cf7936f81d0: Bootstrap starting.
I20260709 13:12:43.496268  3785 tablet_bootstrap.cc:654] T ea26aa43a7c147bea7311233d455f8d5 P 563a1c63813642e591d31cf7936f81d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.511061  3785 tablet_bootstrap.cc:492] T ea26aa43a7c147bea7311233d455f8d5 P 563a1c63813642e591d31cf7936f81d0: No bootstrap required, opened a new log
I20260709 13:12:43.511482  3785 ts_tablet_manager.cc:1403] T ea26aa43a7c147bea7311233d455f8d5 P 563a1c63813642e591d31cf7936f81d0: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.005s
I20260709 13:12:43.511696  3784 tablet_bootstrap.cc:492] T f06a4d3121be4a6fa29269fcb15b1e57 P 1e8299ce77aa4939877e6f90c5bd04aa: No bootstrap required, opened a new log
I20260709 13:12:43.512202  3784 ts_tablet_manager.cc:1403] T f06a4d3121be4a6fa29269fcb15b1e57 P 1e8299ce77aa4939877e6f90c5bd04aa: Time spent bootstrapping tablet: real 0.055s	user 0.007s	sys 0.004s
I20260709 13:12:43.512488  3783 tablet_bootstrap.cc:492] T fab01b4c92b34ed1aa888cc485d1c0e0 P 6dfa3a6e32584eddb9dd28eb4e71bd56: No bootstrap required, opened a new log
I20260709 13:12:43.512992  3783 ts_tablet_manager.cc:1403] T fab01b4c92b34ed1aa888cc485d1c0e0 P 6dfa3a6e32584eddb9dd28eb4e71bd56: Time spent bootstrapping tablet: real 0.032s	user 0.015s	sys 0.012s
I20260709 13:12:43.513641  3785 raft_consensus.cc:359] T ea26aa43a7c147bea7311233d455f8d5 P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.514231  3785 raft_consensus.cc:385] T ea26aa43a7c147bea7311233d455f8d5 P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.514444  3785 raft_consensus.cc:740] T ea26aa43a7c147bea7311233d455f8d5 P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 563a1c63813642e591d31cf7936f81d0, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.515097  3785 consensus_queue.cc:260] T ea26aa43a7c147bea7311233d455f8d5 P 563a1c63813642e591d31cf7936f81d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.515043  3784 raft_consensus.cc:359] T f06a4d3121be4a6fa29269fcb15b1e57 P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.515933  3784 raft_consensus.cc:385] T f06a4d3121be4a6fa29269fcb15b1e57 P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.515684  3783 raft_consensus.cc:359] T fab01b4c92b34ed1aa888cc485d1c0e0 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.516247  3784 raft_consensus.cc:740] T f06a4d3121be4a6fa29269fcb15b1e57 P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e8299ce77aa4939877e6f90c5bd04aa, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.516419  3783 raft_consensus.cc:385] T fab01b4c92b34ed1aa888cc485d1c0e0 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.516745  3783 raft_consensus.cc:740] T fab01b4c92b34ed1aa888cc485d1c0e0 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dfa3a6e32584eddb9dd28eb4e71bd56, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.517023  3784 consensus_queue.cc:260] T f06a4d3121be4a6fa29269fcb15b1e57 P 1e8299ce77aa4939877e6f90c5bd04aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.517648  3619 heartbeater.cc:499] Master 127.28.54.126:45925 was elected leader, sending a full tablet report...
I20260709 13:12:43.517732  3785 ts_tablet_manager.cc:1434] T ea26aa43a7c147bea7311233d455f8d5 P 563a1c63813642e591d31cf7936f81d0: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.004s
I20260709 13:12:43.519744  3785 tablet_bootstrap.cc:492] T 84ca4c013a24451388658395af3b8b78 P 563a1c63813642e591d31cf7936f81d0: Bootstrap starting.
I20260709 13:12:43.520597  3768 heartbeater.cc:499] Master 127.28.54.126:45925 was elected leader, sending a full tablet report...
I20260709 13:12:43.521036  3784 ts_tablet_manager.cc:1434] T f06a4d3121be4a6fa29269fcb15b1e57 P 1e8299ce77aa4939877e6f90c5bd04aa: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.004s
I20260709 13:12:43.522142  3784 tablet_bootstrap.cc:492] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 1e8299ce77aa4939877e6f90c5bd04aa: Bootstrap starting.
I20260709 13:12:43.518186  3783 consensus_queue.cc:260] T fab01b4c92b34ed1aa888cc485d1c0e0 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.528450  3784 tablet_bootstrap.cc:654] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 1e8299ce77aa4939877e6f90c5bd04aa: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.531831  3785 tablet_bootstrap.cc:654] T 84ca4c013a24451388658395af3b8b78 P 563a1c63813642e591d31cf7936f81d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.537053  3694 heartbeater.cc:499] Master 127.28.54.126:45925 was elected leader, sending a full tablet report...
I20260709 13:12:43.539812  3783 ts_tablet_manager.cc:1434] T fab01b4c92b34ed1aa888cc485d1c0e0 P 6dfa3a6e32584eddb9dd28eb4e71bd56: Time spent starting tablet: real 0.027s	user 0.001s	sys 0.014s
I20260709 13:12:43.540863  3783 tablet_bootstrap.cc:492] T f06a4d3121be4a6fa29269fcb15b1e57 P 6dfa3a6e32584eddb9dd28eb4e71bd56: Bootstrap starting.
W20260709 13:12:43.551929  3695 tablet.cc:2406] T fab01b4c92b34ed1aa888cc485d1c0e0 P 6dfa3a6e32584eddb9dd28eb4e71bd56: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:12:43.557708  3785 tablet_bootstrap.cc:492] T 84ca4c013a24451388658395af3b8b78 P 563a1c63813642e591d31cf7936f81d0: No bootstrap required, opened a new log
I20260709 13:12:43.557873  3784 tablet_bootstrap.cc:492] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 1e8299ce77aa4939877e6f90c5bd04aa: No bootstrap required, opened a new log
I20260709 13:12:43.558401  3785 ts_tablet_manager.cc:1403] T 84ca4c013a24451388658395af3b8b78 P 563a1c63813642e591d31cf7936f81d0: Time spent bootstrapping tablet: real 0.039s	user 0.015s	sys 0.008s
I20260709 13:12:43.558580  3784 ts_tablet_manager.cc:1403] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 1e8299ce77aa4939877e6f90c5bd04aa: Time spent bootstrapping tablet: real 0.037s	user 0.015s	sys 0.020s
I20260709 13:12:43.561486  3785 raft_consensus.cc:359] T 84ca4c013a24451388658395af3b8b78 P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.561533  3784 raft_consensus.cc:359] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.562417  3785 raft_consensus.cc:385] T 84ca4c013a24451388658395af3b8b78 P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.562525  3784 raft_consensus.cc:385] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.562844  3785 raft_consensus.cc:740] T 84ca4c013a24451388658395af3b8b78 P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 563a1c63813642e591d31cf7936f81d0, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.562971  3784 raft_consensus.cc:740] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e8299ce77aa4939877e6f90c5bd04aa, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.563720  3785 consensus_queue.cc:260] T 84ca4c013a24451388658395af3b8b78 P 563a1c63813642e591d31cf7936f81d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.563946  3784 consensus_queue.cc:260] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 1e8299ce77aa4939877e6f90c5bd04aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.565801  3785 ts_tablet_manager.cc:1434] T 84ca4c013a24451388658395af3b8b78 P 563a1c63813642e591d31cf7936f81d0: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:12:43.566555  3784 ts_tablet_manager.cc:1434] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 1e8299ce77aa4939877e6f90c5bd04aa: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:12:43.566712  3785 tablet_bootstrap.cc:492] T fab01b4c92b34ed1aa888cc485d1c0e0 P 563a1c63813642e591d31cf7936f81d0: Bootstrap starting.
I20260709 13:12:43.567502  3784 tablet_bootstrap.cc:492] T 92acdf60735749beb2a12618aff17cfd P 1e8299ce77aa4939877e6f90c5bd04aa: Bootstrap starting.
I20260709 13:12:43.572847  3785 tablet_bootstrap.cc:654] T fab01b4c92b34ed1aa888cc485d1c0e0 P 563a1c63813642e591d31cf7936f81d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.573946  3784 tablet_bootstrap.cc:654] T 92acdf60735749beb2a12618aff17cfd P 1e8299ce77aa4939877e6f90c5bd04aa: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.578441  3783 tablet_bootstrap.cc:654] T f06a4d3121be4a6fa29269fcb15b1e57 P 6dfa3a6e32584eddb9dd28eb4e71bd56: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.588948  3784 tablet_bootstrap.cc:492] T 92acdf60735749beb2a12618aff17cfd P 1e8299ce77aa4939877e6f90c5bd04aa: No bootstrap required, opened a new log
I20260709 13:12:43.589425  3784 ts_tablet_manager.cc:1403] T 92acdf60735749beb2a12618aff17cfd P 1e8299ce77aa4939877e6f90c5bd04aa: Time spent bootstrapping tablet: real 0.022s	user 0.002s	sys 0.018s
I20260709 13:12:43.589938  3785 tablet_bootstrap.cc:492] T fab01b4c92b34ed1aa888cc485d1c0e0 P 563a1c63813642e591d31cf7936f81d0: No bootstrap required, opened a new log
I20260709 13:12:43.590442  3785 ts_tablet_manager.cc:1403] T fab01b4c92b34ed1aa888cc485d1c0e0 P 563a1c63813642e591d31cf7936f81d0: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.005s
I20260709 13:12:43.590538  3783 tablet_bootstrap.cc:492] T f06a4d3121be4a6fa29269fcb15b1e57 P 6dfa3a6e32584eddb9dd28eb4e71bd56: No bootstrap required, opened a new log
I20260709 13:12:43.591127  3783 ts_tablet_manager.cc:1403] T f06a4d3121be4a6fa29269fcb15b1e57 P 6dfa3a6e32584eddb9dd28eb4e71bd56: Time spent bootstrapping tablet: real 0.050s	user 0.010s	sys 0.003s
I20260709 13:12:43.591665  3784 raft_consensus.cc:359] T 92acdf60735749beb2a12618aff17cfd P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.592329  3784 raft_consensus.cc:385] T 92acdf60735749beb2a12618aff17cfd P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.592549  3784 raft_consensus.cc:740] T 92acdf60735749beb2a12618aff17cfd P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e8299ce77aa4939877e6f90c5bd04aa, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.593201  3784 consensus_queue.cc:260] T 92acdf60735749beb2a12618aff17cfd P 1e8299ce77aa4939877e6f90c5bd04aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.593290  3785 raft_consensus.cc:359] T fab01b4c92b34ed1aa888cc485d1c0e0 P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.594058  3785 raft_consensus.cc:385] T fab01b4c92b34ed1aa888cc485d1c0e0 P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.593923  3783 raft_consensus.cc:359] T f06a4d3121be4a6fa29269fcb15b1e57 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.594412  3785 raft_consensus.cc:740] T fab01b4c92b34ed1aa888cc485d1c0e0 P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 563a1c63813642e591d31cf7936f81d0, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.594695  3783 raft_consensus.cc:385] T f06a4d3121be4a6fa29269fcb15b1e57 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.595012  3783 raft_consensus.cc:740] T f06a4d3121be4a6fa29269fcb15b1e57 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dfa3a6e32584eddb9dd28eb4e71bd56, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.595350  3784 ts_tablet_manager.cc:1434] T 92acdf60735749beb2a12618aff17cfd P 1e8299ce77aa4939877e6f90c5bd04aa: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:12:43.595181  3785 consensus_queue.cc:260] T fab01b4c92b34ed1aa888cc485d1c0e0 P 563a1c63813642e591d31cf7936f81d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.595842  3783 consensus_queue.cc:260] T f06a4d3121be4a6fa29269fcb15b1e57 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.596344  3784 tablet_bootstrap.cc:492] T 04d72e5e1a07401996c45a94f44bd659 P 1e8299ce77aa4939877e6f90c5bd04aa: Bootstrap starting.
I20260709 13:12:43.597549  3785 ts_tablet_manager.cc:1434] T fab01b4c92b34ed1aa888cc485d1c0e0 P 563a1c63813642e591d31cf7936f81d0: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 13:12:43.598488  3785 tablet_bootstrap.cc:492] T 3077a0a5b9944af39dde06a7e84b9df9 P 563a1c63813642e591d31cf7936f81d0: Bootstrap starting.
I20260709 13:12:43.602862  3783 ts_tablet_manager.cc:1434] T f06a4d3121be4a6fa29269fcb15b1e57 P 6dfa3a6e32584eddb9dd28eb4e71bd56: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:12:43.602968  3784 tablet_bootstrap.cc:654] T 04d72e5e1a07401996c45a94f44bd659 P 1e8299ce77aa4939877e6f90c5bd04aa: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.603924  3783 tablet_bootstrap.cc:492] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 6dfa3a6e32584eddb9dd28eb4e71bd56: Bootstrap starting.
I20260709 13:12:43.604351  3785 tablet_bootstrap.cc:654] T 3077a0a5b9944af39dde06a7e84b9df9 P 563a1c63813642e591d31cf7936f81d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.614041  3783 tablet_bootstrap.cc:654] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 6dfa3a6e32584eddb9dd28eb4e71bd56: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.626536  3784 tablet_bootstrap.cc:492] T 04d72e5e1a07401996c45a94f44bd659 P 1e8299ce77aa4939877e6f90c5bd04aa: No bootstrap required, opened a new log
I20260709 13:12:43.627036  3784 ts_tablet_manager.cc:1403] T 04d72e5e1a07401996c45a94f44bd659 P 1e8299ce77aa4939877e6f90c5bd04aa: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.012s
I20260709 13:12:43.627756  3785 tablet_bootstrap.cc:492] T 3077a0a5b9944af39dde06a7e84b9df9 P 563a1c63813642e591d31cf7936f81d0: No bootstrap required, opened a new log
I20260709 13:12:43.627849  3783 tablet_bootstrap.cc:492] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 6dfa3a6e32584eddb9dd28eb4e71bd56: No bootstrap required, opened a new log
I20260709 13:12:43.628392  3785 ts_tablet_manager.cc:1403] T 3077a0a5b9944af39dde06a7e84b9df9 P 563a1c63813642e591d31cf7936f81d0: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.013s
I20260709 13:12:43.628441  3783 ts_tablet_manager.cc:1403] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 6dfa3a6e32584eddb9dd28eb4e71bd56: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.000s
I20260709 13:12:43.629801  3784 raft_consensus.cc:359] T 04d72e5e1a07401996c45a94f44bd659 P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.630548  3784 raft_consensus.cc:385] T 04d72e5e1a07401996c45a94f44bd659 P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.630824  3784 raft_consensus.cc:740] T 04d72e5e1a07401996c45a94f44bd659 P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e8299ce77aa4939877e6f90c5bd04aa, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.630792  3783 raft_consensus.cc:359] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.631469  3783 raft_consensus.cc:385] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.631278  3785 raft_consensus.cc:359] T 3077a0a5b9944af39dde06a7e84b9df9 P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } } peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } }
I20260709 13:12:43.631808  3783 raft_consensus.cc:740] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dfa3a6e32584eddb9dd28eb4e71bd56, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.632059  3785 raft_consensus.cc:385] T 3077a0a5b9944af39dde06a7e84b9df9 P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.631747  3784 consensus_queue.cc:260] T 04d72e5e1a07401996c45a94f44bd659 P 1e8299ce77aa4939877e6f90c5bd04aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.632421  3785 raft_consensus.cc:740] T 3077a0a5b9944af39dde06a7e84b9df9 P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 563a1c63813642e591d31cf7936f81d0, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.632674  3783 consensus_queue.cc:260] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.633203  3785 consensus_queue.cc:260] T 3077a0a5b9944af39dde06a7e84b9df9 P 563a1c63813642e591d31cf7936f81d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } } peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } }
I20260709 13:12:43.634063  3784 ts_tablet_manager.cc:1434] T 04d72e5e1a07401996c45a94f44bd659 P 1e8299ce77aa4939877e6f90c5bd04aa: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:12:43.634972  3784 tablet_bootstrap.cc:492] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa: Bootstrap starting.
I20260709 13:12:43.635363  3785 ts_tablet_manager.cc:1434] T 3077a0a5b9944af39dde06a7e84b9df9 P 563a1c63813642e591d31cf7936f81d0: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 13:12:43.636356  3785 tablet_bootstrap.cc:492] T ba2c5f7a7dd946bc843001bcb47a202a P 563a1c63813642e591d31cf7936f81d0: Bootstrap starting.
I20260709 13:12:43.640987  3784 tablet_bootstrap.cc:654] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.642163  3783 ts_tablet_manager.cc:1434] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 6dfa3a6e32584eddb9dd28eb4e71bd56: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 13:12:43.642239  3785 tablet_bootstrap.cc:654] T ba2c5f7a7dd946bc843001bcb47a202a P 563a1c63813642e591d31cf7936f81d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.649260  3783 tablet_bootstrap.cc:492] T 04d72e5e1a07401996c45a94f44bd659 P 6dfa3a6e32584eddb9dd28eb4e71bd56: Bootstrap starting.
I20260709 13:12:43.652400  3784 tablet_bootstrap.cc:492] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa: No bootstrap required, opened a new log
I20260709 13:12:43.653014  3784 ts_tablet_manager.cc:1403] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 13:12:43.655256  3783 tablet_bootstrap.cc:654] T 04d72e5e1a07401996c45a94f44bd659 P 6dfa3a6e32584eddb9dd28eb4e71bd56: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.656159  3784 raft_consensus.cc:359] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.656982  3784 raft_consensus.cc:385] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.657287  3784 raft_consensus.cc:740] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e8299ce77aa4939877e6f90c5bd04aa, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.659577  3783 tablet_bootstrap.cc:492] T 04d72e5e1a07401996c45a94f44bd659 P 6dfa3a6e32584eddb9dd28eb4e71bd56: No bootstrap required, opened a new log
I20260709 13:12:43.659159  3784 consensus_queue.cc:260] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.660017  3783 ts_tablet_manager.cc:1403] T 04d72e5e1a07401996c45a94f44bd659 P 6dfa3a6e32584eddb9dd28eb4e71bd56: Time spent bootstrapping tablet: real 0.011s	user 0.007s	sys 0.002s
I20260709 13:12:43.660285  3785 tablet_bootstrap.cc:492] T ba2c5f7a7dd946bc843001bcb47a202a P 563a1c63813642e591d31cf7936f81d0: No bootstrap required, opened a new log
I20260709 13:12:43.660797  3785 ts_tablet_manager.cc:1403] T ba2c5f7a7dd946bc843001bcb47a202a P 563a1c63813642e591d31cf7936f81d0: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.011s
I20260709 13:12:43.661516  3784 ts_tablet_manager.cc:1434] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:12:43.662631  3784 tablet_bootstrap.cc:492] T 3077a0a5b9944af39dde06a7e84b9df9 P 1e8299ce77aa4939877e6f90c5bd04aa: Bootstrap starting.
I20260709 13:12:43.662889  3783 raft_consensus.cc:359] T 04d72e5e1a07401996c45a94f44bd659 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.664011  3783 raft_consensus.cc:385] T 04d72e5e1a07401996c45a94f44bd659 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.663726  3785 raft_consensus.cc:359] T ba2c5f7a7dd946bc843001bcb47a202a P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.664322  3783 raft_consensus.cc:740] T 04d72e5e1a07401996c45a94f44bd659 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dfa3a6e32584eddb9dd28eb4e71bd56, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.664503  3785 raft_consensus.cc:385] T ba2c5f7a7dd946bc843001bcb47a202a P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.664868  3785 raft_consensus.cc:740] T ba2c5f7a7dd946bc843001bcb47a202a P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 563a1c63813642e591d31cf7936f81d0, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.665194  3783 consensus_queue.cc:260] T 04d72e5e1a07401996c45a94f44bd659 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.665680  3785 consensus_queue.cc:260] T ba2c5f7a7dd946bc843001bcb47a202a P 563a1c63813642e591d31cf7936f81d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.667995  3785 ts_tablet_manager.cc:1434] T ba2c5f7a7dd946bc843001bcb47a202a P 563a1c63813642e591d31cf7936f81d0: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:12:43.668923  3785 tablet_bootstrap.cc:492] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 563a1c63813642e591d31cf7936f81d0: Bootstrap starting.
I20260709 13:12:43.669005  3784 tablet_bootstrap.cc:654] T 3077a0a5b9944af39dde06a7e84b9df9 P 1e8299ce77aa4939877e6f90c5bd04aa: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.670056  3783 ts_tablet_manager.cc:1434] T 04d72e5e1a07401996c45a94f44bd659 P 6dfa3a6e32584eddb9dd28eb4e71bd56: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 13:12:43.671041  3783 tablet_bootstrap.cc:492] T 3077a0a5b9944af39dde06a7e84b9df9 P 6dfa3a6e32584eddb9dd28eb4e71bd56: Bootstrap starting.
I20260709 13:12:43.675776  3785 tablet_bootstrap.cc:654] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 563a1c63813642e591d31cf7936f81d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.676992  3783 tablet_bootstrap.cc:654] T 3077a0a5b9944af39dde06a7e84b9df9 P 6dfa3a6e32584eddb9dd28eb4e71bd56: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.680459  3784 tablet_bootstrap.cc:492] T 3077a0a5b9944af39dde06a7e84b9df9 P 1e8299ce77aa4939877e6f90c5bd04aa: No bootstrap required, opened a new log
I20260709 13:12:43.680991  3784 ts_tablet_manager.cc:1403] T 3077a0a5b9944af39dde06a7e84b9df9 P 1e8299ce77aa4939877e6f90c5bd04aa: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.005s
I20260709 13:12:43.684444  3784 raft_consensus.cc:359] T 3077a0a5b9944af39dde06a7e84b9df9 P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } } peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } }
I20260709 13:12:43.685176  3784 raft_consensus.cc:385] T 3077a0a5b9944af39dde06a7e84b9df9 P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.685465  3784 raft_consensus.cc:740] T 3077a0a5b9944af39dde06a7e84b9df9 P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e8299ce77aa4939877e6f90c5bd04aa, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.686301  3784 consensus_queue.cc:260] T 3077a0a5b9944af39dde06a7e84b9df9 P 1e8299ce77aa4939877e6f90c5bd04aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } } peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } }
I20260709 13:12:43.687418  3785 tablet_bootstrap.cc:492] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 563a1c63813642e591d31cf7936f81d0: No bootstrap required, opened a new log
I20260709 13:12:43.687937  3785 ts_tablet_manager.cc:1403] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 563a1c63813642e591d31cf7936f81d0: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 13:12:43.688199  3783 tablet_bootstrap.cc:492] T 3077a0a5b9944af39dde06a7e84b9df9 P 6dfa3a6e32584eddb9dd28eb4e71bd56: No bootstrap required, opened a new log
I20260709 13:12:43.688629  3784 ts_tablet_manager.cc:1434] T 3077a0a5b9944af39dde06a7e84b9df9 P 1e8299ce77aa4939877e6f90c5bd04aa: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:12:43.688699  3783 ts_tablet_manager.cc:1403] T 3077a0a5b9944af39dde06a7e84b9df9 P 6dfa3a6e32584eddb9dd28eb4e71bd56: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 13:12:43.689731  3784 tablet_bootstrap.cc:492] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa: Bootstrap starting.
I20260709 13:12:43.690697  3785 raft_consensus.cc:359] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.691417  3785 raft_consensus.cc:385] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.691709  3785 raft_consensus.cc:740] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 563a1c63813642e591d31cf7936f81d0, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.692723  3785 consensus_queue.cc:260] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 563a1c63813642e591d31cf7936f81d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.695358  3785 ts_tablet_manager.cc:1434] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 563a1c63813642e591d31cf7936f81d0: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.004s
I20260709 13:12:43.696353  3785 tablet_bootstrap.cc:492] T 28cf86f3998847ab92593600dbdb0d90 P 563a1c63813642e591d31cf7936f81d0: Bootstrap starting.
I20260709 13:12:43.696491  3784 tablet_bootstrap.cc:654] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.701669  3783 raft_consensus.cc:359] T 3077a0a5b9944af39dde06a7e84b9df9 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } } peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } }
I20260709 13:12:43.702442  3783 raft_consensus.cc:385] T 3077a0a5b9944af39dde06a7e84b9df9 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.702580  3785 tablet_bootstrap.cc:654] T 28cf86f3998847ab92593600dbdb0d90 P 563a1c63813642e591d31cf7936f81d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.702732  3783 raft_consensus.cc:740] T 3077a0a5b9944af39dde06a7e84b9df9 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dfa3a6e32584eddb9dd28eb4e71bd56, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.703696  3783 consensus_queue.cc:260] T 3077a0a5b9944af39dde06a7e84b9df9 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } } peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } }
I20260709 13:12:43.705003  3789 raft_consensus.cc:493] T ba2c5f7a7dd946bc843001bcb47a202a P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.705554  3789 raft_consensus.cc:515] T ba2c5f7a7dd946bc843001bcb47a202a P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.716528  3790 raft_consensus.cc:493] T f06a4d3121be4a6fa29269fcb15b1e57 P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.717034  3790 raft_consensus.cc:515] T f06a4d3121be4a6fa29269fcb15b1e57 P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.719143  3789 leader_election.cc:290] T ba2c5f7a7dd946bc843001bcb47a202a P 563a1c63813642e591d31cf7936f81d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66:39331), 1e8299ce77aa4939877e6f90c5bd04aa (127.28.54.67:33771)
I20260709 13:12:43.719521  3790 leader_election.cc:290] T f06a4d3121be4a6fa29269fcb15b1e57 P 1e8299ce77aa4939877e6f90c5bd04aa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995), 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66:39331)
I20260709 13:12:43.723253  3783 ts_tablet_manager.cc:1434] T 3077a0a5b9944af39dde06a7e84b9df9 P 6dfa3a6e32584eddb9dd28eb4e71bd56: Time spent starting tablet: real 0.034s	user 0.005s	sys 0.002s
I20260709 13:12:43.728924  3790 raft_consensus.cc:493] T 04d72e5e1a07401996c45a94f44bd659 P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.729461  3790 raft_consensus.cc:515] T 04d72e5e1a07401996c45a94f44bd659 P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.731033  3785 tablet_bootstrap.cc:492] T 28cf86f3998847ab92593600dbdb0d90 P 563a1c63813642e591d31cf7936f81d0: No bootstrap required, opened a new log
I20260709 13:12:43.731637  3785 ts_tablet_manager.cc:1403] T 28cf86f3998847ab92593600dbdb0d90 P 563a1c63813642e591d31cf7936f81d0: Time spent bootstrapping tablet: real 0.035s	user 0.006s	sys 0.005s
I20260709 13:12:43.732278  3791 raft_consensus.cc:493] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.732753  3791 raft_consensus.cc:515] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.733440  3784 tablet_bootstrap.cc:492] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa: No bootstrap required, opened a new log
I20260709 13:12:43.733968  3784 ts_tablet_manager.cc:1403] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa: Time spent bootstrapping tablet: real 0.044s	user 0.003s	sys 0.029s
I20260709 13:12:43.734902  3785 raft_consensus.cc:359] T 28cf86f3998847ab92593600dbdb0d90 P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.735291  3791 leader_election.cc:290] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995), 1e8299ce77aa4939877e6f90c5bd04aa (127.28.54.67:33771)
I20260709 13:12:43.735730  3785 raft_consensus.cc:385] T 28cf86f3998847ab92593600dbdb0d90 P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.731498  3790 leader_election.cc:290] T 04d72e5e1a07401996c45a94f44bd659 P 1e8299ce77aa4939877e6f90c5bd04aa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995), 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66:39331)
I20260709 13:12:43.736086  3785 raft_consensus.cc:740] T 28cf86f3998847ab92593600dbdb0d90 P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 563a1c63813642e591d31cf7936f81d0, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.736929  3785 consensus_queue.cc:260] T 28cf86f3998847ab92593600dbdb0d90 P 563a1c63813642e591d31cf7936f81d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.741304  3783 tablet_bootstrap.cc:492] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56: Bootstrap starting.
I20260709 13:12:43.744165  3789 raft_consensus.cc:493] T ea26aa43a7c147bea7311233d455f8d5 P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.744678  3789 raft_consensus.cc:515] T ea26aa43a7c147bea7311233d455f8d5 P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.746730  3789 leader_election.cc:290] T ea26aa43a7c147bea7311233d455f8d5 P 563a1c63813642e591d31cf7936f81d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66:39331), 1e8299ce77aa4939877e6f90c5bd04aa (127.28.54.67:33771)
I20260709 13:12:43.752561  3785 ts_tablet_manager.cc:1434] T 28cf86f3998847ab92593600dbdb0d90 P 563a1c63813642e591d31cf7936f81d0: Time spent starting tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 13:12:43.753696  3785 tablet_bootstrap.cc:492] T 92acdf60735749beb2a12618aff17cfd P 563a1c63813642e591d31cf7936f81d0: Bootstrap starting.
I20260709 13:12:43.736753  3784 raft_consensus.cc:359] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.761960  3784 raft_consensus.cc:385] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.762204  3669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2c5f7a7dd946bc843001bcb47a202a" candidate_uuid: "563a1c63813642e591d31cf7936f81d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" is_pre_election: true
I20260709 13:12:43.763841  3668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea26aa43a7c147bea7311233d455f8d5" candidate_uuid: "563a1c63813642e591d31cf7936f81d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" is_pre_election: true
I20260709 13:12:43.764912  3783 tablet_bootstrap.cc:654] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.762269  3784 raft_consensus.cc:740] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e8299ce77aa4939877e6f90c5bd04aa, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.766857  3784 consensus_queue.cc:260] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
W20260709 13:12:43.769349  3557 leader_election.cc:343] T ba2c5f7a7dd946bc843001bcb47a202a P 563a1c63813642e591d31cf7936f81d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66:39331): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:43.770164  3557 leader_election.cc:343] T ea26aa43a7c147bea7311233d455f8d5 P 563a1c63813642e591d31cf7936f81d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:43.771994  3743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2c5f7a7dd946bc843001bcb47a202a" candidate_uuid: "563a1c63813642e591d31cf7936f81d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" is_pre_election: true
I20260709 13:12:43.772303  3785 tablet_bootstrap.cc:654] T 92acdf60735749beb2a12618aff17cfd P 563a1c63813642e591d31cf7936f81d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.773463  3742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea26aa43a7c147bea7311233d455f8d5" candidate_uuid: "563a1c63813642e591d31cf7936f81d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" is_pre_election: true
I20260709 13:12:43.772706  3743 raft_consensus.cc:2468] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 563a1c63813642e591d31cf7936f81d0 in term 0.
W20260709 13:12:43.775466  3557 leader_election.cc:343] T ea26aa43a7c147bea7311233d455f8d5 P 563a1c63813642e591d31cf7936f81d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e8299ce77aa4939877e6f90c5bd04aa (127.28.54.67:33771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:43.778532  3557 leader_election.cc:304] T ea26aa43a7c147bea7311233d455f8d5 P 563a1c63813642e591d31cf7936f81d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 563a1c63813642e591d31cf7936f81d0; no voters: 1e8299ce77aa4939877e6f90c5bd04aa, 6dfa3a6e32584eddb9dd28eb4e71bd56
I20260709 13:12:43.779923  3784 ts_tablet_manager.cc:1434] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa: Time spent starting tablet: real 0.046s	user 0.003s	sys 0.003s
I20260709 13:12:43.780159  3789 raft_consensus.cc:2749] T ea26aa43a7c147bea7311233d455f8d5 P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:43.780962  3594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06a4d3121be4a6fa29269fcb15b1e57" candidate_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "563a1c63813642e591d31cf7936f81d0" is_pre_election: true
I20260709 13:12:43.782208  3593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d72e5e1a07401996c45a94f44bd659" candidate_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "563a1c63813642e591d31cf7936f81d0" is_pre_election: true
W20260709 13:12:43.784227  3706 leader_election.cc:343] T 04d72e5e1a07401996c45a94f44bd659 P 1e8299ce77aa4939877e6f90c5bd04aa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:43.779820  3557 leader_election.cc:304] T ba2c5f7a7dd946bc843001bcb47a202a P 563a1c63813642e591d31cf7936f81d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e8299ce77aa4939877e6f90c5bd04aa, 563a1c63813642e591d31cf7936f81d0; no voters: 6dfa3a6e32584eddb9dd28eb4e71bd56
W20260709 13:12:43.785722  3540 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:43.786235  3789 raft_consensus.cc:2804] T ba2c5f7a7dd946bc843001bcb47a202a P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:43.786574  3789 raft_consensus.cc:493] T ba2c5f7a7dd946bc843001bcb47a202a P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:43.786738  3706 leader_election.cc:343] T f06a4d3121be4a6fa29269fcb15b1e57 P 1e8299ce77aa4939877e6f90c5bd04aa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:43.787654  3789 raft_consensus.cc:3060] T ba2c5f7a7dd946bc843001bcb47a202a P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.788435  3791 raft_consensus.cc:493] T fab01b4c92b34ed1aa888cc485d1c0e0 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.789053  3784 tablet_bootstrap.cc:492] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa: Bootstrap starting.
I20260709 13:12:43.789095  3791 raft_consensus.cc:515] T fab01b4c92b34ed1aa888cc485d1c0e0 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.796232  3789 raft_consensus.cc:515] T ba2c5f7a7dd946bc843001bcb47a202a P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.798602  3791 leader_election.cc:290] T fab01b4c92b34ed1aa888cc485d1c0e0 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995), 1e8299ce77aa4939877e6f90c5bd04aa (127.28.54.67:33771)
I20260709 13:12:43.801239  3789 leader_election.cc:290] T ba2c5f7a7dd946bc843001bcb47a202a P 563a1c63813642e591d31cf7936f81d0 [CANDIDATE]: Term 1 election: Requested vote from peers 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66:39331), 1e8299ce77aa4939877e6f90c5bd04aa (127.28.54.67:33771)
I20260709 13:12:43.802382  3743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2c5f7a7dd946bc843001bcb47a202a" candidate_uuid: "563a1c63813642e591d31cf7936f81d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8299ce77aa4939877e6f90c5bd04aa"
I20260709 13:12:43.802968  3743 raft_consensus.cc:3060] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.805609  3667 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d72e5e1a07401996c45a94f44bd659" candidate_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" is_pre_election: true
I20260709 13:12:43.806135  3669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06a4d3121be4a6fa29269fcb15b1e57" candidate_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" is_pre_election: true
I20260709 13:12:43.806401  3667 raft_consensus.cc:2468] T 04d72e5e1a07401996c45a94f44bd659 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e8299ce77aa4939877e6f90c5bd04aa in term 0.
I20260709 13:12:43.806183  3668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2c5f7a7dd946bc843001bcb47a202a" candidate_uuid: "563a1c63813642e591d31cf7936f81d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56"
I20260709 13:12:43.807256  3593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab01b4c92b34ed1aa888cc485d1c0e0" candidate_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "563a1c63813642e591d31cf7936f81d0" is_pre_election: true
I20260709 13:12:43.807624  3706 leader_election.cc:304] T 04d72e5e1a07401996c45a94f44bd659 P 1e8299ce77aa4939877e6f90c5bd04aa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e8299ce77aa4939877e6f90c5bd04aa, 6dfa3a6e32584eddb9dd28eb4e71bd56; no voters: 563a1c63813642e591d31cf7936f81d0
W20260709 13:12:43.808243  3557 leader_election.cc:343] T ba2c5f7a7dd946bc843001bcb47a202a P 563a1c63813642e591d31cf7936f81d0 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:43.808478  3594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f5afe6645d14571bf8ff8a0ba86afb3" candidate_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "563a1c63813642e591d31cf7936f81d0" is_pre_election: true
I20260709 13:12:43.808876  3790 raft_consensus.cc:2804] T 04d72e5e1a07401996c45a94f44bd659 P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:43.809075  3594 raft_consensus.cc:2468] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6dfa3a6e32584eddb9dd28eb4e71bd56 in term 0.
I20260709 13:12:43.809374  3790 raft_consensus.cc:493] T 04d72e5e1a07401996c45a94f44bd659 P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:43.809794  3790 raft_consensus.cc:3060] T 04d72e5e1a07401996c45a94f44bd659 P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.812207  3743 raft_consensus.cc:2468] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 563a1c63813642e591d31cf7936f81d0 in term 1.
I20260709 13:12:43.813542  3784 tablet_bootstrap.cc:654] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.813385  3557 leader_election.cc:304] T ba2c5f7a7dd946bc843001bcb47a202a P 563a1c63813642e591d31cf7936f81d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e8299ce77aa4939877e6f90c5bd04aa, 563a1c63813642e591d31cf7936f81d0; no voters: 6dfa3a6e32584eddb9dd28eb4e71bd56
I20260709 13:12:43.806770  3669 raft_consensus.cc:2468] T f06a4d3121be4a6fa29269fcb15b1e57 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e8299ce77aa4939877e6f90c5bd04aa in term 0.
I20260709 13:12:43.807849  3593 raft_consensus.cc:2468] T fab01b4c92b34ed1aa888cc485d1c0e0 P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6dfa3a6e32584eddb9dd28eb4e71bd56 in term 0.
I20260709 13:12:43.818459  3790 raft_consensus.cc:515] T 04d72e5e1a07401996c45a94f44bd659 P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.819819  3785 tablet_bootstrap.cc:492] T 92acdf60735749beb2a12618aff17cfd P 563a1c63813642e591d31cf7936f81d0: No bootstrap required, opened a new log
I20260709 13:12:43.820358  3785 ts_tablet_manager.cc:1403] T 92acdf60735749beb2a12618aff17cfd P 563a1c63813642e591d31cf7936f81d0: Time spent bootstrapping tablet: real 0.067s	user 0.014s	sys 0.021s
I20260709 13:12:43.821214  3593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d72e5e1a07401996c45a94f44bd659" candidate_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "563a1c63813642e591d31cf7936f81d0"
W20260709 13:12:43.822755  3706 leader_election.cc:343] T 04d72e5e1a07401996c45a94f44bd659 P 1e8299ce77aa4939877e6f90c5bd04aa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:43.823081  3790 leader_election.cc:290] T 04d72e5e1a07401996c45a94f44bd659 P 1e8299ce77aa4939877e6f90c5bd04aa [CANDIDATE]: Term 1 election: Requested vote from peers 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995), 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66:39331)
I20260709 13:12:43.823230  3785 raft_consensus.cc:359] T 92acdf60735749beb2a12618aff17cfd P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.823984  3785 raft_consensus.cc:385] T 92acdf60735749beb2a12618aff17cfd P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.824291  3785 raft_consensus.cc:740] T 92acdf60735749beb2a12618aff17cfd P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 563a1c63813642e591d31cf7936f81d0, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.824213  3706 leader_election.cc:304] T f06a4d3121be4a6fa29269fcb15b1e57 P 1e8299ce77aa4939877e6f90c5bd04aa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e8299ce77aa4939877e6f90c5bd04aa, 6dfa3a6e32584eddb9dd28eb4e71bd56; no voters: 563a1c63813642e591d31cf7936f81d0
I20260709 13:12:43.825492  3632 leader_election.cc:304] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 563a1c63813642e591d31cf7936f81d0, 6dfa3a6e32584eddb9dd28eb4e71bd56; no voters: 
I20260709 13:12:43.825819  3785 consensus_queue.cc:260] T 92acdf60735749beb2a12618aff17cfd P 563a1c63813642e591d31cf7936f81d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.826610  3669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d72e5e1a07401996c45a94f44bd659" candidate_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56"
I20260709 13:12:43.827347  3669 raft_consensus.cc:3060] T 04d72e5e1a07401996c45a94f44bd659 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.827378  3790 raft_consensus.cc:2804] T f06a4d3121be4a6fa29269fcb15b1e57 P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:43.828018  3790 raft_consensus.cc:493] T f06a4d3121be4a6fa29269fcb15b1e57 P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:43.828251  3783 tablet_bootstrap.cc:492] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56: No bootstrap required, opened a new log
I20260709 13:12:43.828434  3790 raft_consensus.cc:3060] T f06a4d3121be4a6fa29269fcb15b1e57 P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.828773  3783 ts_tablet_manager.cc:1403] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56: Time spent bootstrapping tablet: real 0.088s	user 0.013s	sys 0.015s
I20260709 13:12:43.830116  3791 raft_consensus.cc:2804] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:43.830504  3791 raft_consensus.cc:493] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:43.830824  3791 raft_consensus.cc:3060] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.835848  3790 raft_consensus.cc:515] T f06a4d3121be4a6fa29269fcb15b1e57 P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.836176  3789 raft_consensus.cc:2804] T ba2c5f7a7dd946bc843001bcb47a202a P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:43.841615  3783 raft_consensus.cc:359] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.837899  3669 raft_consensus.cc:2468] T 04d72e5e1a07401996c45a94f44bd659 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e8299ce77aa4939877e6f90c5bd04aa in term 1.
I20260709 13:12:43.838248  3791 raft_consensus.cc:515] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.843027  3789 raft_consensus.cc:697] T ba2c5f7a7dd946bc843001bcb47a202a P 563a1c63813642e591d31cf7936f81d0 [term 1 LEADER]: Becoming Leader. State: Replica: 563a1c63813642e591d31cf7936f81d0, State: Running, Role: LEADER
I20260709 13:12:43.839265  3632 leader_election.cc:304] T fab01b4c92b34ed1aa888cc485d1c0e0 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 563a1c63813642e591d31cf7936f81d0, 6dfa3a6e32584eddb9dd28eb4e71bd56; no voters: 
I20260709 13:12:43.843911  3789 consensus_queue.cc:237] T ba2c5f7a7dd946bc843001bcb47a202a P 563a1c63813642e591d31cf7936f81d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.843951  3791 leader_election.cc:290] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [CANDIDATE]: Term 1 election: Requested vote from peers 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995), 1e8299ce77aa4939877e6f90c5bd04aa (127.28.54.67:33771)
I20260709 13:12:43.845271  3791 raft_consensus.cc:2804] T fab01b4c92b34ed1aa888cc485d1c0e0 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:43.845590  3791 raft_consensus.cc:493] T fab01b4c92b34ed1aa888cc485d1c0e0 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:43.845944  3791 raft_consensus.cc:3060] T fab01b4c92b34ed1aa888cc485d1c0e0 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.846062  3790 leader_election.cc:290] T f06a4d3121be4a6fa29269fcb15b1e57 P 1e8299ce77aa4939877e6f90c5bd04aa [CANDIDATE]: Term 1 election: Requested vote from peers 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995), 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66:39331)
I20260709 13:12:43.846436  3593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06a4d3121be4a6fa29269fcb15b1e57" candidate_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "563a1c63813642e591d31cf7936f81d0"
W20260709 13:12:43.848613  3706 leader_election.cc:343] T f06a4d3121be4a6fa29269fcb15b1e57 P 1e8299ce77aa4939877e6f90c5bd04aa [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:43.842427  3783 raft_consensus.cc:385] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.840214  3784 tablet_bootstrap.cc:492] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa: No bootstrap required, opened a new log
I20260709 13:12:43.850666  3784 ts_tablet_manager.cc:1403] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa: Time spent bootstrapping tablet: real 0.062s	user 0.010s	sys 0.022s
I20260709 13:12:43.850030  3783 raft_consensus.cc:740] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dfa3a6e32584eddb9dd28eb4e71bd56, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.854916  3783 consensus_queue.cc:260] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.855484  3785 ts_tablet_manager.cc:1434] T 92acdf60735749beb2a12618aff17cfd P 563a1c63813642e591d31cf7936f81d0: Time spent starting tablet: real 0.035s	user 0.016s	sys 0.004s
I20260709 13:12:43.857327  3783 ts_tablet_manager.cc:1434] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:12:43.858415  3785 tablet_bootstrap.cc:492] T 04d72e5e1a07401996c45a94f44bd659 P 563a1c63813642e591d31cf7936f81d0: Bootstrap starting.
I20260709 13:12:43.858299  3706 leader_election.cc:304] T 04d72e5e1a07401996c45a94f44bd659 P 1e8299ce77aa4939877e6f90c5bd04aa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e8299ce77aa4939877e6f90c5bd04aa, 6dfa3a6e32584eddb9dd28eb4e71bd56; no voters: 563a1c63813642e591d31cf7936f81d0
I20260709 13:12:43.859081  3790 raft_consensus.cc:2804] T 04d72e5e1a07401996c45a94f44bd659 P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:43.860433  3593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f5afe6645d14571bf8ff8a0ba86afb3" candidate_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "563a1c63813642e591d31cf7936f81d0"
I20260709 13:12:43.860575  3669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06a4d3121be4a6fa29269fcb15b1e57" candidate_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56"
I20260709 13:12:43.861042  3593 raft_consensus.cc:3060] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.861179  3669 raft_consensus.cc:3060] T f06a4d3121be4a6fa29269fcb15b1e57 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.862416  3490 catalog_manager.cc:5697] T ba2c5f7a7dd946bc843001bcb47a202a P 563a1c63813642e591d31cf7936f81d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 563a1c63813642e591d31cf7936f81d0 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "563a1c63813642e591d31cf7936f81d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:43.866721  3743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f5afe6645d14571bf8ff8a0ba86afb3" candidate_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" is_pre_election: true
I20260709 13:12:43.867339  3743 raft_consensus.cc:2468] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6dfa3a6e32584eddb9dd28eb4e71bd56 in term 0.
I20260709 13:12:43.867486  3669 raft_consensus.cc:2468] T f06a4d3121be4a6fa29269fcb15b1e57 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e8299ce77aa4939877e6f90c5bd04aa in term 1.
I20260709 13:12:43.868067  3593 raft_consensus.cc:2468] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dfa3a6e32584eddb9dd28eb4e71bd56 in term 1.
I20260709 13:12:43.868723  3706 leader_election.cc:304] T f06a4d3121be4a6fa29269fcb15b1e57 P 1e8299ce77aa4939877e6f90c5bd04aa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e8299ce77aa4939877e6f90c5bd04aa, 6dfa3a6e32584eddb9dd28eb4e71bd56; no voters: 563a1c63813642e591d31cf7936f81d0
I20260709 13:12:43.869282  3742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f5afe6645d14571bf8ff8a0ba86afb3" candidate_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8299ce77aa4939877e6f90c5bd04aa"
I20260709 13:12:43.869853  3742 raft_consensus.cc:3060] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.872465  3791 raft_consensus.cc:515] T fab01b4c92b34ed1aa888cc485d1c0e0 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.873549  3632 leader_election.cc:304] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 563a1c63813642e591d31cf7936f81d0, 6dfa3a6e32584eddb9dd28eb4e71bd56; no voters: 
I20260709 13:12:43.853317  3784 raft_consensus.cc:359] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.874578  3820 raft_consensus.cc:2804] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:43.874976  3784 raft_consensus.cc:385] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.875312  3784 raft_consensus.cc:740] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e8299ce77aa4939877e6f90c5bd04aa, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.875964  3784 consensus_queue.cc:260] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.876494  3742 raft_consensus.cc:2468] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dfa3a6e32584eddb9dd28eb4e71bd56 in term 1.
I20260709 13:12:43.877413  3743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab01b4c92b34ed1aa888cc485d1c0e0" candidate_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" is_pre_election: true
I20260709 13:12:43.877745  3783 tablet_bootstrap.cc:492] T ba2c5f7a7dd946bc843001bcb47a202a P 6dfa3a6e32584eddb9dd28eb4e71bd56: Bootstrap starting.
W20260709 13:12:43.881351  3632 leader_election.cc:343] T fab01b4c92b34ed1aa888cc485d1c0e0 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1e8299ce77aa4939877e6f90c5bd04aa (127.28.54.67:33771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:43.881549  3594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab01b4c92b34ed1aa888cc485d1c0e0" candidate_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "563a1c63813642e591d31cf7936f81d0"
I20260709 13:12:43.882910  3594 raft_consensus.cc:3060] T fab01b4c92b34ed1aa888cc485d1c0e0 P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.874485  3791 leader_election.cc:290] T fab01b4c92b34ed1aa888cc485d1c0e0 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [CANDIDATE]: Term 1 election: Requested vote from peers 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995), 1e8299ce77aa4939877e6f90c5bd04aa (127.28.54.67:33771)
I20260709 13:12:43.883644  3783 tablet_bootstrap.cc:654] T ba2c5f7a7dd946bc843001bcb47a202a P 6dfa3a6e32584eddb9dd28eb4e71bd56: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.890406  3594 raft_consensus.cc:2468] T fab01b4c92b34ed1aa888cc485d1c0e0 P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dfa3a6e32584eddb9dd28eb4e71bd56 in term 1.
I20260709 13:12:43.891641  3742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab01b4c92b34ed1aa888cc485d1c0e0" candidate_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8299ce77aa4939877e6f90c5bd04aa"
I20260709 13:12:43.891770  3820 raft_consensus.cc:697] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 1 LEADER]: Becoming Leader. State: Replica: 6dfa3a6e32584eddb9dd28eb4e71bd56, State: Running, Role: LEADER
I20260709 13:12:43.892899  3820 consensus_queue.cc:237] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
W20260709 13:12:43.893333  3632 leader_election.cc:343] T fab01b4c92b34ed1aa888cc485d1c0e0 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1e8299ce77aa4939877e6f90c5bd04aa (127.28.54.67:33771): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:43.894284  3632 leader_election.cc:304] T fab01b4c92b34ed1aa888cc485d1c0e0 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 563a1c63813642e591d31cf7936f81d0, 6dfa3a6e32584eddb9dd28eb4e71bd56; no voters: 1e8299ce77aa4939877e6f90c5bd04aa
I20260709 13:12:43.894850  3785 tablet_bootstrap.cc:654] T 04d72e5e1a07401996c45a94f44bd659 P 563a1c63813642e591d31cf7936f81d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.896663  3825 raft_consensus.cc:2804] T fab01b4c92b34ed1aa888cc485d1c0e0 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:43.897269  3825 raft_consensus.cc:697] T fab01b4c92b34ed1aa888cc485d1c0e0 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 1 LEADER]: Becoming Leader. State: Replica: 6dfa3a6e32584eddb9dd28eb4e71bd56, State: Running, Role: LEADER
I20260709 13:12:43.898548  3824 raft_consensus.cc:2804] T f06a4d3121be4a6fa29269fcb15b1e57 P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:43.898139  3825 consensus_queue.cc:237] T fab01b4c92b34ed1aa888cc485d1c0e0 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.906715  3789 raft_consensus.cc:493] T 84ca4c013a24451388658395af3b8b78 P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.900556  3783 tablet_bootstrap.cc:492] T ba2c5f7a7dd946bc843001bcb47a202a P 6dfa3a6e32584eddb9dd28eb4e71bd56: No bootstrap required, opened a new log
I20260709 13:12:43.907191  3789 raft_consensus.cc:515] T 84ca4c013a24451388658395af3b8b78 P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.908038  3783 ts_tablet_manager.cc:1403] T ba2c5f7a7dd946bc843001bcb47a202a P 6dfa3a6e32584eddb9dd28eb4e71bd56: Time spent bootstrapping tablet: real 0.031s	user 0.008s	sys 0.005s
I20260709 13:12:43.909416  3789 leader_election.cc:290] T 84ca4c013a24451388658395af3b8b78 P 563a1c63813642e591d31cf7936f81d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66:39331), 1e8299ce77aa4939877e6f90c5bd04aa (127.28.54.67:33771)
I20260709 13:12:43.903419  3785 tablet_bootstrap.cc:492] T 04d72e5e1a07401996c45a94f44bd659 P 563a1c63813642e591d31cf7936f81d0: No bootstrap required, opened a new log
I20260709 13:12:43.910126  3785 ts_tablet_manager.cc:1403] T 04d72e5e1a07401996c45a94f44bd659 P 563a1c63813642e591d31cf7936f81d0: Time spent bootstrapping tablet: real 0.052s	user 0.010s	sys 0.001s
I20260709 13:12:43.911062  3783 raft_consensus.cc:359] T ba2c5f7a7dd946bc843001bcb47a202a P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.911751  3783 raft_consensus.cc:385] T ba2c5f7a7dd946bc843001bcb47a202a P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.911949  3669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ca4c013a24451388658395af3b8b78" candidate_uuid: "563a1c63813642e591d31cf7936f81d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" is_pre_election: true
I20260709 13:12:43.912020  3783 raft_consensus.cc:740] T ba2c5f7a7dd946bc843001bcb47a202a P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dfa3a6e32584eddb9dd28eb4e71bd56, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.912729  3785 raft_consensus.cc:359] T 04d72e5e1a07401996c45a94f44bd659 P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.913208  3742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ca4c013a24451388658395af3b8b78" candidate_uuid: "563a1c63813642e591d31cf7936f81d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" is_pre_election: true
I20260709 13:12:43.914011  3742 raft_consensus.cc:2468] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 563a1c63813642e591d31cf7936f81d0 in term 0.
I20260709 13:12:43.913792  3783 consensus_queue.cc:260] T ba2c5f7a7dd946bc843001bcb47a202a P 6dfa3a6e32584eddb9dd28eb4e71bd56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.915469  3557 leader_election.cc:304] T 84ca4c013a24451388658395af3b8b78 P 563a1c63813642e591d31cf7936f81d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e8299ce77aa4939877e6f90c5bd04aa, 563a1c63813642e591d31cf7936f81d0; no voters: 
I20260709 13:12:43.916528  3789 raft_consensus.cc:2804] T 84ca4c013a24451388658395af3b8b78 P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:43.916807  3783 ts_tablet_manager.cc:1434] T ba2c5f7a7dd946bc843001bcb47a202a P 6dfa3a6e32584eddb9dd28eb4e71bd56: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:12:43.912674  3669 raft_consensus.cc:2468] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 563a1c63813642e591d31cf7936f81d0 in term 0.
I20260709 13:12:43.918262  3783 tablet_bootstrap.cc:492] T 92acdf60735749beb2a12618aff17cfd P 6dfa3a6e32584eddb9dd28eb4e71bd56: Bootstrap starting.
I20260709 13:12:43.917145  3825 raft_consensus.cc:493] T 3077a0a5b9944af39dde06a7e84b9df9 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.919863  3825 raft_consensus.cc:515] T 3077a0a5b9944af39dde06a7e84b9df9 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } } peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } }
I20260709 13:12:43.920845  3784 ts_tablet_manager.cc:1434] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa: Time spent starting tablet: real 0.070s	user 0.017s	sys 0.018s
I20260709 13:12:43.921397  3825 leader_election.cc:290] T 3077a0a5b9944af39dde06a7e84b9df9 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1e8299ce77aa4939877e6f90c5bd04aa (127.28.54.67:33771), 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995)
I20260709 13:12:43.921789  3784 tablet_bootstrap.cc:492] T fab01b4c92b34ed1aa888cc485d1c0e0 P 1e8299ce77aa4939877e6f90c5bd04aa: Bootstrap starting.
I20260709 13:12:43.923055  3742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3077a0a5b9944af39dde06a7e84b9df9" candidate_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" is_pre_election: true
I20260709 13:12:43.923431  3594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3077a0a5b9944af39dde06a7e84b9df9" candidate_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "563a1c63813642e591d31cf7936f81d0" is_pre_election: true
I20260709 13:12:43.923659  3742 raft_consensus.cc:2468] T 3077a0a5b9944af39dde06a7e84b9df9 P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6dfa3a6e32584eddb9dd28eb4e71bd56 in term 0.
I20260709 13:12:43.924029  3594 raft_consensus.cc:2468] T 3077a0a5b9944af39dde06a7e84b9df9 P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6dfa3a6e32584eddb9dd28eb4e71bd56 in term 0.
I20260709 13:12:43.918932  3790 raft_consensus.cc:697] T 04d72e5e1a07401996c45a94f44bd659 P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 LEADER]: Becoming Leader. State: Replica: 1e8299ce77aa4939877e6f90c5bd04aa, State: Running, Role: LEADER
I20260709 13:12:43.916924  3789 raft_consensus.cc:493] T 84ca4c013a24451388658395af3b8b78 P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:43.925072  3789 raft_consensus.cc:3060] T 84ca4c013a24451388658395af3b8b78 P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.925032  3632 leader_election.cc:304] T 3077a0a5b9944af39dde06a7e84b9df9 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 563a1c63813642e591d31cf7936f81d0, 6dfa3a6e32584eddb9dd28eb4e71bd56; no voters: 
I20260709 13:12:43.925832  3783 tablet_bootstrap.cc:654] T 92acdf60735749beb2a12618aff17cfd P 6dfa3a6e32584eddb9dd28eb4e71bd56: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.926533  3825 raft_consensus.cc:2804] T 3077a0a5b9944af39dde06a7e84b9df9 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:43.926913  3825 raft_consensus.cc:493] T 3077a0a5b9944af39dde06a7e84b9df9 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:43.927227  3825 raft_consensus.cc:3060] T 3077a0a5b9944af39dde06a7e84b9df9 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.927404  3784 tablet_bootstrap.cc:654] T fab01b4c92b34ed1aa888cc485d1c0e0 P 1e8299ce77aa4939877e6f90c5bd04aa: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:43.931967  3789 raft_consensus.cc:515] T 84ca4c013a24451388658395af3b8b78 P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.934676  3669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ca4c013a24451388658395af3b8b78" candidate_uuid: "563a1c63813642e591d31cf7936f81d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56"
I20260709 13:12:43.934616  3825 raft_consensus.cc:515] T 3077a0a5b9944af39dde06a7e84b9df9 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } } peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } }
I20260709 13:12:43.935384  3669 raft_consensus.cc:3060] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.937738  3742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3077a0a5b9944af39dde06a7e84b9df9" candidate_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8299ce77aa4939877e6f90c5bd04aa"
I20260709 13:12:43.938329  3742 raft_consensus.cc:3060] T 3077a0a5b9944af39dde06a7e84b9df9 P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.941279  3819 raft_consensus.cc:493] T 92acdf60735749beb2a12618aff17cfd P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.941860  3819 raft_consensus.cc:515] T 92acdf60735749beb2a12618aff17cfd P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.913468  3785 raft_consensus.cc:385] T 04d72e5e1a07401996c45a94f44bd659 P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:43.942660  3785 raft_consensus.cc:740] T 04d72e5e1a07401996c45a94f44bd659 P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 563a1c63813642e591d31cf7936f81d0, State: Initialized, Role: FOLLOWER
I20260709 13:12:43.943598  3785 consensus_queue.cc:260] T 04d72e5e1a07401996c45a94f44bd659 P 563a1c63813642e591d31cf7936f81d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.944193  3819 leader_election.cc:290] T 92acdf60735749beb2a12618aff17cfd P 563a1c63813642e591d31cf7936f81d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66:39331), 1e8299ce77aa4939877e6f90c5bd04aa (127.28.54.67:33771)
I20260709 13:12:43.944775  3826 raft_consensus.cc:493] T 92acdf60735749beb2a12618aff17cfd P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:43.946513  3668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92acdf60735749beb2a12618aff17cfd" candidate_uuid: "563a1c63813642e591d31cf7936f81d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" is_pre_election: true
I20260709 13:12:43.942411  3669 raft_consensus.cc:2468] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 563a1c63813642e591d31cf7936f81d0 in term 1.
I20260709 13:12:43.946924  3826 raft_consensus.cc:515] T 92acdf60735749beb2a12618aff17cfd P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.947304  3824 raft_consensus.cc:697] T f06a4d3121be4a6fa29269fcb15b1e57 P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 LEADER]: Becoming Leader. State: Replica: 1e8299ce77aa4939877e6f90c5bd04aa, State: Running, Role: LEADER
I20260709 13:12:43.951848  3741 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ca4c013a24451388658395af3b8b78" candidate_uuid: "563a1c63813642e591d31cf7936f81d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8299ce77aa4939877e6f90c5bd04aa"
I20260709 13:12:43.951756  3824 consensus_queue.cc:237] T f06a4d3121be4a6fa29269fcb15b1e57 P 1e8299ce77aa4939877e6f90c5bd04aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.952562  3741 raft_consensus.cc:3060] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.954167  3669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92acdf60735749beb2a12618aff17cfd" candidate_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" is_pre_election: true
I20260709 13:12:43.955029  3826 leader_election.cc:290] T 92acdf60735749beb2a12618aff17cfd P 1e8299ce77aa4939877e6f90c5bd04aa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995), 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66:39331)
I20260709 13:12:43.945528  3785 ts_tablet_manager.cc:1434] T 04d72e5e1a07401996c45a94f44bd659 P 563a1c63813642e591d31cf7936f81d0: Time spent starting tablet: real 0.035s	user 0.003s	sys 0.001s
I20260709 13:12:43.955513  3594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3077a0a5b9944af39dde06a7e84b9df9" candidate_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "563a1c63813642e591d31cf7936f81d0"
I20260709 13:12:43.956563  3594 raft_consensus.cc:3060] T 3077a0a5b9944af39dde06a7e84b9df9 P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.956884  3785 tablet_bootstrap.cc:492] T f06a4d3121be4a6fa29269fcb15b1e57 P 563a1c63813642e591d31cf7936f81d0: Bootstrap starting.
I20260709 13:12:43.958701  3593 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92acdf60735749beb2a12618aff17cfd" candidate_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "563a1c63813642e591d31cf7936f81d0" is_pre_election: true
I20260709 13:12:43.959414  3593 raft_consensus.cc:2468] T 92acdf60735749beb2a12618aff17cfd P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e8299ce77aa4939877e6f90c5bd04aa in term 0.
W20260709 13:12:43.950477  3557 leader_election.cc:343] T 92acdf60735749beb2a12618aff17cfd P 563a1c63813642e591d31cf7936f81d0 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:43.960924  3557 leader_election.cc:304] T 84ca4c013a24451388658395af3b8b78 P 563a1c63813642e591d31cf7936f81d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 563a1c63813642e591d31cf7936f81d0, 6dfa3a6e32584eddb9dd28eb4e71bd56; no voters: 
I20260709 13:12:43.955487  3825 leader_election.cc:290] T 3077a0a5b9944af39dde06a7e84b9df9 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [CANDIDATE]: Term 1 election: Requested vote from peers 1e8299ce77aa4939877e6f90c5bd04aa (127.28.54.67:33771), 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995)
I20260709 13:12:43.961870  3819 raft_consensus.cc:2804] T 84ca4c013a24451388658395af3b8b78 P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:43.962401  3819 raft_consensus.cc:697] T 84ca4c013a24451388658395af3b8b78 P 563a1c63813642e591d31cf7936f81d0 [term 1 LEADER]: Becoming Leader. State: Replica: 563a1c63813642e591d31cf7936f81d0, State: Running, Role: LEADER
I20260709 13:12:43.963230  3819 consensus_queue.cc:237] T 84ca4c013a24451388658395af3b8b78 P 563a1c63813642e591d31cf7936f81d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.964249  3594 raft_consensus.cc:2468] T 3077a0a5b9944af39dde06a7e84b9df9 P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dfa3a6e32584eddb9dd28eb4e71bd56 in term 1.
I20260709 13:12:43.964686  3706 leader_election.cc:304] T 92acdf60735749beb2a12618aff17cfd P 1e8299ce77aa4939877e6f90c5bd04aa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e8299ce77aa4939877e6f90c5bd04aa, 563a1c63813642e591d31cf7936f81d0; no voters: 
I20260709 13:12:43.965487  3826 raft_consensus.cc:2804] T 92acdf60735749beb2a12618aff17cfd P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:43.965519  3632 leader_election.cc:304] T 3077a0a5b9944af39dde06a7e84b9df9 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 563a1c63813642e591d31cf7936f81d0, 6dfa3a6e32584eddb9dd28eb4e71bd56; no voters: 
I20260709 13:12:43.966084  3826 raft_consensus.cc:493] T 92acdf60735749beb2a12618aff17cfd P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:43.949267  3743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92acdf60735749beb2a12618aff17cfd" candidate_uuid: "563a1c63813642e591d31cf7936f81d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" is_pre_election: true
W20260709 13:12:43.967000  3706 leader_election.cc:343] T 92acdf60735749beb2a12618aff17cfd P 1e8299ce77aa4939877e6f90c5bd04aa [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66:39331): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:43.967219  3826 raft_consensus.cc:3060] T 92acdf60735749beb2a12618aff17cfd P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.947877  3790 consensus_queue.cc:237] T 04d72e5e1a07401996c45a94f44bd659 P 1e8299ce77aa4939877e6f90c5bd04aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.970654  3741 raft_consensus.cc:2468] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 563a1c63813642e591d31cf7936f81d0 in term 1.
I20260709 13:12:43.950685  3742 raft_consensus.cc:2468] T 3077a0a5b9944af39dde06a7e84b9df9 P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dfa3a6e32584eddb9dd28eb4e71bd56 in term 1.
I20260709 13:12:43.966518  3825 raft_consensus.cc:2804] T 3077a0a5b9944af39dde06a7e84b9df9 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:43.972882  3825 raft_consensus.cc:697] T 3077a0a5b9944af39dde06a7e84b9df9 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 1 LEADER]: Becoming Leader. State: Replica: 6dfa3a6e32584eddb9dd28eb4e71bd56, State: Running, Role: LEADER
I20260709 13:12:43.973922  3825 consensus_queue.cc:237] T 3077a0a5b9944af39dde06a7e84b9df9 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } } peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } }
I20260709 13:12:43.984520  3826 raft_consensus.cc:515] T 92acdf60735749beb2a12618aff17cfd P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.946281  3789 leader_election.cc:290] T 84ca4c013a24451388658395af3b8b78 P 563a1c63813642e591d31cf7936f81d0 [CANDIDATE]: Term 1 election: Requested vote from peers 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66:39331), 1e8299ce77aa4939877e6f90c5bd04aa (127.28.54.67:33771)
I20260709 13:12:43.993398  3784 tablet_bootstrap.cc:492] T fab01b4c92b34ed1aa888cc485d1c0e0 P 1e8299ce77aa4939877e6f90c5bd04aa: No bootstrap required, opened a new log
I20260709 13:12:43.989949  3783 tablet_bootstrap.cc:492] T 92acdf60735749beb2a12618aff17cfd P 6dfa3a6e32584eddb9dd28eb4e71bd56: No bootstrap required, opened a new log
I20260709 13:12:43.991827  3489 catalog_manager.cc:5697] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 6dfa3a6e32584eddb9dd28eb4e71bd56 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66). New cstate: current_term: 1 leader_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:43.994453  3743 raft_consensus.cc:2393] T 92acdf60735749beb2a12618aff17cfd P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 563a1c63813642e591d31cf7936f81d0 in current term 1: Already voted for candidate 1e8299ce77aa4939877e6f90c5bd04aa in this term.
I20260709 13:12:43.995904  3783 ts_tablet_manager.cc:1403] T 92acdf60735749beb2a12618aff17cfd P 6dfa3a6e32584eddb9dd28eb4e71bd56: Time spent bootstrapping tablet: real 0.078s	user 0.032s	sys 0.015s
I20260709 13:12:43.997648  3557 leader_election.cc:304] T 92acdf60735749beb2a12618aff17cfd P 563a1c63813642e591d31cf7936f81d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 563a1c63813642e591d31cf7936f81d0; no voters: 1e8299ce77aa4939877e6f90c5bd04aa, 6dfa3a6e32584eddb9dd28eb4e71bd56
I20260709 13:12:43.998456  3783 raft_consensus.cc:359] T 92acdf60735749beb2a12618aff17cfd P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:43.998946  3789 raft_consensus.cc:3060] T 92acdf60735749beb2a12618aff17cfd P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:43.999269  3594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92acdf60735749beb2a12618aff17cfd" candidate_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "563a1c63813642e591d31cf7936f81d0"
I20260709 13:12:43.987875  3785 tablet_bootstrap.cc:654] T f06a4d3121be4a6fa29269fcb15b1e57 P 563a1c63813642e591d31cf7936f81d0: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:44.001670  3783 raft_consensus.cc:385] T 92acdf60735749beb2a12618aff17cfd P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:44.001467  3669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92acdf60735749beb2a12618aff17cfd" candidate_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56"
I20260709 13:12:44.002032  3783 raft_consensus.cc:740] T 92acdf60735749beb2a12618aff17cfd P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dfa3a6e32584eddb9dd28eb4e71bd56, State: Initialized, Role: FOLLOWER
I20260709 13:12:44.005209  3783 consensus_queue.cc:260] T 92acdf60735749beb2a12618aff17cfd P 6dfa3a6e32584eddb9dd28eb4e71bd56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:44.006057  3669 raft_consensus.cc:3060] T 92acdf60735749beb2a12618aff17cfd P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:44.007438  3783 ts_tablet_manager.cc:1434] T 92acdf60735749beb2a12618aff17cfd P 6dfa3a6e32584eddb9dd28eb4e71bd56: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:12:44.008358  3783 tablet_bootstrap.cc:492] T 28cf86f3998847ab92593600dbdb0d90 P 6dfa3a6e32584eddb9dd28eb4e71bd56: Bootstrap starting.
I20260709 13:12:44.008567  3826 leader_election.cc:290] T 92acdf60735749beb2a12618aff17cfd P 1e8299ce77aa4939877e6f90c5bd04aa [CANDIDATE]: Term 1 election: Requested vote from peers 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995), 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66:39331)
I20260709 13:12:44.009858  3784 ts_tablet_manager.cc:1403] T fab01b4c92b34ed1aa888cc485d1c0e0 P 1e8299ce77aa4939877e6f90c5bd04aa: Time spent bootstrapping tablet: real 0.088s	user 0.014s	sys 0.012s
I20260709 13:12:44.014127  3789 raft_consensus.cc:2749] T 92acdf60735749beb2a12618aff17cfd P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:44.015115  3669 raft_consensus.cc:2468] T 92acdf60735749beb2a12618aff17cfd P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e8299ce77aa4939877e6f90c5bd04aa in term 1.
I20260709 13:12:44.016475  3783 tablet_bootstrap.cc:654] T 28cf86f3998847ab92593600dbdb0d90 P 6dfa3a6e32584eddb9dd28eb4e71bd56: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:44.021421  3594 raft_consensus.cc:2468] T 92acdf60735749beb2a12618aff17cfd P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e8299ce77aa4939877e6f90c5bd04aa in term 1.
I20260709 13:12:44.025919  3784 raft_consensus.cc:359] T fab01b4c92b34ed1aa888cc485d1c0e0 P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:44.026733  3784 raft_consensus.cc:385] T fab01b4c92b34ed1aa888cc485d1c0e0 P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:44.027001  3784 raft_consensus.cc:740] T fab01b4c92b34ed1aa888cc485d1c0e0 P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e8299ce77aa4939877e6f90c5bd04aa, State: Initialized, Role: FOLLOWER
I20260709 13:12:44.027722  3784 consensus_queue.cc:260] T fab01b4c92b34ed1aa888cc485d1c0e0 P 1e8299ce77aa4939877e6f90c5bd04aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:44.029987  3784 ts_tablet_manager.cc:1434] T fab01b4c92b34ed1aa888cc485d1c0e0 P 1e8299ce77aa4939877e6f90c5bd04aa: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 13:12:44.032797  3706 leader_election.cc:304] T 92acdf60735749beb2a12618aff17cfd P 1e8299ce77aa4939877e6f90c5bd04aa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e8299ce77aa4939877e6f90c5bd04aa, 563a1c63813642e591d31cf7936f81d0; no voters: 
I20260709 13:12:44.033433  3785 tablet_bootstrap.cc:492] T f06a4d3121be4a6fa29269fcb15b1e57 P 563a1c63813642e591d31cf7936f81d0: No bootstrap required, opened a new log
I20260709 13:12:44.033627  3790 raft_consensus.cc:2804] T 92acdf60735749beb2a12618aff17cfd P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:44.033834  3783 tablet_bootstrap.cc:492] T 28cf86f3998847ab92593600dbdb0d90 P 6dfa3a6e32584eddb9dd28eb4e71bd56: No bootstrap required, opened a new log
I20260709 13:12:44.034221  3790 raft_consensus.cc:697] T 92acdf60735749beb2a12618aff17cfd P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 LEADER]: Becoming Leader. State: Replica: 1e8299ce77aa4939877e6f90c5bd04aa, State: Running, Role: LEADER
I20260709 13:12:44.034351  3783 ts_tablet_manager.cc:1403] T 28cf86f3998847ab92593600dbdb0d90 P 6dfa3a6e32584eddb9dd28eb4e71bd56: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.000s
I20260709 13:12:44.034586  3784 tablet_bootstrap.cc:492] T ea26aa43a7c147bea7311233d455f8d5 P 1e8299ce77aa4939877e6f90c5bd04aa: Bootstrap starting.
I20260709 13:12:44.034982  3790 consensus_queue.cc:237] T 92acdf60735749beb2a12618aff17cfd P 1e8299ce77aa4939877e6f90c5bd04aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:44.036972  3783 raft_consensus.cc:359] T 28cf86f3998847ab92593600dbdb0d90 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:44.037686  3783 raft_consensus.cc:385] T 28cf86f3998847ab92593600dbdb0d90 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:44.037973  3783 raft_consensus.cc:740] T 28cf86f3998847ab92593600dbdb0d90 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dfa3a6e32584eddb9dd28eb4e71bd56, State: Initialized, Role: FOLLOWER
I20260709 13:12:44.038648  3783 consensus_queue.cc:260] T 28cf86f3998847ab92593600dbdb0d90 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:44.038239  3490 catalog_manager.cc:5697] T 84ca4c013a24451388658395af3b8b78 P 563a1c63813642e591d31cf7936f81d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 563a1c63813642e591d31cf7936f81d0 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "563a1c63813642e591d31cf7936f81d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:44.040447  3784 tablet_bootstrap.cc:654] T ea26aa43a7c147bea7311233d455f8d5 P 1e8299ce77aa4939877e6f90c5bd04aa: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:44.033942  3785 ts_tablet_manager.cc:1403] T f06a4d3121be4a6fa29269fcb15b1e57 P 563a1c63813642e591d31cf7936f81d0: Time spent bootstrapping tablet: real 0.077s	user 0.011s	sys 0.007s
I20260709 13:12:44.042384  3783 ts_tablet_manager.cc:1434] T 28cf86f3998847ab92593600dbdb0d90 P 6dfa3a6e32584eddb9dd28eb4e71bd56: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:12:44.043251  3783 tablet_bootstrap.cc:492] T ea26aa43a7c147bea7311233d455f8d5 P 6dfa3a6e32584eddb9dd28eb4e71bd56: Bootstrap starting.
I20260709 13:12:44.044422  3785 raft_consensus.cc:359] T f06a4d3121be4a6fa29269fcb15b1e57 P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:44.045080  3785 raft_consensus.cc:385] T f06a4d3121be4a6fa29269fcb15b1e57 P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:44.045318  3785 raft_consensus.cc:740] T f06a4d3121be4a6fa29269fcb15b1e57 P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 563a1c63813642e591d31cf7936f81d0, State: Initialized, Role: FOLLOWER
I20260709 13:12:44.046060  3785 consensus_queue.cc:260] T f06a4d3121be4a6fa29269fcb15b1e57 P 563a1c63813642e591d31cf7936f81d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:44.047915  3785 ts_tablet_manager.cc:1434] T f06a4d3121be4a6fa29269fcb15b1e57 P 563a1c63813642e591d31cf7936f81d0: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 13:12:44.049080  3492 catalog_manager.cc:5697] T 04d72e5e1a07401996c45a94f44bd659 P 1e8299ce77aa4939877e6f90c5bd04aa reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e8299ce77aa4939877e6f90c5bd04aa (127.28.54.67). New cstate: current_term: 1 leader_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:44.049408  3489 catalog_manager.cc:5697] T fab01b4c92b34ed1aa888cc485d1c0e0 P 6dfa3a6e32584eddb9dd28eb4e71bd56 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66). New cstate: current_term: 1 leader_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:44.050158  3784 tablet_bootstrap.cc:492] T ea26aa43a7c147bea7311233d455f8d5 P 1e8299ce77aa4939877e6f90c5bd04aa: No bootstrap required, opened a new log
I20260709 13:12:44.050864  3784 ts_tablet_manager.cc:1403] T ea26aa43a7c147bea7311233d455f8d5 P 1e8299ce77aa4939877e6f90c5bd04aa: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.003s
I20260709 13:12:44.052822  3489 catalog_manager.cc:5697] T 3077a0a5b9944af39dde06a7e84b9df9 P 6dfa3a6e32584eddb9dd28eb4e71bd56 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66). New cstate: current_term: 1 leader_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:44.055116  3784 raft_consensus.cc:359] T ea26aa43a7c147bea7311233d455f8d5 P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:44.055770  3784 raft_consensus.cc:385] T ea26aa43a7c147bea7311233d455f8d5 P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:44.056010  3784 raft_consensus.cc:740] T ea26aa43a7c147bea7311233d455f8d5 P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1e8299ce77aa4939877e6f90c5bd04aa, State: Initialized, Role: FOLLOWER
I20260709 13:12:44.052520  3783 tablet_bootstrap.cc:654] T ea26aa43a7c147bea7311233d455f8d5 P 6dfa3a6e32584eddb9dd28eb4e71bd56: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:44.058969  3784 consensus_queue.cc:260] T ea26aa43a7c147bea7311233d455f8d5 P 1e8299ce77aa4939877e6f90c5bd04aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:44.060932  3784 ts_tablet_manager.cc:1434] T ea26aa43a7c147bea7311233d455f8d5 P 1e8299ce77aa4939877e6f90c5bd04aa: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260709 13:12:44.063851  3783 tablet_bootstrap.cc:492] T ea26aa43a7c147bea7311233d455f8d5 P 6dfa3a6e32584eddb9dd28eb4e71bd56: No bootstrap required, opened a new log
I20260709 13:12:44.064273  3783 ts_tablet_manager.cc:1403] T ea26aa43a7c147bea7311233d455f8d5 P 6dfa3a6e32584eddb9dd28eb4e71bd56: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.000s
I20260709 13:12:44.066867  3783 raft_consensus.cc:359] T ea26aa43a7c147bea7311233d455f8d5 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:44.067471  3783 raft_consensus.cc:385] T ea26aa43a7c147bea7311233d455f8d5 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:44.067723  3783 raft_consensus.cc:740] T ea26aa43a7c147bea7311233d455f8d5 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6dfa3a6e32584eddb9dd28eb4e71bd56, State: Initialized, Role: FOLLOWER
I20260709 13:12:44.068454  3783 consensus_queue.cc:260] T ea26aa43a7c147bea7311233d455f8d5 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:44.070408  3783 ts_tablet_manager.cc:1434] T ea26aa43a7c147bea7311233d455f8d5 P 6dfa3a6e32584eddb9dd28eb4e71bd56: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:12:44.069725  3492 catalog_manager.cc:5697] T f06a4d3121be4a6fa29269fcb15b1e57 P 1e8299ce77aa4939877e6f90c5bd04aa reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e8299ce77aa4939877e6f90c5bd04aa (127.28.54.67). New cstate: current_term: 1 leader_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:44.071382  3492 catalog_manager.cc:5697] T 92acdf60735749beb2a12618aff17cfd P 1e8299ce77aa4939877e6f90c5bd04aa reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e8299ce77aa4939877e6f90c5bd04aa (127.28.54.67). New cstate: current_term: 1 leader_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:44.151648  3819 raft_consensus.cc:493] T f06a4d3121be4a6fa29269fcb15b1e57 P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.152137  3819 raft_consensus.cc:515] T f06a4d3121be4a6fa29269fcb15b1e57 P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:44.153692  3819 leader_election.cc:290] T f06a4d3121be4a6fa29269fcb15b1e57 P 563a1c63813642e591d31cf7936f81d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66:39331), 1e8299ce77aa4939877e6f90c5bd04aa (127.28.54.67:33771)
I20260709 13:12:44.154489  3669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06a4d3121be4a6fa29269fcb15b1e57" candidate_uuid: "563a1c63813642e591d31cf7936f81d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" is_pre_election: true
I20260709 13:12:44.154659  3743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06a4d3121be4a6fa29269fcb15b1e57" candidate_uuid: "563a1c63813642e591d31cf7936f81d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" is_pre_election: true
I20260709 13:12:44.155133  3669 raft_consensus.cc:2393] T f06a4d3121be4a6fa29269fcb15b1e57 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 563a1c63813642e591d31cf7936f81d0 in current term 1: Already voted for candidate 1e8299ce77aa4939877e6f90c5bd04aa in this term.
I20260709 13:12:44.156025  3557 leader_election.cc:304] T f06a4d3121be4a6fa29269fcb15b1e57 P 563a1c63813642e591d31cf7936f81d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 563a1c63813642e591d31cf7936f81d0; no voters: 1e8299ce77aa4939877e6f90c5bd04aa, 6dfa3a6e32584eddb9dd28eb4e71bd56
I20260709 13:12:44.156617  3819 raft_consensus.cc:3060] T f06a4d3121be4a6fa29269fcb15b1e57 P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:44.162139  3819 raft_consensus.cc:2749] T f06a4d3121be4a6fa29269fcb15b1e57 P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:44.180143  3819 raft_consensus.cc:493] T 28cf86f3998847ab92593600dbdb0d90 P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.180580  3819 raft_consensus.cc:515] T 28cf86f3998847ab92593600dbdb0d90 P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:44.182160  3819 leader_election.cc:290] T 28cf86f3998847ab92593600dbdb0d90 P 563a1c63813642e591d31cf7936f81d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66:39331), 1e8299ce77aa4939877e6f90c5bd04aa (127.28.54.67:33771)
I20260709 13:12:44.182914  3669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28cf86f3998847ab92593600dbdb0d90" candidate_uuid: "563a1c63813642e591d31cf7936f81d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" is_pre_election: true
I20260709 13:12:44.183109  3743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28cf86f3998847ab92593600dbdb0d90" candidate_uuid: "563a1c63813642e591d31cf7936f81d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" is_pre_election: true
I20260709 13:12:44.183465  3669 raft_consensus.cc:2468] T 28cf86f3998847ab92593600dbdb0d90 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 563a1c63813642e591d31cf7936f81d0 in term 0.
I20260709 13:12:44.183687  3743 raft_consensus.cc:2468] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 563a1c63813642e591d31cf7936f81d0 in term 0.
I20260709 13:12:44.184545  3557 leader_election.cc:304] T 28cf86f3998847ab92593600dbdb0d90 P 563a1c63813642e591d31cf7936f81d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 563a1c63813642e591d31cf7936f81d0, 6dfa3a6e32584eddb9dd28eb4e71bd56; no voters: 
I20260709 13:12:44.185154  3819 raft_consensus.cc:2804] T 28cf86f3998847ab92593600dbdb0d90 P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:44.185426  3819 raft_consensus.cc:493] T 28cf86f3998847ab92593600dbdb0d90 P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:44.185703  3819 raft_consensus.cc:3060] T 28cf86f3998847ab92593600dbdb0d90 P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:44.190380  3819 raft_consensus.cc:515] T 28cf86f3998847ab92593600dbdb0d90 P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:44.191893  3819 leader_election.cc:290] T 28cf86f3998847ab92593600dbdb0d90 P 563a1c63813642e591d31cf7936f81d0 [CANDIDATE]: Term 1 election: Requested vote from peers 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66:39331), 1e8299ce77aa4939877e6f90c5bd04aa (127.28.54.67:33771)
I20260709 13:12:44.192844  3669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28cf86f3998847ab92593600dbdb0d90" candidate_uuid: "563a1c63813642e591d31cf7936f81d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56"
I20260709 13:12:44.192844  3743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28cf86f3998847ab92593600dbdb0d90" candidate_uuid: "563a1c63813642e591d31cf7936f81d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8299ce77aa4939877e6f90c5bd04aa"
I20260709 13:12:44.193575  3669 raft_consensus.cc:3060] T 28cf86f3998847ab92593600dbdb0d90 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:44.193632  3743 raft_consensus.cc:3060] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:44.198144  3669 raft_consensus.cc:2468] T 28cf86f3998847ab92593600dbdb0d90 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 563a1c63813642e591d31cf7936f81d0 in term 1.
I20260709 13:12:44.198186  3743 raft_consensus.cc:2468] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 563a1c63813642e591d31cf7936f81d0 in term 1.
I20260709 13:12:44.199101  3557 leader_election.cc:304] T 28cf86f3998847ab92593600dbdb0d90 P 563a1c63813642e591d31cf7936f81d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 563a1c63813642e591d31cf7936f81d0, 6dfa3a6e32584eddb9dd28eb4e71bd56; no voters: 
I20260709 13:12:44.199679  3819 raft_consensus.cc:2804] T 28cf86f3998847ab92593600dbdb0d90 P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:44.200145  3819 raft_consensus.cc:697] T 28cf86f3998847ab92593600dbdb0d90 P 563a1c63813642e591d31cf7936f81d0 [term 1 LEADER]: Becoming Leader. State: Replica: 563a1c63813642e591d31cf7936f81d0, State: Running, Role: LEADER
I20260709 13:12:44.200721  3819 consensus_queue.cc:237] T 28cf86f3998847ab92593600dbdb0d90 P 563a1c63813642e591d31cf7936f81d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:44.207444  3489 catalog_manager.cc:5697] T 28cf86f3998847ab92593600dbdb0d90 P 563a1c63813642e591d31cf7936f81d0 reported cstate change: term changed from 0 to 1, leader changed from <none> to 563a1c63813642e591d31cf7936f81d0 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "563a1c63813642e591d31cf7936f81d0" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:44.304383  3790 raft_consensus.cc:493] T ea26aa43a7c147bea7311233d455f8d5 P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.304879  3790 raft_consensus.cc:515] T ea26aa43a7c147bea7311233d455f8d5 P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:44.306558  3790 leader_election.cc:290] T ea26aa43a7c147bea7311233d455f8d5 P 1e8299ce77aa4939877e6f90c5bd04aa [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995), 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66:39331)
I20260709 13:12:44.307242  3594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea26aa43a7c147bea7311233d455f8d5" candidate_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "563a1c63813642e591d31cf7936f81d0" is_pre_election: true
I20260709 13:12:44.307587  3669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea26aa43a7c147bea7311233d455f8d5" candidate_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" is_pre_election: true
I20260709 13:12:44.307794  3594 raft_consensus.cc:2468] T ea26aa43a7c147bea7311233d455f8d5 P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e8299ce77aa4939877e6f90c5bd04aa in term 0.
I20260709 13:12:44.308117  3669 raft_consensus.cc:2468] T ea26aa43a7c147bea7311233d455f8d5 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e8299ce77aa4939877e6f90c5bd04aa in term 0.
I20260709 13:12:44.308730  3706 leader_election.cc:304] T ea26aa43a7c147bea7311233d455f8d5 P 1e8299ce77aa4939877e6f90c5bd04aa [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e8299ce77aa4939877e6f90c5bd04aa, 563a1c63813642e591d31cf7936f81d0; no voters: 
I20260709 13:12:44.309353  3790 raft_consensus.cc:2804] T ea26aa43a7c147bea7311233d455f8d5 P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:44.309700  3790 raft_consensus.cc:493] T ea26aa43a7c147bea7311233d455f8d5 P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:44.310009  3790 raft_consensus.cc:3060] T ea26aa43a7c147bea7311233d455f8d5 P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:44.313617  3669 raft_consensus.cc:3060] T ba2c5f7a7dd946bc843001bcb47a202a P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:44.315205  3790 raft_consensus.cc:515] T ea26aa43a7c147bea7311233d455f8d5 P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:44.316834  3790 leader_election.cc:290] T ea26aa43a7c147bea7311233d455f8d5 P 1e8299ce77aa4939877e6f90c5bd04aa [CANDIDATE]: Term 1 election: Requested vote from peers 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995), 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66:39331)
I20260709 13:12:44.317494  3594 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea26aa43a7c147bea7311233d455f8d5" candidate_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "563a1c63813642e591d31cf7936f81d0"
I20260709 13:12:44.317744  3668 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea26aa43a7c147bea7311233d455f8d5" candidate_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56"
I20260709 13:12:44.318120  3594 raft_consensus.cc:3060] T ea26aa43a7c147bea7311233d455f8d5 P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:44.318281  3668 raft_consensus.cc:3060] T ea26aa43a7c147bea7311233d455f8d5 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:44.320984  3819 consensus_queue.cc:1048] T ba2c5f7a7dd946bc843001bcb47a202a P 563a1c63813642e591d31cf7936f81d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:44.323565  3825 consensus_queue.cc:1048] T fab01b4c92b34ed1aa888cc485d1c0e0 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:44.324476  3668 raft_consensus.cc:2468] T ea26aa43a7c147bea7311233d455f8d5 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e8299ce77aa4939877e6f90c5bd04aa in term 1.
I20260709 13:12:44.325683  3706 leader_election.cc:304] T ea26aa43a7c147bea7311233d455f8d5 P 1e8299ce77aa4939877e6f90c5bd04aa [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e8299ce77aa4939877e6f90c5bd04aa, 6dfa3a6e32584eddb9dd28eb4e71bd56; no voters: 
I20260709 13:12:44.326771  3790 raft_consensus.cc:2804] T ea26aa43a7c147bea7311233d455f8d5 P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:44.328810  3790 raft_consensus.cc:697] T ea26aa43a7c147bea7311233d455f8d5 P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 LEADER]: Becoming Leader. State: Replica: 1e8299ce77aa4939877e6f90c5bd04aa, State: Running, Role: LEADER
I20260709 13:12:44.325492  3594 raft_consensus.cc:2468] T ea26aa43a7c147bea7311233d455f8d5 P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e8299ce77aa4939877e6f90c5bd04aa in term 1.
I20260709 13:12:44.331324  3790 consensus_queue.cc:237] T ea26aa43a7c147bea7311233d455f8d5 P 1e8299ce77aa4939877e6f90c5bd04aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:44.341352  3743 raft_consensus.cc:3060] T fab01b4c92b34ed1aa888cc485d1c0e0 P 1e8299ce77aa4939877e6f90c5bd04aa [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:44.347182  3492 catalog_manager.cc:5697] T ea26aa43a7c147bea7311233d455f8d5 P 1e8299ce77aa4939877e6f90c5bd04aa reported cstate change: term changed from 0 to 1, leader changed from <none> to 1e8299ce77aa4939877e6f90c5bd04aa (127.28.54.67). New cstate: current_term: 1 leader_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:44.349921  3819 consensus_queue.cc:1048] T ba2c5f7a7dd946bc843001bcb47a202a P 563a1c63813642e591d31cf7936f81d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:44.352994  3791 consensus_queue.cc:1048] T fab01b4c92b34ed1aa888cc485d1c0e0 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:44.364794  3819 raft_consensus.cc:493] T 04d72e5e1a07401996c45a94f44bd659 P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:44.365231  3819 raft_consensus.cc:515] T 04d72e5e1a07401996c45a94f44bd659 P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:44.366969  3819 leader_election.cc:290] T 04d72e5e1a07401996c45a94f44bd659 P 563a1c63813642e591d31cf7936f81d0 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66:39331), 1e8299ce77aa4939877e6f90c5bd04aa (127.28.54.67:33771)
I20260709 13:12:44.367663  3669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d72e5e1a07401996c45a94f44bd659" candidate_uuid: "563a1c63813642e591d31cf7936f81d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" is_pre_election: true
I20260709 13:12:44.368350  3669 raft_consensus.cc:2393] T 04d72e5e1a07401996c45a94f44bd659 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 563a1c63813642e591d31cf7936f81d0 in current term 1: Already voted for candidate 1e8299ce77aa4939877e6f90c5bd04aa in this term.
I20260709 13:12:44.367975  3742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d72e5e1a07401996c45a94f44bd659" candidate_uuid: "563a1c63813642e591d31cf7936f81d0" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" is_pre_election: true
I20260709 13:12:44.370687  3557 leader_election.cc:304] T 04d72e5e1a07401996c45a94f44bd659 P 563a1c63813642e591d31cf7936f81d0 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 563a1c63813642e591d31cf7936f81d0; no voters: 1e8299ce77aa4939877e6f90c5bd04aa, 6dfa3a6e32584eddb9dd28eb4e71bd56
I20260709 13:12:44.371351  3819 raft_consensus.cc:3060] T 04d72e5e1a07401996c45a94f44bd659 P 563a1c63813642e591d31cf7936f81d0 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:44.371912  3789 consensus_queue.cc:1048] T 84ca4c013a24451388658395af3b8b78 P 563a1c63813642e591d31cf7936f81d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:44.377281  3819 raft_consensus.cc:2749] T 04d72e5e1a07401996c45a94f44bd659 P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:44.382373 28889 ts_manager.cc:295] Set tserver state for 563a1c63813642e591d31cf7936f81d0 to MAINTENANCE_MODE
I20260709 13:12:44.383023 28889 tablet_server.cc:179] TabletServer@127.28.54.65:0 shutting down...
I20260709 13:12:44.389672  3789 consensus_queue.cc:1048] T 84ca4c013a24451388658395af3b8b78 P 563a1c63813642e591d31cf7936f81d0 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:44.402442  3790 consensus_queue.cc:1048] T f06a4d3121be4a6fa29269fcb15b1e57 P 1e8299ce77aa4939877e6f90c5bd04aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:12:44.404562  3706 consensus_peers.cc:597] T f06a4d3121be4a6fa29269fcb15b1e57 P 1e8299ce77aa4939877e6f90c5bd04aa -> Peer 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995): Couldn't send request to peer 563a1c63813642e591d31cf7936f81d0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:44.407724  3790 consensus_queue.cc:1048] T 04d72e5e1a07401996c45a94f44bd659 P 1e8299ce77aa4939877e6f90c5bd04aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:44.429389  3825 consensus_queue.cc:1048] T 3077a0a5b9944af39dde06a7e84b9df9 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:44.431790 28889 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:44.432672 28889 tablet_replica.cc:333] T f06a4d3121be4a6fa29269fcb15b1e57 P 563a1c63813642e591d31cf7936f81d0: stopping tablet replica
I20260709 13:12:44.433409 28889 raft_consensus.cc:2243] T f06a4d3121be4a6fa29269fcb15b1e57 P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:44.433874 28889 raft_consensus.cc:2272] T f06a4d3121be4a6fa29269fcb15b1e57 P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:44.436040 28889 tablet_replica.cc:333] T 04d72e5e1a07401996c45a94f44bd659 P 563a1c63813642e591d31cf7936f81d0: stopping tablet replica
I20260709 13:12:44.436600 28889 raft_consensus.cc:2243] T 04d72e5e1a07401996c45a94f44bd659 P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:44.437189 28889 raft_consensus.cc:2272] T 04d72e5e1a07401996c45a94f44bd659 P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:44.436568  3706 consensus_peers.cc:597] T 04d72e5e1a07401996c45a94f44bd659 P 1e8299ce77aa4939877e6f90c5bd04aa -> Peer 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995): Couldn't send request to peer 563a1c63813642e591d31cf7936f81d0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:44.438992 28889 tablet_replica.cc:333] T 28cf86f3998847ab92593600dbdb0d90 P 563a1c63813642e591d31cf7936f81d0: stopping tablet replica
I20260709 13:12:44.441336 28889 raft_consensus.cc:2243] T 28cf86f3998847ab92593600dbdb0d90 P 563a1c63813642e591d31cf7936f81d0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:44.442078 28889 pending_rounds.cc:70] T 28cf86f3998847ab92593600dbdb0d90 P 563a1c63813642e591d31cf7936f81d0: Trying to abort 1 pending ops.
I20260709 13:12:44.442283 28889 pending_rounds.cc:77] T 28cf86f3998847ab92593600dbdb0d90 P 563a1c63813642e591d31cf7936f81d0: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305636922172727296 op_type: NO_OP noop_request { }
I20260709 13:12:44.442634 28889 raft_consensus.cc:2889] T 28cf86f3998847ab92593600dbdb0d90 P 563a1c63813642e591d31cf7936f81d0 [term 1 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:12:44.442924 28889 raft_consensus.cc:2272] T 28cf86f3998847ab92593600dbdb0d90 P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:44.445691 28889 tablet_replica.cc:333] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 563a1c63813642e591d31cf7936f81d0: stopping tablet replica
I20260709 13:12:44.446269 28889 raft_consensus.cc:2243] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:44.446691 28889 raft_consensus.cc:2272] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:44.448522 28889 tablet_replica.cc:333] T 92acdf60735749beb2a12618aff17cfd P 563a1c63813642e591d31cf7936f81d0: stopping tablet replica
I20260709 13:12:44.449203 28889 raft_consensus.cc:2243] T 92acdf60735749beb2a12618aff17cfd P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:44.449472  3825 consensus_queue.cc:1048] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:44.449617  3790 consensus_queue.cc:1048] T 92acdf60735749beb2a12618aff17cfd P 1e8299ce77aa4939877e6f90c5bd04aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:44.449625 28889 raft_consensus.cc:2272] T 92acdf60735749beb2a12618aff17cfd P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:44.455711 28889 tablet_replica.cc:333] T ba2c5f7a7dd946bc843001bcb47a202a P 563a1c63813642e591d31cf7936f81d0: stopping tablet replica
I20260709 13:12:44.456429 28889 raft_consensus.cc:2243] T ba2c5f7a7dd946bc843001bcb47a202a P 563a1c63813642e591d31cf7936f81d0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:44.458910 28889 raft_consensus.cc:2272] T ba2c5f7a7dd946bc843001bcb47a202a P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:44.470719 28889 tablet_replica.cc:333] T ea26aa43a7c147bea7311233d455f8d5 P 563a1c63813642e591d31cf7936f81d0: stopping tablet replica
I20260709 13:12:44.471441 28889 raft_consensus.cc:2243] T ea26aa43a7c147bea7311233d455f8d5 P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:44.471872 28889 raft_consensus.cc:2272] T ea26aa43a7c147bea7311233d455f8d5 P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:44.474124 28889 tablet_replica.cc:333] T fab01b4c92b34ed1aa888cc485d1c0e0 P 563a1c63813642e591d31cf7936f81d0: stopping tablet replica
I20260709 13:12:44.474761 28889 raft_consensus.cc:2243] T fab01b4c92b34ed1aa888cc485d1c0e0 P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:44.475263 28889 raft_consensus.cc:2272] T fab01b4c92b34ed1aa888cc485d1c0e0 P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:44.478708  3632 consensus_peers.cc:597] T 3077a0a5b9944af39dde06a7e84b9df9 P 6dfa3a6e32584eddb9dd28eb4e71bd56 -> Peer 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995): Couldn't send request to peer 563a1c63813642e591d31cf7936f81d0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:44.480983  3706 consensus_peers.cc:597] T 92acdf60735749beb2a12618aff17cfd P 1e8299ce77aa4939877e6f90c5bd04aa -> Peer 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995): Couldn't send request to peer 563a1c63813642e591d31cf7936f81d0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:44.484181 28889 tablet_replica.cc:333] T 3077a0a5b9944af39dde06a7e84b9df9 P 563a1c63813642e591d31cf7936f81d0: stopping tablet replica
I20260709 13:12:44.484894 28889 raft_consensus.cc:2243] T 3077a0a5b9944af39dde06a7e84b9df9 P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:44.485325 28889 raft_consensus.cc:2272] T 3077a0a5b9944af39dde06a7e84b9df9 P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:44.487102 28889 tablet_replica.cc:333] T 84ca4c013a24451388658395af3b8b78 P 563a1c63813642e591d31cf7936f81d0: stopping tablet replica
I20260709 13:12:44.487524 28889 raft_consensus.cc:2243] T 84ca4c013a24451388658395af3b8b78 P 563a1c63813642e591d31cf7936f81d0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:44.488276 28889 raft_consensus.cc:2272] T 84ca4c013a24451388658395af3b8b78 P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:44.494206  3632 consensus_peers.cc:597] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 6dfa3a6e32584eddb9dd28eb4e71bd56 -> Peer 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995): Couldn't send request to peer 563a1c63813642e591d31cf7936f81d0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:44.516906 28889 tablet_server.cc:196] TabletServer@127.28.54.65:0 shutdown complete.
I20260709 13:12:44.733112  3826 consensus_queue.cc:1048] T ea26aa43a7c147bea7311233d455f8d5 P 1e8299ce77aa4939877e6f90c5bd04aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 13:12:44.745863  3706 consensus_peers.cc:597] T ea26aa43a7c147bea7311233d455f8d5 P 1e8299ce77aa4939877e6f90c5bd04aa -> Peer 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995): Couldn't send request to peer 563a1c63813642e591d31cf7936f81d0. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:42995: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:44.786706  3540 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:12:44.943346  3632 consensus_peers.cc:597] T fab01b4c92b34ed1aa888cc485d1c0e0 P 6dfa3a6e32584eddb9dd28eb4e71bd56 -> Peer 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995): Couldn't send request to peer 563a1c63813642e591d31cf7936f81d0. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:42995: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:45.735422  3826 raft_consensus.cc:493] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:45.736202  3826 raft_consensus.cc:515] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:45.738183  3826 leader_election.cc:290] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995), 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66:39331)
I20260709 13:12:45.739809  3669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28cf86f3998847ab92593600dbdb0d90" candidate_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" is_pre_election: true
I20260709 13:12:45.740950  3669 raft_consensus.cc:2468] T 28cf86f3998847ab92593600dbdb0d90 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e8299ce77aa4939877e6f90c5bd04aa in term 1.
W20260709 13:12:45.741915  3706 leader_election.cc:336] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995): Network error: Client connection negotiation failed: client connection to 127.28.54.65:42995: connect: Connection refused (error 111)
I20260709 13:12:45.742717  3706 leader_election.cc:304] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e8299ce77aa4939877e6f90c5bd04aa, 6dfa3a6e32584eddb9dd28eb4e71bd56; no voters: 563a1c63813642e591d31cf7936f81d0
I20260709 13:12:45.743425  3826 raft_consensus.cc:2804] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 13:12:45.743773  3826 raft_consensus.cc:493] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:45.744042  3826 raft_consensus.cc:3060] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:45.751593  3826 raft_consensus.cc:515] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:45.753193  3826 leader_election.cc:290] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa [CANDIDATE]: Term 2 election: Requested vote from peers 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995), 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66:39331)
I20260709 13:12:45.754449  3669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28cf86f3998847ab92593600dbdb0d90" candidate_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56"
I20260709 13:12:45.755052  3669 raft_consensus.cc:3060] T 28cf86f3998847ab92593600dbdb0d90 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:45.756187  3706 leader_election.cc:336] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995): Network error: Client connection negotiation failed: client connection to 127.28.54.65:42995: connect: Connection refused (error 111)
I20260709 13:12:45.760483  3669 raft_consensus.cc:2468] T 28cf86f3998847ab92593600dbdb0d90 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e8299ce77aa4939877e6f90c5bd04aa in term 2.
I20260709 13:12:45.761440  3706 leader_election.cc:304] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e8299ce77aa4939877e6f90c5bd04aa, 6dfa3a6e32584eddb9dd28eb4e71bd56; no voters: 563a1c63813642e591d31cf7936f81d0
I20260709 13:12:45.762215  3826 raft_consensus.cc:2804] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:45.763321  3826 raft_consensus.cc:697] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 LEADER]: Becoming Leader. State: Replica: 1e8299ce77aa4939877e6f90c5bd04aa, State: Running, Role: LEADER
I20260709 13:12:45.764675  3826 consensus_queue.cc:237] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:45.771379  3492 catalog_manager.cc:5697] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa reported cstate change: term changed from 1 to 2, leader changed from 563a1c63813642e591d31cf7936f81d0 (127.28.54.65) to 1e8299ce77aa4939877e6f90c5bd04aa (127.28.54.67). New cstate: current_term: 2 leader_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } health_report { overall_health: HEALTHY } } }
W20260709 13:12:45.787758  3540 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:12:45.841745  3820 raft_consensus.cc:493] T ba2c5f7a7dd946bc843001bcb47a202a P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 563a1c63813642e591d31cf7936f81d0)
I20260709 13:12:45.842701  3820 raft_consensus.cc:515] T ba2c5f7a7dd946bc843001bcb47a202a P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:45.847280  3820 leader_election.cc:290] T ba2c5f7a7dd946bc843001bcb47a202a P 6dfa3a6e32584eddb9dd28eb4e71bd56 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995), 1e8299ce77aa4939877e6f90c5bd04aa (127.28.54.67:33771)
I20260709 13:12:45.849280  3742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2c5f7a7dd946bc843001bcb47a202a" candidate_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" is_pre_election: true
W20260709 13:12:45.853222  3632 leader_election.cc:336] T ba2c5f7a7dd946bc843001bcb47a202a P 6dfa3a6e32584eddb9dd28eb4e71bd56 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995): Network error: Client connection negotiation failed: client connection to 127.28.54.65:42995: connect: Connection refused (error 111)
I20260709 13:12:45.853545  3632 leader_election.cc:304] T ba2c5f7a7dd946bc843001bcb47a202a P 6dfa3a6e32584eddb9dd28eb4e71bd56 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6dfa3a6e32584eddb9dd28eb4e71bd56; no voters: 1e8299ce77aa4939877e6f90c5bd04aa, 563a1c63813642e591d31cf7936f81d0
I20260709 13:12:45.854175  3820 raft_consensus.cc:2749] T ba2c5f7a7dd946bc843001bcb47a202a P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:45.854753  3826 raft_consensus.cc:493] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 563a1c63813642e591d31cf7936f81d0)
I20260709 13:12:45.855258  3826 raft_consensus.cc:515] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:45.856719  3826 leader_election.cc:290] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995), 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66:39331)
I20260709 13:12:45.858028  3669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2c5f7a7dd946bc843001bcb47a202a" candidate_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" is_pre_election: true
I20260709 13:12:45.858675  3669 raft_consensus.cc:2468] T ba2c5f7a7dd946bc843001bcb47a202a P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1e8299ce77aa4939877e6f90c5bd04aa in term 1.
I20260709 13:12:45.859498  3706 leader_election.cc:304] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e8299ce77aa4939877e6f90c5bd04aa, 6dfa3a6e32584eddb9dd28eb4e71bd56; no voters: 
I20260709 13:12:45.860184  3826 raft_consensus.cc:2804] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:12:45.860213  3706 leader_election.cc:336] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995): Network error: Client connection negotiation failed: client connection to 127.28.54.65:42995: connect: Connection refused (error 111)
I20260709 13:12:45.860517  3826 raft_consensus.cc:493] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 FOLLOWER]: Starting leader election (detected failure of leader 563a1c63813642e591d31cf7936f81d0)
I20260709 13:12:45.860821  3826 raft_consensus.cc:3060] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:45.866837  3826 raft_consensus.cc:515] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:45.868309  3826 leader_election.cc:290] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa [CANDIDATE]: Term 2 election: Requested vote from peers 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995), 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66:39331)
I20260709 13:12:45.869637  3669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2c5f7a7dd946bc843001bcb47a202a" candidate_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56"
I20260709 13:12:45.870251  3669 raft_consensus.cc:3060] T ba2c5f7a7dd946bc843001bcb47a202a P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:45.871541  3706 leader_election.cc:336] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995): Network error: Client connection negotiation failed: client connection to 127.28.54.65:42995: connect: Connection refused (error 111)
I20260709 13:12:45.874918  3669 raft_consensus.cc:2468] T ba2c5f7a7dd946bc843001bcb47a202a P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e8299ce77aa4939877e6f90c5bd04aa in term 2.
I20260709 13:12:45.875804  3706 leader_election.cc:304] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e8299ce77aa4939877e6f90c5bd04aa, 6dfa3a6e32584eddb9dd28eb4e71bd56; no voters: 563a1c63813642e591d31cf7936f81d0
I20260709 13:12:45.876432  3826 raft_consensus.cc:2804] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:45.876802  3826 raft_consensus.cc:697] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 LEADER]: Becoming Leader. State: Replica: 1e8299ce77aa4939877e6f90c5bd04aa, State: Running, Role: LEADER
I20260709 13:12:45.877733  3826 consensus_queue.cc:237] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:45.884053  3492 catalog_manager.cc:5697] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa reported cstate change: term changed from 1 to 2, leader changed from 563a1c63813642e591d31cf7936f81d0 (127.28.54.65) to 1e8299ce77aa4939877e6f90c5bd04aa (127.28.54.67). New cstate: current_term: 2 leader_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:45.890250  3826 raft_consensus.cc:493] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 563a1c63813642e591d31cf7936f81d0)
I20260709 13:12:45.890990  3826 raft_consensus.cc:515] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:45.893023  3826 leader_election.cc:290] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995), 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66:39331)
I20260709 13:12:45.894294  3669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ca4c013a24451388658395af3b8b78" candidate_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" is_pre_election: true
W20260709 13:12:45.895937  3706 leader_election.cc:336] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995): Network error: Client connection negotiation failed: client connection to 127.28.54.65:42995: connect: Connection refused (error 111)
I20260709 13:12:45.896286  3706 leader_election.cc:304] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1e8299ce77aa4939877e6f90c5bd04aa; no voters: 563a1c63813642e591d31cf7936f81d0, 6dfa3a6e32584eddb9dd28eb4e71bd56
I20260709 13:12:45.896831  3826 raft_consensus.cc:2749] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:45.899771  3820 raft_consensus.cc:493] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 563a1c63813642e591d31cf7936f81d0)
I20260709 13:12:45.900233  3820 raft_consensus.cc:515] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:45.901729  3820 leader_election.cc:290] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995), 1e8299ce77aa4939877e6f90c5bd04aa (127.28.54.67:33771)
I20260709 13:12:45.903052  3742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ca4c013a24451388658395af3b8b78" candidate_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" is_pre_election: true
I20260709 13:12:45.903693  3742 raft_consensus.cc:2468] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6dfa3a6e32584eddb9dd28eb4e71bd56 in term 1.
I20260709 13:12:45.904579  3632 leader_election.cc:304] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e8299ce77aa4939877e6f90c5bd04aa, 6dfa3a6e32584eddb9dd28eb4e71bd56; no voters: 
I20260709 13:12:45.905143  3820 raft_consensus.cc:2804] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 13:12:45.905192  3632 leader_election.cc:336] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995): Network error: Client connection negotiation failed: client connection to 127.28.54.65:42995: connect: Connection refused (error 111)
I20260709 13:12:45.905437  3820 raft_consensus.cc:493] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 563a1c63813642e591d31cf7936f81d0)
I20260709 13:12:45.905781  3820 raft_consensus.cc:3060] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:45.911453  3820 raft_consensus.cc:515] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:45.913210  3820 leader_election.cc:290] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [CANDIDATE]: Term 2 election: Requested vote from peers 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995), 1e8299ce77aa4939877e6f90c5bd04aa (127.28.54.67:33771)
I20260709 13:12:45.915098  3743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ca4c013a24451388658395af3b8b78" candidate_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "1e8299ce77aa4939877e6f90c5bd04aa"
I20260709 13:12:45.915751  3743 raft_consensus.cc:3060] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 FOLLOWER]: Advancing to term 2
W20260709 13:12:45.917291  3632 leader_election.cc:336] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995): Network error: Client connection negotiation failed: client connection to 127.28.54.65:42995: connect: Connection refused (error 111)
I20260709 13:12:45.921636  3743 raft_consensus.cc:2468] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dfa3a6e32584eddb9dd28eb4e71bd56 in term 2.
I20260709 13:12:45.922544  3632 leader_election.cc:304] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1e8299ce77aa4939877e6f90c5bd04aa, 6dfa3a6e32584eddb9dd28eb4e71bd56; no voters: 563a1c63813642e591d31cf7936f81d0
I20260709 13:12:45.923108  3820 raft_consensus.cc:2804] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:45.923444  3820 raft_consensus.cc:697] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 2 LEADER]: Becoming Leader. State: Replica: 6dfa3a6e32584eddb9dd28eb4e71bd56, State: Running, Role: LEADER
I20260709 13:12:45.924161  3820 consensus_queue.cc:237] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:45.931033  3492 catalog_manager.cc:5697] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 reported cstate change: term changed from 1 to 2, leader changed from 563a1c63813642e591d31cf7936f81d0 (127.28.54.65) to 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66). New cstate: current_term: 2 leader_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } health_report { overall_health: UNKNOWN } } }
W20260709 13:12:46.311162  3706 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.54.65:42995: connect: Connection refused (error 111) [suppressed 113 similar messages]
W20260709 13:12:46.313268  3706 consensus_peers.cc:597] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa -> Peer 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995): Couldn't send request to peer 563a1c63813642e591d31cf7936f81d0. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:42995: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:46.315693  3669 raft_consensus.cc:1275] T ba2c5f7a7dd946bc843001bcb47a202a P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 2 FOLLOWER]: Refusing update from remote peer 1e8299ce77aa4939877e6f90c5bd04aa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:46.316941  3869 consensus_queue.cc:1048] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:12:46.317204  3706 consensus_peers.cc:597] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa -> Peer 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995): Couldn't send request to peer 563a1c63813642e591d31cf7936f81d0. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:42995: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:46.320343  3632 consensus_peers.cc:597] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 -> Peer 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995): Couldn't send request to peer 563a1c63813642e591d31cf7936f81d0. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:42995: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:46.353298  3669 raft_consensus.cc:1275] T 28cf86f3998847ab92593600dbdb0d90 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 2 FOLLOWER]: Refusing update from remote peer 1e8299ce77aa4939877e6f90c5bd04aa: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 13:12:46.354539  3826 consensus_queue.cc:1048] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:46.438475  3743 raft_consensus.cc:1275] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 FOLLOWER]: Refusing update from remote peer 6dfa3a6e32584eddb9dd28eb4e71bd56: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:46.439644  3820 consensus_queue.cc:1048] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:12:46.788571  3540 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:12:46.791384  3706 consensus_peers.cc:597] T f06a4d3121be4a6fa29269fcb15b1e57 P 1e8299ce77aa4939877e6f90c5bd04aa -> Peer 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995): Couldn't send request to peer 563a1c63813642e591d31cf7936f81d0. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:42995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:46.905319  3632 consensus_peers.cc:597] T 3077a0a5b9944af39dde06a7e84b9df9 P 6dfa3a6e32584eddb9dd28eb4e71bd56 -> Peer 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995): Couldn't send request to peer 563a1c63813642e591d31cf7936f81d0. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:42995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:46.930341  3632 consensus_peers.cc:597] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 6dfa3a6e32584eddb9dd28eb4e71bd56 -> Peer 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995): Couldn't send request to peer 563a1c63813642e591d31cf7936f81d0. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:42995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:46.933423  3706 consensus_peers.cc:597] T 04d72e5e1a07401996c45a94f44bd659 P 1e8299ce77aa4939877e6f90c5bd04aa -> Peer 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995): Couldn't send request to peer 563a1c63813642e591d31cf7936f81d0. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:42995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:46.971422  3706 consensus_peers.cc:597] T ea26aa43a7c147bea7311233d455f8d5 P 1e8299ce77aa4939877e6f90c5bd04aa -> Peer 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995): Couldn't send request to peer 563a1c63813642e591d31cf7936f81d0. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:42995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:47.066030  3706 consensus_peers.cc:597] T 92acdf60735749beb2a12618aff17cfd P 1e8299ce77aa4939877e6f90c5bd04aa -> Peer 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995): Couldn't send request to peer 563a1c63813642e591d31cf7936f81d0. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:42995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:47.337110  3632 consensus_peers.cc:597] T fab01b4c92b34ed1aa888cc485d1c0e0 P 6dfa3a6e32584eddb9dd28eb4e71bd56 -> Peer 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995): Couldn't send request to peer 563a1c63813642e591d31cf7936f81d0. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:42995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:47.789395  3540 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:12:48.598747  3632 consensus_peers.cc:597] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 -> Peer 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995): Couldn't send request to peer 563a1c63813642e591d31cf7936f81d0. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:42995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:48.697487  3706 consensus_peers.cc:597] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa -> Peer 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995): Couldn't send request to peer 563a1c63813642e591d31cf7936f81d0. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:42995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:48.790304  3540 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 13:12:48.899911  3706 consensus_peers.cc:597] T f06a4d3121be4a6fa29269fcb15b1e57 P 1e8299ce77aa4939877e6f90c5bd04aa -> Peer 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995): Couldn't send request to peer 563a1c63813642e591d31cf7936f81d0. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:42995: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:49.071834  3706 consensus_peers.cc:597] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa -> Peer 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995): Couldn't send request to peer 563a1c63813642e591d31cf7936f81d0. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:42995: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 13:12:49.415800  3706 consensus_peers.cc:597] T 04d72e5e1a07401996c45a94f44bd659 P 1e8299ce77aa4939877e6f90c5bd04aa -> Peer 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995): Couldn't send request to peer 563a1c63813642e591d31cf7936f81d0. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:42995: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:49.505257  3632 consensus_peers.cc:597] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 6dfa3a6e32584eddb9dd28eb4e71bd56 -> Peer 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995): Couldn't send request to peer 563a1c63813642e591d31cf7936f81d0. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:42995: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:49.534272 28889 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:49.540867  3889 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:49.541147  3890 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:49.543639  3892 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:49.544528 28889 server_base.cc:1061] running on GCE node
I20260709 13:12:49.546118 28889 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:49.546317 28889 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:49.546454 28889 hybrid_clock.cc:648] HybridClock initialized: now 1783602769546443 us; error 0 us; skew 500 ppm
I20260709 13:12:49.546936 28889 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:49.549455 28889 webserver.cc:533] Webserver started at http://127.28.54.65:34317/ using document root <none> and password file <none>
I20260709 13:12:49.549954 28889 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:49.550109 28889 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 13:12:49.553732 28889 fs_manager.cc:714] Time spent opening directory manager: real 0.003s	user 0.000s	sys 0.003s
I20260709 13:12:49.557312  3897 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:49.558024 28889 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.003s
I20260709 13:12:49.558269 28889 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602558744475-28889-0/minicluster-data/ts-0-root
uuid: "563a1c63813642e591d31cf7936f81d0"
format_stamp: "Formatted at 2026-07-09 13:12:42 on dist-test-slave-vpdx"
I20260709 13:12:49.558562 28889 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602558744475-28889-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602558744475-28889-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783602558744475-28889-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:49.580489 28889 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:49.581643 28889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:49.583046 28889 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:49.586453  3904 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
W20260709 13:12:49.592643  3632 consensus_peers.cc:597] T 3077a0a5b9944af39dde06a7e84b9df9 P 6dfa3a6e32584eddb9dd28eb4e71bd56 -> Peer 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995): Couldn't send request to peer 563a1c63813642e591d31cf7936f81d0. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:42995: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:49.601869  3706 consensus_peers.cc:597] T ea26aa43a7c147bea7311233d455f8d5 P 1e8299ce77aa4939877e6f90c5bd04aa -> Peer 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995): Couldn't send request to peer 563a1c63813642e591d31cf7936f81d0. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:42995: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 13:12:49.633354  3706 consensus_peers.cc:597] T 92acdf60735749beb2a12618aff17cfd P 1e8299ce77aa4939877e6f90c5bd04aa -> Peer 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995): Couldn't send request to peer 563a1c63813642e591d31cf7936f81d0. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:42995: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 13:12:49.635318 28889 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 13:12:49.635613 28889 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.050s	user 0.000s	sys 0.002s
I20260709 13:12:49.635848 28889 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 13:12:49.641721  3904 tablet_bootstrap.cc:492] T 92acdf60735749beb2a12618aff17cfd P 563a1c63813642e591d31cf7936f81d0: Bootstrap starting.
I20260709 13:12:49.652245  3904 tablet_bootstrap.cc:492] T 92acdf60735749beb2a12618aff17cfd P 563a1c63813642e591d31cf7936f81d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:49.652842  3904 tablet_bootstrap.cc:492] T 92acdf60735749beb2a12618aff17cfd P 563a1c63813642e591d31cf7936f81d0: Bootstrap complete.
I20260709 13:12:49.653321  3904 ts_tablet_manager.cc:1403] T 92acdf60735749beb2a12618aff17cfd P 563a1c63813642e591d31cf7936f81d0: Time spent bootstrapping tablet: real 0.012s	user 0.006s	sys 0.003s
I20260709 13:12:49.655339  3904 raft_consensus.cc:359] T 92acdf60735749beb2a12618aff17cfd P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:49.655839  3904 raft_consensus.cc:740] T 92acdf60735749beb2a12618aff17cfd P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 563a1c63813642e591d31cf7936f81d0, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.656390  3904 consensus_queue.cc:260] T 92acdf60735749beb2a12618aff17cfd P 563a1c63813642e591d31cf7936f81d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:49.658689  3904 ts_tablet_manager.cc:1434] T 92acdf60735749beb2a12618aff17cfd P 563a1c63813642e591d31cf7936f81d0: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.001s
I20260709 13:12:49.659296  3904 tablet_bootstrap.cc:492] T fab01b4c92b34ed1aa888cc485d1c0e0 P 563a1c63813642e591d31cf7936f81d0: Bootstrap starting.
I20260709 13:12:49.671180  3904 tablet_bootstrap.cc:492] T fab01b4c92b34ed1aa888cc485d1c0e0 P 563a1c63813642e591d31cf7936f81d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:49.671450 28889 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 13:12:49.671734 28889 ts_tablet_manager.cc:595] Time spent register tablets: real 0.036s	user 0.030s	sys 0.005s
I20260709 13:12:49.671939  3904 tablet_bootstrap.cc:492] T fab01b4c92b34ed1aa888cc485d1c0e0 P 563a1c63813642e591d31cf7936f81d0: Bootstrap complete.
I20260709 13:12:49.672602  3904 ts_tablet_manager.cc:1403] T fab01b4c92b34ed1aa888cc485d1c0e0 P 563a1c63813642e591d31cf7936f81d0: Time spent bootstrapping tablet: real 0.013s	user 0.010s	sys 0.000s
I20260709 13:12:49.675343  3904 raft_consensus.cc:359] T fab01b4c92b34ed1aa888cc485d1c0e0 P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:49.675846  3904 raft_consensus.cc:740] T fab01b4c92b34ed1aa888cc485d1c0e0 P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 563a1c63813642e591d31cf7936f81d0, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.676447  3904 consensus_queue.cc:260] T fab01b4c92b34ed1aa888cc485d1c0e0 P 563a1c63813642e591d31cf7936f81d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:49.678016  3904 ts_tablet_manager.cc:1434] T fab01b4c92b34ed1aa888cc485d1c0e0 P 563a1c63813642e591d31cf7936f81d0: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:12:49.678725  3904 tablet_bootstrap.cc:492] T 28cf86f3998847ab92593600dbdb0d90 P 563a1c63813642e591d31cf7936f81d0: Bootstrap starting.
I20260709 13:12:49.693692  3904 tablet_bootstrap.cc:492] T 28cf86f3998847ab92593600dbdb0d90 P 563a1c63813642e591d31cf7936f81d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 13:12:49.694527  3904 tablet_bootstrap.cc:492] T 28cf86f3998847ab92593600dbdb0d90 P 563a1c63813642e591d31cf7936f81d0: Bootstrap complete.
I20260709 13:12:49.695147  3904 ts_tablet_manager.cc:1403] T 28cf86f3998847ab92593600dbdb0d90 P 563a1c63813642e591d31cf7936f81d0: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.007s
I20260709 13:12:49.697613  3904 raft_consensus.cc:359] T 28cf86f3998847ab92593600dbdb0d90 P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:49.698316  3904 raft_consensus.cc:740] T 28cf86f3998847ab92593600dbdb0d90 P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 563a1c63813642e591d31cf7936f81d0, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.698916  3904 consensus_queue.cc:260] T 28cf86f3998847ab92593600dbdb0d90 P 563a1c63813642e591d31cf7936f81d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:49.700819  3904 ts_tablet_manager.cc:1434] T 28cf86f3998847ab92593600dbdb0d90 P 563a1c63813642e591d31cf7936f81d0: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:12:49.701501  3904 tablet_bootstrap.cc:492] T 84ca4c013a24451388658395af3b8b78 P 563a1c63813642e591d31cf7936f81d0: Bootstrap starting.
I20260709 13:12:49.714607  3904 tablet_bootstrap.cc:492] T 84ca4c013a24451388658395af3b8b78 P 563a1c63813642e591d31cf7936f81d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:49.715533  3904 tablet_bootstrap.cc:492] T 84ca4c013a24451388658395af3b8b78 P 563a1c63813642e591d31cf7936f81d0: Bootstrap complete.
I20260709 13:12:49.716060  3904 ts_tablet_manager.cc:1403] T 84ca4c013a24451388658395af3b8b78 P 563a1c63813642e591d31cf7936f81d0: Time spent bootstrapping tablet: real 0.015s	user 0.010s	sys 0.004s
I20260709 13:12:49.717875  3904 raft_consensus.cc:359] T 84ca4c013a24451388658395af3b8b78 P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:49.718355  3904 raft_consensus.cc:740] T 84ca4c013a24451388658395af3b8b78 P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 563a1c63813642e591d31cf7936f81d0, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.718962  3904 consensus_queue.cc:260] T 84ca4c013a24451388658395af3b8b78 P 563a1c63813642e591d31cf7936f81d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:49.720374  3904 ts_tablet_manager.cc:1434] T 84ca4c013a24451388658395af3b8b78 P 563a1c63813642e591d31cf7936f81d0: Time spent starting tablet: real 0.004s	user 0.002s	sys 0.000s
I20260709 13:12:49.720988  3904 tablet_bootstrap.cc:492] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 563a1c63813642e591d31cf7936f81d0: Bootstrap starting.
I20260709 13:12:49.729264 28889 rpc_server.cc:307] RPC server started. Bound to: 127.28.54.65:42995
I20260709 13:12:49.729393  3966 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.54.65:42995 every 8 connection(s)
I20260709 13:12:49.731156  3904 tablet_bootstrap.cc:492] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 563a1c63813642e591d31cf7936f81d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:49.731781  3904 tablet_bootstrap.cc:492] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 563a1c63813642e591d31cf7936f81d0: Bootstrap complete.
I20260709 13:12:49.732251  3904 ts_tablet_manager.cc:1403] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 563a1c63813642e591d31cf7936f81d0: Time spent bootstrapping tablet: real 0.011s	user 0.005s	sys 0.004s
I20260709 13:12:49.734509 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:49.734745  3904 raft_consensus.cc:359] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:49.735549  3904 raft_consensus.cc:740] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 563a1c63813642e591d31cf7936f81d0, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.736456  3904 consensus_queue.cc:260] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 563a1c63813642e591d31cf7936f81d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:49.738691  3904 ts_tablet_manager.cc:1434] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 563a1c63813642e591d31cf7936f81d0: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 13:12:49.739621  3904 tablet_bootstrap.cc:492] T 3077a0a5b9944af39dde06a7e84b9df9 P 563a1c63813642e591d31cf7936f81d0: Bootstrap starting.
I20260709 13:12:49.757576  3904 tablet_bootstrap.cc:492] T 3077a0a5b9944af39dde06a7e84b9df9 P 563a1c63813642e591d31cf7936f81d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:49.758627  3904 tablet_bootstrap.cc:492] T 3077a0a5b9944af39dde06a7e84b9df9 P 563a1c63813642e591d31cf7936f81d0: Bootstrap complete.
I20260709 13:12:49.759153  3904 ts_tablet_manager.cc:1403] T 3077a0a5b9944af39dde06a7e84b9df9 P 563a1c63813642e591d31cf7936f81d0: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.004s
I20260709 13:12:49.761653  3904 raft_consensus.cc:359] T 3077a0a5b9944af39dde06a7e84b9df9 P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } } peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } }
I20260709 13:12:49.762355  3904 raft_consensus.cc:740] T 3077a0a5b9944af39dde06a7e84b9df9 P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 563a1c63813642e591d31cf7936f81d0, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.763063  3904 consensus_queue.cc:260] T 3077a0a5b9944af39dde06a7e84b9df9 P 563a1c63813642e591d31cf7936f81d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } } peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } }
I20260709 13:12:49.764889  3904 ts_tablet_manager.cc:1434] T 3077a0a5b9944af39dde06a7e84b9df9 P 563a1c63813642e591d31cf7936f81d0: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 13:12:49.765681  3904 tablet_bootstrap.cc:492] T ba2c5f7a7dd946bc843001bcb47a202a P 563a1c63813642e591d31cf7936f81d0: Bootstrap starting.
I20260709 13:12:49.771996  3669 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84ca4c013a24451388658395af3b8b78"
dest_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56"
mode: GRACEFUL
new_leader_uuid: "1e8299ce77aa4939877e6f90c5bd04aa"
 from {username='slave'} at 127.0.0.1:56424
I20260709 13:12:49.772723  3669 raft_consensus.cc:606] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 2 LEADER]: Received request to transfer leadership to TS 1e8299ce77aa4939877e6f90c5bd04aa
I20260709 13:12:49.773468  3968 heartbeater.cc:344] Connected to a master server at 127.28.54.126:45925
I20260709 13:12:49.773921  3968 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:49.774832  3968 heartbeater.cc:507] Master 127.28.54.126:45925 requested a full tablet report, sending...
I20260709 13:12:49.779099  3904 tablet_bootstrap.cc:492] T ba2c5f7a7dd946bc843001bcb47a202a P 563a1c63813642e591d31cf7936f81d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:49.780108  3904 tablet_bootstrap.cc:492] T ba2c5f7a7dd946bc843001bcb47a202a P 563a1c63813642e591d31cf7936f81d0: Bootstrap complete.
I20260709 13:12:49.780578  3490 ts_manager.cc:194] Re-registered known tserver with Master: 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995)
I20260709 13:12:49.780747  3904 ts_tablet_manager.cc:1403] T ba2c5f7a7dd946bc843001bcb47a202a P 563a1c63813642e591d31cf7936f81d0: Time spent bootstrapping tablet: real 0.015s	user 0.013s	sys 0.000s
I20260709 13:12:49.783263  3904 raft_consensus.cc:359] T ba2c5f7a7dd946bc843001bcb47a202a P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:49.783890  3904 raft_consensus.cc:740] T ba2c5f7a7dd946bc843001bcb47a202a P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 563a1c63813642e591d31cf7936f81d0, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.784547  3904 consensus_queue.cc:260] T ba2c5f7a7dd946bc843001bcb47a202a P 563a1c63813642e591d31cf7936f81d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:49.786372  3904 ts_tablet_manager.cc:1434] T ba2c5f7a7dd946bc843001bcb47a202a P 563a1c63813642e591d31cf7936f81d0: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 13:12:49.787159  3904 tablet_bootstrap.cc:492] T f06a4d3121be4a6fa29269fcb15b1e57 P 563a1c63813642e591d31cf7936f81d0: Bootstrap starting.
I20260709 13:12:49.789063  3743 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba2c5f7a7dd946bc843001bcb47a202a"
dest_uuid: "1e8299ce77aa4939877e6f90c5bd04aa"
mode: GRACEFUL
new_leader_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56"
 from {username='slave'} at 127.0.0.1:42912
I20260709 13:12:49.789732  3743 raft_consensus.cc:606] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 LEADER]: Received request to transfer leadership to TS 6dfa3a6e32584eddb9dd28eb4e71bd56
W20260709 13:12:49.791468  3540 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:12:49.792430  3490 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:47356
I20260709 13:12:49.792658  3743 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ea26aa43a7c147bea7311233d455f8d5"
dest_uuid: "1e8299ce77aa4939877e6f90c5bd04aa"
mode: GRACEFUL
new_leader_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56"
 from {username='slave'} at 127.0.0.1:42912
I20260709 13:12:49.793267  3743 raft_consensus.cc:606] T ea26aa43a7c147bea7311233d455f8d5 P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 LEADER]: Received request to transfer leadership to TS 6dfa3a6e32584eddb9dd28eb4e71bd56
I20260709 13:12:49.794334 28889 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:12:49.794965 28889 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:49.795745 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:49.796113  3968 heartbeater.cc:499] Master 127.28.54.126:45925 was elected leader, sending a full tablet report...
I20260709 13:12:49.798663  3904 tablet_bootstrap.cc:492] T f06a4d3121be4a6fa29269fcb15b1e57 P 563a1c63813642e591d31cf7936f81d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:49.799355  3904 tablet_bootstrap.cc:492] T f06a4d3121be4a6fa29269fcb15b1e57 P 563a1c63813642e591d31cf7936f81d0: Bootstrap complete.
I20260709 13:12:49.799914  3904 ts_tablet_manager.cc:1403] T f06a4d3121be4a6fa29269fcb15b1e57 P 563a1c63813642e591d31cf7936f81d0: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.004s
I20260709 13:12:49.802229  3904 raft_consensus.cc:359] T f06a4d3121be4a6fa29269fcb15b1e57 P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:49.802862  3904 raft_consensus.cc:740] T f06a4d3121be4a6fa29269fcb15b1e57 P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 563a1c63813642e591d31cf7936f81d0, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.803489  3904 consensus_queue.cc:260] T f06a4d3121be4a6fa29269fcb15b1e57 P 563a1c63813642e591d31cf7936f81d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:49.805505  3904 ts_tablet_manager.cc:1434] T f06a4d3121be4a6fa29269fcb15b1e57 P 563a1c63813642e591d31cf7936f81d0: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.000s
I20260709 13:12:49.806277  3904 tablet_bootstrap.cc:492] T ea26aa43a7c147bea7311233d455f8d5 P 563a1c63813642e591d31cf7936f81d0: Bootstrap starting.
I20260709 13:12:49.818065  3904 tablet_bootstrap.cc:492] T ea26aa43a7c147bea7311233d455f8d5 P 563a1c63813642e591d31cf7936f81d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:49.818694  3904 tablet_bootstrap.cc:492] T ea26aa43a7c147bea7311233d455f8d5 P 563a1c63813642e591d31cf7936f81d0: Bootstrap complete.
I20260709 13:12:49.819159  3904 ts_tablet_manager.cc:1403] T ea26aa43a7c147bea7311233d455f8d5 P 563a1c63813642e591d31cf7936f81d0: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 13:12:49.820818  3904 raft_consensus.cc:359] T ea26aa43a7c147bea7311233d455f8d5 P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:49.821237  3904 raft_consensus.cc:740] T ea26aa43a7c147bea7311233d455f8d5 P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 563a1c63813642e591d31cf7936f81d0, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.821838  3904 consensus_queue.cc:260] T ea26aa43a7c147bea7311233d455f8d5 P 563a1c63813642e591d31cf7936f81d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:49.823801  3904 ts_tablet_manager.cc:1434] T ea26aa43a7c147bea7311233d455f8d5 P 563a1c63813642e591d31cf7936f81d0: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:12:49.825095  3904 tablet_bootstrap.cc:492] T 04d72e5e1a07401996c45a94f44bd659 P 563a1c63813642e591d31cf7936f81d0: Bootstrap starting.
I20260709 13:12:49.836695  3904 tablet_bootstrap.cc:492] T 04d72e5e1a07401996c45a94f44bd659 P 563a1c63813642e591d31cf7936f81d0: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 13:12:49.837335  3904 tablet_bootstrap.cc:492] T 04d72e5e1a07401996c45a94f44bd659 P 563a1c63813642e591d31cf7936f81d0: Bootstrap complete.
I20260709 13:12:49.837836  3904 ts_tablet_manager.cc:1403] T 04d72e5e1a07401996c45a94f44bd659 P 563a1c63813642e591d31cf7936f81d0: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.003s
I20260709 13:12:49.839519  3904 raft_consensus.cc:359] T 04d72e5e1a07401996c45a94f44bd659 P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:49.839975  3904 raft_consensus.cc:740] T 04d72e5e1a07401996c45a94f44bd659 P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 563a1c63813642e591d31cf7936f81d0, State: Initialized, Role: FOLLOWER
I20260709 13:12:49.840529  3904 consensus_queue.cc:260] T 04d72e5e1a07401996c45a94f44bd659 P 563a1c63813642e591d31cf7936f81d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:49.841946  3904 ts_tablet_manager.cc:1434] T 04d72e5e1a07401996c45a94f44bd659 P 563a1c63813642e591d31cf7936f81d0: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:12:49.936161  3941 raft_consensus.cc:3060] T 84ca4c013a24451388658395af3b8b78 P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:50.096796  3905 raft_consensus.cc:993] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa: : Instructing follower 6dfa3a6e32584eddb9dd28eb4e71bd56 to start an election
I20260709 13:12:50.097289  3887 raft_consensus.cc:1081] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 LEADER]: Signalling peer 6dfa3a6e32584eddb9dd28eb4e71bd56 to start an election
I20260709 13:12:50.098615  3669 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba2c5f7a7dd946bc843001bcb47a202a"
dest_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56"
 from {username='slave'} at 127.0.0.1:37172
I20260709 13:12:50.099056  3669 raft_consensus.cc:493] T ba2c5f7a7dd946bc843001bcb47a202a P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:50.099329  3669 raft_consensus.cc:3060] T ba2c5f7a7dd946bc843001bcb47a202a P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:50.103683  3669 raft_consensus.cc:515] T ba2c5f7a7dd946bc843001bcb47a202a P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:50.105022  3669 leader_election.cc:290] T ba2c5f7a7dd946bc843001bcb47a202a P 6dfa3a6e32584eddb9dd28eb4e71bd56 [CANDIDATE]: Term 3 election: Requested vote from peers 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995), 1e8299ce77aa4939877e6f90c5bd04aa (127.28.54.67:33771)
I20260709 13:12:50.105803  3941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2c5f7a7dd946bc843001bcb47a202a" candidate_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "563a1c63813642e591d31cf7936f81d0"
I20260709 13:12:50.106491  3941 raft_consensus.cc:3060] T ba2c5f7a7dd946bc843001bcb47a202a P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Advancing to term 3
I20260709 13:12:50.106571  3743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2c5f7a7dd946bc843001bcb47a202a" candidate_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1e8299ce77aa4939877e6f90c5bd04aa"
I20260709 13:12:50.107157  3743 raft_consensus.cc:3055] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:50.107465  3743 raft_consensus.cc:740] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1e8299ce77aa4939877e6f90c5bd04aa, State: Running, Role: LEADER
I20260709 13:12:50.108247  3743 consensus_queue.cc:260] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:50.109491  3743 raft_consensus.cc:3060] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:50.113420  3941 raft_consensus.cc:2468] T ba2c5f7a7dd946bc843001bcb47a202a P 563a1c63813642e591d31cf7936f81d0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dfa3a6e32584eddb9dd28eb4e71bd56 in term 3.
I20260709 13:12:50.114614  3632 leader_election.cc:304] T ba2c5f7a7dd946bc843001bcb47a202a P 6dfa3a6e32584eddb9dd28eb4e71bd56 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 563a1c63813642e591d31cf7936f81d0, 6dfa3a6e32584eddb9dd28eb4e71bd56; no voters: 
I20260709 13:12:50.115305  3885 raft_consensus.cc:2804] T ba2c5f7a7dd946bc843001bcb47a202a P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:50.115758  3743 raft_consensus.cc:2468] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dfa3a6e32584eddb9dd28eb4e71bd56 in term 3.
I20260709 13:12:50.116302  3885 raft_consensus.cc:697] T ba2c5f7a7dd946bc843001bcb47a202a P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 3 LEADER]: Becoming Leader. State: Replica: 6dfa3a6e32584eddb9dd28eb4e71bd56, State: Running, Role: LEADER
I20260709 13:12:50.117172  3885 consensus_queue.cc:237] T ba2c5f7a7dd946bc843001bcb47a202a P 6dfa3a6e32584eddb9dd28eb4e71bd56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:50.123777  3490 catalog_manager.cc:5697] T ba2c5f7a7dd946bc843001bcb47a202a P 6dfa3a6e32584eddb9dd28eb4e71bd56 reported cstate change: term changed from 2 to 3, leader changed from 1e8299ce77aa4939877e6f90c5bd04aa (127.28.54.67) to 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66). New cstate: current_term: 3 leader_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:50.142357  3905 raft_consensus.cc:993] T ea26aa43a7c147bea7311233d455f8d5 P 1e8299ce77aa4939877e6f90c5bd04aa: : Instructing follower 6dfa3a6e32584eddb9dd28eb4e71bd56 to start an election
I20260709 13:12:50.142814  3887 raft_consensus.cc:1081] T ea26aa43a7c147bea7311233d455f8d5 P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 LEADER]: Signalling peer 6dfa3a6e32584eddb9dd28eb4e71bd56 to start an election
I20260709 13:12:50.143975  3669 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ea26aa43a7c147bea7311233d455f8d5"
dest_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56"
 from {username='slave'} at 127.0.0.1:37172
I20260709 13:12:50.144367  3669 raft_consensus.cc:493] T ea26aa43a7c147bea7311233d455f8d5 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:50.144611  3669 raft_consensus.cc:3060] T ea26aa43a7c147bea7311233d455f8d5 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:50.150451  3669 raft_consensus.cc:515] T ea26aa43a7c147bea7311233d455f8d5 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:50.152077  3941 raft_consensus.cc:3060] T 28cf86f3998847ab92593600dbdb0d90 P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:50.152078  3669 leader_election.cc:290] T ea26aa43a7c147bea7311233d455f8d5 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [CANDIDATE]: Term 2 election: Requested vote from peers 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995), 1e8299ce77aa4939877e6f90c5bd04aa (127.28.54.67:33771)
I20260709 13:12:50.152797  3940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea26aa43a7c147bea7311233d455f8d5" candidate_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "563a1c63813642e591d31cf7936f81d0"
I20260709 13:12:50.153093  3743 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ea26aa43a7c147bea7311233d455f8d5" candidate_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e8299ce77aa4939877e6f90c5bd04aa"
I20260709 13:12:50.153439  3940 raft_consensus.cc:3060] T ea26aa43a7c147bea7311233d455f8d5 P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:50.153620  3743 raft_consensus.cc:3055] T ea26aa43a7c147bea7311233d455f8d5 P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:50.153986  3743 raft_consensus.cc:740] T ea26aa43a7c147bea7311233d455f8d5 P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e8299ce77aa4939877e6f90c5bd04aa, State: Running, Role: LEADER
I20260709 13:12:50.154851  3743 consensus_queue.cc:260] T ea26aa43a7c147bea7311233d455f8d5 P 1e8299ce77aa4939877e6f90c5bd04aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:50.155932  3743 raft_consensus.cc:3060] T ea26aa43a7c147bea7311233d455f8d5 P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:50.157433  3941 pending_rounds.cc:85] T 28cf86f3998847ab92593600dbdb0d90 P 563a1c63813642e591d31cf7936f81d0: Aborting all ops after (but not including) 0
I20260709 13:12:50.157698  3941 pending_rounds.cc:107] T 28cf86f3998847ab92593600dbdb0d90 P 563a1c63813642e591d31cf7936f81d0: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 13:12:50.157970  3941 raft_consensus.cc:2889] T 28cf86f3998847ab92593600dbdb0d90 P 563a1c63813642e591d31cf7936f81d0 [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 13:12:50.161010  3940 raft_consensus.cc:2468] T ea26aa43a7c147bea7311233d455f8d5 P 563a1c63813642e591d31cf7936f81d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dfa3a6e32584eddb9dd28eb4e71bd56 in term 2.
I20260709 13:12:50.162068  3632 leader_election.cc:304] T ea26aa43a7c147bea7311233d455f8d5 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 563a1c63813642e591d31cf7936f81d0, 6dfa3a6e32584eddb9dd28eb4e71bd56; no voters: 
I20260709 13:12:50.162649  3885 raft_consensus.cc:2804] T ea26aa43a7c147bea7311233d455f8d5 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:50.163000  3743 raft_consensus.cc:2468] T ea26aa43a7c147bea7311233d455f8d5 P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dfa3a6e32584eddb9dd28eb4e71bd56 in term 2.
I20260709 13:12:50.163010  3885 raft_consensus.cc:697] T ea26aa43a7c147bea7311233d455f8d5 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 2 LEADER]: Becoming Leader. State: Replica: 6dfa3a6e32584eddb9dd28eb4e71bd56, State: Running, Role: LEADER
I20260709 13:12:50.164453  3885 consensus_queue.cc:237] T ea26aa43a7c147bea7311233d455f8d5 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:50.172008  3490 catalog_manager.cc:5697] T ea26aa43a7c147bea7311233d455f8d5 P 6dfa3a6e32584eddb9dd28eb4e71bd56 reported cstate change: term changed from 1 to 2, leader changed from 1e8299ce77aa4939877e6f90c5bd04aa (127.28.54.67) to 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66). New cstate: current_term: 2 leader_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:50.187152  3984 raft_consensus.cc:993] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56: : Instructing follower 1e8299ce77aa4939877e6f90c5bd04aa to start an election
I20260709 13:12:50.187536  3885 raft_consensus.cc:1081] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 2 LEADER]: Signalling peer 1e8299ce77aa4939877e6f90c5bd04aa to start an election
I20260709 13:12:50.188797  3743 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84ca4c013a24451388658395af3b8b78"
dest_uuid: "1e8299ce77aa4939877e6f90c5bd04aa"
 from {username='slave'} at 127.0.0.1:54452
I20260709 13:12:50.189239  3743 raft_consensus.cc:493] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:50.189503  3743 raft_consensus.cc:3060] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:50.194366  3743 raft_consensus.cc:515] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:50.195786  3743 leader_election.cc:290] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa [CANDIDATE]: Term 3 election: Requested vote from peers 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995), 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66:39331)
I20260709 13:12:50.196549  3940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ca4c013a24451388658395af3b8b78" candidate_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "563a1c63813642e591d31cf7936f81d0"
I20260709 13:12:50.196746  3669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ca4c013a24451388658395af3b8b78" candidate_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56"
I20260709 13:12:50.197192  3940 raft_consensus.cc:3060] T 84ca4c013a24451388658395af3b8b78 P 563a1c63813642e591d31cf7936f81d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:50.197242  3669 raft_consensus.cc:3055] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:50.197654  3669 raft_consensus.cc:740] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 6dfa3a6e32584eddb9dd28eb4e71bd56, State: Running, Role: LEADER
I20260709 13:12:50.198371  3669 consensus_queue.cc:260] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:50.199467  3669 raft_consensus.cc:3060] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:50.203796  3940 raft_consensus.cc:2468] T 84ca4c013a24451388658395af3b8b78 P 563a1c63813642e591d31cf7936f81d0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e8299ce77aa4939877e6f90c5bd04aa in term 3.
I20260709 13:12:50.204855  3706 leader_election.cc:304] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e8299ce77aa4939877e6f90c5bd04aa, 563a1c63813642e591d31cf7936f81d0; no voters: 
I20260709 13:12:50.205271  3669 raft_consensus.cc:2468] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e8299ce77aa4939877e6f90c5bd04aa in term 3.
I20260709 13:12:50.205503  3887 raft_consensus.cc:2804] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:50.206084  3887 raft_consensus.cc:697] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa [term 3 LEADER]: Becoming Leader. State: Replica: 1e8299ce77aa4939877e6f90c5bd04aa, State: Running, Role: LEADER
I20260709 13:12:50.206849  3887 consensus_queue.cc:237] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:50.215140  3490 catalog_manager.cc:5697] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa reported cstate change: term changed from 2 to 3, leader changed from 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66) to 1e8299ce77aa4939877e6f90c5bd04aa (127.28.54.67). New cstate: current_term: 3 leader_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:50.549814  3940 raft_consensus.cc:1275] T ba2c5f7a7dd946bc843001bcb47a202a P 563a1c63813642e591d31cf7936f81d0 [term 3 FOLLOWER]: Refusing update from remote peer 6dfa3a6e32584eddb9dd28eb4e71bd56: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:50.551122  3998 consensus_queue.cc:1048] T ba2c5f7a7dd946bc843001bcb47a202a P 6dfa3a6e32584eddb9dd28eb4e71bd56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:50.560034  3743 raft_consensus.cc:1275] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa [term 3 FOLLOWER]: Refusing update from remote peer 6dfa3a6e32584eddb9dd28eb4e71bd56: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:50.561318  3998 consensus_queue.cc:1048] T ba2c5f7a7dd946bc843001bcb47a202a P 6dfa3a6e32584eddb9dd28eb4e71bd56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:50.595925  3940 raft_consensus.cc:1275] T ea26aa43a7c147bea7311233d455f8d5 P 563a1c63813642e591d31cf7936f81d0 [term 2 FOLLOWER]: Refusing update from remote peer 6dfa3a6e32584eddb9dd28eb4e71bd56: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:50.596975  3998 consensus_queue.cc:1048] T ea26aa43a7c147bea7311233d455f8d5 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:50.607172  3743 raft_consensus.cc:1275] T ea26aa43a7c147bea7311233d455f8d5 P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 FOLLOWER]: Refusing update from remote peer 6dfa3a6e32584eddb9dd28eb4e71bd56: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:50.608705  3885 consensus_queue.cc:1048] T ea26aa43a7c147bea7311233d455f8d5 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:50.610276  3669 raft_consensus.cc:1275] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 3 FOLLOWER]: Refusing update from remote peer 1e8299ce77aa4939877e6f90c5bd04aa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:50.611548  3887 consensus_queue.cc:1048] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:50.624143  3940 raft_consensus.cc:1275] T 84ca4c013a24451388658395af3b8b78 P 563a1c63813642e591d31cf7936f81d0 [term 3 FOLLOWER]: Refusing update from remote peer 1e8299ce77aa4939877e6f90c5bd04aa: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:50.625976  3994 consensus_queue.cc:1048] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:12:50.792411  3540 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:12:50.804019 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:50.812531  3669 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f5afe6645d14571bf8ff8a0ba86afb3"
dest_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56"
mode: GRACEFUL
new_leader_uuid: "1e8299ce77aa4939877e6f90c5bd04aa"
 from {username='slave'} at 127.0.0.1:56424
I20260709 13:12:50.812988  3669 raft_consensus.cc:606] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 1 LEADER]: Received request to transfer leadership to TS 1e8299ce77aa4939877e6f90c5bd04aa
I20260709 13:12:50.815259  3743 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28cf86f3998847ab92593600dbdb0d90"
dest_uuid: "1e8299ce77aa4939877e6f90c5bd04aa"
mode: GRACEFUL
new_leader_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56"
 from {username='slave'} at 127.0.0.1:42912
I20260709 13:12:50.815686  3743 raft_consensus.cc:606] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 LEADER]: Received request to transfer leadership to TS 6dfa3a6e32584eddb9dd28eb4e71bd56
I20260709 13:12:50.817808  3669 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fab01b4c92b34ed1aa888cc485d1c0e0"
dest_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56"
mode: GRACEFUL
new_leader_uuid: "1e8299ce77aa4939877e6f90c5bd04aa"
 from {username='slave'} at 127.0.0.1:56424
I20260709 13:12:50.818176  3669 raft_consensus.cc:606] T fab01b4c92b34ed1aa888cc485d1c0e0 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 1 LEADER]: Received request to transfer leadership to TS 1e8299ce77aa4939877e6f90c5bd04aa
I20260709 13:12:50.819093 28889 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:12:50.819552 28889 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:50.820070 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:50.900602  3984 raft_consensus.cc:993] T fab01b4c92b34ed1aa888cc485d1c0e0 P 6dfa3a6e32584eddb9dd28eb4e71bd56: : Instructing follower 1e8299ce77aa4939877e6f90c5bd04aa to start an election
I20260709 13:12:50.901175  3885 raft_consensus.cc:1081] T fab01b4c92b34ed1aa888cc485d1c0e0 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 1 LEADER]: Signalling peer 1e8299ce77aa4939877e6f90c5bd04aa to start an election
I20260709 13:12:50.902734  3743 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fab01b4c92b34ed1aa888cc485d1c0e0"
dest_uuid: "1e8299ce77aa4939877e6f90c5bd04aa"
 from {username='slave'} at 127.0.0.1:54452
I20260709 13:12:50.903254  3743 raft_consensus.cc:493] T fab01b4c92b34ed1aa888cc485d1c0e0 P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:50.903542  3743 raft_consensus.cc:3060] T fab01b4c92b34ed1aa888cc485d1c0e0 P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:50.908655  3743 raft_consensus.cc:515] T fab01b4c92b34ed1aa888cc485d1c0e0 P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:50.910318  3743 leader_election.cc:290] T fab01b4c92b34ed1aa888cc485d1c0e0 P 1e8299ce77aa4939877e6f90c5bd04aa [CANDIDATE]: Term 2 election: Requested vote from peers 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995), 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66:39331)
I20260709 13:12:50.910904  3940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab01b4c92b34ed1aa888cc485d1c0e0" candidate_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "563a1c63813642e591d31cf7936f81d0"
I20260709 13:12:50.911409  3669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fab01b4c92b34ed1aa888cc485d1c0e0" candidate_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56"
I20260709 13:12:50.911523  3940 raft_consensus.cc:3060] T fab01b4c92b34ed1aa888cc485d1c0e0 P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:50.911895  3669 raft_consensus.cc:3055] T fab01b4c92b34ed1aa888cc485d1c0e0 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:50.912145  3669 raft_consensus.cc:740] T fab01b4c92b34ed1aa888cc485d1c0e0 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6dfa3a6e32584eddb9dd28eb4e71bd56, State: Running, Role: LEADER
I20260709 13:12:50.912796  3669 consensus_queue.cc:260] T fab01b4c92b34ed1aa888cc485d1c0e0 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:50.913880  3669 raft_consensus.cc:3060] T fab01b4c92b34ed1aa888cc485d1c0e0 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:50.916905  3940 raft_consensus.cc:2468] T fab01b4c92b34ed1aa888cc485d1c0e0 P 563a1c63813642e591d31cf7936f81d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e8299ce77aa4939877e6f90c5bd04aa in term 2.
I20260709 13:12:50.917802  3706 leader_election.cc:304] T fab01b4c92b34ed1aa888cc485d1c0e0 P 1e8299ce77aa4939877e6f90c5bd04aa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e8299ce77aa4939877e6f90c5bd04aa, 563a1c63813642e591d31cf7936f81d0; no voters: 
I20260709 13:12:50.917999  3669 raft_consensus.cc:2468] T fab01b4c92b34ed1aa888cc485d1c0e0 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e8299ce77aa4939877e6f90c5bd04aa in term 2.
I20260709 13:12:50.918399  3994 raft_consensus.cc:2804] T fab01b4c92b34ed1aa888cc485d1c0e0 P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:50.918860  3994 raft_consensus.cc:697] T fab01b4c92b34ed1aa888cc485d1c0e0 P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 LEADER]: Becoming Leader. State: Replica: 1e8299ce77aa4939877e6f90c5bd04aa, State: Running, Role: LEADER
I20260709 13:12:50.919745  3994 consensus_queue.cc:237] T fab01b4c92b34ed1aa888cc485d1c0e0 P 1e8299ce77aa4939877e6f90c5bd04aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:50.926362  3492 catalog_manager.cc:5697] T fab01b4c92b34ed1aa888cc485d1c0e0 P 1e8299ce77aa4939877e6f90c5bd04aa reported cstate change: term changed from 1 to 2, leader changed from 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66) to 1e8299ce77aa4939877e6f90c5bd04aa (127.28.54.67). New cstate: current_term: 2 leader_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:51.008422  3984 raft_consensus.cc:993] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 6dfa3a6e32584eddb9dd28eb4e71bd56: : Instructing follower 1e8299ce77aa4939877e6f90c5bd04aa to start an election
I20260709 13:12:51.008813  3885 raft_consensus.cc:1081] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 1 LEADER]: Signalling peer 1e8299ce77aa4939877e6f90c5bd04aa to start an election
I20260709 13:12:51.010068  3743 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f5afe6645d14571bf8ff8a0ba86afb3"
dest_uuid: "1e8299ce77aa4939877e6f90c5bd04aa"
 from {username='slave'} at 127.0.0.1:54452
I20260709 13:12:51.010433  3743 raft_consensus.cc:493] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:51.010643  3743 raft_consensus.cc:3060] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:51.015619  3743 raft_consensus.cc:515] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:51.017412  3743 leader_election.cc:290] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 1e8299ce77aa4939877e6f90c5bd04aa [CANDIDATE]: Term 2 election: Requested vote from peers 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995), 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66:39331)
I20260709 13:12:51.018615  3940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f5afe6645d14571bf8ff8a0ba86afb3" candidate_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "563a1c63813642e591d31cf7936f81d0"
I20260709 13:12:51.019199  3940 raft_consensus.cc:3060] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:51.019301  3669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f5afe6645d14571bf8ff8a0ba86afb3" candidate_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56"
I20260709 13:12:51.019941  3669 raft_consensus.cc:3055] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:51.020226  3669 raft_consensus.cc:740] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6dfa3a6e32584eddb9dd28eb4e71bd56, State: Running, Role: LEADER
I20260709 13:12:51.020985  3669 consensus_queue.cc:260] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:51.021873  3669 raft_consensus.cc:3060] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:51.024421  3940 raft_consensus.cc:2468] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 563a1c63813642e591d31cf7936f81d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e8299ce77aa4939877e6f90c5bd04aa in term 2.
I20260709 13:12:51.025328  3706 leader_election.cc:304] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 1e8299ce77aa4939877e6f90c5bd04aa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e8299ce77aa4939877e6f90c5bd04aa, 563a1c63813642e591d31cf7936f81d0; no voters: 
I20260709 13:12:51.025942  3994 raft_consensus.cc:2804] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:51.026049  3669 raft_consensus.cc:2468] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e8299ce77aa4939877e6f90c5bd04aa in term 2.
I20260709 13:12:51.026332  3994 raft_consensus.cc:697] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 LEADER]: Becoming Leader. State: Replica: 1e8299ce77aa4939877e6f90c5bd04aa, State: Running, Role: LEADER
I20260709 13:12:51.027163  3994 consensus_queue.cc:237] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 1e8299ce77aa4939877e6f90c5bd04aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:51.033169  3492 catalog_manager.cc:5697] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 1e8299ce77aa4939877e6f90c5bd04aa reported cstate change: term changed from 1 to 2, leader changed from 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66) to 1e8299ce77aa4939877e6f90c5bd04aa (127.28.54.67). New cstate: current_term: 2 leader_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:51.185444  3887 raft_consensus.cc:993] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa: : Instructing follower 6dfa3a6e32584eddb9dd28eb4e71bd56 to start an election
I20260709 13:12:51.185889  3994 raft_consensus.cc:1081] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 LEADER]: Signalling peer 6dfa3a6e32584eddb9dd28eb4e71bd56 to start an election
I20260709 13:12:51.187014  3669 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "28cf86f3998847ab92593600dbdb0d90"
dest_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56"
 from {username='slave'} at 127.0.0.1:37172
I20260709 13:12:51.187450  3669 raft_consensus.cc:493] T 28cf86f3998847ab92593600dbdb0d90 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:51.187677  3669 raft_consensus.cc:3060] T 28cf86f3998847ab92593600dbdb0d90 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:51.191900  3669 raft_consensus.cc:515] T 28cf86f3998847ab92593600dbdb0d90 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:51.193210  3669 leader_election.cc:290] T 28cf86f3998847ab92593600dbdb0d90 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [CANDIDATE]: Term 3 election: Requested vote from peers 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995), 1e8299ce77aa4939877e6f90c5bd04aa (127.28.54.67:33771)
I20260709 13:12:51.194000  3940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28cf86f3998847ab92593600dbdb0d90" candidate_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "563a1c63813642e591d31cf7936f81d0"
I20260709 13:12:51.194257  3742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28cf86f3998847ab92593600dbdb0d90" candidate_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "1e8299ce77aa4939877e6f90c5bd04aa"
I20260709 13:12:51.194535  3940 raft_consensus.cc:3060] T 28cf86f3998847ab92593600dbdb0d90 P 563a1c63813642e591d31cf7936f81d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:51.194819  3742 raft_consensus.cc:3055] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:51.195104  3742 raft_consensus.cc:740] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1e8299ce77aa4939877e6f90c5bd04aa, State: Running, Role: LEADER
I20260709 13:12:51.195741  3742 consensus_queue.cc:260] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:51.196640  3742 raft_consensus.cc:3060] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:51.199258  3940 raft_consensus.cc:2468] T 28cf86f3998847ab92593600dbdb0d90 P 563a1c63813642e591d31cf7936f81d0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dfa3a6e32584eddb9dd28eb4e71bd56 in term 3.
I20260709 13:12:51.200230  3632 leader_election.cc:304] T 28cf86f3998847ab92593600dbdb0d90 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 563a1c63813642e591d31cf7936f81d0, 6dfa3a6e32584eddb9dd28eb4e71bd56; no voters: 
I20260709 13:12:51.200779  3998 raft_consensus.cc:2804] T 28cf86f3998847ab92593600dbdb0d90 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:51.201128  3998 raft_consensus.cc:697] T 28cf86f3998847ab92593600dbdb0d90 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 3 LEADER]: Becoming Leader. State: Replica: 6dfa3a6e32584eddb9dd28eb4e71bd56, State: Running, Role: LEADER
I20260709 13:12:51.201967  3742 raft_consensus.cc:2468] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dfa3a6e32584eddb9dd28eb4e71bd56 in term 3.
I20260709 13:12:51.201962  3998 consensus_queue.cc:237] T 28cf86f3998847ab92593600dbdb0d90 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:51.208395  3492 catalog_manager.cc:5697] T 28cf86f3998847ab92593600dbdb0d90 P 6dfa3a6e32584eddb9dd28eb4e71bd56 reported cstate change: term changed from 2 to 3, leader changed from 1e8299ce77aa4939877e6f90c5bd04aa (127.28.54.67) to 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66). New cstate: current_term: 3 leader_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:51.330785  3669 raft_consensus.cc:1275] T fab01b4c92b34ed1aa888cc485d1c0e0 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 2 FOLLOWER]: Refusing update from remote peer 1e8299ce77aa4939877e6f90c5bd04aa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:51.331740  3994 consensus_queue.cc:1048] T fab01b4c92b34ed1aa888cc485d1c0e0 P 1e8299ce77aa4939877e6f90c5bd04aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:51.339751  3940 raft_consensus.cc:1275] T fab01b4c92b34ed1aa888cc485d1c0e0 P 563a1c63813642e591d31cf7936f81d0 [term 2 FOLLOWER]: Refusing update from remote peer 1e8299ce77aa4939877e6f90c5bd04aa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:51.341470  3994 consensus_queue.cc:1048] T fab01b4c92b34ed1aa888cc485d1c0e0 P 1e8299ce77aa4939877e6f90c5bd04aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:51.521723  3669 raft_consensus.cc:1275] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 2 FOLLOWER]: Refusing update from remote peer 1e8299ce77aa4939877e6f90c5bd04aa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:51.522889  3887 consensus_queue.cc:1048] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 1e8299ce77aa4939877e6f90c5bd04aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:51.530902  3940 raft_consensus.cc:1275] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 563a1c63813642e591d31cf7936f81d0 [term 2 FOLLOWER]: Refusing update from remote peer 1e8299ce77aa4939877e6f90c5bd04aa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:51.533592  4006 consensus_queue.cc:1048] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 1e8299ce77aa4939877e6f90c5bd04aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:51.677448  3742 raft_consensus.cc:1275] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa [term 3 FOLLOWER]: Refusing update from remote peer 6dfa3a6e32584eddb9dd28eb4e71bd56: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:51.678678  3998 consensus_queue.cc:1048] T 28cf86f3998847ab92593600dbdb0d90 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:51.686864  3940 raft_consensus.cc:1275] T 28cf86f3998847ab92593600dbdb0d90 P 563a1c63813642e591d31cf7936f81d0 [term 3 FOLLOWER]: Refusing update from remote peer 6dfa3a6e32584eddb9dd28eb4e71bd56: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 13:12:51.688405  4011 consensus_queue.cc:1048] T 28cf86f3998847ab92593600dbdb0d90 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:12:51.793290  3540 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:12:51.826242 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:51.833204  3742 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "04d72e5e1a07401996c45a94f44bd659"
dest_uuid: "1e8299ce77aa4939877e6f90c5bd04aa"
mode: GRACEFUL
new_leader_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56"
 from {username='slave'} at 127.0.0.1:42912
I20260709 13:12:51.833709  3742 raft_consensus.cc:606] T 04d72e5e1a07401996c45a94f44bd659 P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 LEADER]: Received request to transfer leadership to TS 6dfa3a6e32584eddb9dd28eb4e71bd56
I20260709 13:12:51.836054  3742 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0f5afe6645d14571bf8ff8a0ba86afb3"
dest_uuid: "1e8299ce77aa4939877e6f90c5bd04aa"
mode: GRACEFUL
new_leader_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56"
 from {username='slave'} at 127.0.0.1:42912
I20260709 13:12:51.836527  3742 raft_consensus.cc:606] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 LEADER]: Received request to transfer leadership to TS 6dfa3a6e32584eddb9dd28eb4e71bd56
I20260709 13:12:51.838815  3667 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "28cf86f3998847ab92593600dbdb0d90"
dest_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56"
mode: GRACEFUL
new_leader_uuid: "1e8299ce77aa4939877e6f90c5bd04aa"
 from {username='slave'} at 127.0.0.1:56424
I20260709 13:12:51.839234  3667 raft_consensus.cc:606] T 28cf86f3998847ab92593600dbdb0d90 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 3 LEADER]: Received request to transfer leadership to TS 1e8299ce77aa4939877e6f90c5bd04aa
I20260709 13:12:51.840154 28889 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:12:51.840598 28889 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:51.841118 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:52.090772  4023 raft_consensus.cc:993] T 28cf86f3998847ab92593600dbdb0d90 P 6dfa3a6e32584eddb9dd28eb4e71bd56: : Instructing follower 1e8299ce77aa4939877e6f90c5bd04aa to start an election
I20260709 13:12:52.091243  4011 raft_consensus.cc:1081] T 28cf86f3998847ab92593600dbdb0d90 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 3 LEADER]: Signalling peer 1e8299ce77aa4939877e6f90c5bd04aa to start an election
I20260709 13:12:52.092523  3742 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "28cf86f3998847ab92593600dbdb0d90"
dest_uuid: "1e8299ce77aa4939877e6f90c5bd04aa"
 from {username='slave'} at 127.0.0.1:54452
I20260709 13:12:52.093024  3742 raft_consensus.cc:493] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:52.093309  3742 raft_consensus.cc:3060] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:52.093506  4006 raft_consensus.cc:993] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 1e8299ce77aa4939877e6f90c5bd04aa: : Instructing follower 6dfa3a6e32584eddb9dd28eb4e71bd56 to start an election
I20260709 13:12:52.094015  3994 raft_consensus.cc:1081] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 LEADER]: Signalling peer 6dfa3a6e32584eddb9dd28eb4e71bd56 to start an election
I20260709 13:12:52.095280  3667 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0f5afe6645d14571bf8ff8a0ba86afb3"
dest_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56"
 from {username='slave'} at 127.0.0.1:37172
I20260709 13:12:52.095686  3667 raft_consensus.cc:493] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:52.095937  3667 raft_consensus.cc:3060] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:52.098798  3742 raft_consensus.cc:515] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:52.100514  3742 leader_election.cc:290] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa [CANDIDATE]: Term 4 election: Requested vote from peers 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995), 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66:39331)
I20260709 13:12:52.101140  3940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28cf86f3998847ab92593600dbdb0d90" candidate_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "563a1c63813642e591d31cf7936f81d0"
I20260709 13:12:52.100942  3667 raft_consensus.cc:515] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:52.101442  3669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "28cf86f3998847ab92593600dbdb0d90" candidate_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56"
I20260709 13:12:52.101789  3940 raft_consensus.cc:3060] T 28cf86f3998847ab92593600dbdb0d90 P 563a1c63813642e591d31cf7936f81d0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:52.102035  3669 raft_consensus.cc:3055] T 28cf86f3998847ab92593600dbdb0d90 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:52.102352  3669 raft_consensus.cc:740] T 28cf86f3998847ab92593600dbdb0d90 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6dfa3a6e32584eddb9dd28eb4e71bd56, State: Running, Role: LEADER
I20260709 13:12:52.102962  3669 consensus_queue.cc:260] T 28cf86f3998847ab92593600dbdb0d90 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:52.103040  3667 leader_election.cc:290] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [CANDIDATE]: Term 3 election: Requested vote from peers 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995), 1e8299ce77aa4939877e6f90c5bd04aa (127.28.54.67:33771)
I20260709 13:12:52.103740  3669 raft_consensus.cc:3060] T 28cf86f3998847ab92593600dbdb0d90 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:52.107048  3940 raft_consensus.cc:2468] T 28cf86f3998847ab92593600dbdb0d90 P 563a1c63813642e591d31cf7936f81d0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e8299ce77aa4939877e6f90c5bd04aa in term 4.
I20260709 13:12:52.108011  3941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f5afe6645d14571bf8ff8a0ba86afb3" candidate_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "563a1c63813642e591d31cf7936f81d0"
I20260709 13:12:52.108343  3669 raft_consensus.cc:2468] T 28cf86f3998847ab92593600dbdb0d90 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e8299ce77aa4939877e6f90c5bd04aa in term 4.
I20260709 13:12:52.108584  3941 raft_consensus.cc:3060] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 563a1c63813642e591d31cf7936f81d0 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:52.108623  3706 leader_election.cc:304] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e8299ce77aa4939877e6f90c5bd04aa, 563a1c63813642e591d31cf7936f81d0; no voters: 
I20260709 13:12:52.108861  3742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0f5afe6645d14571bf8ff8a0ba86afb3" candidate_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1e8299ce77aa4939877e6f90c5bd04aa"
I20260709 13:12:52.109447  3742 raft_consensus.cc:3055] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:52.109535  3994 raft_consensus.cc:2804] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:52.109848  3742 raft_consensus.cc:740] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1e8299ce77aa4939877e6f90c5bd04aa, State: Running, Role: LEADER
I20260709 13:12:52.110298  3994 raft_consensus.cc:697] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa [term 4 LEADER]: Becoming Leader. State: Replica: 1e8299ce77aa4939877e6f90c5bd04aa, State: Running, Role: LEADER
I20260709 13:12:52.110710  3742 consensus_queue.cc:260] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 1e8299ce77aa4939877e6f90c5bd04aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:52.111279  3994 consensus_queue.cc:237] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:52.111963  3742 raft_consensus.cc:3060] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:52.114208  3941 raft_consensus.cc:2468] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 563a1c63813642e591d31cf7936f81d0 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dfa3a6e32584eddb9dd28eb4e71bd56 in term 3.
I20260709 13:12:52.115286  3632 leader_election.cc:304] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 563a1c63813642e591d31cf7936f81d0, 6dfa3a6e32584eddb9dd28eb4e71bd56; no voters: 
I20260709 13:12:52.115854  4011 raft_consensus.cc:2804] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:52.116226  4011 raft_consensus.cc:697] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 3 LEADER]: Becoming Leader. State: Replica: 6dfa3a6e32584eddb9dd28eb4e71bd56, State: Running, Role: LEADER
I20260709 13:12:52.116896  4011 consensus_queue.cc:237] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:52.117985  3742 raft_consensus.cc:2468] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 1e8299ce77aa4939877e6f90c5bd04aa [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dfa3a6e32584eddb9dd28eb4e71bd56 in term 3.
I20260709 13:12:52.118705  3492 catalog_manager.cc:5697] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa reported cstate change: term changed from 3 to 4, leader changed from 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66) to 1e8299ce77aa4939877e6f90c5bd04aa (127.28.54.67). New cstate: current_term: 4 leader_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:52.122946  3490 catalog_manager.cc:5697] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 6dfa3a6e32584eddb9dd28eb4e71bd56 reported cstate change: term changed from 2 to 3, leader changed from 1e8299ce77aa4939877e6f90c5bd04aa (127.28.54.67) to 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66). New cstate: current_term: 3 leader_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:52.137477  4006 raft_consensus.cc:993] T 04d72e5e1a07401996c45a94f44bd659 P 1e8299ce77aa4939877e6f90c5bd04aa: : Instructing follower 6dfa3a6e32584eddb9dd28eb4e71bd56 to start an election
I20260709 13:12:52.137955  3994 raft_consensus.cc:1081] T 04d72e5e1a07401996c45a94f44bd659 P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 LEADER]: Signalling peer 6dfa3a6e32584eddb9dd28eb4e71bd56 to start an election
I20260709 13:12:52.139222  3669 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "04d72e5e1a07401996c45a94f44bd659"
dest_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56"
 from {username='slave'} at 127.0.0.1:37172
I20260709 13:12:52.139590  3669 raft_consensus.cc:493] T 04d72e5e1a07401996c45a94f44bd659 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:52.139801  3669 raft_consensus.cc:3060] T 04d72e5e1a07401996c45a94f44bd659 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:52.144476  3669 raft_consensus.cc:515] T 04d72e5e1a07401996c45a94f44bd659 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:52.145776  3669 leader_election.cc:290] T 04d72e5e1a07401996c45a94f44bd659 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [CANDIDATE]: Term 2 election: Requested vote from peers 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995), 1e8299ce77aa4939877e6f90c5bd04aa (127.28.54.67:33771)
I20260709 13:12:52.146494  3941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d72e5e1a07401996c45a94f44bd659" candidate_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "563a1c63813642e591d31cf7936f81d0"
I20260709 13:12:52.146632  3742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "04d72e5e1a07401996c45a94f44bd659" candidate_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e8299ce77aa4939877e6f90c5bd04aa"
I20260709 13:12:52.147166  3941 raft_consensus.cc:3060] T 04d72e5e1a07401996c45a94f44bd659 P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:52.147199  3742 raft_consensus.cc:3055] T 04d72e5e1a07401996c45a94f44bd659 P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:52.147707  3742 raft_consensus.cc:740] T 04d72e5e1a07401996c45a94f44bd659 P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e8299ce77aa4939877e6f90c5bd04aa, State: Running, Role: LEADER
I20260709 13:12:52.148574  3742 consensus_queue.cc:260] T 04d72e5e1a07401996c45a94f44bd659 P 1e8299ce77aa4939877e6f90c5bd04aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:52.149899  3742 raft_consensus.cc:3060] T 04d72e5e1a07401996c45a94f44bd659 P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:52.154132  3941 raft_consensus.cc:2468] T 04d72e5e1a07401996c45a94f44bd659 P 563a1c63813642e591d31cf7936f81d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dfa3a6e32584eddb9dd28eb4e71bd56 in term 2.
I20260709 13:12:52.155175  3632 leader_election.cc:304] T 04d72e5e1a07401996c45a94f44bd659 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 563a1c63813642e591d31cf7936f81d0, 6dfa3a6e32584eddb9dd28eb4e71bd56; no voters: 
I20260709 13:12:52.155771  4011 raft_consensus.cc:2804] T 04d72e5e1a07401996c45a94f44bd659 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:52.156243  4011 raft_consensus.cc:697] T 04d72e5e1a07401996c45a94f44bd659 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 2 LEADER]: Becoming Leader. State: Replica: 6dfa3a6e32584eddb9dd28eb4e71bd56, State: Running, Role: LEADER
I20260709 13:12:52.156333  3742 raft_consensus.cc:2468] T 04d72e5e1a07401996c45a94f44bd659 P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dfa3a6e32584eddb9dd28eb4e71bd56 in term 2.
I20260709 13:12:52.157068  4011 consensus_queue.cc:237] T 04d72e5e1a07401996c45a94f44bd659 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:52.163318  3490 catalog_manager.cc:5697] T 04d72e5e1a07401996c45a94f44bd659 P 6dfa3a6e32584eddb9dd28eb4e71bd56 reported cstate change: term changed from 1 to 2, leader changed from 1e8299ce77aa4939877e6f90c5bd04aa (127.28.54.67) to 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66). New cstate: current_term: 2 leader_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:52.544493  3941 raft_consensus.cc:1275] T 04d72e5e1a07401996c45a94f44bd659 P 563a1c63813642e591d31cf7936f81d0 [term 2 FOLLOWER]: Refusing update from remote peer 6dfa3a6e32584eddb9dd28eb4e71bd56: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:52.545588  4011 consensus_queue.cc:1048] T 04d72e5e1a07401996c45a94f44bd659 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:52.556581  3742 raft_consensus.cc:1275] T 04d72e5e1a07401996c45a94f44bd659 P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 FOLLOWER]: Refusing update from remote peer 6dfa3a6e32584eddb9dd28eb4e71bd56: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:52.557998  4032 consensus_queue.cc:1048] T 04d72e5e1a07401996c45a94f44bd659 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:52.568938  3742 raft_consensus.cc:1275] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 1e8299ce77aa4939877e6f90c5bd04aa [term 3 FOLLOWER]: Refusing update from remote peer 6dfa3a6e32584eddb9dd28eb4e71bd56: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:52.570005  4032 consensus_queue.cc:1048] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:52.577898  3941 raft_consensus.cc:1275] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 563a1c63813642e591d31cf7936f81d0 [term 3 FOLLOWER]: Refusing update from remote peer 6dfa3a6e32584eddb9dd28eb4e71bd56: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:12:52.579700  4011 consensus_queue.cc:1048] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:52.638875  3669 raft_consensus.cc:1275] T 28cf86f3998847ab92593600dbdb0d90 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 4 FOLLOWER]: Refusing update from remote peer 1e8299ce77aa4939877e6f90c5bd04aa: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:52.640012  3994 consensus_queue.cc:1048] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:12:52.647890  3941 raft_consensus.cc:1275] T 28cf86f3998847ab92593600dbdb0d90 P 563a1c63813642e591d31cf7936f81d0 [term 4 FOLLOWER]: Refusing update from remote peer 1e8299ce77aa4939877e6f90c5bd04aa: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 13:12:52.649593  4039 consensus_queue.cc:1048] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 13:12:52.794198  3540 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:12:52.847030 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:52.856918  3669 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3077a0a5b9944af39dde06a7e84b9df9"
dest_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56"
mode: GRACEFUL
new_leader_uuid: "1e8299ce77aa4939877e6f90c5bd04aa"
 from {username='slave'} at 127.0.0.1:56424
I20260709 13:12:52.857515  3669 raft_consensus.cc:606] T 3077a0a5b9944af39dde06a7e84b9df9 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 1 LEADER]: Received request to transfer leadership to TS 1e8299ce77aa4939877e6f90c5bd04aa
I20260709 13:12:52.860090  3742 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84ca4c013a24451388658395af3b8b78"
dest_uuid: "1e8299ce77aa4939877e6f90c5bd04aa"
mode: GRACEFUL
new_leader_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56"
 from {username='slave'} at 127.0.0.1:42912
I20260709 13:12:52.860584  3742 raft_consensus.cc:606] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa [term 3 LEADER]: Received request to transfer leadership to TS 6dfa3a6e32584eddb9dd28eb4e71bd56
I20260709 13:12:52.862900  3669 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba2c5f7a7dd946bc843001bcb47a202a"
dest_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56"
mode: GRACEFUL
new_leader_uuid: "1e8299ce77aa4939877e6f90c5bd04aa"
 from {username='slave'} at 127.0.0.1:56424
I20260709 13:12:52.863416  3669 raft_consensus.cc:606] T ba2c5f7a7dd946bc843001bcb47a202a P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 3 LEADER]: Received request to transfer leadership to TS 1e8299ce77aa4939877e6f90c5bd04aa
I20260709 13:12:52.864424 28889 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:12:52.864842 28889 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:52.865327 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:52.947820  4023 raft_consensus.cc:993] T ba2c5f7a7dd946bc843001bcb47a202a P 6dfa3a6e32584eddb9dd28eb4e71bd56: : Instructing follower 1e8299ce77aa4939877e6f90c5bd04aa to start an election
I20260709 13:12:52.948323  4011 raft_consensus.cc:1081] T ba2c5f7a7dd946bc843001bcb47a202a P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 3 LEADER]: Signalling peer 1e8299ce77aa4939877e6f90c5bd04aa to start an election
I20260709 13:12:52.949571  3742 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba2c5f7a7dd946bc843001bcb47a202a"
dest_uuid: "1e8299ce77aa4939877e6f90c5bd04aa"
 from {username='slave'} at 127.0.0.1:54452
I20260709 13:12:52.950076  3742 raft_consensus.cc:493] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:52.950335  3742 raft_consensus.cc:3060] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:52.955093  3742 raft_consensus.cc:515] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:52.956533  3742 leader_election.cc:290] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa [CANDIDATE]: Term 4 election: Requested vote from peers 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995), 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66:39331)
I20260709 13:12:52.957285  3941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2c5f7a7dd946bc843001bcb47a202a" candidate_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "563a1c63813642e591d31cf7936f81d0"
I20260709 13:12:52.957507  3669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba2c5f7a7dd946bc843001bcb47a202a" candidate_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56"
I20260709 13:12:52.957980  3941 raft_consensus.cc:3060] T ba2c5f7a7dd946bc843001bcb47a202a P 563a1c63813642e591d31cf7936f81d0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:52.958088  3669 raft_consensus.cc:3055] T ba2c5f7a7dd946bc843001bcb47a202a P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:52.958482  3669 raft_consensus.cc:740] T ba2c5f7a7dd946bc843001bcb47a202a P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 6dfa3a6e32584eddb9dd28eb4e71bd56, State: Running, Role: LEADER
I20260709 13:12:52.959205  3669 consensus_queue.cc:260] T ba2c5f7a7dd946bc843001bcb47a202a P 6dfa3a6e32584eddb9dd28eb4e71bd56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:52.960352  3669 raft_consensus.cc:3060] T ba2c5f7a7dd946bc843001bcb47a202a P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:52.964808  3941 raft_consensus.cc:2468] T ba2c5f7a7dd946bc843001bcb47a202a P 563a1c63813642e591d31cf7936f81d0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e8299ce77aa4939877e6f90c5bd04aa in term 4.
I20260709 13:12:52.966058  3706 leader_election.cc:304] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e8299ce77aa4939877e6f90c5bd04aa, 563a1c63813642e591d31cf7936f81d0; no voters: 
I20260709 13:12:52.966531  3669 raft_consensus.cc:2468] T ba2c5f7a7dd946bc843001bcb47a202a P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e8299ce77aa4939877e6f90c5bd04aa in term 4.
I20260709 13:12:52.966760  4039 raft_consensus.cc:2804] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:52.967259  4039 raft_consensus.cc:697] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa [term 4 LEADER]: Becoming Leader. State: Replica: 1e8299ce77aa4939877e6f90c5bd04aa, State: Running, Role: LEADER
I20260709 13:12:52.967917  4039 consensus_queue.cc:237] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:52.974638  3492 catalog_manager.cc:5697] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa reported cstate change: term changed from 3 to 4, leader changed from 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66) to 1e8299ce77aa4939877e6f90c5bd04aa (127.28.54.67). New cstate: current_term: 4 leader_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:53.191534  4038 raft_consensus.cc:993] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa: : Instructing follower 6dfa3a6e32584eddb9dd28eb4e71bd56 to start an election
I20260709 13:12:53.191962  4039 raft_consensus.cc:1081] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa [term 3 LEADER]: Signalling peer 6dfa3a6e32584eddb9dd28eb4e71bd56 to start an election
I20260709 13:12:53.193228  3669 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84ca4c013a24451388658395af3b8b78"
dest_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56"
 from {username='slave'} at 127.0.0.1:37172
I20260709 13:12:53.193606  3669 raft_consensus.cc:493] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:53.193854  3669 raft_consensus.cc:3060] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:53.198014  3669 raft_consensus.cc:515] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:53.199362  3669 leader_election.cc:290] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [CANDIDATE]: Term 4 election: Requested vote from peers 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995), 1e8299ce77aa4939877e6f90c5bd04aa (127.28.54.67:33771)
I20260709 13:12:53.200098  3941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ca4c013a24451388658395af3b8b78" candidate_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "563a1c63813642e591d31cf7936f81d0"
I20260709 13:12:53.200296  3742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ca4c013a24451388658395af3b8b78" candidate_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1e8299ce77aa4939877e6f90c5bd04aa"
I20260709 13:12:53.200670  3941 raft_consensus.cc:3060] T 84ca4c013a24451388658395af3b8b78 P 563a1c63813642e591d31cf7936f81d0 [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:53.200783  3742 raft_consensus.cc:3055] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa [term 3 LEADER]: Stepping down as leader of term 3
I20260709 13:12:53.201130  3742 raft_consensus.cc:740] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1e8299ce77aa4939877e6f90c5bd04aa, State: Running, Role: LEADER
I20260709 13:12:53.201713  3742 consensus_queue.cc:260] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:53.202593  3742 raft_consensus.cc:3060] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa [term 3 FOLLOWER]: Advancing to term 4
I20260709 13:12:53.205217  3941 raft_consensus.cc:2468] T 84ca4c013a24451388658395af3b8b78 P 563a1c63813642e591d31cf7936f81d0 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dfa3a6e32584eddb9dd28eb4e71bd56 in term 4.
I20260709 13:12:53.206097  3632 leader_election.cc:304] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 563a1c63813642e591d31cf7936f81d0, 6dfa3a6e32584eddb9dd28eb4e71bd56; no voters: 
I20260709 13:12:53.206676  4011 raft_consensus.cc:2804] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 13:12:53.207087  3742 raft_consensus.cc:2468] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dfa3a6e32584eddb9dd28eb4e71bd56 in term 4.
I20260709 13:12:53.207118  4011 raft_consensus.cc:697] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 4 LEADER]: Becoming Leader. State: Replica: 6dfa3a6e32584eddb9dd28eb4e71bd56, State: Running, Role: LEADER
I20260709 13:12:53.208112  4011 consensus_queue.cc:237] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:53.214043  3492 catalog_manager.cc:5697] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 reported cstate change: term changed from 3 to 4, leader changed from 1e8299ce77aa4939877e6f90c5bd04aa (127.28.54.67) to 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66). New cstate: current_term: 4 leader_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:53.321931  4023 raft_consensus.cc:993] T 3077a0a5b9944af39dde06a7e84b9df9 P 6dfa3a6e32584eddb9dd28eb4e71bd56: : Instructing follower 1e8299ce77aa4939877e6f90c5bd04aa to start an election
I20260709 13:12:53.322350  4011 raft_consensus.cc:1081] T 3077a0a5b9944af39dde06a7e84b9df9 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 1 LEADER]: Signalling peer 1e8299ce77aa4939877e6f90c5bd04aa to start an election
I20260709 13:12:53.323614  3742 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3077a0a5b9944af39dde06a7e84b9df9"
dest_uuid: "1e8299ce77aa4939877e6f90c5bd04aa"
 from {username='slave'} at 127.0.0.1:54452
I20260709 13:12:53.324033  3742 raft_consensus.cc:493] T 3077a0a5b9944af39dde06a7e84b9df9 P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:53.324278  3742 raft_consensus.cc:3060] T 3077a0a5b9944af39dde06a7e84b9df9 P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:53.328780  3742 raft_consensus.cc:515] T 3077a0a5b9944af39dde06a7e84b9df9 P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } } peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } }
I20260709 13:12:53.330148  3742 leader_election.cc:290] T 3077a0a5b9944af39dde06a7e84b9df9 P 1e8299ce77aa4939877e6f90c5bd04aa [CANDIDATE]: Term 2 election: Requested vote from peers 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995), 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66:39331)
I20260709 13:12:53.330895  3941 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3077a0a5b9944af39dde06a7e84b9df9" candidate_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "563a1c63813642e591d31cf7936f81d0"
I20260709 13:12:53.331000  3669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3077a0a5b9944af39dde06a7e84b9df9" candidate_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56"
I20260709 13:12:53.331453  3941 raft_consensus.cc:3060] T 3077a0a5b9944af39dde06a7e84b9df9 P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:53.331542  3669 raft_consensus.cc:3055] T 3077a0a5b9944af39dde06a7e84b9df9 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:53.331892  3669 raft_consensus.cc:740] T 3077a0a5b9944af39dde06a7e84b9df9 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6dfa3a6e32584eddb9dd28eb4e71bd56, State: Running, Role: LEADER
I20260709 13:12:53.332525  3669 consensus_queue.cc:260] T 3077a0a5b9944af39dde06a7e84b9df9 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } } peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } }
I20260709 13:12:53.333369  3669 raft_consensus.cc:3060] T 3077a0a5b9944af39dde06a7e84b9df9 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:53.336478  3941 raft_consensus.cc:2468] T 3077a0a5b9944af39dde06a7e84b9df9 P 563a1c63813642e591d31cf7936f81d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e8299ce77aa4939877e6f90c5bd04aa in term 2.
I20260709 13:12:53.337536  3706 leader_election.cc:304] T 3077a0a5b9944af39dde06a7e84b9df9 P 1e8299ce77aa4939877e6f90c5bd04aa [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e8299ce77aa4939877e6f90c5bd04aa, 563a1c63813642e591d31cf7936f81d0; no voters: 
I20260709 13:12:53.338145  4039 raft_consensus.cc:2804] T 3077a0a5b9944af39dde06a7e84b9df9 P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:53.338193  3669 raft_consensus.cc:2468] T 3077a0a5b9944af39dde06a7e84b9df9 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e8299ce77aa4939877e6f90c5bd04aa in term 2.
I20260709 13:12:53.338655  4039 raft_consensus.cc:697] T 3077a0a5b9944af39dde06a7e84b9df9 P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 LEADER]: Becoming Leader. State: Replica: 1e8299ce77aa4939877e6f90c5bd04aa, State: Running, Role: LEADER
I20260709 13:12:53.339550  4039 consensus_queue.cc:237] T 3077a0a5b9944af39dde06a7e84b9df9 P 1e8299ce77aa4939877e6f90c5bd04aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } } peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } }
I20260709 13:12:53.345552  3492 catalog_manager.cc:5697] T 3077a0a5b9944af39dde06a7e84b9df9 P 1e8299ce77aa4939877e6f90c5bd04aa reported cstate change: term changed from 1 to 2, leader changed from 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66) to 1e8299ce77aa4939877e6f90c5bd04aa (127.28.54.67). New cstate: current_term: 2 leader_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:53.357662  3669 raft_consensus.cc:1275] T ba2c5f7a7dd946bc843001bcb47a202a P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 4 FOLLOWER]: Refusing update from remote peer 1e8299ce77aa4939877e6f90c5bd04aa: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:53.358759  4039 consensus_queue.cc:1048] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:53.367146  3941 raft_consensus.cc:1275] T ba2c5f7a7dd946bc843001bcb47a202a P 563a1c63813642e591d31cf7936f81d0 [term 4 FOLLOWER]: Refusing update from remote peer 1e8299ce77aa4939877e6f90c5bd04aa: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:53.368573  4038 consensus_queue.cc:1048] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:53.599643  3941 raft_consensus.cc:1275] T 84ca4c013a24451388658395af3b8b78 P 563a1c63813642e591d31cf7936f81d0 [term 4 FOLLOWER]: Refusing update from remote peer 6dfa3a6e32584eddb9dd28eb4e71bd56: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:53.600754  4011 consensus_queue.cc:1048] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:12:53.608428  3742 raft_consensus.cc:1275] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa [term 4 FOLLOWER]: Refusing update from remote peer 6dfa3a6e32584eddb9dd28eb4e71bd56: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 13:12:53.609854  4023 consensus_queue.cc:1048] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260709 13:12:53.795069  3540 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:12:53.871299 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:53.874908  3941 raft_consensus.cc:1275] T 3077a0a5b9944af39dde06a7e84b9df9 P 563a1c63813642e591d31cf7936f81d0 [term 2 FOLLOWER]: Refusing update from remote peer 1e8299ce77aa4939877e6f90c5bd04aa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:53.876158  4038 consensus_queue.cc:1048] T 3077a0a5b9944af39dde06a7e84b9df9 P 1e8299ce77aa4939877e6f90c5bd04aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:53.879446  3669 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "84ca4c013a24451388658395af3b8b78"
dest_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56"
mode: GRACEFUL
new_leader_uuid: "1e8299ce77aa4939877e6f90c5bd04aa"
 from {username='slave'} at 127.0.0.1:56424
I20260709 13:12:53.879874  3669 raft_consensus.cc:606] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 4 LEADER]: Received request to transfer leadership to TS 1e8299ce77aa4939877e6f90c5bd04aa
I20260709 13:12:53.882306  3742 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92acdf60735749beb2a12618aff17cfd"
dest_uuid: "1e8299ce77aa4939877e6f90c5bd04aa"
mode: GRACEFUL
new_leader_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56"
 from {username='slave'} at 127.0.0.1:42912
I20260709 13:12:53.883104  3742 raft_consensus.cc:606] T 92acdf60735749beb2a12618aff17cfd P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 LEADER]: Received request to transfer leadership to TS 6dfa3a6e32584eddb9dd28eb4e71bd56
I20260709 13:12:53.885144  3669 raft_consensus.cc:1275] T 3077a0a5b9944af39dde06a7e84b9df9 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 2 FOLLOWER]: Refusing update from remote peer 1e8299ce77aa4939877e6f90c5bd04aa: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:53.886154  3742 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f06a4d3121be4a6fa29269fcb15b1e57"
dest_uuid: "1e8299ce77aa4939877e6f90c5bd04aa"
mode: GRACEFUL
new_leader_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56"
 from {username='slave'} at 127.0.0.1:42912
I20260709 13:12:53.886698  3742 raft_consensus.cc:606] T f06a4d3121be4a6fa29269fcb15b1e57 P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 LEADER]: Received request to transfer leadership to TS 6dfa3a6e32584eddb9dd28eb4e71bd56
I20260709 13:12:53.886682  4038 consensus_queue.cc:1048] T 3077a0a5b9944af39dde06a7e84b9df9 P 1e8299ce77aa4939877e6f90c5bd04aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:53.889220 28889 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 13:12:53.889967 28889 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:12:53.890609 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:54.021195  4056 raft_consensus.cc:993] T f06a4d3121be4a6fa29269fcb15b1e57 P 1e8299ce77aa4939877e6f90c5bd04aa: : Instructing follower 6dfa3a6e32584eddb9dd28eb4e71bd56 to start an election
I20260709 13:12:54.021641  4038 raft_consensus.cc:1081] T f06a4d3121be4a6fa29269fcb15b1e57 P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 LEADER]: Signalling peer 6dfa3a6e32584eddb9dd28eb4e71bd56 to start an election
I20260709 13:12:54.022948  3669 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f06a4d3121be4a6fa29269fcb15b1e57"
dest_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56"
 from {username='slave'} at 127.0.0.1:37172
I20260709 13:12:54.023355  3669 raft_consensus.cc:493] T f06a4d3121be4a6fa29269fcb15b1e57 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:54.023598  3669 raft_consensus.cc:3060] T f06a4d3121be4a6fa29269fcb15b1e57 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:54.027854  3669 raft_consensus.cc:515] T f06a4d3121be4a6fa29269fcb15b1e57 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:54.029222  3669 leader_election.cc:290] T f06a4d3121be4a6fa29269fcb15b1e57 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [CANDIDATE]: Term 2 election: Requested vote from peers 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995), 1e8299ce77aa4939877e6f90c5bd04aa (127.28.54.67:33771)
I20260709 13:12:54.030179  3940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06a4d3121be4a6fa29269fcb15b1e57" candidate_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "563a1c63813642e591d31cf7936f81d0"
I20260709 13:12:54.030251  3742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f06a4d3121be4a6fa29269fcb15b1e57" candidate_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e8299ce77aa4939877e6f90c5bd04aa"
I20260709 13:12:54.030936  3940 raft_consensus.cc:3060] T f06a4d3121be4a6fa29269fcb15b1e57 P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:54.031026  3742 raft_consensus.cc:3055] T f06a4d3121be4a6fa29269fcb15b1e57 P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:54.031447  3742 raft_consensus.cc:740] T f06a4d3121be4a6fa29269fcb15b1e57 P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e8299ce77aa4939877e6f90c5bd04aa, State: Running, Role: LEADER
I20260709 13:12:54.032022  3742 consensus_queue.cc:260] T f06a4d3121be4a6fa29269fcb15b1e57 P 1e8299ce77aa4939877e6f90c5bd04aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:54.033077  3742 raft_consensus.cc:3060] T f06a4d3121be4a6fa29269fcb15b1e57 P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:54.035784  3940 raft_consensus.cc:2468] T f06a4d3121be4a6fa29269fcb15b1e57 P 563a1c63813642e591d31cf7936f81d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dfa3a6e32584eddb9dd28eb4e71bd56 in term 2.
I20260709 13:12:54.037048  3632 leader_election.cc:304] T f06a4d3121be4a6fa29269fcb15b1e57 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 563a1c63813642e591d31cf7936f81d0, 6dfa3a6e32584eddb9dd28eb4e71bd56; no voters: 
I20260709 13:12:54.037673  4023 raft_consensus.cc:2804] T f06a4d3121be4a6fa29269fcb15b1e57 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:54.038467  4023 raft_consensus.cc:697] T f06a4d3121be4a6fa29269fcb15b1e57 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 2 LEADER]: Becoming Leader. State: Replica: 6dfa3a6e32584eddb9dd28eb4e71bd56, State: Running, Role: LEADER
I20260709 13:12:54.038836  3742 raft_consensus.cc:2468] T f06a4d3121be4a6fa29269fcb15b1e57 P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dfa3a6e32584eddb9dd28eb4e71bd56 in term 2.
I20260709 13:12:54.039389  4023 consensus_queue.cc:237] T f06a4d3121be4a6fa29269fcb15b1e57 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:54.045423  3489 catalog_manager.cc:5697] T f06a4d3121be4a6fa29269fcb15b1e57 P 6dfa3a6e32584eddb9dd28eb4e71bd56 reported cstate change: term changed from 1 to 2, leader changed from 1e8299ce77aa4939877e6f90c5bd04aa (127.28.54.67) to 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66). New cstate: current_term: 2 leader_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:54.098430  4056 raft_consensus.cc:993] T 92acdf60735749beb2a12618aff17cfd P 1e8299ce77aa4939877e6f90c5bd04aa: : Instructing follower 6dfa3a6e32584eddb9dd28eb4e71bd56 to start an election
I20260709 13:12:54.098822  4038 raft_consensus.cc:1081] T 92acdf60735749beb2a12618aff17cfd P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 LEADER]: Signalling peer 6dfa3a6e32584eddb9dd28eb4e71bd56 to start an election
I20260709 13:12:54.100059  3669 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "92acdf60735749beb2a12618aff17cfd"
dest_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56"
 from {username='slave'} at 127.0.0.1:37172
I20260709 13:12:54.100467  3669 raft_consensus.cc:493] T 92acdf60735749beb2a12618aff17cfd P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:54.100764  3669 raft_consensus.cc:3060] T 92acdf60735749beb2a12618aff17cfd P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:54.105113  3669 raft_consensus.cc:515] T 92acdf60735749beb2a12618aff17cfd P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:54.106508  3669 leader_election.cc:290] T 92acdf60735749beb2a12618aff17cfd P 6dfa3a6e32584eddb9dd28eb4e71bd56 [CANDIDATE]: Term 2 election: Requested vote from peers 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995), 1e8299ce77aa4939877e6f90c5bd04aa (127.28.54.67:33771)
I20260709 13:12:54.107342  3742 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92acdf60735749beb2a12618aff17cfd" candidate_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1e8299ce77aa4939877e6f90c5bd04aa"
I20260709 13:12:54.107131  3940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92acdf60735749beb2a12618aff17cfd" candidate_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "563a1c63813642e591d31cf7936f81d0"
I20260709 13:12:54.107801  3742 raft_consensus.cc:3055] T 92acdf60735749beb2a12618aff17cfd P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:54.107923  3940 raft_consensus.cc:3060] T 92acdf60735749beb2a12618aff17cfd P 563a1c63813642e591d31cf7936f81d0 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:54.108047  3742 raft_consensus.cc:740] T 92acdf60735749beb2a12618aff17cfd P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1e8299ce77aa4939877e6f90c5bd04aa, State: Running, Role: LEADER
I20260709 13:12:54.108722  3742 consensus_queue.cc:260] T 92acdf60735749beb2a12618aff17cfd P 1e8299ce77aa4939877e6f90c5bd04aa [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:54.109529  3742 raft_consensus.cc:3060] T 92acdf60735749beb2a12618aff17cfd P 1e8299ce77aa4939877e6f90c5bd04aa [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:54.112629  3940 raft_consensus.cc:2468] T 92acdf60735749beb2a12618aff17cfd P 563a1c63813642e591d31cf7936f81d0 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dfa3a6e32584eddb9dd28eb4e71bd56 in term 2.
I20260709 13:12:54.113492  3632 leader_election.cc:304] T 92acdf60735749beb2a12618aff17cfd P 6dfa3a6e32584eddb9dd28eb4e71bd56 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 563a1c63813642e591d31cf7936f81d0, 6dfa3a6e32584eddb9dd28eb4e71bd56; no voters: 
I20260709 13:12:54.113698  3742 raft_consensus.cc:2468] T 92acdf60735749beb2a12618aff17cfd P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6dfa3a6e32584eddb9dd28eb4e71bd56 in term 2.
I20260709 13:12:54.114099  4023 raft_consensus.cc:2804] T 92acdf60735749beb2a12618aff17cfd P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:54.114522  4023 raft_consensus.cc:697] T 92acdf60735749beb2a12618aff17cfd P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 2 LEADER]: Becoming Leader. State: Replica: 6dfa3a6e32584eddb9dd28eb4e71bd56, State: Running, Role: LEADER
I20260709 13:12:54.115309  4023 consensus_queue.cc:237] T 92acdf60735749beb2a12618aff17cfd P 6dfa3a6e32584eddb9dd28eb4e71bd56 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:54.121407  3489 catalog_manager.cc:5697] T 92acdf60735749beb2a12618aff17cfd P 6dfa3a6e32584eddb9dd28eb4e71bd56 reported cstate change: term changed from 1 to 2, leader changed from 1e8299ce77aa4939877e6f90c5bd04aa (127.28.54.67) to 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66). New cstate: current_term: 2 leader_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:54.166576  4053 raft_consensus.cc:993] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56: : Instructing follower 1e8299ce77aa4939877e6f90c5bd04aa to start an election
I20260709 13:12:54.167011  4023 raft_consensus.cc:1081] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 4 LEADER]: Signalling peer 1e8299ce77aa4939877e6f90c5bd04aa to start an election
I20260709 13:12:54.168409  3742 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "84ca4c013a24451388658395af3b8b78"
dest_uuid: "1e8299ce77aa4939877e6f90c5bd04aa"
 from {username='slave'} at 127.0.0.1:54452
I20260709 13:12:54.168859  3742 raft_consensus.cc:493] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:54.169214  3742 raft_consensus.cc:3060] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:54.173570  3742 raft_consensus.cc:515] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:54.175024  3742 leader_election.cc:290] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa [CANDIDATE]: Term 5 election: Requested vote from peers 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995), 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66:39331)
I20260709 13:12:54.175879  3940 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ca4c013a24451388658395af3b8b78" candidate_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "563a1c63813642e591d31cf7936f81d0"
I20260709 13:12:54.176029  3669 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "84ca4c013a24451388658395af3b8b78" candidate_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56"
I20260709 13:12:54.176465  3940 raft_consensus.cc:3060] T 84ca4c013a24451388658395af3b8b78 P 563a1c63813642e591d31cf7936f81d0 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:54.176513  3669 raft_consensus.cc:3055] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 13:12:54.176911  3669 raft_consensus.cc:740] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 6dfa3a6e32584eddb9dd28eb4e71bd56, State: Running, Role: LEADER
I20260709 13:12:54.177516  3669 consensus_queue.cc:260] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:54.178483  3669 raft_consensus.cc:3060] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 4 FOLLOWER]: Advancing to term 5
I20260709 13:12:54.181350  3940 raft_consensus.cc:2468] T 84ca4c013a24451388658395af3b8b78 P 563a1c63813642e591d31cf7936f81d0 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e8299ce77aa4939877e6f90c5bd04aa in term 5.
I20260709 13:12:54.182307  3706 leader_election.cc:304] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1e8299ce77aa4939877e6f90c5bd04aa, 563a1c63813642e591d31cf7936f81d0; no voters: 
I20260709 13:12:54.182720  3669 raft_consensus.cc:2468] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1e8299ce77aa4939877e6f90c5bd04aa in term 5.
I20260709 13:12:54.182991  4038 raft_consensus.cc:2804] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa [term 5 FOLLOWER]: Leader election won for term 5
I20260709 13:12:54.183497  4038 raft_consensus.cc:697] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa [term 5 LEADER]: Becoming Leader. State: Replica: 1e8299ce77aa4939877e6f90c5bd04aa, State: Running, Role: LEADER
I20260709 13:12:54.184221  4038 consensus_queue.cc:237] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } }
I20260709 13:12:54.189632  3489 catalog_manager.cc:5697] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa reported cstate change: term changed from 4 to 5, leader changed from 6dfa3a6e32584eddb9dd28eb4e71bd56 (127.28.54.66) to 1e8299ce77aa4939877e6f90c5bd04aa (127.28.54.67). New cstate: current_term: 5 leader_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:54.468554  3940 raft_consensus.cc:1275] T f06a4d3121be4a6fa29269fcb15b1e57 P 563a1c63813642e591d31cf7936f81d0 [term 2 FOLLOWER]: Refusing update from remote peer 6dfa3a6e32584eddb9dd28eb4e71bd56: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:54.469942  4053 consensus_queue.cc:1048] T f06a4d3121be4a6fa29269fcb15b1e57 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:54.471028  3742 raft_consensus.cc:1275] T f06a4d3121be4a6fa29269fcb15b1e57 P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 FOLLOWER]: Refusing update from remote peer 6dfa3a6e32584eddb9dd28eb4e71bd56: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:54.472390  4053 consensus_queue.cc:1048] T f06a4d3121be4a6fa29269fcb15b1e57 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:54.572557  3742 raft_consensus.cc:1275] T 92acdf60735749beb2a12618aff17cfd P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 FOLLOWER]: Refusing update from remote peer 6dfa3a6e32584eddb9dd28eb4e71bd56: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:54.573561  4011 consensus_queue.cc:1048] T 92acdf60735749beb2a12618aff17cfd P 6dfa3a6e32584eddb9dd28eb4e71bd56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1e8299ce77aa4939877e6f90c5bd04aa" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 33771 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:54.581452  3940 raft_consensus.cc:1275] T 92acdf60735749beb2a12618aff17cfd P 563a1c63813642e591d31cf7936f81d0 [term 2 FOLLOWER]: Refusing update from remote peer 6dfa3a6e32584eddb9dd28eb4e71bd56: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:54.584079  4023 consensus_queue.cc:1048] T 92acdf60735749beb2a12618aff17cfd P 6dfa3a6e32584eddb9dd28eb4e71bd56 [LEADER]: Connected to new peer: Peer: permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:54.609038  3940 raft_consensus.cc:1275] T 84ca4c013a24451388658395af3b8b78 P 563a1c63813642e591d31cf7936f81d0 [term 5 FOLLOWER]: Refusing update from remote peer 1e8299ce77aa4939877e6f90c5bd04aa: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:12:54.610075  4056 consensus_queue.cc:1048] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "563a1c63813642e591d31cf7936f81d0" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 42995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 13:12:54.617666  3667 raft_consensus.cc:1275] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 5 FOLLOWER]: Refusing update from remote peer 1e8299ce77aa4939877e6f90c5bd04aa: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 13:12:54.619218  4038 consensus_queue.cc:1048] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa [LEADER]: Connected to new peer: Peer: permanent_uuid: "6dfa3a6e32584eddb9dd28eb4e71bd56" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 39331 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 13:12:54.795934  3540 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 13:12:54.898721 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:12:54.927294 28889 tablet_server.cc:179] TabletServer@127.28.54.65:42995 shutting down...
I20260709 13:12:54.943347 28889 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:54.943989 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:54.944667 28889 raft_consensus.cc:2243] T 04d72e5e1a07401996c45a94f44bd659 P 563a1c63813642e591d31cf7936f81d0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:54.945094 28889 raft_consensus.cc:2272] T 04d72e5e1a07401996c45a94f44bd659 P 563a1c63813642e591d31cf7936f81d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:54.947269 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:54.947868 28889 raft_consensus.cc:2243] T f06a4d3121be4a6fa29269fcb15b1e57 P 563a1c63813642e591d31cf7936f81d0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:54.948403 28889 raft_consensus.cc:2272] T f06a4d3121be4a6fa29269fcb15b1e57 P 563a1c63813642e591d31cf7936f81d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:54.951402 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:54.951893 28889 raft_consensus.cc:2243] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 563a1c63813642e591d31cf7936f81d0 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:54.952250 28889 raft_consensus.cc:2272] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 563a1c63813642e591d31cf7936f81d0 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:54.953857 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:54.954303 28889 raft_consensus.cc:2243] T 84ca4c013a24451388658395af3b8b78 P 563a1c63813642e591d31cf7936f81d0 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:54.954649 28889 raft_consensus.cc:2272] T 84ca4c013a24451388658395af3b8b78 P 563a1c63813642e591d31cf7936f81d0 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:54.956522 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:54.956990 28889 raft_consensus.cc:2243] T ea26aa43a7c147bea7311233d455f8d5 P 563a1c63813642e591d31cf7936f81d0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:54.957326 28889 raft_consensus.cc:2272] T ea26aa43a7c147bea7311233d455f8d5 P 563a1c63813642e591d31cf7936f81d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:54.959097 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:54.959528 28889 raft_consensus.cc:2243] T 3077a0a5b9944af39dde06a7e84b9df9 P 563a1c63813642e591d31cf7936f81d0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:54.959864 28889 raft_consensus.cc:2272] T 3077a0a5b9944af39dde06a7e84b9df9 P 563a1c63813642e591d31cf7936f81d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:54.961439 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:54.961912 28889 raft_consensus.cc:2243] T fab01b4c92b34ed1aa888cc485d1c0e0 P 563a1c63813642e591d31cf7936f81d0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:54.962249 28889 raft_consensus.cc:2272] T fab01b4c92b34ed1aa888cc485d1c0e0 P 563a1c63813642e591d31cf7936f81d0 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:54.963793 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:54.964206 28889 raft_consensus.cc:2243] T 28cf86f3998847ab92593600dbdb0d90 P 563a1c63813642e591d31cf7936f81d0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:54.964542 28889 raft_consensus.cc:2272] T 28cf86f3998847ab92593600dbdb0d90 P 563a1c63813642e591d31cf7936f81d0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:54.966089 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:54.966485 28889 raft_consensus.cc:2243] T ba2c5f7a7dd946bc843001bcb47a202a P 563a1c63813642e591d31cf7936f81d0 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:54.966804 28889 raft_consensus.cc:2272] T ba2c5f7a7dd946bc843001bcb47a202a P 563a1c63813642e591d31cf7936f81d0 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:54.968302 28889 tablet_replica.cc:333] stopping tablet replica
I20260709 13:12:54.968815 28889 raft_consensus.cc:2243] T 92acdf60735749beb2a12618aff17cfd P 563a1c63813642e591d31cf7936f81d0 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:54.969173 28889 raft_consensus.cc:2272] T 92acdf60735749beb2a12618aff17cfd P 563a1c63813642e591d31cf7936f81d0 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:12:54.970579  3706 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 71 similar messages]
W20260709 13:12:54.973141  3706 consensus_peers.cc:597] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa -> Peer 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995): Couldn't send request to peer 563a1c63813642e591d31cf7936f81d0. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:54.997651 28889 tablet_server.cc:196] TabletServer@127.28.54.65:42995 shutdown complete.
W20260709 13:12:55.000589  3632 consensus_peers.cc:597] T f06a4d3121be4a6fa29269fcb15b1e57 P 6dfa3a6e32584eddb9dd28eb4e71bd56 -> Peer 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995): Couldn't send request to peer 563a1c63813642e591d31cf7936f81d0. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:42995: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:12:55.004973  3632 consensus_peers.cc:597] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 6dfa3a6e32584eddb9dd28eb4e71bd56 -> Peer 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995): Couldn't send request to peer 563a1c63813642e591d31cf7936f81d0. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:42995: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:55.016773 28889 tablet_server.cc:179] TabletServer@127.28.54.66:0 shutting down...
I20260709 13:12:55.035569 28889 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:55.036254 28889 tablet_replica.cc:333] T 28cf86f3998847ab92593600dbdb0d90 P 6dfa3a6e32584eddb9dd28eb4e71bd56: stopping tablet replica
I20260709 13:12:55.037055 28889 raft_consensus.cc:2243] T 28cf86f3998847ab92593600dbdb0d90 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.037470 28889 raft_consensus.cc:2272] T 28cf86f3998847ab92593600dbdb0d90 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.039515 28889 tablet_replica.cc:333] T 92acdf60735749beb2a12618aff17cfd P 6dfa3a6e32584eddb9dd28eb4e71bd56: stopping tablet replica
I20260709 13:12:55.040067 28889 raft_consensus.cc:2243] T 92acdf60735749beb2a12618aff17cfd P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:55.040776 28889 raft_consensus.cc:2272] T 92acdf60735749beb2a12618aff17cfd P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.042833 28889 tablet_replica.cc:333] T ba2c5f7a7dd946bc843001bcb47a202a P 6dfa3a6e32584eddb9dd28eb4e71bd56: stopping tablet replica
I20260709 13:12:55.043349 28889 raft_consensus.cc:2243] T ba2c5f7a7dd946bc843001bcb47a202a P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.043697 28889 raft_consensus.cc:2272] T ba2c5f7a7dd946bc843001bcb47a202a P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.045522 28889 tablet_replica.cc:333] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56: stopping tablet replica
I20260709 13:12:55.046028 28889 raft_consensus.cc:2243] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.046378 28889 raft_consensus.cc:2272] T 84ca4c013a24451388658395af3b8b78 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.048622 28889 tablet_replica.cc:333] T ea26aa43a7c147bea7311233d455f8d5 P 6dfa3a6e32584eddb9dd28eb4e71bd56: stopping tablet replica
I20260709 13:12:55.049075 28889 raft_consensus.cc:2243] T ea26aa43a7c147bea7311233d455f8d5 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:55.049724 28889 raft_consensus.cc:2272] T ea26aa43a7c147bea7311233d455f8d5 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.051661 28889 tablet_replica.cc:333] T fab01b4c92b34ed1aa888cc485d1c0e0 P 6dfa3a6e32584eddb9dd28eb4e71bd56: stopping tablet replica
I20260709 13:12:55.052170 28889 raft_consensus.cc:2243] T fab01b4c92b34ed1aa888cc485d1c0e0 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.052521 28889 raft_consensus.cc:2272] T fab01b4c92b34ed1aa888cc485d1c0e0 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.054193 28889 tablet_replica.cc:333] T 3077a0a5b9944af39dde06a7e84b9df9 P 6dfa3a6e32584eddb9dd28eb4e71bd56: stopping tablet replica
I20260709 13:12:55.054601 28889 raft_consensus.cc:2243] T 3077a0a5b9944af39dde06a7e84b9df9 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.054926 28889 raft_consensus.cc:2272] T 3077a0a5b9944af39dde06a7e84b9df9 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.056607 28889 tablet_replica.cc:333] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 6dfa3a6e32584eddb9dd28eb4e71bd56: stopping tablet replica
I20260709 13:12:55.057080 28889 raft_consensus.cc:2243] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:55.057742 28889 raft_consensus.cc:2272] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.059500 28889 tablet_replica.cc:333] T f06a4d3121be4a6fa29269fcb15b1e57 P 6dfa3a6e32584eddb9dd28eb4e71bd56: stopping tablet replica
I20260709 13:12:55.059950 28889 raft_consensus.cc:2243] T f06a4d3121be4a6fa29269fcb15b1e57 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:55.060639 28889 raft_consensus.cc:2272] T f06a4d3121be4a6fa29269fcb15b1e57 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.062726 28889 tablet_replica.cc:333] T 04d72e5e1a07401996c45a94f44bd659 P 6dfa3a6e32584eddb9dd28eb4e71bd56: stopping tablet replica
I20260709 13:12:55.063189 28889 raft_consensus.cc:2243] T 04d72e5e1a07401996c45a94f44bd659 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:55.063849 28889 raft_consensus.cc:2272] T 04d72e5e1a07401996c45a94f44bd659 P 6dfa3a6e32584eddb9dd28eb4e71bd56 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.109504 28889 tablet_server.cc:196] TabletServer@127.28.54.66:0 shutdown complete.
I20260709 13:12:55.150825 28889 tablet_server.cc:179] TabletServer@127.28.54.67:0 shutting down...
W20260709 13:12:55.154135  3706 consensus_peers.cc:597] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa -> Peer 563a1c63813642e591d31cf7936f81d0 (127.28.54.65:42995): Couldn't send request to peer 563a1c63813642e591d31cf7936f81d0. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:42995: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:12:55.173955 28889 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:55.175083 28889 tablet_replica.cc:333] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa: stopping tablet replica
I20260709 13:12:55.176227 28889 raft_consensus.cc:2243] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa [term 5 LEADER]: Raft consensus shutting down.
I20260709 13:12:55.177901 28889 raft_consensus.cc:2272] T 84ca4c013a24451388658395af3b8b78 P 1e8299ce77aa4939877e6f90c5bd04aa [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.181475 28889 tablet_replica.cc:333] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa: stopping tablet replica
I20260709 13:12:55.182147 28889 raft_consensus.cc:2243] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:12:55.183527 28889 raft_consensus.cc:2272] T 28cf86f3998847ab92593600dbdb0d90 P 1e8299ce77aa4939877e6f90c5bd04aa [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.186156 28889 tablet_replica.cc:333] T ea26aa43a7c147bea7311233d455f8d5 P 1e8299ce77aa4939877e6f90c5bd04aa: stopping tablet replica
I20260709 13:12:55.186931 28889 raft_consensus.cc:2243] T ea26aa43a7c147bea7311233d455f8d5 P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.187568 28889 raft_consensus.cc:2272] T ea26aa43a7c147bea7311233d455f8d5 P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.190042 28889 tablet_replica.cc:333] T fab01b4c92b34ed1aa888cc485d1c0e0 P 1e8299ce77aa4939877e6f90c5bd04aa: stopping tablet replica
I20260709 13:12:55.190654 28889 raft_consensus.cc:2243] T fab01b4c92b34ed1aa888cc485d1c0e0 P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:55.191964 28889 raft_consensus.cc:2272] T fab01b4c92b34ed1aa888cc485d1c0e0 P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.194295 28889 tablet_replica.cc:333] T 3077a0a5b9944af39dde06a7e84b9df9 P 1e8299ce77aa4939877e6f90c5bd04aa: stopping tablet replica
I20260709 13:12:55.194821 28889 raft_consensus.cc:2243] T 3077a0a5b9944af39dde06a7e84b9df9 P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:55.196280 28889 raft_consensus.cc:2272] T 3077a0a5b9944af39dde06a7e84b9df9 P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.198843 28889 tablet_replica.cc:333] T 92acdf60735749beb2a12618aff17cfd P 1e8299ce77aa4939877e6f90c5bd04aa: stopping tablet replica
I20260709 13:12:55.199357 28889 raft_consensus.cc:2243] T 92acdf60735749beb2a12618aff17cfd P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.199923 28889 raft_consensus.cc:2272] T 92acdf60735749beb2a12618aff17cfd P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.202865 28889 tablet_replica.cc:333] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa: stopping tablet replica
I20260709 13:12:55.203425 28889 raft_consensus.cc:2243] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa [term 4 LEADER]: Raft consensus shutting down.
I20260709 13:12:55.204747 28889 raft_consensus.cc:2272] T ba2c5f7a7dd946bc843001bcb47a202a P 1e8299ce77aa4939877e6f90c5bd04aa [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.207029 28889 tablet_replica.cc:333] T 04d72e5e1a07401996c45a94f44bd659 P 1e8299ce77aa4939877e6f90c5bd04aa: stopping tablet replica
I20260709 13:12:55.207512 28889 raft_consensus.cc:2243] T 04d72e5e1a07401996c45a94f44bd659 P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.208041 28889 raft_consensus.cc:2272] T 04d72e5e1a07401996c45a94f44bd659 P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.210368 28889 tablet_replica.cc:333] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 1e8299ce77aa4939877e6f90c5bd04aa: stopping tablet replica
I20260709 13:12:55.210846 28889 raft_consensus.cc:2243] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 1e8299ce77aa4939877e6f90c5bd04aa [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.211377 28889 raft_consensus.cc:2272] T 0f5afe6645d14571bf8ff8a0ba86afb3 P 1e8299ce77aa4939877e6f90c5bd04aa [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.213851 28889 tablet_replica.cc:333] T f06a4d3121be4a6fa29269fcb15b1e57 P 1e8299ce77aa4939877e6f90c5bd04aa: stopping tablet replica
I20260709 13:12:55.214342 28889 raft_consensus.cc:2243] T f06a4d3121be4a6fa29269fcb15b1e57 P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:55.214900 28889 raft_consensus.cc:2272] T f06a4d3121be4a6fa29269fcb15b1e57 P 1e8299ce77aa4939877e6f90c5bd04aa [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.249011 28889 tablet_server.cc:196] TabletServer@127.28.54.67:0 shutdown complete.
I20260709 13:12:55.276418 28889 master.cc:562] Master@127.28.54.126:45925 shutting down...
I20260709 13:12:55.295864 28889 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 83e83c73e13844b2af44f0d082fc54e0 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:55.296553 28889 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 83e83c73e13844b2af44f0d082fc54e0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:55.296881 28889 tablet_replica.cc:333] T 00000000000000000000000000000000 P 83e83c73e13844b2af44f0d082fc54e0: stopping tablet replica
I20260709 13:12:55.317137 28889 master.cc:584] Master@127.28.54.126:45925 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (12695 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 13:12:55.362663 28889 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.28.54.126:46005
I20260709 13:12:55.363709 28889 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:55.369091  4081 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:55.369165  4082 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:55.370160  4084 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:55.371236 28889 server_base.cc:1061] running on GCE node
I20260709 13:12:55.372030 28889 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:55.372198 28889 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:55.372323 28889 hybrid_clock.cc:648] HybridClock initialized: now 1783602775372311 us; error 0 us; skew 500 ppm
I20260709 13:12:55.372767 28889 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:55.374883 28889 webserver.cc:533] Webserver started at http://127.28.54.126:40795/ using document root <none> and password file <none>
I20260709 13:12:55.375325 28889 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:55.375473 28889 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:55.375669 28889 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:55.376799 28889 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602558744475-28889-0/minicluster-data/master-0-root/instance:
uuid: "d30b67b40eda4e668f435bdbeb4df30b"
format_stamp: "Formatted at 2026-07-09 13:12:55 on dist-test-slave-vpdx"
I20260709 13:12:55.380854 28889 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.006s
I20260709 13:12:55.384085  4089 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:55.384742 28889 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:12:55.384994 28889 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602558744475-28889-0/minicluster-data/master-0-root
uuid: "d30b67b40eda4e668f435bdbeb4df30b"
format_stamp: "Formatted at 2026-07-09 13:12:55 on dist-test-slave-vpdx"
I20260709 13:12:55.385234 28889 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602558744475-28889-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602558744475-28889-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602558744475-28889-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:55.396274 28889 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:55.397406 28889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:55.433858 28889 rpc_server.cc:307] RPC server started. Bound to: 127.28.54.126:46005
I20260709 13:12:55.433938  4140 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.54.126:46005 every 8 connection(s)
I20260709 13:12:55.437786  4141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.449790  4141 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d30b67b40eda4e668f435bdbeb4df30b: Bootstrap starting.
I20260709 13:12:55.454380  4141 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d30b67b40eda4e668f435bdbeb4df30b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.458401  4141 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d30b67b40eda4e668f435bdbeb4df30b: No bootstrap required, opened a new log
I20260709 13:12:55.460490  4141 raft_consensus.cc:359] T 00000000000000000000000000000000 P d30b67b40eda4e668f435bdbeb4df30b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d30b67b40eda4e668f435bdbeb4df30b" member_type: VOTER }
I20260709 13:12:55.460886  4141 raft_consensus.cc:385] T 00000000000000000000000000000000 P d30b67b40eda4e668f435bdbeb4df30b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.461061  4141 raft_consensus.cc:740] T 00000000000000000000000000000000 P d30b67b40eda4e668f435bdbeb4df30b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d30b67b40eda4e668f435bdbeb4df30b, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.461601  4141 consensus_queue.cc:260] T 00000000000000000000000000000000 P d30b67b40eda4e668f435bdbeb4df30b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d30b67b40eda4e668f435bdbeb4df30b" member_type: VOTER }
I20260709 13:12:55.462059  4141 raft_consensus.cc:399] T 00000000000000000000000000000000 P d30b67b40eda4e668f435bdbeb4df30b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:12:55.462265  4141 raft_consensus.cc:493] T 00000000000000000000000000000000 P d30b67b40eda4e668f435bdbeb4df30b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:12:55.462479  4141 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d30b67b40eda4e668f435bdbeb4df30b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:55.466964  4141 raft_consensus.cc:515] T 00000000000000000000000000000000 P d30b67b40eda4e668f435bdbeb4df30b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d30b67b40eda4e668f435bdbeb4df30b" member_type: VOTER }
I20260709 13:12:55.467408  4141 leader_election.cc:304] T 00000000000000000000000000000000 P d30b67b40eda4e668f435bdbeb4df30b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d30b67b40eda4e668f435bdbeb4df30b; no voters: 
I20260709 13:12:55.468430  4141 leader_election.cc:290] T 00000000000000000000000000000000 P d30b67b40eda4e668f435bdbeb4df30b [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:12:55.468798  4144 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d30b67b40eda4e668f435bdbeb4df30b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:55.470125  4144 raft_consensus.cc:697] T 00000000000000000000000000000000 P d30b67b40eda4e668f435bdbeb4df30b [term 1 LEADER]: Becoming Leader. State: Replica: d30b67b40eda4e668f435bdbeb4df30b, State: Running, Role: LEADER
I20260709 13:12:55.470788  4144 consensus_queue.cc:237] T 00000000000000000000000000000000 P d30b67b40eda4e668f435bdbeb4df30b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d30b67b40eda4e668f435bdbeb4df30b" member_type: VOTER }
I20260709 13:12:55.471072  4141 sys_catalog.cc:565] T 00000000000000000000000000000000 P d30b67b40eda4e668f435bdbeb4df30b [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:12:55.476828  4146 sys_catalog.cc:455] T 00000000000000000000000000000000 P d30b67b40eda4e668f435bdbeb4df30b [sys.catalog]: SysCatalogTable state changed. Reason: New leader d30b67b40eda4e668f435bdbeb4df30b. Latest consensus state: current_term: 1 leader_uuid: "d30b67b40eda4e668f435bdbeb4df30b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d30b67b40eda4e668f435bdbeb4df30b" member_type: VOTER } }
I20260709 13:12:55.476992  4145 sys_catalog.cc:455] T 00000000000000000000000000000000 P d30b67b40eda4e668f435bdbeb4df30b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d30b67b40eda4e668f435bdbeb4df30b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d30b67b40eda4e668f435bdbeb4df30b" member_type: VOTER } }
I20260709 13:12:55.477550  4145 sys_catalog.cc:458] T 00000000000000000000000000000000 P d30b67b40eda4e668f435bdbeb4df30b [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:55.477550  4146 sys_catalog.cc:458] T 00000000000000000000000000000000 P d30b67b40eda4e668f435bdbeb4df30b [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:55.479694  4153 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:12:55.485456  4153 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:12:55.486460 28889 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:12:55.493911  4153 catalog_manager.cc:1383] Generated new cluster ID: 4018f61adf7e442294253b47503325a6
I20260709 13:12:55.494160  4153 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:12:55.515022  4153 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:12:55.516359  4153 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:12:55.529407  4153 catalog_manager.cc:6070] T 00000000000000000000000000000000 P d30b67b40eda4e668f435bdbeb4df30b: Generated new TSK 0
I20260709 13:12:55.529940  4153 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:12:55.553262 28889 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:55.558921  4162 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:55.559718  4163 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:55.562244 28889 server_base.cc:1061] running on GCE node
W20260709 13:12:55.562466  4166 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:55.563367 28889 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:55.563557 28889 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:55.563737 28889 hybrid_clock.cc:648] HybridClock initialized: now 1783602775563721 us; error 0 us; skew 500 ppm
I20260709 13:12:55.564270 28889 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:55.566560 28889 webserver.cc:533] Webserver started at http://127.28.54.65:39795/ using document root <none> and password file <none>
I20260709 13:12:55.567020 28889 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:55.567186 28889 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:55.567432 28889 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:55.568475 28889 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602558744475-28889-0/minicluster-data/ts-0-root/instance:
uuid: "5917eb98fb7349f6bc42bb33140fd4d6"
format_stamp: "Formatted at 2026-07-09 13:12:55 on dist-test-slave-vpdx"
I20260709 13:12:55.572846 28889 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:12:55.576151  4170 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:55.576932 28889 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 13:12:55.577211 28889 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602558744475-28889-0/minicluster-data/ts-0-root
uuid: "5917eb98fb7349f6bc42bb33140fd4d6"
format_stamp: "Formatted at 2026-07-09 13:12:55 on dist-test-slave-vpdx"
I20260709 13:12:55.577491 28889 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602558744475-28889-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602558744475-28889-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602558744475-28889-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:55.596686 28889 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:55.597929 28889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:55.599361 28889 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:55.601557 28889 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:55.601742 28889 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:55.602000 28889 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:55.602169 28889 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:55.643663 28889 rpc_server.cc:307] RPC server started. Bound to: 127.28.54.65:34143
I20260709 13:12:55.643778  4232 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.54.65:34143 every 8 connection(s)
I20260709 13:12:55.648721 28889 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:55.656976  4237 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:55.658422  4238 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:55.661180  4240 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:55.661422 28889 server_base.cc:1061] running on GCE node
I20260709 13:12:55.662683 28889 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:55.662936 28889 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:55.662993  4233 heartbeater.cc:344] Connected to a master server at 127.28.54.126:46005
I20260709 13:12:55.663162 28889 hybrid_clock.cc:648] HybridClock initialized: now 1783602775663138 us; error 0 us; skew 500 ppm
I20260709 13:12:55.663468  4233 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:55.663975 28889 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:55.664397  4233 heartbeater.cc:507] Master 127.28.54.126:46005 requested a full tablet report, sending...
I20260709 13:12:55.666744 28889 webserver.cc:533] Webserver started at http://127.28.54.66:46067/ using document root <none> and password file <none>
I20260709 13:12:55.666855  4106 ts_manager.cc:194] Registered new tserver with Master: 5917eb98fb7349f6bc42bb33140fd4d6 (127.28.54.65:34143)
I20260709 13:12:55.667306 28889 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:55.667529 28889 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:55.667783 28889 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:55.668764  4106 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41634
I20260709 13:12:55.668951 28889 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602558744475-28889-0/minicluster-data/ts-1-root/instance:
uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1"
format_stamp: "Formatted at 2026-07-09 13:12:55 on dist-test-slave-vpdx"
I20260709 13:12:55.674301 28889 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:12:55.678181  4245 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:55.679075 28889 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 13:12:55.679378 28889 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602558744475-28889-0/minicluster-data/ts-1-root
uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1"
format_stamp: "Formatted at 2026-07-09 13:12:55 on dist-test-slave-vpdx"
I20260709 13:12:55.679632 28889 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602558744475-28889-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602558744475-28889-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602558744475-28889-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:55.697726 28889 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:55.698959 28889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:55.700393 28889 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:55.702555 28889 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:55.702730 28889 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:55.702957 28889 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:55.703097 28889 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:55.742298 28889 rpc_server.cc:307] RPC server started. Bound to: 127.28.54.66:35433
I20260709 13:12:55.742404  4307 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.54.66:35433 every 8 connection(s)
I20260709 13:12:55.746762 28889 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:55.753711  4311 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:55.754366  4312 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:55.758574  4308 heartbeater.cc:344] Connected to a master server at 127.28.54.126:46005
I20260709 13:12:55.758643 28889 server_base.cc:1061] running on GCE node
I20260709 13:12:55.759099  4308 heartbeater.cc:461] Registering TS with master...
W20260709 13:12:55.759575  4315 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:55.760088  4308 heartbeater.cc:507] Master 127.28.54.126:46005 requested a full tablet report, sending...
I20260709 13:12:55.760560 28889 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:55.760805 28889 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:55.760995 28889 hybrid_clock.cc:648] HybridClock initialized: now 1783602775760975 us; error 0 us; skew 500 ppm
I20260709 13:12:55.761636 28889 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:55.762131  4106 ts_manager.cc:194] Registered new tserver with Master: 9f2222fc10ea4fb2be4e17e7c999a7c1 (127.28.54.66:35433)
I20260709 13:12:55.763576  4106 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41638
I20260709 13:12:55.764035 28889 webserver.cc:533] Webserver started at http://127.28.54.67:34081/ using document root <none> and password file <none>
I20260709 13:12:55.764665 28889 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:55.764891 28889 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:55.765151 28889 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:55.766319 28889 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602558744475-28889-0/minicluster-data/ts-2-root/instance:
uuid: "7981d8ad22c3493ea724d42c4e73f023"
format_stamp: "Formatted at 2026-07-09 13:12:55 on dist-test-slave-vpdx"
I20260709 13:12:55.770527 28889 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.002s
I20260709 13:12:55.773976  4319 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:55.774777 28889 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:12:55.775068 28889 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602558744475-28889-0/minicluster-data/ts-2-root
uuid: "7981d8ad22c3493ea724d42c4e73f023"
format_stamp: "Formatted at 2026-07-09 13:12:55 on dist-test-slave-vpdx"
I20260709 13:12:55.775358 28889 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602558744475-28889-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602558744475-28889-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783602558744475-28889-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:55.790613 28889 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:55.791774 28889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:55.793150 28889 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:55.795264 28889 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:55.795454 28889 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:55.795678 28889 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:55.795825 28889 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:55.834165 28889 rpc_server.cc:307] RPC server started. Bound to: 127.28.54.67:34891
I20260709 13:12:55.834255  4381 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.54.67:34891 every 8 connection(s)
I20260709 13:12:55.846977  4382 heartbeater.cc:344] Connected to a master server at 127.28.54.126:46005
I20260709 13:12:55.847359  4382 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:55.847996  4382 heartbeater.cc:507] Master 127.28.54.126:46005 requested a full tablet report, sending...
I20260709 13:12:55.849725  4106 ts_manager.cc:194] Registered new tserver with Master: 7981d8ad22c3493ea724d42c4e73f023 (127.28.54.67:34891)
I20260709 13:12:55.850600 28889 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013321089s
I20260709 13:12:55.850991  4106 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41642
I20260709 13:12:55.873611  4106 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41644:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:12:55.875690  4106 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:12:55.917239  4347 tablet_service.cc:1511] Processing CreateTablet for tablet 65234ae56a6846d69fbea66ac66aeb9f (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f42e0be38156445ea8bebd71654ac2ec]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:12:55.917230  4346 tablet_service.cc:1511] Processing CreateTablet for tablet 9303514156d64c4fa32695ae08535d20 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f42e0be38156445ea8bebd71654ac2ec]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:12:55.918784  4347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65234ae56a6846d69fbea66ac66aeb9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.919361  4346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9303514156d64c4fa32695ae08535d20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.929160  4273 tablet_service.cc:1511] Processing CreateTablet for tablet 65234ae56a6846d69fbea66ac66aeb9f (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f42e0be38156445ea8bebd71654ac2ec]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:12:55.929502  4272 tablet_service.cc:1511] Processing CreateTablet for tablet 9303514156d64c4fa32695ae08535d20 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f42e0be38156445ea8bebd71654ac2ec]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:12:55.930645  4273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65234ae56a6846d69fbea66ac66aeb9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.931252  4272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9303514156d64c4fa32695ae08535d20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.936210  4198 tablet_service.cc:1511] Processing CreateTablet for tablet 65234ae56a6846d69fbea66ac66aeb9f (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f42e0be38156445ea8bebd71654ac2ec]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:12:55.936885  4197 tablet_service.cc:1511] Processing CreateTablet for tablet 9303514156d64c4fa32695ae08535d20 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=f42e0be38156445ea8bebd71654ac2ec]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:12:55.937539  4198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65234ae56a6846d69fbea66ac66aeb9f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.944253  4197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9303514156d64c4fa32695ae08535d20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:55.959002  4397 tablet_bootstrap.cc:492] T 9303514156d64c4fa32695ae08535d20 P 9f2222fc10ea4fb2be4e17e7c999a7c1: Bootstrap starting.
I20260709 13:12:55.960512  4396 tablet_bootstrap.cc:492] T 9303514156d64c4fa32695ae08535d20 P 7981d8ad22c3493ea724d42c4e73f023: Bootstrap starting.
I20260709 13:12:55.967347  4397 tablet_bootstrap.cc:654] T 9303514156d64c4fa32695ae08535d20 P 9f2222fc10ea4fb2be4e17e7c999a7c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.970762  4396 tablet_bootstrap.cc:654] T 9303514156d64c4fa32695ae08535d20 P 7981d8ad22c3493ea724d42c4e73f023: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.973457  4398 tablet_bootstrap.cc:492] T 65234ae56a6846d69fbea66ac66aeb9f P 5917eb98fb7349f6bc42bb33140fd4d6: Bootstrap starting.
I20260709 13:12:55.976665  4396 tablet_bootstrap.cc:492] T 9303514156d64c4fa32695ae08535d20 P 7981d8ad22c3493ea724d42c4e73f023: No bootstrap required, opened a new log
I20260709 13:12:55.976872  4397 tablet_bootstrap.cc:492] T 9303514156d64c4fa32695ae08535d20 P 9f2222fc10ea4fb2be4e17e7c999a7c1: No bootstrap required, opened a new log
I20260709 13:12:55.977190  4396 ts_tablet_manager.cc:1403] T 9303514156d64c4fa32695ae08535d20 P 7981d8ad22c3493ea724d42c4e73f023: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.000s
I20260709 13:12:55.977339  4397 ts_tablet_manager.cc:1403] T 9303514156d64c4fa32695ae08535d20 P 9f2222fc10ea4fb2be4e17e7c999a7c1: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.007s
I20260709 13:12:55.979604  4398 tablet_bootstrap.cc:654] T 65234ae56a6846d69fbea66ac66aeb9f P 5917eb98fb7349f6bc42bb33140fd4d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.980237  4396 raft_consensus.cc:359] T 9303514156d64c4fa32695ae08535d20 P 7981d8ad22c3493ea724d42c4e73f023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } } peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } }
I20260709 13:12:55.980436  4397 raft_consensus.cc:359] T 9303514156d64c4fa32695ae08535d20 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } } peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } }
I20260709 13:12:55.981107  4396 raft_consensus.cc:385] T 9303514156d64c4fa32695ae08535d20 P 7981d8ad22c3493ea724d42c4e73f023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.981287  4397 raft_consensus.cc:385] T 9303514156d64c4fa32695ae08535d20 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.981459  4396 raft_consensus.cc:740] T 9303514156d64c4fa32695ae08535d20 P 7981d8ad22c3493ea724d42c4e73f023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7981d8ad22c3493ea724d42c4e73f023, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.981652  4397 raft_consensus.cc:740] T 9303514156d64c4fa32695ae08535d20 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f2222fc10ea4fb2be4e17e7c999a7c1, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.982301  4396 consensus_queue.cc:260] T 9303514156d64c4fa32695ae08535d20 P 7981d8ad22c3493ea724d42c4e73f023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } } peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } }
I20260709 13:12:55.982630  4397 consensus_queue.cc:260] T 9303514156d64c4fa32695ae08535d20 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } } peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } }
I20260709 13:12:55.984622  4398 tablet_bootstrap.cc:492] T 65234ae56a6846d69fbea66ac66aeb9f P 5917eb98fb7349f6bc42bb33140fd4d6: No bootstrap required, opened a new log
I20260709 13:12:55.985095  4398 ts_tablet_manager.cc:1403] T 65234ae56a6846d69fbea66ac66aeb9f P 5917eb98fb7349f6bc42bb33140fd4d6: Time spent bootstrapping tablet: real 0.012s	user 0.003s	sys 0.006s
I20260709 13:12:55.987749  4308 heartbeater.cc:499] Master 127.28.54.126:46005 was elected leader, sending a full tablet report...
I20260709 13:12:55.988090  4382 heartbeater.cc:499] Master 127.28.54.126:46005 was elected leader, sending a full tablet report...
I20260709 13:12:55.989231  4398 raft_consensus.cc:359] T 65234ae56a6846d69fbea66ac66aeb9f P 5917eb98fb7349f6bc42bb33140fd4d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } } peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } }
I20260709 13:12:55.987785  4396 ts_tablet_manager.cc:1434] T 9303514156d64c4fa32695ae08535d20 P 7981d8ad22c3493ea724d42c4e73f023: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.004s
I20260709 13:12:55.989916  4398 raft_consensus.cc:385] T 65234ae56a6846d69fbea66ac66aeb9f P 5917eb98fb7349f6bc42bb33140fd4d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:55.990303  4397 ts_tablet_manager.cc:1434] T 9303514156d64c4fa32695ae08535d20 P 9f2222fc10ea4fb2be4e17e7c999a7c1: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.006s
I20260709 13:12:55.990272  4398 raft_consensus.cc:740] T 65234ae56a6846d69fbea66ac66aeb9f P 5917eb98fb7349f6bc42bb33140fd4d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5917eb98fb7349f6bc42bb33140fd4d6, State: Initialized, Role: FOLLOWER
I20260709 13:12:55.990671  4396 tablet_bootstrap.cc:492] T 65234ae56a6846d69fbea66ac66aeb9f P 7981d8ad22c3493ea724d42c4e73f023: Bootstrap starting.
I20260709 13:12:55.991397  4397 tablet_bootstrap.cc:492] T 65234ae56a6846d69fbea66ac66aeb9f P 9f2222fc10ea4fb2be4e17e7c999a7c1: Bootstrap starting.
I20260709 13:12:55.991451  4398 consensus_queue.cc:260] T 65234ae56a6846d69fbea66ac66aeb9f P 5917eb98fb7349f6bc42bb33140fd4d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } } peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } }
I20260709 13:12:55.997844  4396 tablet_bootstrap.cc:654] T 65234ae56a6846d69fbea66ac66aeb9f P 7981d8ad22c3493ea724d42c4e73f023: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:55.998481  4397 tablet_bootstrap.cc:654] T 65234ae56a6846d69fbea66ac66aeb9f P 9f2222fc10ea4fb2be4e17e7c999a7c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:56.001569  4398 ts_tablet_manager.cc:1434] T 65234ae56a6846d69fbea66ac66aeb9f P 5917eb98fb7349f6bc42bb33140fd4d6: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.008s
I20260709 13:12:56.002360  4233 heartbeater.cc:499] Master 127.28.54.126:46005 was elected leader, sending a full tablet report...
I20260709 13:12:56.016848  4398 tablet_bootstrap.cc:492] T 9303514156d64c4fa32695ae08535d20 P 5917eb98fb7349f6bc42bb33140fd4d6: Bootstrap starting.
I20260709 13:12:56.020429  4396 tablet_bootstrap.cc:492] T 65234ae56a6846d69fbea66ac66aeb9f P 7981d8ad22c3493ea724d42c4e73f023: No bootstrap required, opened a new log
I20260709 13:12:56.020920  4396 ts_tablet_manager.cc:1403] T 65234ae56a6846d69fbea66ac66aeb9f P 7981d8ad22c3493ea724d42c4e73f023: Time spent bootstrapping tablet: real 0.030s	user 0.009s	sys 0.019s
I20260709 13:12:56.021072  4397 tablet_bootstrap.cc:492] T 65234ae56a6846d69fbea66ac66aeb9f P 9f2222fc10ea4fb2be4e17e7c999a7c1: No bootstrap required, opened a new log
I20260709 13:12:56.021613  4397 ts_tablet_manager.cc:1403] T 65234ae56a6846d69fbea66ac66aeb9f P 9f2222fc10ea4fb2be4e17e7c999a7c1: Time spent bootstrapping tablet: real 0.030s	user 0.024s	sys 0.004s
I20260709 13:12:56.022929  4398 tablet_bootstrap.cc:654] T 9303514156d64c4fa32695ae08535d20 P 5917eb98fb7349f6bc42bb33140fd4d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:56.023603  4396 raft_consensus.cc:359] T 65234ae56a6846d69fbea66ac66aeb9f P 7981d8ad22c3493ea724d42c4e73f023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } } peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } }
I20260709 13:12:56.024336  4396 raft_consensus.cc:385] T 65234ae56a6846d69fbea66ac66aeb9f P 7981d8ad22c3493ea724d42c4e73f023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.024616  4396 raft_consensus.cc:740] T 65234ae56a6846d69fbea66ac66aeb9f P 7981d8ad22c3493ea724d42c4e73f023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7981d8ad22c3493ea724d42c4e73f023, State: Initialized, Role: FOLLOWER
I20260709 13:12:56.024564  4397 raft_consensus.cc:359] T 65234ae56a6846d69fbea66ac66aeb9f P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } } peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } }
I20260709 13:12:56.025399  4397 raft_consensus.cc:385] T 65234ae56a6846d69fbea66ac66aeb9f P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.025708  4397 raft_consensus.cc:740] T 65234ae56a6846d69fbea66ac66aeb9f P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f2222fc10ea4fb2be4e17e7c999a7c1, State: Initialized, Role: FOLLOWER
I20260709 13:12:56.025620  4396 consensus_queue.cc:260] T 65234ae56a6846d69fbea66ac66aeb9f P 7981d8ad22c3493ea724d42c4e73f023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } } peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } }
I20260709 13:12:56.026721  4397 consensus_queue.cc:260] T 65234ae56a6846d69fbea66ac66aeb9f P 9f2222fc10ea4fb2be4e17e7c999a7c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } } peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } }
I20260709 13:12:56.028030  4396 ts_tablet_manager.cc:1434] T 65234ae56a6846d69fbea66ac66aeb9f P 7981d8ad22c3493ea724d42c4e73f023: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:12:56.028427  4398 tablet_bootstrap.cc:492] T 9303514156d64c4fa32695ae08535d20 P 5917eb98fb7349f6bc42bb33140fd4d6: No bootstrap required, opened a new log
I20260709 13:12:56.028968  4398 ts_tablet_manager.cc:1403] T 9303514156d64c4fa32695ae08535d20 P 5917eb98fb7349f6bc42bb33140fd4d6: Time spent bootstrapping tablet: real 0.012s	user 0.009s	sys 0.003s
I20260709 13:12:56.029908  4397 ts_tablet_manager.cc:1434] T 65234ae56a6846d69fbea66ac66aeb9f P 9f2222fc10ea4fb2be4e17e7c999a7c1: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 13:12:56.031982  4398 raft_consensus.cc:359] T 9303514156d64c4fa32695ae08535d20 P 5917eb98fb7349f6bc42bb33140fd4d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } } peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } }
I20260709 13:12:56.032722  4398 raft_consensus.cc:385] T 9303514156d64c4fa32695ae08535d20 P 5917eb98fb7349f6bc42bb33140fd4d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.033390  4398 raft_consensus.cc:740] T 9303514156d64c4fa32695ae08535d20 P 5917eb98fb7349f6bc42bb33140fd4d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5917eb98fb7349f6bc42bb33140fd4d6, State: Initialized, Role: FOLLOWER
I20260709 13:12:56.034076  4398 consensus_queue.cc:260] T 9303514156d64c4fa32695ae08535d20 P 5917eb98fb7349f6bc42bb33140fd4d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } } peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } }
I20260709 13:12:56.035990  4398 ts_tablet_manager.cc:1434] T 9303514156d64c4fa32695ae08535d20 P 5917eb98fb7349f6bc42bb33140fd4d6: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:12:56.038985  4403 raft_consensus.cc:493] T 65234ae56a6846d69fbea66ac66aeb9f P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.039490  4403 raft_consensus.cc:515] T 65234ae56a6846d69fbea66ac66aeb9f P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } } peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } }
I20260709 13:12:56.041680  4403 leader_election.cc:290] T 65234ae56a6846d69fbea66ac66aeb9f P 9f2222fc10ea4fb2be4e17e7c999a7c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7981d8ad22c3493ea724d42c4e73f023 (127.28.54.67:34891), 5917eb98fb7349f6bc42bb33140fd4d6 (127.28.54.65:34143)
I20260709 13:12:56.048149  4404 raft_consensus.cc:493] T 65234ae56a6846d69fbea66ac66aeb9f P 5917eb98fb7349f6bc42bb33140fd4d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.048674  4404 raft_consensus.cc:515] T 65234ae56a6846d69fbea66ac66aeb9f P 5917eb98fb7349f6bc42bb33140fd4d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } } peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } }
I20260709 13:12:56.051394  4404 leader_election.cc:290] T 65234ae56a6846d69fbea66ac66aeb9f P 5917eb98fb7349f6bc42bb33140fd4d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7981d8ad22c3493ea724d42c4e73f023 (127.28.54.67:34891), 9f2222fc10ea4fb2be4e17e7c999a7c1 (127.28.54.66:35433)
I20260709 13:12:56.053311  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65234ae56a6846d69fbea66ac66aeb9f" candidate_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7981d8ad22c3493ea724d42c4e73f023" is_pre_election: true
I20260709 13:12:56.054134  4357 raft_consensus.cc:2468] T 65234ae56a6846d69fbea66ac66aeb9f P 7981d8ad22c3493ea724d42c4e73f023 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f2222fc10ea4fb2be4e17e7c999a7c1 in term 0.
I20260709 13:12:56.055384  4246 leader_election.cc:304] T 65234ae56a6846d69fbea66ac66aeb9f P 9f2222fc10ea4fb2be4e17e7c999a7c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7981d8ad22c3493ea724d42c4e73f023, 9f2222fc10ea4fb2be4e17e7c999a7c1; no voters: 
I20260709 13:12:56.056195  4403 raft_consensus.cc:2804] T 65234ae56a6846d69fbea66ac66aeb9f P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:56.056473  4208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65234ae56a6846d69fbea66ac66aeb9f" candidate_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" is_pre_election: true
I20260709 13:12:56.056557  4403 raft_consensus.cc:493] T 65234ae56a6846d69fbea66ac66aeb9f P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:56.057042  4403 raft_consensus.cc:3060] T 65234ae56a6846d69fbea66ac66aeb9f P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.057041  4208 raft_consensus.cc:2468] T 65234ae56a6846d69fbea66ac66aeb9f P 5917eb98fb7349f6bc42bb33140fd4d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f2222fc10ea4fb2be4e17e7c999a7c1 in term 0.
I20260709 13:12:56.063081  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65234ae56a6846d69fbea66ac66aeb9f" candidate_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7981d8ad22c3493ea724d42c4e73f023" is_pre_election: true
I20260709 13:12:56.063649  4357 raft_consensus.cc:2468] T 65234ae56a6846d69fbea66ac66aeb9f P 7981d8ad22c3493ea724d42c4e73f023 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5917eb98fb7349f6bc42bb33140fd4d6 in term 0.
I20260709 13:12:56.064432  4403 raft_consensus.cc:515] T 65234ae56a6846d69fbea66ac66aeb9f P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } } peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } }
I20260709 13:12:56.064718  4171 leader_election.cc:304] T 65234ae56a6846d69fbea66ac66aeb9f P 5917eb98fb7349f6bc42bb33140fd4d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5917eb98fb7349f6bc42bb33140fd4d6, 7981d8ad22c3493ea724d42c4e73f023; no voters: 
I20260709 13:12:56.065465  4404 raft_consensus.cc:2804] T 65234ae56a6846d69fbea66ac66aeb9f P 5917eb98fb7349f6bc42bb33140fd4d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:56.065835  4404 raft_consensus.cc:493] T 65234ae56a6846d69fbea66ac66aeb9f P 5917eb98fb7349f6bc42bb33140fd4d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:56.066051  4403 leader_election.cc:290] T 65234ae56a6846d69fbea66ac66aeb9f P 9f2222fc10ea4fb2be4e17e7c999a7c1 [CANDIDATE]: Term 1 election: Requested vote from peers 7981d8ad22c3493ea724d42c4e73f023 (127.28.54.67:34891), 5917eb98fb7349f6bc42bb33140fd4d6 (127.28.54.65:34143)
I20260709 13:12:56.066143  4404 raft_consensus.cc:3060] T 65234ae56a6846d69fbea66ac66aeb9f P 5917eb98fb7349f6bc42bb33140fd4d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.066987  4208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65234ae56a6846d69fbea66ac66aeb9f" candidate_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5917eb98fb7349f6bc42bb33140fd4d6"
I20260709 13:12:56.067066  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65234ae56a6846d69fbea66ac66aeb9f" candidate_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7981d8ad22c3493ea724d42c4e73f023"
I20260709 13:12:56.067690  4357 raft_consensus.cc:3060] T 65234ae56a6846d69fbea66ac66aeb9f P 7981d8ad22c3493ea724d42c4e73f023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.070809  4283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65234ae56a6846d69fbea66ac66aeb9f" candidate_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" is_pre_election: true
I20260709 13:12:56.071657  4283 raft_consensus.cc:2393] T 65234ae56a6846d69fbea66ac66aeb9f P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5917eb98fb7349f6bc42bb33140fd4d6 in current term 1: Already voted for candidate 9f2222fc10ea4fb2be4e17e7c999a7c1 in this term.
I20260709 13:12:56.073304  4404 raft_consensus.cc:515] T 65234ae56a6846d69fbea66ac66aeb9f P 5917eb98fb7349f6bc42bb33140fd4d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } } peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } }
I20260709 13:12:56.074288  4208 raft_consensus.cc:2393] T 65234ae56a6846d69fbea66ac66aeb9f P 5917eb98fb7349f6bc42bb33140fd4d6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 9f2222fc10ea4fb2be4e17e7c999a7c1 in current term 1: Already voted for candidate 5917eb98fb7349f6bc42bb33140fd4d6 in this term.
I20260709 13:12:56.074738  4357 raft_consensus.cc:2468] T 65234ae56a6846d69fbea66ac66aeb9f P 7981d8ad22c3493ea724d42c4e73f023 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f2222fc10ea4fb2be4e17e7c999a7c1 in term 1.
I20260709 13:12:56.074874  4404 leader_election.cc:290] T 65234ae56a6846d69fbea66ac66aeb9f P 5917eb98fb7349f6bc42bb33140fd4d6 [CANDIDATE]: Term 1 election: Requested vote from peers 7981d8ad22c3493ea724d42c4e73f023 (127.28.54.67:34891), 9f2222fc10ea4fb2be4e17e7c999a7c1 (127.28.54.66:35433)
I20260709 13:12:56.075981  4246 leader_election.cc:304] T 65234ae56a6846d69fbea66ac66aeb9f P 9f2222fc10ea4fb2be4e17e7c999a7c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7981d8ad22c3493ea724d42c4e73f023, 9f2222fc10ea4fb2be4e17e7c999a7c1; no voters: 
I20260709 13:12:56.077045  4403 raft_consensus.cc:2804] T 65234ae56a6846d69fbea66ac66aeb9f P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:56.077016  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65234ae56a6846d69fbea66ac66aeb9f" candidate_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7981d8ad22c3493ea724d42c4e73f023"
I20260709 13:12:56.077539  4283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65234ae56a6846d69fbea66ac66aeb9f" candidate_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1"
I20260709 13:12:56.077971  4357 raft_consensus.cc:2393] T 65234ae56a6846d69fbea66ac66aeb9f P 7981d8ad22c3493ea724d42c4e73f023 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5917eb98fb7349f6bc42bb33140fd4d6 in current term 1: Already voted for candidate 9f2222fc10ea4fb2be4e17e7c999a7c1 in this term.
I20260709 13:12:56.078406  4403 raft_consensus.cc:697] T 65234ae56a6846d69fbea66ac66aeb9f P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 1 LEADER]: Becoming Leader. State: Replica: 9f2222fc10ea4fb2be4e17e7c999a7c1, State: Running, Role: LEADER
I20260709 13:12:56.080024  4403 consensus_queue.cc:237] T 65234ae56a6846d69fbea66ac66aeb9f P 9f2222fc10ea4fb2be4e17e7c999a7c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } } peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } }
I20260709 13:12:56.086588  4171 leader_election.cc:304] T 65234ae56a6846d69fbea66ac66aeb9f P 5917eb98fb7349f6bc42bb33140fd4d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5917eb98fb7349f6bc42bb33140fd4d6; no voters: 7981d8ad22c3493ea724d42c4e73f023, 9f2222fc10ea4fb2be4e17e7c999a7c1
I20260709 13:12:56.087296  4404 raft_consensus.cc:2749] T 65234ae56a6846d69fbea66ac66aeb9f P 5917eb98fb7349f6bc42bb33140fd4d6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:12:56.089399  4104 catalog_manager.cc:5697] T 65234ae56a6846d69fbea66ac66aeb9f P 9f2222fc10ea4fb2be4e17e7c999a7c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f2222fc10ea4fb2be4e17e7c999a7c1 (127.28.54.66). New cstate: current_term: 1 leader_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:56.386897  4404 raft_consensus.cc:493] T 9303514156d64c4fa32695ae08535d20 P 5917eb98fb7349f6bc42bb33140fd4d6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.387470  4404 raft_consensus.cc:515] T 9303514156d64c4fa32695ae08535d20 P 5917eb98fb7349f6bc42bb33140fd4d6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } } peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } }
I20260709 13:12:56.389076  4404 leader_election.cc:290] T 9303514156d64c4fa32695ae08535d20 P 5917eb98fb7349f6bc42bb33140fd4d6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9f2222fc10ea4fb2be4e17e7c999a7c1 (127.28.54.66:35433), 7981d8ad22c3493ea724d42c4e73f023 (127.28.54.67:34891)
I20260709 13:12:56.389708  4283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9303514156d64c4fa32695ae08535d20" candidate_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" is_pre_election: true
I20260709 13:12:56.390041  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9303514156d64c4fa32695ae08535d20" candidate_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7981d8ad22c3493ea724d42c4e73f023" is_pre_election: true
I20260709 13:12:56.390424  4283 raft_consensus.cc:2468] T 9303514156d64c4fa32695ae08535d20 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5917eb98fb7349f6bc42bb33140fd4d6 in term 0.
I20260709 13:12:56.390641  4357 raft_consensus.cc:2468] T 9303514156d64c4fa32695ae08535d20 P 7981d8ad22c3493ea724d42c4e73f023 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5917eb98fb7349f6bc42bb33140fd4d6 in term 0.
I20260709 13:12:56.391449  4171 leader_election.cc:304] T 9303514156d64c4fa32695ae08535d20 P 5917eb98fb7349f6bc42bb33140fd4d6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5917eb98fb7349f6bc42bb33140fd4d6, 9f2222fc10ea4fb2be4e17e7c999a7c1; no voters: 
I20260709 13:12:56.392031  4404 raft_consensus.cc:2804] T 9303514156d64c4fa32695ae08535d20 P 5917eb98fb7349f6bc42bb33140fd4d6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:56.392294  4404 raft_consensus.cc:493] T 9303514156d64c4fa32695ae08535d20 P 5917eb98fb7349f6bc42bb33140fd4d6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:56.392544  4404 raft_consensus.cc:3060] T 9303514156d64c4fa32695ae08535d20 P 5917eb98fb7349f6bc42bb33140fd4d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.397270  4404 raft_consensus.cc:515] T 9303514156d64c4fa32695ae08535d20 P 5917eb98fb7349f6bc42bb33140fd4d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } } peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } }
I20260709 13:12:56.398833  4404 leader_election.cc:290] T 9303514156d64c4fa32695ae08535d20 P 5917eb98fb7349f6bc42bb33140fd4d6 [CANDIDATE]: Term 1 election: Requested vote from peers 9f2222fc10ea4fb2be4e17e7c999a7c1 (127.28.54.66:35433), 7981d8ad22c3493ea724d42c4e73f023 (127.28.54.67:34891)
I20260709 13:12:56.399650  4283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9303514156d64c4fa32695ae08535d20" candidate_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1"
I20260709 13:12:56.399737  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9303514156d64c4fa32695ae08535d20" candidate_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7981d8ad22c3493ea724d42c4e73f023"
I20260709 13:12:56.400242  4283 raft_consensus.cc:3060] T 9303514156d64c4fa32695ae08535d20 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.400362  4357 raft_consensus.cc:3060] T 9303514156d64c4fa32695ae08535d20 P 7981d8ad22c3493ea724d42c4e73f023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.405133  4283 raft_consensus.cc:2468] T 9303514156d64c4fa32695ae08535d20 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5917eb98fb7349f6bc42bb33140fd4d6 in term 1.
I20260709 13:12:56.405233  4357 raft_consensus.cc:2468] T 9303514156d64c4fa32695ae08535d20 P 7981d8ad22c3493ea724d42c4e73f023 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5917eb98fb7349f6bc42bb33140fd4d6 in term 1.
I20260709 13:12:56.406075  4171 leader_election.cc:304] T 9303514156d64c4fa32695ae08535d20 P 5917eb98fb7349f6bc42bb33140fd4d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5917eb98fb7349f6bc42bb33140fd4d6, 9f2222fc10ea4fb2be4e17e7c999a7c1; no voters: 
I20260709 13:12:56.406656  4404 raft_consensus.cc:2804] T 9303514156d64c4fa32695ae08535d20 P 5917eb98fb7349f6bc42bb33140fd4d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:56.407428  4404 raft_consensus.cc:697] T 9303514156d64c4fa32695ae08535d20 P 5917eb98fb7349f6bc42bb33140fd4d6 [term 1 LEADER]: Becoming Leader. State: Replica: 5917eb98fb7349f6bc42bb33140fd4d6, State: Running, Role: LEADER
I20260709 13:12:56.408059  4404 consensus_queue.cc:237] T 9303514156d64c4fa32695ae08535d20 P 5917eb98fb7349f6bc42bb33140fd4d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } } peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } }
I20260709 13:12:56.414044  4104 catalog_manager.cc:5697] T 9303514156d64c4fa32695ae08535d20 P 5917eb98fb7349f6bc42bb33140fd4d6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5917eb98fb7349f6bc42bb33140fd4d6 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:56.510615  4403 consensus_queue.cc:1048] T 65234ae56a6846d69fbea66ac66aeb9f P 9f2222fc10ea4fb2be4e17e7c999a7c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:56.524439  4403 consensus_queue.cc:1048] T 65234ae56a6846d69fbea66ac66aeb9f P 9f2222fc10ea4fb2be4e17e7c999a7c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:56.524247  4104 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41646:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:12:56.527482  4104 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:12:56.554723  4198 tablet_service.cc:1511] Processing CreateTablet for tablet 31e7df492de84ae990f655e6f8bf06f3 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=cbebd4c8745b47e5ad2f16c6d5d77192]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:12:56.555984  4198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31e7df492de84ae990f655e6f8bf06f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.556593  4272 tablet_service.cc:1511] Processing CreateTablet for tablet 31e7df492de84ae990f655e6f8bf06f3 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=cbebd4c8745b47e5ad2f16c6d5d77192]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:12:56.557528  4272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31e7df492de84ae990f655e6f8bf06f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.559731  4347 tablet_service.cc:1511] Processing CreateTablet for tablet 31e7df492de84ae990f655e6f8bf06f3 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=cbebd4c8745b47e5ad2f16c6d5d77192]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 13:12:56.560475  4197 tablet_service.cc:1511] Processing CreateTablet for tablet 7c481aab50ad4294a1661a3044e214a3 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=cbebd4c8745b47e5ad2f16c6d5d77192]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:12:56.560573  4273 tablet_service.cc:1511] Processing CreateTablet for tablet 7c481aab50ad4294a1661a3044e214a3 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=cbebd4c8745b47e5ad2f16c6d5d77192]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:12:56.561452  4197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c481aab50ad4294a1661a3044e214a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.561846  4273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c481aab50ad4294a1661a3044e214a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.560936  4347 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 31e7df492de84ae990f655e6f8bf06f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.563812  4346 tablet_service.cc:1511] Processing CreateTablet for tablet 7c481aab50ad4294a1661a3044e214a3 (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=cbebd4c8745b47e5ad2f16c6d5d77192]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 13:12:56.565054  4346 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7c481aab50ad4294a1661a3044e214a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:56.584638  4427 tablet_bootstrap.cc:492] T 7c481aab50ad4294a1661a3044e214a3 P 9f2222fc10ea4fb2be4e17e7c999a7c1: Bootstrap starting.
I20260709 13:12:56.592724  4429 tablet_bootstrap.cc:492] T 31e7df492de84ae990f655e6f8bf06f3 P 7981d8ad22c3493ea724d42c4e73f023: Bootstrap starting.
I20260709 13:12:56.594282  4427 tablet_bootstrap.cc:654] T 7c481aab50ad4294a1661a3044e214a3 P 9f2222fc10ea4fb2be4e17e7c999a7c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:56.595459  4428 tablet_bootstrap.cc:492] T 7c481aab50ad4294a1661a3044e214a3 P 5917eb98fb7349f6bc42bb33140fd4d6: Bootstrap starting.
I20260709 13:12:56.599980  4427 tablet_bootstrap.cc:492] T 7c481aab50ad4294a1661a3044e214a3 P 9f2222fc10ea4fb2be4e17e7c999a7c1: No bootstrap required, opened a new log
I20260709 13:12:56.600493  4427 ts_tablet_manager.cc:1403] T 7c481aab50ad4294a1661a3044e214a3 P 9f2222fc10ea4fb2be4e17e7c999a7c1: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.000s
I20260709 13:12:56.602417  4429 tablet_bootstrap.cc:654] T 31e7df492de84ae990f655e6f8bf06f3 P 7981d8ad22c3493ea724d42c4e73f023: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:56.603369  4427 raft_consensus.cc:359] T 7c481aab50ad4294a1661a3044e214a3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } } peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } }
I20260709 13:12:56.604183  4427 raft_consensus.cc:385] T 7c481aab50ad4294a1661a3044e214a3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.604473  4427 raft_consensus.cc:740] T 7c481aab50ad4294a1661a3044e214a3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f2222fc10ea4fb2be4e17e7c999a7c1, State: Initialized, Role: FOLLOWER
I20260709 13:12:56.605265  4427 consensus_queue.cc:260] T 7c481aab50ad4294a1661a3044e214a3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } } peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } }
I20260709 13:12:56.606199  4428 tablet_bootstrap.cc:654] T 7c481aab50ad4294a1661a3044e214a3 P 5917eb98fb7349f6bc42bb33140fd4d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:56.607331  4427 ts_tablet_manager.cc:1434] T 7c481aab50ad4294a1661a3044e214a3 P 9f2222fc10ea4fb2be4e17e7c999a7c1: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.006s
I20260709 13:12:56.607969  4429 tablet_bootstrap.cc:492] T 31e7df492de84ae990f655e6f8bf06f3 P 7981d8ad22c3493ea724d42c4e73f023: No bootstrap required, opened a new log
I20260709 13:12:56.608347  4427 tablet_bootstrap.cc:492] T 31e7df492de84ae990f655e6f8bf06f3 P 9f2222fc10ea4fb2be4e17e7c999a7c1: Bootstrap starting.
I20260709 13:12:56.608506  4429 ts_tablet_manager.cc:1403] T 31e7df492de84ae990f655e6f8bf06f3 P 7981d8ad22c3493ea724d42c4e73f023: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.000s
I20260709 13:12:56.611512  4429 raft_consensus.cc:359] T 31e7df492de84ae990f655e6f8bf06f3 P 7981d8ad22c3493ea724d42c4e73f023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } } peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } }
I20260709 13:12:56.612317  4429 raft_consensus.cc:385] T 31e7df492de84ae990f655e6f8bf06f3 P 7981d8ad22c3493ea724d42c4e73f023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.612663  4429 raft_consensus.cc:740] T 31e7df492de84ae990f655e6f8bf06f3 P 7981d8ad22c3493ea724d42c4e73f023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7981d8ad22c3493ea724d42c4e73f023, State: Initialized, Role: FOLLOWER
I20260709 13:12:56.613569  4429 consensus_queue.cc:260] T 31e7df492de84ae990f655e6f8bf06f3 P 7981d8ad22c3493ea724d42c4e73f023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } } peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } }
I20260709 13:12:56.615309  4427 tablet_bootstrap.cc:654] T 31e7df492de84ae990f655e6f8bf06f3 P 9f2222fc10ea4fb2be4e17e7c999a7c1: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:56.620445  4410 raft_consensus.cc:493] T 7c481aab50ad4294a1661a3044e214a3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.620977  4410 raft_consensus.cc:515] T 7c481aab50ad4294a1661a3044e214a3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } } peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } }
I20260709 13:12:56.623104  4410 leader_election.cc:290] T 7c481aab50ad4294a1661a3044e214a3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5917eb98fb7349f6bc42bb33140fd4d6 (127.28.54.65:34143), 7981d8ad22c3493ea724d42c4e73f023 (127.28.54.67:34891)
I20260709 13:12:56.625675  4208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c481aab50ad4294a1661a3044e214a3" candidate_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" is_pre_election: true
I20260709 13:12:56.627101  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c481aab50ad4294a1661a3044e214a3" candidate_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7981d8ad22c3493ea724d42c4e73f023" is_pre_election: true
I20260709 13:12:56.629283  4429 ts_tablet_manager.cc:1434] T 31e7df492de84ae990f655e6f8bf06f3 P 7981d8ad22c3493ea724d42c4e73f023: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
W20260709 13:12:56.629417  4246 leader_election.cc:343] T 7c481aab50ad4294a1661a3044e214a3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5917eb98fb7349f6bc42bb33140fd4d6 (127.28.54.65:34143): Illegal state: must be running to vote when last-logged opid is not known
W20260709 13:12:56.630223  4246 leader_election.cc:343] T 7c481aab50ad4294a1661a3044e214a3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7981d8ad22c3493ea724d42c4e73f023 (127.28.54.67:34891): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:56.630627  4246 leader_election.cc:304] T 7c481aab50ad4294a1661a3044e214a3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9f2222fc10ea4fb2be4e17e7c999a7c1; no voters: 5917eb98fb7349f6bc42bb33140fd4d6, 7981d8ad22c3493ea724d42c4e73f023
I20260709 13:12:56.632556  4410 raft_consensus.cc:2749] T 7c481aab50ad4294a1661a3044e214a3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:56.636439  4428 tablet_bootstrap.cc:492] T 7c481aab50ad4294a1661a3044e214a3 P 5917eb98fb7349f6bc42bb33140fd4d6: No bootstrap required, opened a new log
I20260709 13:12:56.636920  4428 ts_tablet_manager.cc:1403] T 7c481aab50ad4294a1661a3044e214a3 P 5917eb98fb7349f6bc42bb33140fd4d6: Time spent bootstrapping tablet: real 0.042s	user 0.019s	sys 0.016s
I20260709 13:12:56.637787  4429 tablet_bootstrap.cc:492] T 7c481aab50ad4294a1661a3044e214a3 P 7981d8ad22c3493ea724d42c4e73f023: Bootstrap starting.
I20260709 13:12:56.639099  4428 raft_consensus.cc:359] T 7c481aab50ad4294a1661a3044e214a3 P 5917eb98fb7349f6bc42bb33140fd4d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } } peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } }
I20260709 13:12:56.639642  4428 raft_consensus.cc:385] T 7c481aab50ad4294a1661a3044e214a3 P 5917eb98fb7349f6bc42bb33140fd4d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.639860  4428 raft_consensus.cc:740] T 7c481aab50ad4294a1661a3044e214a3 P 5917eb98fb7349f6bc42bb33140fd4d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5917eb98fb7349f6bc42bb33140fd4d6, State: Initialized, Role: FOLLOWER
I20260709 13:12:56.640478  4428 consensus_queue.cc:260] T 7c481aab50ad4294a1661a3044e214a3 P 5917eb98fb7349f6bc42bb33140fd4d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } } peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } }
I20260709 13:12:56.642380  4428 ts_tablet_manager.cc:1434] T 7c481aab50ad4294a1661a3044e214a3 P 5917eb98fb7349f6bc42bb33140fd4d6: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:12:56.643383  4428 tablet_bootstrap.cc:492] T 31e7df492de84ae990f655e6f8bf06f3 P 5917eb98fb7349f6bc42bb33140fd4d6: Bootstrap starting.
I20260709 13:12:56.645212  4429 tablet_bootstrap.cc:654] T 7c481aab50ad4294a1661a3044e214a3 P 7981d8ad22c3493ea724d42c4e73f023: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:56.651150  4428 tablet_bootstrap.cc:654] T 31e7df492de84ae990f655e6f8bf06f3 P 5917eb98fb7349f6bc42bb33140fd4d6: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:56.652416  4427 tablet_bootstrap.cc:492] T 31e7df492de84ae990f655e6f8bf06f3 P 9f2222fc10ea4fb2be4e17e7c999a7c1: No bootstrap required, opened a new log
I20260709 13:12:56.652992  4427 ts_tablet_manager.cc:1403] T 31e7df492de84ae990f655e6f8bf06f3 P 9f2222fc10ea4fb2be4e17e7c999a7c1: Time spent bootstrapping tablet: real 0.045s	user 0.018s	sys 0.025s
I20260709 13:12:56.656291  4427 raft_consensus.cc:359] T 31e7df492de84ae990f655e6f8bf06f3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } } peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } }
I20260709 13:12:56.657045  4427 raft_consensus.cc:385] T 31e7df492de84ae990f655e6f8bf06f3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.657334  4427 raft_consensus.cc:740] T 31e7df492de84ae990f655e6f8bf06f3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9f2222fc10ea4fb2be4e17e7c999a7c1, State: Initialized, Role: FOLLOWER
I20260709 13:12:56.658016  4427 consensus_queue.cc:260] T 31e7df492de84ae990f655e6f8bf06f3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } } peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } }
I20260709 13:12:56.659559  4429 tablet_bootstrap.cc:492] T 7c481aab50ad4294a1661a3044e214a3 P 7981d8ad22c3493ea724d42c4e73f023: No bootstrap required, opened a new log
I20260709 13:12:56.660064  4429 ts_tablet_manager.cc:1403] T 7c481aab50ad4294a1661a3044e214a3 P 7981d8ad22c3493ea724d42c4e73f023: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.005s
I20260709 13:12:56.660085  4427 ts_tablet_manager.cc:1434] T 31e7df492de84ae990f655e6f8bf06f3 P 9f2222fc10ea4fb2be4e17e7c999a7c1: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:12:56.662214  4428 tablet_bootstrap.cc:492] T 31e7df492de84ae990f655e6f8bf06f3 P 5917eb98fb7349f6bc42bb33140fd4d6: No bootstrap required, opened a new log
I20260709 13:12:56.665525  4428 ts_tablet_manager.cc:1403] T 31e7df492de84ae990f655e6f8bf06f3 P 5917eb98fb7349f6bc42bb33140fd4d6: Time spent bootstrapping tablet: real 0.022s	user 0.007s	sys 0.011s
I20260709 13:12:56.667054  4429 raft_consensus.cc:359] T 7c481aab50ad4294a1661a3044e214a3 P 7981d8ad22c3493ea724d42c4e73f023 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } } peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } }
I20260709 13:12:56.667732  4429 raft_consensus.cc:385] T 7c481aab50ad4294a1661a3044e214a3 P 7981d8ad22c3493ea724d42c4e73f023 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.667994  4429 raft_consensus.cc:740] T 7c481aab50ad4294a1661a3044e214a3 P 7981d8ad22c3493ea724d42c4e73f023 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7981d8ad22c3493ea724d42c4e73f023, State: Initialized, Role: FOLLOWER
I20260709 13:12:56.668350  4428 raft_consensus.cc:359] T 31e7df492de84ae990f655e6f8bf06f3 P 5917eb98fb7349f6bc42bb33140fd4d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } } peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } }
I20260709 13:12:56.668704  4429 consensus_queue.cc:260] T 7c481aab50ad4294a1661a3044e214a3 P 7981d8ad22c3493ea724d42c4e73f023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } } peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } }
I20260709 13:12:56.669057  4428 raft_consensus.cc:385] T 31e7df492de84ae990f655e6f8bf06f3 P 5917eb98fb7349f6bc42bb33140fd4d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:56.669400  4428 raft_consensus.cc:740] T 31e7df492de84ae990f655e6f8bf06f3 P 5917eb98fb7349f6bc42bb33140fd4d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5917eb98fb7349f6bc42bb33140fd4d6, State: Initialized, Role: FOLLOWER
I20260709 13:12:56.670115  4428 consensus_queue.cc:260] T 31e7df492de84ae990f655e6f8bf06f3 P 5917eb98fb7349f6bc42bb33140fd4d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } } peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } }
I20260709 13:12:56.670816  4429 ts_tablet_manager.cc:1434] T 7c481aab50ad4294a1661a3044e214a3 P 7981d8ad22c3493ea724d42c4e73f023: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.005s
I20260709 13:12:56.672246  4428 ts_tablet_manager.cc:1434] T 31e7df492de84ae990f655e6f8bf06f3 P 5917eb98fb7349f6bc42bb33140fd4d6: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:12:56.709586  4410 raft_consensus.cc:493] T 31e7df492de84ae990f655e6f8bf06f3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.710086  4410 raft_consensus.cc:515] T 31e7df492de84ae990f655e6f8bf06f3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } } peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } }
I20260709 13:12:56.711591  4410 leader_election.cc:290] T 31e7df492de84ae990f655e6f8bf06f3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5917eb98fb7349f6bc42bb33140fd4d6 (127.28.54.65:34143), 7981d8ad22c3493ea724d42c4e73f023 (127.28.54.67:34891)
I20260709 13:12:56.712327  4208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e7df492de84ae990f655e6f8bf06f3" candidate_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" is_pre_election: true
I20260709 13:12:56.712497  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e7df492de84ae990f655e6f8bf06f3" candidate_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7981d8ad22c3493ea724d42c4e73f023" is_pre_election: true
I20260709 13:12:56.712885  4208 raft_consensus.cc:2468] T 31e7df492de84ae990f655e6f8bf06f3 P 5917eb98fb7349f6bc42bb33140fd4d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f2222fc10ea4fb2be4e17e7c999a7c1 in term 0.
I20260709 13:12:56.713061  4357 raft_consensus.cc:2468] T 31e7df492de84ae990f655e6f8bf06f3 P 7981d8ad22c3493ea724d42c4e73f023 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9f2222fc10ea4fb2be4e17e7c999a7c1 in term 0.
I20260709 13:12:56.713783  4246 leader_election.cc:304] T 31e7df492de84ae990f655e6f8bf06f3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5917eb98fb7349f6bc42bb33140fd4d6, 9f2222fc10ea4fb2be4e17e7c999a7c1; no voters: 
I20260709 13:12:56.714365  4410 raft_consensus.cc:2804] T 31e7df492de84ae990f655e6f8bf06f3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:56.714617  4410 raft_consensus.cc:493] T 31e7df492de84ae990f655e6f8bf06f3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:56.714869  4410 raft_consensus.cc:3060] T 31e7df492de84ae990f655e6f8bf06f3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.719888  4410 raft_consensus.cc:515] T 31e7df492de84ae990f655e6f8bf06f3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } } peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } }
I20260709 13:12:56.721304  4410 leader_election.cc:290] T 31e7df492de84ae990f655e6f8bf06f3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [CANDIDATE]: Term 1 election: Requested vote from peers 5917eb98fb7349f6bc42bb33140fd4d6 (127.28.54.65:34143), 7981d8ad22c3493ea724d42c4e73f023 (127.28.54.67:34891)
I20260709 13:12:56.722071  4208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e7df492de84ae990f655e6f8bf06f3" candidate_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5917eb98fb7349f6bc42bb33140fd4d6"
I20260709 13:12:56.722195  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e7df492de84ae990f655e6f8bf06f3" candidate_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7981d8ad22c3493ea724d42c4e73f023"
I20260709 13:12:56.722569  4208 raft_consensus.cc:3060] T 31e7df492de84ae990f655e6f8bf06f3 P 5917eb98fb7349f6bc42bb33140fd4d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.722695  4357 raft_consensus.cc:3060] T 31e7df492de84ae990f655e6f8bf06f3 P 7981d8ad22c3493ea724d42c4e73f023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.727918  4357 raft_consensus.cc:2468] T 31e7df492de84ae990f655e6f8bf06f3 P 7981d8ad22c3493ea724d42c4e73f023 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f2222fc10ea4fb2be4e17e7c999a7c1 in term 1.
I20260709 13:12:56.728148  4208 raft_consensus.cc:2468] T 31e7df492de84ae990f655e6f8bf06f3 P 5917eb98fb7349f6bc42bb33140fd4d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f2222fc10ea4fb2be4e17e7c999a7c1 in term 1.
I20260709 13:12:56.728749  4246 leader_election.cc:304] T 31e7df492de84ae990f655e6f8bf06f3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7981d8ad22c3493ea724d42c4e73f023, 9f2222fc10ea4fb2be4e17e7c999a7c1; no voters: 
I20260709 13:12:56.729494  4410 raft_consensus.cc:2804] T 31e7df492de84ae990f655e6f8bf06f3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:56.729970  4410 raft_consensus.cc:697] T 31e7df492de84ae990f655e6f8bf06f3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 1 LEADER]: Becoming Leader. State: Replica: 9f2222fc10ea4fb2be4e17e7c999a7c1, State: Running, Role: LEADER
I20260709 13:12:56.730693  4410 consensus_queue.cc:237] T 31e7df492de84ae990f655e6f8bf06f3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } } peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } }
I20260709 13:12:56.737185  4105 catalog_manager.cc:5697] T 31e7df492de84ae990f655e6f8bf06f3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 9f2222fc10ea4fb2be4e17e7c999a7c1 (127.28.54.66). New cstate: current_term: 1 leader_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:56.783166  4424 raft_consensus.cc:493] T 7c481aab50ad4294a1661a3044e214a3 P 7981d8ad22c3493ea724d42c4e73f023 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:56.783711  4424 raft_consensus.cc:515] T 7c481aab50ad4294a1661a3044e214a3 P 7981d8ad22c3493ea724d42c4e73f023 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } } peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } }
I20260709 13:12:56.785778  4424 leader_election.cc:290] T 7c481aab50ad4294a1661a3044e214a3 P 7981d8ad22c3493ea724d42c4e73f023 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5917eb98fb7349f6bc42bb33140fd4d6 (127.28.54.65:34143), 9f2222fc10ea4fb2be4e17e7c999a7c1 (127.28.54.66:35433)
I20260709 13:12:56.796795  4208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c481aab50ad4294a1661a3044e214a3" candidate_uuid: "7981d8ad22c3493ea724d42c4e73f023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" is_pre_election: true
I20260709 13:12:56.797405  4208 raft_consensus.cc:2468] T 7c481aab50ad4294a1661a3044e214a3 P 5917eb98fb7349f6bc42bb33140fd4d6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7981d8ad22c3493ea724d42c4e73f023 in term 0.
I20260709 13:12:56.798301  4320 leader_election.cc:304] T 7c481aab50ad4294a1661a3044e214a3 P 7981d8ad22c3493ea724d42c4e73f023 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5917eb98fb7349f6bc42bb33140fd4d6, 7981d8ad22c3493ea724d42c4e73f023; no voters: 
I20260709 13:12:56.798357  4283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c481aab50ad4294a1661a3044e214a3" candidate_uuid: "7981d8ad22c3493ea724d42c4e73f023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" is_pre_election: true
I20260709 13:12:56.798923  4283 raft_consensus.cc:2468] T 7c481aab50ad4294a1661a3044e214a3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7981d8ad22c3493ea724d42c4e73f023 in term 0.
I20260709 13:12:56.798969  4424 raft_consensus.cc:2804] T 7c481aab50ad4294a1661a3044e214a3 P 7981d8ad22c3493ea724d42c4e73f023 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:56.799528  4424 raft_consensus.cc:493] T 7c481aab50ad4294a1661a3044e214a3 P 7981d8ad22c3493ea724d42c4e73f023 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:56.799876  4424 raft_consensus.cc:3060] T 7c481aab50ad4294a1661a3044e214a3 P 7981d8ad22c3493ea724d42c4e73f023 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.804994  4424 raft_consensus.cc:515] T 7c481aab50ad4294a1661a3044e214a3 P 7981d8ad22c3493ea724d42c4e73f023 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } } peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } }
I20260709 13:12:56.806501  4424 leader_election.cc:290] T 7c481aab50ad4294a1661a3044e214a3 P 7981d8ad22c3493ea724d42c4e73f023 [CANDIDATE]: Term 1 election: Requested vote from peers 5917eb98fb7349f6bc42bb33140fd4d6 (127.28.54.65:34143), 9f2222fc10ea4fb2be4e17e7c999a7c1 (127.28.54.66:35433)
I20260709 13:12:56.807226  4208 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c481aab50ad4294a1661a3044e214a3" candidate_uuid: "7981d8ad22c3493ea724d42c4e73f023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5917eb98fb7349f6bc42bb33140fd4d6"
I20260709 13:12:56.807512  4283 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c481aab50ad4294a1661a3044e214a3" candidate_uuid: "7981d8ad22c3493ea724d42c4e73f023" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1"
I20260709 13:12:56.807837  4208 raft_consensus.cc:3060] T 7c481aab50ad4294a1661a3044e214a3 P 5917eb98fb7349f6bc42bb33140fd4d6 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.808094  4283 raft_consensus.cc:3060] T 7c481aab50ad4294a1661a3044e214a3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:56.810169  4404 consensus_queue.cc:1048] T 9303514156d64c4fa32695ae08535d20 P 5917eb98fb7349f6bc42bb33140fd4d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:56.813840  4208 raft_consensus.cc:2468] T 7c481aab50ad4294a1661a3044e214a3 P 5917eb98fb7349f6bc42bb33140fd4d6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7981d8ad22c3493ea724d42c4e73f023 in term 1.
I20260709 13:12:56.814066  4283 raft_consensus.cc:2468] T 7c481aab50ad4294a1661a3044e214a3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7981d8ad22c3493ea724d42c4e73f023 in term 1.
I20260709 13:12:56.814972  4320 leader_election.cc:304] T 7c481aab50ad4294a1661a3044e214a3 P 7981d8ad22c3493ea724d42c4e73f023 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5917eb98fb7349f6bc42bb33140fd4d6, 7981d8ad22c3493ea724d42c4e73f023; no voters: 
I20260709 13:12:56.815827  4424 raft_consensus.cc:2804] T 7c481aab50ad4294a1661a3044e214a3 P 7981d8ad22c3493ea724d42c4e73f023 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:56.817193  4424 raft_consensus.cc:697] T 7c481aab50ad4294a1661a3044e214a3 P 7981d8ad22c3493ea724d42c4e73f023 [term 1 LEADER]: Becoming Leader. State: Replica: 7981d8ad22c3493ea724d42c4e73f023, State: Running, Role: LEADER
I20260709 13:12:56.818102  4424 consensus_queue.cc:237] T 7c481aab50ad4294a1661a3044e214a3 P 7981d8ad22c3493ea724d42c4e73f023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } } peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } }
I20260709 13:12:56.822089  4404 consensus_queue.cc:1048] T 9303514156d64c4fa32695ae08535d20 P 5917eb98fb7349f6bc42bb33140fd4d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:56.830068  4106 catalog_manager.cc:5697] T 7c481aab50ad4294a1661a3044e214a3 P 7981d8ad22c3493ea724d42c4e73f023 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7981d8ad22c3493ea724d42c4e73f023 (127.28.54.67). New cstate: current_term: 1 leader_uuid: "7981d8ad22c3493ea724d42c4e73f023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:56.856299  4282 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "65234ae56a6846d69fbea66ac66aeb9f"
dest_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1"
mode: GRACEFUL
new_leader_uuid: "5917eb98fb7349f6bc42bb33140fd4d6"
 from {username='slave'} at 127.0.0.1:44648
I20260709 13:12:56.856861  4282 raft_consensus.cc:606] T 65234ae56a6846d69fbea66ac66aeb9f P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 1 LEADER]: Received request to transfer leadership to TS 5917eb98fb7349f6bc42bb33140fd4d6
I20260709 13:12:56.867861  4208 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9303514156d64c4fa32695ae08535d20"
dest_uuid: "5917eb98fb7349f6bc42bb33140fd4d6"
mode: GRACEFUL
new_leader_uuid: "7981d8ad22c3493ea724d42c4e73f023"
 from {username='slave'} at 127.0.0.1:60380
I20260709 13:12:56.868343  4208 raft_consensus.cc:606] T 9303514156d64c4fa32695ae08535d20 P 5917eb98fb7349f6bc42bb33140fd4d6 [term 1 LEADER]: Received request to transfer leadership to TS 7981d8ad22c3493ea724d42c4e73f023
I20260709 13:12:56.873709  4282 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "31e7df492de84ae990f655e6f8bf06f3"
dest_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1"
mode: GRACEFUL
new_leader_uuid: "5917eb98fb7349f6bc42bb33140fd4d6"
 from {username='slave'} at 127.0.0.1:44648
I20260709 13:12:56.874230  4282 raft_consensus.cc:606] T 31e7df492de84ae990f655e6f8bf06f3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 1 LEADER]: Received request to transfer leadership to TS 5917eb98fb7349f6bc42bb33140fd4d6
I20260709 13:12:56.886658  4357 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c481aab50ad4294a1661a3044e214a3"
dest_uuid: "7981d8ad22c3493ea724d42c4e73f023"
mode: GRACEFUL
new_leader_uuid: "5917eb98fb7349f6bc42bb33140fd4d6"
 from {username='slave'} at 127.0.0.1:55370
I20260709 13:12:56.887179  4357 raft_consensus.cc:606] T 7c481aab50ad4294a1661a3044e214a3 P 7981d8ad22c3493ea724d42c4e73f023 [term 1 LEADER]: Received request to transfer leadership to TS 5917eb98fb7349f6bc42bb33140fd4d6
I20260709 13:12:56.983299  4423 raft_consensus.cc:993] T 65234ae56a6846d69fbea66ac66aeb9f P 9f2222fc10ea4fb2be4e17e7c999a7c1: : Instructing follower 5917eb98fb7349f6bc42bb33140fd4d6 to start an election
I20260709 13:12:56.983755  4410 raft_consensus.cc:1081] T 65234ae56a6846d69fbea66ac66aeb9f P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 1 LEADER]: Signalling peer 5917eb98fb7349f6bc42bb33140fd4d6 to start an election
I20260709 13:12:56.985090  4208 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "65234ae56a6846d69fbea66ac66aeb9f"
dest_uuid: "5917eb98fb7349f6bc42bb33140fd4d6"
 from {username='slave'} at 127.0.0.1:60364
I20260709 13:12:56.985569  4208 raft_consensus.cc:493] T 65234ae56a6846d69fbea66ac66aeb9f P 5917eb98fb7349f6bc42bb33140fd4d6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:56.985863  4208 raft_consensus.cc:3060] T 65234ae56a6846d69fbea66ac66aeb9f P 5917eb98fb7349f6bc42bb33140fd4d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:56.992070  4208 raft_consensus.cc:515] T 65234ae56a6846d69fbea66ac66aeb9f P 5917eb98fb7349f6bc42bb33140fd4d6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } } peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } }
I20260709 13:12:56.993563  4208 leader_election.cc:290] T 65234ae56a6846d69fbea66ac66aeb9f P 5917eb98fb7349f6bc42bb33140fd4d6 [CANDIDATE]: Term 2 election: Requested vote from peers 7981d8ad22c3493ea724d42c4e73f023 (127.28.54.67:34891), 9f2222fc10ea4fb2be4e17e7c999a7c1 (127.28.54.66:35433)
I20260709 13:12:56.994251  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65234ae56a6846d69fbea66ac66aeb9f" candidate_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7981d8ad22c3493ea724d42c4e73f023"
I20260709 13:12:56.994763  4357 raft_consensus.cc:3060] T 65234ae56a6846d69fbea66ac66aeb9f P 7981d8ad22c3493ea724d42c4e73f023 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:56.994740  4282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "65234ae56a6846d69fbea66ac66aeb9f" candidate_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1"
I20260709 13:12:56.995342  4282 raft_consensus.cc:3055] T 65234ae56a6846d69fbea66ac66aeb9f P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:56.995575  4282 raft_consensus.cc:740] T 65234ae56a6846d69fbea66ac66aeb9f P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9f2222fc10ea4fb2be4e17e7c999a7c1, State: Running, Role: LEADER
I20260709 13:12:56.996161  4282 consensus_queue.cc:260] T 65234ae56a6846d69fbea66ac66aeb9f P 9f2222fc10ea4fb2be4e17e7c999a7c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } } peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } }
I20260709 13:12:56.997044  4282 raft_consensus.cc:3060] T 65234ae56a6846d69fbea66ac66aeb9f P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:56.999657  4357 raft_consensus.cc:2468] T 65234ae56a6846d69fbea66ac66aeb9f P 7981d8ad22c3493ea724d42c4e73f023 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5917eb98fb7349f6bc42bb33140fd4d6 in term 2.
I20260709 13:12:57.000674  4171 leader_election.cc:304] T 65234ae56a6846d69fbea66ac66aeb9f P 5917eb98fb7349f6bc42bb33140fd4d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5917eb98fb7349f6bc42bb33140fd4d6, 7981d8ad22c3493ea724d42c4e73f023; no voters: 
I20260709 13:12:57.001564  4443 raft_consensus.cc:2804] T 65234ae56a6846d69fbea66ac66aeb9f P 5917eb98fb7349f6bc42bb33140fd4d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:57.002049  4443 raft_consensus.cc:697] T 65234ae56a6846d69fbea66ac66aeb9f P 5917eb98fb7349f6bc42bb33140fd4d6 [term 2 LEADER]: Becoming Leader. State: Replica: 5917eb98fb7349f6bc42bb33140fd4d6, State: Running, Role: LEADER
I20260709 13:12:57.002727  4282 raft_consensus.cc:2468] T 65234ae56a6846d69fbea66ac66aeb9f P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5917eb98fb7349f6bc42bb33140fd4d6 in term 2.
I20260709 13:12:57.002846  4443 consensus_queue.cc:237] T 65234ae56a6846d69fbea66ac66aeb9f P 5917eb98fb7349f6bc42bb33140fd4d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } } peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } }
I20260709 13:12:57.008697  4105 catalog_manager.cc:5697] T 65234ae56a6846d69fbea66ac66aeb9f P 5917eb98fb7349f6bc42bb33140fd4d6 reported cstate change: term changed from 1 to 2, leader changed from 9f2222fc10ea4fb2be4e17e7c999a7c1 (127.28.54.66) to 5917eb98fb7349f6bc42bb33140fd4d6 (127.28.54.65). New cstate: current_term: 2 leader_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:57.128343  4410 consensus_queue.cc:1048] T 31e7df492de84ae990f655e6f8bf06f3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:57.139122  4449 consensus_queue.cc:1048] T 31e7df492de84ae990f655e6f8bf06f3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:57.146615  4410 raft_consensus.cc:993] T 31e7df492de84ae990f655e6f8bf06f3 P 9f2222fc10ea4fb2be4e17e7c999a7c1: : Instructing follower 5917eb98fb7349f6bc42bb33140fd4d6 to start an election
I20260709 13:12:57.147040  4449 raft_consensus.cc:1081] T 31e7df492de84ae990f655e6f8bf06f3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 1 LEADER]: Signalling peer 5917eb98fb7349f6bc42bb33140fd4d6 to start an election
I20260709 13:12:57.148362  4208 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "31e7df492de84ae990f655e6f8bf06f3"
dest_uuid: "5917eb98fb7349f6bc42bb33140fd4d6"
 from {username='slave'} at 127.0.0.1:60364
I20260709 13:12:57.148916  4208 raft_consensus.cc:493] T 31e7df492de84ae990f655e6f8bf06f3 P 5917eb98fb7349f6bc42bb33140fd4d6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:57.149264  4208 raft_consensus.cc:3060] T 31e7df492de84ae990f655e6f8bf06f3 P 5917eb98fb7349f6bc42bb33140fd4d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:57.156008  4208 raft_consensus.cc:515] T 31e7df492de84ae990f655e6f8bf06f3 P 5917eb98fb7349f6bc42bb33140fd4d6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } } peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } }
I20260709 13:12:57.157893  4208 leader_election.cc:290] T 31e7df492de84ae990f655e6f8bf06f3 P 5917eb98fb7349f6bc42bb33140fd4d6 [CANDIDATE]: Term 2 election: Requested vote from peers 9f2222fc10ea4fb2be4e17e7c999a7c1 (127.28.54.66:35433), 7981d8ad22c3493ea724d42c4e73f023 (127.28.54.67:34891)
I20260709 13:12:57.158967  4282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e7df492de84ae990f655e6f8bf06f3" candidate_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1"
I20260709 13:12:57.159399  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "31e7df492de84ae990f655e6f8bf06f3" candidate_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7981d8ad22c3493ea724d42c4e73f023"
I20260709 13:12:57.159596  4282 raft_consensus.cc:3055] T 31e7df492de84ae990f655e6f8bf06f3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:57.160020  4282 raft_consensus.cc:740] T 31e7df492de84ae990f655e6f8bf06f3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9f2222fc10ea4fb2be4e17e7c999a7c1, State: Running, Role: LEADER
I20260709 13:12:57.160377  4357 raft_consensus.cc:3060] T 31e7df492de84ae990f655e6f8bf06f3 P 7981d8ad22c3493ea724d42c4e73f023 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:57.160840  4282 consensus_queue.cc:260] T 31e7df492de84ae990f655e6f8bf06f3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } } peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } }
I20260709 13:12:57.162176  4282 raft_consensus.cc:3060] T 31e7df492de84ae990f655e6f8bf06f3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:57.165871  4357 raft_consensus.cc:2468] T 31e7df492de84ae990f655e6f8bf06f3 P 7981d8ad22c3493ea724d42c4e73f023 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5917eb98fb7349f6bc42bb33140fd4d6 in term 2.
I20260709 13:12:57.167119  4171 leader_election.cc:304] T 31e7df492de84ae990f655e6f8bf06f3 P 5917eb98fb7349f6bc42bb33140fd4d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5917eb98fb7349f6bc42bb33140fd4d6, 7981d8ad22c3493ea724d42c4e73f023; no voters: 
I20260709 13:12:57.167464  4282 raft_consensus.cc:2468] T 31e7df492de84ae990f655e6f8bf06f3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5917eb98fb7349f6bc42bb33140fd4d6 in term 2.
I20260709 13:12:57.167764  4443 raft_consensus.cc:2804] T 31e7df492de84ae990f655e6f8bf06f3 P 5917eb98fb7349f6bc42bb33140fd4d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:57.168265  4443 raft_consensus.cc:697] T 31e7df492de84ae990f655e6f8bf06f3 P 5917eb98fb7349f6bc42bb33140fd4d6 [term 2 LEADER]: Becoming Leader. State: Replica: 5917eb98fb7349f6bc42bb33140fd4d6, State: Running, Role: LEADER
I20260709 13:12:57.168992  4443 consensus_queue.cc:237] T 31e7df492de84ae990f655e6f8bf06f3 P 5917eb98fb7349f6bc42bb33140fd4d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } } peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } }
I20260709 13:12:57.174875  4104 catalog_manager.cc:5697] T 31e7df492de84ae990f655e6f8bf06f3 P 5917eb98fb7349f6bc42bb33140fd4d6 reported cstate change: term changed from 1 to 2, leader changed from 9f2222fc10ea4fb2be4e17e7c999a7c1 (127.28.54.66) to 5917eb98fb7349f6bc42bb33140fd4d6 (127.28.54.65). New cstate: current_term: 2 leader_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:57.218235  4442 consensus_queue.cc:1048] T 7c481aab50ad4294a1661a3044e214a3 P 7981d8ad22c3493ea724d42c4e73f023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:57.224282  4424 raft_consensus.cc:993] T 7c481aab50ad4294a1661a3044e214a3 P 7981d8ad22c3493ea724d42c4e73f023: : Instructing follower 5917eb98fb7349f6bc42bb33140fd4d6 to start an election
I20260709 13:12:57.224906  4442 raft_consensus.cc:1081] T 7c481aab50ad4294a1661a3044e214a3 P 7981d8ad22c3493ea724d42c4e73f023 [term 1 LEADER]: Signalling peer 5917eb98fb7349f6bc42bb33140fd4d6 to start an election
I20260709 13:12:57.227109  4207 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c481aab50ad4294a1661a3044e214a3"
dest_uuid: "5917eb98fb7349f6bc42bb33140fd4d6"
 from {username='slave'} at 127.0.0.1:60368
I20260709 13:12:57.228693  4207 raft_consensus.cc:493] T 7c481aab50ad4294a1661a3044e214a3 P 5917eb98fb7349f6bc42bb33140fd4d6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:57.229101  4207 raft_consensus.cc:3060] T 7c481aab50ad4294a1661a3044e214a3 P 5917eb98fb7349f6bc42bb33140fd4d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:57.230492  4442 consensus_queue.cc:1048] T 7c481aab50ad4294a1661a3044e214a3 P 7981d8ad22c3493ea724d42c4e73f023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:57.236120  4207 raft_consensus.cc:515] T 7c481aab50ad4294a1661a3044e214a3 P 5917eb98fb7349f6bc42bb33140fd4d6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } } peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } }
I20260709 13:12:57.239799  4207 leader_election.cc:290] T 7c481aab50ad4294a1661a3044e214a3 P 5917eb98fb7349f6bc42bb33140fd4d6 [CANDIDATE]: Term 2 election: Requested vote from peers 9f2222fc10ea4fb2be4e17e7c999a7c1 (127.28.54.66:35433), 7981d8ad22c3493ea724d42c4e73f023 (127.28.54.67:34891)
I20260709 13:12:57.241454  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c481aab50ad4294a1661a3044e214a3" candidate_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7981d8ad22c3493ea724d42c4e73f023"
I20260709 13:12:57.242094  4357 raft_consensus.cc:3055] T 7c481aab50ad4294a1661a3044e214a3 P 7981d8ad22c3493ea724d42c4e73f023 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:57.242435  4357 raft_consensus.cc:740] T 7c481aab50ad4294a1661a3044e214a3 P 7981d8ad22c3493ea724d42c4e73f023 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7981d8ad22c3493ea724d42c4e73f023, State: Running, Role: LEADER
I20260709 13:12:57.243086  4282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c481aab50ad4294a1661a3044e214a3" candidate_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1"
I20260709 13:12:57.243191  4357 consensus_queue.cc:260] T 7c481aab50ad4294a1661a3044e214a3 P 7981d8ad22c3493ea724d42c4e73f023 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } } peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } }
I20260709 13:12:57.243750  4282 raft_consensus.cc:3060] T 7c481aab50ad4294a1661a3044e214a3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:57.244537  4357 raft_consensus.cc:3060] T 7c481aab50ad4294a1661a3044e214a3 P 7981d8ad22c3493ea724d42c4e73f023 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:57.250617  4282 raft_consensus.cc:2468] T 7c481aab50ad4294a1661a3044e214a3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5917eb98fb7349f6bc42bb33140fd4d6 in term 2.
I20260709 13:12:57.251488  4357 raft_consensus.cc:2468] T 7c481aab50ad4294a1661a3044e214a3 P 7981d8ad22c3493ea724d42c4e73f023 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5917eb98fb7349f6bc42bb33140fd4d6 in term 2.
I20260709 13:12:57.251695  4171 leader_election.cc:304] T 7c481aab50ad4294a1661a3044e214a3 P 5917eb98fb7349f6bc42bb33140fd4d6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5917eb98fb7349f6bc42bb33140fd4d6, 9f2222fc10ea4fb2be4e17e7c999a7c1; no voters: 
I20260709 13:12:57.252449  4443 raft_consensus.cc:2804] T 7c481aab50ad4294a1661a3044e214a3 P 5917eb98fb7349f6bc42bb33140fd4d6 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:57.252925  4443 raft_consensus.cc:697] T 7c481aab50ad4294a1661a3044e214a3 P 5917eb98fb7349f6bc42bb33140fd4d6 [term 2 LEADER]: Becoming Leader. State: Replica: 5917eb98fb7349f6bc42bb33140fd4d6, State: Running, Role: LEADER
I20260709 13:12:57.253641  4443 consensus_queue.cc:237] T 7c481aab50ad4294a1661a3044e214a3 P 5917eb98fb7349f6bc42bb33140fd4d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } } peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } }
I20260709 13:12:57.258987  4104 catalog_manager.cc:5697] T 7c481aab50ad4294a1661a3044e214a3 P 5917eb98fb7349f6bc42bb33140fd4d6 reported cstate change: term changed from 1 to 2, leader changed from 7981d8ad22c3493ea724d42c4e73f023 (127.28.54.67) to 5917eb98fb7349f6bc42bb33140fd4d6 (127.28.54.65). New cstate: current_term: 2 leader_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:57.263054  4412 raft_consensus.cc:993] T 9303514156d64c4fa32695ae08535d20 P 5917eb98fb7349f6bc42bb33140fd4d6: : Instructing follower 7981d8ad22c3493ea724d42c4e73f023 to start an election
I20260709 13:12:57.263523  4443 raft_consensus.cc:1081] T 9303514156d64c4fa32695ae08535d20 P 5917eb98fb7349f6bc42bb33140fd4d6 [term 1 LEADER]: Signalling peer 7981d8ad22c3493ea724d42c4e73f023 to start an election
I20260709 13:12:57.264825  4357 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9303514156d64c4fa32695ae08535d20"
dest_uuid: "7981d8ad22c3493ea724d42c4e73f023"
 from {username='slave'} at 127.0.0.1:55368
I20260709 13:12:57.265249  4357 raft_consensus.cc:493] T 9303514156d64c4fa32695ae08535d20 P 7981d8ad22c3493ea724d42c4e73f023 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:57.265520  4357 raft_consensus.cc:3060] T 9303514156d64c4fa32695ae08535d20 P 7981d8ad22c3493ea724d42c4e73f023 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:57.270561  4357 raft_consensus.cc:515] T 9303514156d64c4fa32695ae08535d20 P 7981d8ad22c3493ea724d42c4e73f023 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } } peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } }
I20260709 13:12:57.272255  4357 leader_election.cc:290] T 9303514156d64c4fa32695ae08535d20 P 7981d8ad22c3493ea724d42c4e73f023 [CANDIDATE]: Term 2 election: Requested vote from peers 5917eb98fb7349f6bc42bb33140fd4d6 (127.28.54.65:34143), 9f2222fc10ea4fb2be4e17e7c999a7c1 (127.28.54.66:35433)
I20260709 13:12:57.273156  4207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9303514156d64c4fa32695ae08535d20" candidate_uuid: "7981d8ad22c3493ea724d42c4e73f023" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5917eb98fb7349f6bc42bb33140fd4d6"
I20260709 13:12:57.273167  4282 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9303514156d64c4fa32695ae08535d20" candidate_uuid: "7981d8ad22c3493ea724d42c4e73f023" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1"
I20260709 13:12:57.273772  4207 raft_consensus.cc:3055] T 9303514156d64c4fa32695ae08535d20 P 5917eb98fb7349f6bc42bb33140fd4d6 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:57.273874  4282 raft_consensus.cc:3060] T 9303514156d64c4fa32695ae08535d20 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:57.274076  4207 raft_consensus.cc:740] T 9303514156d64c4fa32695ae08535d20 P 5917eb98fb7349f6bc42bb33140fd4d6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5917eb98fb7349f6bc42bb33140fd4d6, State: Running, Role: LEADER
I20260709 13:12:57.274812  4207 consensus_queue.cc:260] T 9303514156d64c4fa32695ae08535d20 P 5917eb98fb7349f6bc42bb33140fd4d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } } peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } }
I20260709 13:12:57.275691  4207 raft_consensus.cc:3060] T 9303514156d64c4fa32695ae08535d20 P 5917eb98fb7349f6bc42bb33140fd4d6 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:57.278865  4282 raft_consensus.cc:2468] T 9303514156d64c4fa32695ae08535d20 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7981d8ad22c3493ea724d42c4e73f023 in term 2.
I20260709 13:12:57.279808  4320 leader_election.cc:304] T 9303514156d64c4fa32695ae08535d20 P 7981d8ad22c3493ea724d42c4e73f023 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7981d8ad22c3493ea724d42c4e73f023, 9f2222fc10ea4fb2be4e17e7c999a7c1; no voters: 
I20260709 13:12:57.280573  4442 raft_consensus.cc:2804] T 9303514156d64c4fa32695ae08535d20 P 7981d8ad22c3493ea724d42c4e73f023 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:57.280963  4442 raft_consensus.cc:697] T 9303514156d64c4fa32695ae08535d20 P 7981d8ad22c3493ea724d42c4e73f023 [term 2 LEADER]: Becoming Leader. State: Replica: 7981d8ad22c3493ea724d42c4e73f023, State: Running, Role: LEADER
I20260709 13:12:57.280906  4207 raft_consensus.cc:2468] T 9303514156d64c4fa32695ae08535d20 P 5917eb98fb7349f6bc42bb33140fd4d6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7981d8ad22c3493ea724d42c4e73f023 in term 2.
I20260709 13:12:57.281944  4442 consensus_queue.cc:237] T 9303514156d64c4fa32695ae08535d20 P 7981d8ad22c3493ea724d42c4e73f023 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } } peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } }
I20260709 13:12:57.287842  4104 catalog_manager.cc:5697] T 9303514156d64c4fa32695ae08535d20 P 7981d8ad22c3493ea724d42c4e73f023 reported cstate change: term changed from 1 to 2, leader changed from 5917eb98fb7349f6bc42bb33140fd4d6 (127.28.54.65) to 7981d8ad22c3493ea724d42c4e73f023 (127.28.54.67). New cstate: current_term: 2 leader_uuid: "7981d8ad22c3493ea724d42c4e73f023" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:57.310966 28889 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 13:12:57.312433 28889 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 13:12:57.312788 28889 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 13:12:57.325165  4207 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7c481aab50ad4294a1661a3044e214a3"
dest_uuid: "5917eb98fb7349f6bc42bb33140fd4d6"
mode: GRACEFUL
new_leader_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1"
 from {username='slave'} at 127.0.0.1:55886
I20260709 13:12:57.325667  4207 raft_consensus.cc:606] T 7c481aab50ad4294a1661a3044e214a3 P 5917eb98fb7349f6bc42bb33140fd4d6 [term 2 LEADER]: Received request to transfer leadership to TS 9f2222fc10ea4fb2be4e17e7c999a7c1
I20260709 13:12:57.326742 28889 auto_leader_rebalancer.cc:452] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 13:12:57.494191  4282 raft_consensus.cc:1275] T 65234ae56a6846d69fbea66ac66aeb9f P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 2 FOLLOWER]: Refusing update from remote peer 5917eb98fb7349f6bc42bb33140fd4d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:57.495410  4443 consensus_queue.cc:1048] T 65234ae56a6846d69fbea66ac66aeb9f P 5917eb98fb7349f6bc42bb33140fd4d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:57.504194  4357 raft_consensus.cc:1275] T 65234ae56a6846d69fbea66ac66aeb9f P 7981d8ad22c3493ea724d42c4e73f023 [term 2 FOLLOWER]: Refusing update from remote peer 5917eb98fb7349f6bc42bb33140fd4d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:57.505787  4412 consensus_queue.cc:1048] T 65234ae56a6846d69fbea66ac66aeb9f P 5917eb98fb7349f6bc42bb33140fd4d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:57.585263  4357 raft_consensus.cc:1275] T 31e7df492de84ae990f655e6f8bf06f3 P 7981d8ad22c3493ea724d42c4e73f023 [term 2 FOLLOWER]: Refusing update from remote peer 5917eb98fb7349f6bc42bb33140fd4d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:57.586609  4443 consensus_queue.cc:1048] T 31e7df492de84ae990f655e6f8bf06f3 P 5917eb98fb7349f6bc42bb33140fd4d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:57.593719  4282 raft_consensus.cc:1275] T 31e7df492de84ae990f655e6f8bf06f3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 2 FOLLOWER]: Refusing update from remote peer 5917eb98fb7349f6bc42bb33140fd4d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:57.595338  4412 consensus_queue.cc:1048] T 31e7df492de84ae990f655e6f8bf06f3 P 5917eb98fb7349f6bc42bb33140fd4d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:57.671592  4357 raft_consensus.cc:1275] T 7c481aab50ad4294a1661a3044e214a3 P 7981d8ad22c3493ea724d42c4e73f023 [term 2 FOLLOWER]: Refusing update from remote peer 5917eb98fb7349f6bc42bb33140fd4d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:57.672724  4412 consensus_queue.cc:1048] T 7c481aab50ad4294a1661a3044e214a3 P 5917eb98fb7349f6bc42bb33140fd4d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:57.680084  4282 raft_consensus.cc:1275] T 7c481aab50ad4294a1661a3044e214a3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 2 FOLLOWER]: Refusing update from remote peer 5917eb98fb7349f6bc42bb33140fd4d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:57.681859  4443 consensus_queue.cc:1048] T 7c481aab50ad4294a1661a3044e214a3 P 5917eb98fb7349f6bc42bb33140fd4d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:57.687358  4443 raft_consensus.cc:993] T 7c481aab50ad4294a1661a3044e214a3 P 5917eb98fb7349f6bc42bb33140fd4d6: : Instructing follower 9f2222fc10ea4fb2be4e17e7c999a7c1 to start an election
I20260709 13:12:57.687899  4404 raft_consensus.cc:1081] T 7c481aab50ad4294a1661a3044e214a3 P 5917eb98fb7349f6bc42bb33140fd4d6 [term 2 LEADER]: Signalling peer 9f2222fc10ea4fb2be4e17e7c999a7c1 to start an election
I20260709 13:12:57.689307  4282 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7c481aab50ad4294a1661a3044e214a3"
dest_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1"
 from {username='slave'} at 127.0.0.1:44628
I20260709 13:12:57.689882  4282 raft_consensus.cc:493] T 7c481aab50ad4294a1661a3044e214a3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:57.690162  4282 raft_consensus.cc:3060] T 7c481aab50ad4294a1661a3044e214a3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:57.695251  4282 raft_consensus.cc:515] T 7c481aab50ad4294a1661a3044e214a3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } } peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } }
I20260709 13:12:57.697062  4282 leader_election.cc:290] T 7c481aab50ad4294a1661a3044e214a3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [CANDIDATE]: Term 3 election: Requested vote from peers 5917eb98fb7349f6bc42bb33140fd4d6 (127.28.54.65:34143), 7981d8ad22c3493ea724d42c4e73f023 (127.28.54.67:34891)
I20260709 13:12:57.697816  4207 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c481aab50ad4294a1661a3044e214a3" candidate_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5917eb98fb7349f6bc42bb33140fd4d6"
I20260709 13:12:57.698144  4357 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7c481aab50ad4294a1661a3044e214a3" candidate_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7981d8ad22c3493ea724d42c4e73f023"
I20260709 13:12:57.698446  4207 raft_consensus.cc:3055] T 7c481aab50ad4294a1661a3044e214a3 P 5917eb98fb7349f6bc42bb33140fd4d6 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:12:57.698721  4357 raft_consensus.cc:3060] T 7c481aab50ad4294a1661a3044e214a3 P 7981d8ad22c3493ea724d42c4e73f023 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:57.698832  4207 raft_consensus.cc:740] T 7c481aab50ad4294a1661a3044e214a3 P 5917eb98fb7349f6bc42bb33140fd4d6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5917eb98fb7349f6bc42bb33140fd4d6, State: Running, Role: LEADER
I20260709 13:12:57.699743  4207 consensus_queue.cc:260] T 7c481aab50ad4294a1661a3044e214a3 P 5917eb98fb7349f6bc42bb33140fd4d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } } peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } }
I20260709 13:12:57.701119  4207 raft_consensus.cc:3060] T 7c481aab50ad4294a1661a3044e214a3 P 5917eb98fb7349f6bc42bb33140fd4d6 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:12:57.705839  4357 raft_consensus.cc:2468] T 7c481aab50ad4294a1661a3044e214a3 P 7981d8ad22c3493ea724d42c4e73f023 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f2222fc10ea4fb2be4e17e7c999a7c1 in term 3.
I20260709 13:12:57.707113  4246 leader_election.cc:304] T 7c481aab50ad4294a1661a3044e214a3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7981d8ad22c3493ea724d42c4e73f023, 9f2222fc10ea4fb2be4e17e7c999a7c1; no voters: 
I20260709 13:12:57.707872  4207 raft_consensus.cc:2468] T 7c481aab50ad4294a1661a3044e214a3 P 5917eb98fb7349f6bc42bb33140fd4d6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9f2222fc10ea4fb2be4e17e7c999a7c1 in term 3.
I20260709 13:12:57.707892  4449 raft_consensus.cc:2804] T 7c481aab50ad4294a1661a3044e214a3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:12:57.708992  4449 raft_consensus.cc:697] T 7c481aab50ad4294a1661a3044e214a3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 3 LEADER]: Becoming Leader. State: Replica: 9f2222fc10ea4fb2be4e17e7c999a7c1, State: Running, Role: LEADER
I20260709 13:12:57.709719  4449 consensus_queue.cc:237] T 7c481aab50ad4294a1661a3044e214a3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } } peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } }
I20260709 13:12:57.715054  4104 catalog_manager.cc:5697] T 7c481aab50ad4294a1661a3044e214a3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 reported cstate change: term changed from 2 to 3, leader changed from 5917eb98fb7349f6bc42bb33140fd4d6 (127.28.54.65) to 9f2222fc10ea4fb2be4e17e7c999a7c1 (127.28.54.66). New cstate: current_term: 3 leader_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7981d8ad22c3493ea724d42c4e73f023" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 34891 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:57.779249  4207 raft_consensus.cc:1275] T 9303514156d64c4fa32695ae08535d20 P 5917eb98fb7349f6bc42bb33140fd4d6 [term 2 FOLLOWER]: Refusing update from remote peer 7981d8ad22c3493ea724d42c4e73f023: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:57.780509  4442 consensus_queue.cc:1048] T 9303514156d64c4fa32695ae08535d20 P 7981d8ad22c3493ea724d42c4e73f023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5917eb98fb7349f6bc42bb33140fd4d6" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 34143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:57.790217  4282 raft_consensus.cc:1275] T 9303514156d64c4fa32695ae08535d20 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 2 FOLLOWER]: Refusing update from remote peer 7981d8ad22c3493ea724d42c4e73f023: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:12:57.791671  4457 consensus_queue.cc:1048] T 9303514156d64c4fa32695ae08535d20 P 7981d8ad22c3493ea724d42c4e73f023 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9f2222fc10ea4fb2be4e17e7c999a7c1" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 35433 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:12:57.933459 28889 tablet_server.cc:179] TabletServer@127.28.54.65:0 shutting down...
I20260709 13:12:57.949440 28889 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:57.950053 28889 tablet_replica.cc:333] T 31e7df492de84ae990f655e6f8bf06f3 P 5917eb98fb7349f6bc42bb33140fd4d6: stopping tablet replica
I20260709 13:12:57.950631 28889 raft_consensus.cc:2243] T 31e7df492de84ae990f655e6f8bf06f3 P 5917eb98fb7349f6bc42bb33140fd4d6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:57.951416 28889 raft_consensus.cc:2272] T 31e7df492de84ae990f655e6f8bf06f3 P 5917eb98fb7349f6bc42bb33140fd4d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:57.953625 28889 tablet_replica.cc:333] T 7c481aab50ad4294a1661a3044e214a3 P 5917eb98fb7349f6bc42bb33140fd4d6: stopping tablet replica
I20260709 13:12:57.954155 28889 raft_consensus.cc:2243] T 7c481aab50ad4294a1661a3044e214a3 P 5917eb98fb7349f6bc42bb33140fd4d6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:57.954533 28889 raft_consensus.cc:2272] T 7c481aab50ad4294a1661a3044e214a3 P 5917eb98fb7349f6bc42bb33140fd4d6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:57.956738 28889 tablet_replica.cc:333] T 9303514156d64c4fa32695ae08535d20 P 5917eb98fb7349f6bc42bb33140fd4d6: stopping tablet replica
I20260709 13:12:57.957221 28889 raft_consensus.cc:2243] T 9303514156d64c4fa32695ae08535d20 P 5917eb98fb7349f6bc42bb33140fd4d6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:57.957616 28889 raft_consensus.cc:2272] T 9303514156d64c4fa32695ae08535d20 P 5917eb98fb7349f6bc42bb33140fd4d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:57.959568 28889 tablet_replica.cc:333] T 65234ae56a6846d69fbea66ac66aeb9f P 5917eb98fb7349f6bc42bb33140fd4d6: stopping tablet replica
I20260709 13:12:57.960012 28889 raft_consensus.cc:2243] T 65234ae56a6846d69fbea66ac66aeb9f P 5917eb98fb7349f6bc42bb33140fd4d6 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:57.960744 28889 raft_consensus.cc:2272] T 65234ae56a6846d69fbea66ac66aeb9f P 5917eb98fb7349f6bc42bb33140fd4d6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:57.973251 28889 tablet_server.cc:196] TabletServer@127.28.54.65:0 shutdown complete.
I20260709 13:12:57.984230 28889 tablet_server.cc:179] TabletServer@127.28.54.66:0 shutting down...
I20260709 13:12:58.002286 28889 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:58.002908 28889 tablet_replica.cc:333] T 31e7df492de84ae990f655e6f8bf06f3 P 9f2222fc10ea4fb2be4e17e7c999a7c1: stopping tablet replica
I20260709 13:12:58.003418 28889 raft_consensus.cc:2243] T 31e7df492de84ae990f655e6f8bf06f3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:58.003854 28889 raft_consensus.cc:2272] T 31e7df492de84ae990f655e6f8bf06f3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:58.005847 28889 tablet_replica.cc:333] T 7c481aab50ad4294a1661a3044e214a3 P 9f2222fc10ea4fb2be4e17e7c999a7c1: stopping tablet replica
I20260709 13:12:58.006326 28889 raft_consensus.cc:2243] T 7c481aab50ad4294a1661a3044e214a3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:12:58.006896 28889 pending_rounds.cc:70] T 7c481aab50ad4294a1661a3044e214a3 P 9f2222fc10ea4fb2be4e17e7c999a7c1: Trying to abort 1 pending ops.
I20260709 13:12:58.007052 28889 pending_rounds.cc:77] T 7c481aab50ad4294a1661a3044e214a3 P 9f2222fc10ea4fb2be4e17e7c999a7c1: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305636977505931264 op_type: NO_OP noop_request { }
I20260709 13:12:58.007325 28889 raft_consensus.cc:2889] T 7c481aab50ad4294a1661a3044e214a3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:12:58.007568 28889 raft_consensus.cc:2272] T 7c481aab50ad4294a1661a3044e214a3 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:58.009816 28889 tablet_replica.cc:333] T 65234ae56a6846d69fbea66ac66aeb9f P 9f2222fc10ea4fb2be4e17e7c999a7c1: stopping tablet replica
I20260709 13:12:58.010283 28889 raft_consensus.cc:2243] T 65234ae56a6846d69fbea66ac66aeb9f P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:58.010667 28889 raft_consensus.cc:2272] T 65234ae56a6846d69fbea66ac66aeb9f P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:58.012516 28889 tablet_replica.cc:333] T 9303514156d64c4fa32695ae08535d20 P 9f2222fc10ea4fb2be4e17e7c999a7c1: stopping tablet replica
I20260709 13:12:58.013069 28889 raft_consensus.cc:2243] T 9303514156d64c4fa32695ae08535d20 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:58.013520 28889 raft_consensus.cc:2272] T 9303514156d64c4fa32695ae08535d20 P 9f2222fc10ea4fb2be4e17e7c999a7c1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:58.035519 28889 tablet_server.cc:196] TabletServer@127.28.54.66:0 shutdown complete.
I20260709 13:12:58.046345 28889 tablet_server.cc:179] TabletServer@127.28.54.67:0 shutting down...
I20260709 13:12:58.062520 28889 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:12:58.063082 28889 tablet_replica.cc:333] T 7c481aab50ad4294a1661a3044e214a3 P 7981d8ad22c3493ea724d42c4e73f023: stopping tablet replica
I20260709 13:12:58.063575 28889 raft_consensus.cc:2243] T 7c481aab50ad4294a1661a3044e214a3 P 7981d8ad22c3493ea724d42c4e73f023 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:58.063978 28889 raft_consensus.cc:2272] T 7c481aab50ad4294a1661a3044e214a3 P 7981d8ad22c3493ea724d42c4e73f023 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:58.065953 28889 tablet_replica.cc:333] T 31e7df492de84ae990f655e6f8bf06f3 P 7981d8ad22c3493ea724d42c4e73f023: stopping tablet replica
I20260709 13:12:58.066414 28889 raft_consensus.cc:2243] T 31e7df492de84ae990f655e6f8bf06f3 P 7981d8ad22c3493ea724d42c4e73f023 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:58.066774 28889 raft_consensus.cc:2272] T 31e7df492de84ae990f655e6f8bf06f3 P 7981d8ad22c3493ea724d42c4e73f023 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:58.068776 28889 tablet_replica.cc:333] T 65234ae56a6846d69fbea66ac66aeb9f P 7981d8ad22c3493ea724d42c4e73f023: stopping tablet replica
I20260709 13:12:58.069207 28889 raft_consensus.cc:2243] T 65234ae56a6846d69fbea66ac66aeb9f P 7981d8ad22c3493ea724d42c4e73f023 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:12:58.069552 28889 raft_consensus.cc:2272] T 65234ae56a6846d69fbea66ac66aeb9f P 7981d8ad22c3493ea724d42c4e73f023 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:58.071400 28889 tablet_replica.cc:333] T 9303514156d64c4fa32695ae08535d20 P 7981d8ad22c3493ea724d42c4e73f023: stopping tablet replica
I20260709 13:12:58.071826 28889 raft_consensus.cc:2243] T 9303514156d64c4fa32695ae08535d20 P 7981d8ad22c3493ea724d42c4e73f023 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:12:58.072569 28889 raft_consensus.cc:2272] T 9303514156d64c4fa32695ae08535d20 P 7981d8ad22c3493ea724d42c4e73f023 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:58.083968 28889 tablet_server.cc:196] TabletServer@127.28.54.67:0 shutdown complete.
I20260709 13:12:58.094916 28889 master.cc:562] Master@127.28.54.126:46005 shutting down...
I20260709 13:12:58.108089 28889 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d30b67b40eda4e668f435bdbeb4df30b [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:12:58.108580 28889 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d30b67b40eda4e668f435bdbeb4df30b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:12:58.108840 28889 tablet_replica.cc:333] T 00000000000000000000000000000000 P d30b67b40eda4e668f435bdbeb4df30b: stopping tablet replica
I20260709 13:12:58.118754 28889 master.cc:584] Master@127.28.54.126:46005 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2781 ms)
[----------] 6 tests from LeaderRebalancerTest (219233 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 13:12:58.144002 28889 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.28.54.126:39327
I20260709 13:12:58.144982 28889 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:58.149681  4458 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:58.150162  4459 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:58.151563  4461 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:58.152145 28889 server_base.cc:1061] running on GCE node
I20260709 13:12:58.152881 28889 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:58.153050 28889 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:58.153206 28889 hybrid_clock.cc:648] HybridClock initialized: now 1783602778153188 us; error 0 us; skew 500 ppm
I20260709 13:12:58.153707 28889 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:58.155867 28889 webserver.cc:533] Webserver started at http://127.28.54.126:33463/ using document root <none> and password file <none>
I20260709 13:12:58.156335 28889 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:58.156502 28889 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:58.156744 28889 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:58.157709 28889 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602558744475-28889-0/minicluster-data/master-0-root/instance:
uuid: "d807ea9b011c4093877294934d6364d9"
format_stamp: "Formatted at 2026-07-09 13:12:58 on dist-test-slave-vpdx"
I20260709 13:12:58.161695 28889 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 13:12:58.164796  4466 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:58.165444 28889 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:12:58.165691 28889 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602558744475-28889-0/minicluster-data/master-0-root
uuid: "d807ea9b011c4093877294934d6364d9"
format_stamp: "Formatted at 2026-07-09 13:12:58 on dist-test-slave-vpdx"
I20260709 13:12:58.165977 28889 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602558744475-28889-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602558744475-28889-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602558744475-28889-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:58.186353 28889 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:58.187294 28889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:58.220319 28889 rpc_server.cc:307] RPC server started. Bound to: 127.28.54.126:39327
I20260709 13:12:58.220414  4517 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.54.126:39327 every 8 connection(s)
I20260709 13:12:58.223906  4518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.234251  4518 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d807ea9b011c4093877294934d6364d9: Bootstrap starting.
I20260709 13:12:58.238487  4518 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d807ea9b011c4093877294934d6364d9: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.242183  4518 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d807ea9b011c4093877294934d6364d9: No bootstrap required, opened a new log
I20260709 13:12:58.244124  4518 raft_consensus.cc:359] T 00000000000000000000000000000000 P d807ea9b011c4093877294934d6364d9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d807ea9b011c4093877294934d6364d9" member_type: VOTER }
I20260709 13:12:58.244481  4518 raft_consensus.cc:385] T 00000000000000000000000000000000 P d807ea9b011c4093877294934d6364d9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.244697  4518 raft_consensus.cc:740] T 00000000000000000000000000000000 P d807ea9b011c4093877294934d6364d9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d807ea9b011c4093877294934d6364d9, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.245275  4518 consensus_queue.cc:260] T 00000000000000000000000000000000 P d807ea9b011c4093877294934d6364d9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d807ea9b011c4093877294934d6364d9" member_type: VOTER }
I20260709 13:12:58.245693  4518 raft_consensus.cc:399] T 00000000000000000000000000000000 P d807ea9b011c4093877294934d6364d9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:12:58.245922  4518 raft_consensus.cc:493] T 00000000000000000000000000000000 P d807ea9b011c4093877294934d6364d9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:12:58.246176  4518 raft_consensus.cc:3060] T 00000000000000000000000000000000 P d807ea9b011c4093877294934d6364d9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:58.250562  4518 raft_consensus.cc:515] T 00000000000000000000000000000000 P d807ea9b011c4093877294934d6364d9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d807ea9b011c4093877294934d6364d9" member_type: VOTER }
I20260709 13:12:58.251052  4518 leader_election.cc:304] T 00000000000000000000000000000000 P d807ea9b011c4093877294934d6364d9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d807ea9b011c4093877294934d6364d9; no voters: 
I20260709 13:12:58.252092  4518 leader_election.cc:290] T 00000000000000000000000000000000 P d807ea9b011c4093877294934d6364d9 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:12:58.252365  4521 raft_consensus.cc:2804] T 00000000000000000000000000000000 P d807ea9b011c4093877294934d6364d9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:58.253620  4521 raft_consensus.cc:697] T 00000000000000000000000000000000 P d807ea9b011c4093877294934d6364d9 [term 1 LEADER]: Becoming Leader. State: Replica: d807ea9b011c4093877294934d6364d9, State: Running, Role: LEADER
I20260709 13:12:58.254278  4521 consensus_queue.cc:237] T 00000000000000000000000000000000 P d807ea9b011c4093877294934d6364d9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d807ea9b011c4093877294934d6364d9" member_type: VOTER }
I20260709 13:12:58.254817  4518 sys_catalog.cc:565] T 00000000000000000000000000000000 P d807ea9b011c4093877294934d6364d9 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:12:58.256831  4522 sys_catalog.cc:455] T 00000000000000000000000000000000 P d807ea9b011c4093877294934d6364d9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d807ea9b011c4093877294934d6364d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d807ea9b011c4093877294934d6364d9" member_type: VOTER } }
I20260709 13:12:58.257519  4522 sys_catalog.cc:458] T 00000000000000000000000000000000 P d807ea9b011c4093877294934d6364d9 [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:58.256906  4523 sys_catalog.cc:455] T 00000000000000000000000000000000 P d807ea9b011c4093877294934d6364d9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d807ea9b011c4093877294934d6364d9. Latest consensus state: current_term: 1 leader_uuid: "d807ea9b011c4093877294934d6364d9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d807ea9b011c4093877294934d6364d9" member_type: VOTER } }
I20260709 13:12:58.257936  4523 sys_catalog.cc:458] T 00000000000000000000000000000000 P d807ea9b011c4093877294934d6364d9 [sys.catalog]: This master's current role is: LEADER
I20260709 13:12:58.260985  4526 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:12:58.268038  4526 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:12:58.269022 28889 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:12:58.276183  4526 catalog_manager.cc:1383] Generated new cluster ID: 304b5f1a16404ab9904175cfd2b56f59
I20260709 13:12:58.276432  4526 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:12:58.297153  4526 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:12:58.298398  4526 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:12:58.315024  4526 catalog_manager.cc:6070] T 00000000000000000000000000000000 P d807ea9b011c4093877294934d6364d9: Generated new TSK 0
I20260709 13:12:58.315577  4526 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:12:58.335621 28889 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:58.341086  4539 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:58.341790  4540 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:58.343819 28889 server_base.cc:1061] running on GCE node
W20260709 13:12:58.344144  4542 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:58.345017 28889 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:58.345216 28889 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:58.345377 28889 hybrid_clock.cc:648] HybridClock initialized: now 1783602778345359 us; error 0 us; skew 500 ppm
I20260709 13:12:58.345912 28889 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:58.348024 28889 webserver.cc:533] Webserver started at http://127.28.54.65:33831/ using document root <none> and password file <none>
I20260709 13:12:58.348464 28889 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:58.348632 28889 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:58.348875 28889 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:58.349946 28889 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602558744475-28889-0/minicluster-data/ts-0-root/instance:
uuid: "ed488ca31ad54b53836e5a10d053b568"
format_stamp: "Formatted at 2026-07-09 13:12:58 on dist-test-slave-vpdx"
I20260709 13:12:58.354224 28889 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:12:58.357424  4547 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:58.358148 28889 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 13:12:58.358418 28889 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602558744475-28889-0/minicluster-data/ts-0-root
uuid: "ed488ca31ad54b53836e5a10d053b568"
format_stamp: "Formatted at 2026-07-09 13:12:58 on dist-test-slave-vpdx"
I20260709 13:12:58.358677 28889 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602558744475-28889-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602558744475-28889-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602558744475-28889-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:58.387033 28889 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:58.388325 28889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:58.389700 28889 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:58.391819 28889 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:58.392005 28889 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:58.392220 28889 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:58.392364 28889 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:58.427805 28889 rpc_server.cc:307] RPC server started. Bound to: 127.28.54.65:36419
I20260709 13:12:58.427906  4609 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.54.65:36419 every 8 connection(s)
I20260709 13:12:58.432377 28889 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:58.438776  4614 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:58.440737  4615 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:58.444199 28889 server_base.cc:1061] running on GCE node
I20260709 13:12:58.444635  4610 heartbeater.cc:344] Connected to a master server at 127.28.54.126:39327
W20260709 13:12:58.444936  4617 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:58.445052  4610 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:58.445942 28889 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 13:12:58.446046  4610 heartbeater.cc:507] Master 127.28.54.126:39327 requested a full tablet report, sending...
W20260709 13:12:58.446234 28889 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:58.446491 28889 hybrid_clock.cc:648] HybridClock initialized: now 1783602778446470 us; error 0 us; skew 500 ppm
I20260709 13:12:58.447176 28889 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:58.448271  4483 ts_manager.cc:194] Registered new tserver with Master: ed488ca31ad54b53836e5a10d053b568 (127.28.54.65:36419)
I20260709 13:12:58.449863 28889 webserver.cc:533] Webserver started at http://127.28.54.66:33523/ using document root <none> and password file <none>
I20260709 13:12:58.450052  4483 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34362
I20260709 13:12:58.450400 28889 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:58.450634 28889 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:58.450871 28889 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:58.451973 28889 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602558744475-28889-0/minicluster-data/ts-1-root/instance:
uuid: "c800c72b860f42878733b72fa57c227e"
format_stamp: "Formatted at 2026-07-09 13:12:58 on dist-test-slave-vpdx"
I20260709 13:12:58.456097 28889 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 13:12:58.459267  4622 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:58.459977 28889 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 13:12:58.460250 28889 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602558744475-28889-0/minicluster-data/ts-1-root
uuid: "c800c72b860f42878733b72fa57c227e"
format_stamp: "Formatted at 2026-07-09 13:12:58 on dist-test-slave-vpdx"
I20260709 13:12:58.460546 28889 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602558744475-28889-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602558744475-28889-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602558744475-28889-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:58.478859 28889 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:58.479887 28889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:58.481268 28889 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:58.483695 28889 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:58.483901 28889 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:58.484153 28889 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:58.484293 28889 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:58.520704 28889 rpc_server.cc:307] RPC server started. Bound to: 127.28.54.66:43707
I20260709 13:12:58.520794  4684 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.54.66:43707 every 8 connection(s)
I20260709 13:12:58.525432 28889 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:12:58.532194  4688 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:12:58.533789  4689 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:58.536581 28889 server_base.cc:1061] running on GCE node
W20260709 13:12:58.536751  4691 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:12:58.537191  4685 heartbeater.cc:344] Connected to a master server at 127.28.54.126:39327
I20260709 13:12:58.537657  4685 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:58.537724 28889 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:12:58.538066 28889 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:12:58.538242 28889 hybrid_clock.cc:648] HybridClock initialized: now 1783602778538222 us; error 0 us; skew 500 ppm
I20260709 13:12:58.538496  4685 heartbeater.cc:507] Master 127.28.54.126:39327 requested a full tablet report, sending...
I20260709 13:12:58.538848 28889 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:12:58.540401  4483 ts_manager.cc:194] Registered new tserver with Master: c800c72b860f42878733b72fa57c227e (127.28.54.66:43707)
I20260709 13:12:58.541211 28889 webserver.cc:533] Webserver started at http://127.28.54.67:36683/ using document root <none> and password file <none>
I20260709 13:12:58.541702 28889 fs_manager.cc:362] Metadata directory not provided
I20260709 13:12:58.541747  4483 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34374
I20260709 13:12:58.541935 28889 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:12:58.542313 28889 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:12:58.543437 28889 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602558744475-28889-0/minicluster-data/ts-2-root/instance:
uuid: "308ac45a3f334cdcac265c0cfbbc039b"
format_stamp: "Formatted at 2026-07-09 13:12:58 on dist-test-slave-vpdx"
I20260709 13:12:58.547451 28889 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 13:12:58.550524  4696 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:58.551210 28889 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:12:58.551512 28889 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602558744475-28889-0/minicluster-data/ts-2-root
uuid: "308ac45a3f334cdcac265c0cfbbc039b"
format_stamp: "Formatted at 2026-07-09 13:12:58 on dist-test-slave-vpdx"
I20260709 13:12:58.551805 28889 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602558744475-28889-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602558744475-28889-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783602558744475-28889-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:12:58.584570 28889 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:12:58.585573 28889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:12:58.586923 28889 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:12:58.588997 28889 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:12:58.589184 28889 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:58.589406 28889 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:12:58.589555 28889 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:12:58.626816 28889 rpc_server.cc:307] RPC server started. Bound to: 127.28.54.67:43965
I20260709 13:12:58.626909  4758 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.54.67:43965 every 8 connection(s)
I20260709 13:12:58.639240  4759 heartbeater.cc:344] Connected to a master server at 127.28.54.126:39327
I20260709 13:12:58.639628  4759 heartbeater.cc:461] Registering TS with master...
I20260709 13:12:58.640327  4759 heartbeater.cc:507] Master 127.28.54.126:39327 requested a full tablet report, sending...
I20260709 13:12:58.642163  4483 ts_manager.cc:194] Registered new tserver with Master: 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965)
I20260709 13:12:58.642306 28889 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.012482135s
I20260709 13:12:58.643417  4483 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:34384
I20260709 13:12:58.665323  4483 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34386:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:12:58.667888  4483 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:12:58.732980  4575 tablet_service.cc:1511] Processing CreateTablet for tablet bc88f6f533ef4807bba8f78c14dbc9f2 (DEFAULT_TABLE table=test-workload [id=e71cd74f91f64771ae0486cfff2dbaad]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:58.734458  4575 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc88f6f533ef4807bba8f78c14dbc9f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.735477  4572 tablet_service.cc:1511] Processing CreateTablet for tablet 0e2df276ddf14a03bd0bb461cd92f6c9 (DEFAULT_TABLE table=test-workload [id=e71cd74f91f64771ae0486cfff2dbaad]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:58.736790  4572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e2df276ddf14a03bd0bb461cd92f6c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.737079  4571 tablet_service.cc:1511] Processing CreateTablet for tablet 984b5083f2394eef88d52b75f6705949 (DEFAULT_TABLE table=test-workload [id=e71cd74f91f64771ae0486cfff2dbaad]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:58.738336  4571 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 984b5083f2394eef88d52b75f6705949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.738564  4573 tablet_service.cc:1511] Processing CreateTablet for tablet c437ad3104ee4400a2917a4e7c362efa (DEFAULT_TABLE table=test-workload [id=e71cd74f91f64771ae0486cfff2dbaad]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:58.739758  4573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c437ad3104ee4400a2917a4e7c362efa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.742681  4574 tablet_service.cc:1511] Processing CreateTablet for tablet b69c4c8d794d46b5a9339d9cf118cfcd (DEFAULT_TABLE table=test-workload [id=e71cd74f91f64771ae0486cfff2dbaad]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:58.743916  4574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b69c4c8d794d46b5a9339d9cf118cfcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.744938  4570 tablet_service.cc:1511] Processing CreateTablet for tablet 4b35da8e30d245c5a00c054010005f9d (DEFAULT_TABLE table=test-workload [id=e71cd74f91f64771ae0486cfff2dbaad]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:58.746218  4570 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b35da8e30d245c5a00c054010005f9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.752966  4569 tablet_service.cc:1511] Processing CreateTablet for tablet d9d05411f1e749669cdf7c1be8d9d941 (DEFAULT_TABLE table=test-workload [id=e71cd74f91f64771ae0486cfff2dbaad]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:58.754453  4569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9d05411f1e749669cdf7c1be8d9d941. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.760135  4568 tablet_service.cc:1511] Processing CreateTablet for tablet f12e6e418b9c4465b718cdbb4786377a (DEFAULT_TABLE table=test-workload [id=e71cd74f91f64771ae0486cfff2dbaad]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:58.761561  4568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f12e6e418b9c4465b718cdbb4786377a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.764577  4567 tablet_service.cc:1511] Processing CreateTablet for tablet f68bd211ab4a49de8ad6de70a45d005a (DEFAULT_TABLE table=test-workload [id=e71cd74f91f64771ae0486cfff2dbaad]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:58.765914  4567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f68bd211ab4a49de8ad6de70a45d005a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.771770  4774 tablet_bootstrap.cc:492] T bc88f6f533ef4807bba8f78c14dbc9f2 P ed488ca31ad54b53836e5a10d053b568: Bootstrap starting.
I20260709 13:12:58.777333  4774 tablet_bootstrap.cc:654] T bc88f6f533ef4807bba8f78c14dbc9f2 P ed488ca31ad54b53836e5a10d053b568: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.801483  4724 tablet_service.cc:1511] Processing CreateTablet for tablet bc88f6f533ef4807bba8f78c14dbc9f2 (DEFAULT_TABLE table=test-workload [id=e71cd74f91f64771ae0486cfff2dbaad]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:58.802914  4724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc88f6f533ef4807bba8f78c14dbc9f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.804160  4774 tablet_bootstrap.cc:492] T bc88f6f533ef4807bba8f78c14dbc9f2 P ed488ca31ad54b53836e5a10d053b568: No bootstrap required, opened a new log
I20260709 13:12:58.804672  4774 ts_tablet_manager.cc:1403] T bc88f6f533ef4807bba8f78c14dbc9f2 P ed488ca31ad54b53836e5a10d053b568: Time spent bootstrapping tablet: real 0.033s	user 0.012s	sys 0.017s
I20260709 13:12:58.806519  4716 tablet_service.cc:1511] Processing CreateTablet for tablet f68bd211ab4a49de8ad6de70a45d005a (DEFAULT_TABLE table=test-workload [id=e71cd74f91f64771ae0486cfff2dbaad]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:58.807848  4716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f68bd211ab4a49de8ad6de70a45d005a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.807534  4722 tablet_service.cc:1511] Processing CreateTablet for tablet c437ad3104ee4400a2917a4e7c362efa (DEFAULT_TABLE table=test-workload [id=e71cd74f91f64771ae0486cfff2dbaad]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:58.809182  4722 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c437ad3104ee4400a2917a4e7c362efa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.806517  4723 tablet_service.cc:1511] Processing CreateTablet for tablet b69c4c8d794d46b5a9339d9cf118cfcd (DEFAULT_TABLE table=test-workload [id=e71cd74f91f64771ae0486cfff2dbaad]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:58.810271  4723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b69c4c8d794d46b5a9339d9cf118cfcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.810793  4721 tablet_service.cc:1511] Processing CreateTablet for tablet 0e2df276ddf14a03bd0bb461cd92f6c9 (DEFAULT_TABLE table=test-workload [id=e71cd74f91f64771ae0486cfff2dbaad]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:58.812141  4721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e2df276ddf14a03bd0bb461cd92f6c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.814013  4720 tablet_service.cc:1511] Processing CreateTablet for tablet 984b5083f2394eef88d52b75f6705949 (DEFAULT_TABLE table=test-workload [id=e71cd74f91f64771ae0486cfff2dbaad]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:58.815352  4774 raft_consensus.cc:359] T bc88f6f533ef4807bba8f78c14dbc9f2 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } }
I20260709 13:12:58.816175  4774 raft_consensus.cc:385] T bc88f6f533ef4807bba8f78c14dbc9f2 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.816475  4774 raft_consensus.cc:740] T bc88f6f533ef4807bba8f78c14dbc9f2 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed488ca31ad54b53836e5a10d053b568, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.815311  4720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 984b5083f2394eef88d52b75f6705949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.817492  4774 consensus_queue.cc:260] T bc88f6f533ef4807bba8f78c14dbc9f2 P ed488ca31ad54b53836e5a10d053b568 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } }
I20260709 13:12:58.817881  4718 tablet_service.cc:1511] Processing CreateTablet for tablet d9d05411f1e749669cdf7c1be8d9d941 (DEFAULT_TABLE table=test-workload [id=e71cd74f91f64771ae0486cfff2dbaad]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:58.818797  4649 tablet_service.cc:1511] Processing CreateTablet for tablet b69c4c8d794d46b5a9339d9cf118cfcd (DEFAULT_TABLE table=test-workload [id=e71cd74f91f64771ae0486cfff2dbaad]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:12:58.816509  4719 tablet_service.cc:1511] Processing CreateTablet for tablet 4b35da8e30d245c5a00c054010005f9d (DEFAULT_TABLE table=test-workload [id=e71cd74f91f64771ae0486cfff2dbaad]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:58.820119  4649 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b69c4c8d794d46b5a9339d9cf118cfcd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.819300  4718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9d05411f1e749669cdf7c1be8d9d941. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.820017  4650 tablet_service.cc:1511] Processing CreateTablet for tablet bc88f6f533ef4807bba8f78c14dbc9f2 (DEFAULT_TABLE table=test-workload [id=e71cd74f91f64771ae0486cfff2dbaad]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:12:58.818833  4717 tablet_service.cc:1511] Processing CreateTablet for tablet f12e6e418b9c4465b718cdbb4786377a (DEFAULT_TABLE table=test-workload [id=e71cd74f91f64771ae0486cfff2dbaad]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:58.822801  4719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b35da8e30d245c5a00c054010005f9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.823372  4650 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc88f6f533ef4807bba8f78c14dbc9f2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.823588  4717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f12e6e418b9c4465b718cdbb4786377a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.828140  4648 tablet_service.cc:1511] Processing CreateTablet for tablet c437ad3104ee4400a2917a4e7c362efa (DEFAULT_TABLE table=test-workload [id=e71cd74f91f64771ae0486cfff2dbaad]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:12:58.829458  4648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c437ad3104ee4400a2917a4e7c362efa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.835289  4647 tablet_service.cc:1511] Processing CreateTablet for tablet 0e2df276ddf14a03bd0bb461cd92f6c9 (DEFAULT_TABLE table=test-workload [id=e71cd74f91f64771ae0486cfff2dbaad]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:12:58.836601  4647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0e2df276ddf14a03bd0bb461cd92f6c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.839234  4646 tablet_service.cc:1511] Processing CreateTablet for tablet 984b5083f2394eef88d52b75f6705949 (DEFAULT_TABLE table=test-workload [id=e71cd74f91f64771ae0486cfff2dbaad]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:12:58.840646  4646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 984b5083f2394eef88d52b75f6705949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.843439  4645 tablet_service.cc:1511] Processing CreateTablet for tablet 4b35da8e30d245c5a00c054010005f9d (DEFAULT_TABLE table=test-workload [id=e71cd74f91f64771ae0486cfff2dbaad]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:12:58.845033  4645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b35da8e30d245c5a00c054010005f9d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.847424  4644 tablet_service.cc:1511] Processing CreateTablet for tablet d9d05411f1e749669cdf7c1be8d9d941 (DEFAULT_TABLE table=test-workload [id=e71cd74f91f64771ae0486cfff2dbaad]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:12:58.847765  4643 tablet_service.cc:1511] Processing CreateTablet for tablet f12e6e418b9c4465b718cdbb4786377a (DEFAULT_TABLE table=test-workload [id=e71cd74f91f64771ae0486cfff2dbaad]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:12:58.848879  4644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d9d05411f1e749669cdf7c1be8d9d941. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.849567  4643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f12e6e418b9c4465b718cdbb4786377a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.883443  4642 tablet_service.cc:1511] Processing CreateTablet for tablet f68bd211ab4a49de8ad6de70a45d005a (DEFAULT_TABLE table=test-workload [id=e71cd74f91f64771ae0486cfff2dbaad]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:12:58.885004  4642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f68bd211ab4a49de8ad6de70a45d005a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:12:58.934324  4610 heartbeater.cc:499] Master 127.28.54.126:39327 was elected leader, sending a full tablet report...
I20260709 13:12:58.934880  4774 ts_tablet_manager.cc:1434] T bc88f6f533ef4807bba8f78c14dbc9f2 P ed488ca31ad54b53836e5a10d053b568: Time spent starting tablet: real 0.130s	user 0.058s	sys 0.070s
I20260709 13:12:58.935889  4774 tablet_bootstrap.cc:492] T 984b5083f2394eef88d52b75f6705949 P ed488ca31ad54b53836e5a10d053b568: Bootstrap starting.
I20260709 13:12:58.941661  4774 tablet_bootstrap.cc:654] T 984b5083f2394eef88d52b75f6705949 P ed488ca31ad54b53836e5a10d053b568: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.954221  4774 tablet_bootstrap.cc:492] T 984b5083f2394eef88d52b75f6705949 P ed488ca31ad54b53836e5a10d053b568: No bootstrap required, opened a new log
I20260709 13:12:58.954692  4774 ts_tablet_manager.cc:1403] T 984b5083f2394eef88d52b75f6705949 P ed488ca31ad54b53836e5a10d053b568: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.002s
I20260709 13:12:58.957458  4774 raft_consensus.cc:359] T 984b5083f2394eef88d52b75f6705949 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:58.958137  4774 raft_consensus.cc:385] T 984b5083f2394eef88d52b75f6705949 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:58.958736  4774 raft_consensus.cc:740] T 984b5083f2394eef88d52b75f6705949 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed488ca31ad54b53836e5a10d053b568, State: Initialized, Role: FOLLOWER
I20260709 13:12:58.960058  4774 consensus_queue.cc:260] T 984b5083f2394eef88d52b75f6705949 P ed488ca31ad54b53836e5a10d053b568 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:58.970084  4778 tablet_bootstrap.cc:492] T d9d05411f1e749669cdf7c1be8d9d941 P c800c72b860f42878733b72fa57c227e: Bootstrap starting.
I20260709 13:12:58.973784  4774 ts_tablet_manager.cc:1434] T 984b5083f2394eef88d52b75f6705949 P ed488ca31ad54b53836e5a10d053b568: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260709 13:12:58.974804  4774 tablet_bootstrap.cc:492] T 4b35da8e30d245c5a00c054010005f9d P ed488ca31ad54b53836e5a10d053b568: Bootstrap starting.
I20260709 13:12:58.980970  4777 tablet_bootstrap.cc:492] T 4b35da8e30d245c5a00c054010005f9d P 308ac45a3f334cdcac265c0cfbbc039b: Bootstrap starting.
I20260709 13:12:58.986747  4777 tablet_bootstrap.cc:654] T 4b35da8e30d245c5a00c054010005f9d P 308ac45a3f334cdcac265c0cfbbc039b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.990445  4778 tablet_bootstrap.cc:654] T d9d05411f1e749669cdf7c1be8d9d941 P c800c72b860f42878733b72fa57c227e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:58.990820  4774 tablet_bootstrap.cc:654] T 4b35da8e30d245c5a00c054010005f9d P ed488ca31ad54b53836e5a10d053b568: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.004176  4778 tablet_bootstrap.cc:492] T d9d05411f1e749669cdf7c1be8d9d941 P c800c72b860f42878733b72fa57c227e: No bootstrap required, opened a new log
I20260709 13:12:59.004685  4778 ts_tablet_manager.cc:1403] T d9d05411f1e749669cdf7c1be8d9d941 P c800c72b860f42878733b72fa57c227e: Time spent bootstrapping tablet: real 0.035s	user 0.005s	sys 0.007s
I20260709 13:12:59.005414  4774 tablet_bootstrap.cc:492] T 4b35da8e30d245c5a00c054010005f9d P ed488ca31ad54b53836e5a10d053b568: No bootstrap required, opened a new log
I20260709 13:12:59.005978  4774 ts_tablet_manager.cc:1403] T 4b35da8e30d245c5a00c054010005f9d P ed488ca31ad54b53836e5a10d053b568: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.000s
I20260709 13:12:59.005987  4777 tablet_bootstrap.cc:492] T 4b35da8e30d245c5a00c054010005f9d P 308ac45a3f334cdcac265c0cfbbc039b: No bootstrap required, opened a new log
I20260709 13:12:59.006680  4777 ts_tablet_manager.cc:1403] T 4b35da8e30d245c5a00c054010005f9d P 308ac45a3f334cdcac265c0cfbbc039b: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.000s
I20260709 13:12:59.007467  4778 raft_consensus.cc:359] T d9d05411f1e749669cdf7c1be8d9d941 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.008277  4778 raft_consensus.cc:385] T d9d05411f1e749669cdf7c1be8d9d941 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.008606  4778 raft_consensus.cc:740] T d9d05411f1e749669cdf7c1be8d9d941 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c800c72b860f42878733b72fa57c227e, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.008791  4774 raft_consensus.cc:359] T 4b35da8e30d245c5a00c054010005f9d P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.009521  4774 raft_consensus.cc:385] T 4b35da8e30d245c5a00c054010005f9d P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.009298  4777 raft_consensus.cc:359] T 4b35da8e30d245c5a00c054010005f9d P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.009358  4778 consensus_queue.cc:260] T d9d05411f1e749669cdf7c1be8d9d941 P c800c72b860f42878733b72fa57c227e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.010012  4774 raft_consensus.cc:740] T 4b35da8e30d245c5a00c054010005f9d P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed488ca31ad54b53836e5a10d053b568, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.010169  4777 raft_consensus.cc:385] T 4b35da8e30d245c5a00c054010005f9d P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.010502  4777 raft_consensus.cc:740] T 4b35da8e30d245c5a00c054010005f9d P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 308ac45a3f334cdcac265c0cfbbc039b, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.010845  4774 consensus_queue.cc:260] T 4b35da8e30d245c5a00c054010005f9d P ed488ca31ad54b53836e5a10d053b568 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.011240  4777 consensus_queue.cc:260] T 4b35da8e30d245c5a00c054010005f9d P 308ac45a3f334cdcac265c0cfbbc039b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.011987  4685 heartbeater.cc:499] Master 127.28.54.126:39327 was elected leader, sending a full tablet report...
I20260709 13:12:59.012423  4778 ts_tablet_manager.cc:1434] T d9d05411f1e749669cdf7c1be8d9d941 P c800c72b860f42878733b72fa57c227e: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.001s
I20260709 13:12:59.013535  4778 tablet_bootstrap.cc:492] T bc88f6f533ef4807bba8f78c14dbc9f2 P c800c72b860f42878733b72fa57c227e: Bootstrap starting.
I20260709 13:12:59.013994  4777 ts_tablet_manager.cc:1434] T 4b35da8e30d245c5a00c054010005f9d P 308ac45a3f334cdcac265c0cfbbc039b: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:12:59.014794  4777 tablet_bootstrap.cc:492] T 984b5083f2394eef88d52b75f6705949 P 308ac45a3f334cdcac265c0cfbbc039b: Bootstrap starting.
I20260709 13:12:59.015879  4759 heartbeater.cc:499] Master 127.28.54.126:39327 was elected leader, sending a full tablet report...
I20260709 13:12:59.018996  4778 tablet_bootstrap.cc:654] T bc88f6f533ef4807bba8f78c14dbc9f2 P c800c72b860f42878733b72fa57c227e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.021437  4777 tablet_bootstrap.cc:654] T 984b5083f2394eef88d52b75f6705949 P 308ac45a3f334cdcac265c0cfbbc039b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.030566  4778 tablet_bootstrap.cc:492] T bc88f6f533ef4807bba8f78c14dbc9f2 P c800c72b860f42878733b72fa57c227e: No bootstrap required, opened a new log
I20260709 13:12:59.030966  4778 ts_tablet_manager.cc:1403] T bc88f6f533ef4807bba8f78c14dbc9f2 P c800c72b860f42878733b72fa57c227e: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.008s
I20260709 13:12:59.032923  4778 raft_consensus.cc:359] T bc88f6f533ef4807bba8f78c14dbc9f2 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } }
I20260709 13:12:59.033391  4778 raft_consensus.cc:385] T bc88f6f533ef4807bba8f78c14dbc9f2 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.033716  4778 raft_consensus.cc:740] T bc88f6f533ef4807bba8f78c14dbc9f2 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c800c72b860f42878733b72fa57c227e, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.034770  4774 ts_tablet_manager.cc:1434] T 4b35da8e30d245c5a00c054010005f9d P ed488ca31ad54b53836e5a10d053b568: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260709 13:12:59.034631  4778 consensus_queue.cc:260] T bc88f6f533ef4807bba8f78c14dbc9f2 P c800c72b860f42878733b72fa57c227e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } }
I20260709 13:12:59.035843  4774 tablet_bootstrap.cc:492] T f12e6e418b9c4465b718cdbb4786377a P ed488ca31ad54b53836e5a10d053b568: Bootstrap starting.
I20260709 13:12:59.037544  4778 ts_tablet_manager.cc:1434] T bc88f6f533ef4807bba8f78c14dbc9f2 P c800c72b860f42878733b72fa57c227e: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 13:12:59.038604  4778 tablet_bootstrap.cc:492] T b69c4c8d794d46b5a9339d9cf118cfcd P c800c72b860f42878733b72fa57c227e: Bootstrap starting.
I20260709 13:12:59.042215  4774 tablet_bootstrap.cc:654] T f12e6e418b9c4465b718cdbb4786377a P ed488ca31ad54b53836e5a10d053b568: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.044114  4778 tablet_bootstrap.cc:654] T b69c4c8d794d46b5a9339d9cf118cfcd P c800c72b860f42878733b72fa57c227e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.044689  4777 tablet_bootstrap.cc:492] T 984b5083f2394eef88d52b75f6705949 P 308ac45a3f334cdcac265c0cfbbc039b: No bootstrap required, opened a new log
I20260709 13:12:59.045265  4777 ts_tablet_manager.cc:1403] T 984b5083f2394eef88d52b75f6705949 P 308ac45a3f334cdcac265c0cfbbc039b: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.005s
I20260709 13:12:59.048177  4777 raft_consensus.cc:359] T 984b5083f2394eef88d52b75f6705949 P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.048974  4777 raft_consensus.cc:385] T 984b5083f2394eef88d52b75f6705949 P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.049333  4777 raft_consensus.cc:740] T 984b5083f2394eef88d52b75f6705949 P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 308ac45a3f334cdcac265c0cfbbc039b, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.049527  4776 raft_consensus.cc:493] T 984b5083f2394eef88d52b75f6705949 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.050421  4776 raft_consensus.cc:515] T 984b5083f2394eef88d52b75f6705949 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.050405  4777 consensus_queue.cc:260] T 984b5083f2394eef88d52b75f6705949 P 308ac45a3f334cdcac265c0cfbbc039b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.053277  4774 tablet_bootstrap.cc:492] T f12e6e418b9c4465b718cdbb4786377a P ed488ca31ad54b53836e5a10d053b568: No bootstrap required, opened a new log
I20260709 13:12:59.054107  4774 ts_tablet_manager.cc:1403] T f12e6e418b9c4465b718cdbb4786377a P ed488ca31ad54b53836e5a10d053b568: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260709 13:12:59.056247  4778 tablet_bootstrap.cc:492] T b69c4c8d794d46b5a9339d9cf118cfcd P c800c72b860f42878733b72fa57c227e: No bootstrap required, opened a new log
I20260709 13:12:59.056792  4778 ts_tablet_manager.cc:1403] T b69c4c8d794d46b5a9339d9cf118cfcd P c800c72b860f42878733b72fa57c227e: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.007s
I20260709 13:12:59.056941  4774 raft_consensus.cc:359] T f12e6e418b9c4465b718cdbb4786377a P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.057668  4774 raft_consensus.cc:385] T f12e6e418b9c4465b718cdbb4786377a P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.057991  4774 raft_consensus.cc:740] T f12e6e418b9c4465b718cdbb4786377a P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed488ca31ad54b53836e5a10d053b568, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.058676  4774 consensus_queue.cc:260] T f12e6e418b9c4465b718cdbb4786377a P ed488ca31ad54b53836e5a10d053b568 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.053453  4777 ts_tablet_manager.cc:1434] T 984b5083f2394eef88d52b75f6705949 P 308ac45a3f334cdcac265c0cfbbc039b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:12:59.060010  4778 raft_consensus.cc:359] T b69c4c8d794d46b5a9339d9cf118cfcd P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.060737  4778 raft_consensus.cc:385] T b69c4c8d794d46b5a9339d9cf118cfcd P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.060849  4777 tablet_bootstrap.cc:492] T 0e2df276ddf14a03bd0bb461cd92f6c9 P 308ac45a3f334cdcac265c0cfbbc039b: Bootstrap starting.
I20260709 13:12:59.062424  4776 leader_election.cc:290] T 984b5083f2394eef88d52b75f6705949 P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c800c72b860f42878733b72fa57c227e (127.28.54.66:43707), 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965)
I20260709 13:12:59.065835  4778 raft_consensus.cc:740] T b69c4c8d794d46b5a9339d9cf118cfcd P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c800c72b860f42878733b72fa57c227e, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.067420  4777 tablet_bootstrap.cc:654] T 0e2df276ddf14a03bd0bb461cd92f6c9 P 308ac45a3f334cdcac265c0cfbbc039b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.067586  4774 ts_tablet_manager.cc:1434] T f12e6e418b9c4465b718cdbb4786377a P ed488ca31ad54b53836e5a10d053b568: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.005s
I20260709 13:12:59.067942  4778 consensus_queue.cc:260] T b69c4c8d794d46b5a9339d9cf118cfcd P c800c72b860f42878733b72fa57c227e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.068625  4774 tablet_bootstrap.cc:492] T d9d05411f1e749669cdf7c1be8d9d941 P ed488ca31ad54b53836e5a10d053b568: Bootstrap starting.
I20260709 13:12:59.070174  4778 ts_tablet_manager.cc:1434] T b69c4c8d794d46b5a9339d9cf118cfcd P c800c72b860f42878733b72fa57c227e: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.002s
I20260709 13:12:59.071170  4778 tablet_bootstrap.cc:492] T c437ad3104ee4400a2917a4e7c362efa P c800c72b860f42878733b72fa57c227e: Bootstrap starting.
I20260709 13:12:59.074890  4774 tablet_bootstrap.cc:654] T d9d05411f1e749669cdf7c1be8d9d941 P ed488ca31ad54b53836e5a10d053b568: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.076771  4778 tablet_bootstrap.cc:654] T c437ad3104ee4400a2917a4e7c362efa P c800c72b860f42878733b72fa57c227e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.088008  4774 tablet_bootstrap.cc:492] T d9d05411f1e749669cdf7c1be8d9d941 P ed488ca31ad54b53836e5a10d053b568: No bootstrap required, opened a new log
I20260709 13:12:59.088008  4777 tablet_bootstrap.cc:492] T 0e2df276ddf14a03bd0bb461cd92f6c9 P 308ac45a3f334cdcac265c0cfbbc039b: No bootstrap required, opened a new log
I20260709 13:12:59.088737  4774 ts_tablet_manager.cc:1403] T d9d05411f1e749669cdf7c1be8d9d941 P ed488ca31ad54b53836e5a10d053b568: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.009s
I20260709 13:12:59.088783  4777 ts_tablet_manager.cc:1403] T 0e2df276ddf14a03bd0bb461cd92f6c9 P 308ac45a3f334cdcac265c0cfbbc039b: Time spent bootstrapping tablet: real 0.028s	user 0.015s	sys 0.000s
I20260709 13:12:59.091837  4774 raft_consensus.cc:359] T d9d05411f1e749669cdf7c1be8d9d941 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.092067  4777 raft_consensus.cc:359] T 0e2df276ddf14a03bd0bb461cd92f6c9 P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.092628  4774 raft_consensus.cc:385] T d9d05411f1e749669cdf7c1be8d9d941 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.092780  4777 raft_consensus.cc:385] T 0e2df276ddf14a03bd0bb461cd92f6c9 P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.093003  4774 raft_consensus.cc:740] T d9d05411f1e749669cdf7c1be8d9d941 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed488ca31ad54b53836e5a10d053b568, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.093122  4777 raft_consensus.cc:740] T 0e2df276ddf14a03bd0bb461cd92f6c9 P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 308ac45a3f334cdcac265c0cfbbc039b, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.093914  4777 consensus_queue.cc:260] T 0e2df276ddf14a03bd0bb461cd92f6c9 P 308ac45a3f334cdcac265c0cfbbc039b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.094030  4774 consensus_queue.cc:260] T d9d05411f1e749669cdf7c1be8d9d941 P ed488ca31ad54b53836e5a10d053b568 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.098292  4734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984b5083f2394eef88d52b75f6705949" candidate_uuid: "ed488ca31ad54b53836e5a10d053b568" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b" is_pre_election: true
I20260709 13:12:59.098968  4734 raft_consensus.cc:2468] T 984b5083f2394eef88d52b75f6705949 P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed488ca31ad54b53836e5a10d053b568 in term 0.
I20260709 13:12:59.100667  4774 ts_tablet_manager.cc:1434] T d9d05411f1e749669cdf7c1be8d9d941 P ed488ca31ad54b53836e5a10d053b568: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 13:12:59.100790  4783 raft_consensus.cc:493] T b69c4c8d794d46b5a9339d9cf118cfcd P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.101022  4660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984b5083f2394eef88d52b75f6705949" candidate_uuid: "ed488ca31ad54b53836e5a10d053b568" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c800c72b860f42878733b72fa57c227e" is_pre_election: true
I20260709 13:12:59.101325  4783 raft_consensus.cc:515] T b69c4c8d794d46b5a9339d9cf118cfcd P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.101969  4774 tablet_bootstrap.cc:492] T b69c4c8d794d46b5a9339d9cf118cfcd P ed488ca31ad54b53836e5a10d053b568: Bootstrap starting.
I20260709 13:12:59.102725  4548 leader_election.cc:304] T 984b5083f2394eef88d52b75f6705949 P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 308ac45a3f334cdcac265c0cfbbc039b, ed488ca31ad54b53836e5a10d053b568; no voters: 
W20260709 13:12:59.103734  4550 leader_election.cc:343] T 984b5083f2394eef88d52b75f6705949 P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c800c72b860f42878733b72fa57c227e (127.28.54.66:43707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:59.103819  4776 raft_consensus.cc:2804] T 984b5083f2394eef88d52b75f6705949 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:59.104259  4776 raft_consensus.cc:493] T 984b5083f2394eef88d52b75f6705949 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.105363  4776 raft_consensus.cc:3060] T 984b5083f2394eef88d52b75f6705949 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.106740  4777 ts_tablet_manager.cc:1434] T 0e2df276ddf14a03bd0bb461cd92f6c9 P 308ac45a3f334cdcac265c0cfbbc039b: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 13:12:59.107648  4777 tablet_bootstrap.cc:492] T c437ad3104ee4400a2917a4e7c362efa P 308ac45a3f334cdcac265c0cfbbc039b: Bootstrap starting.
I20260709 13:12:59.111778  4783 leader_election.cc:290] T b69c4c8d794d46b5a9339d9cf118cfcd P c800c72b860f42878733b72fa57c227e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed488ca31ad54b53836e5a10d053b568 (127.28.54.65:36419), 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965)
I20260709 13:12:59.119294  4776 raft_consensus.cc:515] T 984b5083f2394eef88d52b75f6705949 P ed488ca31ad54b53836e5a10d053b568 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.121802  4777 tablet_bootstrap.cc:654] T c437ad3104ee4400a2917a4e7c362efa P 308ac45a3f334cdcac265c0cfbbc039b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.123593  4660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984b5083f2394eef88d52b75f6705949" candidate_uuid: "ed488ca31ad54b53836e5a10d053b568" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c800c72b860f42878733b72fa57c227e"
I20260709 13:12:59.124096  4734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984b5083f2394eef88d52b75f6705949" candidate_uuid: "ed488ca31ad54b53836e5a10d053b568" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b"
I20260709 13:12:59.125063  4734 raft_consensus.cc:3060] T 984b5083f2394eef88d52b75f6705949 P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:59.125528  4550 leader_election.cc:343] T 984b5083f2394eef88d52b75f6705949 P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c800c72b860f42878733b72fa57c227e (127.28.54.66:43707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:59.126572  4774 tablet_bootstrap.cc:654] T b69c4c8d794d46b5a9339d9cf118cfcd P ed488ca31ad54b53836e5a10d053b568: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.127399  4778 tablet_bootstrap.cc:492] T c437ad3104ee4400a2917a4e7c362efa P c800c72b860f42878733b72fa57c227e: No bootstrap required, opened a new log
I20260709 13:12:59.127882  4778 ts_tablet_manager.cc:1403] T c437ad3104ee4400a2917a4e7c362efa P c800c72b860f42878733b72fa57c227e: Time spent bootstrapping tablet: real 0.057s	user 0.021s	sys 0.005s
I20260709 13:12:59.124786  4776 leader_election.cc:290] T 984b5083f2394eef88d52b75f6705949 P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 election: Requested vote from peers c800c72b860f42878733b72fa57c227e (127.28.54.66:43707), 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965)
I20260709 13:12:59.131511  4778 raft_consensus.cc:359] T c437ad3104ee4400a2917a4e7c362efa P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.132241  4778 raft_consensus.cc:385] T c437ad3104ee4400a2917a4e7c362efa P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.132593  4778 raft_consensus.cc:740] T c437ad3104ee4400a2917a4e7c362efa P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c800c72b860f42878733b72fa57c227e, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.133031  4734 raft_consensus.cc:2468] T 984b5083f2394eef88d52b75f6705949 P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed488ca31ad54b53836e5a10d053b568 in term 1.
I20260709 13:12:59.133365  4778 consensus_queue.cc:260] T c437ad3104ee4400a2917a4e7c362efa P c800c72b860f42878733b72fa57c227e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.134322  4548 leader_election.cc:304] T 984b5083f2394eef88d52b75f6705949 P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 308ac45a3f334cdcac265c0cfbbc039b, ed488ca31ad54b53836e5a10d053b568; no voters: c800c72b860f42878733b72fa57c227e
I20260709 13:12:59.135545  4776 raft_consensus.cc:2804] T 984b5083f2394eef88d52b75f6705949 P ed488ca31ad54b53836e5a10d053b568 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:59.135640  4778 ts_tablet_manager.cc:1434] T c437ad3104ee4400a2917a4e7c362efa P c800c72b860f42878733b72fa57c227e: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:12:59.135910  4774 tablet_bootstrap.cc:492] T b69c4c8d794d46b5a9339d9cf118cfcd P ed488ca31ad54b53836e5a10d053b568: No bootstrap required, opened a new log
I20260709 13:12:59.136785  4778 tablet_bootstrap.cc:492] T f68bd211ab4a49de8ad6de70a45d005a P c800c72b860f42878733b72fa57c227e: Bootstrap starting.
I20260709 13:12:59.137048  4774 ts_tablet_manager.cc:1403] T b69c4c8d794d46b5a9339d9cf118cfcd P ed488ca31ad54b53836e5a10d053b568: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.000s
I20260709 13:12:59.138268  4777 tablet_bootstrap.cc:492] T c437ad3104ee4400a2917a4e7c362efa P 308ac45a3f334cdcac265c0cfbbc039b: No bootstrap required, opened a new log
I20260709 13:12:59.138803  4777 ts_tablet_manager.cc:1403] T c437ad3104ee4400a2917a4e7c362efa P 308ac45a3f334cdcac265c0cfbbc039b: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.000s
I20260709 13:12:59.140077  4774 raft_consensus.cc:359] T b69c4c8d794d46b5a9339d9cf118cfcd P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.141180  4774 raft_consensus.cc:385] T b69c4c8d794d46b5a9339d9cf118cfcd P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.141462  4774 raft_consensus.cc:740] T b69c4c8d794d46b5a9339d9cf118cfcd P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed488ca31ad54b53836e5a10d053b568, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.142191  4774 consensus_queue.cc:260] T b69c4c8d794d46b5a9339d9cf118cfcd P ed488ca31ad54b53836e5a10d053b568 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.142277  4777 raft_consensus.cc:359] T c437ad3104ee4400a2917a4e7c362efa P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.143417  4777 raft_consensus.cc:385] T c437ad3104ee4400a2917a4e7c362efa P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.143714  4777 raft_consensus.cc:740] T c437ad3104ee4400a2917a4e7c362efa P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 308ac45a3f334cdcac265c0cfbbc039b, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.140442  4776 raft_consensus.cc:697] T 984b5083f2394eef88d52b75f6705949 P ed488ca31ad54b53836e5a10d053b568 [term 1 LEADER]: Becoming Leader. State: Replica: ed488ca31ad54b53836e5a10d053b568, State: Running, Role: LEADER
I20260709 13:12:59.144452  4777 consensus_queue.cc:260] T c437ad3104ee4400a2917a4e7c362efa P 308ac45a3f334cdcac265c0cfbbc039b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.145112  4776 consensus_queue.cc:237] T 984b5083f2394eef88d52b75f6705949 P ed488ca31ad54b53836e5a10d053b568 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.146610  4777 ts_tablet_manager.cc:1434] T c437ad3104ee4400a2917a4e7c362efa P 308ac45a3f334cdcac265c0cfbbc039b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:12:59.148743  4774 ts_tablet_manager.cc:1434] T b69c4c8d794d46b5a9339d9cf118cfcd P ed488ca31ad54b53836e5a10d053b568: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 13:12:59.149497  4778 tablet_bootstrap.cc:654] T f68bd211ab4a49de8ad6de70a45d005a P c800c72b860f42878733b72fa57c227e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.149788  4774 tablet_bootstrap.cc:492] T 0e2df276ddf14a03bd0bb461cd92f6c9 P ed488ca31ad54b53836e5a10d053b568: Bootstrap starting.
I20260709 13:12:59.154656  4777 tablet_bootstrap.cc:492] T d9d05411f1e749669cdf7c1be8d9d941 P 308ac45a3f334cdcac265c0cfbbc039b: Bootstrap starting.
I20260709 13:12:59.156883  4774 tablet_bootstrap.cc:654] T 0e2df276ddf14a03bd0bb461cd92f6c9 P ed488ca31ad54b53836e5a10d053b568: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.159121  4585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b69c4c8d794d46b5a9339d9cf118cfcd" candidate_uuid: "c800c72b860f42878733b72fa57c227e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed488ca31ad54b53836e5a10d053b568" is_pre_election: true
I20260709 13:12:59.159475  4776 raft_consensus.cc:493] T 4b35da8e30d245c5a00c054010005f9d P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.159962  4776 raft_consensus.cc:515] T 4b35da8e30d245c5a00c054010005f9d P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.162067  4776 leader_election.cc:290] T 4b35da8e30d245c5a00c054010005f9d P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c800c72b860f42878733b72fa57c227e (127.28.54.66:43707), 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965)
I20260709 13:12:59.163197  4777 tablet_bootstrap.cc:654] T d9d05411f1e749669cdf7c1be8d9d941 P 308ac45a3f334cdcac265c0cfbbc039b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.162591  4481 catalog_manager.cc:5697] T 984b5083f2394eef88d52b75f6705949 P ed488ca31ad54b53836e5a10d053b568 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed488ca31ad54b53836e5a10d053b568 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "ed488ca31ad54b53836e5a10d053b568" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:59.164901  4660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b35da8e30d245c5a00c054010005f9d" candidate_uuid: "ed488ca31ad54b53836e5a10d053b568" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c800c72b860f42878733b72fa57c227e" is_pre_election: true
I20260709 13:12:59.167793  4585 raft_consensus.cc:2468] T b69c4c8d794d46b5a9339d9cf118cfcd P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c800c72b860f42878733b72fa57c227e in term 0.
W20260709 13:12:59.167891  4550 leader_election.cc:343] T 4b35da8e30d245c5a00c054010005f9d P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c800c72b860f42878733b72fa57c227e (127.28.54.66:43707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:59.155143  4778 tablet_bootstrap.cc:492] T f68bd211ab4a49de8ad6de70a45d005a P c800c72b860f42878733b72fa57c227e: No bootstrap required, opened a new log
I20260709 13:12:59.169346  4778 ts_tablet_manager.cc:1403] T f68bd211ab4a49de8ad6de70a45d005a P c800c72b860f42878733b72fa57c227e: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.001s
I20260709 13:12:59.172320  4774 tablet_bootstrap.cc:492] T 0e2df276ddf14a03bd0bb461cd92f6c9 P ed488ca31ad54b53836e5a10d053b568: No bootstrap required, opened a new log
I20260709 13:12:59.172456  4778 raft_consensus.cc:359] T f68bd211ab4a49de8ad6de70a45d005a P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.172955  4774 ts_tablet_manager.cc:1403] T 0e2df276ddf14a03bd0bb461cd92f6c9 P ed488ca31ad54b53836e5a10d053b568: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.003s
I20260709 13:12:59.173214  4778 raft_consensus.cc:385] T f68bd211ab4a49de8ad6de70a45d005a P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.173542  4778 raft_consensus.cc:740] T f68bd211ab4a49de8ad6de70a45d005a P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c800c72b860f42878733b72fa57c227e, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.174418  4778 consensus_queue.cc:260] T f68bd211ab4a49de8ad6de70a45d005a P c800c72b860f42878733b72fa57c227e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.175941  4774 raft_consensus.cc:359] T 0e2df276ddf14a03bd0bb461cd92f6c9 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.176474  4778 ts_tablet_manager.cc:1434] T f68bd211ab4a49de8ad6de70a45d005a P c800c72b860f42878733b72fa57c227e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:12:59.176692  4774 raft_consensus.cc:385] T 0e2df276ddf14a03bd0bb461cd92f6c9 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.177038  4774 raft_consensus.cc:740] T 0e2df276ddf14a03bd0bb461cd92f6c9 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed488ca31ad54b53836e5a10d053b568, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.177870  4774 consensus_queue.cc:260] T 0e2df276ddf14a03bd0bb461cd92f6c9 P ed488ca31ad54b53836e5a10d053b568 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.180336  4774 ts_tablet_manager.cc:1434] T 0e2df276ddf14a03bd0bb461cd92f6c9 P ed488ca31ad54b53836e5a10d053b568: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:12:59.181315  4774 tablet_bootstrap.cc:492] T f68bd211ab4a49de8ad6de70a45d005a P ed488ca31ad54b53836e5a10d053b568: Bootstrap starting.
I20260709 13:12:59.183828  4778 tablet_bootstrap.cc:492] T f12e6e418b9c4465b718cdbb4786377a P c800c72b860f42878733b72fa57c227e: Bootstrap starting.
I20260709 13:12:59.169294  4625 leader_election.cc:304] T b69c4c8d794d46b5a9339d9cf118cfcd P c800c72b860f42878733b72fa57c227e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c800c72b860f42878733b72fa57c227e, ed488ca31ad54b53836e5a10d053b568; no voters: 
I20260709 13:12:59.186208  4783 raft_consensus.cc:2804] T b69c4c8d794d46b5a9339d9cf118cfcd P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:59.186604  4783 raft_consensus.cc:493] T b69c4c8d794d46b5a9339d9cf118cfcd P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.186932  4783 raft_consensus.cc:3060] T b69c4c8d794d46b5a9339d9cf118cfcd P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.187543  4774 tablet_bootstrap.cc:654] T f68bd211ab4a49de8ad6de70a45d005a P ed488ca31ad54b53836e5a10d053b568: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.190699  4778 tablet_bootstrap.cc:654] T f12e6e418b9c4465b718cdbb4786377a P c800c72b860f42878733b72fa57c227e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.199976  4774 tablet_bootstrap.cc:492] T f68bd211ab4a49de8ad6de70a45d005a P ed488ca31ad54b53836e5a10d053b568: No bootstrap required, opened a new log
I20260709 13:12:59.200420  4774 ts_tablet_manager.cc:1403] T f68bd211ab4a49de8ad6de70a45d005a P ed488ca31ad54b53836e5a10d053b568: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260709 13:12:59.201409  4734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b35da8e30d245c5a00c054010005f9d" candidate_uuid: "ed488ca31ad54b53836e5a10d053b568" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b" is_pre_election: true
I20260709 13:12:59.202917  4774 raft_consensus.cc:359] T f68bd211ab4a49de8ad6de70a45d005a P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.203620  4774 raft_consensus.cc:385] T f68bd211ab4a49de8ad6de70a45d005a P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.203891  4774 raft_consensus.cc:740] T f68bd211ab4a49de8ad6de70a45d005a P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed488ca31ad54b53836e5a10d053b568, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.204725  4774 consensus_queue.cc:260] T f68bd211ab4a49de8ad6de70a45d005a P ed488ca31ad54b53836e5a10d053b568 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.206169  4734 raft_consensus.cc:2468] T 4b35da8e30d245c5a00c054010005f9d P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed488ca31ad54b53836e5a10d053b568 in term 0.
I20260709 13:12:59.209172  4548 leader_election.cc:304] T 4b35da8e30d245c5a00c054010005f9d P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 308ac45a3f334cdcac265c0cfbbc039b, ed488ca31ad54b53836e5a10d053b568; no voters: c800c72b860f42878733b72fa57c227e
I20260709 13:12:59.210302  4776 raft_consensus.cc:2804] T 4b35da8e30d245c5a00c054010005f9d P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:59.210655  4776 raft_consensus.cc:493] T 4b35da8e30d245c5a00c054010005f9d P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.211016  4776 raft_consensus.cc:3060] T 4b35da8e30d245c5a00c054010005f9d P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.211145  4805 raft_consensus.cc:493] T d9d05411f1e749669cdf7c1be8d9d941 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.212145  4805 raft_consensus.cc:515] T d9d05411f1e749669cdf7c1be8d9d941 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.206928  4774 ts_tablet_manager.cc:1434] T f68bd211ab4a49de8ad6de70a45d005a P ed488ca31ad54b53836e5a10d053b568: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 13:12:59.211308  4783 raft_consensus.cc:515] T b69c4c8d794d46b5a9339d9cf118cfcd P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.214270  4774 tablet_bootstrap.cc:492] T c437ad3104ee4400a2917a4e7c362efa P ed488ca31ad54b53836e5a10d053b568: Bootstrap starting.
I20260709 13:12:59.214804  4585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d05411f1e749669cdf7c1be8d9d941" candidate_uuid: "c800c72b860f42878733b72fa57c227e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed488ca31ad54b53836e5a10d053b568" is_pre_election: true
I20260709 13:12:59.215468  4585 raft_consensus.cc:2468] T d9d05411f1e749669cdf7c1be8d9d941 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c800c72b860f42878733b72fa57c227e in term 0.
I20260709 13:12:59.216336  4783 leader_election.cc:290] T b69c4c8d794d46b5a9339d9cf118cfcd P c800c72b860f42878733b72fa57c227e [CANDIDATE]: Term 1 election: Requested vote from peers ed488ca31ad54b53836e5a10d053b568 (127.28.54.65:36419), 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965)
I20260709 13:12:59.217133  4791 raft_consensus.cc:493] T 0e2df276ddf14a03bd0bb461cd92f6c9 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.217665  4791 raft_consensus.cc:515] T 0e2df276ddf14a03bd0bb461cd92f6c9 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.219781  4791 leader_election.cc:290] T 0e2df276ddf14a03bd0bb461cd92f6c9 P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c800c72b860f42878733b72fa57c227e (127.28.54.66:43707), 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965)
I20260709 13:12:59.220201  4791 raft_consensus.cc:493] T bc88f6f533ef4807bba8f78c14dbc9f2 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.220595  4791 raft_consensus.cc:515] T bc88f6f533ef4807bba8f78c14dbc9f2 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } }
I20260709 13:12:59.221192  4778 tablet_bootstrap.cc:492] T f12e6e418b9c4465b718cdbb4786377a P c800c72b860f42878733b72fa57c227e: No bootstrap required, opened a new log
I20260709 13:12:59.221711  4778 ts_tablet_manager.cc:1403] T f12e6e418b9c4465b718cdbb4786377a P c800c72b860f42878733b72fa57c227e: Time spent bootstrapping tablet: real 0.038s	user 0.006s	sys 0.010s
I20260709 13:12:59.222540  4783 raft_consensus.cc:493] T bc88f6f533ef4807bba8f78c14dbc9f2 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.222970  4660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2df276ddf14a03bd0bb461cd92f6c9" candidate_uuid: "ed488ca31ad54b53836e5a10d053b568" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c800c72b860f42878733b72fa57c227e" is_pre_election: true
W20260709 13:12:59.225198  4550 leader_election.cc:343] T 0e2df276ddf14a03bd0bb461cd92f6c9 P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c800c72b860f42878733b72fa57c227e (127.28.54.66:43707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:59.225836  4777 tablet_bootstrap.cc:492] T d9d05411f1e749669cdf7c1be8d9d941 P 308ac45a3f334cdcac265c0cfbbc039b: No bootstrap required, opened a new log
I20260709 13:12:59.226320  4805 leader_election.cc:290] T d9d05411f1e749669cdf7c1be8d9d941 P c800c72b860f42878733b72fa57c227e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed488ca31ad54b53836e5a10d053b568 (127.28.54.65:36419), 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965)
I20260709 13:12:59.226419  4777 ts_tablet_manager.cc:1403] T d9d05411f1e749669cdf7c1be8d9d941 P 308ac45a3f334cdcac265c0cfbbc039b: Time spent bootstrapping tablet: real 0.072s	user 0.024s	sys 0.042s
I20260709 13:12:59.229077  4733 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b69c4c8d794d46b5a9339d9cf118cfcd" candidate_uuid: "c800c72b860f42878733b72fa57c227e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b" is_pre_election: true
I20260709 13:12:59.229825  4777 raft_consensus.cc:359] T d9d05411f1e749669cdf7c1be8d9d941 P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.230569  4777 raft_consensus.cc:385] T d9d05411f1e749669cdf7c1be8d9d941 P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.230940  4777 raft_consensus.cc:740] T d9d05411f1e749669cdf7c1be8d9d941 P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 308ac45a3f334cdcac265c0cfbbc039b, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.230509  4732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b69c4c8d794d46b5a9339d9cf118cfcd" candidate_uuid: "c800c72b860f42878733b72fa57c227e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b"
I20260709 13:12:59.231711  4777 consensus_queue.cc:260] T d9d05411f1e749669cdf7c1be8d9d941 P 308ac45a3f334cdcac265c0cfbbc039b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
W20260709 13:12:59.232969  4623 leader_election.cc:343] T b69c4c8d794d46b5a9339d9cf118cfcd P c800c72b860f42878733b72fa57c227e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:59.233383  4774 tablet_bootstrap.cc:654] T c437ad3104ee4400a2917a4e7c362efa P ed488ca31ad54b53836e5a10d053b568: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.233902  4777 ts_tablet_manager.cc:1434] T d9d05411f1e749669cdf7c1be8d9d941 P 308ac45a3f334cdcac265c0cfbbc039b: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 13:12:59.225544  4778 raft_consensus.cc:359] T f12e6e418b9c4465b718cdbb4786377a P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.234400  4778 raft_consensus.cc:385] T f12e6e418b9c4465b718cdbb4786377a P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.231122  4731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d05411f1e749669cdf7c1be8d9d941" candidate_uuid: "c800c72b860f42878733b72fa57c227e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b" is_pre_election: true
I20260709 13:12:59.234926  4778 raft_consensus.cc:740] T f12e6e418b9c4465b718cdbb4786377a P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c800c72b860f42878733b72fa57c227e, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.235334  4731 raft_consensus.cc:2468] T d9d05411f1e749669cdf7c1be8d9d941 P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c800c72b860f42878733b72fa57c227e in term 0.
I20260709 13:12:59.235849  4778 consensus_queue.cc:260] T f12e6e418b9c4465b718cdbb4786377a P c800c72b860f42878733b72fa57c227e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
W20260709 13:12:59.233934  4623 leader_election.cc:343] T b69c4c8d794d46b5a9339d9cf118cfcd P c800c72b860f42878733b72fa57c227e [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:59.237106  4623 leader_election.cc:304] T d9d05411f1e749669cdf7c1be8d9d941 P c800c72b860f42878733b72fa57c227e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 308ac45a3f334cdcac265c0cfbbc039b, c800c72b860f42878733b72fa57c227e; no voters: 
I20260709 13:12:59.234376  4732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc88f6f533ef4807bba8f78c14dbc9f2" candidate_uuid: "ed488ca31ad54b53836e5a10d053b568" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b" is_pre_election: true
I20260709 13:12:59.226014  4585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b69c4c8d794d46b5a9339d9cf118cfcd" candidate_uuid: "c800c72b860f42878733b72fa57c227e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed488ca31ad54b53836e5a10d053b568"
I20260709 13:12:59.238716  4585 raft_consensus.cc:3060] T b69c4c8d794d46b5a9339d9cf118cfcd P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:59.242390  4548 leader_election.cc:343] T bc88f6f533ef4807bba8f78c14dbc9f2 P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:59.244141  4791 leader_election.cc:290] T bc88f6f533ef4807bba8f78c14dbc9f2 P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965), c800c72b860f42878733b72fa57c227e (127.28.54.66:43707)
I20260709 13:12:59.244462  4805 raft_consensus.cc:2804] T d9d05411f1e749669cdf7c1be8d9d941 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:59.244912  4805 raft_consensus.cc:493] T d9d05411f1e749669cdf7c1be8d9d941 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.245237  4805 raft_consensus.cc:3060] T d9d05411f1e749669cdf7c1be8d9d941 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.245986  4777 tablet_bootstrap.cc:492] T f68bd211ab4a49de8ad6de70a45d005a P 308ac45a3f334cdcac265c0cfbbc039b: Bootstrap starting.
I20260709 13:12:59.247822  4734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2df276ddf14a03bd0bb461cd92f6c9" candidate_uuid: "ed488ca31ad54b53836e5a10d053b568" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b" is_pre_election: true
I20260709 13:12:59.248469  4734 raft_consensus.cc:2468] T 0e2df276ddf14a03bd0bb461cd92f6c9 P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed488ca31ad54b53836e5a10d053b568 in term 0.
I20260709 13:12:59.238205  4778 ts_tablet_manager.cc:1434] T f12e6e418b9c4465b718cdbb4786377a P c800c72b860f42878733b72fa57c227e: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 13:12:59.249802  4660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc88f6f533ef4807bba8f78c14dbc9f2" candidate_uuid: "ed488ca31ad54b53836e5a10d053b568" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c800c72b860f42878733b72fa57c227e" is_pre_election: true
I20260709 13:12:59.249593  4548 leader_election.cc:304] T 0e2df276ddf14a03bd0bb461cd92f6c9 P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 308ac45a3f334cdcac265c0cfbbc039b, ed488ca31ad54b53836e5a10d053b568; no voters: c800c72b860f42878733b72fa57c227e
I20260709 13:12:59.252502  4791 raft_consensus.cc:2804] T 0e2df276ddf14a03bd0bb461cd92f6c9 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:59.256085  4777 tablet_bootstrap.cc:654] T f68bd211ab4a49de8ad6de70a45d005a P 308ac45a3f334cdcac265c0cfbbc039b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.250787  4778 tablet_bootstrap.cc:492] T 0e2df276ddf14a03bd0bb461cd92f6c9 P c800c72b860f42878733b72fa57c227e: Bootstrap starting.
I20260709 13:12:59.252871  4791 raft_consensus.cc:493] T 0e2df276ddf14a03bd0bb461cd92f6c9 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.261340  4791 raft_consensus.cc:3060] T 0e2df276ddf14a03bd0bb461cd92f6c9 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.263073  4784 raft_consensus.cc:493] T c437ad3104ee4400a2917a4e7c362efa P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.263564  4784 raft_consensus.cc:515] T c437ad3104ee4400a2917a4e7c362efa P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
W20260709 13:12:59.264864  4531 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:12:59.266036  4784 leader_election.cc:290] T c437ad3104ee4400a2917a4e7c362efa P 308ac45a3f334cdcac265c0cfbbc039b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed488ca31ad54b53836e5a10d053b568 (127.28.54.65:36419), c800c72b860f42878733b72fa57c227e (127.28.54.66:43707)
I20260709 13:12:59.223002  4783 raft_consensus.cc:515] T bc88f6f533ef4807bba8f78c14dbc9f2 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } }
I20260709 13:12:59.269452  4660 raft_consensus.cc:2468] T bc88f6f533ef4807bba8f78c14dbc9f2 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed488ca31ad54b53836e5a10d053b568 in term 0.
I20260709 13:12:59.269841  4805 raft_consensus.cc:515] T d9d05411f1e749669cdf7c1be8d9d941 P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.272749  4584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d05411f1e749669cdf7c1be8d9d941" candidate_uuid: "c800c72b860f42878733b72fa57c227e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed488ca31ad54b53836e5a10d053b568"
I20260709 13:12:59.273371  4584 raft_consensus.cc:3060] T d9d05411f1e749669cdf7c1be8d9d941 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.274607  4585 raft_consensus.cc:2468] T b69c4c8d794d46b5a9339d9cf118cfcd P ed488ca31ad54b53836e5a10d053b568 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c800c72b860f42878733b72fa57c227e in term 1.
I20260709 13:12:59.276655  4777 tablet_bootstrap.cc:492] T f68bd211ab4a49de8ad6de70a45d005a P 308ac45a3f334cdcac265c0cfbbc039b: No bootstrap required, opened a new log
I20260709 13:12:59.266506  4776 raft_consensus.cc:515] T 4b35da8e30d245c5a00c054010005f9d P ed488ca31ad54b53836e5a10d053b568 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.280902  4776 leader_election.cc:290] T 4b35da8e30d245c5a00c054010005f9d P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 election: Requested vote from peers c800c72b860f42878733b72fa57c227e (127.28.54.66:43707), 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965)
I20260709 13:12:59.277716  4734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc88f6f533ef4807bba8f78c14dbc9f2" candidate_uuid: "c800c72b860f42878733b72fa57c227e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b" is_pre_election: true
I20260709 13:12:59.277274  4783 leader_election.cc:290] T bc88f6f533ef4807bba8f78c14dbc9f2 P c800c72b860f42878733b72fa57c227e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed488ca31ad54b53836e5a10d053b568 (127.28.54.65:36419), 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965)
W20260709 13:12:59.282299  4623 leader_election.cc:343] T bc88f6f533ef4807bba8f78c14dbc9f2 P c800c72b860f42878733b72fa57c227e [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:59.282950  4777 ts_tablet_manager.cc:1403] T f68bd211ab4a49de8ad6de70a45d005a P 308ac45a3f334cdcac265c0cfbbc039b: Time spent bootstrapping tablet: real 0.037s	user 0.017s	sys 0.000s
I20260709 13:12:59.280781  4550 leader_election.cc:304] T bc88f6f533ef4807bba8f78c14dbc9f2 P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c800c72b860f42878733b72fa57c227e, ed488ca31ad54b53836e5a10d053b568; no voters: 308ac45a3f334cdcac265c0cfbbc039b
I20260709 13:12:59.285676  4806 raft_consensus.cc:2804] T bc88f6f533ef4807bba8f78c14dbc9f2 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:59.286381  4660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b35da8e30d245c5a00c054010005f9d" candidate_uuid: "ed488ca31ad54b53836e5a10d053b568" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c800c72b860f42878733b72fa57c227e"
I20260709 13:12:59.287427  4625 leader_election.cc:304] T b69c4c8d794d46b5a9339d9cf118cfcd P c800c72b860f42878733b72fa57c227e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c800c72b860f42878733b72fa57c227e, ed488ca31ad54b53836e5a10d053b568; no voters: 308ac45a3f334cdcac265c0cfbbc039b
I20260709 13:12:59.288308  4783 raft_consensus.cc:2804] T b69c4c8d794d46b5a9339d9cf118cfcd P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:12:59.288573  4550 leader_election.cc:343] T 4b35da8e30d245c5a00c054010005f9d P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c800c72b860f42878733b72fa57c227e (127.28.54.66:43707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:59.287066  4585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc88f6f533ef4807bba8f78c14dbc9f2" candidate_uuid: "c800c72b860f42878733b72fa57c227e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed488ca31ad54b53836e5a10d053b568" is_pre_election: true
I20260709 13:12:59.288837  4783 raft_consensus.cc:697] T b69c4c8d794d46b5a9339d9cf118cfcd P c800c72b860f42878733b72fa57c227e [term 1 LEADER]: Becoming Leader. State: Replica: c800c72b860f42878733b72fa57c227e, State: Running, Role: LEADER
I20260709 13:12:59.289825  4806 raft_consensus.cc:493] T bc88f6f533ef4807bba8f78c14dbc9f2 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.290232  4806 raft_consensus.cc:3060] T bc88f6f533ef4807bba8f78c14dbc9f2 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.289938  4783 consensus_queue.cc:237] T b69c4c8d794d46b5a9339d9cf118cfcd P c800c72b860f42878733b72fa57c227e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.291143  4778 tablet_bootstrap.cc:654] T 0e2df276ddf14a03bd0bb461cd92f6c9 P c800c72b860f42878733b72fa57c227e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.288769  4584 raft_consensus.cc:2468] T d9d05411f1e749669cdf7c1be8d9d941 P ed488ca31ad54b53836e5a10d053b568 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c800c72b860f42878733b72fa57c227e in term 1.
I20260709 13:12:59.294900  4774 tablet_bootstrap.cc:492] T c437ad3104ee4400a2917a4e7c362efa P ed488ca31ad54b53836e5a10d053b568: No bootstrap required, opened a new log
I20260709 13:12:59.295408  4774 ts_tablet_manager.cc:1403] T c437ad3104ee4400a2917a4e7c362efa P ed488ca31ad54b53836e5a10d053b568: Time spent bootstrapping tablet: real 0.081s	user 0.019s	sys 0.013s
I20260709 13:12:59.294703  4625 leader_election.cc:304] T d9d05411f1e749669cdf7c1be8d9d941 P c800c72b860f42878733b72fa57c227e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c800c72b860f42878733b72fa57c227e, ed488ca31ad54b53836e5a10d053b568; no voters: 
I20260709 13:12:59.298543  4808 raft_consensus.cc:2804] T d9d05411f1e749669cdf7c1be8d9d941 P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:59.298702  4774 raft_consensus.cc:359] T c437ad3104ee4400a2917a4e7c362efa P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.299431  4774 raft_consensus.cc:385] T c437ad3104ee4400a2917a4e7c362efa P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.299721  4774 raft_consensus.cc:740] T c437ad3104ee4400a2917a4e7c362efa P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed488ca31ad54b53836e5a10d053b568, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.299957  4777 raft_consensus.cc:359] T f68bd211ab4a49de8ad6de70a45d005a P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.302193  4777 raft_consensus.cc:385] T f68bd211ab4a49de8ad6de70a45d005a P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.303596  4777 raft_consensus.cc:740] T f68bd211ab4a49de8ad6de70a45d005a P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 308ac45a3f334cdcac265c0cfbbc039b, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.300529  4774 consensus_queue.cc:260] T c437ad3104ee4400a2917a4e7c362efa P ed488ca31ad54b53836e5a10d053b568 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.284468  4791 raft_consensus.cc:515] T 0e2df276ddf14a03bd0bb461cd92f6c9 P ed488ca31ad54b53836e5a10d053b568 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.304878  4734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d05411f1e749669cdf7c1be8d9d941" candidate_uuid: "c800c72b860f42878733b72fa57c227e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b"
I20260709 13:12:59.305512  4734 raft_consensus.cc:3060] T d9d05411f1e749669cdf7c1be8d9d941 P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.306406  4774 ts_tablet_manager.cc:1434] T c437ad3104ee4400a2917a4e7c362efa P ed488ca31ad54b53836e5a10d053b568: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 13:12:59.307343  4660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2df276ddf14a03bd0bb461cd92f6c9" candidate_uuid: "ed488ca31ad54b53836e5a10d053b568" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c800c72b860f42878733b72fa57c227e"
I20260709 13:12:59.308157  4777 consensus_queue.cc:260] T f68bd211ab4a49de8ad6de70a45d005a P 308ac45a3f334cdcac265c0cfbbc039b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
W20260709 13:12:59.308895  4550 leader_election.cc:343] T 0e2df276ddf14a03bd0bb461cd92f6c9 P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c800c72b860f42878733b72fa57c227e (127.28.54.66:43707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:59.312774  4734 raft_consensus.cc:2468] T d9d05411f1e749669cdf7c1be8d9d941 P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c800c72b860f42878733b72fa57c227e in term 1.
I20260709 13:12:59.313042  4791 leader_election.cc:290] T 0e2df276ddf14a03bd0bb461cd92f6c9 P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 election: Requested vote from peers c800c72b860f42878733b72fa57c227e (127.28.54.66:43707), 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965)
I20260709 13:12:59.315323  4805 leader_election.cc:290] T d9d05411f1e749669cdf7c1be8d9d941 P c800c72b860f42878733b72fa57c227e [CANDIDATE]: Term 1 election: Requested vote from peers ed488ca31ad54b53836e5a10d053b568 (127.28.54.65:36419), 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965)
I20260709 13:12:59.318679  4777 ts_tablet_manager.cc:1434] T f68bd211ab4a49de8ad6de70a45d005a P 308ac45a3f334cdcac265c0cfbbc039b: Time spent starting tablet: real 0.034s	user 0.002s	sys 0.005s
I20260709 13:12:59.316995  4791 raft_consensus.cc:493] T f12e6e418b9c4465b718cdbb4786377a P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.322741  4791 raft_consensus.cc:515] T f12e6e418b9c4465b718cdbb4786377a P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.325539  4660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12e6e418b9c4465b718cdbb4786377a" candidate_uuid: "ed488ca31ad54b53836e5a10d053b568" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c800c72b860f42878733b72fa57c227e" is_pre_election: true
I20260709 13:12:59.326179  4660 raft_consensus.cc:2468] T f12e6e418b9c4465b718cdbb4786377a P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed488ca31ad54b53836e5a10d053b568 in term 0.
I20260709 13:12:59.327214  4550 leader_election.cc:304] T f12e6e418b9c4465b718cdbb4786377a P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c800c72b860f42878733b72fa57c227e, ed488ca31ad54b53836e5a10d053b568; no voters: 
I20260709 13:12:59.327515  4777 tablet_bootstrap.cc:492] T f12e6e418b9c4465b718cdbb4786377a P 308ac45a3f334cdcac265c0cfbbc039b: Bootstrap starting.
I20260709 13:12:59.327929  4776 raft_consensus.cc:2804] T f12e6e418b9c4465b718cdbb4786377a P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:59.328889  4776 raft_consensus.cc:493] T f12e6e418b9c4465b718cdbb4786377a P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.329281  4776 raft_consensus.cc:3060] T f12e6e418b9c4465b718cdbb4786377a P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.329969  4808 raft_consensus.cc:697] T d9d05411f1e749669cdf7c1be8d9d941 P c800c72b860f42878733b72fa57c227e [term 1 LEADER]: Becoming Leader. State: Replica: c800c72b860f42878733b72fa57c227e, State: Running, Role: LEADER
I20260709 13:12:59.330839  4808 consensus_queue.cc:237] T d9d05411f1e749669cdf7c1be8d9d941 P c800c72b860f42878733b72fa57c227e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.328974  4778 tablet_bootstrap.cc:492] T 0e2df276ddf14a03bd0bb461cd92f6c9 P c800c72b860f42878733b72fa57c227e: No bootstrap required, opened a new log
I20260709 13:12:59.334416  4778 ts_tablet_manager.cc:1403] T 0e2df276ddf14a03bd0bb461cd92f6c9 P c800c72b860f42878733b72fa57c227e: Time spent bootstrapping tablet: real 0.084s	user 0.017s	sys 0.000s
I20260709 13:12:59.336138  4776 raft_consensus.cc:515] T f12e6e418b9c4465b718cdbb4786377a P ed488ca31ad54b53836e5a10d053b568 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.331401  4482 catalog_manager.cc:5697] T b69c4c8d794d46b5a9339d9cf118cfcd P c800c72b860f42878733b72fa57c227e reported cstate change: term changed from 0 to 1, leader changed from <none> to c800c72b860f42878733b72fa57c227e (127.28.54.66). New cstate: current_term: 1 leader_uuid: "c800c72b860f42878733b72fa57c227e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:59.337311  4778 raft_consensus.cc:359] T 0e2df276ddf14a03bd0bb461cd92f6c9 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.338037  4778 raft_consensus.cc:385] T 0e2df276ddf14a03bd0bb461cd92f6c9 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.338886  4660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12e6e418b9c4465b718cdbb4786377a" candidate_uuid: "ed488ca31ad54b53836e5a10d053b568" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c800c72b860f42878733b72fa57c227e"
I20260709 13:12:59.339448  4660 raft_consensus.cc:3060] T f12e6e418b9c4465b718cdbb4786377a P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.328125  4791 leader_election.cc:290] T f12e6e418b9c4465b718cdbb4786377a P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c800c72b860f42878733b72fa57c227e (127.28.54.66:43707), 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965)
I20260709 13:12:59.341214  4777 tablet_bootstrap.cc:654] T f12e6e418b9c4465b718cdbb4786377a P 308ac45a3f334cdcac265c0cfbbc039b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.344745  4734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b35da8e30d245c5a00c054010005f9d" candidate_uuid: "ed488ca31ad54b53836e5a10d053b568" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b"
I20260709 13:12:59.345361  4734 raft_consensus.cc:3060] T 4b35da8e30d245c5a00c054010005f9d P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.347335  4660 raft_consensus.cc:2468] T f12e6e418b9c4465b718cdbb4786377a P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed488ca31ad54b53836e5a10d053b568 in term 1.
I20260709 13:12:59.339469  4776 leader_election.cc:290] T f12e6e418b9c4465b718cdbb4786377a P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 election: Requested vote from peers c800c72b860f42878733b72fa57c227e (127.28.54.66:43707), 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965)
I20260709 13:12:59.348452  4550 leader_election.cc:304] T f12e6e418b9c4465b718cdbb4786377a P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c800c72b860f42878733b72fa57c227e, ed488ca31ad54b53836e5a10d053b568; no voters: 
I20260709 13:12:59.349267  4776 raft_consensus.cc:2804] T f12e6e418b9c4465b718cdbb4786377a P ed488ca31ad54b53836e5a10d053b568 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:59.349655  4776 raft_consensus.cc:697] T f12e6e418b9c4465b718cdbb4786377a P ed488ca31ad54b53836e5a10d053b568 [term 1 LEADER]: Becoming Leader. State: Replica: ed488ca31ad54b53836e5a10d053b568, State: Running, Role: LEADER
I20260709 13:12:59.350430  4776 consensus_queue.cc:237] T f12e6e418b9c4465b718cdbb4786377a P ed488ca31ad54b53836e5a10d053b568 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.352006  4734 raft_consensus.cc:2468] T 4b35da8e30d245c5a00c054010005f9d P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed488ca31ad54b53836e5a10d053b568 in term 1.
I20260709 13:12:59.345368  4806 raft_consensus.cc:515] T bc88f6f533ef4807bba8f78c14dbc9f2 P ed488ca31ad54b53836e5a10d053b568 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } }
I20260709 13:12:59.338315  4778 raft_consensus.cc:740] T 0e2df276ddf14a03bd0bb461cd92f6c9 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c800c72b860f42878733b72fa57c227e, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.354671  4585 raft_consensus.cc:2393] T bc88f6f533ef4807bba8f78c14dbc9f2 P ed488ca31ad54b53836e5a10d053b568 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c800c72b860f42878733b72fa57c227e in current term 1: Already voted for candidate ed488ca31ad54b53836e5a10d053b568 in this term.
I20260709 13:12:59.355510  4548 leader_election.cc:304] T 4b35da8e30d245c5a00c054010005f9d P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 308ac45a3f334cdcac265c0cfbbc039b, ed488ca31ad54b53836e5a10d053b568; no voters: c800c72b860f42878733b72fa57c227e
I20260709 13:12:59.355409  4778 consensus_queue.cc:260] T 0e2df276ddf14a03bd0bb461cd92f6c9 P c800c72b860f42878733b72fa57c227e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.356581  4625 leader_election.cc:304] T bc88f6f533ef4807bba8f78c14dbc9f2 P c800c72b860f42878733b72fa57c227e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c800c72b860f42878733b72fa57c227e; no voters: 308ac45a3f334cdcac265c0cfbbc039b, ed488ca31ad54b53836e5a10d053b568
I20260709 13:12:59.356804  4791 raft_consensus.cc:2804] T 4b35da8e30d245c5a00c054010005f9d P ed488ca31ad54b53836e5a10d053b568 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:59.356958  4731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12e6e418b9c4465b718cdbb4786377a" candidate_uuid: "ed488ca31ad54b53836e5a10d053b568" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b"
I20260709 13:12:59.358553  4783 raft_consensus.cc:3060] T bc88f6f533ef4807bba8f78c14dbc9f2 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:59.360870  4548 leader_election.cc:343] T f12e6e418b9c4465b718cdbb4786377a P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:59.363051  4660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c437ad3104ee4400a2917a4e7c362efa" candidate_uuid: "308ac45a3f334cdcac265c0cfbbc039b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c800c72b860f42878733b72fa57c227e" is_pre_election: true
I20260709 13:12:59.363754  4660 raft_consensus.cc:2468] T c437ad3104ee4400a2917a4e7c362efa P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 308ac45a3f334cdcac265c0cfbbc039b in term 0.
I20260709 13:12:59.365222  4699 leader_election.cc:304] T c437ad3104ee4400a2917a4e7c362efa P 308ac45a3f334cdcac265c0cfbbc039b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 308ac45a3f334cdcac265c0cfbbc039b, c800c72b860f42878733b72fa57c227e; no voters: 
I20260709 13:12:59.365432  4783 raft_consensus.cc:2749] T bc88f6f533ef4807bba8f78c14dbc9f2 P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:59.366218  4585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c437ad3104ee4400a2917a4e7c362efa" candidate_uuid: "308ac45a3f334cdcac265c0cfbbc039b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed488ca31ad54b53836e5a10d053b568" is_pre_election: true
I20260709 13:12:59.366834  4585 raft_consensus.cc:2468] T c437ad3104ee4400a2917a4e7c362efa P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 308ac45a3f334cdcac265c0cfbbc039b in term 0.
I20260709 13:12:59.356609  4732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12e6e418b9c4465b718cdbb4786377a" candidate_uuid: "ed488ca31ad54b53836e5a10d053b568" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b" is_pre_election: true
I20260709 13:12:59.367949  4784 raft_consensus.cc:2804] T c437ad3104ee4400a2917a4e7c362efa P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:59.368376  4784 raft_consensus.cc:493] T c437ad3104ee4400a2917a4e7c362efa P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 13:12:59.368582  4548 leader_election.cc:343] T f12e6e418b9c4465b718cdbb4786377a P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:59.368170  4482 catalog_manager.cc:5697] T f12e6e418b9c4465b718cdbb4786377a P ed488ca31ad54b53836e5a10d053b568 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed488ca31ad54b53836e5a10d053b568 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "ed488ca31ad54b53836e5a10d053b568" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:59.369043  4806 leader_election.cc:290] T bc88f6f533ef4807bba8f78c14dbc9f2 P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 election: Requested vote from peers 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965), c800c72b860f42878733b72fa57c227e (127.28.54.66:43707)
I20260709 13:12:59.370731  4660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc88f6f533ef4807bba8f78c14dbc9f2" candidate_uuid: "ed488ca31ad54b53836e5a10d053b568" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c800c72b860f42878733b72fa57c227e"
I20260709 13:12:59.370944  4732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc88f6f533ef4807bba8f78c14dbc9f2" candidate_uuid: "ed488ca31ad54b53836e5a10d053b568" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b"
I20260709 13:12:59.371803  4784 raft_consensus.cc:3060] T c437ad3104ee4400a2917a4e7c362efa P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Advancing to term 1
W20260709 13:12:59.372902  4548 leader_election.cc:343] T bc88f6f533ef4807bba8f78c14dbc9f2 P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:12:59.373315  4480 catalog_manager.cc:5697] T d9d05411f1e749669cdf7c1be8d9d941 P c800c72b860f42878733b72fa57c227e reported cstate change: term changed from 0 to 1, leader changed from <none> to c800c72b860f42878733b72fa57c227e (127.28.54.66). New cstate: current_term: 1 leader_uuid: "c800c72b860f42878733b72fa57c227e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:59.379228  4784 raft_consensus.cc:515] T c437ad3104ee4400a2917a4e7c362efa P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.381883  4585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c437ad3104ee4400a2917a4e7c362efa" candidate_uuid: "308ac45a3f334cdcac265c0cfbbc039b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed488ca31ad54b53836e5a10d053b568"
I20260709 13:12:59.382434  4585 raft_consensus.cc:3060] T c437ad3104ee4400a2917a4e7c362efa P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.383351  4791 raft_consensus.cc:697] T 4b35da8e30d245c5a00c054010005f9d P ed488ca31ad54b53836e5a10d053b568 [term 1 LEADER]: Becoming Leader. State: Replica: ed488ca31ad54b53836e5a10d053b568, State: Running, Role: LEADER
I20260709 13:12:59.384351  4791 consensus_queue.cc:237] T 4b35da8e30d245c5a00c054010005f9d P ed488ca31ad54b53836e5a10d053b568 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.387176  4660 raft_consensus.cc:2468] T bc88f6f533ef4807bba8f78c14dbc9f2 P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed488ca31ad54b53836e5a10d053b568 in term 1.
I20260709 13:12:59.389185  4550 leader_election.cc:304] T bc88f6f533ef4807bba8f78c14dbc9f2 P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c800c72b860f42878733b72fa57c227e, ed488ca31ad54b53836e5a10d053b568; no voters: 308ac45a3f334cdcac265c0cfbbc039b
I20260709 13:12:59.390386  4806 raft_consensus.cc:2804] T bc88f6f533ef4807bba8f78c14dbc9f2 P ed488ca31ad54b53836e5a10d053b568 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:59.390853  4806 raft_consensus.cc:697] T bc88f6f533ef4807bba8f78c14dbc9f2 P ed488ca31ad54b53836e5a10d053b568 [term 1 LEADER]: Becoming Leader. State: Replica: ed488ca31ad54b53836e5a10d053b568, State: Running, Role: LEADER
I20260709 13:12:59.391518  4585 raft_consensus.cc:2468] T c437ad3104ee4400a2917a4e7c362efa P ed488ca31ad54b53836e5a10d053b568 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 308ac45a3f334cdcac265c0cfbbc039b in term 1.
I20260709 13:12:59.391636  4806 consensus_queue.cc:237] T bc88f6f533ef4807bba8f78c14dbc9f2 P ed488ca31ad54b53836e5a10d053b568 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } }
I20260709 13:12:59.392625  4699 leader_election.cc:304] T c437ad3104ee4400a2917a4e7c362efa P 308ac45a3f334cdcac265c0cfbbc039b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 308ac45a3f334cdcac265c0cfbbc039b, ed488ca31ad54b53836e5a10d053b568; no voters: 
I20260709 13:12:59.394276  4778 ts_tablet_manager.cc:1434] T 0e2df276ddf14a03bd0bb461cd92f6c9 P c800c72b860f42878733b72fa57c227e: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.001s
I20260709 13:12:59.395330  4778 tablet_bootstrap.cc:492] T 4b35da8e30d245c5a00c054010005f9d P c800c72b860f42878733b72fa57c227e: Bootstrap starting.
I20260709 13:12:59.393455  4734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2df276ddf14a03bd0bb461cd92f6c9" candidate_uuid: "ed488ca31ad54b53836e5a10d053b568" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b"
I20260709 13:12:59.405282  4784 leader_election.cc:290] T c437ad3104ee4400a2917a4e7c362efa P 308ac45a3f334cdcac265c0cfbbc039b [CANDIDATE]: Term 1 election: Requested vote from peers ed488ca31ad54b53836e5a10d053b568 (127.28.54.65:36419), c800c72b860f42878733b72fa57c227e (127.28.54.66:43707)
I20260709 13:12:59.405989  4784 raft_consensus.cc:2804] T c437ad3104ee4400a2917a4e7c362efa P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:59.406464  4784 raft_consensus.cc:697] T c437ad3104ee4400a2917a4e7c362efa P 308ac45a3f334cdcac265c0cfbbc039b [term 1 LEADER]: Becoming Leader. State: Replica: 308ac45a3f334cdcac265c0cfbbc039b, State: Running, Role: LEADER
I20260709 13:12:59.407750  4777 tablet_bootstrap.cc:492] T f12e6e418b9c4465b718cdbb4786377a P 308ac45a3f334cdcac265c0cfbbc039b: No bootstrap required, opened a new log
I20260709 13:12:59.408131  4734 raft_consensus.cc:3060] T 0e2df276ddf14a03bd0bb461cd92f6c9 P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.408360  4777 ts_tablet_manager.cc:1403] T f12e6e418b9c4465b718cdbb4786377a P 308ac45a3f334cdcac265c0cfbbc039b: Time spent bootstrapping tablet: real 0.081s	user 0.014s	sys 0.026s
I20260709 13:12:59.407325  4784 consensus_queue.cc:237] T c437ad3104ee4400a2917a4e7c362efa P 308ac45a3f334cdcac265c0cfbbc039b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.411687  4777 raft_consensus.cc:359] T f12e6e418b9c4465b718cdbb4786377a P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.412426  4777 raft_consensus.cc:385] T f12e6e418b9c4465b718cdbb4786377a P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.413077  4777 raft_consensus.cc:740] T f12e6e418b9c4465b718cdbb4786377a P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 308ac45a3f334cdcac265c0cfbbc039b, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.414075  4777 consensus_queue.cc:260] T f12e6e418b9c4465b718cdbb4786377a P 308ac45a3f334cdcac265c0cfbbc039b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.415772  4817 raft_consensus.cc:493] T f68bd211ab4a49de8ad6de70a45d005a P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.416319  4817 raft_consensus.cc:515] T f68bd211ab4a49de8ad6de70a45d005a P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.419955  4817 leader_election.cc:290] T f68bd211ab4a49de8ad6de70a45d005a P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c800c72b860f42878733b72fa57c227e (127.28.54.66:43707), 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965)
I20260709 13:12:59.412708  4778 tablet_bootstrap.cc:654] T 4b35da8e30d245c5a00c054010005f9d P c800c72b860f42878733b72fa57c227e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.420194  4660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68bd211ab4a49de8ad6de70a45d005a" candidate_uuid: "ed488ca31ad54b53836e5a10d053b568" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c800c72b860f42878733b72fa57c227e" is_pre_election: true
I20260709 13:12:59.420877  4660 raft_consensus.cc:2468] T f68bd211ab4a49de8ad6de70a45d005a P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed488ca31ad54b53836e5a10d053b568 in term 0.
I20260709 13:12:59.422062  4550 leader_election.cc:304] T f68bd211ab4a49de8ad6de70a45d005a P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c800c72b860f42878733b72fa57c227e, ed488ca31ad54b53836e5a10d053b568; no voters: 
I20260709 13:12:59.423002  4817 raft_consensus.cc:2804] T f68bd211ab4a49de8ad6de70a45d005a P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:12:59.423416  4817 raft_consensus.cc:493] T f68bd211ab4a49de8ad6de70a45d005a P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:12:59.424448  4817 raft_consensus.cc:3060] T f68bd211ab4a49de8ad6de70a45d005a P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.427000  4734 raft_consensus.cc:2468] T 0e2df276ddf14a03bd0bb461cd92f6c9 P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed488ca31ad54b53836e5a10d053b568 in term 1.
I20260709 13:12:59.427300  4660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c437ad3104ee4400a2917a4e7c362efa" candidate_uuid: "308ac45a3f334cdcac265c0cfbbc039b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c800c72b860f42878733b72fa57c227e"
I20260709 13:12:59.427986  4660 raft_consensus.cc:3060] T c437ad3104ee4400a2917a4e7c362efa P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.429418  4777 ts_tablet_manager.cc:1434] T f12e6e418b9c4465b718cdbb4786377a P 308ac45a3f334cdcac265c0cfbbc039b: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.004s
I20260709 13:12:59.431386  4777 tablet_bootstrap.cc:492] T bc88f6f533ef4807bba8f78c14dbc9f2 P 308ac45a3f334cdcac265c0cfbbc039b: Bootstrap starting.
I20260709 13:12:59.439121  4482 catalog_manager.cc:5697] T c437ad3104ee4400a2917a4e7c362efa P 308ac45a3f334cdcac265c0cfbbc039b reported cstate change: term changed from 0 to 1, leader changed from <none> to 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67). New cstate: current_term: 1 leader_uuid: "308ac45a3f334cdcac265c0cfbbc039b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } health_report { overall_health: HEALTHY } } }
I20260709 13:12:59.440914  4660 raft_consensus.cc:2468] T c437ad3104ee4400a2917a4e7c362efa P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 308ac45a3f334cdcac265c0cfbbc039b in term 1.
I20260709 13:12:59.444482  4777 tablet_bootstrap.cc:654] T bc88f6f533ef4807bba8f78c14dbc9f2 P 308ac45a3f334cdcac265c0cfbbc039b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.446570  4734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68bd211ab4a49de8ad6de70a45d005a" candidate_uuid: "ed488ca31ad54b53836e5a10d053b568" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b" is_pre_election: true
I20260709 13:12:59.437551  4817 raft_consensus.cc:515] T f68bd211ab4a49de8ad6de70a45d005a P ed488ca31ad54b53836e5a10d053b568 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.447252  4734 raft_consensus.cc:2468] T f68bd211ab4a49de8ad6de70a45d005a P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed488ca31ad54b53836e5a10d053b568 in term 0.
I20260709 13:12:59.448016  4548 leader_election.cc:304] T 0e2df276ddf14a03bd0bb461cd92f6c9 P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 308ac45a3f334cdcac265c0cfbbc039b, ed488ca31ad54b53836e5a10d053b568; no voters: c800c72b860f42878733b72fa57c227e
I20260709 13:12:59.448791  4821 raft_consensus.cc:493] T f12e6e418b9c4465b718cdbb4786377a P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.450728  4791 raft_consensus.cc:2804] T 0e2df276ddf14a03bd0bb461cd92f6c9 P ed488ca31ad54b53836e5a10d053b568 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:59.451398  4791 raft_consensus.cc:697] T 0e2df276ddf14a03bd0bb461cd92f6c9 P ed488ca31ad54b53836e5a10d053b568 [term 1 LEADER]: Becoming Leader. State: Replica: ed488ca31ad54b53836e5a10d053b568, State: Running, Role: LEADER
I20260709 13:12:59.452140  4791 consensus_queue.cc:237] T 0e2df276ddf14a03bd0bb461cd92f6c9 P ed488ca31ad54b53836e5a10d053b568 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.452812  4821 raft_consensus.cc:515] T f12e6e418b9c4465b718cdbb4786377a P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.454962  4821 leader_election.cc:290] T f12e6e418b9c4465b718cdbb4786377a P 308ac45a3f334cdcac265c0cfbbc039b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed488ca31ad54b53836e5a10d053b568 (127.28.54.65:36419), c800c72b860f42878733b72fa57c227e (127.28.54.66:43707)
I20260709 13:12:59.456552  4585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12e6e418b9c4465b718cdbb4786377a" candidate_uuid: "308ac45a3f334cdcac265c0cfbbc039b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed488ca31ad54b53836e5a10d053b568" is_pre_election: true
I20260709 13:12:59.454672  4480 catalog_manager.cc:5697] T 4b35da8e30d245c5a00c054010005f9d P ed488ca31ad54b53836e5a10d053b568 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed488ca31ad54b53836e5a10d053b568 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "ed488ca31ad54b53836e5a10d053b568" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:59.456898  4660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12e6e418b9c4465b718cdbb4786377a" candidate_uuid: "308ac45a3f334cdcac265c0cfbbc039b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c800c72b860f42878733b72fa57c227e" is_pre_election: true
I20260709 13:12:59.457664  4660 raft_consensus.cc:2393] T f12e6e418b9c4465b718cdbb4786377a P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 308ac45a3f334cdcac265c0cfbbc039b in current term 1: Already voted for candidate ed488ca31ad54b53836e5a10d053b568 in this term.
I20260709 13:12:59.461938  4660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68bd211ab4a49de8ad6de70a45d005a" candidate_uuid: "ed488ca31ad54b53836e5a10d053b568" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c800c72b860f42878733b72fa57c227e"
I20260709 13:12:59.462694  4660 raft_consensus.cc:3060] T f68bd211ab4a49de8ad6de70a45d005a P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.462970  4817 leader_election.cc:290] T f68bd211ab4a49de8ad6de70a45d005a P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 election: Requested vote from peers c800c72b860f42878733b72fa57c227e (127.28.54.66:43707), 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965)
I20260709 13:12:59.465746  4777 tablet_bootstrap.cc:492] T bc88f6f533ef4807bba8f78c14dbc9f2 P 308ac45a3f334cdcac265c0cfbbc039b: No bootstrap required, opened a new log
I20260709 13:12:59.466311  4777 ts_tablet_manager.cc:1403] T bc88f6f533ef4807bba8f78c14dbc9f2 P 308ac45a3f334cdcac265c0cfbbc039b: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.001s
I20260709 13:12:59.462006  4699 leader_election.cc:304] T f12e6e418b9c4465b718cdbb4786377a P 308ac45a3f334cdcac265c0cfbbc039b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 308ac45a3f334cdcac265c0cfbbc039b; no voters: c800c72b860f42878733b72fa57c227e, ed488ca31ad54b53836e5a10d053b568
I20260709 13:12:59.468947  4777 raft_consensus.cc:359] T bc88f6f533ef4807bba8f78c14dbc9f2 P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } }
I20260709 13:12:59.469787  4777 raft_consensus.cc:385] T bc88f6f533ef4807bba8f78c14dbc9f2 P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.468870  4778 tablet_bootstrap.cc:492] T 4b35da8e30d245c5a00c054010005f9d P c800c72b860f42878733b72fa57c227e: No bootstrap required, opened a new log
I20260709 13:12:59.471009  4734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68bd211ab4a49de8ad6de70a45d005a" candidate_uuid: "ed488ca31ad54b53836e5a10d053b568" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b"
I20260709 13:12:59.472309  4777 raft_consensus.cc:740] T bc88f6f533ef4807bba8f78c14dbc9f2 P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 308ac45a3f334cdcac265c0cfbbc039b, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.470139  4821 raft_consensus.cc:3060] T f12e6e418b9c4465b718cdbb4786377a P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.472898  4734 raft_consensus.cc:3060] T f68bd211ab4a49de8ad6de70a45d005a P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.473485  4777 consensus_queue.cc:260] T bc88f6f533ef4807bba8f78c14dbc9f2 P 308ac45a3f334cdcac265c0cfbbc039b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } }
I20260709 13:12:59.472645  4778 ts_tablet_manager.cc:1403] T 4b35da8e30d245c5a00c054010005f9d P c800c72b860f42878733b72fa57c227e: Time spent bootstrapping tablet: real 0.078s	user 0.018s	sys 0.000s
I20260709 13:12:59.475666  4777 ts_tablet_manager.cc:1434] T bc88f6f533ef4807bba8f78c14dbc9f2 P 308ac45a3f334cdcac265c0cfbbc039b: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 13:12:59.476604  4777 tablet_bootstrap.cc:492] T b69c4c8d794d46b5a9339d9cf118cfcd P 308ac45a3f334cdcac265c0cfbbc039b: Bootstrap starting.
I20260709 13:12:59.477628  4778 raft_consensus.cc:359] T 4b35da8e30d245c5a00c054010005f9d P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.478350  4778 raft_consensus.cc:385] T 4b35da8e30d245c5a00c054010005f9d P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.478606  4778 raft_consensus.cc:740] T 4b35da8e30d245c5a00c054010005f9d P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c800c72b860f42878733b72fa57c227e, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.479794  4734 raft_consensus.cc:2468] T f68bd211ab4a49de8ad6de70a45d005a P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed488ca31ad54b53836e5a10d053b568 in term 1.
I20260709 13:12:59.480886  4548 leader_election.cc:304] T f68bd211ab4a49de8ad6de70a45d005a P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 308ac45a3f334cdcac265c0cfbbc039b, ed488ca31ad54b53836e5a10d053b568; no voters: 
I20260709 13:12:59.481743  4791 raft_consensus.cc:2804] T f68bd211ab4a49de8ad6de70a45d005a P ed488ca31ad54b53836e5a10d053b568 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:12:59.482398  4791 raft_consensus.cc:697] T f68bd211ab4a49de8ad6de70a45d005a P ed488ca31ad54b53836e5a10d053b568 [term 1 LEADER]: Becoming Leader. State: Replica: ed488ca31ad54b53836e5a10d053b568, State: Running, Role: LEADER
I20260709 13:12:59.483070  4777 tablet_bootstrap.cc:654] T b69c4c8d794d46b5a9339d9cf118cfcd P 308ac45a3f334cdcac265c0cfbbc039b: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.483191  4791 consensus_queue.cc:237] T f68bd211ab4a49de8ad6de70a45d005a P ed488ca31ad54b53836e5a10d053b568 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.484102  4821 raft_consensus.cc:2749] T f12e6e418b9c4465b718cdbb4786377a P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:59.486021  4778 consensus_queue.cc:260] T 4b35da8e30d245c5a00c054010005f9d P c800c72b860f42878733b72fa57c227e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.488842  4482 catalog_manager.cc:5697] T bc88f6f533ef4807bba8f78c14dbc9f2 P ed488ca31ad54b53836e5a10d053b568 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed488ca31ad54b53836e5a10d053b568 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "ed488ca31ad54b53836e5a10d053b568" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:59.490746  4482 catalog_manager.cc:5697] T 0e2df276ddf14a03bd0bb461cd92f6c9 P ed488ca31ad54b53836e5a10d053b568 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed488ca31ad54b53836e5a10d053b568 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "ed488ca31ad54b53836e5a10d053b568" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:59.495476  4660 raft_consensus.cc:2468] T f68bd211ab4a49de8ad6de70a45d005a P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed488ca31ad54b53836e5a10d053b568 in term 1.
I20260709 13:12:59.496110  4778 ts_tablet_manager.cc:1434] T 4b35da8e30d245c5a00c054010005f9d P c800c72b860f42878733b72fa57c227e: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 13:12:59.503775  4778 tablet_bootstrap.cc:492] T 984b5083f2394eef88d52b75f6705949 P c800c72b860f42878733b72fa57c227e: Bootstrap starting.
I20260709 13:12:59.509364  4778 tablet_bootstrap.cc:654] T 984b5083f2394eef88d52b75f6705949 P c800c72b860f42878733b72fa57c227e: Neither blocks nor log segments found. Creating new log.
I20260709 13:12:59.510529  4808 raft_consensus.cc:493] T 4b35da8e30d245c5a00c054010005f9d P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.511140  4808 raft_consensus.cc:515] T 4b35da8e30d245c5a00c054010005f9d P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.513312  4808 leader_election.cc:290] T 4b35da8e30d245c5a00c054010005f9d P c800c72b860f42878733b72fa57c227e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed488ca31ad54b53836e5a10d053b568 (127.28.54.65:36419), 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965)
I20260709 13:12:59.514303  4734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b35da8e30d245c5a00c054010005f9d" candidate_uuid: "c800c72b860f42878733b72fa57c227e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b" is_pre_election: true
I20260709 13:12:59.515115  4734 raft_consensus.cc:2393] T 4b35da8e30d245c5a00c054010005f9d P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c800c72b860f42878733b72fa57c227e in current term 1: Already voted for candidate ed488ca31ad54b53836e5a10d053b568 in this term.
I20260709 13:12:59.515856  4480 catalog_manager.cc:5697] T f68bd211ab4a49de8ad6de70a45d005a P ed488ca31ad54b53836e5a10d053b568 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed488ca31ad54b53836e5a10d053b568 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "ed488ca31ad54b53836e5a10d053b568" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:59.517840  4777 tablet_bootstrap.cc:492] T b69c4c8d794d46b5a9339d9cf118cfcd P 308ac45a3f334cdcac265c0cfbbc039b: No bootstrap required, opened a new log
I20260709 13:12:59.518057  4585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b35da8e30d245c5a00c054010005f9d" candidate_uuid: "c800c72b860f42878733b72fa57c227e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed488ca31ad54b53836e5a10d053b568" is_pre_election: true
I20260709 13:12:59.518381  4777 ts_tablet_manager.cc:1403] T b69c4c8d794d46b5a9339d9cf118cfcd P 308ac45a3f334cdcac265c0cfbbc039b: Time spent bootstrapping tablet: real 0.042s	user 0.032s	sys 0.003s
I20260709 13:12:59.519444  4625 leader_election.cc:304] T 4b35da8e30d245c5a00c054010005f9d P c800c72b860f42878733b72fa57c227e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c800c72b860f42878733b72fa57c227e; no voters: 308ac45a3f334cdcac265c0cfbbc039b, ed488ca31ad54b53836e5a10d053b568
I20260709 13:12:59.520576  4808 raft_consensus.cc:3060] T 4b35da8e30d245c5a00c054010005f9d P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.521281  4777 raft_consensus.cc:359] T b69c4c8d794d46b5a9339d9cf118cfcd P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.521992  4777 raft_consensus.cc:385] T b69c4c8d794d46b5a9339d9cf118cfcd P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.522312  4777 raft_consensus.cc:740] T b69c4c8d794d46b5a9339d9cf118cfcd P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 308ac45a3f334cdcac265c0cfbbc039b, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.523121  4777 consensus_queue.cc:260] T b69c4c8d794d46b5a9339d9cf118cfcd P 308ac45a3f334cdcac265c0cfbbc039b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.528149  4777 ts_tablet_manager.cc:1434] T b69c4c8d794d46b5a9339d9cf118cfcd P 308ac45a3f334cdcac265c0cfbbc039b: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:12:59.528515  4808 raft_consensus.cc:2749] T 4b35da8e30d245c5a00c054010005f9d P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:59.531121  4778 tablet_bootstrap.cc:492] T 984b5083f2394eef88d52b75f6705949 P c800c72b860f42878733b72fa57c227e: No bootstrap required, opened a new log
I20260709 13:12:59.531534  4778 ts_tablet_manager.cc:1403] T 984b5083f2394eef88d52b75f6705949 P c800c72b860f42878733b72fa57c227e: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.008s
I20260709 13:12:59.533852  4778 raft_consensus.cc:359] T 984b5083f2394eef88d52b75f6705949 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.534324  4778 raft_consensus.cc:385] T 984b5083f2394eef88d52b75f6705949 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:12:59.534509  4778 raft_consensus.cc:740] T 984b5083f2394eef88d52b75f6705949 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c800c72b860f42878733b72fa57c227e, State: Initialized, Role: FOLLOWER
I20260709 13:12:59.535037  4778 consensus_queue.cc:260] T 984b5083f2394eef88d52b75f6705949 P c800c72b860f42878733b72fa57c227e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.536609  4778 ts_tablet_manager.cc:1434] T 984b5083f2394eef88d52b75f6705949 P c800c72b860f42878733b72fa57c227e: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:12:59.556671  4821 raft_consensus.cc:493] T bc88f6f533ef4807bba8f78c14dbc9f2 P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.557173  4821 raft_consensus.cc:515] T bc88f6f533ef4807bba8f78c14dbc9f2 P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } }
I20260709 13:12:59.558790  4821 leader_election.cc:290] T bc88f6f533ef4807bba8f78c14dbc9f2 P 308ac45a3f334cdcac265c0cfbbc039b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed488ca31ad54b53836e5a10d053b568 (127.28.54.65:36419), c800c72b860f42878733b72fa57c227e (127.28.54.66:43707)
I20260709 13:12:59.559518  4585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc88f6f533ef4807bba8f78c14dbc9f2" candidate_uuid: "308ac45a3f334cdcac265c0cfbbc039b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed488ca31ad54b53836e5a10d053b568" is_pre_election: true
I20260709 13:12:59.559746  4660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc88f6f533ef4807bba8f78c14dbc9f2" candidate_uuid: "308ac45a3f334cdcac265c0cfbbc039b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c800c72b860f42878733b72fa57c227e" is_pre_election: true
I20260709 13:12:59.560417  4660 raft_consensus.cc:2393] T bc88f6f533ef4807bba8f78c14dbc9f2 P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 308ac45a3f334cdcac265c0cfbbc039b in current term 1: Already voted for candidate ed488ca31ad54b53836e5a10d053b568 in this term.
I20260709 13:12:59.561249  4699 leader_election.cc:304] T bc88f6f533ef4807bba8f78c14dbc9f2 P 308ac45a3f334cdcac265c0cfbbc039b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 308ac45a3f334cdcac265c0cfbbc039b; no voters: c800c72b860f42878733b72fa57c227e, ed488ca31ad54b53836e5a10d053b568
I20260709 13:12:59.561832  4821 raft_consensus.cc:3060] T bc88f6f533ef4807bba8f78c14dbc9f2 P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.566574  4821 raft_consensus.cc:2749] T bc88f6f533ef4807bba8f78c14dbc9f2 P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:59.636312  4660 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b69c4c8d794d46b5a9339d9cf118cfcd"
dest_uuid: "c800c72b860f42878733b72fa57c227e"
mode: GRACEFUL
new_leader_uuid: "ed488ca31ad54b53836e5a10d053b568"
 from {username='slave'} at 127.0.0.1:43478
I20260709 13:12:59.636924  4660 raft_consensus.cc:606] T b69c4c8d794d46b5a9339d9cf118cfcd P c800c72b860f42878733b72fa57c227e [term 1 LEADER]: Received request to transfer leadership to TS ed488ca31ad54b53836e5a10d053b568
I20260709 13:12:59.648357  4734 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c437ad3104ee4400a2917a4e7c362efa"
dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b"
mode: GRACEFUL
new_leader_uuid: "ed488ca31ad54b53836e5a10d053b568"
 from {username='slave'} at 127.0.0.1:39282
I20260709 13:12:59.648813  4734 raft_consensus.cc:606] T c437ad3104ee4400a2917a4e7c362efa P 308ac45a3f334cdcac265c0cfbbc039b [term 1 LEADER]: Received request to transfer leadership to TS ed488ca31ad54b53836e5a10d053b568
I20260709 13:12:59.663249  4585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "984b5083f2394eef88d52b75f6705949"
dest_uuid: "ed488ca31ad54b53836e5a10d053b568"
mode: GRACEFUL
new_leader_uuid: "c800c72b860f42878733b72fa57c227e"
 from {username='slave'} at 127.0.0.1:51488
I20260709 13:12:59.663733  4585 raft_consensus.cc:606] T 984b5083f2394eef88d52b75f6705949 P ed488ca31ad54b53836e5a10d053b568 [term 1 LEADER]: Received request to transfer leadership to TS c800c72b860f42878733b72fa57c227e
I20260709 13:12:59.668340  4585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4b35da8e30d245c5a00c054010005f9d"
dest_uuid: "ed488ca31ad54b53836e5a10d053b568"
mode: GRACEFUL
new_leader_uuid: "c800c72b860f42878733b72fa57c227e"
 from {username='slave'} at 127.0.0.1:51488
I20260709 13:12:59.668810  4585 raft_consensus.cc:606] T 4b35da8e30d245c5a00c054010005f9d P ed488ca31ad54b53836e5a10d053b568 [term 1 LEADER]: Received request to transfer leadership to TS c800c72b860f42878733b72fa57c227e
I20260709 13:12:59.675894  4585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f12e6e418b9c4465b718cdbb4786377a"
dest_uuid: "ed488ca31ad54b53836e5a10d053b568"
mode: GRACEFUL
new_leader_uuid: "c800c72b860f42878733b72fa57c227e"
 from {username='slave'} at 127.0.0.1:51488
I20260709 13:12:59.676448  4585 raft_consensus.cc:606] T f12e6e418b9c4465b718cdbb4786377a P ed488ca31ad54b53836e5a10d053b568 [term 1 LEADER]: Received request to transfer leadership to TS c800c72b860f42878733b72fa57c227e
I20260709 13:12:59.680855  4585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f68bd211ab4a49de8ad6de70a45d005a"
dest_uuid: "ed488ca31ad54b53836e5a10d053b568"
mode: GRACEFUL
new_leader_uuid: "308ac45a3f334cdcac265c0cfbbc039b"
 from {username='slave'} at 127.0.0.1:51488
I20260709 13:12:59.681305  4585 raft_consensus.cc:606] T f68bd211ab4a49de8ad6de70a45d005a P ed488ca31ad54b53836e5a10d053b568 [term 1 LEADER]: Received request to transfer leadership to TS 308ac45a3f334cdcac265c0cfbbc039b
I20260709 13:12:59.692937  4660 raft_consensus.cc:3060] T 984b5083f2394eef88d52b75f6705949 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.698974  4791 consensus_queue.cc:1048] T 984b5083f2394eef88d52b75f6705949 P ed488ca31ad54b53836e5a10d053b568 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:59.704888  4817 raft_consensus.cc:993] T 984b5083f2394eef88d52b75f6705949 P ed488ca31ad54b53836e5a10d053b568: : Instructing follower c800c72b860f42878733b72fa57c227e to start an election
I20260709 13:12:59.705371  4806 raft_consensus.cc:1081] T 984b5083f2394eef88d52b75f6705949 P ed488ca31ad54b53836e5a10d053b568 [term 1 LEADER]: Signalling peer c800c72b860f42878733b72fa57c227e to start an election
I20260709 13:12:59.707037  4659 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "984b5083f2394eef88d52b75f6705949"
dest_uuid: "c800c72b860f42878733b72fa57c227e"
 from {username='slave'} at 127.0.0.1:43464
I20260709 13:12:59.709841  4659 raft_consensus.cc:493] T 984b5083f2394eef88d52b75f6705949 P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:59.710220  4659 raft_consensus.cc:3060] T 984b5083f2394eef88d52b75f6705949 P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.712208  4791 consensus_queue.cc:1048] T 984b5083f2394eef88d52b75f6705949 P ed488ca31ad54b53836e5a10d053b568 [LEADER]: Connected to new peer: Peer: permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:59.713466  4808 consensus_queue.cc:1048] T b69c4c8d794d46b5a9339d9cf118cfcd P c800c72b860f42878733b72fa57c227e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:59.717717  4659 raft_consensus.cc:515] T 984b5083f2394eef88d52b75f6705949 P c800c72b860f42878733b72fa57c227e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.721339  4659 leader_election.cc:290] T 984b5083f2394eef88d52b75f6705949 P c800c72b860f42878733b72fa57c227e [CANDIDATE]: Term 2 election: Requested vote from peers ed488ca31ad54b53836e5a10d053b568 (127.28.54.65:36419), 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965)
I20260709 13:12:59.722496  4584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984b5083f2394eef88d52b75f6705949" candidate_uuid: "c800c72b860f42878733b72fa57c227e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed488ca31ad54b53836e5a10d053b568"
I20260709 13:12:59.723122  4584 raft_consensus.cc:3055] T 984b5083f2394eef88d52b75f6705949 P ed488ca31ad54b53836e5a10d053b568 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:59.723434  4584 raft_consensus.cc:740] T 984b5083f2394eef88d52b75f6705949 P ed488ca31ad54b53836e5a10d053b568 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed488ca31ad54b53836e5a10d053b568, State: Running, Role: LEADER
I20260709 13:12:59.723531  4734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "984b5083f2394eef88d52b75f6705949" candidate_uuid: "c800c72b860f42878733b72fa57c227e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b"
I20260709 13:12:59.724306  4734 raft_consensus.cc:3060] T 984b5083f2394eef88d52b75f6705949 P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.724264  4584 consensus_queue.cc:260] T 984b5083f2394eef88d52b75f6705949 P ed488ca31ad54b53836e5a10d053b568 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.725855  4584 raft_consensus.cc:3060] T 984b5083f2394eef88d52b75f6705949 P ed488ca31ad54b53836e5a10d053b568 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.731009  4734 raft_consensus.cc:2468] T 984b5083f2394eef88d52b75f6705949 P 308ac45a3f334cdcac265c0cfbbc039b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c800c72b860f42878733b72fa57c227e in term 2.
I20260709 13:12:59.732081  4623 leader_election.cc:304] T 984b5083f2394eef88d52b75f6705949 P c800c72b860f42878733b72fa57c227e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 308ac45a3f334cdcac265c0cfbbc039b, c800c72b860f42878733b72fa57c227e; no voters: 
I20260709 13:12:59.732843  4808 raft_consensus.cc:2804] T 984b5083f2394eef88d52b75f6705949 P c800c72b860f42878733b72fa57c227e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:59.733341  4808 raft_consensus.cc:697] T 984b5083f2394eef88d52b75f6705949 P c800c72b860f42878733b72fa57c227e [term 2 LEADER]: Becoming Leader. State: Replica: c800c72b860f42878733b72fa57c227e, State: Running, Role: LEADER
I20260709 13:12:59.734208  4808 consensus_queue.cc:237] T 984b5083f2394eef88d52b75f6705949 P c800c72b860f42878733b72fa57c227e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.738366  4584 raft_consensus.cc:2468] T 984b5083f2394eef88d52b75f6705949 P ed488ca31ad54b53836e5a10d053b568 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c800c72b860f42878733b72fa57c227e in term 2.
I20260709 13:12:59.740211  4814 raft_consensus.cc:993] T b69c4c8d794d46b5a9339d9cf118cfcd P c800c72b860f42878733b72fa57c227e: : Instructing follower ed488ca31ad54b53836e5a10d053b568 to start an election
I20260709 13:12:59.740658  4814 raft_consensus.cc:1081] T b69c4c8d794d46b5a9339d9cf118cfcd P c800c72b860f42878733b72fa57c227e [term 1 LEADER]: Signalling peer ed488ca31ad54b53836e5a10d053b568 to start an election
I20260709 13:12:59.743470  4584 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b69c4c8d794d46b5a9339d9cf118cfcd"
dest_uuid: "ed488ca31ad54b53836e5a10d053b568"
 from {username='slave'} at 127.0.0.1:51466
I20260709 13:12:59.743734  4481 catalog_manager.cc:5697] T 984b5083f2394eef88d52b75f6705949 P c800c72b860f42878733b72fa57c227e reported cstate change: term changed from 1 to 2, leader changed from ed488ca31ad54b53836e5a10d053b568 (127.28.54.65) to c800c72b860f42878733b72fa57c227e (127.28.54.66). New cstate: current_term: 2 leader_uuid: "c800c72b860f42878733b72fa57c227e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:59.744675  4584 raft_consensus.cc:493] T b69c4c8d794d46b5a9339d9cf118cfcd P ed488ca31ad54b53836e5a10d053b568 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:59.745173  4584 raft_consensus.cc:3060] T b69c4c8d794d46b5a9339d9cf118cfcd P ed488ca31ad54b53836e5a10d053b568 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.747495  4734 raft_consensus.cc:3060] T b69c4c8d794d46b5a9339d9cf118cfcd P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.751740  4584 raft_consensus.cc:515] T b69c4c8d794d46b5a9339d9cf118cfcd P ed488ca31ad54b53836e5a10d053b568 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.755637  4808 consensus_queue.cc:1048] T b69c4c8d794d46b5a9339d9cf118cfcd P c800c72b860f42878733b72fa57c227e [LEADER]: Connected to new peer: Peer: permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:59.756031  4821 raft_consensus.cc:493] T b69c4c8d794d46b5a9339d9cf118cfcd P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.756480  4821 raft_consensus.cc:515] T b69c4c8d794d46b5a9339d9cf118cfcd P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.758351  4821 leader_election.cc:290] T b69c4c8d794d46b5a9339d9cf118cfcd P 308ac45a3f334cdcac265c0cfbbc039b [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers ed488ca31ad54b53836e5a10d053b568 (127.28.54.65:36419), c800c72b860f42878733b72fa57c227e (127.28.54.66:43707)
I20260709 13:12:59.760068  4585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b69c4c8d794d46b5a9339d9cf118cfcd" candidate_uuid: "308ac45a3f334cdcac265c0cfbbc039b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed488ca31ad54b53836e5a10d053b568" is_pre_election: true
I20260709 13:12:59.761859  4660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b69c4c8d794d46b5a9339d9cf118cfcd" candidate_uuid: "ed488ca31ad54b53836e5a10d053b568" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c800c72b860f42878733b72fa57c227e"
I20260709 13:12:59.759954  4659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b69c4c8d794d46b5a9339d9cf118cfcd" candidate_uuid: "308ac45a3f334cdcac265c0cfbbc039b" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c800c72b860f42878733b72fa57c227e" is_pre_election: true
I20260709 13:12:59.762167  4732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b69c4c8d794d46b5a9339d9cf118cfcd" candidate_uuid: "ed488ca31ad54b53836e5a10d053b568" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b"
I20260709 13:12:59.762537  4660 raft_consensus.cc:3055] T b69c4c8d794d46b5a9339d9cf118cfcd P c800c72b860f42878733b72fa57c227e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:59.763720  4699 leader_election.cc:304] T b69c4c8d794d46b5a9339d9cf118cfcd P 308ac45a3f334cdcac265c0cfbbc039b [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 308ac45a3f334cdcac265c0cfbbc039b; no voters: c800c72b860f42878733b72fa57c227e, ed488ca31ad54b53836e5a10d053b568
I20260709 13:12:59.763936  4660 raft_consensus.cc:740] T b69c4c8d794d46b5a9339d9cf118cfcd P c800c72b860f42878733b72fa57c227e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c800c72b860f42878733b72fa57c227e, State: Running, Role: LEADER
I20260709 13:12:59.764753  4660 consensus_queue.cc:260] T b69c4c8d794d46b5a9339d9cf118cfcd P c800c72b860f42878733b72fa57c227e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.762409  4584 leader_election.cc:290] T b69c4c8d794d46b5a9339d9cf118cfcd P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 2 election: Requested vote from peers c800c72b860f42878733b72fa57c227e (127.28.54.66:43707), 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965)
I20260709 13:12:59.765635  4660 raft_consensus.cc:3060] T b69c4c8d794d46b5a9339d9cf118cfcd P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.767201  4821 raft_consensus.cc:2749] T b69c4c8d794d46b5a9339d9cf118cfcd P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:12:59.772954  4660 raft_consensus.cc:2468] T b69c4c8d794d46b5a9339d9cf118cfcd P c800c72b860f42878733b72fa57c227e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed488ca31ad54b53836e5a10d053b568 in term 2.
I20260709 13:12:59.773909  4550 leader_election.cc:304] T b69c4c8d794d46b5a9339d9cf118cfcd P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c800c72b860f42878733b72fa57c227e, ed488ca31ad54b53836e5a10d053b568; no voters: 308ac45a3f334cdcac265c0cfbbc039b
I20260709 13:12:59.774533  4791 raft_consensus.cc:2804] T b69c4c8d794d46b5a9339d9cf118cfcd P ed488ca31ad54b53836e5a10d053b568 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:59.774906  4791 raft_consensus.cc:697] T b69c4c8d794d46b5a9339d9cf118cfcd P ed488ca31ad54b53836e5a10d053b568 [term 2 LEADER]: Becoming Leader. State: Replica: ed488ca31ad54b53836e5a10d053b568, State: Running, Role: LEADER
I20260709 13:12:59.775722  4791 consensus_queue.cc:237] T b69c4c8d794d46b5a9339d9cf118cfcd P ed488ca31ad54b53836e5a10d053b568 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.781538  4480 catalog_manager.cc:5697] T b69c4c8d794d46b5a9339d9cf118cfcd P ed488ca31ad54b53836e5a10d053b568 reported cstate change: term changed from 1 to 2, leader changed from c800c72b860f42878733b72fa57c227e (127.28.54.66) to ed488ca31ad54b53836e5a10d053b568 (127.28.54.65). New cstate: current_term: 2 leader_uuid: "ed488ca31ad54b53836e5a10d053b568" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:59.783560  4791 consensus_queue.cc:1048] T f12e6e418b9c4465b718cdbb4786377a P ed488ca31ad54b53836e5a10d053b568 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:59.790155  4806 raft_consensus.cc:993] T f12e6e418b9c4465b718cdbb4786377a P ed488ca31ad54b53836e5a10d053b568: : Instructing follower c800c72b860f42878733b72fa57c227e to start an election
I20260709 13:12:59.790601  4806 raft_consensus.cc:1081] T f12e6e418b9c4465b718cdbb4786377a P ed488ca31ad54b53836e5a10d053b568 [term 1 LEADER]: Signalling peer c800c72b860f42878733b72fa57c227e to start an election
I20260709 13:12:59.795452  4660 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f12e6e418b9c4465b718cdbb4786377a"
dest_uuid: "c800c72b860f42878733b72fa57c227e"
 from {username='slave'} at 127.0.0.1:43464
I20260709 13:12:59.795616  4817 consensus_queue.cc:1048] T f12e6e418b9c4465b718cdbb4786377a P ed488ca31ad54b53836e5a10d053b568 [LEADER]: Connected to new peer: Peer: permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:59.796015  4660 raft_consensus.cc:493] T f12e6e418b9c4465b718cdbb4786377a P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:59.796444  4660 raft_consensus.cc:3060] T f12e6e418b9c4465b718cdbb4786377a P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.804800  4660 raft_consensus.cc:515] T f12e6e418b9c4465b718cdbb4786377a P c800c72b860f42878733b72fa57c227e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.807140  4660 leader_election.cc:290] T f12e6e418b9c4465b718cdbb4786377a P c800c72b860f42878733b72fa57c227e [CANDIDATE]: Term 2 election: Requested vote from peers ed488ca31ad54b53836e5a10d053b568 (127.28.54.65:36419), 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965)
I20260709 13:12:59.807507  4584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12e6e418b9c4465b718cdbb4786377a" candidate_uuid: "c800c72b860f42878733b72fa57c227e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed488ca31ad54b53836e5a10d053b568"
I20260709 13:12:59.807986  4734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f12e6e418b9c4465b718cdbb4786377a" candidate_uuid: "c800c72b860f42878733b72fa57c227e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b"
I20260709 13:12:59.808115  4584 raft_consensus.cc:3055] T f12e6e418b9c4465b718cdbb4786377a P ed488ca31ad54b53836e5a10d053b568 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:59.808617  4584 raft_consensus.cc:740] T f12e6e418b9c4465b718cdbb4786377a P ed488ca31ad54b53836e5a10d053b568 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed488ca31ad54b53836e5a10d053b568, State: Running, Role: LEADER
I20260709 13:12:59.808660  4734 raft_consensus.cc:3060] T f12e6e418b9c4465b718cdbb4786377a P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.809372  4584 consensus_queue.cc:260] T f12e6e418b9c4465b718cdbb4786377a P ed488ca31ad54b53836e5a10d053b568 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.810611  4584 raft_consensus.cc:3060] T f12e6e418b9c4465b718cdbb4786377a P ed488ca31ad54b53836e5a10d053b568 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.813961  4734 raft_consensus.cc:2468] T f12e6e418b9c4465b718cdbb4786377a P 308ac45a3f334cdcac265c0cfbbc039b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c800c72b860f42878733b72fa57c227e in term 2.
I20260709 13:12:59.814895  4623 leader_election.cc:304] T f12e6e418b9c4465b718cdbb4786377a P c800c72b860f42878733b72fa57c227e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 308ac45a3f334cdcac265c0cfbbc039b, c800c72b860f42878733b72fa57c227e; no voters: 
I20260709 13:12:59.815652  4808 raft_consensus.cc:2804] T f12e6e418b9c4465b718cdbb4786377a P c800c72b860f42878733b72fa57c227e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:59.816022  4808 raft_consensus.cc:697] T f12e6e418b9c4465b718cdbb4786377a P c800c72b860f42878733b72fa57c227e [term 2 LEADER]: Becoming Leader. State: Replica: c800c72b860f42878733b72fa57c227e, State: Running, Role: LEADER
I20260709 13:12:59.816267  4584 raft_consensus.cc:2468] T f12e6e418b9c4465b718cdbb4786377a P ed488ca31ad54b53836e5a10d053b568 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c800c72b860f42878733b72fa57c227e in term 2.
I20260709 13:12:59.816684  4808 consensus_queue.cc:237] T f12e6e418b9c4465b718cdbb4786377a P c800c72b860f42878733b72fa57c227e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.822321  4480 catalog_manager.cc:5697] T f12e6e418b9c4465b718cdbb4786377a P c800c72b860f42878733b72fa57c227e reported cstate change: term changed from 1 to 2, leader changed from ed488ca31ad54b53836e5a10d053b568 (127.28.54.65) to c800c72b860f42878733b72fa57c227e (127.28.54.66). New cstate: current_term: 2 leader_uuid: "c800c72b860f42878733b72fa57c227e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:59.825577  4808 raft_consensus.cc:493] T 0e2df276ddf14a03bd0bb461cd92f6c9 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:12:59.826081  4808 raft_consensus.cc:515] T 0e2df276ddf14a03bd0bb461cd92f6c9 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.828073  4808 leader_election.cc:290] T 0e2df276ddf14a03bd0bb461cd92f6c9 P c800c72b860f42878733b72fa57c227e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed488ca31ad54b53836e5a10d053b568 (127.28.54.65:36419), 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965)
I20260709 13:12:59.828738  4584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2df276ddf14a03bd0bb461cd92f6c9" candidate_uuid: "c800c72b860f42878733b72fa57c227e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed488ca31ad54b53836e5a10d053b568" is_pre_election: true
I20260709 13:12:59.829115  4734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0e2df276ddf14a03bd0bb461cd92f6c9" candidate_uuid: "c800c72b860f42878733b72fa57c227e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b" is_pre_election: true
I20260709 13:12:59.830073  4734 raft_consensus.cc:2393] T 0e2df276ddf14a03bd0bb461cd92f6c9 P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c800c72b860f42878733b72fa57c227e in current term 1: Already voted for candidate ed488ca31ad54b53836e5a10d053b568 in this term.
I20260709 13:12:59.830917  4623 leader_election.cc:304] T 0e2df276ddf14a03bd0bb461cd92f6c9 P c800c72b860f42878733b72fa57c227e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c800c72b860f42878733b72fa57c227e; no voters: 308ac45a3f334cdcac265c0cfbbc039b, ed488ca31ad54b53836e5a10d053b568
I20260709 13:12:59.831492  4808 raft_consensus.cc:3060] T 0e2df276ddf14a03bd0bb461cd92f6c9 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:12:59.836059  4808 raft_consensus.cc:2749] T 0e2df276ddf14a03bd0bb461cd92f6c9 P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:12:59.856819  4817 consensus_queue.cc:1048] T 0e2df276ddf14a03bd0bb461cd92f6c9 P ed488ca31ad54b53836e5a10d053b568 [LEADER]: Connected to new peer: Peer: permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:59.866609  4817 consensus_queue.cc:1048] T 0e2df276ddf14a03bd0bb461cd92f6c9 P ed488ca31ad54b53836e5a10d053b568 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:59.879680  4817 consensus_queue.cc:1048] T 4b35da8e30d245c5a00c054010005f9d P ed488ca31ad54b53836e5a10d053b568 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:59.885944  4791 raft_consensus.cc:993] T 4b35da8e30d245c5a00c054010005f9d P ed488ca31ad54b53836e5a10d053b568: : Instructing follower c800c72b860f42878733b72fa57c227e to start an election
I20260709 13:12:59.886444  4806 raft_consensus.cc:1081] T 4b35da8e30d245c5a00c054010005f9d P ed488ca31ad54b53836e5a10d053b568 [term 1 LEADER]: Signalling peer c800c72b860f42878733b72fa57c227e to start an election
I20260709 13:12:59.888271  4659 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4b35da8e30d245c5a00c054010005f9d"
dest_uuid: "c800c72b860f42878733b72fa57c227e"
 from {username='slave'} at 127.0.0.1:43464
I20260709 13:12:59.891050  4659 raft_consensus.cc:493] T 4b35da8e30d245c5a00c054010005f9d P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:59.891433  4659 raft_consensus.cc:3060] T 4b35da8e30d245c5a00c054010005f9d P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.891330  4808 consensus_queue.cc:1048] T d9d05411f1e749669cdf7c1be8d9d941 P c800c72b860f42878733b72fa57c227e [LEADER]: Connected to new peer: Peer: permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:12:59.895148  4817 consensus_queue.cc:1048] T 4b35da8e30d245c5a00c054010005f9d P ed488ca31ad54b53836e5a10d053b568 [LEADER]: Connected to new peer: Peer: permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:59.898696  4659 raft_consensus.cc:515] T 4b35da8e30d245c5a00c054010005f9d P c800c72b860f42878733b72fa57c227e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.905820  4732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b35da8e30d245c5a00c054010005f9d" candidate_uuid: "c800c72b860f42878733b72fa57c227e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b"
I20260709 13:12:59.907562  4659 leader_election.cc:290] T 4b35da8e30d245c5a00c054010005f9d P c800c72b860f42878733b72fa57c227e [CANDIDATE]: Term 2 election: Requested vote from peers ed488ca31ad54b53836e5a10d053b568 (127.28.54.65:36419), 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965)
I20260709 13:12:59.908095  4585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4b35da8e30d245c5a00c054010005f9d" candidate_uuid: "c800c72b860f42878733b72fa57c227e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed488ca31ad54b53836e5a10d053b568"
I20260709 13:12:59.908747  4585 raft_consensus.cc:3055] T 4b35da8e30d245c5a00c054010005f9d P ed488ca31ad54b53836e5a10d053b568 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:59.909055  4585 raft_consensus.cc:740] T 4b35da8e30d245c5a00c054010005f9d P ed488ca31ad54b53836e5a10d053b568 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed488ca31ad54b53836e5a10d053b568, State: Running, Role: LEADER
I20260709 13:12:59.909919  4585 consensus_queue.cc:260] T 4b35da8e30d245c5a00c054010005f9d P ed488ca31ad54b53836e5a10d053b568 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.910969  4585 raft_consensus.cc:3060] T 4b35da8e30d245c5a00c054010005f9d P ed488ca31ad54b53836e5a10d053b568 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.911309  4808 consensus_queue.cc:1048] T d9d05411f1e749669cdf7c1be8d9d941 P c800c72b860f42878733b72fa57c227e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:59.920782  4585 raft_consensus.cc:2468] T 4b35da8e30d245c5a00c054010005f9d P ed488ca31ad54b53836e5a10d053b568 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c800c72b860f42878733b72fa57c227e in term 2.
I20260709 13:12:59.922155  4625 leader_election.cc:304] T 4b35da8e30d245c5a00c054010005f9d P c800c72b860f42878733b72fa57c227e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c800c72b860f42878733b72fa57c227e, ed488ca31ad54b53836e5a10d053b568; no voters: 308ac45a3f334cdcac265c0cfbbc039b
I20260709 13:12:59.923381  4808 raft_consensus.cc:2804] T 4b35da8e30d245c5a00c054010005f9d P c800c72b860f42878733b72fa57c227e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:59.924288  4806 consensus_queue.cc:1048] T bc88f6f533ef4807bba8f78c14dbc9f2 P ed488ca31ad54b53836e5a10d053b568 [LEADER]: Connected to new peer: Peer: permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:59.924765  4808 raft_consensus.cc:697] T 4b35da8e30d245c5a00c054010005f9d P c800c72b860f42878733b72fa57c227e [term 2 LEADER]: Becoming Leader. State: Replica: c800c72b860f42878733b72fa57c227e, State: Running, Role: LEADER
I20260709 13:12:59.925724  4808 consensus_queue.cc:237] T 4b35da8e30d245c5a00c054010005f9d P c800c72b860f42878733b72fa57c227e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.927438  4806 consensus_queue.cc:1048] T f68bd211ab4a49de8ad6de70a45d005a P ed488ca31ad54b53836e5a10d053b568 [LEADER]: Connected to new peer: Peer: permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:59.936280  4482 catalog_manager.cc:5697] T 4b35da8e30d245c5a00c054010005f9d P c800c72b860f42878733b72fa57c227e reported cstate change: term changed from 1 to 2, leader changed from ed488ca31ad54b53836e5a10d053b568 (127.28.54.65) to c800c72b860f42878733b72fa57c227e (127.28.54.66). New cstate: current_term: 2 leader_uuid: "c800c72b860f42878733b72fa57c227e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:12:59.937099  4817 raft_consensus.cc:993] T f68bd211ab4a49de8ad6de70a45d005a P ed488ca31ad54b53836e5a10d053b568: : Instructing follower 308ac45a3f334cdcac265c0cfbbc039b to start an election
I20260709 13:12:59.937806  4817 raft_consensus.cc:1081] T f68bd211ab4a49de8ad6de70a45d005a P ed488ca31ad54b53836e5a10d053b568 [term 1 LEADER]: Signalling peer 308ac45a3f334cdcac265c0cfbbc039b to start an election
I20260709 13:12:59.946761  4791 consensus_queue.cc:1048] T f68bd211ab4a49de8ad6de70a45d005a P ed488ca31ad54b53836e5a10d053b568 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:59.950044  4732 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f68bd211ab4a49de8ad6de70a45d005a"
dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b"
 from {username='slave'} at 127.0.0.1:39278
I20260709 13:12:59.951599  4732 raft_consensus.cc:493] T f68bd211ab4a49de8ad6de70a45d005a P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:12:59.951973  4732 raft_consensus.cc:3060] T f68bd211ab4a49de8ad6de70a45d005a P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.959470  4732 raft_consensus.cc:515] T f68bd211ab4a49de8ad6de70a45d005a P 308ac45a3f334cdcac265c0cfbbc039b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.961045  4776 consensus_queue.cc:1048] T bc88f6f533ef4807bba8f78c14dbc9f2 P ed488ca31ad54b53836e5a10d053b568 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:12:59.961990  4734 raft_consensus.cc:1240] T f68bd211ab4a49de8ad6de70a45d005a P 308ac45a3f334cdcac265c0cfbbc039b [term 2 FOLLOWER]: Rejecting Update request from peer ed488ca31ad54b53836e5a10d053b568 for earlier term 1. Current term is 2. Ops: []
I20260709 13:12:59.966591  4585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68bd211ab4a49de8ad6de70a45d005a" candidate_uuid: "308ac45a3f334cdcac265c0cfbbc039b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed488ca31ad54b53836e5a10d053b568"
I20260709 13:12:59.967274  4585 raft_consensus.cc:3055] T f68bd211ab4a49de8ad6de70a45d005a P ed488ca31ad54b53836e5a10d053b568 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:12:59.967581  4585 raft_consensus.cc:740] T f68bd211ab4a49de8ad6de70a45d005a P ed488ca31ad54b53836e5a10d053b568 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed488ca31ad54b53836e5a10d053b568, State: Running, Role: LEADER
I20260709 13:12:59.968417  4585 consensus_queue.cc:260] T f68bd211ab4a49de8ad6de70a45d005a P ed488ca31ad54b53836e5a10d053b568 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.969400  4585 raft_consensus.cc:3060] T f68bd211ab4a49de8ad6de70a45d005a P ed488ca31ad54b53836e5a10d053b568 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:12:59.970374  4732 leader_election.cc:290] T f68bd211ab4a49de8ad6de70a45d005a P 308ac45a3f334cdcac265c0cfbbc039b [CANDIDATE]: Term 2 election: Requested vote from peers ed488ca31ad54b53836e5a10d053b568 (127.28.54.65:36419), c800c72b860f42878733b72fa57c227e (127.28.54.66:43707)
I20260709 13:12:59.971391  4660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f68bd211ab4a49de8ad6de70a45d005a" candidate_uuid: "308ac45a3f334cdcac265c0cfbbc039b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c800c72b860f42878733b72fa57c227e"
I20260709 13:12:59.976822  4585 raft_consensus.cc:2468] T f68bd211ab4a49de8ad6de70a45d005a P ed488ca31ad54b53836e5a10d053b568 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 308ac45a3f334cdcac265c0cfbbc039b in term 2.
I20260709 13:12:59.977901  4699 leader_election.cc:304] T f68bd211ab4a49de8ad6de70a45d005a P 308ac45a3f334cdcac265c0cfbbc039b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 308ac45a3f334cdcac265c0cfbbc039b, ed488ca31ad54b53836e5a10d053b568; no voters: c800c72b860f42878733b72fa57c227e
I20260709 13:12:59.978689  4821 raft_consensus.cc:2804] T f68bd211ab4a49de8ad6de70a45d005a P 308ac45a3f334cdcac265c0cfbbc039b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:12:59.979067  4821 raft_consensus.cc:697] T f68bd211ab4a49de8ad6de70a45d005a P 308ac45a3f334cdcac265c0cfbbc039b [term 2 LEADER]: Becoming Leader. State: Replica: 308ac45a3f334cdcac265c0cfbbc039b, State: Running, Role: LEADER
I20260709 13:12:59.979768  4821 consensus_queue.cc:237] T f68bd211ab4a49de8ad6de70a45d005a P 308ac45a3f334cdcac265c0cfbbc039b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:12:59.986054  4481 catalog_manager.cc:5697] T f68bd211ab4a49de8ad6de70a45d005a P 308ac45a3f334cdcac265c0cfbbc039b reported cstate change: term changed from 1 to 2, leader changed from ed488ca31ad54b53836e5a10d053b568 (127.28.54.65) to 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67). New cstate: current_term: 2 leader_uuid: "308ac45a3f334cdcac265c0cfbbc039b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:00.009222  4821 consensus_queue.cc:1048] T c437ad3104ee4400a2917a4e7c362efa P 308ac45a3f334cdcac265c0cfbbc039b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:00.015190  4820 raft_consensus.cc:993] T c437ad3104ee4400a2917a4e7c362efa P 308ac45a3f334cdcac265c0cfbbc039b: : Instructing follower ed488ca31ad54b53836e5a10d053b568 to start an election
I20260709 13:13:00.015929  4821 raft_consensus.cc:1081] T c437ad3104ee4400a2917a4e7c362efa P 308ac45a3f334cdcac265c0cfbbc039b [term 1 LEADER]: Signalling peer ed488ca31ad54b53836e5a10d053b568 to start an election
I20260709 13:13:00.019097  4585 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c437ad3104ee4400a2917a4e7c362efa"
dest_uuid: "ed488ca31ad54b53836e5a10d053b568"
 from {username='slave'} at 127.0.0.1:51476
I20260709 13:13:00.019729  4585 raft_consensus.cc:493] T c437ad3104ee4400a2917a4e7c362efa P ed488ca31ad54b53836e5a10d053b568 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:00.020157  4585 raft_consensus.cc:3060] T c437ad3104ee4400a2917a4e7c362efa P ed488ca31ad54b53836e5a10d053b568 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.022053  4852 consensus_queue.cc:1048] T c437ad3104ee4400a2917a4e7c362efa P 308ac45a3f334cdcac265c0cfbbc039b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:00.027493  4585 raft_consensus.cc:515] T c437ad3104ee4400a2917a4e7c362efa P ed488ca31ad54b53836e5a10d053b568 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:00.030158  4585 leader_election.cc:290] T c437ad3104ee4400a2917a4e7c362efa P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 2 election: Requested vote from peers c800c72b860f42878733b72fa57c227e (127.28.54.66:43707), 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965)
I20260709 13:13:00.030320  4659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c437ad3104ee4400a2917a4e7c362efa" candidate_uuid: "ed488ca31ad54b53836e5a10d053b568" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c800c72b860f42878733b72fa57c227e"
I20260709 13:13:00.030931  4659 raft_consensus.cc:3060] T c437ad3104ee4400a2917a4e7c362efa P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.031471  4734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c437ad3104ee4400a2917a4e7c362efa" candidate_uuid: "ed488ca31ad54b53836e5a10d053b568" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b"
I20260709 13:13:00.032055  4734 raft_consensus.cc:3055] T c437ad3104ee4400a2917a4e7c362efa P 308ac45a3f334cdcac265c0cfbbc039b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:00.032379  4734 raft_consensus.cc:740] T c437ad3104ee4400a2917a4e7c362efa P 308ac45a3f334cdcac265c0cfbbc039b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 308ac45a3f334cdcac265c0cfbbc039b, State: Running, Role: LEADER
I20260709 13:13:00.033129  4734 consensus_queue.cc:260] T c437ad3104ee4400a2917a4e7c362efa P 308ac45a3f334cdcac265c0cfbbc039b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:00.034058  4734 raft_consensus.cc:3060] T c437ad3104ee4400a2917a4e7c362efa P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.036271  4659 raft_consensus.cc:2468] T c437ad3104ee4400a2917a4e7c362efa P c800c72b860f42878733b72fa57c227e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed488ca31ad54b53836e5a10d053b568 in term 2.
I20260709 13:13:00.038173  4550 leader_election.cc:304] T c437ad3104ee4400a2917a4e7c362efa P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c800c72b860f42878733b72fa57c227e, ed488ca31ad54b53836e5a10d053b568; no voters: 
I20260709 13:13:00.038843  4776 raft_consensus.cc:2804] T c437ad3104ee4400a2917a4e7c362efa P ed488ca31ad54b53836e5a10d053b568 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:00.039294  4776 raft_consensus.cc:697] T c437ad3104ee4400a2917a4e7c362efa P ed488ca31ad54b53836e5a10d053b568 [term 2 LEADER]: Becoming Leader. State: Replica: ed488ca31ad54b53836e5a10d053b568, State: Running, Role: LEADER
I20260709 13:13:00.039949  4776 consensus_queue.cc:237] T c437ad3104ee4400a2917a4e7c362efa P ed488ca31ad54b53836e5a10d053b568 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:00.040505  4734 raft_consensus.cc:2468] T c437ad3104ee4400a2917a4e7c362efa P 308ac45a3f334cdcac265c0cfbbc039b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed488ca31ad54b53836e5a10d053b568 in term 2.
I20260709 13:13:00.045926  4480 catalog_manager.cc:5697] T c437ad3104ee4400a2917a4e7c362efa P ed488ca31ad54b53836e5a10d053b568 reported cstate change: term changed from 1 to 2, leader changed from 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67) to ed488ca31ad54b53836e5a10d053b568 (127.28.54.65). New cstate: current_term: 2 leader_uuid: "ed488ca31ad54b53836e5a10d053b568" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:00.265101  4659 raft_consensus.cc:1275] T b69c4c8d794d46b5a9339d9cf118cfcd P c800c72b860f42878733b72fa57c227e [term 2 FOLLOWER]: Refusing update from remote peer ed488ca31ad54b53836e5a10d053b568: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:00.266253  4776 consensus_queue.cc:1048] T b69c4c8d794d46b5a9339d9cf118cfcd P ed488ca31ad54b53836e5a10d053b568 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:00.276302  4734 raft_consensus.cc:3060] T b69c4c8d794d46b5a9339d9cf118cfcd P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.287361  4734 raft_consensus.cc:1275] T b69c4c8d794d46b5a9339d9cf118cfcd P 308ac45a3f334cdcac265c0cfbbc039b [term 2 FOLLOWER]: Refusing update from remote peer ed488ca31ad54b53836e5a10d053b568: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:00.288631  4855 consensus_queue.cc:1048] T b69c4c8d794d46b5a9339d9cf118cfcd P ed488ca31ad54b53836e5a10d053b568 [LEADER]: Connected to new peer: Peer: permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:00.310364  4734 raft_consensus.cc:1275] T 984b5083f2394eef88d52b75f6705949 P 308ac45a3f334cdcac265c0cfbbc039b [term 2 FOLLOWER]: Refusing update from remote peer c800c72b860f42878733b72fa57c227e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:00.311874  4808 consensus_queue.cc:1048] T 984b5083f2394eef88d52b75f6705949 P c800c72b860f42878733b72fa57c227e [LEADER]: Connected to new peer: Peer: permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:00.314615  4585 raft_consensus.cc:1275] T f12e6e418b9c4465b718cdbb4786377a P ed488ca31ad54b53836e5a10d053b568 [term 2 FOLLOWER]: Refusing update from remote peer c800c72b860f42878733b72fa57c227e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:00.315750  4584 raft_consensus.cc:1275] T 984b5083f2394eef88d52b75f6705949 P ed488ca31ad54b53836e5a10d053b568 [term 2 FOLLOWER]: Refusing update from remote peer c800c72b860f42878733b72fa57c227e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:00.316195  4814 consensus_queue.cc:1048] T f12e6e418b9c4465b718cdbb4786377a P c800c72b860f42878733b72fa57c227e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:00.317292  4808 consensus_queue.cc:1048] T 984b5083f2394eef88d52b75f6705949 P c800c72b860f42878733b72fa57c227e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:00.326687  4734 raft_consensus.cc:1275] T f12e6e418b9c4465b718cdbb4786377a P 308ac45a3f334cdcac265c0cfbbc039b [term 2 FOLLOWER]: Refusing update from remote peer c800c72b860f42878733b72fa57c227e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:00.328207  4805 consensus_queue.cc:1048] T f12e6e418b9c4465b718cdbb4786377a P c800c72b860f42878733b72fa57c227e [LEADER]: Connected to new peer: Peer: permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:00.380193  4585 raft_consensus.cc:1275] T f68bd211ab4a49de8ad6de70a45d005a P ed488ca31ad54b53836e5a10d053b568 [term 2 FOLLOWER]: Refusing update from remote peer 308ac45a3f334cdcac265c0cfbbc039b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:00.381305  4852 consensus_queue.cc:1048] T f68bd211ab4a49de8ad6de70a45d005a P 308ac45a3f334cdcac265c0cfbbc039b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:00.388360  4659 raft_consensus.cc:3060] T f68bd211ab4a49de8ad6de70a45d005a P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.395740  4659 raft_consensus.cc:1275] T f68bd211ab4a49de8ad6de70a45d005a P c800c72b860f42878733b72fa57c227e [term 2 FOLLOWER]: Refusing update from remote peer 308ac45a3f334cdcac265c0cfbbc039b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:00.396970  4852 consensus_queue.cc:1048] T f68bd211ab4a49de8ad6de70a45d005a P 308ac45a3f334cdcac265c0cfbbc039b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:00.424074  4734 raft_consensus.cc:3060] T 4b35da8e30d245c5a00c054010005f9d P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:00.429065  4734 raft_consensus.cc:1275] T 4b35da8e30d245c5a00c054010005f9d P 308ac45a3f334cdcac265c0cfbbc039b [term 2 FOLLOWER]: Refusing update from remote peer c800c72b860f42878733b72fa57c227e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:00.430249  4808 consensus_queue.cc:1048] T 4b35da8e30d245c5a00c054010005f9d P c800c72b860f42878733b72fa57c227e [LEADER]: Connected to new peer: Peer: permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:00.436715  4585 raft_consensus.cc:1275] T 4b35da8e30d245c5a00c054010005f9d P ed488ca31ad54b53836e5a10d053b568 [term 2 FOLLOWER]: Refusing update from remote peer c800c72b860f42878733b72fa57c227e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:00.438169  4805 consensus_queue.cc:1048] T 4b35da8e30d245c5a00c054010005f9d P c800c72b860f42878733b72fa57c227e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:00.447646  4659 raft_consensus.cc:1275] T c437ad3104ee4400a2917a4e7c362efa P c800c72b860f42878733b72fa57c227e [term 2 FOLLOWER]: Refusing update from remote peer ed488ca31ad54b53836e5a10d053b568: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:00.448841  4855 consensus_queue.cc:1048] T c437ad3104ee4400a2917a4e7c362efa P ed488ca31ad54b53836e5a10d053b568 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:00.456748  4734 raft_consensus.cc:1275] T c437ad3104ee4400a2917a4e7c362efa P 308ac45a3f334cdcac265c0cfbbc039b [term 2 FOLLOWER]: Refusing update from remote peer ed488ca31ad54b53836e5a10d053b568: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:00.458388  4855 consensus_queue.cc:1048] T c437ad3104ee4400a2917a4e7c362efa P ed488ca31ad54b53836e5a10d053b568 [LEADER]: Connected to new peer: Peer: permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:02.710343  4482 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34394:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:02.712350  4482 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:02.759166  4573 tablet_service.cc:1511] Processing CreateTablet for tablet cd72c6318be5424f9c7a36d563d8cd32 (DEFAULT_TABLE table=soft_deleted_table [id=6be13d5630a24c88b897bbaa1fa581ac]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:02.760380  4573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd72c6318be5424f9c7a36d563d8cd32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:02.761602  4646 tablet_service.cc:1511] Processing CreateTablet for tablet cd72c6318be5424f9c7a36d563d8cd32 (DEFAULT_TABLE table=soft_deleted_table [id=6be13d5630a24c88b897bbaa1fa581ac]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:02.762919  4646 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd72c6318be5424f9c7a36d563d8cd32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:02.762959  4723 tablet_service.cc:1511] Processing CreateTablet for tablet cd72c6318be5424f9c7a36d563d8cd32 (DEFAULT_TABLE table=soft_deleted_table [id=6be13d5630a24c88b897bbaa1fa581ac]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:02.764292  4723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cd72c6318be5424f9c7a36d563d8cd32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:02.767444  4567 tablet_service.cc:1511] Processing CreateTablet for tablet 886cca6de3e54269a85c11555b07822f (DEFAULT_TABLE table=soft_deleted_table [id=6be13d5630a24c88b897bbaa1fa581ac]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:02.768710  4567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 886cca6de3e54269a85c11555b07822f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:02.768988  4647 tablet_service.cc:1511] Processing CreateTablet for tablet ad48d60224d54518b33057b28cbef56b (DEFAULT_TABLE table=soft_deleted_table [id=6be13d5630a24c88b897bbaa1fa581ac]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:02.769681  4724 tablet_service.cc:1511] Processing CreateTablet for tablet ad48d60224d54518b33057b28cbef56b (DEFAULT_TABLE table=soft_deleted_table [id=6be13d5630a24c88b897bbaa1fa581ac]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:02.770871  4724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad48d60224d54518b33057b28cbef56b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:02.770651  4572 tablet_service.cc:1511] Processing CreateTablet for tablet ad48d60224d54518b33057b28cbef56b (DEFAULT_TABLE table=soft_deleted_table [id=6be13d5630a24c88b897bbaa1fa581ac]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:02.771852  4572 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad48d60224d54518b33057b28cbef56b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:02.772667  4574 tablet_service.cc:1511] Processing CreateTablet for tablet bf723babacbc4c8887c87a9fe84d6992 (DEFAULT_TABLE table=soft_deleted_table [id=6be13d5630a24c88b897bbaa1fa581ac]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:02.773471  4647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ad48d60224d54518b33057b28cbef56b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:02.773854  4574 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf723babacbc4c8887c87a9fe84d6992. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:02.774015  4645 tablet_service.cc:1511] Processing CreateTablet for tablet 886cca6de3e54269a85c11555b07822f (DEFAULT_TABLE table=soft_deleted_table [id=6be13d5630a24c88b897bbaa1fa581ac]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:02.775190  4645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 886cca6de3e54269a85c11555b07822f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:02.776496  4643 tablet_service.cc:1511] Processing CreateTablet for tablet bf723babacbc4c8887c87a9fe84d6992 (DEFAULT_TABLE table=soft_deleted_table [id=6be13d5630a24c88b897bbaa1fa581ac]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:02.777698  4643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf723babacbc4c8887c87a9fe84d6992. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:02.767501  4717 tablet_service.cc:1511] Processing CreateTablet for tablet 886cca6de3e54269a85c11555b07822f (DEFAULT_TABLE table=soft_deleted_table [id=6be13d5630a24c88b897bbaa1fa581ac]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:02.779114  4717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 886cca6de3e54269a85c11555b07822f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:02.782768  4716 tablet_service.cc:1511] Processing CreateTablet for tablet bf723babacbc4c8887c87a9fe84d6992 (DEFAULT_TABLE table=soft_deleted_table [id=6be13d5630a24c88b897bbaa1fa581ac]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:02.784029  4716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf723babacbc4c8887c87a9fe84d6992. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:02.808360  4569 tablet_service.cc:1511] Processing CreateTablet for tablet 2d50b7657708498da25d2ca6b238746d (DEFAULT_TABLE table=soft_deleted_table [id=6be13d5630a24c88b897bbaa1fa581ac]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:02.810103  4569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d50b7657708498da25d2ca6b238746d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:02.816435  4642 tablet_service.cc:1511] Processing CreateTablet for tablet 2d50b7657708498da25d2ca6b238746d (DEFAULT_TABLE table=soft_deleted_table [id=6be13d5630a24c88b897bbaa1fa581ac]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:02.817939  4642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d50b7657708498da25d2ca6b238746d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:02.835625  4870 tablet_bootstrap.cc:492] T cd72c6318be5424f9c7a36d563d8cd32 P 308ac45a3f334cdcac265c0cfbbc039b: Bootstrap starting.
I20260709 13:13:02.838011  4568 tablet_service.cc:1511] Processing CreateTablet for tablet 1e6249d3f0d24da1955671f551e05009 (DEFAULT_TABLE table=soft_deleted_table [id=6be13d5630a24c88b897bbaa1fa581ac]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:02.838295  4717 tablet_service.cc:1511] Processing CreateTablet for tablet 2d50b7657708498da25d2ca6b238746d (DEFAULT_TABLE table=soft_deleted_table [id=6be13d5630a24c88b897bbaa1fa581ac]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:02.839318  4568 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e6249d3f0d24da1955671f551e05009. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:02.839947  4648 tablet_service.cc:1511] Processing CreateTablet for tablet 1e6249d3f0d24da1955671f551e05009 (DEFAULT_TABLE table=soft_deleted_table [id=6be13d5630a24c88b897bbaa1fa581ac]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:02.841120  4648 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e6249d3f0d24da1955671f551e05009. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:02.847929  4717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2d50b7657708498da25d2ca6b238746d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:02.859033  4723 tablet_service.cc:1511] Processing CreateTablet for tablet 1e6249d3f0d24da1955671f551e05009 (DEFAULT_TABLE table=soft_deleted_table [id=6be13d5630a24c88b897bbaa1fa581ac]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:02.860311  4723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e6249d3f0d24da1955671f551e05009. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:02.876857  4647 tablet_service.cc:1511] Processing CreateTablet for tablet 1c91359ff2954c87a2caee08711bd33e (DEFAULT_TABLE table=soft_deleted_table [id=6be13d5630a24c88b897bbaa1fa581ac]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:02.878294  4647 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c91359ff2954c87a2caee08711bd33e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:02.880461  4573 tablet_service.cc:1511] Processing CreateTablet for tablet 1c91359ff2954c87a2caee08711bd33e (DEFAULT_TABLE table=soft_deleted_table [id=6be13d5630a24c88b897bbaa1fa581ac]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:02.881937  4573 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c91359ff2954c87a2caee08711bd33e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:02.882207  4569 tablet_service.cc:1511] Processing CreateTablet for tablet fe8690eb51c946f282a28a9a065cf575 (DEFAULT_TABLE table=soft_deleted_table [id=6be13d5630a24c88b897bbaa1fa581ac]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:02.883378  4569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe8690eb51c946f282a28a9a065cf575. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:02.889011  4872 tablet_bootstrap.cc:492] T 886cca6de3e54269a85c11555b07822f P ed488ca31ad54b53836e5a10d053b568: Bootstrap starting.
I20260709 13:13:02.891189  4645 tablet_service.cc:1511] Processing CreateTablet for tablet fe8690eb51c946f282a28a9a065cf575 (DEFAULT_TABLE table=soft_deleted_table [id=6be13d5630a24c88b897bbaa1fa581ac]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:02.889739  4871 tablet_bootstrap.cc:492] T ad48d60224d54518b33057b28cbef56b P c800c72b860f42878733b72fa57c227e: Bootstrap starting.
I20260709 13:13:02.892515  4645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe8690eb51c946f282a28a9a065cf575. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:02.895165  4870 tablet_bootstrap.cc:654] T cd72c6318be5424f9c7a36d563d8cd32 P 308ac45a3f334cdcac265c0cfbbc039b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:02.901525  4717 tablet_service.cc:1511] Processing CreateTablet for tablet 1c91359ff2954c87a2caee08711bd33e (DEFAULT_TABLE table=soft_deleted_table [id=6be13d5630a24c88b897bbaa1fa581ac]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:02.907437  4871 tablet_bootstrap.cc:654] T ad48d60224d54518b33057b28cbef56b P c800c72b860f42878733b72fa57c227e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:02.919504  4723 tablet_service.cc:1511] Processing CreateTablet for tablet 5e58e02271134e058cd0af272aa9be5b (DEFAULT_TABLE table=soft_deleted_table [id=6be13d5630a24c88b897bbaa1fa581ac]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:02.920588  4716 tablet_service.cc:1511] Processing CreateTablet for tablet fe8690eb51c946f282a28a9a065cf575 (DEFAULT_TABLE table=soft_deleted_table [id=6be13d5630a24c88b897bbaa1fa581ac]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:02.920766  4643 tablet_service.cc:1511] Processing CreateTablet for tablet 5e58e02271134e058cd0af272aa9be5b (DEFAULT_TABLE table=soft_deleted_table [id=6be13d5630a24c88b897bbaa1fa581ac]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:02.907840  4717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c91359ff2954c87a2caee08711bd33e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:02.921993  4643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e58e02271134e058cd0af272aa9be5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:02.923034  4716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe8690eb51c946f282a28a9a065cf575. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:02.904820  4872 tablet_bootstrap.cc:654] T 886cca6de3e54269a85c11555b07822f P ed488ca31ad54b53836e5a10d053b568: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:02.924494  4723 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e58e02271134e058cd0af272aa9be5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:02.919627  4567 tablet_service.cc:1511] Processing CreateTablet for tablet 5e58e02271134e058cd0af272aa9be5b (DEFAULT_TABLE table=soft_deleted_table [id=6be13d5630a24c88b897bbaa1fa581ac]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:02.930728  4567 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e58e02271134e058cd0af272aa9be5b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:02.980839  4872 tablet_bootstrap.cc:492] T 886cca6de3e54269a85c11555b07822f P ed488ca31ad54b53836e5a10d053b568: No bootstrap required, opened a new log
I20260709 13:13:02.981314  4872 ts_tablet_manager.cc:1403] T 886cca6de3e54269a85c11555b07822f P ed488ca31ad54b53836e5a10d053b568: Time spent bootstrapping tablet: real 0.093s	user 0.012s	sys 0.018s
I20260709 13:13:02.982299  4870 tablet_bootstrap.cc:492] T cd72c6318be5424f9c7a36d563d8cd32 P 308ac45a3f334cdcac265c0cfbbc039b: No bootstrap required, opened a new log
I20260709 13:13:02.982860  4870 ts_tablet_manager.cc:1403] T cd72c6318be5424f9c7a36d563d8cd32 P 308ac45a3f334cdcac265c0cfbbc039b: Time spent bootstrapping tablet: real 0.147s	user 0.007s	sys 0.008s
I20260709 13:13:02.984130  4872 raft_consensus.cc:359] T 886cca6de3e54269a85c11555b07822f P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:02.985029  4872 raft_consensus.cc:385] T 886cca6de3e54269a85c11555b07822f P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:02.985334  4872 raft_consensus.cc:740] T 886cca6de3e54269a85c11555b07822f P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed488ca31ad54b53836e5a10d053b568, State: Initialized, Role: FOLLOWER
I20260709 13:13:02.986295  4871 tablet_bootstrap.cc:492] T ad48d60224d54518b33057b28cbef56b P c800c72b860f42878733b72fa57c227e: No bootstrap required, opened a new log
I20260709 13:13:02.986133  4872 consensus_queue.cc:260] T 886cca6de3e54269a85c11555b07822f P ed488ca31ad54b53836e5a10d053b568 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:02.988031  4871 ts_tablet_manager.cc:1403] T ad48d60224d54518b33057b28cbef56b P c800c72b860f42878733b72fa57c227e: Time spent bootstrapping tablet: real 0.099s	user 0.026s	sys 0.025s
I20260709 13:13:02.989431  4872 ts_tablet_manager.cc:1434] T 886cca6de3e54269a85c11555b07822f P ed488ca31ad54b53836e5a10d053b568: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:13:02.990484  4872 tablet_bootstrap.cc:492] T bf723babacbc4c8887c87a9fe84d6992 P ed488ca31ad54b53836e5a10d053b568: Bootstrap starting.
I20260709 13:13:02.990957  4871 raft_consensus.cc:359] T ad48d60224d54518b33057b28cbef56b P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:02.991705  4871 raft_consensus.cc:385] T ad48d60224d54518b33057b28cbef56b P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:02.991994  4871 raft_consensus.cc:740] T ad48d60224d54518b33057b28cbef56b P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c800c72b860f42878733b72fa57c227e, State: Initialized, Role: FOLLOWER
I20260709 13:13:02.987301  4870 raft_consensus.cc:359] T cd72c6318be5424f9c7a36d563d8cd32 P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:02.992461  4870 raft_consensus.cc:385] T cd72c6318be5424f9c7a36d563d8cd32 P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:02.992766  4870 raft_consensus.cc:740] T cd72c6318be5424f9c7a36d563d8cd32 P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 308ac45a3f334cdcac265c0cfbbc039b, State: Initialized, Role: FOLLOWER
I20260709 13:13:02.992846  4871 consensus_queue.cc:260] T ad48d60224d54518b33057b28cbef56b P c800c72b860f42878733b72fa57c227e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:02.994120  4870 consensus_queue.cc:260] T cd72c6318be5424f9c7a36d563d8cd32 P 308ac45a3f334cdcac265c0cfbbc039b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:02.995265  4871 ts_tablet_manager.cc:1434] T ad48d60224d54518b33057b28cbef56b P c800c72b860f42878733b72fa57c227e: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:02.996327  4871 tablet_bootstrap.cc:492] T cd72c6318be5424f9c7a36d563d8cd32 P c800c72b860f42878733b72fa57c227e: Bootstrap starting.
I20260709 13:13:02.996331  4870 ts_tablet_manager.cc:1434] T cd72c6318be5424f9c7a36d563d8cd32 P 308ac45a3f334cdcac265c0cfbbc039b: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 13:13:02.998652  4870 tablet_bootstrap.cc:492] T ad48d60224d54518b33057b28cbef56b P 308ac45a3f334cdcac265c0cfbbc039b: Bootstrap starting.
I20260709 13:13:03.000646  4872 tablet_bootstrap.cc:654] T bf723babacbc4c8887c87a9fe84d6992 P ed488ca31ad54b53836e5a10d053b568: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:03.004863  4870 tablet_bootstrap.cc:654] T ad48d60224d54518b33057b28cbef56b P 308ac45a3f334cdcac265c0cfbbc039b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:03.006505  4872 tablet_bootstrap.cc:492] T bf723babacbc4c8887c87a9fe84d6992 P ed488ca31ad54b53836e5a10d053b568: No bootstrap required, opened a new log
I20260709 13:13:03.007051  4872 ts_tablet_manager.cc:1403] T bf723babacbc4c8887c87a9fe84d6992 P ed488ca31ad54b53836e5a10d053b568: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.004s
I20260709 13:13:03.010237  4871 tablet_bootstrap.cc:654] T cd72c6318be5424f9c7a36d563d8cd32 P c800c72b860f42878733b72fa57c227e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:03.010017  4872 raft_consensus.cc:359] T bf723babacbc4c8887c87a9fe84d6992 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.010777  4872 raft_consensus.cc:385] T bf723babacbc4c8887c87a9fe84d6992 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:03.011099  4872 raft_consensus.cc:740] T bf723babacbc4c8887c87a9fe84d6992 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed488ca31ad54b53836e5a10d053b568, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.011898  4872 consensus_queue.cc:260] T bf723babacbc4c8887c87a9fe84d6992 P ed488ca31ad54b53836e5a10d053b568 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.014366  4872 ts_tablet_manager.cc:1434] T bf723babacbc4c8887c87a9fe84d6992 P ed488ca31ad54b53836e5a10d053b568: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:03.015309  4872 tablet_bootstrap.cc:492] T ad48d60224d54518b33057b28cbef56b P ed488ca31ad54b53836e5a10d053b568: Bootstrap starting.
I20260709 13:13:03.019699  4870 tablet_bootstrap.cc:492] T ad48d60224d54518b33057b28cbef56b P 308ac45a3f334cdcac265c0cfbbc039b: No bootstrap required, opened a new log
I20260709 13:13:03.020336  4870 ts_tablet_manager.cc:1403] T ad48d60224d54518b33057b28cbef56b P 308ac45a3f334cdcac265c0cfbbc039b: Time spent bootstrapping tablet: real 0.022s	user 0.000s	sys 0.017s
I20260709 13:13:03.021399  4872 tablet_bootstrap.cc:654] T ad48d60224d54518b33057b28cbef56b P ed488ca31ad54b53836e5a10d053b568: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:03.023641  4870 raft_consensus.cc:359] T ad48d60224d54518b33057b28cbef56b P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.025030  4870 raft_consensus.cc:385] T ad48d60224d54518b33057b28cbef56b P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:03.025398  4870 raft_consensus.cc:740] T ad48d60224d54518b33057b28cbef56b P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 308ac45a3f334cdcac265c0cfbbc039b, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.026358  4870 consensus_queue.cc:260] T ad48d60224d54518b33057b28cbef56b P 308ac45a3f334cdcac265c0cfbbc039b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.028981  4870 ts_tablet_manager.cc:1434] T ad48d60224d54518b33057b28cbef56b P 308ac45a3f334cdcac265c0cfbbc039b: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:13:03.032038  4871 tablet_bootstrap.cc:492] T cd72c6318be5424f9c7a36d563d8cd32 P c800c72b860f42878733b72fa57c227e: No bootstrap required, opened a new log
I20260709 13:13:03.032545  4871 ts_tablet_manager.cc:1403] T cd72c6318be5424f9c7a36d563d8cd32 P c800c72b860f42878733b72fa57c227e: Time spent bootstrapping tablet: real 0.036s	user 0.012s	sys 0.015s
I20260709 13:13:03.032670  4870 tablet_bootstrap.cc:492] T 886cca6de3e54269a85c11555b07822f P 308ac45a3f334cdcac265c0cfbbc039b: Bootstrap starting.
I20260709 13:13:03.035553  4871 raft_consensus.cc:359] T cd72c6318be5424f9c7a36d563d8cd32 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.036298  4871 raft_consensus.cc:385] T cd72c6318be5424f9c7a36d563d8cd32 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:03.036661  4871 raft_consensus.cc:740] T cd72c6318be5424f9c7a36d563d8cd32 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c800c72b860f42878733b72fa57c227e, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.037463  4871 consensus_queue.cc:260] T cd72c6318be5424f9c7a36d563d8cd32 P c800c72b860f42878733b72fa57c227e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.039718  4871 ts_tablet_manager.cc:1434] T cd72c6318be5424f9c7a36d563d8cd32 P c800c72b860f42878733b72fa57c227e: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 13:13:03.040256  4817 raft_consensus.cc:493] T 886cca6de3e54269a85c11555b07822f P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.040786  4817 raft_consensus.cc:515] T 886cca6de3e54269a85c11555b07822f P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.042732  4817 leader_election.cc:290] T 886cca6de3e54269a85c11555b07822f P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c800c72b860f42878733b72fa57c227e (127.28.54.66:43707), 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965)
I20260709 13:13:03.043495  4659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "886cca6de3e54269a85c11555b07822f" candidate_uuid: "ed488ca31ad54b53836e5a10d053b568" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c800c72b860f42878733b72fa57c227e" is_pre_election: true
I20260709 13:13:03.044559  4871 tablet_bootstrap.cc:492] T 2d50b7657708498da25d2ca6b238746d P c800c72b860f42878733b72fa57c227e: Bootstrap starting.
W20260709 13:13:03.045176  4550 leader_election.cc:343] T 886cca6de3e54269a85c11555b07822f P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c800c72b860f42878733b72fa57c227e (127.28.54.66:43707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:03.051839  4871 tablet_bootstrap.cc:654] T 2d50b7657708498da25d2ca6b238746d P c800c72b860f42878733b72fa57c227e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:03.058409  4870 tablet_bootstrap.cc:654] T 886cca6de3e54269a85c11555b07822f P 308ac45a3f334cdcac265c0cfbbc039b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:03.061560  4872 tablet_bootstrap.cc:492] T ad48d60224d54518b33057b28cbef56b P ed488ca31ad54b53836e5a10d053b568: No bootstrap required, opened a new log
I20260709 13:13:03.062147  4872 ts_tablet_manager.cc:1403] T ad48d60224d54518b33057b28cbef56b P ed488ca31ad54b53836e5a10d053b568: Time spent bootstrapping tablet: real 0.047s	user 0.020s	sys 0.024s
I20260709 13:13:03.065160  4872 raft_consensus.cc:359] T ad48d60224d54518b33057b28cbef56b P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.065671  4872 raft_consensus.cc:385] T ad48d60224d54518b33057b28cbef56b P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:03.066020  4872 raft_consensus.cc:740] T ad48d60224d54518b33057b28cbef56b P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed488ca31ad54b53836e5a10d053b568, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.066689  4871 tablet_bootstrap.cc:492] T 2d50b7657708498da25d2ca6b238746d P c800c72b860f42878733b72fa57c227e: No bootstrap required, opened a new log
I20260709 13:13:03.066715  4732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "886cca6de3e54269a85c11555b07822f" candidate_uuid: "ed488ca31ad54b53836e5a10d053b568" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b" is_pre_election: true
I20260709 13:13:03.067440  4871 ts_tablet_manager.cc:1403] T 2d50b7657708498da25d2ca6b238746d P c800c72b860f42878733b72fa57c227e: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.004s
I20260709 13:13:03.066901  4872 consensus_queue.cc:260] T ad48d60224d54518b33057b28cbef56b P ed488ca31ad54b53836e5a10d053b568 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.068454  4870 tablet_bootstrap.cc:492] T 886cca6de3e54269a85c11555b07822f P 308ac45a3f334cdcac265c0cfbbc039b: No bootstrap required, opened a new log
I20260709 13:13:03.068985  4870 ts_tablet_manager.cc:1403] T 886cca6de3e54269a85c11555b07822f P 308ac45a3f334cdcac265c0cfbbc039b: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.000s
I20260709 13:13:03.069406  4872 ts_tablet_manager.cc:1434] T ad48d60224d54518b33057b28cbef56b P ed488ca31ad54b53836e5a10d053b568: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.005s
I20260709 13:13:03.070513  4872 tablet_bootstrap.cc:492] T cd72c6318be5424f9c7a36d563d8cd32 P ed488ca31ad54b53836e5a10d053b568: Bootstrap starting.
I20260709 13:13:03.070508  4871 raft_consensus.cc:359] T 2d50b7657708498da25d2ca6b238746d P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.071447  4871 raft_consensus.cc:385] T 2d50b7657708498da25d2ca6b238746d P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:03.071780  4871 raft_consensus.cc:740] T 2d50b7657708498da25d2ca6b238746d P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c800c72b860f42878733b72fa57c227e, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.075393  4871 consensus_queue.cc:260] T 2d50b7657708498da25d2ca6b238746d P c800c72b860f42878733b72fa57c227e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.071730  4870 raft_consensus.cc:359] T 886cca6de3e54269a85c11555b07822f P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.077142  4870 raft_consensus.cc:385] T 886cca6de3e54269a85c11555b07822f P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:03.077363  4872 tablet_bootstrap.cc:654] T cd72c6318be5424f9c7a36d563d8cd32 P ed488ca31ad54b53836e5a10d053b568: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:03.077491  4870 raft_consensus.cc:740] T 886cca6de3e54269a85c11555b07822f P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 308ac45a3f334cdcac265c0cfbbc039b, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.079799  4871 ts_tablet_manager.cc:1434] T 2d50b7657708498da25d2ca6b238746d P c800c72b860f42878733b72fa57c227e: Time spent starting tablet: real 0.012s	user 0.002s	sys 0.004s
I20260709 13:13:03.080840  4871 tablet_bootstrap.cc:492] T 886cca6de3e54269a85c11555b07822f P c800c72b860f42878733b72fa57c227e: Bootstrap starting.
I20260709 13:13:03.082274  4870 consensus_queue.cc:260] T 886cca6de3e54269a85c11555b07822f P 308ac45a3f334cdcac265c0cfbbc039b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.084808  4870 ts_tablet_manager.cc:1434] T 886cca6de3e54269a85c11555b07822f P 308ac45a3f334cdcac265c0cfbbc039b: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:13:03.085903  4870 tablet_bootstrap.cc:492] T 2d50b7657708498da25d2ca6b238746d P 308ac45a3f334cdcac265c0cfbbc039b: Bootstrap starting.
I20260709 13:13:03.088860  4872 tablet_bootstrap.cc:492] T cd72c6318be5424f9c7a36d563d8cd32 P ed488ca31ad54b53836e5a10d053b568: No bootstrap required, opened a new log
I20260709 13:13:03.089483  4872 ts_tablet_manager.cc:1403] T cd72c6318be5424f9c7a36d563d8cd32 P ed488ca31ad54b53836e5a10d053b568: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.009s
I20260709 13:13:03.090185  4871 tablet_bootstrap.cc:654] T 886cca6de3e54269a85c11555b07822f P c800c72b860f42878733b72fa57c227e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:03.092100  4870 tablet_bootstrap.cc:654] T 2d50b7657708498da25d2ca6b238746d P 308ac45a3f334cdcac265c0cfbbc039b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:03.092329  4872 raft_consensus.cc:359] T cd72c6318be5424f9c7a36d563d8cd32 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.093218  4872 raft_consensus.cc:385] T cd72c6318be5424f9c7a36d563d8cd32 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:03.093562  4872 raft_consensus.cc:740] T cd72c6318be5424f9c7a36d563d8cd32 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed488ca31ad54b53836e5a10d053b568, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.094485  4872 consensus_queue.cc:260] T cd72c6318be5424f9c7a36d563d8cd32 P ed488ca31ad54b53836e5a10d053b568 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.096871  4872 ts_tablet_manager.cc:1434] T cd72c6318be5424f9c7a36d563d8cd32 P ed488ca31ad54b53836e5a10d053b568: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:03.098279  4872 tablet_bootstrap.cc:492] T 2d50b7657708498da25d2ca6b238746d P ed488ca31ad54b53836e5a10d053b568: Bootstrap starting.
I20260709 13:13:03.103615  4870 tablet_bootstrap.cc:492] T 2d50b7657708498da25d2ca6b238746d P 308ac45a3f334cdcac265c0cfbbc039b: No bootstrap required, opened a new log
I20260709 13:13:03.104221  4870 ts_tablet_manager.cc:1403] T 2d50b7657708498da25d2ca6b238746d P 308ac45a3f334cdcac265c0cfbbc039b: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 13:13:03.104524  4872 tablet_bootstrap.cc:654] T 2d50b7657708498da25d2ca6b238746d P ed488ca31ad54b53836e5a10d053b568: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:03.105226  4871 tablet_bootstrap.cc:492] T 886cca6de3e54269a85c11555b07822f P c800c72b860f42878733b72fa57c227e: No bootstrap required, opened a new log
I20260709 13:13:03.106315  4871 ts_tablet_manager.cc:1403] T 886cca6de3e54269a85c11555b07822f P c800c72b860f42878733b72fa57c227e: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.008s
I20260709 13:13:03.107133  4870 raft_consensus.cc:359] T 2d50b7657708498da25d2ca6b238746d P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.108166  4870 raft_consensus.cc:385] T 2d50b7657708498da25d2ca6b238746d P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:03.109414  4871 raft_consensus.cc:359] T 886cca6de3e54269a85c11555b07822f P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.110252  4871 raft_consensus.cc:385] T 886cca6de3e54269a85c11555b07822f P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 13:13:03.110363  4548 leader_election.cc:343] T 886cca6de3e54269a85c11555b07822f P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:03.110625  4871 raft_consensus.cc:740] T 886cca6de3e54269a85c11555b07822f P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c800c72b860f42878733b72fa57c227e, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.110927  4548 leader_election.cc:304] T 886cca6de3e54269a85c11555b07822f P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ed488ca31ad54b53836e5a10d053b568; no voters: 308ac45a3f334cdcac265c0cfbbc039b, c800c72b860f42878733b72fa57c227e
I20260709 13:13:03.111598  4871 consensus_queue.cc:260] T 886cca6de3e54269a85c11555b07822f P c800c72b860f42878733b72fa57c227e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.108515  4870 raft_consensus.cc:740] T 2d50b7657708498da25d2ca6b238746d P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 308ac45a3f334cdcac265c0cfbbc039b, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.113706  4870 consensus_queue.cc:260] T 2d50b7657708498da25d2ca6b238746d P 308ac45a3f334cdcac265c0cfbbc039b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.114624  4817 raft_consensus.cc:2749] T 886cca6de3e54269a85c11555b07822f P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:03.116158  4870 ts_tablet_manager.cc:1434] T 2d50b7657708498da25d2ca6b238746d P 308ac45a3f334cdcac265c0cfbbc039b: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:13:03.118714  4871 ts_tablet_manager.cc:1434] T 886cca6de3e54269a85c11555b07822f P c800c72b860f42878733b72fa57c227e: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.001s
I20260709 13:13:03.119663  4870 tablet_bootstrap.cc:492] T bf723babacbc4c8887c87a9fe84d6992 P 308ac45a3f334cdcac265c0cfbbc039b: Bootstrap starting.
I20260709 13:13:03.119825  4871 tablet_bootstrap.cc:492] T 1e6249d3f0d24da1955671f551e05009 P c800c72b860f42878733b72fa57c227e: Bootstrap starting.
I20260709 13:13:03.127053  4871 tablet_bootstrap.cc:654] T 1e6249d3f0d24da1955671f551e05009 P c800c72b860f42878733b72fa57c227e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:03.127067  4870 tablet_bootstrap.cc:654] T bf723babacbc4c8887c87a9fe84d6992 P 308ac45a3f334cdcac265c0cfbbc039b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:03.129609  4872 tablet_bootstrap.cc:492] T 2d50b7657708498da25d2ca6b238746d P ed488ca31ad54b53836e5a10d053b568: No bootstrap required, opened a new log
I20260709 13:13:03.130213  4872 ts_tablet_manager.cc:1403] T 2d50b7657708498da25d2ca6b238746d P ed488ca31ad54b53836e5a10d053b568: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.021s
I20260709 13:13:03.133371  4872 raft_consensus.cc:359] T 2d50b7657708498da25d2ca6b238746d P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.134171  4872 raft_consensus.cc:385] T 2d50b7657708498da25d2ca6b238746d P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:03.134539  4872 raft_consensus.cc:740] T 2d50b7657708498da25d2ca6b238746d P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed488ca31ad54b53836e5a10d053b568, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.135308  4872 consensus_queue.cc:260] T 2d50b7657708498da25d2ca6b238746d P ed488ca31ad54b53836e5a10d053b568 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.136415  4870 tablet_bootstrap.cc:492] T bf723babacbc4c8887c87a9fe84d6992 P 308ac45a3f334cdcac265c0cfbbc039b: No bootstrap required, opened a new log
I20260709 13:13:03.136998  4870 ts_tablet_manager.cc:1403] T bf723babacbc4c8887c87a9fe84d6992 P 308ac45a3f334cdcac265c0cfbbc039b: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.003s
I20260709 13:13:03.137557  4872 ts_tablet_manager.cc:1434] T 2d50b7657708498da25d2ca6b238746d P ed488ca31ad54b53836e5a10d053b568: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 13:13:03.138660  4872 tablet_bootstrap.cc:492] T 1e6249d3f0d24da1955671f551e05009 P ed488ca31ad54b53836e5a10d053b568: Bootstrap starting.
I20260709 13:13:03.139923  4870 raft_consensus.cc:359] T bf723babacbc4c8887c87a9fe84d6992 P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.141161  4870 raft_consensus.cc:385] T bf723babacbc4c8887c87a9fe84d6992 P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:03.141498  4870 raft_consensus.cc:740] T bf723babacbc4c8887c87a9fe84d6992 P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 308ac45a3f334cdcac265c0cfbbc039b, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.142279  4870 consensus_queue.cc:260] T bf723babacbc4c8887c87a9fe84d6992 P 308ac45a3f334cdcac265c0cfbbc039b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.143376  4871 tablet_bootstrap.cc:492] T 1e6249d3f0d24da1955671f551e05009 P c800c72b860f42878733b72fa57c227e: No bootstrap required, opened a new log
I20260709 13:13:03.143935  4871 ts_tablet_manager.cc:1403] T 1e6249d3f0d24da1955671f551e05009 P c800c72b860f42878733b72fa57c227e: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.010s
I20260709 13:13:03.144505  4870 ts_tablet_manager.cc:1434] T bf723babacbc4c8887c87a9fe84d6992 P 308ac45a3f334cdcac265c0cfbbc039b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:03.145467  4872 tablet_bootstrap.cc:654] T 1e6249d3f0d24da1955671f551e05009 P ed488ca31ad54b53836e5a10d053b568: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:03.145483  4870 tablet_bootstrap.cc:492] T 1e6249d3f0d24da1955671f551e05009 P 308ac45a3f334cdcac265c0cfbbc039b: Bootstrap starting.
I20260709 13:13:03.146931  4871 raft_consensus.cc:359] T 1e6249d3f0d24da1955671f551e05009 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.147657  4871 raft_consensus.cc:385] T 1e6249d3f0d24da1955671f551e05009 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:03.148005  4871 raft_consensus.cc:740] T 1e6249d3f0d24da1955671f551e05009 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c800c72b860f42878733b72fa57c227e, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.148823  4871 consensus_queue.cc:260] T 1e6249d3f0d24da1955671f551e05009 P c800c72b860f42878733b72fa57c227e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.154537  4871 ts_tablet_manager.cc:1434] T 1e6249d3f0d24da1955671f551e05009 P c800c72b860f42878733b72fa57c227e: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:13:03.155673  4871 tablet_bootstrap.cc:492] T bf723babacbc4c8887c87a9fe84d6992 P c800c72b860f42878733b72fa57c227e: Bootstrap starting.
I20260709 13:13:03.160082  4870 tablet_bootstrap.cc:654] T 1e6249d3f0d24da1955671f551e05009 P 308ac45a3f334cdcac265c0cfbbc039b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:03.162569  4871 tablet_bootstrap.cc:654] T bf723babacbc4c8887c87a9fe84d6992 P c800c72b860f42878733b72fa57c227e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:03.165484  4872 tablet_bootstrap.cc:492] T 1e6249d3f0d24da1955671f551e05009 P ed488ca31ad54b53836e5a10d053b568: No bootstrap required, opened a new log
I20260709 13:13:03.166033  4872 ts_tablet_manager.cc:1403] T 1e6249d3f0d24da1955671f551e05009 P ed488ca31ad54b53836e5a10d053b568: Time spent bootstrapping tablet: real 0.028s	user 0.019s	sys 0.008s
I20260709 13:13:03.169157  4872 raft_consensus.cc:359] T 1e6249d3f0d24da1955671f551e05009 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.169898  4872 raft_consensus.cc:385] T 1e6249d3f0d24da1955671f551e05009 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:03.170186  4872 raft_consensus.cc:740] T 1e6249d3f0d24da1955671f551e05009 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed488ca31ad54b53836e5a10d053b568, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.170897  4872 consensus_queue.cc:260] T 1e6249d3f0d24da1955671f551e05009 P ed488ca31ad54b53836e5a10d053b568 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.173183  4872 ts_tablet_manager.cc:1434] T 1e6249d3f0d24da1955671f551e05009 P ed488ca31ad54b53836e5a10d053b568: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 13:13:03.175168  4872 tablet_bootstrap.cc:492] T 1c91359ff2954c87a2caee08711bd33e P ed488ca31ad54b53836e5a10d053b568: Bootstrap starting.
I20260709 13:13:03.181098  4870 tablet_bootstrap.cc:492] T 1e6249d3f0d24da1955671f551e05009 P 308ac45a3f334cdcac265c0cfbbc039b: No bootstrap required, opened a new log
I20260709 13:13:03.181090  4872 tablet_bootstrap.cc:654] T 1c91359ff2954c87a2caee08711bd33e P ed488ca31ad54b53836e5a10d053b568: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:03.181707  4870 ts_tablet_manager.cc:1403] T 1e6249d3f0d24da1955671f551e05009 P 308ac45a3f334cdcac265c0cfbbc039b: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.010s
I20260709 13:13:03.183648  4871 tablet_bootstrap.cc:492] T bf723babacbc4c8887c87a9fe84d6992 P c800c72b860f42878733b72fa57c227e: No bootstrap required, opened a new log
I20260709 13:13:03.184137  4871 ts_tablet_manager.cc:1403] T bf723babacbc4c8887c87a9fe84d6992 P c800c72b860f42878733b72fa57c227e: Time spent bootstrapping tablet: real 0.029s	user 0.017s	sys 0.006s
I20260709 13:13:03.185034  4870 raft_consensus.cc:359] T 1e6249d3f0d24da1955671f551e05009 P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.185901  4870 raft_consensus.cc:385] T 1e6249d3f0d24da1955671f551e05009 P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:03.186229  4870 raft_consensus.cc:740] T 1e6249d3f0d24da1955671f551e05009 P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 308ac45a3f334cdcac265c0cfbbc039b, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.186848  4890 raft_consensus.cc:493] T 2d50b7657708498da25d2ca6b238746d P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.187011  4870 consensus_queue.cc:260] T 1e6249d3f0d24da1955671f551e05009 P 308ac45a3f334cdcac265c0cfbbc039b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.187031  4871 raft_consensus.cc:359] T bf723babacbc4c8887c87a9fe84d6992 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.187307  4890 raft_consensus.cc:515] T 2d50b7657708498da25d2ca6b238746d P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.187961  4871 raft_consensus.cc:385] T bf723babacbc4c8887c87a9fe84d6992 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:03.188294  4871 raft_consensus.cc:740] T bf723babacbc4c8887c87a9fe84d6992 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c800c72b860f42878733b72fa57c227e, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.188993  4871 consensus_queue.cc:260] T bf723babacbc4c8887c87a9fe84d6992 P c800c72b860f42878733b72fa57c227e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.189429  4870 ts_tablet_manager.cc:1434] T 1e6249d3f0d24da1955671f551e05009 P 308ac45a3f334cdcac265c0cfbbc039b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:03.190551  4870 tablet_bootstrap.cc:492] T 1c91359ff2954c87a2caee08711bd33e P 308ac45a3f334cdcac265c0cfbbc039b: Bootstrap starting.
I20260709 13:13:03.189432  4890 leader_election.cc:290] T 2d50b7657708498da25d2ca6b238746d P c800c72b860f42878733b72fa57c227e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed488ca31ad54b53836e5a10d053b568 (127.28.54.65:36419), 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965)
I20260709 13:13:03.191285  4732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d50b7657708498da25d2ca6b238746d" candidate_uuid: "c800c72b860f42878733b72fa57c227e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b" is_pre_election: true
I20260709 13:13:03.191982  4732 raft_consensus.cc:2468] T 2d50b7657708498da25d2ca6b238746d P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c800c72b860f42878733b72fa57c227e in term 0.
I20260709 13:13:03.192734  4584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d50b7657708498da25d2ca6b238746d" candidate_uuid: "c800c72b860f42878733b72fa57c227e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed488ca31ad54b53836e5a10d053b568" is_pre_election: true
I20260709 13:13:03.193383  4584 raft_consensus.cc:2468] T 2d50b7657708498da25d2ca6b238746d P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c800c72b860f42878733b72fa57c227e in term 0.
I20260709 13:13:03.193393  4623 leader_election.cc:304] T 2d50b7657708498da25d2ca6b238746d P c800c72b860f42878733b72fa57c227e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 308ac45a3f334cdcac265c0cfbbc039b, c800c72b860f42878733b72fa57c227e; no voters: 
I20260709 13:13:03.194450  4890 raft_consensus.cc:2804] T 2d50b7657708498da25d2ca6b238746d P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:03.194806  4890 raft_consensus.cc:493] T 2d50b7657708498da25d2ca6b238746d P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:03.195145  4890 raft_consensus.cc:3060] T 2d50b7657708498da25d2ca6b238746d P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:03.196367  4871 ts_tablet_manager.cc:1434] T bf723babacbc4c8887c87a9fe84d6992 P c800c72b860f42878733b72fa57c227e: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.004s
I20260709 13:13:03.197341  4871 tablet_bootstrap.cc:492] T 1c91359ff2954c87a2caee08711bd33e P c800c72b860f42878733b72fa57c227e: Bootstrap starting.
I20260709 13:13:03.198151  4870 tablet_bootstrap.cc:654] T 1c91359ff2954c87a2caee08711bd33e P 308ac45a3f334cdcac265c0cfbbc039b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:03.204170  4871 tablet_bootstrap.cc:654] T 1c91359ff2954c87a2caee08711bd33e P c800c72b860f42878733b72fa57c227e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:03.208527  4872 tablet_bootstrap.cc:492] T 1c91359ff2954c87a2caee08711bd33e P ed488ca31ad54b53836e5a10d053b568: No bootstrap required, opened a new log
I20260709 13:13:03.209100  4872 ts_tablet_manager.cc:1403] T 1c91359ff2954c87a2caee08711bd33e P ed488ca31ad54b53836e5a10d053b568: Time spent bootstrapping tablet: real 0.034s	user 0.021s	sys 0.002s
I20260709 13:13:03.212033  4872 raft_consensus.cc:359] T 1c91359ff2954c87a2caee08711bd33e P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.212709  4872 raft_consensus.cc:385] T 1c91359ff2954c87a2caee08711bd33e P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:03.212903  4890 raft_consensus.cc:515] T 2d50b7657708498da25d2ca6b238746d P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.213721  4870 tablet_bootstrap.cc:492] T 1c91359ff2954c87a2caee08711bd33e P 308ac45a3f334cdcac265c0cfbbc039b: No bootstrap required, opened a new log
I20260709 13:13:03.213003  4872 raft_consensus.cc:740] T 1c91359ff2954c87a2caee08711bd33e P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed488ca31ad54b53836e5a10d053b568, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.214433  4870 ts_tablet_manager.cc:1403] T 1c91359ff2954c87a2caee08711bd33e P 308ac45a3f334cdcac265c0cfbbc039b: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.010s
I20260709 13:13:03.214990  4872 consensus_queue.cc:260] T 1c91359ff2954c87a2caee08711bd33e P ed488ca31ad54b53836e5a10d053b568 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.215628  4584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d50b7657708498da25d2ca6b238746d" candidate_uuid: "c800c72b860f42878733b72fa57c227e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed488ca31ad54b53836e5a10d053b568"
I20260709 13:13:03.216204  4584 raft_consensus.cc:3060] T 2d50b7657708498da25d2ca6b238746d P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:03.217499  4870 raft_consensus.cc:359] T 1c91359ff2954c87a2caee08711bd33e P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.218308  4870 raft_consensus.cc:385] T 1c91359ff2954c87a2caee08711bd33e P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:03.218595  4870 raft_consensus.cc:740] T 1c91359ff2954c87a2caee08711bd33e P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 308ac45a3f334cdcac265c0cfbbc039b, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.220590  4872 ts_tablet_manager.cc:1434] T 1c91359ff2954c87a2caee08711bd33e P ed488ca31ad54b53836e5a10d053b568: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:13:03.221652  4872 tablet_bootstrap.cc:492] T fe8690eb51c946f282a28a9a065cf575 P ed488ca31ad54b53836e5a10d053b568: Bootstrap starting.
I20260709 13:13:03.222916  4584 raft_consensus.cc:2468] T 2d50b7657708498da25d2ca6b238746d P ed488ca31ad54b53836e5a10d053b568 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c800c72b860f42878733b72fa57c227e in term 1.
I20260709 13:13:03.224063  4625 leader_election.cc:304] T 2d50b7657708498da25d2ca6b238746d P c800c72b860f42878733b72fa57c227e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c800c72b860f42878733b72fa57c227e, ed488ca31ad54b53836e5a10d053b568; no voters: 
I20260709 13:13:03.224915  4783 raft_consensus.cc:2804] T 2d50b7657708498da25d2ca6b238746d P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:03.227103  4880 raft_consensus.cc:493] T cd72c6318be5424f9c7a36d563d8cd32 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.227589  4880 raft_consensus.cc:515] T cd72c6318be5424f9c7a36d563d8cd32 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.228070  4872 tablet_bootstrap.cc:654] T fe8690eb51c946f282a28a9a065cf575 P ed488ca31ad54b53836e5a10d053b568: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:03.230892  4732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd72c6318be5424f9c7a36d563d8cd32" candidate_uuid: "ed488ca31ad54b53836e5a10d053b568" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b" is_pre_election: true
I20260709 13:13:03.231225  4870 consensus_queue.cc:260] T 1c91359ff2954c87a2caee08711bd33e P 308ac45a3f334cdcac265c0cfbbc039b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.232461  4659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd72c6318be5424f9c7a36d563d8cd32" candidate_uuid: "ed488ca31ad54b53836e5a10d053b568" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c800c72b860f42878733b72fa57c227e" is_pre_election: true
I20260709 13:13:03.233137  4659 raft_consensus.cc:2468] T cd72c6318be5424f9c7a36d563d8cd32 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed488ca31ad54b53836e5a10d053b568 in term 0.
I20260709 13:13:03.233724  4870 ts_tablet_manager.cc:1434] T 1c91359ff2954c87a2caee08711bd33e P 308ac45a3f334cdcac265c0cfbbc039b: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 13:13:03.234140  4817 raft_consensus.cc:493] T 1c91359ff2954c87a2caee08711bd33e P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.234823  4870 tablet_bootstrap.cc:492] T 5e58e02271134e058cd0af272aa9be5b P 308ac45a3f334cdcac265c0cfbbc039b: Bootstrap starting.
I20260709 13:13:03.234674  4817 raft_consensus.cc:515] T 1c91359ff2954c87a2caee08711bd33e P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.236884  4817 leader_election.cc:290] T 1c91359ff2954c87a2caee08711bd33e P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c800c72b860f42878733b72fa57c227e (127.28.54.66:43707), 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965)
I20260709 13:13:03.237522  4858 raft_consensus.cc:493] T ad48d60224d54518b33057b28cbef56b P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.237993  4858 raft_consensus.cc:515] T ad48d60224d54518b33057b28cbef56b P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.238834  4734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c91359ff2954c87a2caee08711bd33e" candidate_uuid: "ed488ca31ad54b53836e5a10d053b568" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b" is_pre_election: true
I20260709 13:13:03.239383  4734 raft_consensus.cc:2468] T 1c91359ff2954c87a2caee08711bd33e P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed488ca31ad54b53836e5a10d053b568 in term 0.
I20260709 13:13:03.239897  4858 leader_election.cc:290] T ad48d60224d54518b33057b28cbef56b P 308ac45a3f334cdcac265c0cfbbc039b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed488ca31ad54b53836e5a10d053b568 (127.28.54.65:36419), c800c72b860f42878733b72fa57c227e (127.28.54.66:43707)
I20260709 13:13:03.240482  4550 leader_election.cc:304] T cd72c6318be5424f9c7a36d563d8cd32 P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c800c72b860f42878733b72fa57c227e, ed488ca31ad54b53836e5a10d053b568; no voters: 
I20260709 13:13:03.241824  4870 tablet_bootstrap.cc:654] T 5e58e02271134e058cd0af272aa9be5b P 308ac45a3f334cdcac265c0cfbbc039b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:03.242071  4732 raft_consensus.cc:2468] T cd72c6318be5424f9c7a36d563d8cd32 P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed488ca31ad54b53836e5a10d053b568 in term 0.
I20260709 13:13:03.242489  4660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad48d60224d54518b33057b28cbef56b" candidate_uuid: "308ac45a3f334cdcac265c0cfbbc039b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c800c72b860f42878733b72fa57c227e" is_pre_election: true
I20260709 13:13:03.243074  4660 raft_consensus.cc:2468] T ad48d60224d54518b33057b28cbef56b P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 308ac45a3f334cdcac265c0cfbbc039b in term 0.
I20260709 13:13:03.241427  4548 leader_election.cc:304] T 1c91359ff2954c87a2caee08711bd33e P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 308ac45a3f334cdcac265c0cfbbc039b, ed488ca31ad54b53836e5a10d053b568; no voters: 
I20260709 13:13:03.241861  4659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c91359ff2954c87a2caee08711bd33e" candidate_uuid: "ed488ca31ad54b53836e5a10d053b568" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c800c72b860f42878733b72fa57c227e" is_pre_election: true
W20260709 13:13:03.244783  4550 leader_election.cc:343] T 1c91359ff2954c87a2caee08711bd33e P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c800c72b860f42878733b72fa57c227e (127.28.54.66:43707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:03.243146  4880 leader_election.cc:290] T cd72c6318be5424f9c7a36d563d8cd32 P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c800c72b860f42878733b72fa57c227e (127.28.54.66:43707), 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965)
I20260709 13:13:03.245100  4699 leader_election.cc:304] T ad48d60224d54518b33057b28cbef56b P 308ac45a3f334cdcac265c0cfbbc039b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 308ac45a3f334cdcac265c0cfbbc039b, c800c72b860f42878733b72fa57c227e; no voters: 
I20260709 13:13:03.245491  4880 raft_consensus.cc:2804] T cd72c6318be5424f9c7a36d563d8cd32 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:03.245867  4880 raft_consensus.cc:493] T cd72c6318be5424f9c7a36d563d8cd32 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:03.246047  4858 raft_consensus.cc:2804] T ad48d60224d54518b33057b28cbef56b P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:03.246248  4817 raft_consensus.cc:2804] T 1c91359ff2954c87a2caee08711bd33e P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:03.246425  4858 raft_consensus.cc:493] T ad48d60224d54518b33057b28cbef56b P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:03.246642  4817 raft_consensus.cc:493] T 1c91359ff2954c87a2caee08711bd33e P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:03.246865  4858 raft_consensus.cc:3060] T ad48d60224d54518b33057b28cbef56b P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:03.247023  4817 raft_consensus.cc:3060] T 1c91359ff2954c87a2caee08711bd33e P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:03.249920  4880 raft_consensus.cc:3060] T cd72c6318be5424f9c7a36d563d8cd32 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:03.259507  4858 raft_consensus.cc:515] T ad48d60224d54518b33057b28cbef56b P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.260891  4870 tablet_bootstrap.cc:492] T 5e58e02271134e058cd0af272aa9be5b P 308ac45a3f334cdcac265c0cfbbc039b: No bootstrap required, opened a new log
I20260709 13:13:03.264951  4870 ts_tablet_manager.cc:1403] T 5e58e02271134e058cd0af272aa9be5b P 308ac45a3f334cdcac265c0cfbbc039b: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.006s
I20260709 13:13:03.267432  4817 raft_consensus.cc:515] T 1c91359ff2954c87a2caee08711bd33e P ed488ca31ad54b53836e5a10d053b568 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.267956  4870 raft_consensus.cc:359] T 5e58e02271134e058cd0af272aa9be5b P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.268858  4870 raft_consensus.cc:385] T 5e58e02271134e058cd0af272aa9be5b P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:03.269104  4870 raft_consensus.cc:740] T 5e58e02271134e058cd0af272aa9be5b P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 308ac45a3f334cdcac265c0cfbbc039b, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.269785  4870 consensus_queue.cc:260] T 5e58e02271134e058cd0af272aa9be5b P 308ac45a3f334cdcac265c0cfbbc039b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.270118  4660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c91359ff2954c87a2caee08711bd33e" candidate_uuid: "ed488ca31ad54b53836e5a10d053b568" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c800c72b860f42878733b72fa57c227e"
W20260709 13:13:03.271544  4550 leader_election.cc:343] T 1c91359ff2954c87a2caee08711bd33e P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c800c72b860f42878733b72fa57c227e (127.28.54.66:43707): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:03.273138  4584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad48d60224d54518b33057b28cbef56b" candidate_uuid: "308ac45a3f334cdcac265c0cfbbc039b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed488ca31ad54b53836e5a10d053b568" is_pre_election: true
I20260709 13:13:03.274075  4880 raft_consensus.cc:515] T cd72c6318be5424f9c7a36d563d8cd32 P ed488ca31ad54b53836e5a10d053b568 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.274520  4585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad48d60224d54518b33057b28cbef56b" candidate_uuid: "308ac45a3f334cdcac265c0cfbbc039b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed488ca31ad54b53836e5a10d053b568"
I20260709 13:13:03.273869  4584 raft_consensus.cc:2468] T ad48d60224d54518b33057b28cbef56b P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 308ac45a3f334cdcac265c0cfbbc039b in term 0.
I20260709 13:13:03.276115  4880 leader_election.cc:290] T cd72c6318be5424f9c7a36d563d8cd32 P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 election: Requested vote from peers c800c72b860f42878733b72fa57c227e (127.28.54.66:43707), 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965)
I20260709 13:13:03.276659  4660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd72c6318be5424f9c7a36d563d8cd32" candidate_uuid: "ed488ca31ad54b53836e5a10d053b568" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c800c72b860f42878733b72fa57c227e"
I20260709 13:13:03.281430  4734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cd72c6318be5424f9c7a36d563d8cd32" candidate_uuid: "ed488ca31ad54b53836e5a10d053b568" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b"
I20260709 13:13:03.281798  4660 raft_consensus.cc:3060] T cd72c6318be5424f9c7a36d563d8cd32 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:03.281960  4734 raft_consensus.cc:3060] T cd72c6318be5424f9c7a36d563d8cd32 P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:03.282199  4872 tablet_bootstrap.cc:492] T fe8690eb51c946f282a28a9a065cf575 P ed488ca31ad54b53836e5a10d053b568: No bootstrap required, opened a new log
I20260709 13:13:03.282718  4872 ts_tablet_manager.cc:1403] T fe8690eb51c946f282a28a9a065cf575 P ed488ca31ad54b53836e5a10d053b568: Time spent bootstrapping tablet: real 0.061s	user 0.014s	sys 0.002s
I20260709 13:13:03.283891  4731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c91359ff2954c87a2caee08711bd33e" candidate_uuid: "ed488ca31ad54b53836e5a10d053b568" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b"
I20260709 13:13:03.284482  4731 raft_consensus.cc:3060] T 1c91359ff2954c87a2caee08711bd33e P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:03.276865  4890 leader_election.cc:290] T 2d50b7657708498da25d2ca6b238746d P c800c72b860f42878733b72fa57c227e [CANDIDATE]: Term 1 election: Requested vote from peers ed488ca31ad54b53836e5a10d053b568 (127.28.54.65:36419), 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965)
I20260709 13:13:03.277952  4896 raft_consensus.cc:493] T bf723babacbc4c8887c87a9fe84d6992 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.278227  4732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d50b7657708498da25d2ca6b238746d" candidate_uuid: "c800c72b860f42878733b72fa57c227e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b"
I20260709 13:13:03.286279  4732 raft_consensus.cc:3060] T 2d50b7657708498da25d2ca6b238746d P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:03.288579  4660 raft_consensus.cc:2468] T cd72c6318be5424f9c7a36d563d8cd32 P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed488ca31ad54b53836e5a10d053b568 in term 1.
I20260709 13:13:03.289808  4550 leader_election.cc:304] T cd72c6318be5424f9c7a36d563d8cd32 P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c800c72b860f42878733b72fa57c227e, ed488ca31ad54b53836e5a10d053b568; no voters: 
I20260709 13:13:03.278720  4783 raft_consensus.cc:697] T 2d50b7657708498da25d2ca6b238746d P c800c72b860f42878733b72fa57c227e [term 1 LEADER]: Becoming Leader. State: Replica: c800c72b860f42878733b72fa57c227e, State: Running, Role: LEADER
I20260709 13:13:03.279304  4817 leader_election.cc:290] T 1c91359ff2954c87a2caee08711bd33e P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 election: Requested vote from peers c800c72b860f42878733b72fa57c227e (127.28.54.66:43707), 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965)
I20260709 13:13:03.295398  4817 raft_consensus.cc:493] T bf723babacbc4c8887c87a9fe84d6992 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.294440  4783 consensus_queue.cc:237] T 2d50b7657708498da25d2ca6b238746d P c800c72b860f42878733b72fa57c227e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.296321  4903 raft_consensus.cc:2804] T cd72c6318be5424f9c7a36d563d8cd32 P ed488ca31ad54b53836e5a10d053b568 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:03.296813  4903 raft_consensus.cc:697] T cd72c6318be5424f9c7a36d563d8cd32 P ed488ca31ad54b53836e5a10d053b568 [term 1 LEADER]: Becoming Leader. State: Replica: ed488ca31ad54b53836e5a10d053b568, State: Running, Role: LEADER
I20260709 13:13:03.297381  4734 raft_consensus.cc:2468] T cd72c6318be5424f9c7a36d563d8cd32 P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed488ca31ad54b53836e5a10d053b568 in term 1.
I20260709 13:13:03.297173  4731 raft_consensus.cc:2468] T 1c91359ff2954c87a2caee08711bd33e P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed488ca31ad54b53836e5a10d053b568 in term 1.
I20260709 13:13:03.293464  4732 raft_consensus.cc:2468] T 2d50b7657708498da25d2ca6b238746d P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c800c72b860f42878733b72fa57c227e in term 1.
I20260709 13:13:03.298821  4903 consensus_queue.cc:237] T cd72c6318be5424f9c7a36d563d8cd32 P ed488ca31ad54b53836e5a10d053b568 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.300383  4896 raft_consensus.cc:515] T bf723babacbc4c8887c87a9fe84d6992 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.295821  4817 raft_consensus.cc:515] T bf723babacbc4c8887c87a9fe84d6992 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.302474  4817 leader_election.cc:290] T bf723babacbc4c8887c87a9fe84d6992 P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c800c72b860f42878733b72fa57c227e (127.28.54.66:43707), 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965)
I20260709 13:13:03.303483  4732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf723babacbc4c8887c87a9fe84d6992" candidate_uuid: "c800c72b860f42878733b72fa57c227e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b" is_pre_election: true
I20260709 13:13:03.304096  4732 raft_consensus.cc:2468] T bf723babacbc4c8887c87a9fe84d6992 P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c800c72b860f42878733b72fa57c227e in term 0.
I20260709 13:13:03.305132  4623 leader_election.cc:304] T bf723babacbc4c8887c87a9fe84d6992 P c800c72b860f42878733b72fa57c227e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 308ac45a3f334cdcac265c0cfbbc039b, c800c72b860f42878733b72fa57c227e; no voters: 
W20260709 13:13:03.305358  4531 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:03.280124  4870 ts_tablet_manager.cc:1434] T 5e58e02271134e058cd0af272aa9be5b P 308ac45a3f334cdcac265c0cfbbc039b: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 13:13:03.285496  4872 raft_consensus.cc:359] T fe8690eb51c946f282a28a9a065cf575 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.306394  4872 raft_consensus.cc:385] T fe8690eb51c946f282a28a9a065cf575 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:03.306665  4872 raft_consensus.cc:740] T fe8690eb51c946f282a28a9a065cf575 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed488ca31ad54b53836e5a10d053b568, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.304211  4548 leader_election.cc:304] T 1c91359ff2954c87a2caee08711bd33e P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 308ac45a3f334cdcac265c0cfbbc039b, ed488ca31ad54b53836e5a10d053b568; no voters: c800c72b860f42878733b72fa57c227e
I20260709 13:13:03.306150  4858 leader_election.cc:290] T ad48d60224d54518b33057b28cbef56b P 308ac45a3f334cdcac265c0cfbbc039b [CANDIDATE]: Term 1 election: Requested vote from peers ed488ca31ad54b53836e5a10d053b568 (127.28.54.65:36419), c800c72b860f42878733b72fa57c227e (127.28.54.66:43707)
I20260709 13:13:03.307366  4732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf723babacbc4c8887c87a9fe84d6992" candidate_uuid: "ed488ca31ad54b53836e5a10d053b568" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b" is_pre_election: true
I20260709 13:13:03.307698  4890 raft_consensus.cc:493] T 886cca6de3e54269a85c11555b07822f P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.306679  4870 tablet_bootstrap.cc:492] T fe8690eb51c946f282a28a9a065cf575 P 308ac45a3f334cdcac265c0cfbbc039b: Bootstrap starting.
I20260709 13:13:03.308684  4901 raft_consensus.cc:2804] T bf723babacbc4c8887c87a9fe84d6992 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:03.308480  4890 raft_consensus.cc:515] T 886cca6de3e54269a85c11555b07822f P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.309101  4901 raft_consensus.cc:493] T bf723babacbc4c8887c87a9fe84d6992 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:03.309443  4901 raft_consensus.cc:3060] T bf723babacbc4c8887c87a9fe84d6992 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:03.310607  4660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad48d60224d54518b33057b28cbef56b" candidate_uuid: "308ac45a3f334cdcac265c0cfbbc039b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c800c72b860f42878733b72fa57c227e"
I20260709 13:13:03.311235  4660 raft_consensus.cc:3060] T ad48d60224d54518b33057b28cbef56b P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:03.313702  4871 tablet_bootstrap.cc:492] T 1c91359ff2954c87a2caee08711bd33e P c800c72b860f42878733b72fa57c227e: No bootstrap required, opened a new log
I20260709 13:13:03.314631  4871 ts_tablet_manager.cc:1403] T 1c91359ff2954c87a2caee08711bd33e P c800c72b860f42878733b72fa57c227e: Time spent bootstrapping tablet: real 0.118s	user 0.030s	sys 0.058s
I20260709 13:13:03.317710  4871 raft_consensus.cc:359] T 1c91359ff2954c87a2caee08711bd33e P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.318032  4659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf723babacbc4c8887c87a9fe84d6992" candidate_uuid: "ed488ca31ad54b53836e5a10d053b568" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c800c72b860f42878733b72fa57c227e" is_pre_election: true
I20260709 13:13:03.318617  4871 raft_consensus.cc:385] T 1c91359ff2954c87a2caee08711bd33e P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:03.318921  4871 raft_consensus.cc:740] T 1c91359ff2954c87a2caee08711bd33e P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c800c72b860f42878733b72fa57c227e, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.319006  4731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "886cca6de3e54269a85c11555b07822f" candidate_uuid: "c800c72b860f42878733b72fa57c227e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b" is_pre_election: true
I20260709 13:13:03.319941  4871 consensus_queue.cc:260] T 1c91359ff2954c87a2caee08711bd33e P c800c72b860f42878733b72fa57c227e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.321770  4731 raft_consensus.cc:2468] T 886cca6de3e54269a85c11555b07822f P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c800c72b860f42878733b72fa57c227e in term 0.
I20260709 13:13:03.319083  4890 leader_election.cc:290] T 886cca6de3e54269a85c11555b07822f P c800c72b860f42878733b72fa57c227e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed488ca31ad54b53836e5a10d053b568 (127.28.54.65:36419), 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965)
I20260709 13:13:03.322450  4871 ts_tablet_manager.cc:1434] T 1c91359ff2954c87a2caee08711bd33e P c800c72b860f42878733b72fa57c227e: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260709 13:13:03.323136  4623 leader_election.cc:304] T 886cca6de3e54269a85c11555b07822f P c800c72b860f42878733b72fa57c227e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 308ac45a3f334cdcac265c0cfbbc039b, c800c72b860f42878733b72fa57c227e; no voters: 
I20260709 13:13:03.323974  4890 raft_consensus.cc:2804] T 886cca6de3e54269a85c11555b07822f P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:03.324350  4890 raft_consensus.cc:493] T 886cca6de3e54269a85c11555b07822f P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:03.324689  4890 raft_consensus.cc:3060] T 886cca6de3e54269a85c11555b07822f P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:03.306767  4896 leader_election.cc:290] T bf723babacbc4c8887c87a9fe84d6992 P c800c72b860f42878733b72fa57c227e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed488ca31ad54b53836e5a10d053b568 (127.28.54.65:36419), 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965)
I20260709 13:13:03.307371  4872 consensus_queue.cc:260] T fe8690eb51c946f282a28a9a065cf575 P ed488ca31ad54b53836e5a10d053b568 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.308171  4732 raft_consensus.cc:2468] T bf723babacbc4c8887c87a9fe84d6992 P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed488ca31ad54b53836e5a10d053b568 in term 0.
I20260709 13:13:03.327930  4548 leader_election.cc:304] T bf723babacbc4c8887c87a9fe84d6992 P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 308ac45a3f334cdcac265c0cfbbc039b, ed488ca31ad54b53836e5a10d053b568; no voters: 
I20260709 13:13:03.325174  4660 raft_consensus.cc:2468] T ad48d60224d54518b33057b28cbef56b P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 308ac45a3f334cdcac265c0cfbbc039b in term 1.
I20260709 13:13:03.330744  4585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "886cca6de3e54269a85c11555b07822f" candidate_uuid: "c800c72b860f42878733b72fa57c227e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed488ca31ad54b53836e5a10d053b568" is_pre_election: true
I20260709 13:13:03.331377  4585 raft_consensus.cc:2468] T 886cca6de3e54269a85c11555b07822f P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c800c72b860f42878733b72fa57c227e in term 0.
I20260709 13:13:03.331489  4479 catalog_manager.cc:5697] T cd72c6318be5424f9c7a36d563d8cd32 P ed488ca31ad54b53836e5a10d053b568 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed488ca31ad54b53836e5a10d053b568 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "ed488ca31ad54b53836e5a10d053b568" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:03.314569  4880 raft_consensus.cc:2804] T 1c91359ff2954c87a2caee08711bd33e P ed488ca31ad54b53836e5a10d053b568 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:03.333678  4880 raft_consensus.cc:697] T 1c91359ff2954c87a2caee08711bd33e P ed488ca31ad54b53836e5a10d053b568 [term 1 LEADER]: Becoming Leader. State: Replica: ed488ca31ad54b53836e5a10d053b568, State: Running, Role: LEADER
I20260709 13:13:03.333545  4482 catalog_manager.cc:5697] T 2d50b7657708498da25d2ca6b238746d P c800c72b860f42878733b72fa57c227e reported cstate change: term changed from 0 to 1, leader changed from <none> to c800c72b860f42878733b72fa57c227e (127.28.54.66). New cstate: current_term: 1 leader_uuid: "c800c72b860f42878733b72fa57c227e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:03.334548  4880 consensus_queue.cc:237] T 1c91359ff2954c87a2caee08711bd33e P ed488ca31ad54b53836e5a10d053b568 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.333683  4872 ts_tablet_manager.cc:1434] T fe8690eb51c946f282a28a9a065cf575 P ed488ca31ad54b53836e5a10d053b568: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.000s
I20260709 13:13:03.338423  4872 tablet_bootstrap.cc:492] T 5e58e02271134e058cd0af272aa9be5b P ed488ca31ad54b53836e5a10d053b568: Bootstrap starting.
I20260709 13:13:03.338321  4699 leader_election.cc:304] T ad48d60224d54518b33057b28cbef56b P 308ac45a3f334cdcac265c0cfbbc039b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 308ac45a3f334cdcac265c0cfbbc039b, c800c72b860f42878733b72fa57c227e; no voters: ed488ca31ad54b53836e5a10d053b568
I20260709 13:13:03.338923  4871 tablet_bootstrap.cc:492] T fe8690eb51c946f282a28a9a065cf575 P c800c72b860f42878733b72fa57c227e: Bootstrap starting.
I20260709 13:13:03.339589  4858 raft_consensus.cc:2804] T ad48d60224d54518b33057b28cbef56b P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:03.318954  4584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf723babacbc4c8887c87a9fe84d6992" candidate_uuid: "c800c72b860f42878733b72fa57c227e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed488ca31ad54b53836e5a10d053b568" is_pre_election: true
I20260709 13:13:03.340994  4584 raft_consensus.cc:2468] T bf723babacbc4c8887c87a9fe84d6992 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c800c72b860f42878733b72fa57c227e in term 0.
I20260709 13:13:03.340499  4858 raft_consensus.cc:697] T ad48d60224d54518b33057b28cbef56b P 308ac45a3f334cdcac265c0cfbbc039b [term 1 LEADER]: Becoming Leader. State: Replica: 308ac45a3f334cdcac265c0cfbbc039b, State: Running, Role: LEADER
I20260709 13:13:03.342386  4858 consensus_queue.cc:237] T ad48d60224d54518b33057b28cbef56b P 308ac45a3f334cdcac265c0cfbbc039b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.338060  4890 raft_consensus.cc:515] T 886cca6de3e54269a85c11555b07822f P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.344596  4872 tablet_bootstrap.cc:654] T 5e58e02271134e058cd0af272aa9be5b P ed488ca31ad54b53836e5a10d053b568: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:03.345348  4902 raft_consensus.cc:2804] T bf723babacbc4c8887c87a9fe84d6992 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:03.345727  4902 raft_consensus.cc:493] T bf723babacbc4c8887c87a9fe84d6992 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:03.346040  4902 raft_consensus.cc:3060] T bf723babacbc4c8887c87a9fe84d6992 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:03.348040  4870 tablet_bootstrap.cc:654] T fe8690eb51c946f282a28a9a065cf575 P 308ac45a3f334cdcac265c0cfbbc039b: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:03.352859  4902 raft_consensus.cc:515] T bf723babacbc4c8887c87a9fe84d6992 P ed488ca31ad54b53836e5a10d053b568 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.354998  4902 leader_election.cc:290] T bf723babacbc4c8887c87a9fe84d6992 P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 election: Requested vote from peers c800c72b860f42878733b72fa57c227e (127.28.54.66:43707), 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965)
I20260709 13:13:03.355715  4660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf723babacbc4c8887c87a9fe84d6992" candidate_uuid: "ed488ca31ad54b53836e5a10d053b568" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c800c72b860f42878733b72fa57c227e"
I20260709 13:13:03.355609  4871 tablet_bootstrap.cc:654] T fe8690eb51c946f282a28a9a065cf575 P c800c72b860f42878733b72fa57c227e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:03.364234  4731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf723babacbc4c8887c87a9fe84d6992" candidate_uuid: "ed488ca31ad54b53836e5a10d053b568" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b"
I20260709 13:13:03.366546  4731 raft_consensus.cc:3060] T bf723babacbc4c8887c87a9fe84d6992 P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:03.366977  4584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "886cca6de3e54269a85c11555b07822f" candidate_uuid: "c800c72b860f42878733b72fa57c227e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed488ca31ad54b53836e5a10d053b568"
I20260709 13:13:03.367558  4584 raft_consensus.cc:3060] T 886cca6de3e54269a85c11555b07822f P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:03.372987  4890 leader_election.cc:290] T 886cca6de3e54269a85c11555b07822f P c800c72b860f42878733b72fa57c227e [CANDIDATE]: Term 1 election: Requested vote from peers ed488ca31ad54b53836e5a10d053b568 (127.28.54.65:36419), 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965)
I20260709 13:13:03.373257  4732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "886cca6de3e54269a85c11555b07822f" candidate_uuid: "c800c72b860f42878733b72fa57c227e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b"
I20260709 13:13:03.373946  4732 raft_consensus.cc:3060] T 886cca6de3e54269a85c11555b07822f P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:03.378790  4584 raft_consensus.cc:2468] T 886cca6de3e54269a85c11555b07822f P ed488ca31ad54b53836e5a10d053b568 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c800c72b860f42878733b72fa57c227e in term 1.
I20260709 13:13:03.380553  4625 leader_election.cc:304] T 886cca6de3e54269a85c11555b07822f P c800c72b860f42878733b72fa57c227e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c800c72b860f42878733b72fa57c227e, ed488ca31ad54b53836e5a10d053b568; no voters: 
I20260709 13:13:03.381304  4896 raft_consensus.cc:493] T 1c91359ff2954c87a2caee08711bd33e P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.381367  4890 raft_consensus.cc:2804] T 886cca6de3e54269a85c11555b07822f P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:03.381965  4896 raft_consensus.cc:515] T 1c91359ff2954c87a2caee08711bd33e P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.382351  4890 raft_consensus.cc:697] T 886cca6de3e54269a85c11555b07822f P c800c72b860f42878733b72fa57c227e [term 1 LEADER]: Becoming Leader. State: Replica: c800c72b860f42878733b72fa57c227e, State: Running, Role: LEADER
I20260709 13:13:03.383170  4890 consensus_queue.cc:237] T 886cca6de3e54269a85c11555b07822f P c800c72b860f42878733b72fa57c227e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.384069  4896 leader_election.cc:290] T 1c91359ff2954c87a2caee08711bd33e P c800c72b860f42878733b72fa57c227e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed488ca31ad54b53836e5a10d053b568 (127.28.54.65:36419), 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965)
I20260709 13:13:03.386027  4734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c91359ff2954c87a2caee08711bd33e" candidate_uuid: "c800c72b860f42878733b72fa57c227e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b" is_pre_election: true
I20260709 13:13:03.386799  4734 raft_consensus.cc:2393] T 1c91359ff2954c87a2caee08711bd33e P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c800c72b860f42878733b72fa57c227e in current term 1: Already voted for candidate ed488ca31ad54b53836e5a10d053b568 in this term.
I20260709 13:13:03.389822  4732 raft_consensus.cc:2468] T 886cca6de3e54269a85c11555b07822f P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c800c72b860f42878733b72fa57c227e in term 1.
I20260709 13:13:03.390419  4731 raft_consensus.cc:2468] T bf723babacbc4c8887c87a9fe84d6992 P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed488ca31ad54b53836e5a10d053b568 in term 1.
I20260709 13:13:03.390885  4584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c91359ff2954c87a2caee08711bd33e" candidate_uuid: "c800c72b860f42878733b72fa57c227e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed488ca31ad54b53836e5a10d053b568" is_pre_election: true
I20260709 13:13:03.396376  4548 leader_election.cc:304] T bf723babacbc4c8887c87a9fe84d6992 P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 308ac45a3f334cdcac265c0cfbbc039b, ed488ca31ad54b53836e5a10d053b568; no voters: c800c72b860f42878733b72fa57c227e
I20260709 13:13:03.396544  4625 leader_election.cc:304] T 1c91359ff2954c87a2caee08711bd33e P c800c72b860f42878733b72fa57c227e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c800c72b860f42878733b72fa57c227e; no voters: 308ac45a3f334cdcac265c0cfbbc039b, ed488ca31ad54b53836e5a10d053b568
I20260709 13:13:03.397301  4902 raft_consensus.cc:2804] T bf723babacbc4c8887c87a9fe84d6992 P ed488ca31ad54b53836e5a10d053b568 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:03.397801  4783 raft_consensus.cc:3060] T 1c91359ff2954c87a2caee08711bd33e P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:03.398072  4902 raft_consensus.cc:697] T bf723babacbc4c8887c87a9fe84d6992 P ed488ca31ad54b53836e5a10d053b568 [term 1 LEADER]: Becoming Leader. State: Replica: ed488ca31ad54b53836e5a10d053b568, State: Running, Role: LEADER
I20260709 13:13:03.398952  4902 consensus_queue.cc:237] T bf723babacbc4c8887c87a9fe84d6992 P ed488ca31ad54b53836e5a10d053b568 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.400981  4871 tablet_bootstrap.cc:492] T fe8690eb51c946f282a28a9a065cf575 P c800c72b860f42878733b72fa57c227e: No bootstrap required, opened a new log
I20260709 13:13:03.401477  4871 ts_tablet_manager.cc:1403] T fe8690eb51c946f282a28a9a065cf575 P c800c72b860f42878733b72fa57c227e: Time spent bootstrapping tablet: real 0.063s	user 0.011s	sys 0.015s
I20260709 13:13:03.393548  4870 tablet_bootstrap.cc:492] T fe8690eb51c946f282a28a9a065cf575 P 308ac45a3f334cdcac265c0cfbbc039b: No bootstrap required, opened a new log
I20260709 13:13:03.404227  4870 ts_tablet_manager.cc:1403] T fe8690eb51c946f282a28a9a065cf575 P 308ac45a3f334cdcac265c0cfbbc039b: Time spent bootstrapping tablet: real 0.098s	user 0.014s	sys 0.004s
I20260709 13:13:03.404723  4783 raft_consensus.cc:2749] T 1c91359ff2954c87a2caee08711bd33e P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:03.394745  4901 raft_consensus.cc:515] T bf723babacbc4c8887c87a9fe84d6992 P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.406792  4659 raft_consensus.cc:2393] T bf723babacbc4c8887c87a9fe84d6992 P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ed488ca31ad54b53836e5a10d053b568 in current term 1: Already voted for candidate c800c72b860f42878733b72fa57c227e in this term.
I20260709 13:13:03.407074  4870 raft_consensus.cc:359] T fe8690eb51c946f282a28a9a065cf575 P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.407720  4870 raft_consensus.cc:385] T fe8690eb51c946f282a28a9a065cf575 P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:03.407959  4870 raft_consensus.cc:740] T fe8690eb51c946f282a28a9a065cf575 P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 308ac45a3f334cdcac265c0cfbbc039b, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.408578  4870 consensus_queue.cc:260] T fe8690eb51c946f282a28a9a065cf575 P 308ac45a3f334cdcac265c0cfbbc039b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.410478  4870 ts_tablet_manager.cc:1434] T fe8690eb51c946f282a28a9a065cf575 P 308ac45a3f334cdcac265c0cfbbc039b: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 13:13:03.411098  4901 leader_election.cc:290] T bf723babacbc4c8887c87a9fe84d6992 P c800c72b860f42878733b72fa57c227e [CANDIDATE]: Term 1 election: Requested vote from peers ed488ca31ad54b53836e5a10d053b568 (127.28.54.65:36419), 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965)
I20260709 13:13:03.411765  4731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf723babacbc4c8887c87a9fe84d6992" candidate_uuid: "c800c72b860f42878733b72fa57c227e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b"
I20260709 13:13:03.412510  4731 raft_consensus.cc:2393] T bf723babacbc4c8887c87a9fe84d6992 P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c800c72b860f42878733b72fa57c227e in current term 1: Already voted for candidate ed488ca31ad54b53836e5a10d053b568 in this term.
I20260709 13:13:03.414027  4584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf723babacbc4c8887c87a9fe84d6992" candidate_uuid: "c800c72b860f42878733b72fa57c227e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed488ca31ad54b53836e5a10d053b568"
I20260709 13:13:03.414348  4872 tablet_bootstrap.cc:492] T 5e58e02271134e058cd0af272aa9be5b P ed488ca31ad54b53836e5a10d053b568: No bootstrap required, opened a new log
I20260709 13:13:03.415170  4872 ts_tablet_manager.cc:1403] T 5e58e02271134e058cd0af272aa9be5b P ed488ca31ad54b53836e5a10d053b568: Time spent bootstrapping tablet: real 0.077s	user 0.011s	sys 0.006s
I20260709 13:13:03.415374  4625 leader_election.cc:304] T bf723babacbc4c8887c87a9fe84d6992 P c800c72b860f42878733b72fa57c227e [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c800c72b860f42878733b72fa57c227e; no voters: 308ac45a3f334cdcac265c0cfbbc039b, ed488ca31ad54b53836e5a10d053b568
I20260709 13:13:03.416153  4901 raft_consensus.cc:2749] T bf723babacbc4c8887c87a9fe84d6992 P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 13:13:03.404176  4871 raft_consensus.cc:359] T fe8690eb51c946f282a28a9a065cf575 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.418795  4871 raft_consensus.cc:385] T fe8690eb51c946f282a28a9a065cf575 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:03.419055  4871 raft_consensus.cc:740] T fe8690eb51c946f282a28a9a065cf575 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c800c72b860f42878733b72fa57c227e, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.419677  4871 consensus_queue.cc:260] T fe8690eb51c946f282a28a9a065cf575 P c800c72b860f42878733b72fa57c227e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.419793  4483 catalog_manager.cc:5697] T ad48d60224d54518b33057b28cbef56b P 308ac45a3f334cdcac265c0cfbbc039b reported cstate change: term changed from 0 to 1, leader changed from <none> to 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67). New cstate: current_term: 1 leader_uuid: "308ac45a3f334cdcac265c0cfbbc039b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:03.420632  4872 raft_consensus.cc:359] T 5e58e02271134e058cd0af272aa9be5b P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.421412  4872 raft_consensus.cc:385] T 5e58e02271134e058cd0af272aa9be5b P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:03.421548  4871 ts_tablet_manager.cc:1434] T fe8690eb51c946f282a28a9a065cf575 P c800c72b860f42878733b72fa57c227e: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.000s
I20260709 13:13:03.421746  4872 raft_consensus.cc:740] T 5e58e02271134e058cd0af272aa9be5b P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ed488ca31ad54b53836e5a10d053b568, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.422510  4872 consensus_queue.cc:260] T 5e58e02271134e058cd0af272aa9be5b P ed488ca31ad54b53836e5a10d053b568 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.423131  4871 tablet_bootstrap.cc:492] T 5e58e02271134e058cd0af272aa9be5b P c800c72b860f42878733b72fa57c227e: Bootstrap starting.
I20260709 13:13:03.424700  4872 ts_tablet_manager.cc:1434] T 5e58e02271134e058cd0af272aa9be5b P ed488ca31ad54b53836e5a10d053b568: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:13:03.425853  4479 catalog_manager.cc:5697] T 886cca6de3e54269a85c11555b07822f P c800c72b860f42878733b72fa57c227e reported cstate change: term changed from 0 to 1, leader changed from <none> to c800c72b860f42878733b72fa57c227e (127.28.54.66). New cstate: current_term: 1 leader_uuid: "c800c72b860f42878733b72fa57c227e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:03.427911  4871 tablet_bootstrap.cc:654] T 5e58e02271134e058cd0af272aa9be5b P c800c72b860f42878733b72fa57c227e: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:03.440867  4482 catalog_manager.cc:5697] T 1c91359ff2954c87a2caee08711bd33e P ed488ca31ad54b53836e5a10d053b568 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed488ca31ad54b53836e5a10d053b568 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "ed488ca31ad54b53836e5a10d053b568" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:03.441915  4871 tablet_bootstrap.cc:492] T 5e58e02271134e058cd0af272aa9be5b P c800c72b860f42878733b72fa57c227e: No bootstrap required, opened a new log
I20260709 13:13:03.442404  4871 ts_tablet_manager.cc:1403] T 5e58e02271134e058cd0af272aa9be5b P c800c72b860f42878733b72fa57c227e: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.008s
I20260709 13:13:03.442320  4482 catalog_manager.cc:5697] T bf723babacbc4c8887c87a9fe84d6992 P ed488ca31ad54b53836e5a10d053b568 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed488ca31ad54b53836e5a10d053b568 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "ed488ca31ad54b53836e5a10d053b568" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:03.444950  4871 raft_consensus.cc:359] T 5e58e02271134e058cd0af272aa9be5b P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.445425  4871 raft_consensus.cc:385] T 5e58e02271134e058cd0af272aa9be5b P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:03.445628  4871 raft_consensus.cc:740] T 5e58e02271134e058cd0af272aa9be5b P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c800c72b860f42878733b72fa57c227e, State: Initialized, Role: FOLLOWER
I20260709 13:13:03.446199  4871 consensus_queue.cc:260] T 5e58e02271134e058cd0af272aa9be5b P c800c72b860f42878733b72fa57c227e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.447631  4871 ts_tablet_manager.cc:1434] T 5e58e02271134e058cd0af272aa9be5b P c800c72b860f42878733b72fa57c227e: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 13:13:03.505240  4901 raft_consensus.cc:493] T 1e6249d3f0d24da1955671f551e05009 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.505780  4901 raft_consensus.cc:515] T 1e6249d3f0d24da1955671f551e05009 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.507287  4901 leader_election.cc:290] T 1e6249d3f0d24da1955671f551e05009 P c800c72b860f42878733b72fa57c227e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed488ca31ad54b53836e5a10d053b568 (127.28.54.65:36419), 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965)
I20260709 13:13:03.507977  4584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e6249d3f0d24da1955671f551e05009" candidate_uuid: "c800c72b860f42878733b72fa57c227e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed488ca31ad54b53836e5a10d053b568" is_pre_election: true
I20260709 13:13:03.508208  4731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e6249d3f0d24da1955671f551e05009" candidate_uuid: "c800c72b860f42878733b72fa57c227e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b" is_pre_election: true
I20260709 13:13:03.508519  4584 raft_consensus.cc:2468] T 1e6249d3f0d24da1955671f551e05009 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c800c72b860f42878733b72fa57c227e in term 0.
I20260709 13:13:03.508800  4731 raft_consensus.cc:2468] T 1e6249d3f0d24da1955671f551e05009 P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c800c72b860f42878733b72fa57c227e in term 0.
I20260709 13:13:03.509419  4625 leader_election.cc:304] T 1e6249d3f0d24da1955671f551e05009 P c800c72b860f42878733b72fa57c227e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c800c72b860f42878733b72fa57c227e, ed488ca31ad54b53836e5a10d053b568; no voters: 
I20260709 13:13:03.510232  4901 raft_consensus.cc:2804] T 1e6249d3f0d24da1955671f551e05009 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:03.510510  4901 raft_consensus.cc:493] T 1e6249d3f0d24da1955671f551e05009 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:03.510749  4901 raft_consensus.cc:3060] T 1e6249d3f0d24da1955671f551e05009 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:03.515383  4901 raft_consensus.cc:515] T 1e6249d3f0d24da1955671f551e05009 P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.516778  4901 leader_election.cc:290] T 1e6249d3f0d24da1955671f551e05009 P c800c72b860f42878733b72fa57c227e [CANDIDATE]: Term 1 election: Requested vote from peers ed488ca31ad54b53836e5a10d053b568 (127.28.54.65:36419), 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965)
I20260709 13:13:03.517508  4584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e6249d3f0d24da1955671f551e05009" candidate_uuid: "c800c72b860f42878733b72fa57c227e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed488ca31ad54b53836e5a10d053b568"
I20260709 13:13:03.517611  4731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1e6249d3f0d24da1955671f551e05009" candidate_uuid: "c800c72b860f42878733b72fa57c227e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b"
I20260709 13:13:03.518041  4584 raft_consensus.cc:3060] T 1e6249d3f0d24da1955671f551e05009 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:03.518129  4731 raft_consensus.cc:3060] T 1e6249d3f0d24da1955671f551e05009 P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:03.522584  4584 raft_consensus.cc:2468] T 1e6249d3f0d24da1955671f551e05009 P ed488ca31ad54b53836e5a10d053b568 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c800c72b860f42878733b72fa57c227e in term 1.
I20260709 13:13:03.522732  4731 raft_consensus.cc:2468] T 1e6249d3f0d24da1955671f551e05009 P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c800c72b860f42878733b72fa57c227e in term 1.
I20260709 13:13:03.523564  4625 leader_election.cc:304] T 1e6249d3f0d24da1955671f551e05009 P c800c72b860f42878733b72fa57c227e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c800c72b860f42878733b72fa57c227e, ed488ca31ad54b53836e5a10d053b568; no voters: 
I20260709 13:13:03.524260  4901 raft_consensus.cc:2804] T 1e6249d3f0d24da1955671f551e05009 P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:03.524664  4901 raft_consensus.cc:697] T 1e6249d3f0d24da1955671f551e05009 P c800c72b860f42878733b72fa57c227e [term 1 LEADER]: Becoming Leader. State: Replica: c800c72b860f42878733b72fa57c227e, State: Running, Role: LEADER
I20260709 13:13:03.525377  4901 consensus_queue.cc:237] T 1e6249d3f0d24da1955671f551e05009 P c800c72b860f42878733b72fa57c227e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.538269  4479 catalog_manager.cc:5697] T 1e6249d3f0d24da1955671f551e05009 P c800c72b860f42878733b72fa57c227e reported cstate change: term changed from 0 to 1, leader changed from <none> to c800c72b860f42878733b72fa57c227e (127.28.54.66). New cstate: current_term: 1 leader_uuid: "c800c72b860f42878733b72fa57c227e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:03.538928  4901 raft_consensus.cc:493] T fe8690eb51c946f282a28a9a065cf575 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.539477  4901 raft_consensus.cc:515] T fe8690eb51c946f282a28a9a065cf575 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.541427  4901 leader_election.cc:290] T fe8690eb51c946f282a28a9a065cf575 P c800c72b860f42878733b72fa57c227e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ed488ca31ad54b53836e5a10d053b568 (127.28.54.65:36419), 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965)
I20260709 13:13:03.542008  4584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe8690eb51c946f282a28a9a065cf575" candidate_uuid: "c800c72b860f42878733b72fa57c227e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed488ca31ad54b53836e5a10d053b568" is_pre_election: true
I20260709 13:13:03.542450  4731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe8690eb51c946f282a28a9a065cf575" candidate_uuid: "c800c72b860f42878733b72fa57c227e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b" is_pre_election: true
I20260709 13:13:03.542599  4584 raft_consensus.cc:2468] T fe8690eb51c946f282a28a9a065cf575 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c800c72b860f42878733b72fa57c227e in term 0.
I20260709 13:13:03.543072  4731 raft_consensus.cc:2468] T fe8690eb51c946f282a28a9a065cf575 P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c800c72b860f42878733b72fa57c227e in term 0.
I20260709 13:13:03.543860  4625 leader_election.cc:304] T fe8690eb51c946f282a28a9a065cf575 P c800c72b860f42878733b72fa57c227e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c800c72b860f42878733b72fa57c227e, ed488ca31ad54b53836e5a10d053b568; no voters: 
I20260709 13:13:03.544551  4901 raft_consensus.cc:2804] T fe8690eb51c946f282a28a9a065cf575 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:03.544842  4901 raft_consensus.cc:493] T fe8690eb51c946f282a28a9a065cf575 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:03.545085  4901 raft_consensus.cc:3060] T fe8690eb51c946f282a28a9a065cf575 P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:03.550666  4901 raft_consensus.cc:515] T fe8690eb51c946f282a28a9a065cf575 P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.553071  4584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe8690eb51c946f282a28a9a065cf575" candidate_uuid: "c800c72b860f42878733b72fa57c227e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ed488ca31ad54b53836e5a10d053b568"
I20260709 13:13:03.553391  4731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fe8690eb51c946f282a28a9a065cf575" candidate_uuid: "c800c72b860f42878733b72fa57c227e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b"
I20260709 13:13:03.553699  4584 raft_consensus.cc:3060] T fe8690eb51c946f282a28a9a065cf575 P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:03.554380  4901 leader_election.cc:290] T fe8690eb51c946f282a28a9a065cf575 P c800c72b860f42878733b72fa57c227e [CANDIDATE]: Term 1 election: Requested vote from peers ed488ca31ad54b53836e5a10d053b568 (127.28.54.65:36419), 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965)
I20260709 13:13:03.554018  4731 raft_consensus.cc:3060] T fe8690eb51c946f282a28a9a065cf575 P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:03.559774  4584 raft_consensus.cc:2468] T fe8690eb51c946f282a28a9a065cf575 P ed488ca31ad54b53836e5a10d053b568 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c800c72b860f42878733b72fa57c227e in term 1.
I20260709 13:13:03.560720  4625 leader_election.cc:304] T fe8690eb51c946f282a28a9a065cf575 P c800c72b860f42878733b72fa57c227e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c800c72b860f42878733b72fa57c227e, ed488ca31ad54b53836e5a10d053b568; no voters: 
I20260709 13:13:03.560927  4731 raft_consensus.cc:2468] T fe8690eb51c946f282a28a9a065cf575 P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c800c72b860f42878733b72fa57c227e in term 1.
I20260709 13:13:03.561333  4783 raft_consensus.cc:2804] T fe8690eb51c946f282a28a9a065cf575 P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:03.561815  4783 raft_consensus.cc:697] T fe8690eb51c946f282a28a9a065cf575 P c800c72b860f42878733b72fa57c227e [term 1 LEADER]: Becoming Leader. State: Replica: c800c72b860f42878733b72fa57c227e, State: Running, Role: LEADER
I20260709 13:13:03.562556  4783 consensus_queue.cc:237] T fe8690eb51c946f282a28a9a065cf575 P c800c72b860f42878733b72fa57c227e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.570060  4479 catalog_manager.cc:5697] T fe8690eb51c946f282a28a9a065cf575 P c800c72b860f42878733b72fa57c227e reported cstate change: term changed from 0 to 1, leader changed from <none> to c800c72b860f42878733b72fa57c227e (127.28.54.66). New cstate: current_term: 1 leader_uuid: "c800c72b860f42878733b72fa57c227e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:03.585886  4902 raft_consensus.cc:493] T 5e58e02271134e058cd0af272aa9be5b P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:03.586386  4902 raft_consensus.cc:515] T 5e58e02271134e058cd0af272aa9be5b P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.587900  4902 leader_election.cc:290] T 5e58e02271134e058cd0af272aa9be5b P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c800c72b860f42878733b72fa57c227e (127.28.54.66:43707), 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965)
I20260709 13:13:03.588627  4659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e58e02271134e058cd0af272aa9be5b" candidate_uuid: "ed488ca31ad54b53836e5a10d053b568" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c800c72b860f42878733b72fa57c227e" is_pre_election: true
I20260709 13:13:03.588775  4731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e58e02271134e058cd0af272aa9be5b" candidate_uuid: "ed488ca31ad54b53836e5a10d053b568" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b" is_pre_election: true
I20260709 13:13:03.589157  4659 raft_consensus.cc:2468] T 5e58e02271134e058cd0af272aa9be5b P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed488ca31ad54b53836e5a10d053b568 in term 0.
I20260709 13:13:03.589304  4731 raft_consensus.cc:2468] T 5e58e02271134e058cd0af272aa9be5b P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ed488ca31ad54b53836e5a10d053b568 in term 0.
I20260709 13:13:03.590045  4550 leader_election.cc:304] T 5e58e02271134e058cd0af272aa9be5b P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c800c72b860f42878733b72fa57c227e, ed488ca31ad54b53836e5a10d053b568; no voters: 
I20260709 13:13:03.590755  4902 raft_consensus.cc:2804] T 5e58e02271134e058cd0af272aa9be5b P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:03.591118  4902 raft_consensus.cc:493] T 5e58e02271134e058cd0af272aa9be5b P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:03.591413  4902 raft_consensus.cc:3060] T 5e58e02271134e058cd0af272aa9be5b P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:03.596536  4902 raft_consensus.cc:515] T 5e58e02271134e058cd0af272aa9be5b P ed488ca31ad54b53836e5a10d053b568 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.597947  4902 leader_election.cc:290] T 5e58e02271134e058cd0af272aa9be5b P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 election: Requested vote from peers c800c72b860f42878733b72fa57c227e (127.28.54.66:43707), 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965)
I20260709 13:13:03.598563  4659 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e58e02271134e058cd0af272aa9be5b" candidate_uuid: "ed488ca31ad54b53836e5a10d053b568" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c800c72b860f42878733b72fa57c227e"
I20260709 13:13:03.598757  4731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e58e02271134e058cd0af272aa9be5b" candidate_uuid: "ed488ca31ad54b53836e5a10d053b568" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b"
I20260709 13:13:03.599099  4659 raft_consensus.cc:3060] T 5e58e02271134e058cd0af272aa9be5b P c800c72b860f42878733b72fa57c227e [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:03.599248  4731 raft_consensus.cc:3060] T 5e58e02271134e058cd0af272aa9be5b P 308ac45a3f334cdcac265c0cfbbc039b [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:03.603706  4659 raft_consensus.cc:2468] T 5e58e02271134e058cd0af272aa9be5b P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed488ca31ad54b53836e5a10d053b568 in term 1.
I20260709 13:13:03.603801  4731 raft_consensus.cc:2468] T 5e58e02271134e058cd0af272aa9be5b P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed488ca31ad54b53836e5a10d053b568 in term 1.
I20260709 13:13:03.604653  4550 leader_election.cc:304] T 5e58e02271134e058cd0af272aa9be5b P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c800c72b860f42878733b72fa57c227e, ed488ca31ad54b53836e5a10d053b568; no voters: 
I20260709 13:13:03.605263  4902 raft_consensus.cc:2804] T 5e58e02271134e058cd0af272aa9be5b P ed488ca31ad54b53836e5a10d053b568 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:03.605662  4902 raft_consensus.cc:697] T 5e58e02271134e058cd0af272aa9be5b P ed488ca31ad54b53836e5a10d053b568 [term 1 LEADER]: Becoming Leader. State: Replica: ed488ca31ad54b53836e5a10d053b568, State: Running, Role: LEADER
I20260709 13:13:03.606338  4902 consensus_queue.cc:237] T 5e58e02271134e058cd0af272aa9be5b P ed488ca31ad54b53836e5a10d053b568 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.613539  4479 catalog_manager.cc:5697] T 5e58e02271134e058cd0af272aa9be5b P ed488ca31ad54b53836e5a10d053b568 reported cstate change: term changed from 0 to 1, leader changed from <none> to ed488ca31ad54b53836e5a10d053b568 (127.28.54.65). New cstate: current_term: 1 leader_uuid: "ed488ca31ad54b53836e5a10d053b568" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:03.730765  4659 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "886cca6de3e54269a85c11555b07822f"
dest_uuid: "c800c72b860f42878733b72fa57c227e"
mode: GRACEFUL
new_leader_uuid: "ed488ca31ad54b53836e5a10d053b568"
 from {username='slave'} at 127.0.0.1:43478
I20260709 13:13:03.731272  4659 raft_consensus.cc:606] T 886cca6de3e54269a85c11555b07822f P c800c72b860f42878733b72fa57c227e [term 1 LEADER]: Received request to transfer leadership to TS ed488ca31ad54b53836e5a10d053b568
I20260709 13:13:03.735805  4731 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad48d60224d54518b33057b28cbef56b"
dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b"
mode: GRACEFUL
new_leader_uuid: "ed488ca31ad54b53836e5a10d053b568"
 from {username='slave'} at 127.0.0.1:39282
I20260709 13:13:03.736258  4731 raft_consensus.cc:606] T ad48d60224d54518b33057b28cbef56b P 308ac45a3f334cdcac265c0cfbbc039b [term 1 LEADER]: Received request to transfer leadership to TS ed488ca31ad54b53836e5a10d053b568
I20260709 13:13:03.747202  4584 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c91359ff2954c87a2caee08711bd33e"
dest_uuid: "ed488ca31ad54b53836e5a10d053b568"
mode: GRACEFUL
new_leader_uuid: "c800c72b860f42878733b72fa57c227e"
 from {username='slave'} at 127.0.0.1:51488
I20260709 13:13:03.747654  4584 raft_consensus.cc:606] T 1c91359ff2954c87a2caee08711bd33e P ed488ca31ad54b53836e5a10d053b568 [term 1 LEADER]: Received request to transfer leadership to TS c800c72b860f42878733b72fa57c227e
I20260709 13:13:03.753623  4584 raft_consensus.cc:3060] T ad48d60224d54518b33057b28cbef56b P ed488ca31ad54b53836e5a10d053b568 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:03.754246  4585 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e58e02271134e058cd0af272aa9be5b"
dest_uuid: "ed488ca31ad54b53836e5a10d053b568"
mode: GRACEFUL
new_leader_uuid: "308ac45a3f334cdcac265c0cfbbc039b"
 from {username='slave'} at 127.0.0.1:51488
I20260709 13:13:03.754868  4585 raft_consensus.cc:606] T 5e58e02271134e058cd0af272aa9be5b P ed488ca31ad54b53836e5a10d053b568 [term 1 LEADER]: Received request to transfer leadership to TS 308ac45a3f334cdcac265c0cfbbc039b
I20260709 13:13:03.757654  4902 consensus_queue.cc:1048] T cd72c6318be5424f9c7a36d563d8cd32 P ed488ca31ad54b53836e5a10d053b568 [LEADER]: Connected to new peer: Peer: permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:03.761919  4858 consensus_queue.cc:1048] T ad48d60224d54518b33057b28cbef56b P 308ac45a3f334cdcac265c0cfbbc039b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:03.769595  4900 raft_consensus.cc:993] T ad48d60224d54518b33057b28cbef56b P 308ac45a3f334cdcac265c0cfbbc039b: : Instructing follower ed488ca31ad54b53836e5a10d053b568 to start an election
I20260709 13:13:03.770331  4858 raft_consensus.cc:1081] T ad48d60224d54518b33057b28cbef56b P 308ac45a3f334cdcac265c0cfbbc039b [term 1 LEADER]: Signalling peer ed488ca31ad54b53836e5a10d053b568 to start an election
I20260709 13:13:03.772557  4585 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ad48d60224d54518b33057b28cbef56b"
dest_uuid: "ed488ca31ad54b53836e5a10d053b568"
 from {username='slave'} at 127.0.0.1:51476
I20260709 13:13:03.785532  4925 consensus_queue.cc:1048] T ad48d60224d54518b33057b28cbef56b P 308ac45a3f334cdcac265c0cfbbc039b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:03.796193  4880 consensus_queue.cc:1048] T cd72c6318be5424f9c7a36d563d8cd32 P ed488ca31ad54b53836e5a10d053b568 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:03.798183  4585 raft_consensus.cc:493] T ad48d60224d54518b33057b28cbef56b P ed488ca31ad54b53836e5a10d053b568 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:03.798590  4585 raft_consensus.cc:3060] T ad48d60224d54518b33057b28cbef56b P ed488ca31ad54b53836e5a10d053b568 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:03.808815  4585 raft_consensus.cc:515] T ad48d60224d54518b33057b28cbef56b P ed488ca31ad54b53836e5a10d053b568 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.813210  4731 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad48d60224d54518b33057b28cbef56b" candidate_uuid: "ed488ca31ad54b53836e5a10d053b568" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b"
I20260709 13:13:03.813839  4731 raft_consensus.cc:3055] T ad48d60224d54518b33057b28cbef56b P 308ac45a3f334cdcac265c0cfbbc039b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:03.814142  4731 raft_consensus.cc:740] T ad48d60224d54518b33057b28cbef56b P 308ac45a3f334cdcac265c0cfbbc039b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 308ac45a3f334cdcac265c0cfbbc039b, State: Running, Role: LEADER
I20260709 13:13:03.814838  4731 consensus_queue.cc:260] T ad48d60224d54518b33057b28cbef56b P 308ac45a3f334cdcac265c0cfbbc039b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.815905  4731 raft_consensus.cc:3060] T ad48d60224d54518b33057b28cbef56b P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:03.816138  4783 consensus_queue.cc:1048] T 2d50b7657708498da25d2ca6b238746d P c800c72b860f42878733b72fa57c227e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:03.816524  4660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad48d60224d54518b33057b28cbef56b" candidate_uuid: "ed488ca31ad54b53836e5a10d053b568" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c800c72b860f42878733b72fa57c227e"
I20260709 13:13:03.817077  4660 raft_consensus.cc:3060] T ad48d60224d54518b33057b28cbef56b P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:03.823781  4731 raft_consensus.cc:2468] T ad48d60224d54518b33057b28cbef56b P 308ac45a3f334cdcac265c0cfbbc039b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed488ca31ad54b53836e5a10d053b568 in term 2.
I20260709 13:13:03.824635  4585 leader_election.cc:290] T ad48d60224d54518b33057b28cbef56b P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 2 election: Requested vote from peers c800c72b860f42878733b72fa57c227e (127.28.54.66:43707), 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965)
I20260709 13:13:03.825088  4548 leader_election.cc:304] T ad48d60224d54518b33057b28cbef56b P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 308ac45a3f334cdcac265c0cfbbc039b, ed488ca31ad54b53836e5a10d053b568; no voters: 
I20260709 13:13:03.825893  4880 raft_consensus.cc:2804] T ad48d60224d54518b33057b28cbef56b P ed488ca31ad54b53836e5a10d053b568 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:03.826337  4880 raft_consensus.cc:697] T ad48d60224d54518b33057b28cbef56b P ed488ca31ad54b53836e5a10d053b568 [term 2 LEADER]: Becoming Leader. State: Replica: ed488ca31ad54b53836e5a10d053b568, State: Running, Role: LEADER
I20260709 13:13:03.826877  4660 raft_consensus.cc:2468] T ad48d60224d54518b33057b28cbef56b P c800c72b860f42878733b72fa57c227e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed488ca31ad54b53836e5a10d053b568 in term 2.
I20260709 13:13:03.826951  4880 consensus_queue.cc:237] T ad48d60224d54518b33057b28cbef56b P ed488ca31ad54b53836e5a10d053b568 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.837203  4896 consensus_queue.cc:1048] T 2d50b7657708498da25d2ca6b238746d P c800c72b860f42878733b72fa57c227e [LEADER]: Connected to new peer: Peer: permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:03.844821  4783 consensus_queue.cc:1048] T 886cca6de3e54269a85c11555b07822f P c800c72b860f42878733b72fa57c227e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:03.844967  4483 catalog_manager.cc:5697] T ad48d60224d54518b33057b28cbef56b P ed488ca31ad54b53836e5a10d053b568 reported cstate change: term changed from 1 to 2, leader changed from 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67) to ed488ca31ad54b53836e5a10d053b568 (127.28.54.65). New cstate: current_term: 2 leader_uuid: "ed488ca31ad54b53836e5a10d053b568" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:03.851888  4896 raft_consensus.cc:993] T 886cca6de3e54269a85c11555b07822f P c800c72b860f42878733b72fa57c227e: : Instructing follower ed488ca31ad54b53836e5a10d053b568 to start an election
I20260709 13:13:03.852286  4896 raft_consensus.cc:1081] T 886cca6de3e54269a85c11555b07822f P c800c72b860f42878733b72fa57c227e [term 1 LEADER]: Signalling peer ed488ca31ad54b53836e5a10d053b568 to start an election
I20260709 13:13:03.856326  4585 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "886cca6de3e54269a85c11555b07822f"
dest_uuid: "ed488ca31ad54b53836e5a10d053b568"
 from {username='slave'} at 127.0.0.1:51466
I20260709 13:13:03.856887  4585 raft_consensus.cc:493] T 886cca6de3e54269a85c11555b07822f P ed488ca31ad54b53836e5a10d053b568 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:03.857293  4585 raft_consensus.cc:3060] T 886cca6de3e54269a85c11555b07822f P ed488ca31ad54b53836e5a10d053b568 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:03.862730  4896 consensus_queue.cc:1048] T 886cca6de3e54269a85c11555b07822f P c800c72b860f42878733b72fa57c227e [LEADER]: Connected to new peer: Peer: permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:03.863826  4880 consensus_queue.cc:1048] T bf723babacbc4c8887c87a9fe84d6992 P ed488ca31ad54b53836e5a10d053b568 [LEADER]: Connected to new peer: Peer: permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:03.866037  4585 raft_consensus.cc:515] T 886cca6de3e54269a85c11555b07822f P ed488ca31ad54b53836e5a10d053b568 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.871579  4585 leader_election.cc:290] T 886cca6de3e54269a85c11555b07822f P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 2 election: Requested vote from peers c800c72b860f42878733b72fa57c227e (127.28.54.66:43707), 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965)
I20260709 13:13:03.871724  4660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "886cca6de3e54269a85c11555b07822f" candidate_uuid: "ed488ca31ad54b53836e5a10d053b568" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c800c72b860f42878733b72fa57c227e"
I20260709 13:13:03.872623  4734 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "886cca6de3e54269a85c11555b07822f" candidate_uuid: "ed488ca31ad54b53836e5a10d053b568" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b"
I20260709 13:13:03.872409  4660 raft_consensus.cc:3055] T 886cca6de3e54269a85c11555b07822f P c800c72b860f42878733b72fa57c227e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:03.874280  4660 raft_consensus.cc:740] T 886cca6de3e54269a85c11555b07822f P c800c72b860f42878733b72fa57c227e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c800c72b860f42878733b72fa57c227e, State: Running, Role: LEADER
I20260709 13:13:03.875236  4660 consensus_queue.cc:260] T 886cca6de3e54269a85c11555b07822f P c800c72b860f42878733b72fa57c227e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.876361  4660 raft_consensus.cc:3060] T 886cca6de3e54269a85c11555b07822f P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:03.883513  4898 consensus_queue.cc:1048] T bf723babacbc4c8887c87a9fe84d6992 P ed488ca31ad54b53836e5a10d053b568 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:03.884092  4660 raft_consensus.cc:2468] T 886cca6de3e54269a85c11555b07822f P c800c72b860f42878733b72fa57c227e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ed488ca31ad54b53836e5a10d053b568 in term 2.
I20260709 13:13:03.885687  4550 leader_election.cc:304] T 886cca6de3e54269a85c11555b07822f P ed488ca31ad54b53836e5a10d053b568 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c800c72b860f42878733b72fa57c227e, ed488ca31ad54b53836e5a10d053b568; no voters: 308ac45a3f334cdcac265c0cfbbc039b
I20260709 13:13:03.886466  4898 raft_consensus.cc:2804] T 886cca6de3e54269a85c11555b07822f P ed488ca31ad54b53836e5a10d053b568 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:03.887071  4898 raft_consensus.cc:697] T 886cca6de3e54269a85c11555b07822f P ed488ca31ad54b53836e5a10d053b568 [term 2 LEADER]: Becoming Leader. State: Replica: ed488ca31ad54b53836e5a10d053b568, State: Running, Role: LEADER
I20260709 13:13:03.888415  4898 consensus_queue.cc:237] T 886cca6de3e54269a85c11555b07822f P ed488ca31ad54b53836e5a10d053b568 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.900013  4483 catalog_manager.cc:5697] T 886cca6de3e54269a85c11555b07822f P ed488ca31ad54b53836e5a10d053b568 reported cstate change: term changed from 1 to 2, leader changed from c800c72b860f42878733b72fa57c227e (127.28.54.66) to ed488ca31ad54b53836e5a10d053b568 (127.28.54.65). New cstate: current_term: 2 leader_uuid: "ed488ca31ad54b53836e5a10d053b568" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:03.903769  4902 consensus_queue.cc:1048] T 1c91359ff2954c87a2caee08711bd33e P ed488ca31ad54b53836e5a10d053b568 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:03.914829  4902 raft_consensus.cc:993] T 1c91359ff2954c87a2caee08711bd33e P ed488ca31ad54b53836e5a10d053b568: : Instructing follower c800c72b860f42878733b72fa57c227e to start an election
I20260709 13:13:03.915259  4902 raft_consensus.cc:1081] T 1c91359ff2954c87a2caee08711bd33e P ed488ca31ad54b53836e5a10d053b568 [term 1 LEADER]: Signalling peer c800c72b860f42878733b72fa57c227e to start an election
I20260709 13:13:03.918723  4659 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c91359ff2954c87a2caee08711bd33e"
dest_uuid: "c800c72b860f42878733b72fa57c227e"
 from {username='slave'} at 127.0.0.1:43464
I20260709 13:13:03.919797  4659 raft_consensus.cc:493] T 1c91359ff2954c87a2caee08711bd33e P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:03.920192  4659 raft_consensus.cc:3060] T 1c91359ff2954c87a2caee08711bd33e P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:03.921149  4880 consensus_queue.cc:1048] T 1c91359ff2954c87a2caee08711bd33e P ed488ca31ad54b53836e5a10d053b568 [LEADER]: Connected to new peer: Peer: permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:03.927407  4659 raft_consensus.cc:515] T 1c91359ff2954c87a2caee08711bd33e P c800c72b860f42878733b72fa57c227e [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.930541  4732 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c91359ff2954c87a2caee08711bd33e" candidate_uuid: "c800c72b860f42878733b72fa57c227e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b"
I20260709 13:13:03.930536  4585 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c91359ff2954c87a2caee08711bd33e" candidate_uuid: "c800c72b860f42878733b72fa57c227e" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed488ca31ad54b53836e5a10d053b568"
I20260709 13:13:03.931324  4585 raft_consensus.cc:3055] T 1c91359ff2954c87a2caee08711bd33e P ed488ca31ad54b53836e5a10d053b568 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:03.931627  4585 raft_consensus.cc:740] T 1c91359ff2954c87a2caee08711bd33e P ed488ca31ad54b53836e5a10d053b568 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed488ca31ad54b53836e5a10d053b568, State: Running, Role: LEADER
I20260709 13:13:03.932369  4585 consensus_queue.cc:260] T 1c91359ff2954c87a2caee08711bd33e P ed488ca31ad54b53836e5a10d053b568 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.933238  4585 raft_consensus.cc:3060] T 1c91359ff2954c87a2caee08711bd33e P ed488ca31ad54b53836e5a10d053b568 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:03.940541  4585 raft_consensus.cc:2468] T 1c91359ff2954c87a2caee08711bd33e P ed488ca31ad54b53836e5a10d053b568 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c800c72b860f42878733b72fa57c227e in term 2.
I20260709 13:13:03.941025  4659 leader_election.cc:290] T 1c91359ff2954c87a2caee08711bd33e P c800c72b860f42878733b72fa57c227e [CANDIDATE]: Term 2 election: Requested vote from peers ed488ca31ad54b53836e5a10d053b568 (127.28.54.65:36419), 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67:43965)
I20260709 13:13:03.941351  4625 leader_election.cc:304] T 1c91359ff2954c87a2caee08711bd33e P c800c72b860f42878733b72fa57c227e [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c800c72b860f42878733b72fa57c227e, ed488ca31ad54b53836e5a10d053b568; no voters: 308ac45a3f334cdcac265c0cfbbc039b
I20260709 13:13:03.942188  4896 raft_consensus.cc:2804] T 1c91359ff2954c87a2caee08711bd33e P c800c72b860f42878733b72fa57c227e [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:03.942603  4896 raft_consensus.cc:697] T 1c91359ff2954c87a2caee08711bd33e P c800c72b860f42878733b72fa57c227e [term 2 LEADER]: Becoming Leader. State: Replica: c800c72b860f42878733b72fa57c227e, State: Running, Role: LEADER
I20260709 13:13:03.943243  4896 consensus_queue.cc:237] T 1c91359ff2954c87a2caee08711bd33e P c800c72b860f42878733b72fa57c227e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:03.949290  4479 catalog_manager.cc:5697] T 1c91359ff2954c87a2caee08711bd33e P c800c72b860f42878733b72fa57c227e reported cstate change: term changed from 1 to 2, leader changed from ed488ca31ad54b53836e5a10d053b568 (127.28.54.65) to c800c72b860f42878733b72fa57c227e (127.28.54.66). New cstate: current_term: 2 leader_uuid: "c800c72b860f42878733b72fa57c227e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:04.037698  4896 consensus_queue.cc:1048] T 1e6249d3f0d24da1955671f551e05009 P c800c72b860f42878733b72fa57c227e [LEADER]: Connected to new peer: Peer: permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:04.048256  4896 consensus_queue.cc:1048] T 1e6249d3f0d24da1955671f551e05009 P c800c72b860f42878733b72fa57c227e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:04.075958  4937 consensus_queue.cc:1048] T 5e58e02271134e058cd0af272aa9be5b P ed488ca31ad54b53836e5a10d053b568 [LEADER]: Connected to new peer: Peer: permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:04.081025  4896 consensus_queue.cc:1048] T fe8690eb51c946f282a28a9a065cf575 P c800c72b860f42878733b72fa57c227e [LEADER]: Connected to new peer: Peer: permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:04.081878  4880 raft_consensus.cc:993] T 5e58e02271134e058cd0af272aa9be5b P ed488ca31ad54b53836e5a10d053b568: : Instructing follower 308ac45a3f334cdcac265c0cfbbc039b to start an election
I20260709 13:13:04.082371  4880 raft_consensus.cc:1081] T 5e58e02271134e058cd0af272aa9be5b P ed488ca31ad54b53836e5a10d053b568 [term 1 LEADER]: Signalling peer 308ac45a3f334cdcac265c0cfbbc039b to start an election
I20260709 13:13:04.086920  4732 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e58e02271134e058cd0af272aa9be5b"
dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b"
 from {username='slave'} at 127.0.0.1:39278
I20260709 13:13:04.088686  4732 raft_consensus.cc:493] T 5e58e02271134e058cd0af272aa9be5b P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:04.089126  4732 raft_consensus.cc:3060] T 5e58e02271134e058cd0af272aa9be5b P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:04.089588  4880 consensus_queue.cc:1048] T 5e58e02271134e058cd0af272aa9be5b P ed488ca31ad54b53836e5a10d053b568 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:04.098037  4732 raft_consensus.cc:515] T 5e58e02271134e058cd0af272aa9be5b P 308ac45a3f334cdcac265c0cfbbc039b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:04.100801  4584 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e58e02271134e058cd0af272aa9be5b" candidate_uuid: "308ac45a3f334cdcac265c0cfbbc039b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed488ca31ad54b53836e5a10d053b568"
I20260709 13:13:04.101351  4584 raft_consensus.cc:3055] T 5e58e02271134e058cd0af272aa9be5b P ed488ca31ad54b53836e5a10d053b568 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:04.101640  4584 raft_consensus.cc:740] T 5e58e02271134e058cd0af272aa9be5b P ed488ca31ad54b53836e5a10d053b568 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ed488ca31ad54b53836e5a10d053b568, State: Running, Role: LEADER
I20260709 13:13:04.101645  4890 consensus_queue.cc:1048] T fe8690eb51c946f282a28a9a065cf575 P c800c72b860f42878733b72fa57c227e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:04.102703  4584 consensus_queue.cc:260] T 5e58e02271134e058cd0af272aa9be5b P ed488ca31ad54b53836e5a10d053b568 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:04.103681  4584 raft_consensus.cc:3060] T 5e58e02271134e058cd0af272aa9be5b P ed488ca31ad54b53836e5a10d053b568 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:04.105087  4732 leader_election.cc:290] T 5e58e02271134e058cd0af272aa9be5b P 308ac45a3f334cdcac265c0cfbbc039b [CANDIDATE]: Term 2 election: Requested vote from peers ed488ca31ad54b53836e5a10d053b568 (127.28.54.65:36419), c800c72b860f42878733b72fa57c227e (127.28.54.66:43707)
I20260709 13:13:04.106339  4660 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e58e02271134e058cd0af272aa9be5b" candidate_uuid: "308ac45a3f334cdcac265c0cfbbc039b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c800c72b860f42878733b72fa57c227e"
I20260709 13:13:04.111990  4584 raft_consensus.cc:2468] T 5e58e02271134e058cd0af272aa9be5b P ed488ca31ad54b53836e5a10d053b568 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 308ac45a3f334cdcac265c0cfbbc039b in term 2.
I20260709 13:13:04.113026  4699 leader_election.cc:304] T 5e58e02271134e058cd0af272aa9be5b P 308ac45a3f334cdcac265c0cfbbc039b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 308ac45a3f334cdcac265c0cfbbc039b, ed488ca31ad54b53836e5a10d053b568; no voters: c800c72b860f42878733b72fa57c227e
I20260709 13:13:04.113932  4925 raft_consensus.cc:2804] T 5e58e02271134e058cd0af272aa9be5b P 308ac45a3f334cdcac265c0cfbbc039b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:04.114390  4925 raft_consensus.cc:697] T 5e58e02271134e058cd0af272aa9be5b P 308ac45a3f334cdcac265c0cfbbc039b [term 2 LEADER]: Becoming Leader. State: Replica: 308ac45a3f334cdcac265c0cfbbc039b, State: Running, Role: LEADER
I20260709 13:13:04.115192  4925 consensus_queue.cc:237] T 5e58e02271134e058cd0af272aa9be5b P 308ac45a3f334cdcac265c0cfbbc039b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:04.122720  4479 catalog_manager.cc:5697] T 5e58e02271134e058cd0af272aa9be5b P 308ac45a3f334cdcac265c0cfbbc039b reported cstate change: term changed from 1 to 2, leader changed from ed488ca31ad54b53836e5a10d053b568 (127.28.54.65) to 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67). New cstate: current_term: 2 leader_uuid: "308ac45a3f334cdcac265c0cfbbc039b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:04.303686  4732 raft_consensus.cc:3060] T 886cca6de3e54269a85c11555b07822f P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:04.304144  4659 raft_consensus.cc:1275] T 886cca6de3e54269a85c11555b07822f P c800c72b860f42878733b72fa57c227e [term 2 FOLLOWER]: Refusing update from remote peer ed488ca31ad54b53836e5a10d053b568: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:04.305433  4880 consensus_queue.cc:1048] T 886cca6de3e54269a85c11555b07822f P ed488ca31ad54b53836e5a10d053b568 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:04.310221  4732 raft_consensus.cc:1275] T 886cca6de3e54269a85c11555b07822f P 308ac45a3f334cdcac265c0cfbbc039b [term 2 FOLLOWER]: Refusing update from remote peer ed488ca31ad54b53836e5a10d053b568: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:04.311820  4880 consensus_queue.cc:1048] T 886cca6de3e54269a85c11555b07822f P ed488ca31ad54b53836e5a10d053b568 [LEADER]: Connected to new peer: Peer: permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:04.334503  4585 raft_consensus.cc:1275] T 1c91359ff2954c87a2caee08711bd33e P ed488ca31ad54b53836e5a10d053b568 [term 2 FOLLOWER]: Refusing update from remote peer c800c72b860f42878733b72fa57c227e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:04.335757  4890 consensus_queue.cc:1048] T 1c91359ff2954c87a2caee08711bd33e P c800c72b860f42878733b72fa57c227e [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:04.340184  4659 raft_consensus.cc:1275] T ad48d60224d54518b33057b28cbef56b P c800c72b860f42878733b72fa57c227e [term 2 FOLLOWER]: Refusing update from remote peer ed488ca31ad54b53836e5a10d053b568: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:04.341600  4880 consensus_queue.cc:1048] T ad48d60224d54518b33057b28cbef56b P ed488ca31ad54b53836e5a10d053b568 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:04.342555  4731 raft_consensus.cc:3060] T 1c91359ff2954c87a2caee08711bd33e P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:04.349617  4732 raft_consensus.cc:1275] T ad48d60224d54518b33057b28cbef56b P 308ac45a3f334cdcac265c0cfbbc039b [term 2 FOLLOWER]: Refusing update from remote peer ed488ca31ad54b53836e5a10d053b568: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:04.351035  4937 consensus_queue.cc:1048] T ad48d60224d54518b33057b28cbef56b P ed488ca31ad54b53836e5a10d053b568 [LEADER]: Connected to new peer: Peer: permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:04.356828  4731 raft_consensus.cc:1275] T 1c91359ff2954c87a2caee08711bd33e P 308ac45a3f334cdcac265c0cfbbc039b [term 2 FOLLOWER]: Refusing update from remote peer c800c72b860f42878733b72fa57c227e: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:04.358395  4890 consensus_queue.cc:1048] T 1c91359ff2954c87a2caee08711bd33e P c800c72b860f42878733b72fa57c227e [LEADER]: Connected to new peer: Peer: permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:04.538539  4585 raft_consensus.cc:1275] T 5e58e02271134e058cd0af272aa9be5b P ed488ca31ad54b53836e5a10d053b568 [term 2 FOLLOWER]: Refusing update from remote peer 308ac45a3f334cdcac265c0cfbbc039b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:04.539640  4925 consensus_queue.cc:1048] T 5e58e02271134e058cd0af272aa9be5b P 308ac45a3f334cdcac265c0cfbbc039b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:04.546557  4659 raft_consensus.cc:3060] T 5e58e02271134e058cd0af272aa9be5b P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:04.552868  4659 raft_consensus.cc:1275] T 5e58e02271134e058cd0af272aa9be5b P c800c72b860f42878733b72fa57c227e [term 2 FOLLOWER]: Refusing update from remote peer 308ac45a3f334cdcac265c0cfbbc039b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:04.553936  4925 consensus_queue.cc:1048] T 5e58e02271134e058cd0af272aa9be5b P 308ac45a3f334cdcac265c0cfbbc039b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:06.760619  4479 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34394:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:13:06.783322  4479 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34394:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:13:06.807471 28889 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:13:06.879061  4981 tablet.cc:1724] T 886cca6de3e54269a85c11555b07822f P ed488ca31ad54b53836e5a10d053b568: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:06.950848  4985 tablet.cc:1724] T 886cca6de3e54269a85c11555b07822f P 308ac45a3f334cdcac265c0cfbbc039b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:06.991617  4977 log.cc:927] Time spent T 2d50b7657708498da25d2ca6b238746d P c800c72b860f42878733b72fa57c227e: Append to log took a long time: real 0.105s	user 0.003s	sys 0.000s
W20260709 13:13:07.009433  4760 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:886cca6de3e54269a85c11555b07822f)
I20260709 13:13:07.009960  5005 tablet.cc:1724] T 886cca6de3e54269a85c11555b07822f P c800c72b860f42878733b72fa57c227e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:07.014328  4760 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:886cca6de3e54269a85c11555b07822f)
W20260709 13:13:07.030146  4760 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:886cca6de3e54269a85c11555b07822f)
I20260709 13:13:07.055183  5006 tablet.cc:1724] T 5e58e02271134e058cd0af272aa9be5b P 308ac45a3f334cdcac265c0cfbbc039b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:07.058200  4656 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2d50b7657708498da25d2ca6b238746d"
dest_uuid: "c800c72b860f42878733b72fa57c227e"
mode: GRACEFUL
new_leader_uuid: "308ac45a3f334cdcac265c0cfbbc039b"
 from {username='slave'} at 127.0.0.1:43486
I20260709 13:13:07.058935  4656 raft_consensus.cc:606] T 2d50b7657708498da25d2ca6b238746d P c800c72b860f42878733b72fa57c227e [term 1 LEADER]: Received request to transfer leadership to TS 308ac45a3f334cdcac265c0cfbbc039b
I20260709 13:13:07.077536  5012 tablet.cc:1724] T 2d50b7657708498da25d2ca6b238746d P 308ac45a3f334cdcac265c0cfbbc039b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:07.095621  5011 tablet.cc:1724] T 5e58e02271134e058cd0af272aa9be5b P ed488ca31ad54b53836e5a10d053b568: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:07.097311  5004 tablet.cc:1724] T 2d50b7657708498da25d2ca6b238746d P c800c72b860f42878733b72fa57c227e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:07.117671  5015 raft_consensus.cc:993] T 2d50b7657708498da25d2ca6b238746d P c800c72b860f42878733b72fa57c227e: : Instructing follower 308ac45a3f334cdcac265c0cfbbc039b to start an election
I20260709 13:13:07.122035  5015 raft_consensus.cc:1081] T 2d50b7657708498da25d2ca6b238746d P c800c72b860f42878733b72fa57c227e [term 1 LEADER]: Signalling peer 308ac45a3f334cdcac265c0cfbbc039b to start an election
W20260709 13:13:07.145061  5002 log.cc:927] Time spent T ad48d60224d54518b33057b28cbef56b P c800c72b860f42878733b72fa57c227e: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 13:13:07.145736  5005 tablet.cc:1724] T fe8690eb51c946f282a28a9a065cf575 P c800c72b860f42878733b72fa57c227e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:07.154817  4732 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2d50b7657708498da25d2ca6b238746d"
dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b"
 from {username='slave'} at 127.0.0.1:39280
I20260709 13:13:07.165009  5013 tablet.cc:1724] T ad48d60224d54518b33057b28cbef56b P ed488ca31ad54b53836e5a10d053b568: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:07.166419  5022 tablet.cc:1724] T 5e58e02271134e058cd0af272aa9be5b P c800c72b860f42878733b72fa57c227e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:07.157851  4985 tablet.cc:1724] T bf723babacbc4c8887c87a9fe84d6992 P 308ac45a3f334cdcac265c0cfbbc039b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:07.173900  5012 tablet.cc:1724] T ad48d60224d54518b33057b28cbef56b P 308ac45a3f334cdcac265c0cfbbc039b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:07.174691  4732 raft_consensus.cc:493] T 2d50b7657708498da25d2ca6b238746d P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:07.175205  4732 raft_consensus.cc:3060] T 2d50b7657708498da25d2ca6b238746d P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:07.178134  4981 tablet.cc:1724] T bf723babacbc4c8887c87a9fe84d6992 P ed488ca31ad54b53836e5a10d053b568: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:07.196058  5020 tablet.cc:1724] T 1c91359ff2954c87a2caee08711bd33e P c800c72b860f42878733b72fa57c227e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:07.206655  5021 tablet.cc:1724] T fe8690eb51c946f282a28a9a065cf575 P ed488ca31ad54b53836e5a10d053b568: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:07.209244  5020 tablet.cc:1724] T 1e6249d3f0d24da1955671f551e05009 P c800c72b860f42878733b72fa57c227e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:07.218070  5004 tablet.cc:1724] T cd72c6318be5424f9c7a36d563d8cd32 P c800c72b860f42878733b72fa57c227e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:07.229183  5004 tablet.cc:1724] T ad48d60224d54518b33057b28cbef56b P c800c72b860f42878733b72fa57c227e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:07.192420  5024 tablet.cc:1724] T 1e6249d3f0d24da1955671f551e05009 P 308ac45a3f334cdcac265c0cfbbc039b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:07.216922  5006 tablet.cc:1724] T cd72c6318be5424f9c7a36d563d8cd32 P 308ac45a3f334cdcac265c0cfbbc039b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:07.246618  5021 tablet.cc:1724] T cd72c6318be5424f9c7a36d563d8cd32 P ed488ca31ad54b53836e5a10d053b568: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:07.251070  5012 tablet.cc:1724] T fe8690eb51c946f282a28a9a065cf575 P 308ac45a3f334cdcac265c0cfbbc039b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:07.262820  5022 tablet.cc:1724] T bf723babacbc4c8887c87a9fe84d6992 P c800c72b860f42878733b72fa57c227e: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:07.269496  5024 tablet.cc:1724] T 1c91359ff2954c87a2caee08711bd33e P 308ac45a3f334cdcac265c0cfbbc039b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:07.272502  5013 tablet.cc:1724] T 1e6249d3f0d24da1955671f551e05009 P ed488ca31ad54b53836e5a10d053b568: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:07.257906  4732 raft_consensus.cc:515] T 2d50b7657708498da25d2ca6b238746d P 308ac45a3f334cdcac265c0cfbbc039b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:07.258543  5021 tablet.cc:1724] T 1c91359ff2954c87a2caee08711bd33e P ed488ca31ad54b53836e5a10d053b568: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:07.276925  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d50b7657708498da25d2ca6b238746d" candidate_uuid: "308ac45a3f334cdcac265c0cfbbc039b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "ed488ca31ad54b53836e5a10d053b568"
I20260709 13:13:07.277643  4583 raft_consensus.cc:3060] T 2d50b7657708498da25d2ca6b238746d P ed488ca31ad54b53836e5a10d053b568 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:07.277743  4655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2d50b7657708498da25d2ca6b238746d" candidate_uuid: "308ac45a3f334cdcac265c0cfbbc039b" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "c800c72b860f42878733b72fa57c227e"
I20260709 13:13:07.278441  4655 raft_consensus.cc:3055] T 2d50b7657708498da25d2ca6b238746d P c800c72b860f42878733b72fa57c227e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:07.278748  4655 raft_consensus.cc:740] T 2d50b7657708498da25d2ca6b238746d P c800c72b860f42878733b72fa57c227e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c800c72b860f42878733b72fa57c227e, State: Running, Role: LEADER
I20260709 13:13:07.279662  4655 consensus_queue.cc:260] T 2d50b7657708498da25d2ca6b238746d P c800c72b860f42878733b72fa57c227e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:07.258814  5011 tablet.cc:1724] T 2d50b7657708498da25d2ca6b238746d P ed488ca31ad54b53836e5a10d053b568: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:07.280848  4655 raft_consensus.cc:3060] T 2d50b7657708498da25d2ca6b238746d P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:07.283083  4732 leader_election.cc:290] T 2d50b7657708498da25d2ca6b238746d P 308ac45a3f334cdcac265c0cfbbc039b [CANDIDATE]: Term 2 election: Requested vote from peers ed488ca31ad54b53836e5a10d053b568 (127.28.54.65:36419), c800c72b860f42878733b72fa57c227e (127.28.54.66:43707)
I20260709 13:13:07.285159  4583 raft_consensus.cc:2468] T 2d50b7657708498da25d2ca6b238746d P ed488ca31ad54b53836e5a10d053b568 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 308ac45a3f334cdcac265c0cfbbc039b in term 2.
I20260709 13:13:07.298939  4699 leader_election.cc:304] T 2d50b7657708498da25d2ca6b238746d P 308ac45a3f334cdcac265c0cfbbc039b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 308ac45a3f334cdcac265c0cfbbc039b, ed488ca31ad54b53836e5a10d053b568; no voters: 
I20260709 13:13:07.299961  4925 raft_consensus.cc:2804] T 2d50b7657708498da25d2ca6b238746d P 308ac45a3f334cdcac265c0cfbbc039b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:07.300454  4925 raft_consensus.cc:697] T 2d50b7657708498da25d2ca6b238746d P 308ac45a3f334cdcac265c0cfbbc039b [term 2 LEADER]: Becoming Leader. State: Replica: 308ac45a3f334cdcac265c0cfbbc039b, State: Running, Role: LEADER
I20260709 13:13:07.301410  4925 consensus_queue.cc:237] T 2d50b7657708498da25d2ca6b238746d P 308ac45a3f334cdcac265c0cfbbc039b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:07.311774  4655 raft_consensus.cc:2468] T 2d50b7657708498da25d2ca6b238746d P c800c72b860f42878733b72fa57c227e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 308ac45a3f334cdcac265c0cfbbc039b in term 2.
I20260709 13:13:07.317202  4583 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ad48d60224d54518b33057b28cbef56b"
dest_uuid: "ed488ca31ad54b53836e5a10d053b568"
mode: GRACEFUL
new_leader_uuid: "308ac45a3f334cdcac265c0cfbbc039b"
 from {username='slave'} at 127.0.0.1:39382
I20260709 13:13:07.317831  4583 raft_consensus.cc:606] T ad48d60224d54518b33057b28cbef56b P ed488ca31ad54b53836e5a10d053b568 [term 2 LEADER]: Received request to transfer leadership to TS 308ac45a3f334cdcac265c0cfbbc039b
I20260709 13:13:07.319350 28889 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 13:13:07.319964 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:07.325383  4482 catalog_manager.cc:6242] T 00000000000000000000000000000000 P d807ea9b011c4093877294934d6364d9: soft_deleted_table [id=6be13d5630a24c88b897bbaa1fa581ac] alter complete (version 1)
I20260709 13:13:07.330806  4583 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c437ad3104ee4400a2917a4e7c362efa"
dest_uuid: "ed488ca31ad54b53836e5a10d053b568"
mode: GRACEFUL
new_leader_uuid: "308ac45a3f334cdcac265c0cfbbc039b"
 from {username='slave'} at 127.0.0.1:39382
I20260709 13:13:07.331360  4583 raft_consensus.cc:606] T c437ad3104ee4400a2917a4e7c362efa P ed488ca31ad54b53836e5a10d053b568 [term 2 LEADER]: Received request to transfer leadership to TS 308ac45a3f334cdcac265c0cfbbc039b
I20260709 13:13:07.335669  4655 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d9d05411f1e749669cdf7c1be8d9d941"
dest_uuid: "c800c72b860f42878733b72fa57c227e"
mode: GRACEFUL
new_leader_uuid: "308ac45a3f334cdcac265c0cfbbc039b"
 from {username='slave'} at 127.0.0.1:43486
I20260709 13:13:07.336238  4655 raft_consensus.cc:606] T d9d05411f1e749669cdf7c1be8d9d941 P c800c72b860f42878733b72fa57c227e [term 1 LEADER]: Received request to transfer leadership to TS 308ac45a3f334cdcac265c0cfbbc039b
I20260709 13:13:07.341703 28889 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:13:07.342289 28889 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:07.342298  4479 catalog_manager.cc:5697] T 2d50b7657708498da25d2ca6b238746d P 308ac45a3f334cdcac265c0cfbbc039b reported cstate change: term changed from 1 to 2, leader changed from c800c72b860f42878733b72fa57c227e (127.28.54.66) to 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67). New cstate: current_term: 2 leader_uuid: "308ac45a3f334cdcac265c0cfbbc039b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:07.360659  4968 raft_consensus.cc:993] T c437ad3104ee4400a2917a4e7c362efa P ed488ca31ad54b53836e5a10d053b568: : Instructing follower 308ac45a3f334cdcac265c0cfbbc039b to start an election
I20260709 13:13:07.361109  4950 raft_consensus.cc:1081] T c437ad3104ee4400a2917a4e7c362efa P ed488ca31ad54b53836e5a10d053b568 [term 2 LEADER]: Signalling peer 308ac45a3f334cdcac265c0cfbbc039b to start an election
I20260709 13:13:07.362455  4732 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c437ad3104ee4400a2917a4e7c362efa"
dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b"
 from {username='slave'} at 127.0.0.1:39278
I20260709 13:13:07.362861  4732 raft_consensus.cc:493] T c437ad3104ee4400a2917a4e7c362efa P 308ac45a3f334cdcac265c0cfbbc039b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:07.363098  4732 raft_consensus.cc:3060] T c437ad3104ee4400a2917a4e7c362efa P 308ac45a3f334cdcac265c0cfbbc039b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:07.367645  4732 raft_consensus.cc:515] T c437ad3104ee4400a2917a4e7c362efa P 308ac45a3f334cdcac265c0cfbbc039b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:07.369046  4732 leader_election.cc:290] T c437ad3104ee4400a2917a4e7c362efa P 308ac45a3f334cdcac265c0cfbbc039b [CANDIDATE]: Term 3 election: Requested vote from peers ed488ca31ad54b53836e5a10d053b568 (127.28.54.65:36419), c800c72b860f42878733b72fa57c227e (127.28.54.66:43707)
I20260709 13:13:07.369596  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c437ad3104ee4400a2917a4e7c362efa" candidate_uuid: "308ac45a3f334cdcac265c0cfbbc039b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ed488ca31ad54b53836e5a10d053b568"
I20260709 13:13:07.370007  4655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c437ad3104ee4400a2917a4e7c362efa" candidate_uuid: "308ac45a3f334cdcac265c0cfbbc039b" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c800c72b860f42878733b72fa57c227e"
I20260709 13:13:07.370244  4583 raft_consensus.cc:3055] T c437ad3104ee4400a2917a4e7c362efa P ed488ca31ad54b53836e5a10d053b568 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:07.370537  4655 raft_consensus.cc:3060] T c437ad3104ee4400a2917a4e7c362efa P c800c72b860f42878733b72fa57c227e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:07.370558  4583 raft_consensus.cc:740] T c437ad3104ee4400a2917a4e7c362efa P ed488ca31ad54b53836e5a10d053b568 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ed488ca31ad54b53836e5a10d053b568, State: Running, Role: LEADER
I20260709 13:13:07.371414  4583 consensus_queue.cc:260] T c437ad3104ee4400a2917a4e7c362efa P ed488ca31ad54b53836e5a10d053b568 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:07.372406  4583 raft_consensus.cc:3060] T c437ad3104ee4400a2917a4e7c362efa P ed488ca31ad54b53836e5a10d053b568 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:07.375268  4655 raft_consensus.cc:2468] T c437ad3104ee4400a2917a4e7c362efa P c800c72b860f42878733b72fa57c227e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 308ac45a3f334cdcac265c0cfbbc039b in term 3.
I20260709 13:13:07.376312  4699 leader_election.cc:304] T c437ad3104ee4400a2917a4e7c362efa P 308ac45a3f334cdcac265c0cfbbc039b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 308ac45a3f334cdcac265c0cfbbc039b, c800c72b860f42878733b72fa57c227e; no voters: 
I20260709 13:13:07.377066  4925 raft_consensus.cc:2804] T c437ad3104ee4400a2917a4e7c362efa P 308ac45a3f334cdcac265c0cfbbc039b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:07.377388  4583 raft_consensus.cc:2468] T c437ad3104ee4400a2917a4e7c362efa P ed488ca31ad54b53836e5a10d053b568 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 308ac45a3f334cdcac265c0cfbbc039b in term 3.
I20260709 13:13:07.377425  4925 raft_consensus.cc:697] T c437ad3104ee4400a2917a4e7c362efa P 308ac45a3f334cdcac265c0cfbbc039b [term 3 LEADER]: Becoming Leader. State: Replica: 308ac45a3f334cdcac265c0cfbbc039b, State: Running, Role: LEADER
I20260709 13:13:07.378400  4925 consensus_queue.cc:237] T c437ad3104ee4400a2917a4e7c362efa P 308ac45a3f334cdcac265c0cfbbc039b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:07.386258  4479 catalog_manager.cc:5697] T c437ad3104ee4400a2917a4e7c362efa P 308ac45a3f334cdcac265c0cfbbc039b reported cstate change: term changed from 2 to 3, leader changed from ed488ca31ad54b53836e5a10d053b568 (127.28.54.65) to 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67). New cstate: current_term: 3 leader_uuid: "308ac45a3f334cdcac265c0cfbbc039b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:07.421356  5014 raft_consensus.cc:993] T d9d05411f1e749669cdf7c1be8d9d941 P c800c72b860f42878733b72fa57c227e: : Instructing follower 308ac45a3f334cdcac265c0cfbbc039b to start an election
I20260709 13:13:07.421882  4993 raft_consensus.cc:1081] T d9d05411f1e749669cdf7c1be8d9d941 P c800c72b860f42878733b72fa57c227e [term 1 LEADER]: Signalling peer 308ac45a3f334cdcac265c0cfbbc039b to start an election
I20260709 13:13:07.423190  4732 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d9d05411f1e749669cdf7c1be8d9d941"
dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b"
 from {username='slave'} at 127.0.0.1:39280
I20260709 13:13:07.423569  4732 raft_consensus.cc:493] T d9d05411f1e749669cdf7c1be8d9d941 P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:07.423777  4732 raft_consensus.cc:3060] T d9d05411f1e749669cdf7c1be8d9d941 P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:07.427889  4732 raft_consensus.cc:515] T d9d05411f1e749669cdf7c1be8d9d941 P 308ac45a3f334cdcac265c0cfbbc039b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:07.429139  4732 leader_election.cc:290] T d9d05411f1e749669cdf7c1be8d9d941 P 308ac45a3f334cdcac265c0cfbbc039b [CANDIDATE]: Term 2 election: Requested vote from peers ed488ca31ad54b53836e5a10d053b568 (127.28.54.65:36419), c800c72b860f42878733b72fa57c227e (127.28.54.66:43707)
I20260709 13:13:07.429946  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d05411f1e749669cdf7c1be8d9d941" candidate_uuid: "308ac45a3f334cdcac265c0cfbbc039b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ed488ca31ad54b53836e5a10d053b568"
I20260709 13:13:07.430130  4655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d9d05411f1e749669cdf7c1be8d9d941" candidate_uuid: "308ac45a3f334cdcac265c0cfbbc039b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c800c72b860f42878733b72fa57c227e"
I20260709 13:13:07.430529  4583 raft_consensus.cc:3060] T d9d05411f1e749669cdf7c1be8d9d941 P ed488ca31ad54b53836e5a10d053b568 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:07.430634  4655 raft_consensus.cc:3055] T d9d05411f1e749669cdf7c1be8d9d941 P c800c72b860f42878733b72fa57c227e [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:07.431011  4655 raft_consensus.cc:740] T d9d05411f1e749669cdf7c1be8d9d941 P c800c72b860f42878733b72fa57c227e [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c800c72b860f42878733b72fa57c227e, State: Running, Role: LEADER
I20260709 13:13:07.431651  4655 consensus_queue.cc:260] T d9d05411f1e749669cdf7c1be8d9d941 P c800c72b860f42878733b72fa57c227e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:07.432548  4655 raft_consensus.cc:3060] T d9d05411f1e749669cdf7c1be8d9d941 P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:07.435428  4583 raft_consensus.cc:2468] T d9d05411f1e749669cdf7c1be8d9d941 P ed488ca31ad54b53836e5a10d053b568 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 308ac45a3f334cdcac265c0cfbbc039b in term 2.
I20260709 13:13:07.436389  4699 leader_election.cc:304] T d9d05411f1e749669cdf7c1be8d9d941 P 308ac45a3f334cdcac265c0cfbbc039b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 308ac45a3f334cdcac265c0cfbbc039b, ed488ca31ad54b53836e5a10d053b568; no voters: 
I20260709 13:13:07.437124  4925 raft_consensus.cc:2804] T d9d05411f1e749669cdf7c1be8d9d941 P 308ac45a3f334cdcac265c0cfbbc039b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:07.437494  4925 raft_consensus.cc:697] T d9d05411f1e749669cdf7c1be8d9d941 P 308ac45a3f334cdcac265c0cfbbc039b [term 2 LEADER]: Becoming Leader. State: Replica: 308ac45a3f334cdcac265c0cfbbc039b, State: Running, Role: LEADER
I20260709 13:13:07.437894  4655 raft_consensus.cc:2468] T d9d05411f1e749669cdf7c1be8d9d941 P c800c72b860f42878733b72fa57c227e [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 308ac45a3f334cdcac265c0cfbbc039b in term 2.
I20260709 13:13:07.438261  4925 consensus_queue.cc:237] T d9d05411f1e749669cdf7c1be8d9d941 P 308ac45a3f334cdcac265c0cfbbc039b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:07.445425  4479 catalog_manager.cc:5697] T d9d05411f1e749669cdf7c1be8d9d941 P 308ac45a3f334cdcac265c0cfbbc039b reported cstate change: term changed from 1 to 2, leader changed from c800c72b860f42878733b72fa57c227e (127.28.54.66) to 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67). New cstate: current_term: 2 leader_uuid: "308ac45a3f334cdcac265c0cfbbc039b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:07.501788  4968 raft_consensus.cc:993] T ad48d60224d54518b33057b28cbef56b P ed488ca31ad54b53836e5a10d053b568: : Instructing follower 308ac45a3f334cdcac265c0cfbbc039b to start an election
I20260709 13:13:07.502189  4950 raft_consensus.cc:1081] T ad48d60224d54518b33057b28cbef56b P ed488ca31ad54b53836e5a10d053b568 [term 2 LEADER]: Signalling peer 308ac45a3f334cdcac265c0cfbbc039b to start an election
I20260709 13:13:07.503384  4732 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ad48d60224d54518b33057b28cbef56b"
dest_uuid: "308ac45a3f334cdcac265c0cfbbc039b"
 from {username='slave'} at 127.0.0.1:39278
I20260709 13:13:07.503743  4732 raft_consensus.cc:493] T ad48d60224d54518b33057b28cbef56b P 308ac45a3f334cdcac265c0cfbbc039b [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:07.503958  4732 raft_consensus.cc:3060] T ad48d60224d54518b33057b28cbef56b P 308ac45a3f334cdcac265c0cfbbc039b [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:07.508147  4732 raft_consensus.cc:515] T ad48d60224d54518b33057b28cbef56b P 308ac45a3f334cdcac265c0cfbbc039b [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:07.509361  4732 leader_election.cc:290] T ad48d60224d54518b33057b28cbef56b P 308ac45a3f334cdcac265c0cfbbc039b [CANDIDATE]: Term 3 election: Requested vote from peers ed488ca31ad54b53836e5a10d053b568 (127.28.54.65:36419), c800c72b860f42878733b72fa57c227e (127.28.54.66:43707)
I20260709 13:13:07.510018  4583 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad48d60224d54518b33057b28cbef56b" candidate_uuid: "308ac45a3f334cdcac265c0cfbbc039b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "ed488ca31ad54b53836e5a10d053b568"
I20260709 13:13:07.510253  4655 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ad48d60224d54518b33057b28cbef56b" candidate_uuid: "308ac45a3f334cdcac265c0cfbbc039b" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "c800c72b860f42878733b72fa57c227e"
I20260709 13:13:07.510546  4583 raft_consensus.cc:3055] T ad48d60224d54518b33057b28cbef56b P ed488ca31ad54b53836e5a10d053b568 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:07.510773  4655 raft_consensus.cc:3060] T ad48d60224d54518b33057b28cbef56b P c800c72b860f42878733b72fa57c227e [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:07.510843  4583 raft_consensus.cc:740] T ad48d60224d54518b33057b28cbef56b P ed488ca31ad54b53836e5a10d053b568 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ed488ca31ad54b53836e5a10d053b568, State: Running, Role: LEADER
I20260709 13:13:07.511617  4583 consensus_queue.cc:260] T ad48d60224d54518b33057b28cbef56b P ed488ca31ad54b53836e5a10d053b568 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:07.512517  4583 raft_consensus.cc:3060] T ad48d60224d54518b33057b28cbef56b P ed488ca31ad54b53836e5a10d053b568 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:07.515600  4655 raft_consensus.cc:2468] T ad48d60224d54518b33057b28cbef56b P c800c72b860f42878733b72fa57c227e [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 308ac45a3f334cdcac265c0cfbbc039b in term 3.
I20260709 13:13:07.516500  4699 leader_election.cc:304] T ad48d60224d54518b33057b28cbef56b P 308ac45a3f334cdcac265c0cfbbc039b [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 308ac45a3f334cdcac265c0cfbbc039b, c800c72b860f42878733b72fa57c227e; no voters: 
I20260709 13:13:07.517216  4925 raft_consensus.cc:2804] T ad48d60224d54518b33057b28cbef56b P 308ac45a3f334cdcac265c0cfbbc039b [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:07.517331  4583 raft_consensus.cc:2468] T ad48d60224d54518b33057b28cbef56b P ed488ca31ad54b53836e5a10d053b568 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 308ac45a3f334cdcac265c0cfbbc039b in term 3.
I20260709 13:13:07.517617  4925 raft_consensus.cc:697] T ad48d60224d54518b33057b28cbef56b P 308ac45a3f334cdcac265c0cfbbc039b [term 3 LEADER]: Becoming Leader. State: Replica: 308ac45a3f334cdcac265c0cfbbc039b, State: Running, Role: LEADER
I20260709 13:13:07.518782  4925 consensus_queue.cc:237] T ad48d60224d54518b33057b28cbef56b P 308ac45a3f334cdcac265c0cfbbc039b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } }
I20260709 13:13:07.524664  4479 catalog_manager.cc:5697] T ad48d60224d54518b33057b28cbef56b P 308ac45a3f334cdcac265c0cfbbc039b reported cstate change: term changed from 2 to 3, leader changed from ed488ca31ad54b53836e5a10d053b568 (127.28.54.65) to 308ac45a3f334cdcac265c0cfbbc039b (127.28.54.67). New cstate: current_term: 3 leader_uuid: "308ac45a3f334cdcac265c0cfbbc039b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "308ac45a3f334cdcac265c0cfbbc039b" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 43965 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:07.688130  4583 raft_consensus.cc:1275] T 2d50b7657708498da25d2ca6b238746d P ed488ca31ad54b53836e5a10d053b568 [term 2 FOLLOWER]: Refusing update from remote peer 308ac45a3f334cdcac265c0cfbbc039b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:13:07.689246  4925 consensus_queue.cc:1048] T 2d50b7657708498da25d2ca6b238746d P 308ac45a3f334cdcac265c0cfbbc039b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:07.697546  4655 raft_consensus.cc:1275] T 2d50b7657708498da25d2ca6b238746d P c800c72b860f42878733b72fa57c227e [term 2 FOLLOWER]: Refusing update from remote peer 308ac45a3f334cdcac265c0cfbbc039b: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 13:13:07.698923  4925 consensus_queue.cc:1048] T 2d50b7657708498da25d2ca6b238746d P 308ac45a3f334cdcac265c0cfbbc039b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:07.851996  4655 raft_consensus.cc:1275] T d9d05411f1e749669cdf7c1be8d9d941 P c800c72b860f42878733b72fa57c227e [term 2 FOLLOWER]: Refusing update from remote peer 308ac45a3f334cdcac265c0cfbbc039b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:07.853075  4925 consensus_queue.cc:1048] T d9d05411f1e749669cdf7c1be8d9d941 P 308ac45a3f334cdcac265c0cfbbc039b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:07.862185  4583 raft_consensus.cc:1275] T d9d05411f1e749669cdf7c1be8d9d941 P ed488ca31ad54b53836e5a10d053b568 [term 2 FOLLOWER]: Refusing update from remote peer 308ac45a3f334cdcac265c0cfbbc039b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:07.864840  5035 consensus_queue.cc:1048] T d9d05411f1e749669cdf7c1be8d9d941 P 308ac45a3f334cdcac265c0cfbbc039b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:07.911821  4581 raft_consensus.cc:1275] T c437ad3104ee4400a2917a4e7c362efa P ed488ca31ad54b53836e5a10d053b568 [term 3 FOLLOWER]: Refusing update from remote peer 308ac45a3f334cdcac265c0cfbbc039b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:07.912866  5035 consensus_queue.cc:1048] T c437ad3104ee4400a2917a4e7c362efa P 308ac45a3f334cdcac265c0cfbbc039b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:07.921185  4655 raft_consensus.cc:1275] T ad48d60224d54518b33057b28cbef56b P c800c72b860f42878733b72fa57c227e [term 3 FOLLOWER]: Refusing update from remote peer 308ac45a3f334cdcac265c0cfbbc039b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:13:07.921867  4660 raft_consensus.cc:1275] T c437ad3104ee4400a2917a4e7c362efa P c800c72b860f42878733b72fa57c227e [term 3 FOLLOWER]: Refusing update from remote peer 308ac45a3f334cdcac265c0cfbbc039b: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:07.923183  5038 consensus_queue.cc:1048] T ad48d60224d54518b33057b28cbef56b P 308ac45a3f334cdcac265c0cfbbc039b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:07.927596  5035 consensus_queue.cc:1048] T c437ad3104ee4400a2917a4e7c362efa P 308ac45a3f334cdcac265c0cfbbc039b [LEADER]: Connected to new peer: Peer: permanent_uuid: "c800c72b860f42878733b72fa57c227e" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 43707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:07.934315  4581 raft_consensus.cc:1275] T ad48d60224d54518b33057b28cbef56b P ed488ca31ad54b53836e5a10d053b568 [term 3 FOLLOWER]: Refusing update from remote peer 308ac45a3f334cdcac265c0cfbbc039b: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 13:13:07.935633  5035 consensus_queue.cc:1048] T ad48d60224d54518b33057b28cbef56b P 308ac45a3f334cdcac265c0cfbbc039b [LEADER]: Connected to new peer: Peer: permanent_uuid: "ed488ca31ad54b53836e5a10d053b568" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36419 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 13:13:08.394696 28889 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 13:13:08.399497 28889 auto_leader_rebalancer.cc:452] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 13:13:08.399883 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:08.407354 28889 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 13:13:08.407861 28889 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:09.434602 28889 tablet_server.cc:179] TabletServer@127.28.54.65:0 shutting down...
I20260709 13:13:09.458915 28889 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:09.459870 28889 tablet_replica.cc:333] T fe8690eb51c946f282a28a9a065cf575 P ed488ca31ad54b53836e5a10d053b568: stopping tablet replica
I20260709 13:13:09.461136 28889 raft_consensus.cc:2243] T fe8690eb51c946f282a28a9a065cf575 P ed488ca31ad54b53836e5a10d053b568 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.461714 28889 raft_consensus.cc:2272] T fe8690eb51c946f282a28a9a065cf575 P ed488ca31ad54b53836e5a10d053b568 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.464036 28889 tablet_replica.cc:333] T 1e6249d3f0d24da1955671f551e05009 P ed488ca31ad54b53836e5a10d053b568: stopping tablet replica
I20260709 13:13:09.464620 28889 raft_consensus.cc:2243] T 1e6249d3f0d24da1955671f551e05009 P ed488ca31ad54b53836e5a10d053b568 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.465046 28889 raft_consensus.cc:2272] T 1e6249d3f0d24da1955671f551e05009 P ed488ca31ad54b53836e5a10d053b568 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.466966 28889 tablet_replica.cc:333] T cd72c6318be5424f9c7a36d563d8cd32 P ed488ca31ad54b53836e5a10d053b568: stopping tablet replica
I20260709 13:13:09.467658 28889 raft_consensus.cc:2243] T cd72c6318be5424f9c7a36d563d8cd32 P ed488ca31ad54b53836e5a10d053b568 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:09.468552 28889 raft_consensus.cc:2272] T cd72c6318be5424f9c7a36d563d8cd32 P ed488ca31ad54b53836e5a10d053b568 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.471217 28889 tablet_replica.cc:333] T 5e58e02271134e058cd0af272aa9be5b P ed488ca31ad54b53836e5a10d053b568: stopping tablet replica
I20260709 13:13:09.472062 28889 raft_consensus.cc:2243] T 5e58e02271134e058cd0af272aa9be5b P ed488ca31ad54b53836e5a10d053b568 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.472587 28889 raft_consensus.cc:2272] T 5e58e02271134e058cd0af272aa9be5b P ed488ca31ad54b53836e5a10d053b568 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.474936 28889 tablet_replica.cc:333] T c437ad3104ee4400a2917a4e7c362efa P ed488ca31ad54b53836e5a10d053b568: stopping tablet replica
I20260709 13:13:09.475739 28889 raft_consensus.cc:2243] T c437ad3104ee4400a2917a4e7c362efa P ed488ca31ad54b53836e5a10d053b568 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.476256 28889 raft_consensus.cc:2272] T c437ad3104ee4400a2917a4e7c362efa P ed488ca31ad54b53836e5a10d053b568 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.479295 28889 tablet_replica.cc:333] T d9d05411f1e749669cdf7c1be8d9d941 P ed488ca31ad54b53836e5a10d053b568: stopping tablet replica
I20260709 13:13:09.480099 28889 raft_consensus.cc:2243] T d9d05411f1e749669cdf7c1be8d9d941 P ed488ca31ad54b53836e5a10d053b568 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.480592 28889 raft_consensus.cc:2272] T d9d05411f1e749669cdf7c1be8d9d941 P ed488ca31ad54b53836e5a10d053b568 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.483446 28889 tablet_replica.cc:333] T f68bd211ab4a49de8ad6de70a45d005a P ed488ca31ad54b53836e5a10d053b568: stopping tablet replica
I20260709 13:13:09.484300 28889 raft_consensus.cc:2243] T f68bd211ab4a49de8ad6de70a45d005a P ed488ca31ad54b53836e5a10d053b568 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.484774 28889 raft_consensus.cc:2272] T f68bd211ab4a49de8ad6de70a45d005a P ed488ca31ad54b53836e5a10d053b568 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.486922 28889 tablet_replica.cc:333] T ad48d60224d54518b33057b28cbef56b P ed488ca31ad54b53836e5a10d053b568: stopping tablet replica
I20260709 13:13:09.487469 28889 raft_consensus.cc:2243] T ad48d60224d54518b33057b28cbef56b P ed488ca31ad54b53836e5a10d053b568 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.487844 28889 raft_consensus.cc:2272] T ad48d60224d54518b33057b28cbef56b P ed488ca31ad54b53836e5a10d053b568 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.490053 28889 tablet_replica.cc:333] T 0e2df276ddf14a03bd0bb461cd92f6c9 P ed488ca31ad54b53836e5a10d053b568: stopping tablet replica
I20260709 13:13:09.490598 28889 raft_consensus.cc:2243] T 0e2df276ddf14a03bd0bb461cd92f6c9 P ed488ca31ad54b53836e5a10d053b568 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:09.491307 28889 raft_consensus.cc:2272] T 0e2df276ddf14a03bd0bb461cd92f6c9 P ed488ca31ad54b53836e5a10d053b568 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.493266 28889 tablet_replica.cc:333] T b69c4c8d794d46b5a9339d9cf118cfcd P ed488ca31ad54b53836e5a10d053b568: stopping tablet replica
I20260709 13:13:09.493903 28889 raft_consensus.cc:2243] T b69c4c8d794d46b5a9339d9cf118cfcd P ed488ca31ad54b53836e5a10d053b568 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:09.494693 28889 raft_consensus.cc:2272] T b69c4c8d794d46b5a9339d9cf118cfcd P ed488ca31ad54b53836e5a10d053b568 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.496805 28889 tablet_replica.cc:333] T 2d50b7657708498da25d2ca6b238746d P ed488ca31ad54b53836e5a10d053b568: stopping tablet replica
I20260709 13:13:09.497309 28889 raft_consensus.cc:2243] T 2d50b7657708498da25d2ca6b238746d P ed488ca31ad54b53836e5a10d053b568 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.497705 28889 raft_consensus.cc:2272] T 2d50b7657708498da25d2ca6b238746d P ed488ca31ad54b53836e5a10d053b568 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.499594 28889 tablet_replica.cc:333] T 886cca6de3e54269a85c11555b07822f P ed488ca31ad54b53836e5a10d053b568: stopping tablet replica
I20260709 13:13:09.500064 28889 raft_consensus.cc:2243] T 886cca6de3e54269a85c11555b07822f P ed488ca31ad54b53836e5a10d053b568 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:09.500744 28889 raft_consensus.cc:2272] T 886cca6de3e54269a85c11555b07822f P ed488ca31ad54b53836e5a10d053b568 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.502564 28889 tablet_replica.cc:333] T bf723babacbc4c8887c87a9fe84d6992 P ed488ca31ad54b53836e5a10d053b568: stopping tablet replica
I20260709 13:13:09.503049 28889 raft_consensus.cc:2243] T bf723babacbc4c8887c87a9fe84d6992 P ed488ca31ad54b53836e5a10d053b568 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:09.503750 28889 raft_consensus.cc:2272] T bf723babacbc4c8887c87a9fe84d6992 P ed488ca31ad54b53836e5a10d053b568 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.505509 28889 tablet_replica.cc:333] T 1c91359ff2954c87a2caee08711bd33e P ed488ca31ad54b53836e5a10d053b568: stopping tablet replica
I20260709 13:13:09.506026 28889 raft_consensus.cc:2243] T 1c91359ff2954c87a2caee08711bd33e P ed488ca31ad54b53836e5a10d053b568 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.506425 28889 raft_consensus.cc:2272] T 1c91359ff2954c87a2caee08711bd33e P ed488ca31ad54b53836e5a10d053b568 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.508162 28889 tablet_replica.cc:333] T bc88f6f533ef4807bba8f78c14dbc9f2 P ed488ca31ad54b53836e5a10d053b568: stopping tablet replica
I20260709 13:13:09.508647 28889 raft_consensus.cc:2243] T bc88f6f533ef4807bba8f78c14dbc9f2 P ed488ca31ad54b53836e5a10d053b568 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:09.509385 28889 raft_consensus.cc:2272] T bc88f6f533ef4807bba8f78c14dbc9f2 P ed488ca31ad54b53836e5a10d053b568 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.511597 28889 tablet_replica.cc:333] T 984b5083f2394eef88d52b75f6705949 P ed488ca31ad54b53836e5a10d053b568: stopping tablet replica
I20260709 13:13:09.512090 28889 raft_consensus.cc:2243] T 984b5083f2394eef88d52b75f6705949 P ed488ca31ad54b53836e5a10d053b568 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.512524 28889 raft_consensus.cc:2272] T 984b5083f2394eef88d52b75f6705949 P ed488ca31ad54b53836e5a10d053b568 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.514441 28889 tablet_replica.cc:333] T 4b35da8e30d245c5a00c054010005f9d P ed488ca31ad54b53836e5a10d053b568: stopping tablet replica
I20260709 13:13:09.514917 28889 raft_consensus.cc:2243] T 4b35da8e30d245c5a00c054010005f9d P ed488ca31ad54b53836e5a10d053b568 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.515349 28889 raft_consensus.cc:2272] T 4b35da8e30d245c5a00c054010005f9d P ed488ca31ad54b53836e5a10d053b568 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.517138 28889 tablet_replica.cc:333] T f12e6e418b9c4465b718cdbb4786377a P ed488ca31ad54b53836e5a10d053b568: stopping tablet replica
I20260709 13:13:09.517560 28889 raft_consensus.cc:2243] T f12e6e418b9c4465b718cdbb4786377a P ed488ca31ad54b53836e5a10d053b568 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.518000 28889 raft_consensus.cc:2272] T f12e6e418b9c4465b718cdbb4786377a P ed488ca31ad54b53836e5a10d053b568 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.555943 28889 tablet_server.cc:196] TabletServer@127.28.54.65:0 shutdown complete.
W20260709 13:13:09.585685  4625 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36419: connect: Connection refused (error 111) [suppressed 3 similar messages]
W20260709 13:13:09.589183  4625 consensus_peers.cc:597] T 984b5083f2394eef88d52b75f6705949 P c800c72b860f42878733b72fa57c227e -> Peer ed488ca31ad54b53836e5a10d053b568 (127.28.54.65:36419): Couldn't send request to peer ed488ca31ad54b53836e5a10d053b568. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36419: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:09.592278 28889 tablet_server.cc:179] TabletServer@127.28.54.66:0 shutting down...
W20260709 13:13:09.601377  4625 consensus_peers.cc:597] T 4b35da8e30d245c5a00c054010005f9d P c800c72b860f42878733b72fa57c227e -> Peer ed488ca31ad54b53836e5a10d053b568 (127.28.54.65:36419): Couldn't send request to peer ed488ca31ad54b53836e5a10d053b568. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36419: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:09.608739  4699 consensus_peers.cc:597] T 5e58e02271134e058cd0af272aa9be5b P 308ac45a3f334cdcac265c0cfbbc039b -> Peer c800c72b860f42878733b72fa57c227e (127.28.54.66:43707): Couldn't send request to peer c800c72b860f42878733b72fa57c227e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:09.622824 28889 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:09.623692 28889 tablet_replica.cc:333] T fe8690eb51c946f282a28a9a065cf575 P c800c72b860f42878733b72fa57c227e: stopping tablet replica
W20260709 13:13:09.623976  4699 consensus_peers.cc:597] T f68bd211ab4a49de8ad6de70a45d005a P 308ac45a3f334cdcac265c0cfbbc039b -> Peer ed488ca31ad54b53836e5a10d053b568 (127.28.54.65:36419): Couldn't send request to peer ed488ca31ad54b53836e5a10d053b568. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36419: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:09.624676 28889 raft_consensus.cc:2243] T fe8690eb51c946f282a28a9a065cf575 P c800c72b860f42878733b72fa57c227e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:09.625522 28889 raft_consensus.cc:2272] T fe8690eb51c946f282a28a9a065cf575 P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.627395 28889 tablet_replica.cc:333] T bf723babacbc4c8887c87a9fe84d6992 P c800c72b860f42878733b72fa57c227e: stopping tablet replica
I20260709 13:13:09.627873 28889 raft_consensus.cc:2243] T bf723babacbc4c8887c87a9fe84d6992 P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.628226 28889 raft_consensus.cc:2272] T bf723babacbc4c8887c87a9fe84d6992 P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.630059 28889 tablet_replica.cc:333] T 1e6249d3f0d24da1955671f551e05009 P c800c72b860f42878733b72fa57c227e: stopping tablet replica
I20260709 13:13:09.630564 28889 raft_consensus.cc:2243] T 1e6249d3f0d24da1955671f551e05009 P c800c72b860f42878733b72fa57c227e [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:09.631349 28889 raft_consensus.cc:2272] T 1e6249d3f0d24da1955671f551e05009 P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.633733 28889 tablet_replica.cc:333] T 886cca6de3e54269a85c11555b07822f P c800c72b860f42878733b72fa57c227e: stopping tablet replica
I20260709 13:13:09.634356 28889 raft_consensus.cc:2243] T 886cca6de3e54269a85c11555b07822f P c800c72b860f42878733b72fa57c227e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.634830 28889 raft_consensus.cc:2272] T 886cca6de3e54269a85c11555b07822f P c800c72b860f42878733b72fa57c227e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.637511 28889 tablet_replica.cc:333] T 2d50b7657708498da25d2ca6b238746d P c800c72b860f42878733b72fa57c227e: stopping tablet replica
I20260709 13:13:09.638239 28889 raft_consensus.cc:2243] T 2d50b7657708498da25d2ca6b238746d P c800c72b860f42878733b72fa57c227e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.638690 28889 raft_consensus.cc:2272] T 2d50b7657708498da25d2ca6b238746d P c800c72b860f42878733b72fa57c227e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.640511 28889 tablet_replica.cc:333] T cd72c6318be5424f9c7a36d563d8cd32 P c800c72b860f42878733b72fa57c227e: stopping tablet replica
I20260709 13:13:09.641018 28889 raft_consensus.cc:2243] T cd72c6318be5424f9c7a36d563d8cd32 P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.641414 28889 raft_consensus.cc:2272] T cd72c6318be5424f9c7a36d563d8cd32 P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.643303 28889 tablet_replica.cc:333] T ad48d60224d54518b33057b28cbef56b P c800c72b860f42878733b72fa57c227e: stopping tablet replica
I20260709 13:13:09.643817 28889 raft_consensus.cc:2243] T ad48d60224d54518b33057b28cbef56b P c800c72b860f42878733b72fa57c227e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.644212 28889 raft_consensus.cc:2272] T ad48d60224d54518b33057b28cbef56b P c800c72b860f42878733b72fa57c227e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.646018 28889 tablet_replica.cc:333] T 0e2df276ddf14a03bd0bb461cd92f6c9 P c800c72b860f42878733b72fa57c227e: stopping tablet replica
I20260709 13:13:09.646478 28889 raft_consensus.cc:2243] T 0e2df276ddf14a03bd0bb461cd92f6c9 P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.646853 28889 raft_consensus.cc:2272] T 0e2df276ddf14a03bd0bb461cd92f6c9 P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.648700 28889 tablet_replica.cc:333] T f12e6e418b9c4465b718cdbb4786377a P c800c72b860f42878733b72fa57c227e: stopping tablet replica
I20260709 13:13:09.649179 28889 raft_consensus.cc:2243] T f12e6e418b9c4465b718cdbb4786377a P c800c72b860f42878733b72fa57c227e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:09.649956 28889 raft_consensus.cc:2272] T f12e6e418b9c4465b718cdbb4786377a P c800c72b860f42878733b72fa57c227e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.651714 28889 tablet_replica.cc:333] T d9d05411f1e749669cdf7c1be8d9d941 P c800c72b860f42878733b72fa57c227e: stopping tablet replica
I20260709 13:13:09.652261 28889 raft_consensus.cc:2243] T d9d05411f1e749669cdf7c1be8d9d941 P c800c72b860f42878733b72fa57c227e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.652667 28889 raft_consensus.cc:2272] T d9d05411f1e749669cdf7c1be8d9d941 P c800c72b860f42878733b72fa57c227e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.655056 28889 tablet_replica.cc:333] T f68bd211ab4a49de8ad6de70a45d005a P c800c72b860f42878733b72fa57c227e: stopping tablet replica
I20260709 13:13:09.655690 28889 raft_consensus.cc:2243] T f68bd211ab4a49de8ad6de70a45d005a P c800c72b860f42878733b72fa57c227e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.656093 28889 raft_consensus.cc:2272] T f68bd211ab4a49de8ad6de70a45d005a P c800c72b860f42878733b72fa57c227e [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:09.656155  4699 consensus_peers.cc:597] T d9d05411f1e749669cdf7c1be8d9d941 P 308ac45a3f334cdcac265c0cfbbc039b -> Peer ed488ca31ad54b53836e5a10d053b568 (127.28.54.65:36419): Couldn't send request to peer ed488ca31ad54b53836e5a10d053b568. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36419: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:09.658265 28889 tablet_replica.cc:333] T 5e58e02271134e058cd0af272aa9be5b P c800c72b860f42878733b72fa57c227e: stopping tablet replica
I20260709 13:13:09.658777 28889 raft_consensus.cc:2243] T 5e58e02271134e058cd0af272aa9be5b P c800c72b860f42878733b72fa57c227e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.659129 28889 raft_consensus.cc:2272] T 5e58e02271134e058cd0af272aa9be5b P c800c72b860f42878733b72fa57c227e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.660820 28889 tablet_replica.cc:333] T c437ad3104ee4400a2917a4e7c362efa P c800c72b860f42878733b72fa57c227e: stopping tablet replica
I20260709 13:13:09.661266 28889 raft_consensus.cc:2243] T c437ad3104ee4400a2917a4e7c362efa P c800c72b860f42878733b72fa57c227e [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.661623 28889 raft_consensus.cc:2272] T c437ad3104ee4400a2917a4e7c362efa P c800c72b860f42878733b72fa57c227e [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.663601 28889 tablet_replica.cc:333] T b69c4c8d794d46b5a9339d9cf118cfcd P c800c72b860f42878733b72fa57c227e: stopping tablet replica
I20260709 13:13:09.664101 28889 raft_consensus.cc:2243] T b69c4c8d794d46b5a9339d9cf118cfcd P c800c72b860f42878733b72fa57c227e [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.664494 28889 raft_consensus.cc:2272] T b69c4c8d794d46b5a9339d9cf118cfcd P c800c72b860f42878733b72fa57c227e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.666312 28889 tablet_replica.cc:333] T 984b5083f2394eef88d52b75f6705949 P c800c72b860f42878733b72fa57c227e: stopping tablet replica
I20260709 13:13:09.666771 28889 raft_consensus.cc:2243] T 984b5083f2394eef88d52b75f6705949 P c800c72b860f42878733b72fa57c227e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:09.667456 28889 raft_consensus.cc:2272] T 984b5083f2394eef88d52b75f6705949 P c800c72b860f42878733b72fa57c227e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.669410 28889 tablet_replica.cc:333] T 4b35da8e30d245c5a00c054010005f9d P c800c72b860f42878733b72fa57c227e: stopping tablet replica
I20260709 13:13:09.669883 28889 raft_consensus.cc:2243] T 4b35da8e30d245c5a00c054010005f9d P c800c72b860f42878733b72fa57c227e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:09.670598 28889 raft_consensus.cc:2272] T 4b35da8e30d245c5a00c054010005f9d P c800c72b860f42878733b72fa57c227e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.672325 28889 tablet_replica.cc:333] T 1c91359ff2954c87a2caee08711bd33e P c800c72b860f42878733b72fa57c227e: stopping tablet replica
I20260709 13:13:09.672761 28889 raft_consensus.cc:2243] T 1c91359ff2954c87a2caee08711bd33e P c800c72b860f42878733b72fa57c227e [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:09.673478 28889 raft_consensus.cc:2272] T 1c91359ff2954c87a2caee08711bd33e P c800c72b860f42878733b72fa57c227e [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.675311 28889 tablet_replica.cc:333] T bc88f6f533ef4807bba8f78c14dbc9f2 P c800c72b860f42878733b72fa57c227e: stopping tablet replica
I20260709 13:13:09.675817 28889 raft_consensus.cc:2243] T bc88f6f533ef4807bba8f78c14dbc9f2 P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.676280 28889 raft_consensus.cc:2272] T bc88f6f533ef4807bba8f78c14dbc9f2 P c800c72b860f42878733b72fa57c227e [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:09.678406  4699 consensus_peers.cc:597] T d9d05411f1e749669cdf7c1be8d9d941 P 308ac45a3f334cdcac265c0cfbbc039b -> Peer c800c72b860f42878733b72fa57c227e (127.28.54.66:43707): Couldn't send request to peer c800c72b860f42878733b72fa57c227e. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:09.687496  4699 consensus_peers.cc:597] T c437ad3104ee4400a2917a4e7c362efa P 308ac45a3f334cdcac265c0cfbbc039b -> Peer ed488ca31ad54b53836e5a10d053b568 (127.28.54.65:36419): Couldn't send request to peer ed488ca31ad54b53836e5a10d053b568. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36419: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:09.715090 28889 tablet_server.cc:196] TabletServer@127.28.54.66:0 shutdown complete.
W20260709 13:13:09.719480  4699 consensus_peers.cc:597] T 5e58e02271134e058cd0af272aa9be5b P 308ac45a3f334cdcac265c0cfbbc039b -> Peer ed488ca31ad54b53836e5a10d053b568 (127.28.54.65:36419): Couldn't send request to peer ed488ca31ad54b53836e5a10d053b568. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36419: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:09.747360 28889 tablet_server.cc:179] TabletServer@127.28.54.67:0 shutting down...
W20260709 13:13:09.771449  4699 consensus_peers.cc:597] T f68bd211ab4a49de8ad6de70a45d005a P 308ac45a3f334cdcac265c0cfbbc039b -> Peer c800c72b860f42878733b72fa57c227e (127.28.54.66:43707): Couldn't send request to peer c800c72b860f42878733b72fa57c227e. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.66:43707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:09.775344 28889 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:09.776031 28889 tablet_replica.cc:333] T fe8690eb51c946f282a28a9a065cf575 P 308ac45a3f334cdcac265c0cfbbc039b: stopping tablet replica
I20260709 13:13:09.776669 28889 raft_consensus.cc:2243] T fe8690eb51c946f282a28a9a065cf575 P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.777145 28889 raft_consensus.cc:2272] T fe8690eb51c946f282a28a9a065cf575 P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.779109 28889 tablet_replica.cc:333] T 1e6249d3f0d24da1955671f551e05009 P 308ac45a3f334cdcac265c0cfbbc039b: stopping tablet replica
I20260709 13:13:09.779874 28889 raft_consensus.cc:2243] T 1e6249d3f0d24da1955671f551e05009 P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.780316 28889 raft_consensus.cc:2272] T 1e6249d3f0d24da1955671f551e05009 P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.782740 28889 tablet_replica.cc:333] T bf723babacbc4c8887c87a9fe84d6992 P 308ac45a3f334cdcac265c0cfbbc039b: stopping tablet replica
I20260709 13:13:09.783524 28889 raft_consensus.cc:2243] T bf723babacbc4c8887c87a9fe84d6992 P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 13:13:09.783716  4699 consensus_peers.cc:597] T ad48d60224d54518b33057b28cbef56b P 308ac45a3f334cdcac265c0cfbbc039b -> Peer c800c72b860f42878733b72fa57c227e (127.28.54.66:43707): Couldn't send request to peer c800c72b860f42878733b72fa57c227e. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.66:43707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:09.783984 28889 raft_consensus.cc:2272] T bf723babacbc4c8887c87a9fe84d6992 P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.786471 28889 tablet_replica.cc:333] T 2d50b7657708498da25d2ca6b238746d P 308ac45a3f334cdcac265c0cfbbc039b: stopping tablet replica
I20260709 13:13:09.787180 28889 raft_consensus.cc:2243] T 2d50b7657708498da25d2ca6b238746d P 308ac45a3f334cdcac265c0cfbbc039b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:09.787957 28889 raft_consensus.cc:2272] T 2d50b7657708498da25d2ca6b238746d P 308ac45a3f334cdcac265c0cfbbc039b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.790324 28889 tablet_replica.cc:333] T 886cca6de3e54269a85c11555b07822f P 308ac45a3f334cdcac265c0cfbbc039b: stopping tablet replica
I20260709 13:13:09.791085 28889 raft_consensus.cc:2243] T 886cca6de3e54269a85c11555b07822f P 308ac45a3f334cdcac265c0cfbbc039b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.791606 28889 raft_consensus.cc:2272] T 886cca6de3e54269a85c11555b07822f P 308ac45a3f334cdcac265c0cfbbc039b [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:09.791715  4699 consensus_peers.cc:597] T c437ad3104ee4400a2917a4e7c362efa P 308ac45a3f334cdcac265c0cfbbc039b -> Peer c800c72b860f42878733b72fa57c227e (127.28.54.66:43707): Couldn't send request to peer c800c72b860f42878733b72fa57c227e. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.66:43707: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:09.793557 28889 tablet_replica.cc:333] T cd72c6318be5424f9c7a36d563d8cd32 P 308ac45a3f334cdcac265c0cfbbc039b: stopping tablet replica
I20260709 13:13:09.794165 28889 raft_consensus.cc:2243] T cd72c6318be5424f9c7a36d563d8cd32 P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.794581 28889 raft_consensus.cc:2272] T cd72c6318be5424f9c7a36d563d8cd32 P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.796633 28889 tablet_replica.cc:333] T b69c4c8d794d46b5a9339d9cf118cfcd P 308ac45a3f334cdcac265c0cfbbc039b: stopping tablet replica
I20260709 13:13:09.797191 28889 raft_consensus.cc:2243] T b69c4c8d794d46b5a9339d9cf118cfcd P 308ac45a3f334cdcac265c0cfbbc039b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.797605 28889 raft_consensus.cc:2272] T b69c4c8d794d46b5a9339d9cf118cfcd P 308ac45a3f334cdcac265c0cfbbc039b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.799415 28889 tablet_replica.cc:333] T f12e6e418b9c4465b718cdbb4786377a P 308ac45a3f334cdcac265c0cfbbc039b: stopping tablet replica
I20260709 13:13:09.799926 28889 raft_consensus.cc:2243] T f12e6e418b9c4465b718cdbb4786377a P 308ac45a3f334cdcac265c0cfbbc039b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.800336 28889 raft_consensus.cc:2272] T f12e6e418b9c4465b718cdbb4786377a P 308ac45a3f334cdcac265c0cfbbc039b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.802143 28889 tablet_replica.cc:333] T 0e2df276ddf14a03bd0bb461cd92f6c9 P 308ac45a3f334cdcac265c0cfbbc039b: stopping tablet replica
I20260709 13:13:09.802629 28889 raft_consensus.cc:2243] T 0e2df276ddf14a03bd0bb461cd92f6c9 P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.803004 28889 raft_consensus.cc:2272] T 0e2df276ddf14a03bd0bb461cd92f6c9 P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.805111 28889 tablet_replica.cc:333] T ad48d60224d54518b33057b28cbef56b P 308ac45a3f334cdcac265c0cfbbc039b: stopping tablet replica
I20260709 13:13:09.805595 28889 raft_consensus.cc:2243] T ad48d60224d54518b33057b28cbef56b P 308ac45a3f334cdcac265c0cfbbc039b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:09.806304 28889 raft_consensus.cc:2272] T ad48d60224d54518b33057b28cbef56b P 308ac45a3f334cdcac265c0cfbbc039b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.807982 28889 tablet_replica.cc:333] T d9d05411f1e749669cdf7c1be8d9d941 P 308ac45a3f334cdcac265c0cfbbc039b: stopping tablet replica
I20260709 13:13:09.808455 28889 raft_consensus.cc:2243] T d9d05411f1e749669cdf7c1be8d9d941 P 308ac45a3f334cdcac265c0cfbbc039b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:09.809163 28889 raft_consensus.cc:2272] T d9d05411f1e749669cdf7c1be8d9d941 P 308ac45a3f334cdcac265c0cfbbc039b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.811088 28889 tablet_replica.cc:333] T f68bd211ab4a49de8ad6de70a45d005a P 308ac45a3f334cdcac265c0cfbbc039b: stopping tablet replica
I20260709 13:13:09.811548 28889 raft_consensus.cc:2243] T f68bd211ab4a49de8ad6de70a45d005a P 308ac45a3f334cdcac265c0cfbbc039b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:09.812242 28889 raft_consensus.cc:2272] T f68bd211ab4a49de8ad6de70a45d005a P 308ac45a3f334cdcac265c0cfbbc039b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.814007 28889 tablet_replica.cc:333] T 5e58e02271134e058cd0af272aa9be5b P 308ac45a3f334cdcac265c0cfbbc039b: stopping tablet replica
I20260709 13:13:09.814472 28889 raft_consensus.cc:2243] T 5e58e02271134e058cd0af272aa9be5b P 308ac45a3f334cdcac265c0cfbbc039b [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:09.815172 28889 raft_consensus.cc:2272] T 5e58e02271134e058cd0af272aa9be5b P 308ac45a3f334cdcac265c0cfbbc039b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.816831 28889 tablet_replica.cc:333] T c437ad3104ee4400a2917a4e7c362efa P 308ac45a3f334cdcac265c0cfbbc039b: stopping tablet replica
I20260709 13:13:09.817322 28889 raft_consensus.cc:2243] T c437ad3104ee4400a2917a4e7c362efa P 308ac45a3f334cdcac265c0cfbbc039b [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:09.818043 28889 raft_consensus.cc:2272] T c437ad3104ee4400a2917a4e7c362efa P 308ac45a3f334cdcac265c0cfbbc039b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.819967 28889 tablet_replica.cc:333] T 1c91359ff2954c87a2caee08711bd33e P 308ac45a3f334cdcac265c0cfbbc039b: stopping tablet replica
I20260709 13:13:09.820436 28889 raft_consensus.cc:2243] T 1c91359ff2954c87a2caee08711bd33e P 308ac45a3f334cdcac265c0cfbbc039b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.820815 28889 raft_consensus.cc:2272] T 1c91359ff2954c87a2caee08711bd33e P 308ac45a3f334cdcac265c0cfbbc039b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.822646 28889 tablet_replica.cc:333] T bc88f6f533ef4807bba8f78c14dbc9f2 P 308ac45a3f334cdcac265c0cfbbc039b: stopping tablet replica
I20260709 13:13:09.823098 28889 raft_consensus.cc:2243] T bc88f6f533ef4807bba8f78c14dbc9f2 P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.823496 28889 raft_consensus.cc:2272] T bc88f6f533ef4807bba8f78c14dbc9f2 P 308ac45a3f334cdcac265c0cfbbc039b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.825338 28889 tablet_replica.cc:333] T 984b5083f2394eef88d52b75f6705949 P 308ac45a3f334cdcac265c0cfbbc039b: stopping tablet replica
I20260709 13:13:09.825804 28889 raft_consensus.cc:2243] T 984b5083f2394eef88d52b75f6705949 P 308ac45a3f334cdcac265c0cfbbc039b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.826200 28889 raft_consensus.cc:2272] T 984b5083f2394eef88d52b75f6705949 P 308ac45a3f334cdcac265c0cfbbc039b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.828141 28889 tablet_replica.cc:333] T 4b35da8e30d245c5a00c054010005f9d P 308ac45a3f334cdcac265c0cfbbc039b: stopping tablet replica
I20260709 13:13:09.828564 28889 raft_consensus.cc:2243] T 4b35da8e30d245c5a00c054010005f9d P 308ac45a3f334cdcac265c0cfbbc039b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:09.828948 28889 raft_consensus.cc:2272] T 4b35da8e30d245c5a00c054010005f9d P 308ac45a3f334cdcac265c0cfbbc039b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.865545 28889 tablet_server.cc:196] TabletServer@127.28.54.67:0 shutdown complete.
I20260709 13:13:09.896030 28889 master.cc:562] Master@127.28.54.126:39327 shutting down...
I20260709 13:13:09.914916 28889 raft_consensus.cc:2243] T 00000000000000000000000000000000 P d807ea9b011c4093877294934d6364d9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:09.915433 28889 raft_consensus.cc:2272] T 00000000000000000000000000000000 P d807ea9b011c4093877294934d6364d9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:09.915735 28889 tablet_replica.cc:333] T 00000000000000000000000000000000 P d807ea9b011c4093877294934d6364d9: stopping tablet replica
I20260709 13:13:09.934782 28889 master.cc:584] Master@127.28.54.126:39327 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (11837 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 13:13:09.981405 28889 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.28.54.126:39035
I20260709 13:13:09.982499 28889 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:09.987874  5046 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:09.987916  5045 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:09.988999  5048 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:09.989542 28889 server_base.cc:1061] running on GCE node
I20260709 13:13:09.990437 28889 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:09.990608 28889 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:09.990720 28889 hybrid_clock.cc:648] HybridClock initialized: now 1783602789990709 us; error 0 us; skew 500 ppm
I20260709 13:13:09.991158 28889 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:09.993228 28889 webserver.cc:533] Webserver started at http://127.28.54.126:46147/ using document root <none> and password file <none>
I20260709 13:13:09.993640 28889 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:09.993824 28889 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:09.994046 28889 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:09.995038 28889 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602558744475-28889-0/minicluster-data/master-0-root/instance:
uuid: "5c6ac1e6dd6f4564b1a2b2385ff3355c"
format_stamp: "Formatted at 2026-07-09 13:13:09 on dist-test-slave-vpdx"
I20260709 13:13:09.998996 28889 fs_manager.cc:696] Time spent creating directory manager: real 0.003s	user 0.005s	sys 0.000s
I20260709 13:13:10.002110  5053 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:10.002797 28889 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:13:10.003047 28889 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602558744475-28889-0/minicluster-data/master-0-root
uuid: "5c6ac1e6dd6f4564b1a2b2385ff3355c"
format_stamp: "Formatted at 2026-07-09 13:13:09 on dist-test-slave-vpdx"
I20260709 13:13:10.003291 28889 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602558744475-28889-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602558744475-28889-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602558744475-28889-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:10.021433 28889 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:10.022558 28889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:10.057273 28889 rpc_server.cc:307] RPC server started. Bound to: 127.28.54.126:39035
I20260709 13:13:10.057381  5104 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.54.126:39035 every 8 connection(s)
I20260709 13:13:10.060936  5105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:10.071252  5105 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c6ac1e6dd6f4564b1a2b2385ff3355c: Bootstrap starting.
I20260709 13:13:10.075824  5105 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5c6ac1e6dd6f4564b1a2b2385ff3355c: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:10.079886  5105 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5c6ac1e6dd6f4564b1a2b2385ff3355c: No bootstrap required, opened a new log
I20260709 13:13:10.081951  5105 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5c6ac1e6dd6f4564b1a2b2385ff3355c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c6ac1e6dd6f4564b1a2b2385ff3355c" member_type: VOTER }
I20260709 13:13:10.082309  5105 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5c6ac1e6dd6f4564b1a2b2385ff3355c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:10.082486  5105 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5c6ac1e6dd6f4564b1a2b2385ff3355c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c6ac1e6dd6f4564b1a2b2385ff3355c, State: Initialized, Role: FOLLOWER
I20260709 13:13:10.082949  5105 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5c6ac1e6dd6f4564b1a2b2385ff3355c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c6ac1e6dd6f4564b1a2b2385ff3355c" member_type: VOTER }
I20260709 13:13:10.083364  5105 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5c6ac1e6dd6f4564b1a2b2385ff3355c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 13:13:10.083551  5105 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5c6ac1e6dd6f4564b1a2b2385ff3355c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 13:13:10.083751  5105 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5c6ac1e6dd6f4564b1a2b2385ff3355c [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:10.088099  5105 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5c6ac1e6dd6f4564b1a2b2385ff3355c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c6ac1e6dd6f4564b1a2b2385ff3355c" member_type: VOTER }
I20260709 13:13:10.088549  5105 leader_election.cc:304] T 00000000000000000000000000000000 P 5c6ac1e6dd6f4564b1a2b2385ff3355c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5c6ac1e6dd6f4564b1a2b2385ff3355c; no voters: 
I20260709 13:13:10.089537  5105 leader_election.cc:290] T 00000000000000000000000000000000 P 5c6ac1e6dd6f4564b1a2b2385ff3355c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 13:13:10.089963  5108 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5c6ac1e6dd6f4564b1a2b2385ff3355c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:10.091231  5108 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5c6ac1e6dd6f4564b1a2b2385ff3355c [term 1 LEADER]: Becoming Leader. State: Replica: 5c6ac1e6dd6f4564b1a2b2385ff3355c, State: Running, Role: LEADER
I20260709 13:13:10.091863  5108 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5c6ac1e6dd6f4564b1a2b2385ff3355c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c6ac1e6dd6f4564b1a2b2385ff3355c" member_type: VOTER }
I20260709 13:13:10.092167  5105 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5c6ac1e6dd6f4564b1a2b2385ff3355c [sys.catalog]: configured and running, proceeding with master startup.
I20260709 13:13:10.096124  5110 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c6ac1e6dd6f4564b1a2b2385ff3355c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5c6ac1e6dd6f4564b1a2b2385ff3355c. Latest consensus state: current_term: 1 leader_uuid: "5c6ac1e6dd6f4564b1a2b2385ff3355c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c6ac1e6dd6f4564b1a2b2385ff3355c" member_type: VOTER } }
I20260709 13:13:10.096263  5109 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5c6ac1e6dd6f4564b1a2b2385ff3355c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5c6ac1e6dd6f4564b1a2b2385ff3355c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5c6ac1e6dd6f4564b1a2b2385ff3355c" member_type: VOTER } }
I20260709 13:13:10.096953  5110 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c6ac1e6dd6f4564b1a2b2385ff3355c [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:10.097008  5109 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5c6ac1e6dd6f4564b1a2b2385ff3355c [sys.catalog]: This master's current role is: LEADER
I20260709 13:13:10.103964  5115 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 13:13:10.108739  5115 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 13:13:10.110200 28889 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 13:13:10.116940  5115 catalog_manager.cc:1383] Generated new cluster ID: 88a33105336347dca08b4841574cfaef
I20260709 13:13:10.117231  5115 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 13:13:10.136945  5115 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 13:13:10.138357  5115 catalog_manager.cc:1540] Loading token signing keys...
I20260709 13:13:10.152580  5115 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 5c6ac1e6dd6f4564b1a2b2385ff3355c: Generated new TSK 0
I20260709 13:13:10.153087  5115 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 13:13:10.176085 28889 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:10.181723  5126 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:10.182577  5127 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:10.184453  5129 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:10.184567 28889 server_base.cc:1061] running on GCE node
I20260709 13:13:10.185585 28889 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:10.185786 28889 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:10.185935 28889 hybrid_clock.cc:648] HybridClock initialized: now 1783602790185922 us; error 0 us; skew 500 ppm
I20260709 13:13:10.186376 28889 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:10.188361 28889 webserver.cc:533] Webserver started at http://127.28.54.65:46717/ using document root <none> and password file <none>
I20260709 13:13:10.188759 28889 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:10.188916 28889 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:10.189111 28889 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:10.190124 28889 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602558744475-28889-0/minicluster-data/ts-0-root/instance:
uuid: "20c10f8bb9404efea93b7709bff70f8f"
format_stamp: "Formatted at 2026-07-09 13:13:10 on dist-test-slave-vpdx"
I20260709 13:13:10.194141 28889 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 13:13:10.197068  5134 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:10.197738 28889 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:13:10.198037 28889 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602558744475-28889-0/minicluster-data/ts-0-root
uuid: "20c10f8bb9404efea93b7709bff70f8f"
format_stamp: "Formatted at 2026-07-09 13:13:10 on dist-test-slave-vpdx"
I20260709 13:13:10.198280 28889 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602558744475-28889-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602558744475-28889-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602558744475-28889-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:10.231297 28889 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:10.232415 28889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:10.233764 28889 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:10.235842 28889 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:10.236025 28889 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:10.236229 28889 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:10.236395 28889 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:10.273613 28889 rpc_server.cc:307] RPC server started. Bound to: 127.28.54.65:36789
I20260709 13:13:10.273716  5196 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.54.65:36789 every 8 connection(s)
I20260709 13:13:10.278136 28889 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:10.285037  5201 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:10.286593  5202 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:10.288118  5204 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:10.289156 28889 server_base.cc:1061] running on GCE node
I20260709 13:13:10.290038 28889 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:10.290217 28889 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:10.290374 28889 hybrid_clock.cc:648] HybridClock initialized: now 1783602790290359 us; error 0 us; skew 500 ppm
I20260709 13:13:10.290863 28889 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:10.293820 28889 webserver.cc:533] Webserver started at http://127.28.54.66:40237/ using document root <none> and password file <none>
I20260709 13:13:10.294214  5197 heartbeater.cc:344] Connected to a master server at 127.28.54.126:39035
I20260709 13:13:10.294381 28889 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:10.294667 28889 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:10.294667  5197 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:10.295109 28889 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:10.295683  5197 heartbeater.cc:507] Master 127.28.54.126:39035 requested a full tablet report, sending...
I20260709 13:13:10.296622 28889 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602558744475-28889-0/minicluster-data/ts-1-root/instance:
uuid: "faf57cab004346baae3fe74487d12316"
format_stamp: "Formatted at 2026-07-09 13:13:10 on dist-test-slave-vpdx"
I20260709 13:13:10.297991  5070 ts_manager.cc:194] Registered new tserver with Master: 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789)
I20260709 13:13:10.300314  5070 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60250
I20260709 13:13:10.302300 28889 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.003s	sys 0.003s
I20260709 13:13:10.305658  5209 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:10.306368 28889 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 13:13:10.306622 28889 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602558744475-28889-0/minicluster-data/ts-1-root
uuid: "faf57cab004346baae3fe74487d12316"
format_stamp: "Formatted at 2026-07-09 13:13:10 on dist-test-slave-vpdx"
I20260709 13:13:10.306869 28889 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602558744475-28889-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602558744475-28889-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602558744475-28889-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:10.328828 28889 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:10.329957 28889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:10.331293 28889 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:10.333317 28889 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:10.333503 28889 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:10.333716 28889 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:10.333913 28889 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 13:13:10.370550 28889 rpc_server.cc:307] RPC server started. Bound to: 127.28.54.66:33871
I20260709 13:13:10.370651  5271 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.54.66:33871 every 8 connection(s)
I20260709 13:13:10.375331 28889 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 13:13:10.382330  5275 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:10.382828  5276 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 13:13:10.385493  5278 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 13:13:10.385931 28889 server_base.cc:1061] running on GCE node
I20260709 13:13:10.386511  5272 heartbeater.cc:344] Connected to a master server at 127.28.54.126:39035
I20260709 13:13:10.386941  5272 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:10.387023 28889 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 13:13:10.387336 28889 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 13:13:10.387534 28889 hybrid_clock.cc:648] HybridClock initialized: now 1783602790387516 us; error 0 us; skew 500 ppm
I20260709 13:13:10.387791  5272 heartbeater.cc:507] Master 127.28.54.126:39035 requested a full tablet report, sending...
I20260709 13:13:10.388290 28889 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 13:13:10.390074  5070 ts_manager.cc:194] Registered new tserver with Master: faf57cab004346baae3fe74487d12316 (127.28.54.66:33871)
I20260709 13:13:10.391321  5070 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60260
I20260709 13:13:10.392000 28889 webserver.cc:533] Webserver started at http://127.28.54.67:38963/ using document root <none> and password file <none>
I20260709 13:13:10.392679 28889 fs_manager.cc:362] Metadata directory not provided
I20260709 13:13:10.392912 28889 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 13:13:10.393217 28889 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 13:13:10.394443 28889 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602558744475-28889-0/minicluster-data/ts-2-root/instance:
uuid: "00e3ba273af645d881fe92b48b615951"
format_stamp: "Formatted at 2026-07-09 13:13:10 on dist-test-slave-vpdx"
I20260709 13:13:10.398535 28889 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 13:13:10.401671  5283 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:10.402412 28889 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 13:13:10.402668 28889 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602558744475-28889-0/minicluster-data/ts-2-root
uuid: "00e3ba273af645d881fe92b48b615951"
format_stamp: "Formatted at 2026-07-09 13:13:10 on dist-test-slave-vpdx"
I20260709 13:13:10.402895 28889 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602558744475-28889-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602558744475-28889-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskyEUnoI/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783602558744475-28889-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 13:13:10.438373 28889 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 13:13:10.439452 28889 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 13:13:10.440781 28889 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 13:13:10.442809 28889 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 13:13:10.442994 28889 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:10.443203 28889 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 13:13:10.443352 28889 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 13:13:10.480370 28889 rpc_server.cc:307] RPC server started. Bound to: 127.28.54.67:44205
I20260709 13:13:10.480468  5345 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.28.54.67:44205 every 8 connection(s)
I20260709 13:13:10.493309  5346 heartbeater.cc:344] Connected to a master server at 127.28.54.126:39035
I20260709 13:13:10.493834  5346 heartbeater.cc:461] Registering TS with master...
I20260709 13:13:10.494553  5346 heartbeater.cc:507] Master 127.28.54.126:39035 requested a full tablet report, sending...
I20260709 13:13:10.496413  5070 ts_manager.cc:194] Registered new tserver with Master: 00e3ba273af645d881fe92b48b615951 (127.28.54.67:44205)
I20260709 13:13:10.497434 28889 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014154811s
I20260709 13:13:10.497634  5070 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60268
I20260709 13:13:10.520397  5070 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60278:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:10.522862  5070 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:10.608747  5311 tablet_service.cc:1511] Processing CreateTablet for tablet 02b61ce2481342a58d8418df35ed4fdd (DEFAULT_TABLE table=test-workload [id=65a91660c7334cdf9efca4580eb88e22]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:10.609243  5310 tablet_service.cc:1511] Processing CreateTablet for tablet 33f2bd13db554c9397573a6c81ceb5d1 (DEFAULT_TABLE table=test-workload [id=65a91660c7334cdf9efca4580eb88e22]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:10.610381  5311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02b61ce2481342a58d8418df35ed4fdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:10.610260  5237 tablet_service.cc:1511] Processing CreateTablet for tablet 02b61ce2481342a58d8418df35ed4fdd (DEFAULT_TABLE table=test-workload [id=65a91660c7334cdf9efca4580eb88e22]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:10.611940  5237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02b61ce2481342a58d8418df35ed4fdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:10.613708  5310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33f2bd13db554c9397573a6c81ceb5d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:10.614530  5236 tablet_service.cc:1511] Processing CreateTablet for tablet 33f2bd13db554c9397573a6c81ceb5d1 (DEFAULT_TABLE table=test-workload [id=65a91660c7334cdf9efca4580eb88e22]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:10.615514  5236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33f2bd13db554c9397573a6c81ceb5d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:10.617632  5235 tablet_service.cc:1511] Processing CreateTablet for tablet c56044a4794e4299af4ee1d462580192 (DEFAULT_TABLE table=test-workload [id=65a91660c7334cdf9efca4580eb88e22]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:10.618662  5235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c56044a4794e4299af4ee1d462580192. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:10.622699  5309 tablet_service.cc:1511] Processing CreateTablet for tablet c56044a4794e4299af4ee1d462580192 (DEFAULT_TABLE table=test-workload [id=65a91660c7334cdf9efca4580eb88e22]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:10.622898  5234 tablet_service.cc:1511] Processing CreateTablet for tablet 619fadedef99424fb02cb2220e11f71d (DEFAULT_TABLE table=test-workload [id=65a91660c7334cdf9efca4580eb88e22]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:10.624012  5309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c56044a4794e4299af4ee1d462580192. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:10.624207  5234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 619fadedef99424fb02cb2220e11f71d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:10.624917  5305 tablet_service.cc:1511] Processing CreateTablet for tablet a4a20c8585a445b78ff71276699f1693 (DEFAULT_TABLE table=test-workload [id=65a91660c7334cdf9efca4580eb88e22]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:10.626197  5305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4a20c8585a445b78ff71276699f1693. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:10.626899  5233 tablet_service.cc:1511] Processing CreateTablet for tablet 85f195d86c444318a3b33ec5c008e238 (DEFAULT_TABLE table=test-workload [id=65a91660c7334cdf9efca4580eb88e22]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:10.628176  5233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85f195d86c444318a3b33ec5c008e238. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:10.628016  5307 tablet_service.cc:1511] Processing CreateTablet for tablet 85f195d86c444318a3b33ec5c008e238 (DEFAULT_TABLE table=test-workload [id=65a91660c7334cdf9efca4580eb88e22]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:10.629278  5307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85f195d86c444318a3b33ec5c008e238. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:10.630923  5232 tablet_service.cc:1511] Processing CreateTablet for tablet fbb576f6df1d4ea899f4e15ca176a28b (DEFAULT_TABLE table=test-workload [id=65a91660c7334cdf9efca4580eb88e22]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:10.626895  5308 tablet_service.cc:1511] Processing CreateTablet for tablet 619fadedef99424fb02cb2220e11f71d (DEFAULT_TABLE table=test-workload [id=65a91660c7334cdf9efca4580eb88e22]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:10.632226  5232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbb576f6df1d4ea899f4e15ca176a28b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:10.631963  5303 tablet_service.cc:1511] Processing CreateTablet for tablet c45195d3728449a1813e1bbe3ce5a981 (DEFAULT_TABLE table=test-workload [id=65a91660c7334cdf9efca4580eb88e22]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:10.632725  5308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 619fadedef99424fb02cb2220e11f71d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:10.633368  5303 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c45195d3728449a1813e1bbe3ce5a981. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:10.630915  5306 tablet_service.cc:1511] Processing CreateTablet for tablet fbb576f6df1d4ea899f4e15ca176a28b (DEFAULT_TABLE table=test-workload [id=65a91660c7334cdf9efca4580eb88e22]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:10.634771  5231 tablet_service.cc:1511] Processing CreateTablet for tablet a4a20c8585a445b78ff71276699f1693 (DEFAULT_TABLE table=test-workload [id=65a91660c7334cdf9efca4580eb88e22]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:10.636034  5231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4a20c8585a445b78ff71276699f1693. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:10.636556  5306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbb576f6df1d4ea899f4e15ca176a28b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:10.638535  5230 tablet_service.cc:1511] Processing CreateTablet for tablet 35090704c57b43d494666e056fade162 (DEFAULT_TABLE table=test-workload [id=65a91660c7334cdf9efca4580eb88e22]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:10.639763  5230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35090704c57b43d494666e056fade162. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:10.642815  5229 tablet_service.cc:1511] Processing CreateTablet for tablet c45195d3728449a1813e1bbe3ce5a981 (DEFAULT_TABLE table=test-workload [id=65a91660c7334cdf9efca4580eb88e22]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:10.643970  5229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c45195d3728449a1813e1bbe3ce5a981. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:10.630919  5304 tablet_service.cc:1511] Processing CreateTablet for tablet 35090704c57b43d494666e056fade162 (DEFAULT_TABLE table=test-workload [id=65a91660c7334cdf9efca4580eb88e22]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:10.647099  5304 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35090704c57b43d494666e056fade162. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:10.686831  5162 tablet_service.cc:1511] Processing CreateTablet for tablet 02b61ce2481342a58d8418df35ed4fdd (DEFAULT_TABLE table=test-workload [id=65a91660c7334cdf9efca4580eb88e22]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:10.688176  5162 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02b61ce2481342a58d8418df35ed4fdd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:10.697039  5161 tablet_service.cc:1511] Processing CreateTablet for tablet 33f2bd13db554c9397573a6c81ceb5d1 (DEFAULT_TABLE table=test-workload [id=65a91660c7334cdf9efca4580eb88e22]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:10.698441  5161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33f2bd13db554c9397573a6c81ceb5d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:10.705559  5154 tablet_service.cc:1511] Processing CreateTablet for tablet c45195d3728449a1813e1bbe3ce5a981 (DEFAULT_TABLE table=test-workload [id=65a91660c7334cdf9efca4580eb88e22]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:10.707010  5154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c45195d3728449a1813e1bbe3ce5a981. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:10.707297  5159 tablet_service.cc:1511] Processing CreateTablet for tablet 619fadedef99424fb02cb2220e11f71d (DEFAULT_TABLE table=test-workload [id=65a91660c7334cdf9efca4580eb88e22]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:10.708544  5159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 619fadedef99424fb02cb2220e11f71d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:10.710777  5158 tablet_service.cc:1511] Processing CreateTablet for tablet 85f195d86c444318a3b33ec5c008e238 (DEFAULT_TABLE table=test-workload [id=65a91660c7334cdf9efca4580eb88e22]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:10.712044  5158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 85f195d86c444318a3b33ec5c008e238. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:10.713896  5157 tablet_service.cc:1511] Processing CreateTablet for tablet fbb576f6df1d4ea899f4e15ca176a28b (DEFAULT_TABLE table=test-workload [id=65a91660c7334cdf9efca4580eb88e22]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:10.715210  5157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbb576f6df1d4ea899f4e15ca176a28b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:10.717686  5156 tablet_service.cc:1511] Processing CreateTablet for tablet a4a20c8585a445b78ff71276699f1693 (DEFAULT_TABLE table=test-workload [id=65a91660c7334cdf9efca4580eb88e22]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:10.718919  5156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a4a20c8585a445b78ff71276699f1693. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:10.722956  5155 tablet_service.cc:1511] Processing CreateTablet for tablet 35090704c57b43d494666e056fade162 (DEFAULT_TABLE table=test-workload [id=65a91660c7334cdf9efca4580eb88e22]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:10.724200  5155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35090704c57b43d494666e056fade162. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:10.705520  5160 tablet_service.cc:1511] Processing CreateTablet for tablet c56044a4794e4299af4ee1d462580192 (DEFAULT_TABLE table=test-workload [id=65a91660c7334cdf9efca4580eb88e22]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:10.738481  5160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c56044a4794e4299af4ee1d462580192. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:10.783699  5362 tablet_bootstrap.cc:492] T 35090704c57b43d494666e056fade162 P faf57cab004346baae3fe74487d12316: Bootstrap starting.
I20260709 13:13:10.783766  5361 tablet_bootstrap.cc:492] T 02b61ce2481342a58d8418df35ed4fdd P 00e3ba273af645d881fe92b48b615951: Bootstrap starting.
I20260709 13:13:10.790392  5362 tablet_bootstrap.cc:654] T 35090704c57b43d494666e056fade162 P faf57cab004346baae3fe74487d12316: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:10.790614  5361 tablet_bootstrap.cc:654] T 02b61ce2481342a58d8418df35ed4fdd P 00e3ba273af645d881fe92b48b615951: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:10.807403  5363 tablet_bootstrap.cc:492] T c45195d3728449a1813e1bbe3ce5a981 P 20c10f8bb9404efea93b7709bff70f8f: Bootstrap starting.
I20260709 13:13:10.813562  5363 tablet_bootstrap.cc:654] T c45195d3728449a1813e1bbe3ce5a981 P 20c10f8bb9404efea93b7709bff70f8f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:10.835807  5362 tablet_bootstrap.cc:492] T 35090704c57b43d494666e056fade162 P faf57cab004346baae3fe74487d12316: No bootstrap required, opened a new log
I20260709 13:13:10.836339  5362 ts_tablet_manager.cc:1403] T 35090704c57b43d494666e056fade162 P faf57cab004346baae3fe74487d12316: Time spent bootstrapping tablet: real 0.053s	user 0.012s	sys 0.018s
I20260709 13:13:10.839195  5362 raft_consensus.cc:359] T 35090704c57b43d494666e056fade162 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:10.839901  5362 raft_consensus.cc:385] T 35090704c57b43d494666e056fade162 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:10.840161  5362 raft_consensus.cc:740] T 35090704c57b43d494666e056fade162 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: faf57cab004346baae3fe74487d12316, State: Initialized, Role: FOLLOWER
I20260709 13:13:10.840787  5362 consensus_queue.cc:260] T 35090704c57b43d494666e056fade162 P faf57cab004346baae3fe74487d12316 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:10.841581  5361 tablet_bootstrap.cc:492] T 02b61ce2481342a58d8418df35ed4fdd P 00e3ba273af645d881fe92b48b615951: No bootstrap required, opened a new log
I20260709 13:13:10.842144  5361 ts_tablet_manager.cc:1403] T 02b61ce2481342a58d8418df35ed4fdd P 00e3ba273af645d881fe92b48b615951: Time spent bootstrapping tablet: real 0.059s	user 0.033s	sys 0.024s
I20260709 13:13:10.842710  5272 heartbeater.cc:499] Master 127.28.54.126:39035 was elected leader, sending a full tablet report...
I20260709 13:13:10.843118  5363 tablet_bootstrap.cc:492] T c45195d3728449a1813e1bbe3ce5a981 P 20c10f8bb9404efea93b7709bff70f8f: No bootstrap required, opened a new log
I20260709 13:13:10.843151  5362 ts_tablet_manager.cc:1434] T 35090704c57b43d494666e056fade162 P faf57cab004346baae3fe74487d12316: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 13:13:10.843700  5363 ts_tablet_manager.cc:1403] T c45195d3728449a1813e1bbe3ce5a981 P 20c10f8bb9404efea93b7709bff70f8f: Time spent bootstrapping tablet: real 0.049s	user 0.005s	sys 0.007s
I20260709 13:13:10.844496  5362 tablet_bootstrap.cc:492] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316: Bootstrap starting.
I20260709 13:13:10.845053  5361 raft_consensus.cc:359] T 02b61ce2481342a58d8418df35ed4fdd P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } }
I20260709 13:13:10.845826  5361 raft_consensus.cc:385] T 02b61ce2481342a58d8418df35ed4fdd P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:10.846134  5361 raft_consensus.cc:740] T 02b61ce2481342a58d8418df35ed4fdd P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00e3ba273af645d881fe92b48b615951, State: Initialized, Role: FOLLOWER
I20260709 13:13:10.846563  5363 raft_consensus.cc:359] T c45195d3728449a1813e1bbe3ce5a981 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:10.846869  5361 consensus_queue.cc:260] T 02b61ce2481342a58d8418df35ed4fdd P 00e3ba273af645d881fe92b48b615951 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } }
I20260709 13:13:10.847427  5363 raft_consensus.cc:385] T c45195d3728449a1813e1bbe3ce5a981 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:10.847817  5363 raft_consensus.cc:740] T c45195d3728449a1813e1bbe3ce5a981 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c10f8bb9404efea93b7709bff70f8f, State: Initialized, Role: FOLLOWER
I20260709 13:13:10.848722  5363 consensus_queue.cc:260] T c45195d3728449a1813e1bbe3ce5a981 P 20c10f8bb9404efea93b7709bff70f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:10.851413  5362 tablet_bootstrap.cc:654] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:10.855259  5363 ts_tablet_manager.cc:1434] T c45195d3728449a1813e1bbe3ce5a981 P 20c10f8bb9404efea93b7709bff70f8f: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:13:10.856114  5197 heartbeater.cc:499] Master 127.28.54.126:39035 was elected leader, sending a full tablet report...
I20260709 13:13:10.861820  5363 tablet_bootstrap.cc:492] T 33f2bd13db554c9397573a6c81ceb5d1 P 20c10f8bb9404efea93b7709bff70f8f: Bootstrap starting.
I20260709 13:13:10.862763  5362 tablet_bootstrap.cc:492] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316: No bootstrap required, opened a new log
I20260709 13:13:10.863319  5362 ts_tablet_manager.cc:1403] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 13:13:10.866133  5362 raft_consensus.cc:359] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:10.866981  5362 raft_consensus.cc:385] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:10.867276  5346 heartbeater.cc:499] Master 127.28.54.126:39035 was elected leader, sending a full tablet report...
I20260709 13:13:10.867642  5361 ts_tablet_manager.cc:1434] T 02b61ce2481342a58d8418df35ed4fdd P 00e3ba273af645d881fe92b48b615951: Time spent starting tablet: real 0.025s	user 0.013s	sys 0.011s
I20260709 13:13:10.868711  5361 tablet_bootstrap.cc:492] T c45195d3728449a1813e1bbe3ce5a981 P 00e3ba273af645d881fe92b48b615951: Bootstrap starting.
I20260709 13:13:10.869385  5363 tablet_bootstrap.cc:654] T 33f2bd13db554c9397573a6c81ceb5d1 P 20c10f8bb9404efea93b7709bff70f8f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:10.867311  5362 raft_consensus.cc:740] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: faf57cab004346baae3fe74487d12316, State: Initialized, Role: FOLLOWER
I20260709 13:13:10.872659  5362 consensus_queue.cc:260] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:10.874817  5361 tablet_bootstrap.cc:654] T c45195d3728449a1813e1bbe3ce5a981 P 00e3ba273af645d881fe92b48b615951: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:10.875691  5362 ts_tablet_manager.cc:1434] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 13:13:10.876679  5362 tablet_bootstrap.cc:492] T c56044a4794e4299af4ee1d462580192 P faf57cab004346baae3fe74487d12316: Bootstrap starting.
I20260709 13:13:10.881057  5363 tablet_bootstrap.cc:492] T 33f2bd13db554c9397573a6c81ceb5d1 P 20c10f8bb9404efea93b7709bff70f8f: No bootstrap required, opened a new log
I20260709 13:13:10.882597  5362 tablet_bootstrap.cc:654] T c56044a4794e4299af4ee1d462580192 P faf57cab004346baae3fe74487d12316: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:10.882861  5363 ts_tablet_manager.cc:1403] T 33f2bd13db554c9397573a6c81ceb5d1 P 20c10f8bb9404efea93b7709bff70f8f: Time spent bootstrapping tablet: real 0.021s	user 0.014s	sys 0.003s
I20260709 13:13:10.886380  5363 raft_consensus.cc:359] T 33f2bd13db554c9397573a6c81ceb5d1 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:10.887209  5363 raft_consensus.cc:385] T 33f2bd13db554c9397573a6c81ceb5d1 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:10.887558  5363 raft_consensus.cc:740] T 33f2bd13db554c9397573a6c81ceb5d1 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c10f8bb9404efea93b7709bff70f8f, State: Initialized, Role: FOLLOWER
I20260709 13:13:10.888501  5363 consensus_queue.cc:260] T 33f2bd13db554c9397573a6c81ceb5d1 P 20c10f8bb9404efea93b7709bff70f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:10.889979  5368 raft_consensus.cc:493] T 02b61ce2481342a58d8418df35ed4fdd P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.890501  5368 raft_consensus.cc:515] T 02b61ce2481342a58d8418df35ed4fdd P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } }
I20260709 13:13:10.905217  5368 leader_election.cc:290] T 02b61ce2481342a58d8418df35ed4fdd P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers faf57cab004346baae3fe74487d12316 (127.28.54.66:33871), 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789)
I20260709 13:13:10.910373  5172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b61ce2481342a58d8418df35ed4fdd" candidate_uuid: "00e3ba273af645d881fe92b48b615951" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c10f8bb9404efea93b7709bff70f8f" is_pre_election: true
W20260709 13:13:10.912370  5287 leader_election.cc:343] T 02b61ce2481342a58d8418df35ed4fdd P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:10.925633  5363 ts_tablet_manager.cc:1434] T 33f2bd13db554c9397573a6c81ceb5d1 P 20c10f8bb9404efea93b7709bff70f8f: Time spent starting tablet: real 0.042s	user 0.005s	sys 0.000s
I20260709 13:13:10.928457  5361 tablet_bootstrap.cc:492] T c45195d3728449a1813e1bbe3ce5a981 P 00e3ba273af645d881fe92b48b615951: No bootstrap required, opened a new log
I20260709 13:13:10.929025  5361 ts_tablet_manager.cc:1403] T c45195d3728449a1813e1bbe3ce5a981 P 00e3ba273af645d881fe92b48b615951: Time spent bootstrapping tablet: real 0.061s	user 0.023s	sys 0.036s
I20260709 13:13:10.929594  5362 tablet_bootstrap.cc:492] T c56044a4794e4299af4ee1d462580192 P faf57cab004346baae3fe74487d12316: No bootstrap required, opened a new log
I20260709 13:13:10.930154  5362 ts_tablet_manager.cc:1403] T c56044a4794e4299af4ee1d462580192 P faf57cab004346baae3fe74487d12316: Time spent bootstrapping tablet: real 0.054s	user 0.023s	sys 0.030s
I20260709 13:13:10.931628  5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b61ce2481342a58d8418df35ed4fdd" candidate_uuid: "00e3ba273af645d881fe92b48b615951" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "faf57cab004346baae3fe74487d12316" is_pre_election: true
I20260709 13:13:10.931877  5361 raft_consensus.cc:359] T c45195d3728449a1813e1bbe3ce5a981 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:10.932567  5361 raft_consensus.cc:385] T c45195d3728449a1813e1bbe3ce5a981 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:10.932915  5361 raft_consensus.cc:740] T c45195d3728449a1813e1bbe3ce5a981 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00e3ba273af645d881fe92b48b615951, State: Initialized, Role: FOLLOWER
I20260709 13:13:10.932996  5362 raft_consensus.cc:359] T c56044a4794e4299af4ee1d462580192 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
W20260709 13:13:10.933410  5284 leader_election.cc:343] T 02b61ce2481342a58d8418df35ed4fdd P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer faf57cab004346baae3fe74487d12316 (127.28.54.66:33871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:10.934103  5284 leader_election.cc:304] T 02b61ce2481342a58d8418df35ed4fdd P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00e3ba273af645d881fe92b48b615951; no voters: 20c10f8bb9404efea93b7709bff70f8f, faf57cab004346baae3fe74487d12316
I20260709 13:13:10.933868  5361 consensus_queue.cc:260] T c45195d3728449a1813e1bbe3ce5a981 P 00e3ba273af645d881fe92b48b615951 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:10.933880  5362 raft_consensus.cc:385] T c56044a4794e4299af4ee1d462580192 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:10.934824  5368 raft_consensus.cc:2749] T 02b61ce2481342a58d8418df35ed4fdd P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:10.935591  5362 raft_consensus.cc:740] T c56044a4794e4299af4ee1d462580192 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: faf57cab004346baae3fe74487d12316, State: Initialized, Role: FOLLOWER
I20260709 13:13:10.937300  5361 ts_tablet_manager.cc:1434] T c45195d3728449a1813e1bbe3ce5a981 P 00e3ba273af645d881fe92b48b615951: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 13:13:10.937167  5362 consensus_queue.cc:260] T c56044a4794e4299af4ee1d462580192 P faf57cab004346baae3fe74487d12316 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:10.938221  5361 tablet_bootstrap.cc:492] T 85f195d86c444318a3b33ec5c008e238 P 00e3ba273af645d881fe92b48b615951: Bootstrap starting.
I20260709 13:13:10.939225  5362 ts_tablet_manager.cc:1434] T c56044a4794e4299af4ee1d462580192 P faf57cab004346baae3fe74487d12316: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 13:13:10.940140  5362 tablet_bootstrap.cc:492] T 85f195d86c444318a3b33ec5c008e238 P faf57cab004346baae3fe74487d12316: Bootstrap starting.
I20260709 13:13:10.944491  5361 tablet_bootstrap.cc:654] T 85f195d86c444318a3b33ec5c008e238 P 00e3ba273af645d881fe92b48b615951: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:10.934897  5363 tablet_bootstrap.cc:492] T 02b61ce2481342a58d8418df35ed4fdd P 20c10f8bb9404efea93b7709bff70f8f: Bootstrap starting.
I20260709 13:13:10.946211  5362 tablet_bootstrap.cc:654] T 85f195d86c444318a3b33ec5c008e238 P faf57cab004346baae3fe74487d12316: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:10.952955  5363 tablet_bootstrap.cc:654] T 02b61ce2481342a58d8418df35ed4fdd P 20c10f8bb9404efea93b7709bff70f8f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:10.955456  5361 tablet_bootstrap.cc:492] T 85f195d86c444318a3b33ec5c008e238 P 00e3ba273af645d881fe92b48b615951: No bootstrap required, opened a new log
I20260709 13:13:10.955964  5361 ts_tablet_manager.cc:1403] T 85f195d86c444318a3b33ec5c008e238 P 00e3ba273af645d881fe92b48b615951: Time spent bootstrapping tablet: real 0.018s	user 0.007s	sys 0.008s
I20260709 13:13:10.958261  5363 tablet_bootstrap.cc:492] T 02b61ce2481342a58d8418df35ed4fdd P 20c10f8bb9404efea93b7709bff70f8f: No bootstrap required, opened a new log
I20260709 13:13:10.958601  5362 tablet_bootstrap.cc:492] T 85f195d86c444318a3b33ec5c008e238 P faf57cab004346baae3fe74487d12316: No bootstrap required, opened a new log
I20260709 13:13:10.958465  5361 raft_consensus.cc:359] T 85f195d86c444318a3b33ec5c008e238 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:10.958822  5363 ts_tablet_manager.cc:1403] T 02b61ce2481342a58d8418df35ed4fdd P 20c10f8bb9404efea93b7709bff70f8f: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.004s
I20260709 13:13:10.959141  5362 ts_tablet_manager.cc:1403] T 85f195d86c444318a3b33ec5c008e238 P faf57cab004346baae3fe74487d12316: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.007s
I20260709 13:13:10.959158  5361 raft_consensus.cc:385] T 85f195d86c444318a3b33ec5c008e238 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:10.959638  5361 raft_consensus.cc:740] T 85f195d86c444318a3b33ec5c008e238 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00e3ba273af645d881fe92b48b615951, State: Initialized, Role: FOLLOWER
I20260709 13:13:10.960265  5361 consensus_queue.cc:260] T 85f195d86c444318a3b33ec5c008e238 P 00e3ba273af645d881fe92b48b615951 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:10.961848  5363 raft_consensus.cc:359] T 02b61ce2481342a58d8418df35ed4fdd P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } }
I20260709 13:13:10.962463  5361 ts_tablet_manager.cc:1434] T 85f195d86c444318a3b33ec5c008e238 P 00e3ba273af645d881fe92b48b615951: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.004s
I20260709 13:13:10.962204  5362 raft_consensus.cc:359] T 85f195d86c444318a3b33ec5c008e238 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:10.962663  5363 raft_consensus.cc:385] T 02b61ce2481342a58d8418df35ed4fdd P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:10.963009  5362 raft_consensus.cc:385] T 85f195d86c444318a3b33ec5c008e238 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:10.963054  5363 raft_consensus.cc:740] T 02b61ce2481342a58d8418df35ed4fdd P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c10f8bb9404efea93b7709bff70f8f, State: Initialized, Role: FOLLOWER
I20260709 13:13:10.963555  5361 tablet_bootstrap.cc:492] T 619fadedef99424fb02cb2220e11f71d P 00e3ba273af645d881fe92b48b615951: Bootstrap starting.
I20260709 13:13:10.963464  5362 raft_consensus.cc:740] T 85f195d86c444318a3b33ec5c008e238 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: faf57cab004346baae3fe74487d12316, State: Initialized, Role: FOLLOWER
I20260709 13:13:10.964097  5363 consensus_queue.cc:260] T 02b61ce2481342a58d8418df35ed4fdd P 20c10f8bb9404efea93b7709bff70f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } }
I20260709 13:13:10.964468  5362 consensus_queue.cc:260] T 85f195d86c444318a3b33ec5c008e238 P faf57cab004346baae3fe74487d12316 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:10.968308  5369 raft_consensus.cc:493] T c45195d3728449a1813e1bbe3ce5a981 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.968725  5362 ts_tablet_manager.cc:1434] T 85f195d86c444318a3b33ec5c008e238 P faf57cab004346baae3fe74487d12316: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:13:10.969852  5362 tablet_bootstrap.cc:492] T 02b61ce2481342a58d8418df35ed4fdd P faf57cab004346baae3fe74487d12316: Bootstrap starting.
I20260709 13:13:10.970244  5361 tablet_bootstrap.cc:654] T 619fadedef99424fb02cb2220e11f71d P 00e3ba273af645d881fe92b48b615951: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:10.968777  5369 raft_consensus.cc:515] T c45195d3728449a1813e1bbe3ce5a981 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:10.975807  5362 tablet_bootstrap.cc:654] T 02b61ce2481342a58d8418df35ed4fdd P faf57cab004346baae3fe74487d12316: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:10.981541  5361 tablet_bootstrap.cc:492] T 619fadedef99424fb02cb2220e11f71d P 00e3ba273af645d881fe92b48b615951: No bootstrap required, opened a new log
I20260709 13:13:10.982064  5361 ts_tablet_manager.cc:1403] T 619fadedef99424fb02cb2220e11f71d P 00e3ba273af645d881fe92b48b615951: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.008s
I20260709 13:13:10.984444  5369 leader_election.cc:290] T c45195d3728449a1813e1bbe3ce5a981 P 20c10f8bb9404efea93b7709bff70f8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers faf57cab004346baae3fe74487d12316 (127.28.54.66:33871), 00e3ba273af645d881fe92b48b615951 (127.28.54.67:44205)
I20260709 13:13:10.986321  5361 raft_consensus.cc:359] T 619fadedef99424fb02cb2220e11f71d P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:10.987177  5361 raft_consensus.cc:385] T 619fadedef99424fb02cb2220e11f71d P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:10.987501  5361 raft_consensus.cc:740] T 619fadedef99424fb02cb2220e11f71d P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00e3ba273af645d881fe92b48b615951, State: Initialized, Role: FOLLOWER
I20260709 13:13:10.988389  5361 consensus_queue.cc:260] T 619fadedef99424fb02cb2220e11f71d P 00e3ba273af645d881fe92b48b615951 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:10.989455  5363 ts_tablet_manager.cc:1434] T 02b61ce2481342a58d8418df35ed4fdd P 20c10f8bb9404efea93b7709bff70f8f: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.002s
I20260709 13:13:10.992302  5361 ts_tablet_manager.cc:1434] T 619fadedef99424fb02cb2220e11f71d P 00e3ba273af645d881fe92b48b615951: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260709 13:13:10.992806  5367 raft_consensus.cc:493] T 35090704c57b43d494666e056fade162 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:10.996162  5367 raft_consensus.cc:515] T 35090704c57b43d494666e056fade162 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:10.996702  5361 tablet_bootstrap.cc:492] T 35090704c57b43d494666e056fade162 P 00e3ba273af645d881fe92b48b615951: Bootstrap starting.
I20260709 13:13:10.995048  5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c45195d3728449a1813e1bbe3ce5a981" candidate_uuid: "20c10f8bb9404efea93b7709bff70f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "faf57cab004346baae3fe74487d12316" is_pre_election: true
I20260709 13:13:11.003504  5363 tablet_bootstrap.cc:492] T 85f195d86c444318a3b33ec5c008e238 P 20c10f8bb9404efea93b7709bff70f8f: Bootstrap starting.
I20260709 13:13:11.008750  5367 leader_election.cc:290] T 35090704c57b43d494666e056fade162 P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789), 00e3ba273af645d881fe92b48b615951 (127.28.54.67:44205)
I20260709 13:13:11.009398  5367 raft_consensus.cc:493] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.009891  5367 raft_consensus.cc:515] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.012463  5363 tablet_bootstrap.cc:654] T 85f195d86c444318a3b33ec5c008e238 P 20c10f8bb9404efea93b7709bff70f8f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:11.013075  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c45195d3728449a1813e1bbe3ce5a981" candidate_uuid: "20c10f8bb9404efea93b7709bff70f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e3ba273af645d881fe92b48b615951" is_pre_election: true
I20260709 13:13:11.013865  5321 raft_consensus.cc:2468] T c45195d3728449a1813e1bbe3ce5a981 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c10f8bb9404efea93b7709bff70f8f in term 0.
W20260709 13:13:11.000586  5135 leader_election.cc:343] T c45195d3728449a1813e1bbe3ce5a981 P 20c10f8bb9404efea93b7709bff70f8f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer faf57cab004346baae3fe74487d12316 (127.28.54.66:33871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:11.016710  5369 raft_consensus.cc:493] T 02b61ce2481342a58d8418df35ed4fdd P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.016832  5361 tablet_bootstrap.cc:654] T 35090704c57b43d494666e056fade162 P 00e3ba273af645d881fe92b48b615951: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:11.017253  5369 raft_consensus.cc:515] T 02b61ce2481342a58d8418df35ed4fdd P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } }
I20260709 13:13:11.017596  5138 leader_election.cc:304] T c45195d3728449a1813e1bbe3ce5a981 P 20c10f8bb9404efea93b7709bff70f8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00e3ba273af645d881fe92b48b615951, 20c10f8bb9404efea93b7709bff70f8f; no voters: faf57cab004346baae3fe74487d12316
I20260709 13:13:11.019480  5369 leader_election.cc:290] T 02b61ce2481342a58d8418df35ed4fdd P 20c10f8bb9404efea93b7709bff70f8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 00e3ba273af645d881fe92b48b615951 (127.28.54.67:44205), faf57cab004346baae3fe74487d12316 (127.28.54.66:33871)
I20260709 13:13:11.019992  5369 raft_consensus.cc:2804] T c45195d3728449a1813e1bbe3ce5a981 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:11.020327  5369 raft_consensus.cc:493] T c45195d3728449a1813e1bbe3ce5a981 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:11.020632  5369 raft_consensus.cc:3060] T c45195d3728449a1813e1bbe3ce5a981 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:11.022151  5362 tablet_bootstrap.cc:492] T 02b61ce2481342a58d8418df35ed4fdd P faf57cab004346baae3fe74487d12316: No bootstrap required, opened a new log
I20260709 13:13:11.022708  5362 ts_tablet_manager.cc:1403] T 02b61ce2481342a58d8418df35ed4fdd P faf57cab004346baae3fe74487d12316: Time spent bootstrapping tablet: real 0.053s	user 0.024s	sys 0.027s
I20260709 13:13:11.022722  5367 leader_election.cc:290] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789), 00e3ba273af645d881fe92b48b615951 (127.28.54.67:44205)
I20260709 13:13:11.025864  5362 raft_consensus.cc:359] T 02b61ce2481342a58d8418df35ed4fdd P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } }
I20260709 13:13:11.026683  5362 raft_consensus.cc:385] T 02b61ce2481342a58d8418df35ed4fdd P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:11.027027  5362 raft_consensus.cc:740] T 02b61ce2481342a58d8418df35ed4fdd P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: faf57cab004346baae3fe74487d12316, State: Initialized, Role: FOLLOWER
I20260709 13:13:11.027932  5362 consensus_queue.cc:260] T 02b61ce2481342a58d8418df35ed4fdd P faf57cab004346baae3fe74487d12316 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } }
I20260709 13:13:11.028735  5369 raft_consensus.cc:515] T c45195d3728449a1813e1bbe3ce5a981 P 20c10f8bb9404efea93b7709bff70f8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.030073  5362 ts_tablet_manager.cc:1434] T 02b61ce2481342a58d8418df35ed4fdd P faf57cab004346baae3fe74487d12316: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:11.031148  5362 tablet_bootstrap.cc:492] T fbb576f6df1d4ea899f4e15ca176a28b P faf57cab004346baae3fe74487d12316: Bootstrap starting.
I20260709 13:13:11.035243  5369 leader_election.cc:290] T c45195d3728449a1813e1bbe3ce5a981 P 20c10f8bb9404efea93b7709bff70f8f [CANDIDATE]: Term 1 election: Requested vote from peers faf57cab004346baae3fe74487d12316 (127.28.54.66:33871), 00e3ba273af645d881fe92b48b615951 (127.28.54.67:44205)
I20260709 13:13:11.037802  5362 tablet_bootstrap.cc:654] T fbb576f6df1d4ea899f4e15ca176a28b P faf57cab004346baae3fe74487d12316: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:11.049820  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b61ce2481342a58d8418df35ed4fdd" candidate_uuid: "20c10f8bb9404efea93b7709bff70f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e3ba273af645d881fe92b48b615951" is_pre_election: true
I20260709 13:13:11.050561  5321 raft_consensus.cc:2468] T 02b61ce2481342a58d8418df35ed4fdd P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c10f8bb9404efea93b7709bff70f8f in term 0.
I20260709 13:13:11.051093  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c45195d3728449a1813e1bbe3ce5a981" candidate_uuid: "20c10f8bb9404efea93b7709bff70f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e3ba273af645d881fe92b48b615951"
I20260709 13:13:11.051723  5320 raft_consensus.cc:3060] T c45195d3728449a1813e1bbe3ce5a981 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:11.051816  5138 leader_election.cc:304] T 02b61ce2481342a58d8418df35ed4fdd P 20c10f8bb9404efea93b7709bff70f8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e3ba273af645d881fe92b48b615951, 20c10f8bb9404efea93b7709bff70f8f; no voters: 
I20260709 13:13:11.052058  5361 tablet_bootstrap.cc:492] T 35090704c57b43d494666e056fade162 P 00e3ba273af645d881fe92b48b615951: No bootstrap required, opened a new log
I20260709 13:13:11.052963  5361 ts_tablet_manager.cc:1403] T 35090704c57b43d494666e056fade162 P 00e3ba273af645d881fe92b48b615951: Time spent bootstrapping tablet: real 0.056s	user 0.014s	sys 0.010s
I20260709 13:13:11.056442  5385 raft_consensus.cc:2804] T 02b61ce2481342a58d8418df35ed4fdd P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:11.056936  5385 raft_consensus.cc:493] T 02b61ce2481342a58d8418df35ed4fdd P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:11.057299  5385 raft_consensus.cc:3060] T 02b61ce2481342a58d8418df35ed4fdd P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:11.059015  5320 raft_consensus.cc:2468] T c45195d3728449a1813e1bbe3ce5a981 P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c10f8bb9404efea93b7709bff70f8f in term 1.
I20260709 13:13:11.060591  5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b61ce2481342a58d8418df35ed4fdd" candidate_uuid: "20c10f8bb9404efea93b7709bff70f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "faf57cab004346baae3fe74487d12316" is_pre_election: true
I20260709 13:13:11.061082  5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c45195d3728449a1813e1bbe3ce5a981" candidate_uuid: "20c10f8bb9404efea93b7709bff70f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "faf57cab004346baae3fe74487d12316"
I20260709 13:13:11.061242  5247 raft_consensus.cc:2468] T 02b61ce2481342a58d8418df35ed4fdd P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c10f8bb9404efea93b7709bff70f8f in term 0.
I20260709 13:13:11.060220  5138 leader_election.cc:304] T c45195d3728449a1813e1bbe3ce5a981 P 20c10f8bb9404efea93b7709bff70f8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e3ba273af645d881fe92b48b615951, 20c10f8bb9404efea93b7709bff70f8f; no voters: 
W20260709 13:13:11.064214  5135 leader_election.cc:343] T c45195d3728449a1813e1bbe3ce5a981 P 20c10f8bb9404efea93b7709bff70f8f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer faf57cab004346baae3fe74487d12316 (127.28.54.66:33871): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:11.064404  5369 raft_consensus.cc:2804] T c45195d3728449a1813e1bbe3ce5a981 P 20c10f8bb9404efea93b7709bff70f8f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:11.064764  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35090704c57b43d494666e056fade162" candidate_uuid: "faf57cab004346baae3fe74487d12316" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e3ba273af645d881fe92b48b615951" is_pre_election: true
I20260709 13:13:11.067487  5362 tablet_bootstrap.cc:492] T fbb576f6df1d4ea899f4e15ca176a28b P faf57cab004346baae3fe74487d12316: No bootstrap required, opened a new log
I20260709 13:13:11.067332  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f2bd13db554c9397573a6c81ceb5d1" candidate_uuid: "faf57cab004346baae3fe74487d12316" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e3ba273af645d881fe92b48b615951" is_pre_election: true
I20260709 13:13:11.067860  5363 tablet_bootstrap.cc:492] T 85f195d86c444318a3b33ec5c008e238 P 20c10f8bb9404efea93b7709bff70f8f: No bootstrap required, opened a new log
I20260709 13:13:11.067983  5362 ts_tablet_manager.cc:1403] T fbb576f6df1d4ea899f4e15ca176a28b P faf57cab004346baae3fe74487d12316: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.004s
I20260709 13:13:11.068358  5363 ts_tablet_manager.cc:1403] T 85f195d86c444318a3b33ec5c008e238 P 20c10f8bb9404efea93b7709bff70f8f: Time spent bootstrapping tablet: real 0.065s	user 0.027s	sys 0.006s
W20260709 13:13:11.068874  5213 leader_election.cc:343] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00e3ba273af645d881fe92b48b615951 (127.28.54.67:44205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:11.070864  5362 raft_consensus.cc:359] T fbb576f6df1d4ea899f4e15ca176a28b P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.071116  5363 raft_consensus.cc:359] T 85f195d86c444318a3b33ec5c008e238 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.071592  5362 raft_consensus.cc:385] T fbb576f6df1d4ea899f4e15ca176a28b P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:11.072592  5172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35090704c57b43d494666e056fade162" candidate_uuid: "faf57cab004346baae3fe74487d12316" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c10f8bb9404efea93b7709bff70f8f" is_pre_election: true
I20260709 13:13:11.073161  5363 raft_consensus.cc:385] T 85f195d86c444318a3b33ec5c008e238 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:11.073074  5171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f2bd13db554c9397573a6c81ceb5d1" candidate_uuid: "faf57cab004346baae3fe74487d12316" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c10f8bb9404efea93b7709bff70f8f" is_pre_election: true
I20260709 13:13:11.073653  5363 raft_consensus.cc:740] T 85f195d86c444318a3b33ec5c008e238 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c10f8bb9404efea93b7709bff70f8f, State: Initialized, Role: FOLLOWER
I20260709 13:13:11.073769  5362 raft_consensus.cc:740] T fbb576f6df1d4ea899f4e15ca176a28b P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: faf57cab004346baae3fe74487d12316, State: Initialized, Role: FOLLOWER
W20260709 13:13:11.074787  5213 leader_election.cc:343] T 35090704c57b43d494666e056fade162 P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:11.074512  5362 consensus_queue.cc:260] T fbb576f6df1d4ea899f4e15ca176a28b P faf57cab004346baae3fe74487d12316 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.074472  5363 consensus_queue.cc:260] T 85f195d86c444318a3b33ec5c008e238 P 20c10f8bb9404efea93b7709bff70f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.074082  5171 raft_consensus.cc:2468] T 33f2bd13db554c9397573a6c81ceb5d1 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate faf57cab004346baae3fe74487d12316 in term 0.
I20260709 13:13:11.075848  5369 raft_consensus.cc:697] T c45195d3728449a1813e1bbe3ce5a981 P 20c10f8bb9404efea93b7709bff70f8f [term 1 LEADER]: Becoming Leader. State: Replica: 20c10f8bb9404efea93b7709bff70f8f, State: Running, Role: LEADER
I20260709 13:13:11.076732  5369 consensus_queue.cc:237] T c45195d3728449a1813e1bbe3ce5a981 P 20c10f8bb9404efea93b7709bff70f8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.077080  5363 ts_tablet_manager.cc:1434] T 85f195d86c444318a3b33ec5c008e238 P 20c10f8bb9404efea93b7709bff70f8f: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 13:13:11.076740  5213 leader_election.cc:304] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 20c10f8bb9404efea93b7709bff70f8f, faf57cab004346baae3fe74487d12316; no voters: 00e3ba273af645d881fe92b48b615951
I20260709 13:13:11.078203  5363 tablet_bootstrap.cc:492] T c56044a4794e4299af4ee1d462580192 P 20c10f8bb9404efea93b7709bff70f8f: Bootstrap starting.
I20260709 13:13:11.078122  5383 raft_consensus.cc:2804] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:11.078929  5383 raft_consensus.cc:493] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:11.079243  5383 raft_consensus.cc:3060] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:11.079685  5362 ts_tablet_manager.cc:1434] T fbb576f6df1d4ea899f4e15ca176a28b P faf57cab004346baae3fe74487d12316: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 13:13:11.080668  5362 tablet_bootstrap.cc:492] T 619fadedef99424fb02cb2220e11f71d P faf57cab004346baae3fe74487d12316: Bootstrap starting.
I20260709 13:13:11.085011  5363 tablet_bootstrap.cc:654] T c56044a4794e4299af4ee1d462580192 P 20c10f8bb9404efea93b7709bff70f8f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:11.086666  5362 tablet_bootstrap.cc:654] T 619fadedef99424fb02cb2220e11f71d P faf57cab004346baae3fe74487d12316: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:11.055972  5361 raft_consensus.cc:359] T 35090704c57b43d494666e056fade162 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.088863  5361 raft_consensus.cc:385] T 35090704c57b43d494666e056fade162 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:11.089200  5361 raft_consensus.cc:740] T 35090704c57b43d494666e056fade162 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00e3ba273af645d881fe92b48b615951, State: Initialized, Role: FOLLOWER
I20260709 13:13:11.089977  5361 consensus_queue.cc:260] T 35090704c57b43d494666e056fade162 P 00e3ba273af645d881fe92b48b615951 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.086429  5383 raft_consensus.cc:515] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.090888  5320 raft_consensus.cc:2468] T 35090704c57b43d494666e056fade162 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate faf57cab004346baae3fe74487d12316 in term 0.
I20260709 13:13:11.093343  5171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f2bd13db554c9397573a6c81ceb5d1" candidate_uuid: "faf57cab004346baae3fe74487d12316" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c10f8bb9404efea93b7709bff70f8f"
I20260709 13:13:11.093919  5171 raft_consensus.cc:3060] T 33f2bd13db554c9397573a6c81ceb5d1 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:11.093986  5213 leader_election.cc:304] T 35090704c57b43d494666e056fade162 P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00e3ba273af645d881fe92b48b615951, faf57cab004346baae3fe74487d12316; no voters: 20c10f8bb9404efea93b7709bff70f8f
I20260709 13:13:11.094837  5367 raft_consensus.cc:2804] T 35090704c57b43d494666e056fade162 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:11.095201  5367 raft_consensus.cc:493] T 35090704c57b43d494666e056fade162 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:11.095511  5367 raft_consensus.cc:3060] T 35090704c57b43d494666e056fade162 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:11.096549  5361 ts_tablet_manager.cc:1434] T 35090704c57b43d494666e056fade162 P 00e3ba273af645d881fe92b48b615951: Time spent starting tablet: real 0.043s	user 0.007s	sys 0.000s
I20260709 13:13:11.096634  5363 tablet_bootstrap.cc:492] T c56044a4794e4299af4ee1d462580192 P 20c10f8bb9404efea93b7709bff70f8f: No bootstrap required, opened a new log
I20260709 13:13:11.097311  5363 ts_tablet_manager.cc:1403] T c56044a4794e4299af4ee1d462580192 P 20c10f8bb9404efea93b7709bff70f8f: Time spent bootstrapping tablet: real 0.019s	user 0.017s	sys 0.000s
I20260709 13:13:11.098960  5361 tablet_bootstrap.cc:492] T 33f2bd13db554c9397573a6c81ceb5d1 P 00e3ba273af645d881fe92b48b615951: Bootstrap starting.
I20260709 13:13:11.100793  5363 raft_consensus.cc:359] T c56044a4794e4299af4ee1d462580192 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.101616  5363 raft_consensus.cc:385] T c56044a4794e4299af4ee1d462580192 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:11.101969  5363 raft_consensus.cc:740] T c56044a4794e4299af4ee1d462580192 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c10f8bb9404efea93b7709bff70f8f, State: Initialized, Role: FOLLOWER
I20260709 13:13:11.102496  5367 raft_consensus.cc:515] T 35090704c57b43d494666e056fade162 P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.102833  5363 consensus_queue.cc:260] T c56044a4794e4299af4ee1d462580192 P 20c10f8bb9404efea93b7709bff70f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.105201  5367 leader_election.cc:290] T 35090704c57b43d494666e056fade162 P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 1 election: Requested vote from peers 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789), 00e3ba273af645d881fe92b48b615951 (127.28.54.67:44205)
I20260709 13:13:11.105801  5172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35090704c57b43d494666e056fade162" candidate_uuid: "faf57cab004346baae3fe74487d12316" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c10f8bb9404efea93b7709bff70f8f"
I20260709 13:13:11.105980  5363 ts_tablet_manager.cc:1434] T c56044a4794e4299af4ee1d462580192 P 20c10f8bb9404efea93b7709bff70f8f: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.005s
I20260709 13:13:11.107123  5363 tablet_bootstrap.cc:492] T fbb576f6df1d4ea899f4e15ca176a28b P 20c10f8bb9404efea93b7709bff70f8f: Bootstrap starting.
W20260709 13:13:11.107757  5213 leader_election.cc:343] T 35090704c57b43d494666e056fade162 P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:11.107041  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35090704c57b43d494666e056fade162" candidate_uuid: "faf57cab004346baae3fe74487d12316" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e3ba273af645d881fe92b48b615951"
W20260709 13:13:11.107198  5118 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:11.108783  5320 raft_consensus.cc:3060] T 35090704c57b43d494666e056fade162 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:11.113157  5171 raft_consensus.cc:2468] T 33f2bd13db554c9397573a6c81ceb5d1 P 20c10f8bb9404efea93b7709bff70f8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faf57cab004346baae3fe74487d12316 in term 1.
I20260709 13:13:11.117698  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f2bd13db554c9397573a6c81ceb5d1" candidate_uuid: "faf57cab004346baae3fe74487d12316" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e3ba273af645d881fe92b48b615951"
I20260709 13:13:11.117707  5213 leader_election.cc:304] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c10f8bb9404efea93b7709bff70f8f, faf57cab004346baae3fe74487d12316; no voters: 
I20260709 13:13:11.120098  5367 raft_consensus.cc:2804] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Leader election won for term 1
W20260709 13:13:11.120260  5213 leader_election.cc:343] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 00e3ba273af645d881fe92b48b615951 (127.28.54.67:44205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:11.114934  5363 tablet_bootstrap.cc:654] T fbb576f6df1d4ea899f4e15ca176a28b P 20c10f8bb9404efea93b7709bff70f8f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:11.115581  5320 raft_consensus.cc:2468] T 35090704c57b43d494666e056fade162 P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faf57cab004346baae3fe74487d12316 in term 1.
I20260709 13:13:11.100430  5385 raft_consensus.cc:515] T 02b61ce2481342a58d8418df35ed4fdd P 20c10f8bb9404efea93b7709bff70f8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } }
I20260709 13:13:11.116405  5383 leader_election.cc:290] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 1 election: Requested vote from peers 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789), 00e3ba273af645d881fe92b48b615951 (127.28.54.67:44205)
I20260709 13:13:11.124805  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b61ce2481342a58d8418df35ed4fdd" candidate_uuid: "20c10f8bb9404efea93b7709bff70f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e3ba273af645d881fe92b48b615951"
I20260709 13:13:11.125082  5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b61ce2481342a58d8418df35ed4fdd" candidate_uuid: "20c10f8bb9404efea93b7709bff70f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "faf57cab004346baae3fe74487d12316"
I20260709 13:13:11.125640  5247 raft_consensus.cc:3060] T 02b61ce2481342a58d8418df35ed4fdd P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:11.128414  5362 tablet_bootstrap.cc:492] T 619fadedef99424fb02cb2220e11f71d P faf57cab004346baae3fe74487d12316: No bootstrap required, opened a new log
I20260709 13:13:11.129473  5321 raft_consensus.cc:3060] T 02b61ce2481342a58d8418df35ed4fdd P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:11.130474  5213 leader_election.cc:304] T 35090704c57b43d494666e056fade162 P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00e3ba273af645d881fe92b48b615951, faf57cab004346baae3fe74487d12316; no voters: 20c10f8bb9404efea93b7709bff70f8f
I20260709 13:13:11.131402  5383 raft_consensus.cc:2804] T 35090704c57b43d494666e056fade162 P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:11.131829  5383 raft_consensus.cc:697] T 35090704c57b43d494666e056fade162 P faf57cab004346baae3fe74487d12316 [term 1 LEADER]: Becoming Leader. State: Replica: faf57cab004346baae3fe74487d12316, State: Running, Role: LEADER
I20260709 13:13:11.132615  5383 consensus_queue.cc:237] T 35090704c57b43d494666e056fade162 P faf57cab004346baae3fe74487d12316 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.135996  5390 raft_consensus.cc:493] T 85f195d86c444318a3b33ec5c008e238 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.136480  5390 raft_consensus.cc:515] T 85f195d86c444318a3b33ec5c008e238 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.138197  5321 raft_consensus.cc:2468] T 02b61ce2481342a58d8418df35ed4fdd P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c10f8bb9404efea93b7709bff70f8f in term 1.
I20260709 13:13:11.138681  5361 tablet_bootstrap.cc:654] T 33f2bd13db554c9397573a6c81ceb5d1 P 00e3ba273af645d881fe92b48b615951: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:11.139706  5362 ts_tablet_manager.cc:1403] T 619fadedef99424fb02cb2220e11f71d P faf57cab004346baae3fe74487d12316: Time spent bootstrapping tablet: real 0.059s	user 0.019s	sys 0.011s
I20260709 13:13:11.141836  5138 leader_election.cc:304] T 02b61ce2481342a58d8418df35ed4fdd P 20c10f8bb9404efea93b7709bff70f8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e3ba273af645d881fe92b48b615951, 20c10f8bb9404efea93b7709bff70f8f; no voters: 
I20260709 13:13:11.141258  5070 catalog_manager.cc:5697] T c45195d3728449a1813e1bbe3ce5a981 P 20c10f8bb9404efea93b7709bff70f8f reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65). New cstate: current_term: 1 leader_uuid: "20c10f8bb9404efea93b7709bff70f8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:11.142289  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85f195d86c444318a3b33ec5c008e238" candidate_uuid: "20c10f8bb9404efea93b7709bff70f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e3ba273af645d881fe92b48b615951" is_pre_election: true
I20260709 13:13:11.142710  5369 raft_consensus.cc:2804] T 02b61ce2481342a58d8418df35ed4fdd P 20c10f8bb9404efea93b7709bff70f8f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:11.142977  5321 raft_consensus.cc:2468] T 85f195d86c444318a3b33ec5c008e238 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c10f8bb9404efea93b7709bff70f8f in term 0.
I20260709 13:13:11.152784  5369 raft_consensus.cc:697] T 02b61ce2481342a58d8418df35ed4fdd P 20c10f8bb9404efea93b7709bff70f8f [term 1 LEADER]: Becoming Leader. State: Replica: 20c10f8bb9404efea93b7709bff70f8f, State: Running, Role: LEADER
I20260709 13:13:11.155164  5138 leader_election.cc:304] T 85f195d86c444318a3b33ec5c008e238 P 20c10f8bb9404efea93b7709bff70f8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e3ba273af645d881fe92b48b615951, 20c10f8bb9404efea93b7709bff70f8f; no voters: 
I20260709 13:13:11.155061  5369 consensus_queue.cc:237] T 02b61ce2481342a58d8418df35ed4fdd P 20c10f8bb9404efea93b7709bff70f8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } }
I20260709 13:13:11.138588  5390 leader_election.cc:290] T 85f195d86c444318a3b33ec5c008e238 P 20c10f8bb9404efea93b7709bff70f8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers faf57cab004346baae3fe74487d12316 (127.28.54.66:33871), 00e3ba273af645d881fe92b48b615951 (127.28.54.67:44205)
I20260709 13:13:11.155304  5362 raft_consensus.cc:359] T 619fadedef99424fb02cb2220e11f71d P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.151099  5385 leader_election.cc:290] T 02b61ce2481342a58d8418df35ed4fdd P 20c10f8bb9404efea93b7709bff70f8f [CANDIDATE]: Term 1 election: Requested vote from peers 00e3ba273af645d881fe92b48b615951 (127.28.54.67:44205), faf57cab004346baae3fe74487d12316 (127.28.54.66:33871)
I20260709 13:13:11.159729  5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85f195d86c444318a3b33ec5c008e238" candidate_uuid: "20c10f8bb9404efea93b7709bff70f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "faf57cab004346baae3fe74487d12316" is_pre_election: true
I20260709 13:13:11.156317  5367 raft_consensus.cc:697] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316 [term 1 LEADER]: Becoming Leader. State: Replica: faf57cab004346baae3fe74487d12316, State: Running, Role: LEADER
I20260709 13:13:11.160421  5246 raft_consensus.cc:2468] T 85f195d86c444318a3b33ec5c008e238 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c10f8bb9404efea93b7709bff70f8f in term 0.
I20260709 13:13:11.160820  5367 consensus_queue.cc:237] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.161798  5363 tablet_bootstrap.cc:492] T fbb576f6df1d4ea899f4e15ca176a28b P 20c10f8bb9404efea93b7709bff70f8f: No bootstrap required, opened a new log
I20260709 13:13:11.156998  5362 raft_consensus.cc:385] T 619fadedef99424fb02cb2220e11f71d P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:11.159153  5390 raft_consensus.cc:2804] T 85f195d86c444318a3b33ec5c008e238 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:11.166636  5363 ts_tablet_manager.cc:1403] T fbb576f6df1d4ea899f4e15ca176a28b P 20c10f8bb9404efea93b7709bff70f8f: Time spent bootstrapping tablet: real 0.060s	user 0.029s	sys 0.013s
I20260709 13:13:11.166735  5390 raft_consensus.cc:493] T 85f195d86c444318a3b33ec5c008e238 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:11.170183  5247 raft_consensus.cc:2468] T 02b61ce2481342a58d8418df35ed4fdd P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c10f8bb9404efea93b7709bff70f8f in term 1.
I20260709 13:13:11.170392  5390 raft_consensus.cc:3060] T 85f195d86c444318a3b33ec5c008e238 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:11.166321  5362 raft_consensus.cc:740] T 619fadedef99424fb02cb2220e11f71d P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: faf57cab004346baae3fe74487d12316, State: Initialized, Role: FOLLOWER
I20260709 13:13:11.176831  5361 tablet_bootstrap.cc:492] T 33f2bd13db554c9397573a6c81ceb5d1 P 00e3ba273af645d881fe92b48b615951: No bootstrap required, opened a new log
I20260709 13:13:11.177718  5361 ts_tablet_manager.cc:1403] T 33f2bd13db554c9397573a6c81ceb5d1 P 00e3ba273af645d881fe92b48b615951: Time spent bootstrapping tablet: real 0.079s	user 0.010s	sys 0.008s
I20260709 13:13:11.179869  5362 consensus_queue.cc:260] T 619fadedef99424fb02cb2220e11f71d P faf57cab004346baae3fe74487d12316 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.181726  5362 ts_tablet_manager.cc:1434] T 619fadedef99424fb02cb2220e11f71d P faf57cab004346baae3fe74487d12316: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260709 13:13:11.183578  5362 tablet_bootstrap.cc:492] T a4a20c8585a445b78ff71276699f1693 P faf57cab004346baae3fe74487d12316: Bootstrap starting.
I20260709 13:13:11.184651  5394 raft_consensus.cc:493] T c56044a4794e4299af4ee1d462580192 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.186146  5390 raft_consensus.cc:515] T 85f195d86c444318a3b33ec5c008e238 P 20c10f8bb9404efea93b7709bff70f8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.186473  5394 raft_consensus.cc:515] T c56044a4794e4299af4ee1d462580192 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.186779  5361 raft_consensus.cc:359] T 33f2bd13db554c9397573a6c81ceb5d1 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.187522  5361 raft_consensus.cc:385] T 33f2bd13db554c9397573a6c81ceb5d1 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:11.187815  5361 raft_consensus.cc:740] T 33f2bd13db554c9397573a6c81ceb5d1 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00e3ba273af645d881fe92b48b615951, State: Initialized, Role: FOLLOWER
I20260709 13:13:11.189699  5171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56044a4794e4299af4ee1d462580192" candidate_uuid: "faf57cab004346baae3fe74487d12316" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c10f8bb9404efea93b7709bff70f8f" is_pre_election: true
I20260709 13:13:11.190450  5171 raft_consensus.cc:2468] T c56044a4794e4299af4ee1d462580192 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate faf57cab004346baae3fe74487d12316 in term 0.
I20260709 13:13:11.191534  5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85f195d86c444318a3b33ec5c008e238" candidate_uuid: "20c10f8bb9404efea93b7709bff70f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "faf57cab004346baae3fe74487d12316"
I20260709 13:13:11.191752  5213 leader_election.cc:304] T c56044a4794e4299af4ee1d462580192 P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c10f8bb9404efea93b7709bff70f8f, faf57cab004346baae3fe74487d12316; no voters: 
I20260709 13:13:11.192174  5247 raft_consensus.cc:3060] T 85f195d86c444318a3b33ec5c008e238 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:11.192749  5383 raft_consensus.cc:2804] T c56044a4794e4299af4ee1d462580192 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:11.193148  5383 raft_consensus.cc:493] T c56044a4794e4299af4ee1d462580192 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:11.193508  5383 raft_consensus.cc:3060] T c56044a4794e4299af4ee1d462580192 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:11.193771  5069 catalog_manager.cc:5697] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316 reported cstate change: term changed from 0 to 1, leader changed from <none> to faf57cab004346baae3fe74487d12316 (127.28.54.66). New cstate: current_term: 1 leader_uuid: "faf57cab004346baae3fe74487d12316" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:11.197017  5361 consensus_queue.cc:260] T 33f2bd13db554c9397573a6c81ceb5d1 P 00e3ba273af645d881fe92b48b615951 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.199349  5247 raft_consensus.cc:2468] T 85f195d86c444318a3b33ec5c008e238 P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c10f8bb9404efea93b7709bff70f8f in term 1.
I20260709 13:13:11.201324  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85f195d86c444318a3b33ec5c008e238" candidate_uuid: "20c10f8bb9404efea93b7709bff70f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e3ba273af645d881fe92b48b615951"
I20260709 13:13:11.202975  5321 raft_consensus.cc:3060] T 85f195d86c444318a3b33ec5c008e238 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:11.203215  5383 raft_consensus.cc:515] T c56044a4794e4299af4ee1d462580192 P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.201493  5394 leader_election.cc:290] T c56044a4794e4299af4ee1d462580192 P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789), 00e3ba273af645d881fe92b48b615951 (127.28.54.67:44205)
I20260709 13:13:11.201862  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56044a4794e4299af4ee1d462580192" candidate_uuid: "faf57cab004346baae3fe74487d12316" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e3ba273af645d881fe92b48b615951" is_pre_election: true
W20260709 13:13:11.205554  5213 leader_election.cc:343] T c56044a4794e4299af4ee1d462580192 P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00e3ba273af645d881fe92b48b615951 (127.28.54.67:44205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:11.205551  5361 ts_tablet_manager.cc:1434] T 33f2bd13db554c9397573a6c81ceb5d1 P 00e3ba273af645d881fe92b48b615951: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.003s
I20260709 13:13:11.185261  5363 raft_consensus.cc:359] T fbb576f6df1d4ea899f4e15ca176a28b P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.206779  5363 raft_consensus.cc:385] T fbb576f6df1d4ea899f4e15ca176a28b P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:11.207345  5361 tablet_bootstrap.cc:492] T a4a20c8585a445b78ff71276699f1693 P 00e3ba273af645d881fe92b48b615951: Bootstrap starting.
I20260709 13:13:11.209880  5321 raft_consensus.cc:2468] T 85f195d86c444318a3b33ec5c008e238 P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c10f8bb9404efea93b7709bff70f8f in term 1.
I20260709 13:13:11.210630  5171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56044a4794e4299af4ee1d462580192" candidate_uuid: "faf57cab004346baae3fe74487d12316" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c10f8bb9404efea93b7709bff70f8f"
I20260709 13:13:11.211115  5138 leader_election.cc:304] T 85f195d86c444318a3b33ec5c008e238 P 20c10f8bb9404efea93b7709bff70f8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e3ba273af645d881fe92b48b615951, 20c10f8bb9404efea93b7709bff70f8f; no voters: 
I20260709 13:13:11.208024  5363 raft_consensus.cc:740] T fbb576f6df1d4ea899f4e15ca176a28b P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c10f8bb9404efea93b7709bff70f8f, State: Initialized, Role: FOLLOWER
I20260709 13:13:11.211287  5171 raft_consensus.cc:3060] T c56044a4794e4299af4ee1d462580192 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:11.212051  5369 raft_consensus.cc:2804] T 85f195d86c444318a3b33ec5c008e238 P 20c10f8bb9404efea93b7709bff70f8f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:11.219200  5369 raft_consensus.cc:697] T 85f195d86c444318a3b33ec5c008e238 P 20c10f8bb9404efea93b7709bff70f8f [term 1 LEADER]: Becoming Leader. State: Replica: 20c10f8bb9404efea93b7709bff70f8f, State: Running, Role: LEADER
I20260709 13:13:11.220031  5369 consensus_queue.cc:237] T 85f195d86c444318a3b33ec5c008e238 P 20c10f8bb9404efea93b7709bff70f8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.202405  5390 leader_election.cc:290] T 85f195d86c444318a3b33ec5c008e238 P 20c10f8bb9404efea93b7709bff70f8f [CANDIDATE]: Term 1 election: Requested vote from peers faf57cab004346baae3fe74487d12316 (127.28.54.66:33871), 00e3ba273af645d881fe92b48b615951 (127.28.54.67:44205)
I20260709 13:13:11.214560  5361 tablet_bootstrap.cc:654] T a4a20c8585a445b78ff71276699f1693 P 00e3ba273af645d881fe92b48b615951: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:11.225118  5171 raft_consensus.cc:2468] T c56044a4794e4299af4ee1d462580192 P 20c10f8bb9404efea93b7709bff70f8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faf57cab004346baae3fe74487d12316 in term 1.
I20260709 13:13:11.227386  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56044a4794e4299af4ee1d462580192" candidate_uuid: "faf57cab004346baae3fe74487d12316" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e3ba273af645d881fe92b48b615951"
I20260709 13:13:11.231877  5213 leader_election.cc:304] T c56044a4794e4299af4ee1d462580192 P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c10f8bb9404efea93b7709bff70f8f, faf57cab004346baae3fe74487d12316; no voters: 
I20260709 13:13:11.233246  5394 raft_consensus.cc:2804] T c56044a4794e4299af4ee1d462580192 P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:11.233942  5394 raft_consensus.cc:697] T c56044a4794e4299af4ee1d462580192 P faf57cab004346baae3fe74487d12316 [term 1 LEADER]: Becoming Leader. State: Replica: faf57cab004346baae3fe74487d12316, State: Running, Role: LEADER
W20260709 13:13:11.234484  5213 leader_election.cc:343] T c56044a4794e4299af4ee1d462580192 P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 00e3ba273af645d881fe92b48b615951 (127.28.54.67:44205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:11.235522  5068 catalog_manager.cc:5697] T 35090704c57b43d494666e056fade162 P faf57cab004346baae3fe74487d12316 reported cstate change: term changed from 0 to 1, leader changed from <none> to faf57cab004346baae3fe74487d12316 (127.28.54.66). New cstate: current_term: 1 leader_uuid: "faf57cab004346baae3fe74487d12316" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:11.238062  5394 consensus_queue.cc:237] T c56044a4794e4299af4ee1d462580192 P faf57cab004346baae3fe74487d12316 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.225792  5363 consensus_queue.cc:260] T fbb576f6df1d4ea899f4e15ca176a28b P 20c10f8bb9404efea93b7709bff70f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.238739  5070 catalog_manager.cc:5697] T 85f195d86c444318a3b33ec5c008e238 P 20c10f8bb9404efea93b7709bff70f8f reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65). New cstate: current_term: 1 leader_uuid: "20c10f8bb9404efea93b7709bff70f8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:11.240393  5362 tablet_bootstrap.cc:654] T a4a20c8585a445b78ff71276699f1693 P faf57cab004346baae3fe74487d12316: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:11.240978  5363 ts_tablet_manager.cc:1434] T fbb576f6df1d4ea899f4e15ca176a28b P 20c10f8bb9404efea93b7709bff70f8f: Time spent starting tablet: real 0.074s	user 0.006s	sys 0.000s
I20260709 13:13:11.244889  5363 tablet_bootstrap.cc:492] T 35090704c57b43d494666e056fade162 P 20c10f8bb9404efea93b7709bff70f8f: Bootstrap starting.
I20260709 13:13:11.227523  5383 leader_election.cc:290] T c56044a4794e4299af4ee1d462580192 P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 1 election: Requested vote from peers 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789), 00e3ba273af645d881fe92b48b615951 (127.28.54.67:44205)
I20260709 13:13:11.241232  5070 catalog_manager.cc:5697] T 02b61ce2481342a58d8418df35ed4fdd P 20c10f8bb9404efea93b7709bff70f8f reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65). New cstate: current_term: 1 leader_uuid: "20c10f8bb9404efea93b7709bff70f8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:11.251073  5363 tablet_bootstrap.cc:654] T 35090704c57b43d494666e056fade162 P 20c10f8bb9404efea93b7709bff70f8f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:11.262636  5363 tablet_bootstrap.cc:492] T 35090704c57b43d494666e056fade162 P 20c10f8bb9404efea93b7709bff70f8f: No bootstrap required, opened a new log
I20260709 13:13:11.262831  5362 tablet_bootstrap.cc:492] T a4a20c8585a445b78ff71276699f1693 P faf57cab004346baae3fe74487d12316: No bootstrap required, opened a new log
I20260709 13:13:11.263300  5362 ts_tablet_manager.cc:1403] T a4a20c8585a445b78ff71276699f1693 P faf57cab004346baae3fe74487d12316: Time spent bootstrapping tablet: real 0.080s	user 0.009s	sys 0.008s
I20260709 13:13:11.263300  5363 ts_tablet_manager.cc:1403] T 35090704c57b43d494666e056fade162 P 20c10f8bb9404efea93b7709bff70f8f: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.004s
I20260709 13:13:11.264963  5375 raft_consensus.cc:493] T 33f2bd13db554c9397573a6c81ceb5d1 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.265507  5375 raft_consensus.cc:515] T 33f2bd13db554c9397573a6c81ceb5d1 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.266047  5362 raft_consensus.cc:359] T a4a20c8585a445b78ff71276699f1693 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.266407  5363 raft_consensus.cc:359] T 35090704c57b43d494666e056fade162 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.267192  5363 raft_consensus.cc:385] T 35090704c57b43d494666e056fade162 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:11.267541  5363 raft_consensus.cc:740] T 35090704c57b43d494666e056fade162 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c10f8bb9404efea93b7709bff70f8f, State: Initialized, Role: FOLLOWER
I20260709 13:13:11.266884  5362 raft_consensus.cc:385] T a4a20c8585a445b78ff71276699f1693 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:11.268371  5363 consensus_queue.cc:260] T 35090704c57b43d494666e056fade162 P 20c10f8bb9404efea93b7709bff70f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.268862  5362 raft_consensus.cc:740] T a4a20c8585a445b78ff71276699f1693 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: faf57cab004346baae3fe74487d12316, State: Initialized, Role: FOLLOWER
I20260709 13:13:11.269205  5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f2bd13db554c9397573a6c81ceb5d1" candidate_uuid: "00e3ba273af645d881fe92b48b615951" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "faf57cab004346baae3fe74487d12316" is_pre_election: true
I20260709 13:13:11.269565  5362 consensus_queue.cc:260] T a4a20c8585a445b78ff71276699f1693 P faf57cab004346baae3fe74487d12316 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.270426  5171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f2bd13db554c9397573a6c81ceb5d1" candidate_uuid: "00e3ba273af645d881fe92b48b615951" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c10f8bb9404efea93b7709bff70f8f" is_pre_election: true
I20260709 13:13:11.270852  5363 ts_tablet_manager.cc:1434] T 35090704c57b43d494666e056fade162 P 20c10f8bb9404efea93b7709bff70f8f: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260709 13:13:11.271142  5171 raft_consensus.cc:2393] T 33f2bd13db554c9397573a6c81ceb5d1 P 20c10f8bb9404efea93b7709bff70f8f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00e3ba273af645d881fe92b48b615951 in current term 1: Already voted for candidate faf57cab004346baae3fe74487d12316 in this term.
I20260709 13:13:11.271795  5362 ts_tablet_manager.cc:1434] T a4a20c8585a445b78ff71276699f1693 P faf57cab004346baae3fe74487d12316: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260709 13:13:11.271886  5363 tablet_bootstrap.cc:492] T 619fadedef99424fb02cb2220e11f71d P 20c10f8bb9404efea93b7709bff70f8f: Bootstrap starting.
I20260709 13:13:11.272799  5362 tablet_bootstrap.cc:492] T c45195d3728449a1813e1bbe3ce5a981 P faf57cab004346baae3fe74487d12316: Bootstrap starting.
I20260709 13:13:11.273172  5287 leader_election.cc:304] T 33f2bd13db554c9397573a6c81ceb5d1 P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00e3ba273af645d881fe92b48b615951; no voters: 20c10f8bb9404efea93b7709bff70f8f, faf57cab004346baae3fe74487d12316
I20260709 13:13:11.274078  5368 raft_consensus.cc:3060] T 33f2bd13db554c9397573a6c81ceb5d1 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:11.274334  5068 catalog_manager.cc:5697] T c56044a4794e4299af4ee1d462580192 P faf57cab004346baae3fe74487d12316 reported cstate change: term changed from 0 to 1, leader changed from <none> to faf57cab004346baae3fe74487d12316 (127.28.54.66). New cstate: current_term: 1 leader_uuid: "faf57cab004346baae3fe74487d12316" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:11.270916  5375 leader_election.cc:290] T 33f2bd13db554c9397573a6c81ceb5d1 P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789), faf57cab004346baae3fe74487d12316 (127.28.54.66:33871)
I20260709 13:13:11.278609  5363 tablet_bootstrap.cc:654] T 619fadedef99424fb02cb2220e11f71d P 20c10f8bb9404efea93b7709bff70f8f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:11.278609  5362 tablet_bootstrap.cc:654] T c45195d3728449a1813e1bbe3ce5a981 P faf57cab004346baae3fe74487d12316: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:11.282903  5368 raft_consensus.cc:2749] T 33f2bd13db554c9397573a6c81ceb5d1 P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:11.285132  5361 tablet_bootstrap.cc:492] T a4a20c8585a445b78ff71276699f1693 P 00e3ba273af645d881fe92b48b615951: No bootstrap required, opened a new log
I20260709 13:13:11.285701  5361 ts_tablet_manager.cc:1403] T a4a20c8585a445b78ff71276699f1693 P 00e3ba273af645d881fe92b48b615951: Time spent bootstrapping tablet: real 0.079s	user 0.027s	sys 0.023s
I20260709 13:13:11.288806  5361 raft_consensus.cc:359] T a4a20c8585a445b78ff71276699f1693 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.289557  5361 raft_consensus.cc:385] T a4a20c8585a445b78ff71276699f1693 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:11.289916  5361 raft_consensus.cc:740] T a4a20c8585a445b78ff71276699f1693 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00e3ba273af645d881fe92b48b615951, State: Initialized, Role: FOLLOWER
I20260709 13:13:11.289572  5363 tablet_bootstrap.cc:492] T 619fadedef99424fb02cb2220e11f71d P 20c10f8bb9404efea93b7709bff70f8f: No bootstrap required, opened a new log
I20260709 13:13:11.291054  5363 ts_tablet_manager.cc:1403] T 619fadedef99424fb02cb2220e11f71d P 20c10f8bb9404efea93b7709bff70f8f: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.004s
I20260709 13:13:11.291872  5362 tablet_bootstrap.cc:492] T c45195d3728449a1813e1bbe3ce5a981 P faf57cab004346baae3fe74487d12316: No bootstrap required, opened a new log
I20260709 13:13:11.290597  5361 consensus_queue.cc:260] T a4a20c8585a445b78ff71276699f1693 P 00e3ba273af645d881fe92b48b615951 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.292361  5362 ts_tablet_manager.cc:1403] T c45195d3728449a1813e1bbe3ce5a981 P faf57cab004346baae3fe74487d12316: Time spent bootstrapping tablet: real 0.020s	user 0.011s	sys 0.003s
I20260709 13:13:11.293488  5363 raft_consensus.cc:359] T 619fadedef99424fb02cb2220e11f71d P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.294190  5363 raft_consensus.cc:385] T 619fadedef99424fb02cb2220e11f71d P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:11.294251  5361 ts_tablet_manager.cc:1434] T a4a20c8585a445b78ff71276699f1693 P 00e3ba273af645d881fe92b48b615951: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 13:13:11.294512  5363 raft_consensus.cc:740] T 619fadedef99424fb02cb2220e11f71d P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c10f8bb9404efea93b7709bff70f8f, State: Initialized, Role: FOLLOWER
I20260709 13:13:11.295344  5361 tablet_bootstrap.cc:492] T fbb576f6df1d4ea899f4e15ca176a28b P 00e3ba273af645d881fe92b48b615951: Bootstrap starting.
I20260709 13:13:11.295245  5362 raft_consensus.cc:359] T c45195d3728449a1813e1bbe3ce5a981 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.296067  5362 raft_consensus.cc:385] T c45195d3728449a1813e1bbe3ce5a981 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:11.296378  5362 raft_consensus.cc:740] T c45195d3728449a1813e1bbe3ce5a981 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: faf57cab004346baae3fe74487d12316, State: Initialized, Role: FOLLOWER
I20260709 13:13:11.295367  5363 consensus_queue.cc:260] T 619fadedef99424fb02cb2220e11f71d P 20c10f8bb9404efea93b7709bff70f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.298617  5363 ts_tablet_manager.cc:1434] T 619fadedef99424fb02cb2220e11f71d P 20c10f8bb9404efea93b7709bff70f8f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 13:13:11.299584  5363 tablet_bootstrap.cc:492] T a4a20c8585a445b78ff71276699f1693 P 20c10f8bb9404efea93b7709bff70f8f: Bootstrap starting.
I20260709 13:13:11.301975  5361 tablet_bootstrap.cc:654] T fbb576f6df1d4ea899f4e15ca176a28b P 00e3ba273af645d881fe92b48b615951: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:11.304740  5363 tablet_bootstrap.cc:654] T a4a20c8585a445b78ff71276699f1693 P 20c10f8bb9404efea93b7709bff70f8f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:11.297188  5362 consensus_queue.cc:260] T c45195d3728449a1813e1bbe3ce5a981 P faf57cab004346baae3fe74487d12316 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.309494  5362 ts_tablet_manager.cc:1434] T c45195d3728449a1813e1bbe3ce5a981 P faf57cab004346baae3fe74487d12316: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.002s
I20260709 13:13:11.311429  5361 tablet_bootstrap.cc:492] T fbb576f6df1d4ea899f4e15ca176a28b P 00e3ba273af645d881fe92b48b615951: No bootstrap required, opened a new log
I20260709 13:13:11.311892  5361 ts_tablet_manager.cc:1403] T fbb576f6df1d4ea899f4e15ca176a28b P 00e3ba273af645d881fe92b48b615951: Time spent bootstrapping tablet: real 0.017s	user 0.007s	sys 0.006s
I20260709 13:13:11.312779  5363 tablet_bootstrap.cc:492] T a4a20c8585a445b78ff71276699f1693 P 20c10f8bb9404efea93b7709bff70f8f: No bootstrap required, opened a new log
I20260709 13:13:11.313227  5363 ts_tablet_manager.cc:1403] T a4a20c8585a445b78ff71276699f1693 P 20c10f8bb9404efea93b7709bff70f8f: Time spent bootstrapping tablet: real 0.014s	user 0.008s	sys 0.003s
I20260709 13:13:11.313866  5361 raft_consensus.cc:359] T fbb576f6df1d4ea899f4e15ca176a28b P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.314535  5361 raft_consensus.cc:385] T fbb576f6df1d4ea899f4e15ca176a28b P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:11.314800  5361 raft_consensus.cc:740] T fbb576f6df1d4ea899f4e15ca176a28b P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00e3ba273af645d881fe92b48b615951, State: Initialized, Role: FOLLOWER
I20260709 13:13:11.315488  5361 consensus_queue.cc:260] T fbb576f6df1d4ea899f4e15ca176a28b P 00e3ba273af645d881fe92b48b615951 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.315608  5363 raft_consensus.cc:359] T a4a20c8585a445b78ff71276699f1693 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.317725  5361 ts_tablet_manager.cc:1434] T fbb576f6df1d4ea899f4e15ca176a28b P 00e3ba273af645d881fe92b48b615951: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 13:13:11.318701  5361 tablet_bootstrap.cc:492] T c56044a4794e4299af4ee1d462580192 P 00e3ba273af645d881fe92b48b615951: Bootstrap starting.
I20260709 13:13:11.316351  5363 raft_consensus.cc:385] T a4a20c8585a445b78ff71276699f1693 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:11.322423  5363 raft_consensus.cc:740] T a4a20c8585a445b78ff71276699f1693 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c10f8bb9404efea93b7709bff70f8f, State: Initialized, Role: FOLLOWER
I20260709 13:13:11.323479  5361 tablet_bootstrap.cc:654] T c56044a4794e4299af4ee1d462580192 P 00e3ba273af645d881fe92b48b615951: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:11.323242  5363 consensus_queue.cc:260] T a4a20c8585a445b78ff71276699f1693 P 20c10f8bb9404efea93b7709bff70f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.325277  5363 ts_tablet_manager.cc:1434] T a4a20c8585a445b78ff71276699f1693 P 20c10f8bb9404efea93b7709bff70f8f: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 13:13:11.328173  5361 tablet_bootstrap.cc:492] T c56044a4794e4299af4ee1d462580192 P 00e3ba273af645d881fe92b48b615951: No bootstrap required, opened a new log
I20260709 13:13:11.328594  5361 ts_tablet_manager.cc:1403] T c56044a4794e4299af4ee1d462580192 P 00e3ba273af645d881fe92b48b615951: Time spent bootstrapping tablet: real 0.010s	user 0.005s	sys 0.003s
I20260709 13:13:11.330834  5361 raft_consensus.cc:359] T c56044a4794e4299af4ee1d462580192 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.331457  5361 raft_consensus.cc:385] T c56044a4794e4299af4ee1d462580192 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:11.331712  5361 raft_consensus.cc:740] T c56044a4794e4299af4ee1d462580192 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00e3ba273af645d881fe92b48b615951, State: Initialized, Role: FOLLOWER
I20260709 13:13:11.332321  5361 consensus_queue.cc:260] T c56044a4794e4299af4ee1d462580192 P 00e3ba273af645d881fe92b48b615951 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.334096  5361 ts_tablet_manager.cc:1434] T c56044a4794e4299af4ee1d462580192 P 00e3ba273af645d881fe92b48b615951: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260709 13:13:11.398587  5368 raft_consensus.cc:493] T 619fadedef99424fb02cb2220e11f71d P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.399104  5368 raft_consensus.cc:515] T 619fadedef99424fb02cb2220e11f71d P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.400820  5368 leader_election.cc:290] T 619fadedef99424fb02cb2220e11f71d P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789), faf57cab004346baae3fe74487d12316 (127.28.54.66:33871)
I20260709 13:13:11.401525  5171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fadedef99424fb02cb2220e11f71d" candidate_uuid: "00e3ba273af645d881fe92b48b615951" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c10f8bb9404efea93b7709bff70f8f" is_pre_election: true
I20260709 13:13:11.401890  5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fadedef99424fb02cb2220e11f71d" candidate_uuid: "00e3ba273af645d881fe92b48b615951" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "faf57cab004346baae3fe74487d12316" is_pre_election: true
I20260709 13:13:11.402259  5171 raft_consensus.cc:2468] T 619fadedef99424fb02cb2220e11f71d P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00e3ba273af645d881fe92b48b615951 in term 0.
I20260709 13:13:11.402521  5247 raft_consensus.cc:2468] T 619fadedef99424fb02cb2220e11f71d P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00e3ba273af645d881fe92b48b615951 in term 0.
I20260709 13:13:11.403276  5287 leader_election.cc:304] T 619fadedef99424fb02cb2220e11f71d P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e3ba273af645d881fe92b48b615951, 20c10f8bb9404efea93b7709bff70f8f; no voters: 
I20260709 13:13:11.403908  5368 raft_consensus.cc:2804] T 619fadedef99424fb02cb2220e11f71d P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:11.404248  5368 raft_consensus.cc:493] T 619fadedef99424fb02cb2220e11f71d P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:11.404502  5368 raft_consensus.cc:3060] T 619fadedef99424fb02cb2220e11f71d P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:11.409332  5368 raft_consensus.cc:515] T 619fadedef99424fb02cb2220e11f71d P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.410872  5368 leader_election.cc:290] T 619fadedef99424fb02cb2220e11f71d P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 1 election: Requested vote from peers 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789), faf57cab004346baae3fe74487d12316 (127.28.54.66:33871)
I20260709 13:13:11.411438  5171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fadedef99424fb02cb2220e11f71d" candidate_uuid: "00e3ba273af645d881fe92b48b615951" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c10f8bb9404efea93b7709bff70f8f"
I20260709 13:13:11.411757  5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fadedef99424fb02cb2220e11f71d" candidate_uuid: "00e3ba273af645d881fe92b48b615951" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "faf57cab004346baae3fe74487d12316"
I20260709 13:13:11.412066  5171 raft_consensus.cc:3060] T 619fadedef99424fb02cb2220e11f71d P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:11.412340  5247 raft_consensus.cc:3060] T 619fadedef99424fb02cb2220e11f71d P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:11.412588  5394 raft_consensus.cc:493] T fbb576f6df1d4ea899f4e15ca176a28b P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.413024  5394 raft_consensus.cc:515] T fbb576f6df1d4ea899f4e15ca176a28b P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.414588  5394 leader_election.cc:290] T fbb576f6df1d4ea899f4e15ca176a28b P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789), 00e3ba273af645d881fe92b48b615951 (127.28.54.67:44205)
I20260709 13:13:11.415603  5172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb576f6df1d4ea899f4e15ca176a28b" candidate_uuid: "faf57cab004346baae3fe74487d12316" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c10f8bb9404efea93b7709bff70f8f" is_pre_election: true
I20260709 13:13:11.416005  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb576f6df1d4ea899f4e15ca176a28b" candidate_uuid: "faf57cab004346baae3fe74487d12316" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e3ba273af645d881fe92b48b615951" is_pre_election: true
I20260709 13:13:11.416226  5172 raft_consensus.cc:2468] T fbb576f6df1d4ea899f4e15ca176a28b P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate faf57cab004346baae3fe74487d12316 in term 0.
I20260709 13:13:11.416625  5321 raft_consensus.cc:2468] T fbb576f6df1d4ea899f4e15ca176a28b P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate faf57cab004346baae3fe74487d12316 in term 0.
I20260709 13:13:11.418062  5213 leader_election.cc:304] T fbb576f6df1d4ea899f4e15ca176a28b P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e3ba273af645d881fe92b48b615951, faf57cab004346baae3fe74487d12316; no voters: 
I20260709 13:13:11.418666  5394 raft_consensus.cc:2804] T fbb576f6df1d4ea899f4e15ca176a28b P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:11.418684  5171 raft_consensus.cc:2468] T 619fadedef99424fb02cb2220e11f71d P 20c10f8bb9404efea93b7709bff70f8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00e3ba273af645d881fe92b48b615951 in term 1.
I20260709 13:13:11.419124  5394 raft_consensus.cc:493] T fbb576f6df1d4ea899f4e15ca176a28b P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:11.418684  5247 raft_consensus.cc:2468] T 619fadedef99424fb02cb2220e11f71d P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00e3ba273af645d881fe92b48b615951 in term 1.
I20260709 13:13:11.419530  5394 raft_consensus.cc:3060] T fbb576f6df1d4ea899f4e15ca176a28b P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:11.419986  5287 leader_election.cc:304] T 619fadedef99424fb02cb2220e11f71d P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e3ba273af645d881fe92b48b615951, 20c10f8bb9404efea93b7709bff70f8f; no voters: 
I20260709 13:13:11.420603  5368 raft_consensus.cc:2804] T 619fadedef99424fb02cb2220e11f71d P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:11.421051  5368 raft_consensus.cc:697] T 619fadedef99424fb02cb2220e11f71d P 00e3ba273af645d881fe92b48b615951 [term 1 LEADER]: Becoming Leader. State: Replica: 00e3ba273af645d881fe92b48b615951, State: Running, Role: LEADER
I20260709 13:13:11.421880  5368 consensus_queue.cc:237] T 619fadedef99424fb02cb2220e11f71d P 00e3ba273af645d881fe92b48b615951 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.425859  5394 raft_consensus.cc:515] T fbb576f6df1d4ea899f4e15ca176a28b P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.427986  5394 leader_election.cc:290] T fbb576f6df1d4ea899f4e15ca176a28b P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 1 election: Requested vote from peers 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789), 00e3ba273af645d881fe92b48b615951 (127.28.54.67:44205)
I20260709 13:13:11.428153  5171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb576f6df1d4ea899f4e15ca176a28b" candidate_uuid: "faf57cab004346baae3fe74487d12316" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c10f8bb9404efea93b7709bff70f8f"
I20260709 13:13:11.428803  5171 raft_consensus.cc:3060] T fbb576f6df1d4ea899f4e15ca176a28b P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:11.428960  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fbb576f6df1d4ea899f4e15ca176a28b" candidate_uuid: "faf57cab004346baae3fe74487d12316" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e3ba273af645d881fe92b48b615951"
I20260709 13:13:11.429502  5321 raft_consensus.cc:3060] T fbb576f6df1d4ea899f4e15ca176a28b P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:11.431319  5068 catalog_manager.cc:5697] T 619fadedef99424fb02cb2220e11f71d P 00e3ba273af645d881fe92b48b615951 reported cstate change: term changed from 0 to 1, leader changed from <none> to 00e3ba273af645d881fe92b48b615951 (127.28.54.67). New cstate: current_term: 1 leader_uuid: "00e3ba273af645d881fe92b48b615951" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:11.433471  5171 raft_consensus.cc:2468] T fbb576f6df1d4ea899f4e15ca176a28b P 20c10f8bb9404efea93b7709bff70f8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faf57cab004346baae3fe74487d12316 in term 1.
I20260709 13:13:11.434476  5213 leader_election.cc:304] T fbb576f6df1d4ea899f4e15ca176a28b P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c10f8bb9404efea93b7709bff70f8f, faf57cab004346baae3fe74487d12316; no voters: 
I20260709 13:13:11.436437  5321 raft_consensus.cc:2468] T fbb576f6df1d4ea899f4e15ca176a28b P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faf57cab004346baae3fe74487d12316 in term 1.
I20260709 13:13:11.436625  5394 raft_consensus.cc:2804] T fbb576f6df1d4ea899f4e15ca176a28b P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:11.437418  5394 raft_consensus.cc:697] T fbb576f6df1d4ea899f4e15ca176a28b P faf57cab004346baae3fe74487d12316 [term 1 LEADER]: Becoming Leader. State: Replica: faf57cab004346baae3fe74487d12316, State: Running, Role: LEADER
I20260709 13:13:11.438133  5394 consensus_queue.cc:237] T fbb576f6df1d4ea899f4e15ca176a28b P faf57cab004346baae3fe74487d12316 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.445142  5068 catalog_manager.cc:5697] T fbb576f6df1d4ea899f4e15ca176a28b P faf57cab004346baae3fe74487d12316 reported cstate change: term changed from 0 to 1, leader changed from <none> to faf57cab004346baae3fe74487d12316 (127.28.54.66). New cstate: current_term: 1 leader_uuid: "faf57cab004346baae3fe74487d12316" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:11.468545  5247 raft_consensus.cc:3060] T c45195d3728449a1813e1bbe3ce5a981 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:11.474453  5369 consensus_queue.cc:1048] T c45195d3728449a1813e1bbe3ce5a981 P 20c10f8bb9404efea93b7709bff70f8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:11.485901  5399 consensus_queue.cc:1048] T c45195d3728449a1813e1bbe3ce5a981 P 20c10f8bb9404efea93b7709bff70f8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:11.494973  5399 raft_consensus.cc:493] T 35090704c57b43d494666e056fade162 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.495347  5399 raft_consensus.cc:515] T 35090704c57b43d494666e056fade162 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.496929  5399 leader_election.cc:290] T 35090704c57b43d494666e056fade162 P 20c10f8bb9404efea93b7709bff70f8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers faf57cab004346baae3fe74487d12316 (127.28.54.66:33871), 00e3ba273af645d881fe92b48b615951 (127.28.54.67:44205)
I20260709 13:13:11.497695  5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35090704c57b43d494666e056fade162" candidate_uuid: "20c10f8bb9404efea93b7709bff70f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "faf57cab004346baae3fe74487d12316" is_pre_election: true
I20260709 13:13:11.497972  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35090704c57b43d494666e056fade162" candidate_uuid: "20c10f8bb9404efea93b7709bff70f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e3ba273af645d881fe92b48b615951" is_pre_election: true
I20260709 13:13:11.498728  5321 raft_consensus.cc:2393] T 35090704c57b43d494666e056fade162 P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c10f8bb9404efea93b7709bff70f8f in current term 1: Already voted for candidate faf57cab004346baae3fe74487d12316 in this term.
I20260709 13:13:11.499634  5138 leader_election.cc:304] T 35090704c57b43d494666e056fade162 P 20c10f8bb9404efea93b7709bff70f8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c10f8bb9404efea93b7709bff70f8f; no voters: 00e3ba273af645d881fe92b48b615951, faf57cab004346baae3fe74487d12316
I20260709 13:13:11.500207  5399 raft_consensus.cc:3060] T 35090704c57b43d494666e056fade162 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:11.505355  5399 raft_consensus.cc:2749] T 35090704c57b43d494666e056fade162 P 20c10f8bb9404efea93b7709bff70f8f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:11.525944  5394 consensus_queue.cc:1048] T 35090704c57b43d494666e056fade162 P faf57cab004346baae3fe74487d12316 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:11.535564  5394 consensus_queue.cc:1048] T 35090704c57b43d494666e056fade162 P faf57cab004346baae3fe74487d12316 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:11.540890  5368 raft_consensus.cc:493] T c56044a4794e4299af4ee1d462580192 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.541298  5368 raft_consensus.cc:515] T c56044a4794e4299af4ee1d462580192 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.543371  5368 leader_election.cc:290] T c56044a4794e4299af4ee1d462580192 P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789), faf57cab004346baae3fe74487d12316 (127.28.54.66:33871)
I20260709 13:13:11.544557  5171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56044a4794e4299af4ee1d462580192" candidate_uuid: "00e3ba273af645d881fe92b48b615951" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c10f8bb9404efea93b7709bff70f8f" is_pre_election: true
I20260709 13:13:11.544921  5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56044a4794e4299af4ee1d462580192" candidate_uuid: "00e3ba273af645d881fe92b48b615951" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "faf57cab004346baae3fe74487d12316" is_pre_election: true
I20260709 13:13:11.545379  5171 raft_consensus.cc:2393] T c56044a4794e4299af4ee1d462580192 P 20c10f8bb9404efea93b7709bff70f8f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 00e3ba273af645d881fe92b48b615951 in current term 1: Already voted for candidate faf57cab004346baae3fe74487d12316 in this term.
I20260709 13:13:11.546353  5287 leader_election.cc:304] T c56044a4794e4299af4ee1d462580192 P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00e3ba273af645d881fe92b48b615951; no voters: 20c10f8bb9404efea93b7709bff70f8f, faf57cab004346baae3fe74487d12316
I20260709 13:13:11.547009  5368 raft_consensus.cc:3060] T c56044a4794e4299af4ee1d462580192 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:11.551992  5368 raft_consensus.cc:2749] T c56044a4794e4299af4ee1d462580192 P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:11.599944  5394 consensus_queue.cc:1048] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:11.600587  5367 consensus_queue.cc:1048] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:11.632444  5383 consensus_queue.cc:1048] T c56044a4794e4299af4ee1d462580192 P faf57cab004346baae3fe74487d12316 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:11.645390  5399 consensus_queue.cc:1048] T 02b61ce2481342a58d8418df35ed4fdd P 20c10f8bb9404efea93b7709bff70f8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:11.646359  5427 consensus_queue.cc:1048] T c56044a4794e4299af4ee1d462580192 P faf57cab004346baae3fe74487d12316 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:11.654644  5368 raft_consensus.cc:493] T a4a20c8585a445b78ff71276699f1693 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:11.655097  5368 raft_consensus.cc:515] T a4a20c8585a445b78ff71276699f1693 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.656891  5368 leader_election.cc:290] T a4a20c8585a445b78ff71276699f1693 P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789), faf57cab004346baae3fe74487d12316 (127.28.54.66:33871)
I20260709 13:13:11.657892  5171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a20c8585a445b78ff71276699f1693" candidate_uuid: "00e3ba273af645d881fe92b48b615951" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c10f8bb9404efea93b7709bff70f8f" is_pre_election: true
I20260709 13:13:11.658298  5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a20c8585a445b78ff71276699f1693" candidate_uuid: "00e3ba273af645d881fe92b48b615951" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "faf57cab004346baae3fe74487d12316" is_pre_election: true
I20260709 13:13:11.658607  5171 raft_consensus.cc:2468] T a4a20c8585a445b78ff71276699f1693 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00e3ba273af645d881fe92b48b615951 in term 0.
I20260709 13:13:11.660049  5247 raft_consensus.cc:2468] T a4a20c8585a445b78ff71276699f1693 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00e3ba273af645d881fe92b48b615951 in term 0.
I20260709 13:13:11.660651  5287 leader_election.cc:304] T a4a20c8585a445b78ff71276699f1693 P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e3ba273af645d881fe92b48b615951, 20c10f8bb9404efea93b7709bff70f8f; no voters: 
I20260709 13:13:11.661434  5368 raft_consensus.cc:2804] T a4a20c8585a445b78ff71276699f1693 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:11.661791  5368 raft_consensus.cc:493] T a4a20c8585a445b78ff71276699f1693 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:11.662140  5368 raft_consensus.cc:3060] T a4a20c8585a445b78ff71276699f1693 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:11.662421  5385 consensus_queue.cc:1048] T 02b61ce2481342a58d8418df35ed4fdd P 20c10f8bb9404efea93b7709bff70f8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:11.669039  5368 raft_consensus.cc:515] T a4a20c8585a445b78ff71276699f1693 P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.671790  5171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a20c8585a445b78ff71276699f1693" candidate_uuid: "00e3ba273af645d881fe92b48b615951" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c10f8bb9404efea93b7709bff70f8f"
I20260709 13:13:11.672034  5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a20c8585a445b78ff71276699f1693" candidate_uuid: "00e3ba273af645d881fe92b48b615951" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "faf57cab004346baae3fe74487d12316"
I20260709 13:13:11.672358  5171 raft_consensus.cc:3060] T a4a20c8585a445b78ff71276699f1693 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:11.672683  5246 raft_consensus.cc:3060] T a4a20c8585a445b78ff71276699f1693 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:11.674172  5368 leader_election.cc:290] T a4a20c8585a445b78ff71276699f1693 P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 1 election: Requested vote from peers 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789), faf57cab004346baae3fe74487d12316 (127.28.54.66:33871)
I20260709 13:13:11.678848  5246 raft_consensus.cc:2468] T a4a20c8585a445b78ff71276699f1693 P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00e3ba273af645d881fe92b48b615951 in term 1.
I20260709 13:13:11.678869  5171 raft_consensus.cc:2468] T a4a20c8585a445b78ff71276699f1693 P 20c10f8bb9404efea93b7709bff70f8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00e3ba273af645d881fe92b48b615951 in term 1.
I20260709 13:13:11.679802  5284 leader_election.cc:304] T a4a20c8585a445b78ff71276699f1693 P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e3ba273af645d881fe92b48b615951, faf57cab004346baae3fe74487d12316; no voters: 
I20260709 13:13:11.680545  5368 raft_consensus.cc:2804] T a4a20c8585a445b78ff71276699f1693 P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:11.681012  5368 raft_consensus.cc:697] T a4a20c8585a445b78ff71276699f1693 P 00e3ba273af645d881fe92b48b615951 [term 1 LEADER]: Becoming Leader. State: Replica: 00e3ba273af645d881fe92b48b615951, State: Running, Role: LEADER
I20260709 13:13:11.681810  5368 consensus_queue.cc:237] T a4a20c8585a445b78ff71276699f1693 P 00e3ba273af645d881fe92b48b615951 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.688539  5070 catalog_manager.cc:5697] T a4a20c8585a445b78ff71276699f1693 P 00e3ba273af645d881fe92b48b615951 reported cstate change: term changed from 0 to 1, leader changed from <none> to 00e3ba273af645d881fe92b48b615951 (127.28.54.67). New cstate: current_term: 1 leader_uuid: "00e3ba273af645d881fe92b48b615951" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:11.716146  5385 consensus_queue.cc:1048] T 85f195d86c444318a3b33ec5c008e238 P 20c10f8bb9404efea93b7709bff70f8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:11.725963  5369 consensus_queue.cc:1048] T 85f195d86c444318a3b33ec5c008e238 P 20c10f8bb9404efea93b7709bff70f8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:11.773691  5246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "33f2bd13db554c9397573a6c81ceb5d1"
dest_uuid: "faf57cab004346baae3fe74487d12316"
mode: GRACEFUL
new_leader_uuid: "20c10f8bb9404efea93b7709bff70f8f"
 from {username='slave'} at 127.0.0.1:47836
I20260709 13:13:11.774180  5246 raft_consensus.cc:606] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316 [term 1 LEADER]: Received request to transfer leadership to TS 20c10f8bb9404efea93b7709bff70f8f
I20260709 13:13:11.778733  5246 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c56044a4794e4299af4ee1d462580192"
dest_uuid: "faf57cab004346baae3fe74487d12316"
mode: GRACEFUL
new_leader_uuid: "20c10f8bb9404efea93b7709bff70f8f"
 from {username='slave'} at 127.0.0.1:47836
I20260709 13:13:11.779155  5246 raft_consensus.cc:606] T c56044a4794e4299af4ee1d462580192 P faf57cab004346baae3fe74487d12316 [term 1 LEADER]: Received request to transfer leadership to TS 20c10f8bb9404efea93b7709bff70f8f
I20260709 13:13:11.790900  5321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "619fadedef99424fb02cb2220e11f71d"
dest_uuid: "00e3ba273af645d881fe92b48b615951"
mode: GRACEFUL
new_leader_uuid: "20c10f8bb9404efea93b7709bff70f8f"
 from {username='slave'} at 127.0.0.1:51940
I20260709 13:13:11.791358  5321 raft_consensus.cc:606] T 619fadedef99424fb02cb2220e11f71d P 00e3ba273af645d881fe92b48b615951 [term 1 LEADER]: Received request to transfer leadership to TS 20c10f8bb9404efea93b7709bff70f8f
I20260709 13:13:11.803337  5171 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "85f195d86c444318a3b33ec5c008e238"
dest_uuid: "20c10f8bb9404efea93b7709bff70f8f"
mode: GRACEFUL
new_leader_uuid: "faf57cab004346baae3fe74487d12316"
 from {username='slave'} at 127.0.0.1:47416
I20260709 13:13:11.803797  5171 raft_consensus.cc:606] T 85f195d86c444318a3b33ec5c008e238 P 20c10f8bb9404efea93b7709bff70f8f [term 1 LEADER]: Received request to transfer leadership to TS faf57cab004346baae3fe74487d12316
I20260709 13:13:11.811197  5321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a4a20c8585a445b78ff71276699f1693"
dest_uuid: "00e3ba273af645d881fe92b48b615951"
mode: GRACEFUL
new_leader_uuid: "faf57cab004346baae3fe74487d12316"
 from {username='slave'} at 127.0.0.1:51940
I20260709 13:13:11.811683  5321 raft_consensus.cc:606] T a4a20c8585a445b78ff71276699f1693 P 00e3ba273af645d881fe92b48b615951 [term 1 LEADER]: Received request to transfer leadership to TS faf57cab004346baae3fe74487d12316
I20260709 13:13:11.818289  5171 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c45195d3728449a1813e1bbe3ce5a981"
dest_uuid: "20c10f8bb9404efea93b7709bff70f8f"
mode: GRACEFUL
new_leader_uuid: "00e3ba273af645d881fe92b48b615951"
 from {username='slave'} at 127.0.0.1:47416
I20260709 13:13:11.818758  5171 raft_consensus.cc:606] T c45195d3728449a1813e1bbe3ce5a981 P 20c10f8bb9404efea93b7709bff70f8f [term 1 LEADER]: Received request to transfer leadership to TS 00e3ba273af645d881fe92b48b615951
I20260709 13:13:11.887406  5385 raft_consensus.cc:993] T c45195d3728449a1813e1bbe3ce5a981 P 20c10f8bb9404efea93b7709bff70f8f: : Instructing follower 00e3ba273af645d881fe92b48b615951 to start an election
I20260709 13:13:11.887842  5369 raft_consensus.cc:1081] T c45195d3728449a1813e1bbe3ce5a981 P 20c10f8bb9404efea93b7709bff70f8f [term 1 LEADER]: Signalling peer 00e3ba273af645d881fe92b48b615951 to start an election
I20260709 13:13:11.889205  5321 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c45195d3728449a1813e1bbe3ce5a981"
dest_uuid: "00e3ba273af645d881fe92b48b615951"
 from {username='slave'} at 127.0.0.1:51914
I20260709 13:13:11.889787  5321 raft_consensus.cc:493] T c45195d3728449a1813e1bbe3ce5a981 P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:11.890082  5321 raft_consensus.cc:3060] T c45195d3728449a1813e1bbe3ce5a981 P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.894996  5321 raft_consensus.cc:515] T c45195d3728449a1813e1bbe3ce5a981 P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.896742  5321 leader_election.cc:290] T c45195d3728449a1813e1bbe3ce5a981 P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 2 election: Requested vote from peers 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789), faf57cab004346baae3fe74487d12316 (127.28.54.66:33871)
I20260709 13:13:11.897383  5171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c45195d3728449a1813e1bbe3ce5a981" candidate_uuid: "00e3ba273af645d881fe92b48b615951" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20c10f8bb9404efea93b7709bff70f8f"
I20260709 13:13:11.897717  5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c45195d3728449a1813e1bbe3ce5a981" candidate_uuid: "00e3ba273af645d881fe92b48b615951" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "faf57cab004346baae3fe74487d12316"
I20260709 13:13:11.898015  5171 raft_consensus.cc:3055] T c45195d3728449a1813e1bbe3ce5a981 P 20c10f8bb9404efea93b7709bff70f8f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:11.898286  5246 raft_consensus.cc:3060] T c45195d3728449a1813e1bbe3ce5a981 P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.898334  5171 raft_consensus.cc:740] T c45195d3728449a1813e1bbe3ce5a981 P 20c10f8bb9404efea93b7709bff70f8f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20c10f8bb9404efea93b7709bff70f8f, State: Running, Role: LEADER
I20260709 13:13:11.899174  5171 consensus_queue.cc:260] T c45195d3728449a1813e1bbe3ce5a981 P 20c10f8bb9404efea93b7709bff70f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.900166  5171 raft_consensus.cc:3060] T c45195d3728449a1813e1bbe3ce5a981 P 20c10f8bb9404efea93b7709bff70f8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.903244  5246 raft_consensus.cc:2468] T c45195d3728449a1813e1bbe3ce5a981 P faf57cab004346baae3fe74487d12316 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00e3ba273af645d881fe92b48b615951 in term 2.
I20260709 13:13:11.904307  5284 leader_election.cc:304] T c45195d3728449a1813e1bbe3ce5a981 P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e3ba273af645d881fe92b48b615951, faf57cab004346baae3fe74487d12316; no voters: 
I20260709 13:13:11.905089  5368 raft_consensus.cc:2804] T c45195d3728449a1813e1bbe3ce5a981 P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:11.905269  5171 raft_consensus.cc:2468] T c45195d3728449a1813e1bbe3ce5a981 P 20c10f8bb9404efea93b7709bff70f8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00e3ba273af645d881fe92b48b615951 in term 2.
I20260709 13:13:11.905496  5368 raft_consensus.cc:697] T c45195d3728449a1813e1bbe3ce5a981 P 00e3ba273af645d881fe92b48b615951 [term 2 LEADER]: Becoming Leader. State: Replica: 00e3ba273af645d881fe92b48b615951, State: Running, Role: LEADER
I20260709 13:13:11.906307  5368 consensus_queue.cc:237] T c45195d3728449a1813e1bbe3ce5a981 P 00e3ba273af645d881fe92b48b615951 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.910199  5427 consensus_queue.cc:1048] T fbb576f6df1d4ea899f4e15ca176a28b P faf57cab004346baae3fe74487d12316 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:11.912406  5068 catalog_manager.cc:5697] T c45195d3728449a1813e1bbe3ce5a981 P 00e3ba273af645d881fe92b48b615951 reported cstate change: term changed from 1 to 2, leader changed from 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65) to 00e3ba273af645d881fe92b48b615951 (127.28.54.67). New cstate: current_term: 2 leader_uuid: "00e3ba273af645d881fe92b48b615951" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:11.921175  5383 consensus_queue.cc:1048] T fbb576f6df1d4ea899f4e15ca176a28b P faf57cab004346baae3fe74487d12316 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:11.975286  5368 consensus_queue.cc:1048] T 619fadedef99424fb02cb2220e11f71d P 00e3ba273af645d881fe92b48b615951 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:11.981303  5375 raft_consensus.cc:993] T 619fadedef99424fb02cb2220e11f71d P 00e3ba273af645d881fe92b48b615951: : Instructing follower 20c10f8bb9404efea93b7709bff70f8f to start an election
I20260709 13:13:11.981906  5368 raft_consensus.cc:1081] T 619fadedef99424fb02cb2220e11f71d P 00e3ba273af645d881fe92b48b615951 [term 1 LEADER]: Signalling peer 20c10f8bb9404efea93b7709bff70f8f to start an election
I20260709 13:13:11.983552  5172 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "619fadedef99424fb02cb2220e11f71d"
dest_uuid: "20c10f8bb9404efea93b7709bff70f8f"
 from {username='slave'} at 127.0.0.1:47406
I20260709 13:13:11.985093  5172 raft_consensus.cc:493] T 619fadedef99424fb02cb2220e11f71d P 20c10f8bb9404efea93b7709bff70f8f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:11.985479  5172 raft_consensus.cc:3060] T 619fadedef99424fb02cb2220e11f71d P 20c10f8bb9404efea93b7709bff70f8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:11.986743  5442 consensus_queue.cc:1048] T 619fadedef99424fb02cb2220e11f71d P 00e3ba273af645d881fe92b48b615951 [LEADER]: Connected to new peer: Peer: permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:11.992575  5172 raft_consensus.cc:515] T 619fadedef99424fb02cb2220e11f71d P 20c10f8bb9404efea93b7709bff70f8f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:11.998086  5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fadedef99424fb02cb2220e11f71d" candidate_uuid: "20c10f8bb9404efea93b7709bff70f8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "faf57cab004346baae3fe74487d12316"
I20260709 13:13:11.998247  5172 leader_election.cc:290] T 619fadedef99424fb02cb2220e11f71d P 20c10f8bb9404efea93b7709bff70f8f [CANDIDATE]: Term 2 election: Requested vote from peers faf57cab004346baae3fe74487d12316 (127.28.54.66:33871), 00e3ba273af645d881fe92b48b615951 (127.28.54.67:44205)
I20260709 13:13:11.998481  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fadedef99424fb02cb2220e11f71d" candidate_uuid: "20c10f8bb9404efea93b7709bff70f8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00e3ba273af645d881fe92b48b615951"
I20260709 13:13:11.999161  5321 raft_consensus.cc:3055] T 619fadedef99424fb02cb2220e11f71d P 00e3ba273af645d881fe92b48b615951 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:11.999482  5321 raft_consensus.cc:740] T 619fadedef99424fb02cb2220e11f71d P 00e3ba273af645d881fe92b48b615951 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 00e3ba273af645d881fe92b48b615951, State: Running, Role: LEADER
I20260709 13:13:11.998719  5246 raft_consensus.cc:3060] T 619fadedef99424fb02cb2220e11f71d P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.000252  5321 consensus_queue.cc:260] T 619fadedef99424fb02cb2220e11f71d P 00e3ba273af645d881fe92b48b615951 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:12.001228  5321 raft_consensus.cc:3060] T 619fadedef99424fb02cb2220e11f71d P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.005896  5246 raft_consensus.cc:2468] T 619fadedef99424fb02cb2220e11f71d P faf57cab004346baae3fe74487d12316 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c10f8bb9404efea93b7709bff70f8f in term 2.
I20260709 13:13:12.007161  5321 raft_consensus.cc:2468] T 619fadedef99424fb02cb2220e11f71d P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c10f8bb9404efea93b7709bff70f8f in term 2.
I20260709 13:13:12.008106  5138 leader_election.cc:304] T 619fadedef99424fb02cb2220e11f71d P 20c10f8bb9404efea93b7709bff70f8f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e3ba273af645d881fe92b48b615951, 20c10f8bb9404efea93b7709bff70f8f; no voters: 
I20260709 13:13:12.008867  5369 raft_consensus.cc:2804] T 619fadedef99424fb02cb2220e11f71d P 20c10f8bb9404efea93b7709bff70f8f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:12.009280  5369 raft_consensus.cc:697] T 619fadedef99424fb02cb2220e11f71d P 20c10f8bb9404efea93b7709bff70f8f [term 2 LEADER]: Becoming Leader. State: Replica: 20c10f8bb9404efea93b7709bff70f8f, State: Running, Role: LEADER
I20260709 13:13:12.010039  5369 consensus_queue.cc:237] T 619fadedef99424fb02cb2220e11f71d P 20c10f8bb9404efea93b7709bff70f8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:12.015728  5068 catalog_manager.cc:5697] T 619fadedef99424fb02cb2220e11f71d P 20c10f8bb9404efea93b7709bff70f8f reported cstate change: term changed from 1 to 2, leader changed from 00e3ba273af645d881fe92b48b615951 (127.28.54.67) to 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65). New cstate: current_term: 2 leader_uuid: "20c10f8bb9404efea93b7709bff70f8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:12.072479  5394 raft_consensus.cc:993] T c56044a4794e4299af4ee1d462580192 P faf57cab004346baae3fe74487d12316: : Instructing follower 20c10f8bb9404efea93b7709bff70f8f to start an election
I20260709 13:13:12.072922  5383 raft_consensus.cc:1081] T c56044a4794e4299af4ee1d462580192 P faf57cab004346baae3fe74487d12316 [term 1 LEADER]: Signalling peer 20c10f8bb9404efea93b7709bff70f8f to start an election
I20260709 13:13:12.074328  5172 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c56044a4794e4299af4ee1d462580192"
dest_uuid: "20c10f8bb9404efea93b7709bff70f8f"
 from {username='slave'} at 127.0.0.1:47414
I20260709 13:13:12.074790  5172 raft_consensus.cc:493] T c56044a4794e4299af4ee1d462580192 P 20c10f8bb9404efea93b7709bff70f8f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:12.075174  5172 raft_consensus.cc:3060] T c56044a4794e4299af4ee1d462580192 P 20c10f8bb9404efea93b7709bff70f8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.080279  5172 raft_consensus.cc:515] T c56044a4794e4299af4ee1d462580192 P 20c10f8bb9404efea93b7709bff70f8f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:12.082190  5172 leader_election.cc:290] T c56044a4794e4299af4ee1d462580192 P 20c10f8bb9404efea93b7709bff70f8f [CANDIDATE]: Term 2 election: Requested vote from peers faf57cab004346baae3fe74487d12316 (127.28.54.66:33871), 00e3ba273af645d881fe92b48b615951 (127.28.54.67:44205)
I20260709 13:13:12.082083  5442 consensus_queue.cc:1048] T a4a20c8585a445b78ff71276699f1693 P 00e3ba273af645d881fe92b48b615951 [LEADER]: Connected to new peer: Peer: permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:12.082849  5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56044a4794e4299af4ee1d462580192" candidate_uuid: "20c10f8bb9404efea93b7709bff70f8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "faf57cab004346baae3fe74487d12316"
I20260709 13:13:12.083197  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c56044a4794e4299af4ee1d462580192" candidate_uuid: "20c10f8bb9404efea93b7709bff70f8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00e3ba273af645d881fe92b48b615951"
I20260709 13:13:12.083432  5246 raft_consensus.cc:3055] T c56044a4794e4299af4ee1d462580192 P faf57cab004346baae3fe74487d12316 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:12.083819  5246 raft_consensus.cc:740] T c56044a4794e4299af4ee1d462580192 P faf57cab004346baae3fe74487d12316 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: faf57cab004346baae3fe74487d12316, State: Running, Role: LEADER
I20260709 13:13:12.083825  5321 raft_consensus.cc:3060] T c56044a4794e4299af4ee1d462580192 P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.084738  5246 consensus_queue.cc:260] T c56044a4794e4299af4ee1d462580192 P faf57cab004346baae3fe74487d12316 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:12.085846  5246 raft_consensus.cc:3060] T c56044a4794e4299af4ee1d462580192 P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.089785  5375 raft_consensus.cc:993] T a4a20c8585a445b78ff71276699f1693 P 00e3ba273af645d881fe92b48b615951: : Instructing follower faf57cab004346baae3fe74487d12316 to start an election
I20260709 13:13:12.090268  5375 raft_consensus.cc:1081] T a4a20c8585a445b78ff71276699f1693 P 00e3ba273af645d881fe92b48b615951 [term 1 LEADER]: Signalling peer faf57cab004346baae3fe74487d12316 to start an election
I20260709 13:13:12.090674  5321 raft_consensus.cc:2468] T c56044a4794e4299af4ee1d462580192 P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c10f8bb9404efea93b7709bff70f8f in term 2.
I20260709 13:13:12.091960  5138 leader_election.cc:304] T c56044a4794e4299af4ee1d462580192 P 20c10f8bb9404efea93b7709bff70f8f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e3ba273af645d881fe92b48b615951, 20c10f8bb9404efea93b7709bff70f8f; no voters: 
I20260709 13:13:12.092103  5245 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a4a20c8585a445b78ff71276699f1693"
dest_uuid: "faf57cab004346baae3fe74487d12316"
 from {username='slave'} at 127.0.0.1:47820
I20260709 13:13:12.092758  5246 raft_consensus.cc:2468] T c56044a4794e4299af4ee1d462580192 P faf57cab004346baae3fe74487d12316 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c10f8bb9404efea93b7709bff70f8f in term 2.
I20260709 13:13:12.092734  5245 raft_consensus.cc:493] T a4a20c8585a445b78ff71276699f1693 P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:12.092748  5369 raft_consensus.cc:2804] T c56044a4794e4299af4ee1d462580192 P 20c10f8bb9404efea93b7709bff70f8f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:12.093575  5245 raft_consensus.cc:3060] T a4a20c8585a445b78ff71276699f1693 P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.093719  5369 raft_consensus.cc:697] T c56044a4794e4299af4ee1d462580192 P 20c10f8bb9404efea93b7709bff70f8f [term 2 LEADER]: Becoming Leader. State: Replica: 20c10f8bb9404efea93b7709bff70f8f, State: Running, Role: LEADER
I20260709 13:13:12.094668  5369 consensus_queue.cc:237] T c56044a4794e4299af4ee1d462580192 P 20c10f8bb9404efea93b7709bff70f8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:12.096690  5368 consensus_queue.cc:1048] T a4a20c8585a445b78ff71276699f1693 P 00e3ba273af645d881fe92b48b615951 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:12.103358  5069 catalog_manager.cc:5697] T c56044a4794e4299af4ee1d462580192 P 20c10f8bb9404efea93b7709bff70f8f reported cstate change: term changed from 1 to 2, leader changed from faf57cab004346baae3fe74487d12316 (127.28.54.66) to 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65). New cstate: current_term: 2 leader_uuid: "20c10f8bb9404efea93b7709bff70f8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:12.105330  5245 raft_consensus.cc:515] T a4a20c8585a445b78ff71276699f1693 P faf57cab004346baae3fe74487d12316 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:12.106591  5247 raft_consensus.cc:1240] T a4a20c8585a445b78ff71276699f1693 P faf57cab004346baae3fe74487d12316 [term 2 FOLLOWER]: Rejecting Update request from peer 00e3ba273af645d881fe92b48b615951 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:12.107731  5245 leader_election.cc:290] T a4a20c8585a445b78ff71276699f1693 P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 2 election: Requested vote from peers 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789), 00e3ba273af645d881fe92b48b615951 (127.28.54.67:44205)
I20260709 13:13:12.110395  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a20c8585a445b78ff71276699f1693" candidate_uuid: "faf57cab004346baae3fe74487d12316" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00e3ba273af645d881fe92b48b615951"
I20260709 13:13:12.111279  5368 consensus_queue.cc:1059] T a4a20c8585a445b78ff71276699f1693 P 00e3ba273af645d881fe92b48b615951 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:12.111752  5171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a4a20c8585a445b78ff71276699f1693" candidate_uuid: "faf57cab004346baae3fe74487d12316" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20c10f8bb9404efea93b7709bff70f8f"
I20260709 13:13:12.110975  5321 raft_consensus.cc:3055] T a4a20c8585a445b78ff71276699f1693 P 00e3ba273af645d881fe92b48b615951 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:12.114593  5321 raft_consensus.cc:740] T a4a20c8585a445b78ff71276699f1693 P 00e3ba273af645d881fe92b48b615951 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 00e3ba273af645d881fe92b48b615951, State: Running, Role: LEADER
I20260709 13:13:12.115530  5321 consensus_queue.cc:260] T a4a20c8585a445b78ff71276699f1693 P 00e3ba273af645d881fe92b48b615951 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:12.116865  5321 raft_consensus.cc:3060] T a4a20c8585a445b78ff71276699f1693 P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.124306  5321 raft_consensus.cc:2468] T a4a20c8585a445b78ff71276699f1693 P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faf57cab004346baae3fe74487d12316 in term 2.
W20260709 13:13:12.124848  5368 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 13:13:12.125489  5213 leader_election.cc:304] T a4a20c8585a445b78ff71276699f1693 P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00e3ba273af645d881fe92b48b615951, faf57cab004346baae3fe74487d12316; no voters: 20c10f8bb9404efea93b7709bff70f8f
I20260709 13:13:12.126441  5383 raft_consensus.cc:2804] T a4a20c8585a445b78ff71276699f1693 P faf57cab004346baae3fe74487d12316 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:12.126801  5383 raft_consensus.cc:697] T a4a20c8585a445b78ff71276699f1693 P faf57cab004346baae3fe74487d12316 [term 2 LEADER]: Becoming Leader. State: Replica: faf57cab004346baae3fe74487d12316, State: Running, Role: LEADER
I20260709 13:13:12.127382  5383 consensus_queue.cc:237] T a4a20c8585a445b78ff71276699f1693 P faf57cab004346baae3fe74487d12316 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:12.132853  5069 catalog_manager.cc:5697] T a4a20c8585a445b78ff71276699f1693 P faf57cab004346baae3fe74487d12316 reported cstate change: term changed from 1 to 2, leader changed from 00e3ba273af645d881fe92b48b615951 (127.28.54.67) to faf57cab004346baae3fe74487d12316 (127.28.54.66). New cstate: current_term: 2 leader_uuid: "faf57cab004346baae3fe74487d12316" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:12.141245  5385 raft_consensus.cc:993] T 85f195d86c444318a3b33ec5c008e238 P 20c10f8bb9404efea93b7709bff70f8f: : Instructing follower faf57cab004346baae3fe74487d12316 to start an election
I20260709 13:13:12.141639  5369 raft_consensus.cc:1081] T 85f195d86c444318a3b33ec5c008e238 P 20c10f8bb9404efea93b7709bff70f8f [term 1 LEADER]: Signalling peer faf57cab004346baae3fe74487d12316 to start an election
I20260709 13:13:12.142957  5247 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "85f195d86c444318a3b33ec5c008e238"
dest_uuid: "faf57cab004346baae3fe74487d12316"
 from {username='slave'} at 127.0.0.1:47824
I20260709 13:13:12.143483  5247 raft_consensus.cc:493] T 85f195d86c444318a3b33ec5c008e238 P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:12.143834  5247 raft_consensus.cc:3060] T 85f195d86c444318a3b33ec5c008e238 P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.149439  5247 raft_consensus.cc:515] T 85f195d86c444318a3b33ec5c008e238 P faf57cab004346baae3fe74487d12316 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:12.150894  5247 leader_election.cc:290] T 85f195d86c444318a3b33ec5c008e238 P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 2 election: Requested vote from peers 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789), 00e3ba273af645d881fe92b48b615951 (127.28.54.67:44205)
I20260709 13:13:12.151594  5172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85f195d86c444318a3b33ec5c008e238" candidate_uuid: "faf57cab004346baae3fe74487d12316" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20c10f8bb9404efea93b7709bff70f8f"
I20260709 13:13:12.151827  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85f195d86c444318a3b33ec5c008e238" candidate_uuid: "faf57cab004346baae3fe74487d12316" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00e3ba273af645d881fe92b48b615951"
I20260709 13:13:12.152242  5172 raft_consensus.cc:3055] T 85f195d86c444318a3b33ec5c008e238 P 20c10f8bb9404efea93b7709bff70f8f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:12.152350  5321 raft_consensus.cc:3060] T 85f195d86c444318a3b33ec5c008e238 P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.152629  5172 raft_consensus.cc:740] T 85f195d86c444318a3b33ec5c008e238 P 20c10f8bb9404efea93b7709bff70f8f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20c10f8bb9404efea93b7709bff70f8f, State: Running, Role: LEADER
I20260709 13:13:12.153426  5172 consensus_queue.cc:260] T 85f195d86c444318a3b33ec5c008e238 P 20c10f8bb9404efea93b7709bff70f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:12.154644  5172 raft_consensus.cc:3060] T 85f195d86c444318a3b33ec5c008e238 P 20c10f8bb9404efea93b7709bff70f8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.159179  5321 raft_consensus.cc:2468] T 85f195d86c444318a3b33ec5c008e238 P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faf57cab004346baae3fe74487d12316 in term 2.
I20260709 13:13:12.160337  5213 leader_election.cc:304] T 85f195d86c444318a3b33ec5c008e238 P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e3ba273af645d881fe92b48b615951, faf57cab004346baae3fe74487d12316; no voters: 
I20260709 13:13:12.160969  5383 raft_consensus.cc:2804] T 85f195d86c444318a3b33ec5c008e238 P faf57cab004346baae3fe74487d12316 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:12.161131  5172 raft_consensus.cc:2468] T 85f195d86c444318a3b33ec5c008e238 P 20c10f8bb9404efea93b7709bff70f8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faf57cab004346baae3fe74487d12316 in term 2.
I20260709 13:13:12.161309  5383 raft_consensus.cc:697] T 85f195d86c444318a3b33ec5c008e238 P faf57cab004346baae3fe74487d12316 [term 2 LEADER]: Becoming Leader. State: Replica: faf57cab004346baae3fe74487d12316, State: Running, Role: LEADER
I20260709 13:13:12.162154  5383 consensus_queue.cc:237] T 85f195d86c444318a3b33ec5c008e238 P faf57cab004346baae3fe74487d12316 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:12.167743  5069 catalog_manager.cc:5697] T 85f195d86c444318a3b33ec5c008e238 P faf57cab004346baae3fe74487d12316 reported cstate change: term changed from 1 to 2, leader changed from 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65) to faf57cab004346baae3fe74487d12316 (127.28.54.66). New cstate: current_term: 2 leader_uuid: "faf57cab004346baae3fe74487d12316" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:12.170848  5394 raft_consensus.cc:993] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316: : Instructing follower 20c10f8bb9404efea93b7709bff70f8f to start an election
I20260709 13:13:12.171330  5383 raft_consensus.cc:1081] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316 [term 1 LEADER]: Signalling peer 20c10f8bb9404efea93b7709bff70f8f to start an election
I20260709 13:13:12.172657  5172 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "33f2bd13db554c9397573a6c81ceb5d1"
dest_uuid: "20c10f8bb9404efea93b7709bff70f8f"
 from {username='slave'} at 127.0.0.1:47414
I20260709 13:13:12.173064  5172 raft_consensus.cc:493] T 33f2bd13db554c9397573a6c81ceb5d1 P 20c10f8bb9404efea93b7709bff70f8f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:12.173321  5172 raft_consensus.cc:3060] T 33f2bd13db554c9397573a6c81ceb5d1 P 20c10f8bb9404efea93b7709bff70f8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.178514  5172 raft_consensus.cc:515] T 33f2bd13db554c9397573a6c81ceb5d1 P 20c10f8bb9404efea93b7709bff70f8f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:12.179972  5172 leader_election.cc:290] T 33f2bd13db554c9397573a6c81ceb5d1 P 20c10f8bb9404efea93b7709bff70f8f [CANDIDATE]: Term 2 election: Requested vote from peers faf57cab004346baae3fe74487d12316 (127.28.54.66:33871), 00e3ba273af645d881fe92b48b615951 (127.28.54.67:44205)
I20260709 13:13:12.181010  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f2bd13db554c9397573a6c81ceb5d1" candidate_uuid: "20c10f8bb9404efea93b7709bff70f8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00e3ba273af645d881fe92b48b615951"
I20260709 13:13:12.181038  5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f2bd13db554c9397573a6c81ceb5d1" candidate_uuid: "20c10f8bb9404efea93b7709bff70f8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "faf57cab004346baae3fe74487d12316"
I20260709 13:13:12.181531  5321 raft_consensus.cc:3060] T 33f2bd13db554c9397573a6c81ceb5d1 P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.181667  5247 raft_consensus.cc:3055] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:12.182034  5247 raft_consensus.cc:740] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: faf57cab004346baae3fe74487d12316, State: Running, Role: LEADER
I20260709 13:13:12.182662  5247 consensus_queue.cc:260] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:12.183537  5247 raft_consensus.cc:3060] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.186249  5321 raft_consensus.cc:2468] T 33f2bd13db554c9397573a6c81ceb5d1 P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c10f8bb9404efea93b7709bff70f8f in term 2.
I20260709 13:13:12.187158  5138 leader_election.cc:304] T 33f2bd13db554c9397573a6c81ceb5d1 P 20c10f8bb9404efea93b7709bff70f8f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e3ba273af645d881fe92b48b615951, 20c10f8bb9404efea93b7709bff70f8f; no voters: 
I20260709 13:13:12.187757  5369 raft_consensus.cc:2804] T 33f2bd13db554c9397573a6c81ceb5d1 P 20c10f8bb9404efea93b7709bff70f8f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:12.188112  5369 raft_consensus.cc:697] T 33f2bd13db554c9397573a6c81ceb5d1 P 20c10f8bb9404efea93b7709bff70f8f [term 2 LEADER]: Becoming Leader. State: Replica: 20c10f8bb9404efea93b7709bff70f8f, State: Running, Role: LEADER
I20260709 13:13:12.188391  5247 raft_consensus.cc:2468] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c10f8bb9404efea93b7709bff70f8f in term 2.
I20260709 13:13:12.188803  5369 consensus_queue.cc:237] T 33f2bd13db554c9397573a6c81ceb5d1 P 20c10f8bb9404efea93b7709bff70f8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:12.195251  5069 catalog_manager.cc:5697] T 33f2bd13db554c9397573a6c81ceb5d1 P 20c10f8bb9404efea93b7709bff70f8f reported cstate change: term changed from 1 to 2, leader changed from faf57cab004346baae3fe74487d12316 (127.28.54.66) to 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65). New cstate: current_term: 2 leader_uuid: "20c10f8bb9404efea93b7709bff70f8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:12.402519  5247 raft_consensus.cc:1275] T c45195d3728449a1813e1bbe3ce5a981 P faf57cab004346baae3fe74487d12316 [term 2 FOLLOWER]: Refusing update from remote peer 00e3ba273af645d881fe92b48b615951: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:12.403734  5368 consensus_queue.cc:1048] T c45195d3728449a1813e1bbe3ce5a981 P 00e3ba273af645d881fe92b48b615951 [LEADER]: Connected to new peer: Peer: permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:12.405014  5172 raft_consensus.cc:1275] T c45195d3728449a1813e1bbe3ce5a981 P 20c10f8bb9404efea93b7709bff70f8f [term 2 FOLLOWER]: Refusing update from remote peer 00e3ba273af645d881fe92b48b615951: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:12.406466  5368 consensus_queue.cc:1048] T c45195d3728449a1813e1bbe3ce5a981 P 00e3ba273af645d881fe92b48b615951 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:12.450839  5321 raft_consensus.cc:1275] T 619fadedef99424fb02cb2220e11f71d P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Refusing update from remote peer 20c10f8bb9404efea93b7709bff70f8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:12.451933  5369 consensus_queue.cc:1048] T 619fadedef99424fb02cb2220e11f71d P 20c10f8bb9404efea93b7709bff70f8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:12.458725  5247 raft_consensus.cc:1275] T 619fadedef99424fb02cb2220e11f71d P faf57cab004346baae3fe74487d12316 [term 2 FOLLOWER]: Refusing update from remote peer 20c10f8bb9404efea93b7709bff70f8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:12.460314  5397 consensus_queue.cc:1048] T 619fadedef99424fb02cb2220e11f71d P 20c10f8bb9404efea93b7709bff70f8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:12.591856  5172 raft_consensus.cc:1275] T 85f195d86c444318a3b33ec5c008e238 P 20c10f8bb9404efea93b7709bff70f8f [term 2 FOLLOWER]: Refusing update from remote peer faf57cab004346baae3fe74487d12316: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:12.592942  5383 consensus_queue.cc:1048] T 85f195d86c444318a3b33ec5c008e238 P faf57cab004346baae3fe74487d12316 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:12.599879  5321 raft_consensus.cc:1275] T 85f195d86c444318a3b33ec5c008e238 P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Refusing update from remote peer faf57cab004346baae3fe74487d12316: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:12.601806  5367 consensus_queue.cc:1048] T 85f195d86c444318a3b33ec5c008e238 P faf57cab004346baae3fe74487d12316 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:12.610044  5247 raft_consensus.cc:1275] T c56044a4794e4299af4ee1d462580192 P faf57cab004346baae3fe74487d12316 [term 2 FOLLOWER]: Refusing update from remote peer 20c10f8bb9404efea93b7709bff70f8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:12.611243  5397 consensus_queue.cc:1048] T c56044a4794e4299af4ee1d462580192 P 20c10f8bb9404efea93b7709bff70f8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:12.618573  5321 raft_consensus.cc:1275] T c56044a4794e4299af4ee1d462580192 P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Refusing update from remote peer 20c10f8bb9404efea93b7709bff70f8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:12.618960  5320 raft_consensus.cc:1275] T a4a20c8585a445b78ff71276699f1693 P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Refusing update from remote peer faf57cab004346baae3fe74487d12316: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:12.620261  5385 consensus_queue.cc:1048] T c56044a4794e4299af4ee1d462580192 P 20c10f8bb9404efea93b7709bff70f8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:12.621421  5367 consensus_queue.cc:1048] T a4a20c8585a445b78ff71276699f1693 P faf57cab004346baae3fe74487d12316 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:12.631060  5172 raft_consensus.cc:3060] T a4a20c8585a445b78ff71276699f1693 P 20c10f8bb9404efea93b7709bff70f8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:12.638402  5172 raft_consensus.cc:1275] T a4a20c8585a445b78ff71276699f1693 P 20c10f8bb9404efea93b7709bff70f8f [term 2 FOLLOWER]: Refusing update from remote peer faf57cab004346baae3fe74487d12316: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:12.639494  5367 consensus_queue.cc:1048] T a4a20c8585a445b78ff71276699f1693 P faf57cab004346baae3fe74487d12316 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:12.755218  5247 raft_consensus.cc:1275] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316 [term 2 FOLLOWER]: Refusing update from remote peer 20c10f8bb9404efea93b7709bff70f8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:12.756352  5397 consensus_queue.cc:1048] T 33f2bd13db554c9397573a6c81ceb5d1 P 20c10f8bb9404efea93b7709bff70f8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:12.764213  5321 raft_consensus.cc:1275] T 33f2bd13db554c9397573a6c81ceb5d1 P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Refusing update from remote peer 20c10f8bb9404efea93b7709bff70f8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:12.765491  5369 consensus_queue.cc:1048] T 33f2bd13db554c9397573a6c81ceb5d1 P 20c10f8bb9404efea93b7709bff70f8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:14.842233  5068 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:60294:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 13:13:14.844261  5068 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 13:13:14.888157  5159 tablet_service.cc:1511] Processing CreateTablet for tablet dbe4243871d147358837895129c7dd45 (DEFAULT_TABLE table=soft_deleted_table [id=be73afa613c44ef293a74c93e838ab6b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:14.889084  5229 tablet_service.cc:1511] Processing CreateTablet for tablet dbe4243871d147358837895129c7dd45 (DEFAULT_TABLE table=soft_deleted_table [id=be73afa613c44ef293a74c93e838ab6b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:14.889446  5159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbe4243871d147358837895129c7dd45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:14.890364  5229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbe4243871d147358837895129c7dd45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:14.891988  5309 tablet_service.cc:1511] Processing CreateTablet for tablet dbe4243871d147358837895129c7dd45 (DEFAULT_TABLE table=soft_deleted_table [id=be73afa613c44ef293a74c93e838ab6b]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 13:13:14.892794  5156 tablet_service.cc:1511] Processing CreateTablet for tablet 01fd91b8fb9049d181045604bba46353 (DEFAULT_TABLE table=soft_deleted_table [id=be73afa613c44ef293a74c93e838ab6b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:14.894068  5156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01fd91b8fb9049d181045604bba46353. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:14.894348  5231 tablet_service.cc:1511] Processing CreateTablet for tablet 01fd91b8fb9049d181045604bba46353 (DEFAULT_TABLE table=soft_deleted_table [id=be73afa613c44ef293a74c93e838ab6b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:14.895535  5231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01fd91b8fb9049d181045604bba46353. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:14.893220  5309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbe4243871d147358837895129c7dd45. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:14.897442  5155 tablet_service.cc:1511] Processing CreateTablet for tablet ae428dc990694b0ba45113e7211e332b (DEFAULT_TABLE table=soft_deleted_table [id=be73afa613c44ef293a74c93e838ab6b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:14.898173  5306 tablet_service.cc:1511] Processing CreateTablet for tablet 01fd91b8fb9049d181045604bba46353 (DEFAULT_TABLE table=soft_deleted_table [id=be73afa613c44ef293a74c93e838ab6b]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 13:13:14.898700  5155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae428dc990694b0ba45113e7211e332b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:14.899382  5306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 01fd91b8fb9049d181045604bba46353. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:14.901839  5234 tablet_service.cc:1511] Processing CreateTablet for tablet ae428dc990694b0ba45113e7211e332b (DEFAULT_TABLE table=soft_deleted_table [id=be73afa613c44ef293a74c93e838ab6b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:14.903079  5234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae428dc990694b0ba45113e7211e332b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:14.903685  5305 tablet_service.cc:1511] Processing CreateTablet for tablet ae428dc990694b0ba45113e7211e332b (DEFAULT_TABLE table=soft_deleted_table [id=be73afa613c44ef293a74c93e838ab6b]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 13:13:14.904932  5305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ae428dc990694b0ba45113e7211e332b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:14.906728  5157 tablet_service.cc:1511] Processing CreateTablet for tablet b0a40b61c1b744e399aa024aac76f1f9 (DEFAULT_TABLE table=soft_deleted_table [id=be73afa613c44ef293a74c93e838ab6b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:14.907902  5157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0a40b61c1b744e399aa024aac76f1f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:14.910717  5232 tablet_service.cc:1511] Processing CreateTablet for tablet b0a40b61c1b744e399aa024aac76f1f9 (DEFAULT_TABLE table=soft_deleted_table [id=be73afa613c44ef293a74c93e838ab6b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:14.912045  5232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0a40b61c1b744e399aa024aac76f1f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:14.912729  5311 tablet_service.cc:1511] Processing CreateTablet for tablet b0a40b61c1b744e399aa024aac76f1f9 (DEFAULT_TABLE table=soft_deleted_table [id=be73afa613c44ef293a74c93e838ab6b]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 13:13:14.913964  5311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0a40b61c1b744e399aa024aac76f1f9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:14.936932  5160 tablet_service.cc:1511] Processing CreateTablet for tablet 016eb0d72e0e4e1d843a82e390ce83bc (DEFAULT_TABLE table=soft_deleted_table [id=be73afa613c44ef293a74c93e838ab6b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:14.938441  5160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 016eb0d72e0e4e1d843a82e390ce83bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:14.941742  5460 tablet_bootstrap.cc:492] T ae428dc990694b0ba45113e7211e332b P faf57cab004346baae3fe74487d12316: Bootstrap starting.
I20260709 13:13:14.947363  5461 tablet_bootstrap.cc:492] T b0a40b61c1b744e399aa024aac76f1f9 P 00e3ba273af645d881fe92b48b615951: Bootstrap starting.
I20260709 13:13:14.948396  5460 tablet_bootstrap.cc:654] T ae428dc990694b0ba45113e7211e332b P faf57cab004346baae3fe74487d12316: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:14.955179  5234 tablet_service.cc:1511] Processing CreateTablet for tablet 016eb0d72e0e4e1d843a82e390ce83bc (DEFAULT_TABLE table=soft_deleted_table [id=be73afa613c44ef293a74c93e838ab6b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:14.956441  5234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 016eb0d72e0e4e1d843a82e390ce83bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:14.957137  5311 tablet_service.cc:1511] Processing CreateTablet for tablet 016eb0d72e0e4e1d843a82e390ce83bc (DEFAULT_TABLE table=soft_deleted_table [id=be73afa613c44ef293a74c93e838ab6b]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 13:13:14.958356  5311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 016eb0d72e0e4e1d843a82e390ce83bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:14.971732  5157 tablet_service.cc:1511] Processing CreateTablet for tablet 965bdbceb0374f3994b3f4efa9482f4b (DEFAULT_TABLE table=soft_deleted_table [id=be73afa613c44ef293a74c93e838ab6b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:14.972394  5237 tablet_service.cc:1511] Processing CreateTablet for tablet 965bdbceb0374f3994b3f4efa9482f4b (DEFAULT_TABLE table=soft_deleted_table [id=be73afa613c44ef293a74c93e838ab6b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:14.973737  5237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 965bdbceb0374f3994b3f4efa9482f4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:14.975591  5461 tablet_bootstrap.cc:654] T b0a40b61c1b744e399aa024aac76f1f9 P 00e3ba273af645d881fe92b48b615951: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:14.977999  5306 tablet_service.cc:1511] Processing CreateTablet for tablet 965bdbceb0374f3994b3f4efa9482f4b (DEFAULT_TABLE table=soft_deleted_table [id=be73afa613c44ef293a74c93e838ab6b]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 13:13:14.979444  5306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 965bdbceb0374f3994b3f4efa9482f4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:14.986408  5157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 965bdbceb0374f3994b3f4efa9482f4b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:14.999506  5156 tablet_service.cc:1511] Processing CreateTablet for tablet d3218bc2bfe94d5f81b06f2fd09c1934 (DEFAULT_TABLE table=soft_deleted_table [id=be73afa613c44ef293a74c93e838ab6b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:14.999943  5311 tablet_service.cc:1511] Processing CreateTablet for tablet d3218bc2bfe94d5f81b06f2fd09c1934 (DEFAULT_TABLE table=soft_deleted_table [id=be73afa613c44ef293a74c93e838ab6b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:15.000874  5156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3218bc2bfe94d5f81b06f2fd09c1934. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.001111  5311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3218bc2bfe94d5f81b06f2fd09c1934. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.003307  5158 tablet_service.cc:1511] Processing CreateTablet for tablet f1e891d4721f42eca4e337499ecdede2 (DEFAULT_TABLE table=soft_deleted_table [id=be73afa613c44ef293a74c93e838ab6b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:15.004660  5158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1e891d4721f42eca4e337499ecdede2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.016433  5463 tablet_bootstrap.cc:492] T dbe4243871d147358837895129c7dd45 P 20c10f8bb9404efea93b7709bff70f8f: Bootstrap starting.
I20260709 13:13:15.020565  5234 tablet_service.cc:1511] Processing CreateTablet for tablet f1e891d4721f42eca4e337499ecdede2 (DEFAULT_TABLE table=soft_deleted_table [id=be73afa613c44ef293a74c93e838ab6b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:15.020695  5305 tablet_service.cc:1511] Processing CreateTablet for tablet f1e891d4721f42eca4e337499ecdede2 (DEFAULT_TABLE table=soft_deleted_table [id=be73afa613c44ef293a74c93e838ab6b]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 13:13:15.022819  5305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1e891d4721f42eca4e337499ecdede2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.022527  5231 tablet_service.cc:1511] Processing CreateTablet for tablet d3218bc2bfe94d5f81b06f2fd09c1934 (DEFAULT_TABLE table=soft_deleted_table [id=be73afa613c44ef293a74c93e838ab6b]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 13:13:15.023797  5231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d3218bc2bfe94d5f81b06f2fd09c1934. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.026983  5159 tablet_service.cc:1511] Processing CreateTablet for tablet 4efb7f98e10844e7bc2aac9284cbc6ed (DEFAULT_TABLE table=soft_deleted_table [id=be73afa613c44ef293a74c93e838ab6b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:15.030792  5232 tablet_service.cc:1511] Processing CreateTablet for tablet 4efb7f98e10844e7bc2aac9284cbc6ed (DEFAULT_TABLE table=soft_deleted_table [id=be73afa613c44ef293a74c93e838ab6b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:15.032584  5309 tablet_service.cc:1511] Processing CreateTablet for tablet 4efb7f98e10844e7bc2aac9284cbc6ed (DEFAULT_TABLE table=soft_deleted_table [id=be73afa613c44ef293a74c93e838ab6b]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 13:13:15.034204  5309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4efb7f98e10844e7bc2aac9284cbc6ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.034163  5232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4efb7f98e10844e7bc2aac9284cbc6ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.037088  5460 tablet_bootstrap.cc:492] T ae428dc990694b0ba45113e7211e332b P faf57cab004346baae3fe74487d12316: No bootstrap required, opened a new log
I20260709 13:13:15.037621  5460 ts_tablet_manager.cc:1403] T ae428dc990694b0ba45113e7211e332b P faf57cab004346baae3fe74487d12316: Time spent bootstrapping tablet: real 0.096s	user 0.014s	sys 0.041s
I20260709 13:13:15.038255  5234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1e891d4721f42eca4e337499ecdede2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.040546  5460 raft_consensus.cc:359] T ae428dc990694b0ba45113e7211e332b P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.041303  5460 raft_consensus.cc:385] T ae428dc990694b0ba45113e7211e332b P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:15.029747  5159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4efb7f98e10844e7bc2aac9284cbc6ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 13:13:15.032879  5463 tablet_bootstrap.cc:654] T dbe4243871d147358837895129c7dd45 P 20c10f8bb9404efea93b7709bff70f8f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:15.041596  5460 raft_consensus.cc:740] T ae428dc990694b0ba45113e7211e332b P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: faf57cab004346baae3fe74487d12316, State: Initialized, Role: FOLLOWER
I20260709 13:13:15.058014  5460 consensus_queue.cc:260] T ae428dc990694b0ba45113e7211e332b P faf57cab004346baae3fe74487d12316 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.081094  5460 ts_tablet_manager.cc:1434] T ae428dc990694b0ba45113e7211e332b P faf57cab004346baae3fe74487d12316: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.002s
I20260709 13:13:15.082110  5460 tablet_bootstrap.cc:492] T dbe4243871d147358837895129c7dd45 P faf57cab004346baae3fe74487d12316: Bootstrap starting.
I20260709 13:13:15.091446  5461 tablet_bootstrap.cc:492] T b0a40b61c1b744e399aa024aac76f1f9 P 00e3ba273af645d881fe92b48b615951: No bootstrap required, opened a new log
I20260709 13:13:15.092067  5461 ts_tablet_manager.cc:1403] T b0a40b61c1b744e399aa024aac76f1f9 P 00e3ba273af645d881fe92b48b615951: Time spent bootstrapping tablet: real 0.145s	user 0.019s	sys 0.004s
I20260709 13:13:15.093408  5463 tablet_bootstrap.cc:492] T dbe4243871d147358837895129c7dd45 P 20c10f8bb9404efea93b7709bff70f8f: No bootstrap required, opened a new log
I20260709 13:13:15.094069  5463 ts_tablet_manager.cc:1403] T dbe4243871d147358837895129c7dd45 P 20c10f8bb9404efea93b7709bff70f8f: Time spent bootstrapping tablet: real 0.078s	user 0.004s	sys 0.015s
I20260709 13:13:15.095410  5460 tablet_bootstrap.cc:654] T dbe4243871d147358837895129c7dd45 P faf57cab004346baae3fe74487d12316: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:15.095304  5461 raft_consensus.cc:359] T b0a40b61c1b744e399aa024aac76f1f9 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.096175  5461 raft_consensus.cc:385] T b0a40b61c1b744e399aa024aac76f1f9 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:15.096515  5461 raft_consensus.cc:740] T b0a40b61c1b744e399aa024aac76f1f9 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00e3ba273af645d881fe92b48b615951, State: Initialized, Role: FOLLOWER
I20260709 13:13:15.097122  5463 raft_consensus.cc:359] T dbe4243871d147358837895129c7dd45 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.097358  5461 consensus_queue.cc:260] T b0a40b61c1b744e399aa024aac76f1f9 P 00e3ba273af645d881fe92b48b615951 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.097913  5463 raft_consensus.cc:385] T dbe4243871d147358837895129c7dd45 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:15.099574  5463 raft_consensus.cc:740] T dbe4243871d147358837895129c7dd45 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c10f8bb9404efea93b7709bff70f8f, State: Initialized, Role: FOLLOWER
I20260709 13:13:15.100437  5463 consensus_queue.cc:260] T dbe4243871d147358837895129c7dd45 P 20c10f8bb9404efea93b7709bff70f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.101872  5460 tablet_bootstrap.cc:492] T dbe4243871d147358837895129c7dd45 P faf57cab004346baae3fe74487d12316: No bootstrap required, opened a new log
I20260709 13:13:15.102408  5460 ts_tablet_manager.cc:1403] T dbe4243871d147358837895129c7dd45 P faf57cab004346baae3fe74487d12316: Time spent bootstrapping tablet: real 0.021s	user 0.010s	sys 0.003s
I20260709 13:13:15.100893  5461 ts_tablet_manager.cc:1434] T b0a40b61c1b744e399aa024aac76f1f9 P 00e3ba273af645d881fe92b48b615951: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 13:13:15.104166  5461 tablet_bootstrap.cc:492] T 01fd91b8fb9049d181045604bba46353 P 00e3ba273af645d881fe92b48b615951: Bootstrap starting.
I20260709 13:13:15.105330  5460 raft_consensus.cc:359] T dbe4243871d147358837895129c7dd45 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.106148  5460 raft_consensus.cc:385] T dbe4243871d147358837895129c7dd45 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:15.106469  5460 raft_consensus.cc:740] T dbe4243871d147358837895129c7dd45 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: faf57cab004346baae3fe74487d12316, State: Initialized, Role: FOLLOWER
I20260709 13:13:15.107371  5460 consensus_queue.cc:260] T dbe4243871d147358837895129c7dd45 P faf57cab004346baae3fe74487d12316 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.108430  5463 ts_tablet_manager.cc:1434] T dbe4243871d147358837895129c7dd45 P 20c10f8bb9404efea93b7709bff70f8f: Time spent starting tablet: real 0.014s	user 0.001s	sys 0.005s
I20260709 13:13:15.109869  5460 ts_tablet_manager.cc:1434] T dbe4243871d147358837895129c7dd45 P faf57cab004346baae3fe74487d12316: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:15.110664  5463 tablet_bootstrap.cc:492] T 01fd91b8fb9049d181045604bba46353 P 20c10f8bb9404efea93b7709bff70f8f: Bootstrap starting.
I20260709 13:13:15.110922  5460 tablet_bootstrap.cc:492] T 016eb0d72e0e4e1d843a82e390ce83bc P faf57cab004346baae3fe74487d12316: Bootstrap starting.
I20260709 13:13:15.116859  5463 tablet_bootstrap.cc:654] T 01fd91b8fb9049d181045604bba46353 P 20c10f8bb9404efea93b7709bff70f8f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:15.117477  5460 tablet_bootstrap.cc:654] T 016eb0d72e0e4e1d843a82e390ce83bc P faf57cab004346baae3fe74487d12316: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:15.120291  5461 tablet_bootstrap.cc:654] T 01fd91b8fb9049d181045604bba46353 P 00e3ba273af645d881fe92b48b615951: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:15.131750  5461 tablet_bootstrap.cc:492] T 01fd91b8fb9049d181045604bba46353 P 00e3ba273af645d881fe92b48b615951: No bootstrap required, opened a new log
I20260709 13:13:15.132280  5461 ts_tablet_manager.cc:1403] T 01fd91b8fb9049d181045604bba46353 P 00e3ba273af645d881fe92b48b615951: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.004s
I20260709 13:13:15.137939  5461 raft_consensus.cc:359] T 01fd91b8fb9049d181045604bba46353 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.138659  5461 raft_consensus.cc:385] T 01fd91b8fb9049d181045604bba46353 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:15.139003  5461 raft_consensus.cc:740] T 01fd91b8fb9049d181045604bba46353 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00e3ba273af645d881fe92b48b615951, State: Initialized, Role: FOLLOWER
I20260709 13:13:15.139724  5461 consensus_queue.cc:260] T 01fd91b8fb9049d181045604bba46353 P 00e3ba273af645d881fe92b48b615951 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.141988  5461 ts_tablet_manager.cc:1434] T 01fd91b8fb9049d181045604bba46353 P 00e3ba273af645d881fe92b48b615951: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 13:13:15.142949  5461 tablet_bootstrap.cc:492] T dbe4243871d147358837895129c7dd45 P 00e3ba273af645d881fe92b48b615951: Bootstrap starting.
I20260709 13:13:15.148857  5461 tablet_bootstrap.cc:654] T dbe4243871d147358837895129c7dd45 P 00e3ba273af645d881fe92b48b615951: Neither blocks nor log segments found. Creating new log.
W20260709 13:13:15.149168  5118 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 13:13:15.160012  5461 tablet_bootstrap.cc:492] T dbe4243871d147358837895129c7dd45 P 00e3ba273af645d881fe92b48b615951: No bootstrap required, opened a new log
I20260709 13:13:15.160622  5461 ts_tablet_manager.cc:1403] T dbe4243871d147358837895129c7dd45 P 00e3ba273af645d881fe92b48b615951: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.005s
I20260709 13:13:15.163362  5461 raft_consensus.cc:359] T dbe4243871d147358837895129c7dd45 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.164160  5461 raft_consensus.cc:385] T dbe4243871d147358837895129c7dd45 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:15.164463  5461 raft_consensus.cc:740] T dbe4243871d147358837895129c7dd45 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00e3ba273af645d881fe92b48b615951, State: Initialized, Role: FOLLOWER
I20260709 13:13:15.165305  5460 tablet_bootstrap.cc:492] T 016eb0d72e0e4e1d843a82e390ce83bc P faf57cab004346baae3fe74487d12316: No bootstrap required, opened a new log
I20260709 13:13:15.165191  5461 consensus_queue.cc:260] T dbe4243871d147358837895129c7dd45 P 00e3ba273af645d881fe92b48b615951 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.165882  5460 ts_tablet_manager.cc:1403] T 016eb0d72e0e4e1d843a82e390ce83bc P faf57cab004346baae3fe74487d12316: Time spent bootstrapping tablet: real 0.055s	user 0.029s	sys 0.025s
I20260709 13:13:15.166370  5463 tablet_bootstrap.cc:492] T 01fd91b8fb9049d181045604bba46353 P 20c10f8bb9404efea93b7709bff70f8f: No bootstrap required, opened a new log
I20260709 13:13:15.166901  5463 ts_tablet_manager.cc:1403] T 01fd91b8fb9049d181045604bba46353 P 20c10f8bb9404efea93b7709bff70f8f: Time spent bootstrapping tablet: real 0.058s	user 0.012s	sys 0.042s
I20260709 13:13:15.167351  5461 ts_tablet_manager.cc:1434] T dbe4243871d147358837895129c7dd45 P 00e3ba273af645d881fe92b48b615951: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:13:15.168404  5461 tablet_bootstrap.cc:492] T ae428dc990694b0ba45113e7211e332b P 00e3ba273af645d881fe92b48b615951: Bootstrap starting.
I20260709 13:13:15.169013  5460 raft_consensus.cc:359] T 016eb0d72e0e4e1d843a82e390ce83bc P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.169893  5460 raft_consensus.cc:385] T 016eb0d72e0e4e1d843a82e390ce83bc P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:15.170251  5460 raft_consensus.cc:740] T 016eb0d72e0e4e1d843a82e390ce83bc P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: faf57cab004346baae3fe74487d12316, State: Initialized, Role: FOLLOWER
I20260709 13:13:15.171203  5460 consensus_queue.cc:260] T 016eb0d72e0e4e1d843a82e390ce83bc P faf57cab004346baae3fe74487d12316 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.173877  5460 ts_tablet_manager.cc:1434] T 016eb0d72e0e4e1d843a82e390ce83bc P faf57cab004346baae3fe74487d12316: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 13:13:15.174885  5460 tablet_bootstrap.cc:492] T 01fd91b8fb9049d181045604bba46353 P faf57cab004346baae3fe74487d12316: Bootstrap starting.
I20260709 13:13:15.175171  5461 tablet_bootstrap.cc:654] T ae428dc990694b0ba45113e7211e332b P 00e3ba273af645d881fe92b48b615951: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:15.175835  5463 raft_consensus.cc:359] T 01fd91b8fb9049d181045604bba46353 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.176636  5463 raft_consensus.cc:385] T 01fd91b8fb9049d181045604bba46353 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:15.176963  5463 raft_consensus.cc:740] T 01fd91b8fb9049d181045604bba46353 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c10f8bb9404efea93b7709bff70f8f, State: Initialized, Role: FOLLOWER
I20260709 13:13:15.177685  5463 consensus_queue.cc:260] T 01fd91b8fb9049d181045604bba46353 P 20c10f8bb9404efea93b7709bff70f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.179893  5463 ts_tablet_manager.cc:1434] T 01fd91b8fb9049d181045604bba46353 P 20c10f8bb9404efea93b7709bff70f8f: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
W20260709 13:13:15.180375  5273 tablet.cc:2406] T 016eb0d72e0e4e1d843a82e390ce83bc P faf57cab004346baae3fe74487d12316: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 13:13:15.180835  5463 tablet_bootstrap.cc:492] T b0a40b61c1b744e399aa024aac76f1f9 P 20c10f8bb9404efea93b7709bff70f8f: Bootstrap starting.
I20260709 13:13:15.181437  5460 tablet_bootstrap.cc:654] T 01fd91b8fb9049d181045604bba46353 P faf57cab004346baae3fe74487d12316: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:15.187346  5463 tablet_bootstrap.cc:654] T b0a40b61c1b744e399aa024aac76f1f9 P 20c10f8bb9404efea93b7709bff70f8f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:15.189471  5367 raft_consensus.cc:493] T 016eb0d72e0e4e1d843a82e390ce83bc P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.189998  5367 raft_consensus.cc:515] T 016eb0d72e0e4e1d843a82e390ce83bc P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.191980  5367 leader_election.cc:290] T 016eb0d72e0e4e1d843a82e390ce83bc P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789), 00e3ba273af645d881fe92b48b615951 (127.28.54.67:44205)
I20260709 13:13:15.192342  5461 tablet_bootstrap.cc:492] T ae428dc990694b0ba45113e7211e332b P 00e3ba273af645d881fe92b48b615951: No bootstrap required, opened a new log
I20260709 13:13:15.192906  5461 ts_tablet_manager.cc:1403] T ae428dc990694b0ba45113e7211e332b P 00e3ba273af645d881fe92b48b615951: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.000s
I20260709 13:13:15.193002  5460 tablet_bootstrap.cc:492] T 01fd91b8fb9049d181045604bba46353 P faf57cab004346baae3fe74487d12316: No bootstrap required, opened a new log
I20260709 13:13:15.193703  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016eb0d72e0e4e1d843a82e390ce83bc" candidate_uuid: "faf57cab004346baae3fe74487d12316" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e3ba273af645d881fe92b48b615951" is_pre_election: true
I20260709 13:13:15.194211  5172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016eb0d72e0e4e1d843a82e390ce83bc" candidate_uuid: "faf57cab004346baae3fe74487d12316" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c10f8bb9404efea93b7709bff70f8f" is_pre_election: true
I20260709 13:13:15.193725  5460 ts_tablet_manager.cc:1403] T 01fd91b8fb9049d181045604bba46353 P faf57cab004346baae3fe74487d12316: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.004s
W20260709 13:13:15.195833  5213 leader_election.cc:343] T 016eb0d72e0e4e1d843a82e390ce83bc P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 00e3ba273af645d881fe92b48b615951 (127.28.54.67:44205): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:15.196139  5463 tablet_bootstrap.cc:492] T b0a40b61c1b744e399aa024aac76f1f9 P 20c10f8bb9404efea93b7709bff70f8f: No bootstrap required, opened a new log
I20260709 13:13:15.196594  5463 ts_tablet_manager.cc:1403] T b0a40b61c1b744e399aa024aac76f1f9 P 20c10f8bb9404efea93b7709bff70f8f: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.004s
I20260709 13:13:15.197021  5369 raft_consensus.cc:493] T 01fd91b8fb9049d181045604bba46353 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.197495  5369 raft_consensus.cc:515] T 01fd91b8fb9049d181045604bba46353 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.199699  5369 leader_election.cc:290] T 01fd91b8fb9049d181045604bba46353 P 20c10f8bb9404efea93b7709bff70f8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers faf57cab004346baae3fe74487d12316 (127.28.54.66:33871), 00e3ba273af645d881fe92b48b615951 (127.28.54.67:44205)
I20260709 13:13:15.199457  5463 raft_consensus.cc:359] T b0a40b61c1b744e399aa024aac76f1f9 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.200230  5463 raft_consensus.cc:385] T b0a40b61c1b744e399aa024aac76f1f9 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:15.200048  5461 raft_consensus.cc:359] T ae428dc990694b0ba45113e7211e332b P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
W20260709 13:13:15.196520  5213 leader_election.cc:343] T 016eb0d72e0e4e1d843a82e390ce83bc P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:15.200615  5463 raft_consensus.cc:740] T b0a40b61c1b744e399aa024aac76f1f9 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c10f8bb9404efea93b7709bff70f8f, State: Initialized, Role: FOLLOWER
I20260709 13:13:15.200953  5461 raft_consensus.cc:385] T ae428dc990694b0ba45113e7211e332b P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:15.197554  5460 raft_consensus.cc:359] T 01fd91b8fb9049d181045604bba46353 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.202031  5461 raft_consensus.cc:740] T ae428dc990694b0ba45113e7211e332b P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00e3ba273af645d881fe92b48b615951, State: Initialized, Role: FOLLOWER
I20260709 13:13:15.201825  5463 consensus_queue.cc:260] T b0a40b61c1b744e399aa024aac76f1f9 P 20c10f8bb9404efea93b7709bff70f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.200794  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01fd91b8fb9049d181045604bba46353" candidate_uuid: "20c10f8bb9404efea93b7709bff70f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e3ba273af645d881fe92b48b615951" is_pre_election: true
I20260709 13:13:15.202221  5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01fd91b8fb9049d181045604bba46353" candidate_uuid: "20c10f8bb9404efea93b7709bff70f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "faf57cab004346baae3fe74487d12316" is_pre_election: true
I20260709 13:13:15.202937  5321 raft_consensus.cc:2468] T 01fd91b8fb9049d181045604bba46353 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c10f8bb9404efea93b7709bff70f8f in term 0.
I20260709 13:13:15.202982  5461 consensus_queue.cc:260] T ae428dc990694b0ba45113e7211e332b P 00e3ba273af645d881fe92b48b615951 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.201144  5213 leader_election.cc:304] T 016eb0d72e0e4e1d843a82e390ce83bc P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: faf57cab004346baae3fe74487d12316; no voters: 00e3ba273af645d881fe92b48b615951, 20c10f8bb9404efea93b7709bff70f8f
I20260709 13:13:15.204380  5463 ts_tablet_manager.cc:1434] T b0a40b61c1b744e399aa024aac76f1f9 P 20c10f8bb9404efea93b7709bff70f8f: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 13:13:15.205260  5461 ts_tablet_manager.cc:1434] T ae428dc990694b0ba45113e7211e332b P 00e3ba273af645d881fe92b48b615951: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.000s
I20260709 13:13:15.205188  5367 raft_consensus.cc:2749] T 016eb0d72e0e4e1d843a82e390ce83bc P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:15.205564  5463 tablet_bootstrap.cc:492] T ae428dc990694b0ba45113e7211e332b P 20c10f8bb9404efea93b7709bff70f8f: Bootstrap starting.
I20260709 13:13:15.206380  5461 tablet_bootstrap.cc:492] T 016eb0d72e0e4e1d843a82e390ce83bc P 00e3ba273af645d881fe92b48b615951: Bootstrap starting.
I20260709 13:13:15.202436  5460 raft_consensus.cc:385] T 01fd91b8fb9049d181045604bba46353 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:15.237083  5138 leader_election.cc:304] T 01fd91b8fb9049d181045604bba46353 P 20c10f8bb9404efea93b7709bff70f8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e3ba273af645d881fe92b48b615951, 20c10f8bb9404efea93b7709bff70f8f; no voters: 
I20260709 13:13:15.210103  5460 raft_consensus.cc:740] T 01fd91b8fb9049d181045604bba46353 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: faf57cab004346baae3fe74487d12316, State: Initialized, Role: FOLLOWER
I20260709 13:13:15.252678  5369 raft_consensus.cc:2804] T 01fd91b8fb9049d181045604bba46353 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:15.252244  5460 consensus_queue.cc:260] T 01fd91b8fb9049d181045604bba46353 P faf57cab004346baae3fe74487d12316 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.253278  5369 raft_consensus.cc:493] T 01fd91b8fb9049d181045604bba46353 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:15.253942  5247 raft_consensus.cc:2468] T 01fd91b8fb9049d181045604bba46353 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c10f8bb9404efea93b7709bff70f8f in term 0.
I20260709 13:13:15.257601  5367 raft_consensus.cc:493] T dbe4243871d147358837895129c7dd45 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.258646  5367 raft_consensus.cc:515] T dbe4243871d147358837895129c7dd45 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.263876  5172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe4243871d147358837895129c7dd45" candidate_uuid: "faf57cab004346baae3fe74487d12316" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c10f8bb9404efea93b7709bff70f8f" is_pre_election: true
I20260709 13:13:15.264732  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe4243871d147358837895129c7dd45" candidate_uuid: "faf57cab004346baae3fe74487d12316" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e3ba273af645d881fe92b48b615951" is_pre_election: true
I20260709 13:13:15.265231  5172 raft_consensus.cc:2468] T dbe4243871d147358837895129c7dd45 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate faf57cab004346baae3fe74487d12316 in term 0.
I20260709 13:13:15.265651  5321 raft_consensus.cc:2468] T dbe4243871d147358837895129c7dd45 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate faf57cab004346baae3fe74487d12316 in term 0.
I20260709 13:13:15.265869  5367 leader_election.cc:290] T dbe4243871d147358837895129c7dd45 P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789), 00e3ba273af645d881fe92b48b615951 (127.28.54.67:44205)
I20260709 13:13:15.269711  5463 tablet_bootstrap.cc:654] T ae428dc990694b0ba45113e7211e332b P 20c10f8bb9404efea93b7709bff70f8f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:15.269966  5461 tablet_bootstrap.cc:654] T 016eb0d72e0e4e1d843a82e390ce83bc P 00e3ba273af645d881fe92b48b615951: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:15.272342  5460 ts_tablet_manager.cc:1434] T 01fd91b8fb9049d181045604bba46353 P faf57cab004346baae3fe74487d12316: Time spent starting tablet: real 0.077s	user 0.008s	sys 0.002s
I20260709 13:13:15.253700  5369 raft_consensus.cc:3060] T 01fd91b8fb9049d181045604bba46353 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:15.267444  5213 leader_election.cc:304] T dbe4243871d147358837895129c7dd45 P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e3ba273af645d881fe92b48b615951, faf57cab004346baae3fe74487d12316; no voters: 
I20260709 13:13:15.276110  5367 raft_consensus.cc:2804] T dbe4243871d147358837895129c7dd45 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:15.276492  5367 raft_consensus.cc:493] T dbe4243871d147358837895129c7dd45 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:15.276842  5367 raft_consensus.cc:3060] T dbe4243871d147358837895129c7dd45 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:15.279510  5460 tablet_bootstrap.cc:492] T b0a40b61c1b744e399aa024aac76f1f9 P faf57cab004346baae3fe74487d12316: Bootstrap starting.
I20260709 13:13:15.290740  5367 raft_consensus.cc:515] T dbe4243871d147358837895129c7dd45 P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.294015  5460 tablet_bootstrap.cc:654] T b0a40b61c1b744e399aa024aac76f1f9 P faf57cab004346baae3fe74487d12316: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:15.295073  5172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe4243871d147358837895129c7dd45" candidate_uuid: "faf57cab004346baae3fe74487d12316" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c10f8bb9404efea93b7709bff70f8f"
I20260709 13:13:15.295885  5172 raft_consensus.cc:3060] T dbe4243871d147358837895129c7dd45 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:15.302805  5461 tablet_bootstrap.cc:492] T 016eb0d72e0e4e1d843a82e390ce83bc P 00e3ba273af645d881fe92b48b615951: No bootstrap required, opened a new log
I20260709 13:13:15.304039  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe4243871d147358837895129c7dd45" candidate_uuid: "faf57cab004346baae3fe74487d12316" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e3ba273af645d881fe92b48b615951"
I20260709 13:13:15.305049  5321 raft_consensus.cc:3060] T dbe4243871d147358837895129c7dd45 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:15.305509  5461 ts_tablet_manager.cc:1403] T 016eb0d72e0e4e1d843a82e390ce83bc P 00e3ba273af645d881fe92b48b615951: Time spent bootstrapping tablet: real 0.099s	user 0.012s	sys 0.009s
I20260709 13:13:15.310101  5367 leader_election.cc:290] T dbe4243871d147358837895129c7dd45 P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 1 election: Requested vote from peers 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789), 00e3ba273af645d881fe92b48b615951 (127.28.54.67:44205)
I20260709 13:13:15.310370  5461 raft_consensus.cc:359] T 016eb0d72e0e4e1d843a82e390ce83bc P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.325397  5461 raft_consensus.cc:385] T 016eb0d72e0e4e1d843a82e390ce83bc P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:15.325964  5461 raft_consensus.cc:740] T 016eb0d72e0e4e1d843a82e390ce83bc P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00e3ba273af645d881fe92b48b615951, State: Initialized, Role: FOLLOWER
I20260709 13:13:15.327020  5461 consensus_queue.cc:260] T 016eb0d72e0e4e1d843a82e390ce83bc P 00e3ba273af645d881fe92b48b615951 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.334550  5461 ts_tablet_manager.cc:1434] T 016eb0d72e0e4e1d843a82e390ce83bc P 00e3ba273af645d881fe92b48b615951: Time spent starting tablet: real 0.028s	user 0.009s	sys 0.000s
I20260709 13:13:15.336364  5461 tablet_bootstrap.cc:492] T 965bdbceb0374f3994b3f4efa9482f4b P 00e3ba273af645d881fe92b48b615951: Bootstrap starting.
I20260709 13:13:15.338491  5463 tablet_bootstrap.cc:492] T ae428dc990694b0ba45113e7211e332b P 20c10f8bb9404efea93b7709bff70f8f: No bootstrap required, opened a new log
I20260709 13:13:15.339510  5463 ts_tablet_manager.cc:1403] T ae428dc990694b0ba45113e7211e332b P 20c10f8bb9404efea93b7709bff70f8f: Time spent bootstrapping tablet: real 0.134s	user 0.024s	sys 0.005s
I20260709 13:13:15.342916  5172 raft_consensus.cc:2468] T dbe4243871d147358837895129c7dd45 P 20c10f8bb9404efea93b7709bff70f8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faf57cab004346baae3fe74487d12316 in term 1.
I20260709 13:13:15.344445  5213 leader_election.cc:304] T dbe4243871d147358837895129c7dd45 P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c10f8bb9404efea93b7709bff70f8f, faf57cab004346baae3fe74487d12316; no voters: 
I20260709 13:13:15.344573  5463 raft_consensus.cc:359] T ae428dc990694b0ba45113e7211e332b P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.345464  5463 raft_consensus.cc:385] T ae428dc990694b0ba45113e7211e332b P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:15.345600  5367 raft_consensus.cc:2804] T dbe4243871d147358837895129c7dd45 P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:15.346246  5367 raft_consensus.cc:697] T dbe4243871d147358837895129c7dd45 P faf57cab004346baae3fe74487d12316 [term 1 LEADER]: Becoming Leader. State: Replica: faf57cab004346baae3fe74487d12316, State: Running, Role: LEADER
I20260709 13:13:15.347404  5367 consensus_queue.cc:237] T dbe4243871d147358837895129c7dd45 P faf57cab004346baae3fe74487d12316 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
W20260709 13:13:15.347860  5138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:44205, user_credentials={real_user=slave}} blocked reactor thread for 54911.1us
I20260709 13:13:15.347721  5463 raft_consensus.cc:740] T ae428dc990694b0ba45113e7211e332b P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c10f8bb9404efea93b7709bff70f8f, State: Initialized, Role: FOLLOWER
I20260709 13:13:15.352200  5321 raft_consensus.cc:2468] T dbe4243871d147358837895129c7dd45 P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faf57cab004346baae3fe74487d12316 in term 1.
I20260709 13:13:15.360389  5463 consensus_queue.cc:260] T ae428dc990694b0ba45113e7211e332b P 20c10f8bb9404efea93b7709bff70f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.352479  5369 raft_consensus.cc:515] T 01fd91b8fb9049d181045604bba46353 P 20c10f8bb9404efea93b7709bff70f8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.363299  5463 ts_tablet_manager.cc:1434] T ae428dc990694b0ba45113e7211e332b P 20c10f8bb9404efea93b7709bff70f8f: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.005s
I20260709 13:13:15.364809  5463 tablet_bootstrap.cc:492] T 016eb0d72e0e4e1d843a82e390ce83bc P 20c10f8bb9404efea93b7709bff70f8f: Bootstrap starting.
I20260709 13:13:15.364595  5068 catalog_manager.cc:5697] T dbe4243871d147358837895129c7dd45 P faf57cab004346baae3fe74487d12316 reported cstate change: term changed from 0 to 1, leader changed from <none> to faf57cab004346baae3fe74487d12316 (127.28.54.66). New cstate: current_term: 1 leader_uuid: "faf57cab004346baae3fe74487d12316" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:15.358110  5461 tablet_bootstrap.cc:654] T 965bdbceb0374f3994b3f4efa9482f4b P 00e3ba273af645d881fe92b48b615951: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:15.372375  5369 leader_election.cc:290] T 01fd91b8fb9049d181045604bba46353 P 20c10f8bb9404efea93b7709bff70f8f [CANDIDATE]: Term 1 election: Requested vote from peers faf57cab004346baae3fe74487d12316 (127.28.54.66:33871), 00e3ba273af645d881fe92b48b615951 (127.28.54.67:44205)
I20260709 13:13:15.373704  5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01fd91b8fb9049d181045604bba46353" candidate_uuid: "20c10f8bb9404efea93b7709bff70f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "faf57cab004346baae3fe74487d12316"
I20260709 13:13:15.374979  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "01fd91b8fb9049d181045604bba46353" candidate_uuid: "20c10f8bb9404efea93b7709bff70f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e3ba273af645d881fe92b48b615951"
I20260709 13:13:15.376726  5247 raft_consensus.cc:3060] T 01fd91b8fb9049d181045604bba46353 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:15.376967  5321 raft_consensus.cc:3060] T 01fd91b8fb9049d181045604bba46353 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:15.384377  5321 raft_consensus.cc:2468] T 01fd91b8fb9049d181045604bba46353 P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c10f8bb9404efea93b7709bff70f8f in term 1.
I20260709 13:13:15.376055  5460 tablet_bootstrap.cc:492] T b0a40b61c1b744e399aa024aac76f1f9 P faf57cab004346baae3fe74487d12316: No bootstrap required, opened a new log
I20260709 13:13:15.385489  5460 ts_tablet_manager.cc:1403] T b0a40b61c1b744e399aa024aac76f1f9 P faf57cab004346baae3fe74487d12316: Time spent bootstrapping tablet: real 0.107s	user 0.034s	sys 0.053s
I20260709 13:13:15.385674  5138 leader_election.cc:304] T 01fd91b8fb9049d181045604bba46353 P 20c10f8bb9404efea93b7709bff70f8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e3ba273af645d881fe92b48b615951, 20c10f8bb9404efea93b7709bff70f8f; no voters: 
I20260709 13:13:15.386689  5369 raft_consensus.cc:2804] T 01fd91b8fb9049d181045604bba46353 P 20c10f8bb9404efea93b7709bff70f8f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:15.387435  5369 raft_consensus.cc:697] T 01fd91b8fb9049d181045604bba46353 P 20c10f8bb9404efea93b7709bff70f8f [term 1 LEADER]: Becoming Leader. State: Replica: 20c10f8bb9404efea93b7709bff70f8f, State: Running, Role: LEADER
I20260709 13:13:15.388578  5369 consensus_queue.cc:237] T 01fd91b8fb9049d181045604bba46353 P 20c10f8bb9404efea93b7709bff70f8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.388872  5460 raft_consensus.cc:359] T b0a40b61c1b744e399aa024aac76f1f9 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.390157  5460 raft_consensus.cc:385] T b0a40b61c1b744e399aa024aac76f1f9 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:15.376089  5463 tablet_bootstrap.cc:654] T 016eb0d72e0e4e1d843a82e390ce83bc P 20c10f8bb9404efea93b7709bff70f8f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:15.390462  5460 raft_consensus.cc:740] T b0a40b61c1b744e399aa024aac76f1f9 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: faf57cab004346baae3fe74487d12316, State: Initialized, Role: FOLLOWER
I20260709 13:13:15.390473  5247 raft_consensus.cc:2468] T 01fd91b8fb9049d181045604bba46353 P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c10f8bb9404efea93b7709bff70f8f in term 1.
I20260709 13:13:15.391544  5460 consensus_queue.cc:260] T b0a40b61c1b744e399aa024aac76f1f9 P faf57cab004346baae3fe74487d12316 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.394865  5460 ts_tablet_manager.cc:1434] T b0a40b61c1b744e399aa024aac76f1f9 P faf57cab004346baae3fe74487d12316: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 13:13:15.395689  5461 tablet_bootstrap.cc:492] T 965bdbceb0374f3994b3f4efa9482f4b P 00e3ba273af645d881fe92b48b615951: No bootstrap required, opened a new log
I20260709 13:13:15.396324  5461 ts_tablet_manager.cc:1403] T 965bdbceb0374f3994b3f4efa9482f4b P 00e3ba273af645d881fe92b48b615951: Time spent bootstrapping tablet: real 0.060s	user 0.012s	sys 0.016s
I20260709 13:13:15.396437  5460 tablet_bootstrap.cc:492] T 965bdbceb0374f3994b3f4efa9482f4b P faf57cab004346baae3fe74487d12316: Bootstrap starting.
I20260709 13:13:15.404829  5461 raft_consensus.cc:359] T 965bdbceb0374f3994b3f4efa9482f4b P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.405647  5461 raft_consensus.cc:385] T 965bdbceb0374f3994b3f4efa9482f4b P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:15.406078  5461 raft_consensus.cc:740] T 965bdbceb0374f3994b3f4efa9482f4b P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00e3ba273af645d881fe92b48b615951, State: Initialized, Role: FOLLOWER
I20260709 13:13:15.407054  5461 consensus_queue.cc:260] T 965bdbceb0374f3994b3f4efa9482f4b P 00e3ba273af645d881fe92b48b615951 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.409533  5460 tablet_bootstrap.cc:654] T 965bdbceb0374f3994b3f4efa9482f4b P faf57cab004346baae3fe74487d12316: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:15.410028  5461 ts_tablet_manager.cc:1434] T 965bdbceb0374f3994b3f4efa9482f4b P 00e3ba273af645d881fe92b48b615951: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.003s
I20260709 13:13:15.411409  5461 tablet_bootstrap.cc:492] T d3218bc2bfe94d5f81b06f2fd09c1934 P 00e3ba273af645d881fe92b48b615951: Bootstrap starting.
I20260709 13:13:15.413226  5068 catalog_manager.cc:5697] T 01fd91b8fb9049d181045604bba46353 P 20c10f8bb9404efea93b7709bff70f8f reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65). New cstate: current_term: 1 leader_uuid: "20c10f8bb9404efea93b7709bff70f8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:15.418413  5461 tablet_bootstrap.cc:654] T d3218bc2bfe94d5f81b06f2fd09c1934 P 00e3ba273af645d881fe92b48b615951: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:15.438637  5367 raft_consensus.cc:493] T ae428dc990694b0ba45113e7211e332b P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.439332  5367 raft_consensus.cc:515] T ae428dc990694b0ba45113e7211e332b P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.441582  5367 leader_election.cc:290] T ae428dc990694b0ba45113e7211e332b P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789), 00e3ba273af645d881fe92b48b615951 (127.28.54.67:44205)
I20260709 13:13:15.442607  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae428dc990694b0ba45113e7211e332b" candidate_uuid: "faf57cab004346baae3fe74487d12316" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e3ba273af645d881fe92b48b615951" is_pre_election: true
I20260709 13:13:15.443336  5321 raft_consensus.cc:2468] T ae428dc990694b0ba45113e7211e332b P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate faf57cab004346baae3fe74487d12316 in term 0.
I20260709 13:13:15.445358  5213 leader_election.cc:304] T ae428dc990694b0ba45113e7211e332b P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e3ba273af645d881fe92b48b615951, faf57cab004346baae3fe74487d12316; no voters: 
I20260709 13:13:15.446606  5367 raft_consensus.cc:2804] T ae428dc990694b0ba45113e7211e332b P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:15.447000  5367 raft_consensus.cc:493] T ae428dc990694b0ba45113e7211e332b P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:15.447319  5367 raft_consensus.cc:3060] T ae428dc990694b0ba45113e7211e332b P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:15.448494  5172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae428dc990694b0ba45113e7211e332b" candidate_uuid: "faf57cab004346baae3fe74487d12316" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c10f8bb9404efea93b7709bff70f8f" is_pre_election: true
I20260709 13:13:15.449189  5172 raft_consensus.cc:2468] T ae428dc990694b0ba45113e7211e332b P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate faf57cab004346baae3fe74487d12316 in term 0.
I20260709 13:13:15.445302  5463 tablet_bootstrap.cc:492] T 016eb0d72e0e4e1d843a82e390ce83bc P 20c10f8bb9404efea93b7709bff70f8f: No bootstrap required, opened a new log
I20260709 13:13:15.451157  5463 ts_tablet_manager.cc:1403] T 016eb0d72e0e4e1d843a82e390ce83bc P 20c10f8bb9404efea93b7709bff70f8f: Time spent bootstrapping tablet: real 0.087s	user 0.011s	sys 0.007s
I20260709 13:13:15.462963  5463 raft_consensus.cc:359] T 016eb0d72e0e4e1d843a82e390ce83bc P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.463847  5463 raft_consensus.cc:385] T 016eb0d72e0e4e1d843a82e390ce83bc P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:15.464197  5463 raft_consensus.cc:740] T 016eb0d72e0e4e1d843a82e390ce83bc P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c10f8bb9404efea93b7709bff70f8f, State: Initialized, Role: FOLLOWER
I20260709 13:13:15.465065  5463 consensus_queue.cc:260] T 016eb0d72e0e4e1d843a82e390ce83bc P 20c10f8bb9404efea93b7709bff70f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.467780  5463 ts_tablet_manager.cc:1434] T 016eb0d72e0e4e1d843a82e390ce83bc P 20c10f8bb9404efea93b7709bff70f8f: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.001s
I20260709 13:13:15.473737  5369 raft_consensus.cc:493] T b0a40b61c1b744e399aa024aac76f1f9 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.477465  5369 raft_consensus.cc:515] T b0a40b61c1b744e399aa024aac76f1f9 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.480311  5369 leader_election.cc:290] T b0a40b61c1b744e399aa024aac76f1f9 P 20c10f8bb9404efea93b7709bff70f8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers faf57cab004346baae3fe74487d12316 (127.28.54.66:33871), 00e3ba273af645d881fe92b48b615951 (127.28.54.67:44205)
I20260709 13:13:15.473594  5463 tablet_bootstrap.cc:492] T 965bdbceb0374f3994b3f4efa9482f4b P 20c10f8bb9404efea93b7709bff70f8f: Bootstrap starting.
I20260709 13:13:15.481935  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0a40b61c1b744e399aa024aac76f1f9" candidate_uuid: "20c10f8bb9404efea93b7709bff70f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e3ba273af645d881fe92b48b615951" is_pre_election: true
I20260709 13:13:15.482808  5321 raft_consensus.cc:2468] T b0a40b61c1b744e399aa024aac76f1f9 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c10f8bb9404efea93b7709bff70f8f in term 0.
I20260709 13:13:15.484026  5138 leader_election.cc:304] T b0a40b61c1b744e399aa024aac76f1f9 P 20c10f8bb9404efea93b7709bff70f8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e3ba273af645d881fe92b48b615951, 20c10f8bb9404efea93b7709bff70f8f; no voters: 
I20260709 13:13:15.486400  5455 raft_consensus.cc:2804] T b0a40b61c1b744e399aa024aac76f1f9 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:15.486763  5455 raft_consensus.cc:493] T b0a40b61c1b744e399aa024aac76f1f9 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:15.487062  5455 raft_consensus.cc:3060] T b0a40b61c1b744e399aa024aac76f1f9 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:15.488615  5463 tablet_bootstrap.cc:654] T 965bdbceb0374f3994b3f4efa9482f4b P 20c10f8bb9404efea93b7709bff70f8f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:15.490581  5478 raft_consensus.cc:493] T 016eb0d72e0e4e1d843a82e390ce83bc P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.491101  5478 raft_consensus.cc:515] T 016eb0d72e0e4e1d843a82e390ce83bc P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.493249  5478 leader_election.cc:290] T 016eb0d72e0e4e1d843a82e390ce83bc P 20c10f8bb9404efea93b7709bff70f8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers faf57cab004346baae3fe74487d12316 (127.28.54.66:33871), 00e3ba273af645d881fe92b48b615951 (127.28.54.67:44205)
I20260709 13:13:15.494779  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016eb0d72e0e4e1d843a82e390ce83bc" candidate_uuid: "20c10f8bb9404efea93b7709bff70f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e3ba273af645d881fe92b48b615951" is_pre_election: true
I20260709 13:13:15.495354  5461 tablet_bootstrap.cc:492] T d3218bc2bfe94d5f81b06f2fd09c1934 P 00e3ba273af645d881fe92b48b615951: No bootstrap required, opened a new log
I20260709 13:13:15.493458  5460 tablet_bootstrap.cc:492] T 965bdbceb0374f3994b3f4efa9482f4b P faf57cab004346baae3fe74487d12316: No bootstrap required, opened a new log
I20260709 13:13:15.496064  5461 ts_tablet_manager.cc:1403] T d3218bc2bfe94d5f81b06f2fd09c1934 P 00e3ba273af645d881fe92b48b615951: Time spent bootstrapping tablet: real 0.085s	user 0.031s	sys 0.046s
I20260709 13:13:15.496172  5460 ts_tablet_manager.cc:1403] T 965bdbceb0374f3994b3f4efa9482f4b P faf57cab004346baae3fe74487d12316: Time spent bootstrapping tablet: real 0.100s	user 0.047s	sys 0.044s
I20260709 13:13:15.495458  5321 raft_consensus.cc:2468] T 016eb0d72e0e4e1d843a82e390ce83bc P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c10f8bb9404efea93b7709bff70f8f in term 0.
I20260709 13:13:15.499320  5461 raft_consensus.cc:359] T d3218bc2bfe94d5f81b06f2fd09c1934 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.499747  5138 leader_election.cc:304] T 016eb0d72e0e4e1d843a82e390ce83bc P 20c10f8bb9404efea93b7709bff70f8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e3ba273af645d881fe92b48b615951, 20c10f8bb9404efea93b7709bff70f8f; no voters: 
I20260709 13:13:15.500093  5461 raft_consensus.cc:385] T d3218bc2bfe94d5f81b06f2fd09c1934 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:15.500710  5478 raft_consensus.cc:2804] T 016eb0d72e0e4e1d843a82e390ce83bc P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:15.501106  5478 raft_consensus.cc:493] T 016eb0d72e0e4e1d843a82e390ce83bc P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:15.501431  5478 raft_consensus.cc:3060] T 016eb0d72e0e4e1d843a82e390ce83bc P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:15.501633  5460 raft_consensus.cc:359] T 965bdbceb0374f3994b3f4efa9482f4b P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.502419  5460 raft_consensus.cc:385] T 965bdbceb0374f3994b3f4efa9482f4b P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:15.502701  5460 raft_consensus.cc:740] T 965bdbceb0374f3994b3f4efa9482f4b P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: faf57cab004346baae3fe74487d12316, State: Initialized, Role: FOLLOWER
I20260709 13:13:15.503502  5460 consensus_queue.cc:260] T 965bdbceb0374f3994b3f4efa9482f4b P faf57cab004346baae3fe74487d12316 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.500424  5461 raft_consensus.cc:740] T d3218bc2bfe94d5f81b06f2fd09c1934 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00e3ba273af645d881fe92b48b615951, State: Initialized, Role: FOLLOWER
I20260709 13:13:15.505172  5461 consensus_queue.cc:260] T d3218bc2bfe94d5f81b06f2fd09c1934 P 00e3ba273af645d881fe92b48b615951 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.495651  5367 raft_consensus.cc:515] T ae428dc990694b0ba45113e7211e332b P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.507910  5461 ts_tablet_manager.cc:1434] T d3218bc2bfe94d5f81b06f2fd09c1934 P 00e3ba273af645d881fe92b48b615951: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 13:13:15.509296  5461 tablet_bootstrap.cc:492] T f1e891d4721f42eca4e337499ecdede2 P 00e3ba273af645d881fe92b48b615951: Bootstrap starting.
I20260709 13:13:15.510351  5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0a40b61c1b744e399aa024aac76f1f9" candidate_uuid: "20c10f8bb9404efea93b7709bff70f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "faf57cab004346baae3fe74487d12316" is_pre_election: true
I20260709 13:13:15.511027  5247 raft_consensus.cc:2468] T b0a40b61c1b744e399aa024aac76f1f9 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c10f8bb9404efea93b7709bff70f8f in term 0.
I20260709 13:13:15.514132  5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016eb0d72e0e4e1d843a82e390ce83bc" candidate_uuid: "20c10f8bb9404efea93b7709bff70f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "faf57cab004346baae3fe74487d12316" is_pre_election: true
I20260709 13:13:15.514784  5247 raft_consensus.cc:2468] T 016eb0d72e0e4e1d843a82e390ce83bc P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c10f8bb9404efea93b7709bff70f8f in term 0.
I20260709 13:13:15.516568  5461 tablet_bootstrap.cc:654] T f1e891d4721f42eca4e337499ecdede2 P 00e3ba273af645d881fe92b48b615951: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:15.517561  5172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae428dc990694b0ba45113e7211e332b" candidate_uuid: "faf57cab004346baae3fe74487d12316" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c10f8bb9404efea93b7709bff70f8f"
I20260709 13:13:15.518172  5172 raft_consensus.cc:3060] T ae428dc990694b0ba45113e7211e332b P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:15.519073  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae428dc990694b0ba45113e7211e332b" candidate_uuid: "faf57cab004346baae3fe74487d12316" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e3ba273af645d881fe92b48b615951"
I20260709 13:13:15.519466  5460 ts_tablet_manager.cc:1434] T 965bdbceb0374f3994b3f4efa9482f4b P faf57cab004346baae3fe74487d12316: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260709 13:13:15.519672  5320 raft_consensus.cc:3060] T ae428dc990694b0ba45113e7211e332b P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:15.521347  5460 tablet_bootstrap.cc:492] T d3218bc2bfe94d5f81b06f2fd09c1934 P faf57cab004346baae3fe74487d12316: Bootstrap starting.
I20260709 13:13:15.529486  5460 tablet_bootstrap.cc:654] T d3218bc2bfe94d5f81b06f2fd09c1934 P faf57cab004346baae3fe74487d12316: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:15.532683  5368 raft_consensus.cc:493] T 965bdbceb0374f3994b3f4efa9482f4b P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.533200  5368 raft_consensus.cc:515] T 965bdbceb0374f3994b3f4efa9482f4b P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.535589  5368 leader_election.cc:290] T 965bdbceb0374f3994b3f4efa9482f4b P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789), faf57cab004346baae3fe74487d12316 (127.28.54.66:33871)
I20260709 13:13:15.518169  5367 leader_election.cc:290] T ae428dc990694b0ba45113e7211e332b P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 1 election: Requested vote from peers 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789), 00e3ba273af645d881fe92b48b615951 (127.28.54.67:44205)
I20260709 13:13:15.537575  5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965bdbceb0374f3994b3f4efa9482f4b" candidate_uuid: "00e3ba273af645d881fe92b48b615951" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "faf57cab004346baae3fe74487d12316" is_pre_election: true
I20260709 13:13:15.542809  5461 tablet_bootstrap.cc:492] T f1e891d4721f42eca4e337499ecdede2 P 00e3ba273af645d881fe92b48b615951: No bootstrap required, opened a new log
I20260709 13:13:15.543185  5247 raft_consensus.cc:2468] T 965bdbceb0374f3994b3f4efa9482f4b P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00e3ba273af645d881fe92b48b615951 in term 0.
I20260709 13:13:15.543329  5461 ts_tablet_manager.cc:1403] T f1e891d4721f42eca4e337499ecdede2 P 00e3ba273af645d881fe92b48b615951: Time spent bootstrapping tablet: real 0.034s	user 0.006s	sys 0.009s
I20260709 13:13:15.526413  5172 raft_consensus.cc:2468] T ae428dc990694b0ba45113e7211e332b P 20c10f8bb9404efea93b7709bff70f8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faf57cab004346baae3fe74487d12316 in term 1.
I20260709 13:13:15.544896  5171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965bdbceb0374f3994b3f4efa9482f4b" candidate_uuid: "00e3ba273af645d881fe92b48b615951" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c10f8bb9404efea93b7709bff70f8f" is_pre_election: true
I20260709 13:13:15.544939  5213 leader_election.cc:304] T ae428dc990694b0ba45113e7211e332b P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c10f8bb9404efea93b7709bff70f8f, faf57cab004346baae3fe74487d12316; no voters: 
I20260709 13:13:15.546586  5461 raft_consensus.cc:359] T f1e891d4721f42eca4e337499ecdede2 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
W20260709 13:13:15.547241  5287 leader_election.cc:343] T 965bdbceb0374f3994b3f4efa9482f4b P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:15.550611  5461 raft_consensus.cc:385] T f1e891d4721f42eca4e337499ecdede2 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:15.551033  5479 raft_consensus.cc:2804] T ae428dc990694b0ba45113e7211e332b P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:15.551318  5461 raft_consensus.cc:740] T f1e891d4721f42eca4e337499ecdede2 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00e3ba273af645d881fe92b48b615951, State: Initialized, Role: FOLLOWER
I20260709 13:13:15.552115  5461 consensus_queue.cc:260] T f1e891d4721f42eca4e337499ecdede2 P 00e3ba273af645d881fe92b48b615951 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.552816  5478 raft_consensus.cc:515] T 016eb0d72e0e4e1d843a82e390ce83bc P 20c10f8bb9404efea93b7709bff70f8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.553009  5284 leader_election.cc:304] T 965bdbceb0374f3994b3f4efa9482f4b P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00e3ba273af645d881fe92b48b615951, faf57cab004346baae3fe74487d12316; no voters: 20c10f8bb9404efea93b7709bff70f8f
I20260709 13:13:15.554286  5461 ts_tablet_manager.cc:1434] T f1e891d4721f42eca4e337499ecdede2 P 00e3ba273af645d881fe92b48b615951: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 13:13:15.554368  5368 raft_consensus.cc:2804] T 965bdbceb0374f3994b3f4efa9482f4b P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:15.554826  5368 raft_consensus.cc:493] T 965bdbceb0374f3994b3f4efa9482f4b P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:15.555184  5368 raft_consensus.cc:3060] T 965bdbceb0374f3994b3f4efa9482f4b P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:15.551717  5479 raft_consensus.cc:697] T ae428dc990694b0ba45113e7211e332b P faf57cab004346baae3fe74487d12316 [term 1 LEADER]: Becoming Leader. State: Replica: faf57cab004346baae3fe74487d12316, State: Running, Role: LEADER
I20260709 13:13:15.557739  5479 consensus_queue.cc:237] T ae428dc990694b0ba45113e7211e332b P faf57cab004346baae3fe74487d12316 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.558961  5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016eb0d72e0e4e1d843a82e390ce83bc" candidate_uuid: "20c10f8bb9404efea93b7709bff70f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "faf57cab004346baae3fe74487d12316"
I20260709 13:13:15.559527  5247 raft_consensus.cc:3060] T 016eb0d72e0e4e1d843a82e390ce83bc P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:15.555572  5461 tablet_bootstrap.cc:492] T 4efb7f98e10844e7bc2aac9284cbc6ed P 00e3ba273af645d881fe92b48b615951: Bootstrap starting.
I20260709 13:13:15.563527  5368 raft_consensus.cc:515] T 965bdbceb0374f3994b3f4efa9482f4b P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.566201  5171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965bdbceb0374f3994b3f4efa9482f4b" candidate_uuid: "00e3ba273af645d881fe92b48b615951" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c10f8bb9404efea93b7709bff70f8f"
I20260709 13:13:15.566581  5247 raft_consensus.cc:2468] T 016eb0d72e0e4e1d843a82e390ce83bc P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c10f8bb9404efea93b7709bff70f8f in term 1.
I20260709 13:13:15.556222  5455 raft_consensus.cc:515] T b0a40b61c1b744e399aa024aac76f1f9 P 20c10f8bb9404efea93b7709bff70f8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.567759  5135 leader_election.cc:304] T 016eb0d72e0e4e1d843a82e390ce83bc P 20c10f8bb9404efea93b7709bff70f8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c10f8bb9404efea93b7709bff70f8f, faf57cab004346baae3fe74487d12316; no voters: 
I20260709 13:13:15.568013  5463 tablet_bootstrap.cc:492] T 965bdbceb0374f3994b3f4efa9482f4b P 20c10f8bb9404efea93b7709bff70f8f: No bootstrap required, opened a new log
I20260709 13:13:15.549160  5320 raft_consensus.cc:2468] T ae428dc990694b0ba45113e7211e332b P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faf57cab004346baae3fe74487d12316 in term 1.
W20260709 13:13:15.568470  5287 leader_election.cc:343] T 965bdbceb0374f3994b3f4efa9482f4b P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:15.570160  5368 leader_election.cc:290] T 965bdbceb0374f3994b3f4efa9482f4b P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 1 election: Requested vote from peers 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789), faf57cab004346baae3fe74487d12316 (127.28.54.66:33871)
I20260709 13:13:15.570753  5368 raft_consensus.cc:493] T d3218bc2bfe94d5f81b06f2fd09c1934 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.571274  5368 raft_consensus.cc:515] T d3218bc2bfe94d5f81b06f2fd09c1934 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.572110  5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0a40b61c1b744e399aa024aac76f1f9" candidate_uuid: "20c10f8bb9404efea93b7709bff70f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "faf57cab004346baae3fe74487d12316"
I20260709 13:13:15.566488  5461 tablet_bootstrap.cc:654] T 4efb7f98e10844e7bc2aac9284cbc6ed P 00e3ba273af645d881fe92b48b615951: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:15.572741  5245 raft_consensus.cc:3060] T b0a40b61c1b744e399aa024aac76f1f9 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:15.570677  5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965bdbceb0374f3994b3f4efa9482f4b" candidate_uuid: "00e3ba273af645d881fe92b48b615951" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "faf57cab004346baae3fe74487d12316"
I20260709 13:13:15.568602  5463 ts_tablet_manager.cc:1403] T 965bdbceb0374f3994b3f4efa9482f4b P 20c10f8bb9404efea93b7709bff70f8f: Time spent bootstrapping tablet: real 0.095s	user 0.021s	sys 0.025s
I20260709 13:13:15.572786  5478 leader_election.cc:290] T 016eb0d72e0e4e1d843a82e390ce83bc P 20c10f8bb9404efea93b7709bff70f8f [CANDIDATE]: Term 1 election: Requested vote from peers faf57cab004346baae3fe74487d12316 (127.28.54.66:33871), 00e3ba273af645d881fe92b48b615951 (127.28.54.67:44205)
I20260709 13:13:15.574542  5478 raft_consensus.cc:2804] T 016eb0d72e0e4e1d843a82e390ce83bc P 20c10f8bb9404efea93b7709bff70f8f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:15.574940  5478 raft_consensus.cc:697] T 016eb0d72e0e4e1d843a82e390ce83bc P 20c10f8bb9404efea93b7709bff70f8f [term 1 LEADER]: Becoming Leader. State: Replica: 20c10f8bb9404efea93b7709bff70f8f, State: Running, Role: LEADER
I20260709 13:13:15.573064  5455 leader_election.cc:290] T b0a40b61c1b744e399aa024aac76f1f9 P 20c10f8bb9404efea93b7709bff70f8f [CANDIDATE]: Term 1 election: Requested vote from peers faf57cab004346baae3fe74487d12316 (127.28.54.66:33871), 00e3ba273af645d881fe92b48b615951 (127.28.54.67:44205)
I20260709 13:13:15.577086  5463 raft_consensus.cc:359] T 965bdbceb0374f3994b3f4efa9482f4b P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.577898  5463 raft_consensus.cc:385] T 965bdbceb0374f3994b3f4efa9482f4b P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:15.578624  5463 raft_consensus.cc:740] T 965bdbceb0374f3994b3f4efa9482f4b P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c10f8bb9404efea93b7709bff70f8f, State: Initialized, Role: FOLLOWER
I20260709 13:13:15.575758  5478 consensus_queue.cc:237] T 016eb0d72e0e4e1d843a82e390ce83bc P 20c10f8bb9404efea93b7709bff70f8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.579705  5460 tablet_bootstrap.cc:492] T d3218bc2bfe94d5f81b06f2fd09c1934 P faf57cab004346baae3fe74487d12316: No bootstrap required, opened a new log
I20260709 13:13:15.579411  5463 consensus_queue.cc:260] T 965bdbceb0374f3994b3f4efa9482f4b P 20c10f8bb9404efea93b7709bff70f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.573866  5247 raft_consensus.cc:3060] T 965bdbceb0374f3994b3f4efa9482f4b P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:15.578256  5368 leader_election.cc:290] T d3218bc2bfe94d5f81b06f2fd09c1934 P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789), faf57cab004346baae3fe74487d12316 (127.28.54.66:33871)
I20260709 13:13:15.580298  5460 ts_tablet_manager.cc:1403] T d3218bc2bfe94d5f81b06f2fd09c1934 P faf57cab004346baae3fe74487d12316: Time spent bootstrapping tablet: real 0.059s	user 0.016s	sys 0.016s
I20260709 13:13:15.581202  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0a40b61c1b744e399aa024aac76f1f9" candidate_uuid: "20c10f8bb9404efea93b7709bff70f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e3ba273af645d881fe92b48b615951"
I20260709 13:13:15.582177  5320 raft_consensus.cc:3060] T b0a40b61c1b744e399aa024aac76f1f9 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:15.584995  5460 raft_consensus.cc:359] T d3218bc2bfe94d5f81b06f2fd09c1934 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.585829  5460 raft_consensus.cc:385] T d3218bc2bfe94d5f81b06f2fd09c1934 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:15.586161  5460 raft_consensus.cc:740] T d3218bc2bfe94d5f81b06f2fd09c1934 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: faf57cab004346baae3fe74487d12316, State: Initialized, Role: FOLLOWER
I20260709 13:13:15.586934  5460 consensus_queue.cc:260] T d3218bc2bfe94d5f81b06f2fd09c1934 P faf57cab004346baae3fe74487d12316 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.588243  5247 raft_consensus.cc:2468] T 965bdbceb0374f3994b3f4efa9482f4b P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00e3ba273af645d881fe92b48b615951 in term 1.
I20260709 13:13:15.579787  5171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3218bc2bfe94d5f81b06f2fd09c1934" candidate_uuid: "00e3ba273af645d881fe92b48b615951" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c10f8bb9404efea93b7709bff70f8f" is_pre_election: true
I20260709 13:13:15.582122  5463 ts_tablet_manager.cc:1434] T 965bdbceb0374f3994b3f4efa9482f4b P 20c10f8bb9404efea93b7709bff70f8f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 13:13:15.589496  5460 ts_tablet_manager.cc:1434] T d3218bc2bfe94d5f81b06f2fd09c1934 P faf57cab004346baae3fe74487d12316: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 13:13:15.591246  5284 leader_election.cc:304] T 965bdbceb0374f3994b3f4efa9482f4b P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00e3ba273af645d881fe92b48b615951, faf57cab004346baae3fe74487d12316; no voters: 20c10f8bb9404efea93b7709bff70f8f
I20260709 13:13:15.591693  5460 tablet_bootstrap.cc:492] T 4efb7f98e10844e7bc2aac9284cbc6ed P faf57cab004346baae3fe74487d12316: Bootstrap starting.
W20260709 13:13:15.592453  5287 leader_election.cc:343] T d3218bc2bfe94d5f81b06f2fd09c1934 P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:15.591327  5246 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3218bc2bfe94d5f81b06f2fd09c1934" candidate_uuid: "00e3ba273af645d881fe92b48b615951" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "faf57cab004346baae3fe74487d12316" is_pre_election: true
I20260709 13:13:15.589387  5320 raft_consensus.cc:2468] T b0a40b61c1b744e399aa024aac76f1f9 P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c10f8bb9404efea93b7709bff70f8f in term 1.
I20260709 13:13:15.594717  5246 raft_consensus.cc:2468] T d3218bc2bfe94d5f81b06f2fd09c1934 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00e3ba273af645d881fe92b48b615951 in term 0.
I20260709 13:13:15.590602  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016eb0d72e0e4e1d843a82e390ce83bc" candidate_uuid: "20c10f8bb9404efea93b7709bff70f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e3ba273af645d881fe92b48b615951"
I20260709 13:13:15.593974  5463 tablet_bootstrap.cc:492] T d3218bc2bfe94d5f81b06f2fd09c1934 P 20c10f8bb9404efea93b7709bff70f8f: Bootstrap starting.
I20260709 13:13:15.595530  5321 raft_consensus.cc:3060] T 016eb0d72e0e4e1d843a82e390ce83bc P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:15.596938  5284 leader_election.cc:304] T d3218bc2bfe94d5f81b06f2fd09c1934 P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00e3ba273af645d881fe92b48b615951, faf57cab004346baae3fe74487d12316; no voters: 20c10f8bb9404efea93b7709bff70f8f
I20260709 13:13:15.592662  5368 raft_consensus.cc:2804] T 965bdbceb0374f3994b3f4efa9482f4b P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:15.595693  5138 leader_election.cc:304] T b0a40b61c1b744e399aa024aac76f1f9 P 20c10f8bb9404efea93b7709bff70f8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e3ba273af645d881fe92b48b615951, 20c10f8bb9404efea93b7709bff70f8f; no voters: 
I20260709 13:13:15.598914  5460 tablet_bootstrap.cc:654] T 4efb7f98e10844e7bc2aac9284cbc6ed P faf57cab004346baae3fe74487d12316: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:15.599344  5369 raft_consensus.cc:2804] T b0a40b61c1b744e399aa024aac76f1f9 P 20c10f8bb9404efea93b7709bff70f8f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:15.599785  5461 tablet_bootstrap.cc:492] T 4efb7f98e10844e7bc2aac9284cbc6ed P 00e3ba273af645d881fe92b48b615951: No bootstrap required, opened a new log
I20260709 13:13:15.600291  5461 ts_tablet_manager.cc:1403] T 4efb7f98e10844e7bc2aac9284cbc6ed P 00e3ba273af645d881fe92b48b615951: Time spent bootstrapping tablet: real 0.045s	user 0.006s	sys 0.008s
I20260709 13:13:15.602609  5491 raft_consensus.cc:2804] T d3218bc2bfe94d5f81b06f2fd09c1934 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:15.602960  5491 raft_consensus.cc:493] T d3218bc2bfe94d5f81b06f2fd09c1934 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:15.603143  5461 raft_consensus.cc:359] T 4efb7f98e10844e7bc2aac9284cbc6ed P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.604135  5461 raft_consensus.cc:385] T 4efb7f98e10844e7bc2aac9284cbc6ed P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:15.604544  5461 raft_consensus.cc:740] T 4efb7f98e10844e7bc2aac9284cbc6ed P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 00e3ba273af645d881fe92b48b615951, State: Initialized, Role: FOLLOWER
I20260709 13:13:15.605044  5321 raft_consensus.cc:2468] T 016eb0d72e0e4e1d843a82e390ce83bc P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c10f8bb9404efea93b7709bff70f8f in term 1.
I20260709 13:13:15.599926  5369 raft_consensus.cc:697] T b0a40b61c1b744e399aa024aac76f1f9 P 20c10f8bb9404efea93b7709bff70f8f [term 1 LEADER]: Becoming Leader. State: Replica: 20c10f8bb9404efea93b7709bff70f8f, State: Running, Role: LEADER
I20260709 13:13:15.603255  5491 raft_consensus.cc:3060] T d3218bc2bfe94d5f81b06f2fd09c1934 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:15.606259  5369 consensus_queue.cc:237] T b0a40b61c1b744e399aa024aac76f1f9 P 20c10f8bb9404efea93b7709bff70f8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.610009  5460 tablet_bootstrap.cc:492] T 4efb7f98e10844e7bc2aac9284cbc6ed P faf57cab004346baae3fe74487d12316: No bootstrap required, opened a new log
I20260709 13:13:15.610610  5460 ts_tablet_manager.cc:1403] T 4efb7f98e10844e7bc2aac9284cbc6ed P faf57cab004346baae3fe74487d12316: Time spent bootstrapping tablet: real 0.019s	user 0.010s	sys 0.008s
I20260709 13:13:15.610826  5463 tablet_bootstrap.cc:654] T d3218bc2bfe94d5f81b06f2fd09c1934 P 20c10f8bb9404efea93b7709bff70f8f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:15.605448  5461 consensus_queue.cc:260] T 4efb7f98e10844e7bc2aac9284cbc6ed P 00e3ba273af645d881fe92b48b615951 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.613714  5460 raft_consensus.cc:359] T 4efb7f98e10844e7bc2aac9284cbc6ed P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.616724  5460 raft_consensus.cc:385] T 4efb7f98e10844e7bc2aac9284cbc6ed P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:15.617077  5460 raft_consensus.cc:740] T 4efb7f98e10844e7bc2aac9284cbc6ed P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: faf57cab004346baae3fe74487d12316, State: Initialized, Role: FOLLOWER
I20260709 13:13:15.624198  5460 consensus_queue.cc:260] T 4efb7f98e10844e7bc2aac9284cbc6ed P faf57cab004346baae3fe74487d12316 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.627655  5460 ts_tablet_manager.cc:1434] T 4efb7f98e10844e7bc2aac9284cbc6ed P faf57cab004346baae3fe74487d12316: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 13:13:15.629181  5368 raft_consensus.cc:697] T 965bdbceb0374f3994b3f4efa9482f4b P 00e3ba273af645d881fe92b48b615951 [term 1 LEADER]: Becoming Leader. State: Replica: 00e3ba273af645d881fe92b48b615951, State: Running, Role: LEADER
I20260709 13:13:15.630373  5460 tablet_bootstrap.cc:492] T f1e891d4721f42eca4e337499ecdede2 P faf57cab004346baae3fe74487d12316: Bootstrap starting.
I20260709 13:13:15.599220  5245 raft_consensus.cc:2468] T b0a40b61c1b744e399aa024aac76f1f9 P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c10f8bb9404efea93b7709bff70f8f in term 1.
I20260709 13:13:15.632236  5368 consensus_queue.cc:237] T 965bdbceb0374f3994b3f4efa9482f4b P 00e3ba273af645d881fe92b48b615951 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.630235  5068 catalog_manager.cc:5697] T ae428dc990694b0ba45113e7211e332b P faf57cab004346baae3fe74487d12316 reported cstate change: term changed from 0 to 1, leader changed from <none> to faf57cab004346baae3fe74487d12316 (127.28.54.66). New cstate: current_term: 1 leader_uuid: "faf57cab004346baae3fe74487d12316" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:15.643301  5461 ts_tablet_manager.cc:1434] T 4efb7f98e10844e7bc2aac9284cbc6ed P 00e3ba273af645d881fe92b48b615951: Time spent starting tablet: real 0.043s	user 0.019s	sys 0.002s
I20260709 13:13:15.644248  5491 raft_consensus.cc:515] T d3218bc2bfe94d5f81b06f2fd09c1934 P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.645175  5460 tablet_bootstrap.cc:654] T f1e891d4721f42eca4e337499ecdede2 P faf57cab004346baae3fe74487d12316: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:15.647295  5171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3218bc2bfe94d5f81b06f2fd09c1934" candidate_uuid: "00e3ba273af645d881fe92b48b615951" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c10f8bb9404efea93b7709bff70f8f"
W20260709 13:13:15.648833  5287 leader_election.cc:343] T d3218bc2bfe94d5f81b06f2fd09c1934 P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789): Illegal state: must be running to vote when last-logged opid is not known
I20260709 13:13:15.650383  5491 leader_election.cc:290] T d3218bc2bfe94d5f81b06f2fd09c1934 P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 1 election: Requested vote from peers 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789), faf57cab004346baae3fe74487d12316 (127.28.54.66:33871)
I20260709 13:13:15.650926  5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3218bc2bfe94d5f81b06f2fd09c1934" candidate_uuid: "00e3ba273af645d881fe92b48b615951" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "faf57cab004346baae3fe74487d12316"
I20260709 13:13:15.651427  5463 tablet_bootstrap.cc:492] T d3218bc2bfe94d5f81b06f2fd09c1934 P 20c10f8bb9404efea93b7709bff70f8f: No bootstrap required, opened a new log
I20260709 13:13:15.651542  5247 raft_consensus.cc:3060] T d3218bc2bfe94d5f81b06f2fd09c1934 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:15.652034  5463 ts_tablet_manager.cc:1403] T d3218bc2bfe94d5f81b06f2fd09c1934 P 20c10f8bb9404efea93b7709bff70f8f: Time spent bootstrapping tablet: real 0.058s	user 0.013s	sys 0.012s
I20260709 13:13:15.655097  5463 raft_consensus.cc:359] T d3218bc2bfe94d5f81b06f2fd09c1934 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.658658  5463 raft_consensus.cc:385] T d3218bc2bfe94d5f81b06f2fd09c1934 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:15.659336  5463 raft_consensus.cc:740] T d3218bc2bfe94d5f81b06f2fd09c1934 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c10f8bb9404efea93b7709bff70f8f, State: Initialized, Role: FOLLOWER
I20260709 13:13:15.665374  5463 consensus_queue.cc:260] T d3218bc2bfe94d5f81b06f2fd09c1934 P 20c10f8bb9404efea93b7709bff70f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.667309  5068 catalog_manager.cc:5697] T 016eb0d72e0e4e1d843a82e390ce83bc P 20c10f8bb9404efea93b7709bff70f8f reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65). New cstate: current_term: 1 leader_uuid: "20c10f8bb9404efea93b7709bff70f8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:15.668071  5463 ts_tablet_manager.cc:1434] T d3218bc2bfe94d5f81b06f2fd09c1934 P 20c10f8bb9404efea93b7709bff70f8f: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 13:13:15.668363  5070 catalog_manager.cc:5697] T 965bdbceb0374f3994b3f4efa9482f4b P 00e3ba273af645d881fe92b48b615951 reported cstate change: term changed from 0 to 1, leader changed from <none> to 00e3ba273af645d881fe92b48b615951 (127.28.54.67). New cstate: current_term: 1 leader_uuid: "00e3ba273af645d881fe92b48b615951" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:15.669392  5463 tablet_bootstrap.cc:492] T f1e891d4721f42eca4e337499ecdede2 P 20c10f8bb9404efea93b7709bff70f8f: Bootstrap starting.
I20260709 13:13:15.673455  5460 tablet_bootstrap.cc:492] T f1e891d4721f42eca4e337499ecdede2 P faf57cab004346baae3fe74487d12316: No bootstrap required, opened a new log
I20260709 13:13:15.673981  5460 ts_tablet_manager.cc:1403] T f1e891d4721f42eca4e337499ecdede2 P faf57cab004346baae3fe74487d12316: Time spent bootstrapping tablet: real 0.044s	user 0.018s	sys 0.017s
I20260709 13:13:15.662019  5247 raft_consensus.cc:2468] T d3218bc2bfe94d5f81b06f2fd09c1934 P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00e3ba273af645d881fe92b48b615951 in term 1.
I20260709 13:13:15.676807  5460 raft_consensus.cc:359] T f1e891d4721f42eca4e337499ecdede2 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.677470  5460 raft_consensus.cc:385] T f1e891d4721f42eca4e337499ecdede2 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:15.677793  5460 raft_consensus.cc:740] T f1e891d4721f42eca4e337499ecdede2 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: faf57cab004346baae3fe74487d12316, State: Initialized, Role: FOLLOWER
I20260709 13:13:15.678839  5463 tablet_bootstrap.cc:654] T f1e891d4721f42eca4e337499ecdede2 P 20c10f8bb9404efea93b7709bff70f8f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:15.678591  5460 consensus_queue.cc:260] T f1e891d4721f42eca4e337499ecdede2 P faf57cab004346baae3fe74487d12316 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.680471  5460 ts_tablet_manager.cc:1434] T f1e891d4721f42eca4e337499ecdede2 P faf57cab004346baae3fe74487d12316: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 13:13:15.681344  5284 leader_election.cc:304] T d3218bc2bfe94d5f81b06f2fd09c1934 P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00e3ba273af645d881fe92b48b615951, faf57cab004346baae3fe74487d12316; no voters: 20c10f8bb9404efea93b7709bff70f8f
I20260709 13:13:15.683013  5368 raft_consensus.cc:2804] T d3218bc2bfe94d5f81b06f2fd09c1934 P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:15.683459  5368 raft_consensus.cc:697] T d3218bc2bfe94d5f81b06f2fd09c1934 P 00e3ba273af645d881fe92b48b615951 [term 1 LEADER]: Becoming Leader. State: Replica: 00e3ba273af645d881fe92b48b615951, State: Running, Role: LEADER
I20260709 13:13:15.684257  5463 tablet_bootstrap.cc:492] T f1e891d4721f42eca4e337499ecdede2 P 20c10f8bb9404efea93b7709bff70f8f: No bootstrap required, opened a new log
I20260709 13:13:15.684690  5463 ts_tablet_manager.cc:1403] T f1e891d4721f42eca4e337499ecdede2 P 20c10f8bb9404efea93b7709bff70f8f: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.001s
I20260709 13:13:15.684226  5368 consensus_queue.cc:237] T d3218bc2bfe94d5f81b06f2fd09c1934 P 00e3ba273af645d881fe92b48b615951 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.692620  5463 raft_consensus.cc:359] T f1e891d4721f42eca4e337499ecdede2 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.693387  5463 raft_consensus.cc:385] T f1e891d4721f42eca4e337499ecdede2 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:15.693702  5463 raft_consensus.cc:740] T f1e891d4721f42eca4e337499ecdede2 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c10f8bb9404efea93b7709bff70f8f, State: Initialized, Role: FOLLOWER
I20260709 13:13:15.694495  5463 consensus_queue.cc:260] T f1e891d4721f42eca4e337499ecdede2 P 20c10f8bb9404efea93b7709bff70f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.696964  5463 ts_tablet_manager.cc:1434] T f1e891d4721f42eca4e337499ecdede2 P 20c10f8bb9404efea93b7709bff70f8f: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 13:13:15.698073  5463 tablet_bootstrap.cc:492] T 4efb7f98e10844e7bc2aac9284cbc6ed P 20c10f8bb9404efea93b7709bff70f8f: Bootstrap starting.
I20260709 13:13:15.698342  5070 catalog_manager.cc:5697] T b0a40b61c1b744e399aa024aac76f1f9 P 20c10f8bb9404efea93b7709bff70f8f reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65). New cstate: current_term: 1 leader_uuid: "20c10f8bb9404efea93b7709bff70f8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:15.703775  5463 tablet_bootstrap.cc:654] T 4efb7f98e10844e7bc2aac9284cbc6ed P 20c10f8bb9404efea93b7709bff70f8f: Neither blocks nor log segments found. Creating new log.
I20260709 13:13:15.708518  5068 catalog_manager.cc:5697] T d3218bc2bfe94d5f81b06f2fd09c1934 P 00e3ba273af645d881fe92b48b615951 reported cstate change: term changed from 0 to 1, leader changed from <none> to 00e3ba273af645d881fe92b48b615951 (127.28.54.67). New cstate: current_term: 1 leader_uuid: "00e3ba273af645d881fe92b48b615951" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:15.721323  5463 tablet_bootstrap.cc:492] T 4efb7f98e10844e7bc2aac9284cbc6ed P 20c10f8bb9404efea93b7709bff70f8f: No bootstrap required, opened a new log
I20260709 13:13:15.721778  5463 ts_tablet_manager.cc:1403] T 4efb7f98e10844e7bc2aac9284cbc6ed P 20c10f8bb9404efea93b7709bff70f8f: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.003s
I20260709 13:13:15.723665  5463 raft_consensus.cc:359] T 4efb7f98e10844e7bc2aac9284cbc6ed P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.724107  5463 raft_consensus.cc:385] T 4efb7f98e10844e7bc2aac9284cbc6ed P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 13:13:15.724278  5463 raft_consensus.cc:740] T 4efb7f98e10844e7bc2aac9284cbc6ed P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 20c10f8bb9404efea93b7709bff70f8f, State: Initialized, Role: FOLLOWER
I20260709 13:13:15.724805  5463 consensus_queue.cc:260] T 4efb7f98e10844e7bc2aac9284cbc6ed P 20c10f8bb9404efea93b7709bff70f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.726442  5463 ts_tablet_manager.cc:1434] T 4efb7f98e10844e7bc2aac9284cbc6ed P 20c10f8bb9404efea93b7709bff70f8f: Time spent starting tablet: real 0.004s	user 0.001s	sys 0.003s
I20260709 13:13:15.749835  5368 raft_consensus.cc:493] T f1e891d4721f42eca4e337499ecdede2 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.750326  5368 raft_consensus.cc:515] T f1e891d4721f42eca4e337499ecdede2 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.751865  5368 leader_election.cc:290] T f1e891d4721f42eca4e337499ecdede2 P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789), faf57cab004346baae3fe74487d12316 (127.28.54.66:33871)
I20260709 13:13:15.752537  5171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1e891d4721f42eca4e337499ecdede2" candidate_uuid: "00e3ba273af645d881fe92b48b615951" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c10f8bb9404efea93b7709bff70f8f" is_pre_election: true
I20260709 13:13:15.752789  5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1e891d4721f42eca4e337499ecdede2" candidate_uuid: "00e3ba273af645d881fe92b48b615951" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "faf57cab004346baae3fe74487d12316" is_pre_election: true
I20260709 13:13:15.753252  5171 raft_consensus.cc:2468] T f1e891d4721f42eca4e337499ecdede2 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00e3ba273af645d881fe92b48b615951 in term 0.
I20260709 13:13:15.753407  5247 raft_consensus.cc:2468] T f1e891d4721f42eca4e337499ecdede2 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 00e3ba273af645d881fe92b48b615951 in term 0.
I20260709 13:13:15.754307  5287 leader_election.cc:304] T f1e891d4721f42eca4e337499ecdede2 P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e3ba273af645d881fe92b48b615951, 20c10f8bb9404efea93b7709bff70f8f; no voters: 
I20260709 13:13:15.755127  5368 raft_consensus.cc:2804] T f1e891d4721f42eca4e337499ecdede2 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:15.755426  5368 raft_consensus.cc:493] T f1e891d4721f42eca4e337499ecdede2 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:15.755764  5368 raft_consensus.cc:3060] T f1e891d4721f42eca4e337499ecdede2 P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:15.760787  5368 raft_consensus.cc:515] T f1e891d4721f42eca4e337499ecdede2 P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.762259  5368 leader_election.cc:290] T f1e891d4721f42eca4e337499ecdede2 P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 1 election: Requested vote from peers 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789), faf57cab004346baae3fe74487d12316 (127.28.54.66:33871)
I20260709 13:13:15.762876  5171 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1e891d4721f42eca4e337499ecdede2" candidate_uuid: "00e3ba273af645d881fe92b48b615951" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "20c10f8bb9404efea93b7709bff70f8f"
I20260709 13:13:15.763235  5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1e891d4721f42eca4e337499ecdede2" candidate_uuid: "00e3ba273af645d881fe92b48b615951" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "faf57cab004346baae3fe74487d12316"
I20260709 13:13:15.763509  5171 raft_consensus.cc:3060] T f1e891d4721f42eca4e337499ecdede2 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:15.763777  5247 raft_consensus.cc:3060] T f1e891d4721f42eca4e337499ecdede2 P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:15.770061  5247 raft_consensus.cc:2468] T f1e891d4721f42eca4e337499ecdede2 P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00e3ba273af645d881fe92b48b615951 in term 1.
I20260709 13:13:15.770768  5171 raft_consensus.cc:2468] T f1e891d4721f42eca4e337499ecdede2 P 20c10f8bb9404efea93b7709bff70f8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00e3ba273af645d881fe92b48b615951 in term 1.
I20260709 13:13:15.771006  5284 leader_election.cc:304] T f1e891d4721f42eca4e337499ecdede2 P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e3ba273af645d881fe92b48b615951, faf57cab004346baae3fe74487d12316; no voters: 
I20260709 13:13:15.771749  5368 raft_consensus.cc:2804] T f1e891d4721f42eca4e337499ecdede2 P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:15.772099  5368 raft_consensus.cc:697] T f1e891d4721f42eca4e337499ecdede2 P 00e3ba273af645d881fe92b48b615951 [term 1 LEADER]: Becoming Leader. State: Replica: 00e3ba273af645d881fe92b48b615951, State: Running, Role: LEADER
I20260709 13:13:15.772784  5368 consensus_queue.cc:237] T f1e891d4721f42eca4e337499ecdede2 P 00e3ba273af645d881fe92b48b615951 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.779217  5068 catalog_manager.cc:5697] T f1e891d4721f42eca4e337499ecdede2 P 00e3ba273af645d881fe92b48b615951 reported cstate change: term changed from 0 to 1, leader changed from <none> to 00e3ba273af645d881fe92b48b615951 (127.28.54.67). New cstate: current_term: 1 leader_uuid: "00e3ba273af645d881fe92b48b615951" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:15.824306  5369 raft_consensus.cc:493] T 4efb7f98e10844e7bc2aac9284cbc6ed P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.824786  5369 raft_consensus.cc:515] T 4efb7f98e10844e7bc2aac9284cbc6ed P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.825001  5478 raft_consensus.cc:493] T d3218bc2bfe94d5f81b06f2fd09c1934 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.825453  5478 raft_consensus.cc:515] T d3218bc2bfe94d5f81b06f2fd09c1934 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.826634  5369 leader_election.cc:290] T 4efb7f98e10844e7bc2aac9284cbc6ed P 20c10f8bb9404efea93b7709bff70f8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers faf57cab004346baae3fe74487d12316 (127.28.54.66:33871), 00e3ba273af645d881fe92b48b615951 (127.28.54.67:44205)
I20260709 13:13:15.827442  5478 leader_election.cc:290] T d3218bc2bfe94d5f81b06f2fd09c1934 P 20c10f8bb9404efea93b7709bff70f8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers faf57cab004346baae3fe74487d12316 (127.28.54.66:33871), 00e3ba273af645d881fe92b48b615951 (127.28.54.67:44205)
I20260709 13:13:15.828063  5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3218bc2bfe94d5f81b06f2fd09c1934" candidate_uuid: "20c10f8bb9404efea93b7709bff70f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "faf57cab004346baae3fe74487d12316" is_pre_election: true
I20260709 13:13:15.828763  5319 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3218bc2bfe94d5f81b06f2fd09c1934" candidate_uuid: "20c10f8bb9404efea93b7709bff70f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e3ba273af645d881fe92b48b615951" is_pre_election: true
I20260709 13:13:15.828158  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb7f98e10844e7bc2aac9284cbc6ed" candidate_uuid: "20c10f8bb9404efea93b7709bff70f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e3ba273af645d881fe92b48b615951" is_pre_election: true
I20260709 13:13:15.828963  5245 raft_consensus.cc:2393] T d3218bc2bfe94d5f81b06f2fd09c1934 P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c10f8bb9404efea93b7709bff70f8f in current term 1: Already voted for candidate 00e3ba273af645d881fe92b48b615951 in this term.
I20260709 13:13:15.829509  5321 raft_consensus.cc:2468] T 4efb7f98e10844e7bc2aac9284cbc6ed P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c10f8bb9404efea93b7709bff70f8f in term 0.
I20260709 13:13:15.828939  5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb7f98e10844e7bc2aac9284cbc6ed" candidate_uuid: "20c10f8bb9404efea93b7709bff70f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "faf57cab004346baae3fe74487d12316" is_pre_election: true
I20260709 13:13:15.830389  5138 leader_election.cc:304] T 4efb7f98e10844e7bc2aac9284cbc6ed P 20c10f8bb9404efea93b7709bff70f8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e3ba273af645d881fe92b48b615951, 20c10f8bb9404efea93b7709bff70f8f; no voters: 
I20260709 13:13:15.830426  5247 raft_consensus.cc:2468] T 4efb7f98e10844e7bc2aac9284cbc6ed P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 20c10f8bb9404efea93b7709bff70f8f in term 0.
I20260709 13:13:15.830403  5135 leader_election.cc:304] T d3218bc2bfe94d5f81b06f2fd09c1934 P 20c10f8bb9404efea93b7709bff70f8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c10f8bb9404efea93b7709bff70f8f; no voters: 00e3ba273af645d881fe92b48b615951, faf57cab004346baae3fe74487d12316
I20260709 13:13:15.831063  5478 raft_consensus.cc:2804] T 4efb7f98e10844e7bc2aac9284cbc6ed P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 13:13:15.831422  5369 raft_consensus.cc:3060] T d3218bc2bfe94d5f81b06f2fd09c1934 P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:15.831470  5478 raft_consensus.cc:493] T 4efb7f98e10844e7bc2aac9284cbc6ed P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 13:13:15.831970  5478 raft_consensus.cc:3060] T 4efb7f98e10844e7bc2aac9284cbc6ed P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:15.838518  5369 raft_consensus.cc:2749] T d3218bc2bfe94d5f81b06f2fd09c1934 P 20c10f8bb9404efea93b7709bff70f8f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:15.840402  5478 raft_consensus.cc:515] T 4efb7f98e10844e7bc2aac9284cbc6ed P 20c10f8bb9404efea93b7709bff70f8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.842152  5478 leader_election.cc:290] T 4efb7f98e10844e7bc2aac9284cbc6ed P 20c10f8bb9404efea93b7709bff70f8f [CANDIDATE]: Term 1 election: Requested vote from peers faf57cab004346baae3fe74487d12316 (127.28.54.66:33871), 00e3ba273af645d881fe92b48b615951 (127.28.54.67:44205)
I20260709 13:13:15.842814  5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb7f98e10844e7bc2aac9284cbc6ed" candidate_uuid: "20c10f8bb9404efea93b7709bff70f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "faf57cab004346baae3fe74487d12316"
I20260709 13:13:15.843108  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb7f98e10844e7bc2aac9284cbc6ed" candidate_uuid: "20c10f8bb9404efea93b7709bff70f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e3ba273af645d881fe92b48b615951"
I20260709 13:13:15.843389  5247 raft_consensus.cc:3060] T 4efb7f98e10844e7bc2aac9284cbc6ed P faf57cab004346baae3fe74487d12316 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:15.843638  5321 raft_consensus.cc:3060] T 4efb7f98e10844e7bc2aac9284cbc6ed P 00e3ba273af645d881fe92b48b615951 [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:15.849562  5321 raft_consensus.cc:2468] T 4efb7f98e10844e7bc2aac9284cbc6ed P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c10f8bb9404efea93b7709bff70f8f in term 1.
I20260709 13:13:15.849562  5247 raft_consensus.cc:2468] T 4efb7f98e10844e7bc2aac9284cbc6ed P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c10f8bb9404efea93b7709bff70f8f in term 1.
I20260709 13:13:15.850558  5135 leader_election.cc:304] T 4efb7f98e10844e7bc2aac9284cbc6ed P 20c10f8bb9404efea93b7709bff70f8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c10f8bb9404efea93b7709bff70f8f, faf57cab004346baae3fe74487d12316; no voters: 
I20260709 13:13:15.852169  5478 raft_consensus.cc:2804] T 4efb7f98e10844e7bc2aac9284cbc6ed P 20c10f8bb9404efea93b7709bff70f8f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 13:13:15.852634  5478 raft_consensus.cc:697] T 4efb7f98e10844e7bc2aac9284cbc6ed P 20c10f8bb9404efea93b7709bff70f8f [term 1 LEADER]: Becoming Leader. State: Replica: 20c10f8bb9404efea93b7709bff70f8f, State: Running, Role: LEADER
I20260709 13:13:15.853308  5478 consensus_queue.cc:237] T 4efb7f98e10844e7bc2aac9284cbc6ed P 20c10f8bb9404efea93b7709bff70f8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.861721  5068 catalog_manager.cc:5697] T 4efb7f98e10844e7bc2aac9284cbc6ed P 20c10f8bb9404efea93b7709bff70f8f reported cstate change: term changed from 0 to 1, leader changed from <none> to 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65). New cstate: current_term: 1 leader_uuid: "20c10f8bb9404efea93b7709bff70f8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:15.873535  5247 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dbe4243871d147358837895129c7dd45"
dest_uuid: "faf57cab004346baae3fe74487d12316"
mode: GRACEFUL
new_leader_uuid: "20c10f8bb9404efea93b7709bff70f8f"
 from {username='slave'} at 127.0.0.1:47836
I20260709 13:13:15.874105  5247 raft_consensus.cc:606] T dbe4243871d147358837895129c7dd45 P faf57cab004346baae3fe74487d12316 [term 1 LEADER]: Received request to transfer leadership to TS 20c10f8bb9404efea93b7709bff70f8f
I20260709 13:13:15.880761  5247 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ae428dc990694b0ba45113e7211e332b"
dest_uuid: "faf57cab004346baae3fe74487d12316"
mode: GRACEFUL
new_leader_uuid: "20c10f8bb9404efea93b7709bff70f8f"
 from {username='slave'} at 127.0.0.1:47836
I20260709 13:13:15.881172  5247 raft_consensus.cc:606] T ae428dc990694b0ba45113e7211e332b P faf57cab004346baae3fe74487d12316 [term 1 LEADER]: Received request to transfer leadership to TS 20c10f8bb9404efea93b7709bff70f8f
I20260709 13:13:15.887629  5171 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "016eb0d72e0e4e1d843a82e390ce83bc"
dest_uuid: "20c10f8bb9404efea93b7709bff70f8f"
mode: GRACEFUL
new_leader_uuid: "faf57cab004346baae3fe74487d12316"
 from {username='slave'} at 127.0.0.1:47416
I20260709 13:13:15.888152  5171 raft_consensus.cc:606] T 016eb0d72e0e4e1d843a82e390ce83bc P 20c10f8bb9404efea93b7709bff70f8f [term 1 LEADER]: Received request to transfer leadership to TS faf57cab004346baae3fe74487d12316
I20260709 13:13:15.892401  5321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "965bdbceb0374f3994b3f4efa9482f4b"
dest_uuid: "00e3ba273af645d881fe92b48b615951"
mode: GRACEFUL
new_leader_uuid: "faf57cab004346baae3fe74487d12316"
 from {username='slave'} at 127.0.0.1:51940
I20260709 13:13:15.892791  5321 raft_consensus.cc:606] T 965bdbceb0374f3994b3f4efa9482f4b P 00e3ba273af645d881fe92b48b615951 [term 1 LEADER]: Received request to transfer leadership to TS faf57cab004346baae3fe74487d12316
I20260709 13:13:15.896922  5321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d3218bc2bfe94d5f81b06f2fd09c1934"
dest_uuid: "00e3ba273af645d881fe92b48b615951"
mode: GRACEFUL
new_leader_uuid: "faf57cab004346baae3fe74487d12316"
 from {username='slave'} at 127.0.0.1:51940
I20260709 13:13:15.897301  5321 raft_consensus.cc:606] T d3218bc2bfe94d5f81b06f2fd09c1934 P 00e3ba273af645d881fe92b48b615951 [term 1 LEADER]: Received request to transfer leadership to TS faf57cab004346baae3fe74487d12316
I20260709 13:13:15.901212  5321 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f1e891d4721f42eca4e337499ecdede2"
dest_uuid: "00e3ba273af645d881fe92b48b615951"
mode: GRACEFUL
new_leader_uuid: "faf57cab004346baae3fe74487d12316"
 from {username='slave'} at 127.0.0.1:51940
I20260709 13:13:15.901582  5321 raft_consensus.cc:606] T f1e891d4721f42eca4e337499ecdede2 P 00e3ba273af645d881fe92b48b615951 [term 1 LEADER]: Received request to transfer leadership to TS faf57cab004346baae3fe74487d12316
I20260709 13:13:15.905573  5171 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4efb7f98e10844e7bc2aac9284cbc6ed"
dest_uuid: "20c10f8bb9404efea93b7709bff70f8f"
mode: GRACEFUL
new_leader_uuid: "00e3ba273af645d881fe92b48b615951"
 from {username='slave'} at 127.0.0.1:47416
I20260709 13:13:15.906060  5171 raft_consensus.cc:606] T 4efb7f98e10844e7bc2aac9284cbc6ed P 20c10f8bb9404efea93b7709bff70f8f [term 1 LEADER]: Received request to transfer leadership to TS 00e3ba273af645d881fe92b48b615951
I20260709 13:13:15.929965  5478 raft_consensus.cc:493] T 965bdbceb0374f3994b3f4efa9482f4b P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 13:13:15.930473  5478 raft_consensus.cc:515] T 965bdbceb0374f3994b3f4efa9482f4b P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.932055  5478 leader_election.cc:290] T 965bdbceb0374f3994b3f4efa9482f4b P 20c10f8bb9404efea93b7709bff70f8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers faf57cab004346baae3fe74487d12316 (127.28.54.66:33871), 00e3ba273af645d881fe92b48b615951 (127.28.54.67:44205)
I20260709 13:13:15.932754  5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965bdbceb0374f3994b3f4efa9482f4b" candidate_uuid: "20c10f8bb9404efea93b7709bff70f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "faf57cab004346baae3fe74487d12316" is_pre_election: true
I20260709 13:13:15.932917  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965bdbceb0374f3994b3f4efa9482f4b" candidate_uuid: "20c10f8bb9404efea93b7709bff70f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "00e3ba273af645d881fe92b48b615951" is_pre_election: true
I20260709 13:13:15.933357  5247 raft_consensus.cc:2393] T 965bdbceb0374f3994b3f4efa9482f4b P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 20c10f8bb9404efea93b7709bff70f8f in current term 1: Already voted for candidate 00e3ba273af645d881fe92b48b615951 in this term.
I20260709 13:13:15.934196  5135 leader_election.cc:304] T 965bdbceb0374f3994b3f4efa9482f4b P 20c10f8bb9404efea93b7709bff70f8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 20c10f8bb9404efea93b7709bff70f8f; no voters: 00e3ba273af645d881fe92b48b615951, faf57cab004346baae3fe74487d12316
I20260709 13:13:15.934778  5478 raft_consensus.cc:3060] T 965bdbceb0374f3994b3f4efa9482f4b P 20c10f8bb9404efea93b7709bff70f8f [term 0 FOLLOWER]: Advancing to term 1
I20260709 13:13:15.939440  5478 raft_consensus.cc:2749] T 965bdbceb0374f3994b3f4efa9482f4b P 20c10f8bb9404efea93b7709bff70f8f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 13:13:15.942821  5486 consensus_queue.cc:1048] T ae428dc990694b0ba45113e7211e332b P faf57cab004346baae3fe74487d12316 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:15.943557  5479 consensus_queue.cc:1048] T ae428dc990694b0ba45113e7211e332b P faf57cab004346baae3fe74487d12316 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:15.956259  5367 raft_consensus.cc:993] T ae428dc990694b0ba45113e7211e332b P faf57cab004346baae3fe74487d12316: : Instructing follower 20c10f8bb9404efea93b7709bff70f8f to start an election
I20260709 13:13:15.956801  5479 raft_consensus.cc:1081] T ae428dc990694b0ba45113e7211e332b P faf57cab004346baae3fe74487d12316 [term 1 LEADER]: Signalling peer 20c10f8bb9404efea93b7709bff70f8f to start an election
I20260709 13:13:15.959805  5172 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ae428dc990694b0ba45113e7211e332b"
dest_uuid: "20c10f8bb9404efea93b7709bff70f8f"
 from {username='slave'} at 127.0.0.1:47414
I20260709 13:13:15.961819  5172 raft_consensus.cc:493] T ae428dc990694b0ba45113e7211e332b P 20c10f8bb9404efea93b7709bff70f8f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:15.962225  5172 raft_consensus.cc:3060] T ae428dc990694b0ba45113e7211e332b P 20c10f8bb9404efea93b7709bff70f8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:15.964679  5367 consensus_queue.cc:1048] T dbe4243871d147358837895129c7dd45 P faf57cab004346baae3fe74487d12316 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:15.969200  5486 consensus_queue.cc:1048] T dbe4243871d147358837895129c7dd45 P faf57cab004346baae3fe74487d12316 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:15.970531  5172 raft_consensus.cc:515] T ae428dc990694b0ba45113e7211e332b P 20c10f8bb9404efea93b7709bff70f8f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.980146  5172 leader_election.cc:290] T ae428dc990694b0ba45113e7211e332b P 20c10f8bb9404efea93b7709bff70f8f [CANDIDATE]: Term 2 election: Requested vote from peers faf57cab004346baae3fe74487d12316 (127.28.54.66:33871), 00e3ba273af645d881fe92b48b615951 (127.28.54.67:44205)
I20260709 13:13:15.981784  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae428dc990694b0ba45113e7211e332b" candidate_uuid: "20c10f8bb9404efea93b7709bff70f8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00e3ba273af645d881fe92b48b615951"
I20260709 13:13:15.984136  5321 raft_consensus.cc:3060] T ae428dc990694b0ba45113e7211e332b P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:15.983201  5367 raft_consensus.cc:993] T dbe4243871d147358837895129c7dd45 P faf57cab004346baae3fe74487d12316: : Instructing follower 20c10f8bb9404efea93b7709bff70f8f to start an election
I20260709 13:13:15.984789  5367 raft_consensus.cc:1081] T dbe4243871d147358837895129c7dd45 P faf57cab004346baae3fe74487d12316 [term 1 LEADER]: Signalling peer 20c10f8bb9404efea93b7709bff70f8f to start an election
I20260709 13:13:15.987377  5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ae428dc990694b0ba45113e7211e332b" candidate_uuid: "20c10f8bb9404efea93b7709bff70f8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "faf57cab004346baae3fe74487d12316"
I20260709 13:13:15.987944  5247 raft_consensus.cc:3055] T ae428dc990694b0ba45113e7211e332b P faf57cab004346baae3fe74487d12316 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:15.988199  5247 raft_consensus.cc:740] T ae428dc990694b0ba45113e7211e332b P faf57cab004346baae3fe74487d12316 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: faf57cab004346baae3fe74487d12316, State: Running, Role: LEADER
I20260709 13:13:15.990451  5170 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dbe4243871d147358837895129c7dd45"
dest_uuid: "20c10f8bb9404efea93b7709bff70f8f"
 from {username='slave'} at 127.0.0.1:47414
I20260709 13:13:15.990965  5170 raft_consensus.cc:493] T dbe4243871d147358837895129c7dd45 P 20c10f8bb9404efea93b7709bff70f8f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:15.991339  5170 raft_consensus.cc:3060] T dbe4243871d147358837895129c7dd45 P 20c10f8bb9404efea93b7709bff70f8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:15.991941  5247 consensus_queue.cc:260] T ae428dc990694b0ba45113e7211e332b P faf57cab004346baae3fe74487d12316 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:15.994138  5247 raft_consensus.cc:3060] T ae428dc990694b0ba45113e7211e332b P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:16.001091  5247 raft_consensus.cc:2468] T ae428dc990694b0ba45113e7211e332b P faf57cab004346baae3fe74487d12316 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c10f8bb9404efea93b7709bff70f8f in term 2.
I20260709 13:13:16.002171  5135 leader_election.cc:304] T ae428dc990694b0ba45113e7211e332b P 20c10f8bb9404efea93b7709bff70f8f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c10f8bb9404efea93b7709bff70f8f, faf57cab004346baae3fe74487d12316; no voters: 
I20260709 13:13:16.002938  5478 raft_consensus.cc:2804] T ae428dc990694b0ba45113e7211e332b P 20c10f8bb9404efea93b7709bff70f8f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:16.003415  5478 raft_consensus.cc:697] T ae428dc990694b0ba45113e7211e332b P 20c10f8bb9404efea93b7709bff70f8f [term 2 LEADER]: Becoming Leader. State: Replica: 20c10f8bb9404efea93b7709bff70f8f, State: Running, Role: LEADER
I20260709 13:13:16.002945  5321 raft_consensus.cc:2468] T ae428dc990694b0ba45113e7211e332b P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c10f8bb9404efea93b7709bff70f8f in term 2.
I20260709 13:13:16.004217  5478 consensus_queue.cc:237] T ae428dc990694b0ba45113e7211e332b P 20c10f8bb9404efea93b7709bff70f8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:16.007854  5170 raft_consensus.cc:515] T dbe4243871d147358837895129c7dd45 P 20c10f8bb9404efea93b7709bff70f8f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:16.009159  5172 raft_consensus.cc:1240] T dbe4243871d147358837895129c7dd45 P 20c10f8bb9404efea93b7709bff70f8f [term 2 FOLLOWER]: Rejecting Update request from peer faf57cab004346baae3fe74487d12316 for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:16.011152  5170 leader_election.cc:290] T dbe4243871d147358837895129c7dd45 P 20c10f8bb9404efea93b7709bff70f8f [CANDIDATE]: Term 2 election: Requested vote from peers faf57cab004346baae3fe74487d12316 (127.28.54.66:33871), 00e3ba273af645d881fe92b48b615951 (127.28.54.67:44205)
I20260709 13:13:16.011965  5247 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe4243871d147358837895129c7dd45" candidate_uuid: "20c10f8bb9404efea93b7709bff70f8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "faf57cab004346baae3fe74487d12316"
I20260709 13:13:16.012605  5247 raft_consensus.cc:3055] T dbe4243871d147358837895129c7dd45 P faf57cab004346baae3fe74487d12316 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:16.012910  5247 raft_consensus.cc:740] T dbe4243871d147358837895129c7dd45 P faf57cab004346baae3fe74487d12316 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: faf57cab004346baae3fe74487d12316, State: Running, Role: LEADER
I20260709 13:13:16.013131  5321 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe4243871d147358837895129c7dd45" candidate_uuid: "20c10f8bb9404efea93b7709bff70f8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00e3ba273af645d881fe92b48b615951"
I20260709 13:13:16.013713  5247 consensus_queue.cc:260] T dbe4243871d147358837895129c7dd45 P faf57cab004346baae3fe74487d12316 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:16.013603  5070 catalog_manager.cc:5697] T ae428dc990694b0ba45113e7211e332b P 20c10f8bb9404efea93b7709bff70f8f reported cstate change: term changed from 1 to 2, leader changed from faf57cab004346baae3fe74487d12316 (127.28.54.66) to 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65). New cstate: current_term: 2 leader_uuid: "20c10f8bb9404efea93b7709bff70f8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:16.015002  5479 consensus_queue.cc:1059] T dbe4243871d147358837895129c7dd45 P faf57cab004346baae3fe74487d12316 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:16.013722  5321 raft_consensus.cc:3060] T dbe4243871d147358837895129c7dd45 P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:16.018038  5247 raft_consensus.cc:3060] T dbe4243871d147358837895129c7dd45 P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:16.017961  5478 consensus_queue.cc:1048] T 01fd91b8fb9049d181045604bba46353 P 20c10f8bb9404efea93b7709bff70f8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:16.019748  5369 consensus_queue.cc:1048] T 01fd91b8fb9049d181045604bba46353 P 20c10f8bb9404efea93b7709bff70f8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:16.024828  5247 raft_consensus.cc:2468] T dbe4243871d147358837895129c7dd45 P faf57cab004346baae3fe74487d12316 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c10f8bb9404efea93b7709bff70f8f in term 2.
I20260709 13:13:16.026011  5135 leader_election.cc:304] T dbe4243871d147358837895129c7dd45 P 20c10f8bb9404efea93b7709bff70f8f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c10f8bb9404efea93b7709bff70f8f, faf57cab004346baae3fe74487d12316; no voters: 
I20260709 13:13:16.027567  5455 raft_consensus.cc:2804] T dbe4243871d147358837895129c7dd45 P 20c10f8bb9404efea93b7709bff70f8f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:16.035805  5455 raft_consensus.cc:697] T dbe4243871d147358837895129c7dd45 P 20c10f8bb9404efea93b7709bff70f8f [term 2 LEADER]: Becoming Leader. State: Replica: 20c10f8bb9404efea93b7709bff70f8f, State: Running, Role: LEADER
I20260709 13:13:16.036710  5455 consensus_queue.cc:237] T dbe4243871d147358837895129c7dd45 P 20c10f8bb9404efea93b7709bff70f8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:16.038074  5368 consensus_queue.cc:1048] T 965bdbceb0374f3994b3f4efa9482f4b P 00e3ba273af645d881fe92b48b615951 [LEADER]: Connected to new peer: Peer: permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:16.047380  5321 raft_consensus.cc:2468] T dbe4243871d147358837895129c7dd45 P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 20c10f8bb9404efea93b7709bff70f8f in term 2.
I20260709 13:13:16.048030  5070 catalog_manager.cc:5697] T dbe4243871d147358837895129c7dd45 P 20c10f8bb9404efea93b7709bff70f8f reported cstate change: term changed from 1 to 2, leader changed from faf57cab004346baae3fe74487d12316 (127.28.54.66) to 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65). New cstate: current_term: 2 leader_uuid: "20c10f8bb9404efea93b7709bff70f8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:16.056069  5496 raft_consensus.cc:993] T 965bdbceb0374f3994b3f4efa9482f4b P 00e3ba273af645d881fe92b48b615951: : Instructing follower faf57cab004346baae3fe74487d12316 to start an election
I20260709 13:13:16.056529  5496 raft_consensus.cc:1081] T 965bdbceb0374f3994b3f4efa9482f4b P 00e3ba273af645d881fe92b48b615951 [term 1 LEADER]: Signalling peer faf57cab004346baae3fe74487d12316 to start an election
I20260709 13:13:16.058310  5496 consensus_queue.cc:1048] T 965bdbceb0374f3994b3f4efa9482f4b P 00e3ba273af645d881fe92b48b615951 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:16.066278  5478 consensus_queue.cc:1048] T b0a40b61c1b744e399aa024aac76f1f9 P 20c10f8bb9404efea93b7709bff70f8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:16.068940  5245 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "965bdbceb0374f3994b3f4efa9482f4b"
dest_uuid: "faf57cab004346baae3fe74487d12316"
 from {username='slave'} at 127.0.0.1:47820
I20260709 13:13:16.069478  5245 raft_consensus.cc:493] T 965bdbceb0374f3994b3f4efa9482f4b P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:16.069873  5245 raft_consensus.cc:3060] T 965bdbceb0374f3994b3f4efa9482f4b P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:16.078275  5245 raft_consensus.cc:515] T 965bdbceb0374f3994b3f4efa9482f4b P faf57cab004346baae3fe74487d12316 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:16.078868  5478 consensus_queue.cc:1048] T 016eb0d72e0e4e1d843a82e390ce83bc P 20c10f8bb9404efea93b7709bff70f8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:16.083606  5245 leader_election.cc:290] T 965bdbceb0374f3994b3f4efa9482f4b P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 2 election: Requested vote from peers 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789), 00e3ba273af645d881fe92b48b615951 (127.28.54.67:44205)
I20260709 13:13:16.084707  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965bdbceb0374f3994b3f4efa9482f4b" candidate_uuid: "faf57cab004346baae3fe74487d12316" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00e3ba273af645d881fe92b48b615951"
I20260709 13:13:16.085361  5320 raft_consensus.cc:3055] T 965bdbceb0374f3994b3f4efa9482f4b P 00e3ba273af645d881fe92b48b615951 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:16.085698  5320 raft_consensus.cc:740] T 965bdbceb0374f3994b3f4efa9482f4b P 00e3ba273af645d881fe92b48b615951 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 00e3ba273af645d881fe92b48b615951, State: Running, Role: LEADER
I20260709 13:13:16.086587  5320 consensus_queue.cc:260] T 965bdbceb0374f3994b3f4efa9482f4b P 00e3ba273af645d881fe92b48b615951 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:16.087819  5320 raft_consensus.cc:3060] T 965bdbceb0374f3994b3f4efa9482f4b P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:16.090634  5172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "965bdbceb0374f3994b3f4efa9482f4b" candidate_uuid: "faf57cab004346baae3fe74487d12316" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20c10f8bb9404efea93b7709bff70f8f"
I20260709 13:13:16.091347  5172 raft_consensus.cc:3060] T 965bdbceb0374f3994b3f4efa9482f4b P 20c10f8bb9404efea93b7709bff70f8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:16.099663  5172 raft_consensus.cc:2468] T 965bdbceb0374f3994b3f4efa9482f4b P 20c10f8bb9404efea93b7709bff70f8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faf57cab004346baae3fe74487d12316 in term 2.
I20260709 13:13:16.100741  5213 leader_election.cc:304] T 965bdbceb0374f3994b3f4efa9482f4b P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c10f8bb9404efea93b7709bff70f8f, faf57cab004346baae3fe74487d12316; no voters: 
I20260709 13:13:16.100875  5478 consensus_queue.cc:1048] T b0a40b61c1b744e399aa024aac76f1f9 P 20c10f8bb9404efea93b7709bff70f8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:16.101626  5479 raft_consensus.cc:2804] T 965bdbceb0374f3994b3f4efa9482f4b P faf57cab004346baae3fe74487d12316 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:16.102049  5479 raft_consensus.cc:697] T 965bdbceb0374f3994b3f4efa9482f4b P faf57cab004346baae3fe74487d12316 [term 2 LEADER]: Becoming Leader. State: Replica: faf57cab004346baae3fe74487d12316, State: Running, Role: LEADER
I20260709 13:13:16.102106  5320 raft_consensus.cc:2468] T 965bdbceb0374f3994b3f4efa9482f4b P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faf57cab004346baae3fe74487d12316 in term 2.
I20260709 13:13:16.102845  5479 consensus_queue.cc:237] T 965bdbceb0374f3994b3f4efa9482f4b P faf57cab004346baae3fe74487d12316 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:16.111979  5068 catalog_manager.cc:5697] T 965bdbceb0374f3994b3f4efa9482f4b P faf57cab004346baae3fe74487d12316 reported cstate change: term changed from 1 to 2, leader changed from 00e3ba273af645d881fe92b48b615951 (127.28.54.67) to faf57cab004346baae3fe74487d12316 (127.28.54.66). New cstate: current_term: 2 leader_uuid: "faf57cab004346baae3fe74487d12316" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:16.120891  5517 consensus_queue.cc:1048] T 016eb0d72e0e4e1d843a82e390ce83bc P 20c10f8bb9404efea93b7709bff70f8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 13:13:16.131209  5516 raft_consensus.cc:993] T 016eb0d72e0e4e1d843a82e390ce83bc P 20c10f8bb9404efea93b7709bff70f8f: : Instructing follower faf57cab004346baae3fe74487d12316 to start an election
I20260709 13:13:16.131736  5517 raft_consensus.cc:1081] T 016eb0d72e0e4e1d843a82e390ce83bc P 20c10f8bb9404efea93b7709bff70f8f [term 1 LEADER]: Signalling peer faf57cab004346baae3fe74487d12316 to start an election
I20260709 13:13:16.133170  5247 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "016eb0d72e0e4e1d843a82e390ce83bc"
dest_uuid: "faf57cab004346baae3fe74487d12316"
 from {username='slave'} at 127.0.0.1:47824
I20260709 13:13:16.133683  5247 raft_consensus.cc:493] T 016eb0d72e0e4e1d843a82e390ce83bc P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:16.134056  5247 raft_consensus.cc:3060] T 016eb0d72e0e4e1d843a82e390ce83bc P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:16.139701  5247 raft_consensus.cc:515] T 016eb0d72e0e4e1d843a82e390ce83bc P faf57cab004346baae3fe74487d12316 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:16.140954  5247 leader_election.cc:290] T 016eb0d72e0e4e1d843a82e390ce83bc P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 2 election: Requested vote from peers 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789), 00e3ba273af645d881fe92b48b615951 (127.28.54.67:44205)
I20260709 13:13:16.142040  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016eb0d72e0e4e1d843a82e390ce83bc" candidate_uuid: "faf57cab004346baae3fe74487d12316" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00e3ba273af645d881fe92b48b615951"
I20260709 13:13:16.142518  5320 raft_consensus.cc:3060] T 016eb0d72e0e4e1d843a82e390ce83bc P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:16.141633  5172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "016eb0d72e0e4e1d843a82e390ce83bc" candidate_uuid: "faf57cab004346baae3fe74487d12316" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20c10f8bb9404efea93b7709bff70f8f"
I20260709 13:13:16.143144  5172 raft_consensus.cc:3055] T 016eb0d72e0e4e1d843a82e390ce83bc P 20c10f8bb9404efea93b7709bff70f8f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:16.143429  5172 raft_consensus.cc:740] T 016eb0d72e0e4e1d843a82e390ce83bc P 20c10f8bb9404efea93b7709bff70f8f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20c10f8bb9404efea93b7709bff70f8f, State: Running, Role: LEADER
I20260709 13:13:16.144030  5172 consensus_queue.cc:260] T 016eb0d72e0e4e1d843a82e390ce83bc P 20c10f8bb9404efea93b7709bff70f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:16.145136  5172 raft_consensus.cc:3060] T 016eb0d72e0e4e1d843a82e390ce83bc P 20c10f8bb9404efea93b7709bff70f8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:16.147754  5320 raft_consensus.cc:2468] T 016eb0d72e0e4e1d843a82e390ce83bc P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faf57cab004346baae3fe74487d12316 in term 2.
I20260709 13:13:16.148677  5213 leader_election.cc:304] T 016eb0d72e0e4e1d843a82e390ce83bc P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e3ba273af645d881fe92b48b615951, faf57cab004346baae3fe74487d12316; no voters: 
I20260709 13:13:16.149271  5479 raft_consensus.cc:2804] T 016eb0d72e0e4e1d843a82e390ce83bc P faf57cab004346baae3fe74487d12316 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:16.149497  5172 raft_consensus.cc:2468] T 016eb0d72e0e4e1d843a82e390ce83bc P 20c10f8bb9404efea93b7709bff70f8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faf57cab004346baae3fe74487d12316 in term 2.
I20260709 13:13:16.149933  5479 raft_consensus.cc:697] T 016eb0d72e0e4e1d843a82e390ce83bc P faf57cab004346baae3fe74487d12316 [term 2 LEADER]: Becoming Leader. State: Replica: faf57cab004346baae3fe74487d12316, State: Running, Role: LEADER
I20260709 13:13:16.151590  5479 consensus_queue.cc:237] T 016eb0d72e0e4e1d843a82e390ce83bc P faf57cab004346baae3fe74487d12316 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:16.158398  5069 catalog_manager.cc:5697] T 016eb0d72e0e4e1d843a82e390ce83bc P faf57cab004346baae3fe74487d12316 reported cstate change: term changed from 1 to 2, leader changed from 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65) to faf57cab004346baae3fe74487d12316 (127.28.54.66). New cstate: current_term: 2 leader_uuid: "faf57cab004346baae3fe74487d12316" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:16.199234  5493 consensus_queue.cc:1048] T d3218bc2bfe94d5f81b06f2fd09c1934 P 00e3ba273af645d881fe92b48b615951 [LEADER]: Connected to new peer: Peer: permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:16.205277  5496 raft_consensus.cc:993] T d3218bc2bfe94d5f81b06f2fd09c1934 P 00e3ba273af645d881fe92b48b615951: : Instructing follower faf57cab004346baae3fe74487d12316 to start an election
I20260709 13:13:16.205713  5491 raft_consensus.cc:1081] T d3218bc2bfe94d5f81b06f2fd09c1934 P 00e3ba273af645d881fe92b48b615951 [term 1 LEADER]: Signalling peer faf57cab004346baae3fe74487d12316 to start an election
I20260709 13:13:16.207383  5245 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d3218bc2bfe94d5f81b06f2fd09c1934"
dest_uuid: "faf57cab004346baae3fe74487d12316"
 from {username='slave'} at 127.0.0.1:47820
I20260709 13:13:16.207895  5245 raft_consensus.cc:493] T d3218bc2bfe94d5f81b06f2fd09c1934 P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:16.208282  5245 raft_consensus.cc:3060] T d3218bc2bfe94d5f81b06f2fd09c1934 P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:16.215315  5491 consensus_queue.cc:1048] T d3218bc2bfe94d5f81b06f2fd09c1934 P 00e3ba273af645d881fe92b48b615951 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:16.215728  5245 raft_consensus.cc:515] T d3218bc2bfe94d5f81b06f2fd09c1934 P faf57cab004346baae3fe74487d12316 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:16.218138  5245 leader_election.cc:290] T d3218bc2bfe94d5f81b06f2fd09c1934 P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 2 election: Requested vote from peers 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789), 00e3ba273af645d881fe92b48b615951 (127.28.54.67:44205)
I20260709 13:13:16.219134  5170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3218bc2bfe94d5f81b06f2fd09c1934" candidate_uuid: "faf57cab004346baae3fe74487d12316" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20c10f8bb9404efea93b7709bff70f8f"
I20260709 13:13:16.219228  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d3218bc2bfe94d5f81b06f2fd09c1934" candidate_uuid: "faf57cab004346baae3fe74487d12316" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00e3ba273af645d881fe92b48b615951"
I20260709 13:13:16.219941  5320 raft_consensus.cc:3055] T d3218bc2bfe94d5f81b06f2fd09c1934 P 00e3ba273af645d881fe92b48b615951 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:16.220250  5320 raft_consensus.cc:740] T d3218bc2bfe94d5f81b06f2fd09c1934 P 00e3ba273af645d881fe92b48b615951 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 00e3ba273af645d881fe92b48b615951, State: Running, Role: LEADER
I20260709 13:13:16.221186  5320 consensus_queue.cc:260] T d3218bc2bfe94d5f81b06f2fd09c1934 P 00e3ba273af645d881fe92b48b615951 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:16.222260  5320 raft_consensus.cc:3060] T d3218bc2bfe94d5f81b06f2fd09c1934 P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:16.229218  5320 raft_consensus.cc:2468] T d3218bc2bfe94d5f81b06f2fd09c1934 P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faf57cab004346baae3fe74487d12316 in term 2.
I20260709 13:13:16.230093  5213 leader_election.cc:304] T d3218bc2bfe94d5f81b06f2fd09c1934 P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00e3ba273af645d881fe92b48b615951, faf57cab004346baae3fe74487d12316; no voters: 20c10f8bb9404efea93b7709bff70f8f
I20260709 13:13:16.230746  5479 raft_consensus.cc:2804] T d3218bc2bfe94d5f81b06f2fd09c1934 P faf57cab004346baae3fe74487d12316 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:16.231222  5479 raft_consensus.cc:697] T d3218bc2bfe94d5f81b06f2fd09c1934 P faf57cab004346baae3fe74487d12316 [term 2 LEADER]: Becoming Leader. State: Replica: faf57cab004346baae3fe74487d12316, State: Running, Role: LEADER
I20260709 13:13:16.231986  5479 consensus_queue.cc:237] T d3218bc2bfe94d5f81b06f2fd09c1934 P faf57cab004346baae3fe74487d12316 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:16.239563  5069 catalog_manager.cc:5697] T d3218bc2bfe94d5f81b06f2fd09c1934 P faf57cab004346baae3fe74487d12316 reported cstate change: term changed from 1 to 2, leader changed from 00e3ba273af645d881fe92b48b615951 (127.28.54.67) to faf57cab004346baae3fe74487d12316 (127.28.54.66). New cstate: current_term: 2 leader_uuid: "faf57cab004346baae3fe74487d12316" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:16.311017  5491 consensus_queue.cc:1048] T f1e891d4721f42eca4e337499ecdede2 P 00e3ba273af645d881fe92b48b615951 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:16.314994  5516 consensus_queue.cc:1048] T 4efb7f98e10844e7bc2aac9284cbc6ed P 20c10f8bb9404efea93b7709bff70f8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:16.315747  5517 consensus_queue.cc:1048] T 4efb7f98e10844e7bc2aac9284cbc6ed P 20c10f8bb9404efea93b7709bff70f8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:16.325107  5493 consensus_queue.cc:1048] T f1e891d4721f42eca4e337499ecdede2 P 00e3ba273af645d881fe92b48b615951 [LEADER]: Connected to new peer: Peer: permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:16.332425  5478 raft_consensus.cc:993] T 4efb7f98e10844e7bc2aac9284cbc6ed P 20c10f8bb9404efea93b7709bff70f8f: : Instructing follower 00e3ba273af645d881fe92b48b615951 to start an election
I20260709 13:13:16.332865  5478 raft_consensus.cc:1081] T 4efb7f98e10844e7bc2aac9284cbc6ed P 20c10f8bb9404efea93b7709bff70f8f [term 1 LEADER]: Signalling peer 00e3ba273af645d881fe92b48b615951 to start an election
I20260709 13:13:16.337430  5319 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4efb7f98e10844e7bc2aac9284cbc6ed"
dest_uuid: "00e3ba273af645d881fe92b48b615951"
 from {username='slave'} at 127.0.0.1:51914
I20260709 13:13:16.338013  5319 raft_consensus.cc:493] T 4efb7f98e10844e7bc2aac9284cbc6ed P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:16.338423  5319 raft_consensus.cc:3060] T 4efb7f98e10844e7bc2aac9284cbc6ed P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:16.341290  5493 raft_consensus.cc:993] T f1e891d4721f42eca4e337499ecdede2 P 00e3ba273af645d881fe92b48b615951: : Instructing follower faf57cab004346baae3fe74487d12316 to start an election
I20260709 13:13:16.341810  5368 raft_consensus.cc:1081] T f1e891d4721f42eca4e337499ecdede2 P 00e3ba273af645d881fe92b48b615951 [term 1 LEADER]: Signalling peer faf57cab004346baae3fe74487d12316 to start an election
I20260709 13:13:16.343490  5247 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f1e891d4721f42eca4e337499ecdede2"
dest_uuid: "faf57cab004346baae3fe74487d12316"
 from {username='slave'} at 127.0.0.1:47820
I20260709 13:13:16.344014  5247 raft_consensus.cc:493] T f1e891d4721f42eca4e337499ecdede2 P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:16.344388  5247 raft_consensus.cc:3060] T f1e891d4721f42eca4e337499ecdede2 P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:16.345585  5319 raft_consensus.cc:515] T 4efb7f98e10844e7bc2aac9284cbc6ed P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:16.348253  5172 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb7f98e10844e7bc2aac9284cbc6ed" candidate_uuid: "00e3ba273af645d881fe92b48b615951" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20c10f8bb9404efea93b7709bff70f8f"
I20260709 13:13:16.348851  5172 raft_consensus.cc:3055] T 4efb7f98e10844e7bc2aac9284cbc6ed P 20c10f8bb9404efea93b7709bff70f8f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:16.349185  5172 raft_consensus.cc:740] T 4efb7f98e10844e7bc2aac9284cbc6ed P 20c10f8bb9404efea93b7709bff70f8f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 20c10f8bb9404efea93b7709bff70f8f, State: Running, Role: LEADER
I20260709 13:13:16.348320  5320 raft_consensus.cc:1240] T 4efb7f98e10844e7bc2aac9284cbc6ed P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Rejecting Update request from peer 20c10f8bb9404efea93b7709bff70f8f for earlier term 1. Current term is 2. Ops: []
I20260709 13:13:16.350049  5245 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4efb7f98e10844e7bc2aac9284cbc6ed" candidate_uuid: "00e3ba273af645d881fe92b48b615951" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "faf57cab004346baae3fe74487d12316"
I20260709 13:13:16.350734  5245 raft_consensus.cc:3060] T 4efb7f98e10844e7bc2aac9284cbc6ed P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:16.349815  5319 leader_election.cc:290] T 4efb7f98e10844e7bc2aac9284cbc6ed P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 2 election: Requested vote from peers 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789), faf57cab004346baae3fe74487d12316 (127.28.54.66:33871)
I20260709 13:13:16.351714  5247 raft_consensus.cc:515] T f1e891d4721f42eca4e337499ecdede2 P faf57cab004346baae3fe74487d12316 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:16.350044  5172 consensus_queue.cc:260] T 4efb7f98e10844e7bc2aac9284cbc6ed P 20c10f8bb9404efea93b7709bff70f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:16.353297  5478 consensus_queue.cc:1059] T 4efb7f98e10844e7bc2aac9284cbc6ed P 20c10f8bb9404efea93b7709bff70f8f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 13:13:16.354379  5247 leader_election.cc:290] T f1e891d4721f42eca4e337499ecdede2 P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 2 election: Requested vote from peers 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789), 00e3ba273af645d881fe92b48b615951 (127.28.54.67:44205)
I20260709 13:13:16.354249  5170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1e891d4721f42eca4e337499ecdede2" candidate_uuid: "faf57cab004346baae3fe74487d12316" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "20c10f8bb9404efea93b7709bff70f8f"
I20260709 13:13:16.355297  5170 raft_consensus.cc:3060] T f1e891d4721f42eca4e337499ecdede2 P 20c10f8bb9404efea93b7709bff70f8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:16.355307  5320 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1e891d4721f42eca4e337499ecdede2" candidate_uuid: "faf57cab004346baae3fe74487d12316" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "00e3ba273af645d881fe92b48b615951"
I20260709 13:13:16.356060  5320 raft_consensus.cc:3055] T f1e891d4721f42eca4e337499ecdede2 P 00e3ba273af645d881fe92b48b615951 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 13:13:16.356333  5172 raft_consensus.cc:3060] T 4efb7f98e10844e7bc2aac9284cbc6ed P 20c10f8bb9404efea93b7709bff70f8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:16.356369  5320 raft_consensus.cc:740] T f1e891d4721f42eca4e337499ecdede2 P 00e3ba273af645d881fe92b48b615951 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 00e3ba273af645d881fe92b48b615951, State: Running, Role: LEADER
I20260709 13:13:16.357345  5320 consensus_queue.cc:260] T f1e891d4721f42eca4e337499ecdede2 P 00e3ba273af645d881fe92b48b615951 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:16.358580  5320 raft_consensus.cc:3060] T f1e891d4721f42eca4e337499ecdede2 P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:16.358701  5245 raft_consensus.cc:2468] T 4efb7f98e10844e7bc2aac9284cbc6ed P faf57cab004346baae3fe74487d12316 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00e3ba273af645d881fe92b48b615951 in term 2.
I20260709 13:13:16.359939  5284 leader_election.cc:304] T 4efb7f98e10844e7bc2aac9284cbc6ed P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e3ba273af645d881fe92b48b615951, faf57cab004346baae3fe74487d12316; no voters: 
I20260709 13:13:16.360764  5368 raft_consensus.cc:2804] T 4efb7f98e10844e7bc2aac9284cbc6ed P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:16.361186  5368 raft_consensus.cc:697] T 4efb7f98e10844e7bc2aac9284cbc6ed P 00e3ba273af645d881fe92b48b615951 [term 2 LEADER]: Becoming Leader. State: Replica: 00e3ba273af645d881fe92b48b615951, State: Running, Role: LEADER
I20260709 13:13:16.361886  5368 consensus_queue.cc:237] T 4efb7f98e10844e7bc2aac9284cbc6ed P 00e3ba273af645d881fe92b48b615951 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:16.362114  5170 raft_consensus.cc:2468] T f1e891d4721f42eca4e337499ecdede2 P 20c10f8bb9404efea93b7709bff70f8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faf57cab004346baae3fe74487d12316 in term 2.
I20260709 13:13:16.362679  5172 raft_consensus.cc:2468] T 4efb7f98e10844e7bc2aac9284cbc6ed P 20c10f8bb9404efea93b7709bff70f8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00e3ba273af645d881fe92b48b615951 in term 2.
I20260709 13:13:16.363715  5213 leader_election.cc:304] T f1e891d4721f42eca4e337499ecdede2 P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 20c10f8bb9404efea93b7709bff70f8f, faf57cab004346baae3fe74487d12316; no voters: 
I20260709 13:13:16.364511  5479 raft_consensus.cc:2804] T f1e891d4721f42eca4e337499ecdede2 P faf57cab004346baae3fe74487d12316 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 13:13:16.364940  5479 raft_consensus.cc:697] T f1e891d4721f42eca4e337499ecdede2 P faf57cab004346baae3fe74487d12316 [term 2 LEADER]: Becoming Leader. State: Replica: faf57cab004346baae3fe74487d12316, State: Running, Role: LEADER
I20260709 13:13:16.365655  5320 raft_consensus.cc:2468] T f1e891d4721f42eca4e337499ecdede2 P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faf57cab004346baae3fe74487d12316 in term 2.
I20260709 13:13:16.365694  5479 consensus_queue.cc:237] T f1e891d4721f42eca4e337499ecdede2 P faf57cab004346baae3fe74487d12316 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:16.369673  5069 catalog_manager.cc:5697] T 4efb7f98e10844e7bc2aac9284cbc6ed P 00e3ba273af645d881fe92b48b615951 reported cstate change: term changed from 1 to 2, leader changed from 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65) to 00e3ba273af645d881fe92b48b615951 (127.28.54.67). New cstate: current_term: 2 leader_uuid: "00e3ba273af645d881fe92b48b615951" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:16.372769  5068 catalog_manager.cc:5697] T f1e891d4721f42eca4e337499ecdede2 P faf57cab004346baae3fe74487d12316 reported cstate change: term changed from 1 to 2, leader changed from 00e3ba273af645d881fe92b48b615951 (127.28.54.67) to faf57cab004346baae3fe74487d12316 (127.28.54.66). New cstate: current_term: 2 leader_uuid: "faf57cab004346baae3fe74487d12316" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } health_report { overall_health: UNKNOWN } } }
I20260709 13:13:16.591288  5245 raft_consensus.cc:1275] T ae428dc990694b0ba45113e7211e332b P faf57cab004346baae3fe74487d12316 [term 2 FOLLOWER]: Refusing update from remote peer 20c10f8bb9404efea93b7709bff70f8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:16.592602  5517 consensus_queue.cc:1048] T ae428dc990694b0ba45113e7211e332b P 20c10f8bb9404efea93b7709bff70f8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:16.599277  5320 raft_consensus.cc:1275] T ae428dc990694b0ba45113e7211e332b P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Refusing update from remote peer 20c10f8bb9404efea93b7709bff70f8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:16.600797  5478 consensus_queue.cc:1048] T ae428dc990694b0ba45113e7211e332b P 20c10f8bb9404efea93b7709bff70f8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:16.621465  5320 raft_consensus.cc:1275] T d3218bc2bfe94d5f81b06f2fd09c1934 P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Refusing update from remote peer faf57cab004346baae3fe74487d12316: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:16.622505  5319 raft_consensus.cc:1275] T 016eb0d72e0e4e1d843a82e390ce83bc P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Refusing update from remote peer faf57cab004346baae3fe74487d12316: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:16.623008  5486 consensus_queue.cc:1048] T d3218bc2bfe94d5f81b06f2fd09c1934 P faf57cab004346baae3fe74487d12316 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:16.623287  5320 raft_consensus.cc:1275] T dbe4243871d147358837895129c7dd45 P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Refusing update from remote peer 20c10f8bb9404efea93b7709bff70f8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:16.624069  5479 consensus_queue.cc:1048] T 016eb0d72e0e4e1d843a82e390ce83bc P faf57cab004346baae3fe74487d12316 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:16.625888  5478 consensus_queue.cc:1048] T dbe4243871d147358837895129c7dd45 P 20c10f8bb9404efea93b7709bff70f8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:16.638456  5170 raft_consensus.cc:3060] T d3218bc2bfe94d5f81b06f2fd09c1934 P 20c10f8bb9404efea93b7709bff70f8f [term 1 FOLLOWER]: Advancing to term 2
I20260709 13:13:16.644356  5319 raft_consensus.cc:1275] T 965bdbceb0374f3994b3f4efa9482f4b P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Refusing update from remote peer faf57cab004346baae3fe74487d12316: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:16.648818  5531 consensus_queue.cc:1048] T 965bdbceb0374f3994b3f4efa9482f4b P faf57cab004346baae3fe74487d12316 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:16.648964  5247 raft_consensus.cc:1275] T dbe4243871d147358837895129c7dd45 P faf57cab004346baae3fe74487d12316 [term 2 FOLLOWER]: Refusing update from remote peer 20c10f8bb9404efea93b7709bff70f8f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:16.649922  5172 raft_consensus.cc:1275] T 965bdbceb0374f3994b3f4efa9482f4b P 20c10f8bb9404efea93b7709bff70f8f [term 2 FOLLOWER]: Refusing update from remote peer faf57cab004346baae3fe74487d12316: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:16.650635  5478 consensus_queue.cc:1048] T dbe4243871d147358837895129c7dd45 P 20c10f8bb9404efea93b7709bff70f8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:16.652776  5171 raft_consensus.cc:1275] T 016eb0d72e0e4e1d843a82e390ce83bc P 20c10f8bb9404efea93b7709bff70f8f [term 2 FOLLOWER]: Refusing update from remote peer faf57cab004346baae3fe74487d12316: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:16.653627  5170 raft_consensus.cc:1275] T d3218bc2bfe94d5f81b06f2fd09c1934 P 20c10f8bb9404efea93b7709bff70f8f [term 2 FOLLOWER]: Refusing update from remote peer faf57cab004346baae3fe74487d12316: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:16.654527  5486 consensus_queue.cc:1048] T 965bdbceb0374f3994b3f4efa9482f4b P faf57cab004346baae3fe74487d12316 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:16.665802  5486 consensus_queue.cc:1048] T 016eb0d72e0e4e1d843a82e390ce83bc P faf57cab004346baae3fe74487d12316 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 13:13:16.676771  5486 consensus_queue.cc:1048] T d3218bc2bfe94d5f81b06f2fd09c1934 P faf57cab004346baae3fe74487d12316 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 13:13:16.778887  5245 raft_consensus.cc:1275] T 4efb7f98e10844e7bc2aac9284cbc6ed P faf57cab004346baae3fe74487d12316 [term 2 FOLLOWER]: Refusing update from remote peer 00e3ba273af645d881fe92b48b615951: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:16.780088  5493 consensus_queue.cc:1048] T 4efb7f98e10844e7bc2aac9284cbc6ed P 00e3ba273af645d881fe92b48b615951 [LEADER]: Connected to new peer: Peer: permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:16.788637  5170 raft_consensus.cc:1275] T 4efb7f98e10844e7bc2aac9284cbc6ed P 20c10f8bb9404efea93b7709bff70f8f [term 2 FOLLOWER]: Refusing update from remote peer 00e3ba273af645d881fe92b48b615951: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:16.789784  5493 consensus_queue.cc:1048] T 4efb7f98e10844e7bc2aac9284cbc6ed P 00e3ba273af645d881fe92b48b615951 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:16.809549  5320 raft_consensus.cc:1275] T f1e891d4721f42eca4e337499ecdede2 P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Refusing update from remote peer faf57cab004346baae3fe74487d12316: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:16.810629  5531 consensus_queue.cc:1048] T f1e891d4721f42eca4e337499ecdede2 P faf57cab004346baae3fe74487d12316 [LEADER]: Connected to new peer: Peer: permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 13:13:16.817413  5170 raft_consensus.cc:1275] T f1e891d4721f42eca4e337499ecdede2 P 20c10f8bb9404efea93b7709bff70f8f [term 2 FOLLOWER]: Refusing update from remote peer faf57cab004346baae3fe74487d12316: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 13:13:16.818758  5486 consensus_queue.cc:1048] T f1e891d4721f42eca4e337499ecdede2 P faf57cab004346baae3fe74487d12316 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 13:13:18.723511  5193 debug-util.cc:398] Leaking SignalData structure 0x7b08003e6b20 after lost signal to thread 28892
W20260709 13:13:18.724529  5193 debug-util.cc:398] Leaking SignalData structure 0x7b0800134f00 after lost signal to thread 5104
W20260709 13:13:18.725521  5193 debug-util.cc:398] Leaking SignalData structure 0x7b080013db00 after lost signal to thread 5196
W20260709 13:13:18.726464  5193 debug-util.cc:398] Leaking SignalData structure 0x7b080015e200 after lost signal to thread 5271
W20260709 13:13:18.727326  5193 debug-util.cc:398] Leaking SignalData structure 0x7b0800087780 after lost signal to thread 5345
I20260709 13:13:19.047254  5068 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:60294:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 13:13:19.068547  5068 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:60294:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 13:13:19.097498 28889 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 13:13:19.292438  5171 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "619fadedef99424fb02cb2220e11f71d"
dest_uuid: "20c10f8bb9404efea93b7709bff70f8f"
mode: GRACEFUL
new_leader_uuid: "00e3ba273af645d881fe92b48b615951"
 from {username='slave'} at 127.0.0.1:57654
W20260709 13:13:19.292910  5570 log.cc:927] Time spent T dbe4243871d147358837895129c7dd45 P faf57cab004346baae3fe74487d12316: Append to log took a long time: real 0.069s	user 0.002s	sys 0.000s
I20260709 13:13:19.293138  5171 raft_consensus.cc:606] T 619fadedef99424fb02cb2220e11f71d P 20c10f8bb9404efea93b7709bff70f8f [term 2 LEADER]: Received request to transfer leadership to TS 00e3ba273af645d881fe92b48b615951
W20260709 13:13:19.298077  5571 log.cc:927] Time spent T f1e891d4721f42eca4e337499ecdede2 P faf57cab004346baae3fe74487d12316: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
W20260709 13:13:19.305922  5558 log.cc:927] Time spent T 4efb7f98e10844e7bc2aac9284cbc6ed P 00e3ba273af645d881fe92b48b615951: Append to log took a long time: real 0.100s	user 0.002s	sys 0.000s
W20260709 13:13:19.295907  5575 log.cc:927] Time spent T dbe4243871d147358837895129c7dd45 P 00e3ba273af645d881fe92b48b615951: Append to log took a long time: real 0.090s	user 0.003s	sys 0.000s
I20260709 13:13:19.316740  5587 tablet.cc:1724] T ae428dc990694b0ba45113e7211e332b P 20c10f8bb9404efea93b7709bff70f8f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:19.323676  5593 tablet.cc:1724] T 016eb0d72e0e4e1d843a82e390ce83bc P 20c10f8bb9404efea93b7709bff70f8f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:19.326118  5572 raft_consensus.cc:993] T 619fadedef99424fb02cb2220e11f71d P 20c10f8bb9404efea93b7709bff70f8f: : Instructing follower 00e3ba273af645d881fe92b48b615951 to start an election
I20260709 13:13:19.326786  5572 raft_consensus.cc:1081] T 619fadedef99424fb02cb2220e11f71d P 20c10f8bb9404efea93b7709bff70f8f [term 2 LEADER]: Signalling peer 00e3ba273af645d881fe92b48b615951 to start an election
W20260709 13:13:19.331697  5585 log.cc:927] Time spent T 4efb7f98e10844e7bc2aac9284cbc6ed P 20c10f8bb9404efea93b7709bff70f8f: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 13:13:19.376084  5321 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "619fadedef99424fb02cb2220e11f71d"
dest_uuid: "00e3ba273af645d881fe92b48b615951"
 from {username='slave'} at 127.0.0.1:51914
I20260709 13:13:19.376844  5321 raft_consensus.cc:493] T 619fadedef99424fb02cb2220e11f71d P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:19.377310  5321 raft_consensus.cc:3060] T 619fadedef99424fb02cb2220e11f71d P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:19.393656  5599 tablet.cc:1724] T 016eb0d72e0e4e1d843a82e390ce83bc P 00e3ba273af645d881fe92b48b615951: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:19.408252  5600 tablet.cc:1724] T ae428dc990694b0ba45113e7211e332b P faf57cab004346baae3fe74487d12316: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:19.398365  5601 tablet.cc:1724] T 016eb0d72e0e4e1d843a82e390ce83bc P faf57cab004346baae3fe74487d12316: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:19.416651  5603 tablet.cc:1724] T 965bdbceb0374f3994b3f4efa9482f4b P faf57cab004346baae3fe74487d12316: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:19.423772  5593 tablet.cc:1724] T 965bdbceb0374f3994b3f4efa9482f4b P 20c10f8bb9404efea93b7709bff70f8f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:19.427645  5602 tablet.cc:1724] T dbe4243871d147358837895129c7dd45 P 20c10f8bb9404efea93b7709bff70f8f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:19.434528  5321 raft_consensus.cc:515] T 619fadedef99424fb02cb2220e11f71d P 00e3ba273af645d881fe92b48b615951 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:19.454828  5321 leader_election.cc:290] T 619fadedef99424fb02cb2220e11f71d P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 3 election: Requested vote from peers 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789), faf57cab004346baae3fe74487d12316 (127.28.54.66:33871)
I20260709 13:13:19.456344  5610 tablet.cc:1724] T 01fd91b8fb9049d181045604bba46353 P 20c10f8bb9404efea93b7709bff70f8f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:19.456507  5609 tablet.cc:1724] T d3218bc2bfe94d5f81b06f2fd09c1934 P faf57cab004346baae3fe74487d12316: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:19.458866  5170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fadedef99424fb02cb2220e11f71d" candidate_uuid: "00e3ba273af645d881fe92b48b615951" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "20c10f8bb9404efea93b7709bff70f8f"
I20260709 13:13:19.458498  5608 tablet.cc:1724] T ae428dc990694b0ba45113e7211e332b P 00e3ba273af645d881fe92b48b615951: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:19.459458  5170 raft_consensus.cc:3055] T 619fadedef99424fb02cb2220e11f71d P 20c10f8bb9404efea93b7709bff70f8f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:19.459877  5170 raft_consensus.cc:740] T 619fadedef99424fb02cb2220e11f71d P 20c10f8bb9404efea93b7709bff70f8f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 20c10f8bb9404efea93b7709bff70f8f, State: Running, Role: LEADER
I20260709 13:13:19.460705  5170 consensus_queue.cc:260] T 619fadedef99424fb02cb2220e11f71d P 20c10f8bb9404efea93b7709bff70f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:19.462383  5611 tablet.cc:1724] T 4efb7f98e10844e7bc2aac9284cbc6ed P 00e3ba273af645d881fe92b48b615951: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 13:13:19.449595  5138 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:44205, user_credentials={real_user=slave}} blocked reactor thread for 70571.2us
I20260709 13:13:19.470379  5593 tablet.cc:1724] T 4efb7f98e10844e7bc2aac9284cbc6ed P 20c10f8bb9404efea93b7709bff70f8f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:19.475006  5602 tablet.cc:1724] T b0a40b61c1b744e399aa024aac76f1f9 P 20c10f8bb9404efea93b7709bff70f8f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:19.479576  5170 raft_consensus.cc:3060] T 619fadedef99424fb02cb2220e11f71d P 20c10f8bb9404efea93b7709bff70f8f [term 2 FOLLOWER]: Advancing to term 3
W20260709 13:13:19.495705  5213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.28.54.67:44205, user_credentials={real_user=slave}} blocked reactor thread for 100876us
I20260709 13:13:19.504892  5587 tablet.cc:1724] T f1e891d4721f42eca4e337499ecdede2 P 20c10f8bb9404efea93b7709bff70f8f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:19.508083  5600 tablet.cc:1724] T f1e891d4721f42eca4e337499ecdede2 P faf57cab004346baae3fe74487d12316: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:19.526297  5244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "619fadedef99424fb02cb2220e11f71d" candidate_uuid: "00e3ba273af645d881fe92b48b615951" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "faf57cab004346baae3fe74487d12316"
I20260709 13:13:19.526964  5244 raft_consensus.cc:3060] T 619fadedef99424fb02cb2220e11f71d P faf57cab004346baae3fe74487d12316 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:19.527565  5587 tablet.cc:1724] T d3218bc2bfe94d5f81b06f2fd09c1934 P 20c10f8bb9404efea93b7709bff70f8f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:19.515501  5611 tablet.cc:1724] T d3218bc2bfe94d5f81b06f2fd09c1934 P 00e3ba273af645d881fe92b48b615951: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:19.547120  5244 raft_consensus.cc:2468] T 619fadedef99424fb02cb2220e11f71d P faf57cab004346baae3fe74487d12316 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00e3ba273af645d881fe92b48b615951 in term 3.
I20260709 13:13:19.549582  5170 raft_consensus.cc:2468] T 619fadedef99424fb02cb2220e11f71d P 20c10f8bb9404efea93b7709bff70f8f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00e3ba273af645d881fe92b48b615951 in term 3.
I20260709 13:13:19.551023  5287 leader_election.cc:304] T 619fadedef99424fb02cb2220e11f71d P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e3ba273af645d881fe92b48b615951, 20c10f8bb9404efea93b7709bff70f8f; no voters: 
I20260709 13:13:19.551819  5603 tablet.cc:1724] T 4efb7f98e10844e7bc2aac9284cbc6ed P faf57cab004346baae3fe74487d12316: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:19.552866  5582 raft_consensus.cc:2804] T 619fadedef99424fb02cb2220e11f71d P 00e3ba273af645d881fe92b48b615951 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:19.553465  5582 raft_consensus.cc:697] T 619fadedef99424fb02cb2220e11f71d P 00e3ba273af645d881fe92b48b615951 [term 3 LEADER]: Becoming Leader. State: Replica: 00e3ba273af645d881fe92b48b615951, State: Running, Role: LEADER
I20260709 13:13:19.554404  5582 consensus_queue.cc:237] T 619fadedef99424fb02cb2220e11f71d P 00e3ba273af645d881fe92b48b615951 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:19.563244  5608 tablet.cc:1724] T 01fd91b8fb9049d181045604bba46353 P 00e3ba273af645d881fe92b48b615951: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:19.590374  5600 tablet.cc:1724] T dbe4243871d147358837895129c7dd45 P faf57cab004346baae3fe74487d12316: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:19.590680  5612 tablet.cc:1724] T dbe4243871d147358837895129c7dd45 P 00e3ba273af645d881fe92b48b615951: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:19.594265  5244 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "85f195d86c444318a3b33ec5c008e238"
dest_uuid: "faf57cab004346baae3fe74487d12316"
mode: GRACEFUL
new_leader_uuid: "00e3ba273af645d881fe92b48b615951"
 from {username='slave'} at 127.0.0.1:38298
I20260709 13:13:19.595511  5244 raft_consensus.cc:606] T 85f195d86c444318a3b33ec5c008e238 P faf57cab004346baae3fe74487d12316 [term 2 LEADER]: Received request to transfer leadership to TS 00e3ba273af645d881fe92b48b615951
I20260709 13:13:19.596801  5069 catalog_manager.cc:5697] T 619fadedef99424fb02cb2220e11f71d P 00e3ba273af645d881fe92b48b615951 reported cstate change: term changed from 2 to 3, leader changed from 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65) to 00e3ba273af645d881fe92b48b615951 (127.28.54.67). New cstate: current_term: 3 leader_uuid: "00e3ba273af645d881fe92b48b615951" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:19.597134  5601 tablet.cc:1724] T 01fd91b8fb9049d181045604bba46353 P faf57cab004346baae3fe74487d12316: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:19.590379  5599 tablet.cc:1724] T b0a40b61c1b744e399aa024aac76f1f9 P 00e3ba273af645d881fe92b48b615951: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:19.601202 28889 auto_leader_rebalancer.cc:452] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 13:13:19.601994 28889 auto_leader_rebalancer.cc:527] All tables' leader rebalancing finished this round
I20260709 13:13:19.602782  5608 tablet.cc:1724] T 965bdbceb0374f3994b3f4efa9482f4b P 00e3ba273af645d881fe92b48b615951: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:19.605337  5611 tablet.cc:1724] T f1e891d4721f42eca4e337499ecdede2 P 00e3ba273af645d881fe92b48b615951: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:19.607738  5609 tablet.cc:1724] T b0a40b61c1b744e399aa024aac76f1f9 P faf57cab004346baae3fe74487d12316: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 13:13:19.612912  5588 raft_consensus.cc:993] T 85f195d86c444318a3b33ec5c008e238 P faf57cab004346baae3fe74487d12316: : Instructing follower 00e3ba273af645d881fe92b48b615951 to start an election
I20260709 13:13:19.613438  5588 raft_consensus.cc:1081] T 85f195d86c444318a3b33ec5c008e238 P faf57cab004346baae3fe74487d12316 [term 2 LEADER]: Signalling peer 00e3ba273af645d881fe92b48b615951 to start an election
I20260709 13:13:19.624858  5318 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "85f195d86c444318a3b33ec5c008e238"
dest_uuid: "00e3ba273af645d881fe92b48b615951"
 from {username='slave'} at 127.0.0.1:51926
I20260709 13:13:19.625365  5318 raft_consensus.cc:493] T 85f195d86c444318a3b33ec5c008e238 P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 13:13:19.625653  5318 raft_consensus.cc:3060] T 85f195d86c444318a3b33ec5c008e238 P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:19.632242  5318 raft_consensus.cc:515] T 85f195d86c444318a3b33ec5c008e238 P 00e3ba273af645d881fe92b48b615951 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:19.634508  5318 leader_election.cc:290] T 85f195d86c444318a3b33ec5c008e238 P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 3 election: Requested vote from peers 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789), faf57cab004346baae3fe74487d12316 (127.28.54.66:33871)
I20260709 13:13:19.635303  5170 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85f195d86c444318a3b33ec5c008e238" candidate_uuid: "00e3ba273af645d881fe92b48b615951" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "20c10f8bb9404efea93b7709bff70f8f"
I20260709 13:13:19.635638  5244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "85f195d86c444318a3b33ec5c008e238" candidate_uuid: "00e3ba273af645d881fe92b48b615951" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "faf57cab004346baae3fe74487d12316"
I20260709 13:13:19.636027  5170 raft_consensus.cc:3060] T 85f195d86c444318a3b33ec5c008e238 P 20c10f8bb9404efea93b7709bff70f8f [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:19.636261  5244 raft_consensus.cc:3055] T 85f195d86c444318a3b33ec5c008e238 P faf57cab004346baae3fe74487d12316 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 13:13:19.636612  5244 raft_consensus.cc:740] T 85f195d86c444318a3b33ec5c008e238 P faf57cab004346baae3fe74487d12316 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: faf57cab004346baae3fe74487d12316, State: Running, Role: LEADER
I20260709 13:13:19.637465  5244 consensus_queue.cc:260] T 85f195d86c444318a3b33ec5c008e238 P faf57cab004346baae3fe74487d12316 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:19.638821  5244 raft_consensus.cc:3060] T 85f195d86c444318a3b33ec5c008e238 P faf57cab004346baae3fe74487d12316 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:19.645328  5170 raft_consensus.cc:2468] T 85f195d86c444318a3b33ec5c008e238 P 20c10f8bb9404efea93b7709bff70f8f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00e3ba273af645d881fe92b48b615951 in term 3.
I20260709 13:13:19.645613  5244 raft_consensus.cc:2468] T 85f195d86c444318a3b33ec5c008e238 P faf57cab004346baae3fe74487d12316 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 00e3ba273af645d881fe92b48b615951 in term 3.
I20260709 13:13:19.646654  5287 leader_election.cc:304] T 85f195d86c444318a3b33ec5c008e238 P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e3ba273af645d881fe92b48b615951, 20c10f8bb9404efea93b7709bff70f8f; no voters: 
I20260709 13:13:19.647940  5582 raft_consensus.cc:2804] T 85f195d86c444318a3b33ec5c008e238 P 00e3ba273af645d881fe92b48b615951 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:19.648582  5582 raft_consensus.cc:697] T 85f195d86c444318a3b33ec5c008e238 P 00e3ba273af645d881fe92b48b615951 [term 3 LEADER]: Becoming Leader. State: Replica: 00e3ba273af645d881fe92b48b615951, State: Running, Role: LEADER
I20260709 13:13:19.649442  5582 consensus_queue.cc:237] T 85f195d86c444318a3b33ec5c008e238 P 00e3ba273af645d881fe92b48b615951 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:19.659121  5070 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 5c6ac1e6dd6f4564b1a2b2385ff3355c: soft_deleted_table [id=be73afa613c44ef293a74c93e838ab6b] alter complete (version 1)
I20260709 13:13:19.674881  5070 catalog_manager.cc:5697] T 85f195d86c444318a3b33ec5c008e238 P 00e3ba273af645d881fe92b48b615951 reported cstate change: term changed from 2 to 3, leader changed from faf57cab004346baae3fe74487d12316 (127.28.54.66) to 00e3ba273af645d881fe92b48b615951 (127.28.54.67). New cstate: current_term: 3 leader_uuid: "00e3ba273af645d881fe92b48b615951" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } health_report { overall_health: HEALTHY } } }
I20260709 13:13:20.048765  5244 raft_consensus.cc:1275] T 85f195d86c444318a3b33ec5c008e238 P faf57cab004346baae3fe74487d12316 [term 3 FOLLOWER]: Refusing update from remote peer 00e3ba273af645d881fe92b48b615951: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:20.049911  5582 consensus_queue.cc:1048] T 85f195d86c444318a3b33ec5c008e238 P 00e3ba273af645d881fe92b48b615951 [LEADER]: Connected to new peer: Peer: permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:20.064757  5167 raft_consensus.cc:1275] T 619fadedef99424fb02cb2220e11f71d P 20c10f8bb9404efea93b7709bff70f8f [term 3 FOLLOWER]: Refusing update from remote peer 00e3ba273af645d881fe92b48b615951: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:20.069069  5620 consensus_queue.cc:1048] T 619fadedef99424fb02cb2220e11f71d P 00e3ba273af645d881fe92b48b615951 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 13:13:20.074373  5246 raft_consensus.cc:1275] T 619fadedef99424fb02cb2220e11f71d P faf57cab004346baae3fe74487d12316 [term 3 FOLLOWER]: Refusing update from remote peer 00e3ba273af645d881fe92b48b615951: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:20.079493  5493 consensus_queue.cc:1048] T 619fadedef99424fb02cb2220e11f71d P 00e3ba273af645d881fe92b48b615951 [LEADER]: Connected to new peer: Peer: permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:20.091467  5170 raft_consensus.cc:1275] T 85f195d86c444318a3b33ec5c008e238 P 20c10f8bb9404efea93b7709bff70f8f [term 3 FOLLOWER]: Refusing update from remote peer 00e3ba273af645d881fe92b48b615951: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 13:13:20.095057  5493 consensus_queue.cc:1048] T 85f195d86c444318a3b33ec5c008e238 P 00e3ba273af645d881fe92b48b615951 [LEADER]: Connected to new peer: Peer: permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 13:13:20.658739 28889 tablet_server.cc:179] TabletServer@127.28.54.65:0 shutting down...
I20260709 13:13:20.686676 28889 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:20.687440 28889 tablet_replica.cc:333] T f1e891d4721f42eca4e337499ecdede2 P 20c10f8bb9404efea93b7709bff70f8f: stopping tablet replica
I20260709 13:13:20.688390 28889 raft_consensus.cc:2243] T f1e891d4721f42eca4e337499ecdede2 P 20c10f8bb9404efea93b7709bff70f8f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:20.688969 28889 raft_consensus.cc:2272] T f1e891d4721f42eca4e337499ecdede2 P 20c10f8bb9404efea93b7709bff70f8f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.690810 28889 tablet_replica.cc:333] T 016eb0d72e0e4e1d843a82e390ce83bc P 20c10f8bb9404efea93b7709bff70f8f: stopping tablet replica
I20260709 13:13:20.691313 28889 raft_consensus.cc:2243] T 016eb0d72e0e4e1d843a82e390ce83bc P 20c10f8bb9404efea93b7709bff70f8f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:20.691696 28889 raft_consensus.cc:2272] T 016eb0d72e0e4e1d843a82e390ce83bc P 20c10f8bb9404efea93b7709bff70f8f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.693374 28889 tablet_replica.cc:333] T b0a40b61c1b744e399aa024aac76f1f9 P 20c10f8bb9404efea93b7709bff70f8f: stopping tablet replica
I20260709 13:13:20.694013 28889 raft_consensus.cc:2243] T b0a40b61c1b744e399aa024aac76f1f9 P 20c10f8bb9404efea93b7709bff70f8f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:20.694723 28889 raft_consensus.cc:2272] T b0a40b61c1b744e399aa024aac76f1f9 P 20c10f8bb9404efea93b7709bff70f8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.696830 28889 tablet_replica.cc:333] T dbe4243871d147358837895129c7dd45 P 20c10f8bb9404efea93b7709bff70f8f: stopping tablet replica
I20260709 13:13:20.697371 28889 raft_consensus.cc:2243] T dbe4243871d147358837895129c7dd45 P 20c10f8bb9404efea93b7709bff70f8f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:20.698115 28889 raft_consensus.cc:2272] T dbe4243871d147358837895129c7dd45 P 20c10f8bb9404efea93b7709bff70f8f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.699950 28889 tablet_replica.cc:333] T 02b61ce2481342a58d8418df35ed4fdd P 20c10f8bb9404efea93b7709bff70f8f: stopping tablet replica
I20260709 13:13:20.700440 28889 raft_consensus.cc:2243] T 02b61ce2481342a58d8418df35ed4fdd P 20c10f8bb9404efea93b7709bff70f8f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:20.701181 28889 raft_consensus.cc:2272] T 02b61ce2481342a58d8418df35ed4fdd P 20c10f8bb9404efea93b7709bff70f8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.703305 28889 tablet_replica.cc:333] T a4a20c8585a445b78ff71276699f1693 P 20c10f8bb9404efea93b7709bff70f8f: stopping tablet replica
I20260709 13:13:20.703902 28889 raft_consensus.cc:2243] T a4a20c8585a445b78ff71276699f1693 P 20c10f8bb9404efea93b7709bff70f8f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:20.704384 28889 raft_consensus.cc:2272] T a4a20c8585a445b78ff71276699f1693 P 20c10f8bb9404efea93b7709bff70f8f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.706553 28889 tablet_replica.cc:333] T 01fd91b8fb9049d181045604bba46353 P 20c10f8bb9404efea93b7709bff70f8f: stopping tablet replica
I20260709 13:13:20.707072 28889 raft_consensus.cc:2243] T 01fd91b8fb9049d181045604bba46353 P 20c10f8bb9404efea93b7709bff70f8f [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:20.707715 28889 raft_consensus.cc:2272] T 01fd91b8fb9049d181045604bba46353 P 20c10f8bb9404efea93b7709bff70f8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.709515 28889 tablet_replica.cc:333] T fbb576f6df1d4ea899f4e15ca176a28b P 20c10f8bb9404efea93b7709bff70f8f: stopping tablet replica
I20260709 13:13:20.710080 28889 raft_consensus.cc:2243] T fbb576f6df1d4ea899f4e15ca176a28b P 20c10f8bb9404efea93b7709bff70f8f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:20.710477 28889 raft_consensus.cc:2272] T fbb576f6df1d4ea899f4e15ca176a28b P 20c10f8bb9404efea93b7709bff70f8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.712410 28889 tablet_replica.cc:333] T 33f2bd13db554c9397573a6c81ceb5d1 P 20c10f8bb9404efea93b7709bff70f8f: stopping tablet replica
I20260709 13:13:20.712896 28889 raft_consensus.cc:2243] T 33f2bd13db554c9397573a6c81ceb5d1 P 20c10f8bb9404efea93b7709bff70f8f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:20.713642 28889 raft_consensus.cc:2272] T 33f2bd13db554c9397573a6c81ceb5d1 P 20c10f8bb9404efea93b7709bff70f8f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.715777 28889 tablet_replica.cc:333] T d3218bc2bfe94d5f81b06f2fd09c1934 P 20c10f8bb9404efea93b7709bff70f8f: stopping tablet replica
I20260709 13:13:20.716267 28889 raft_consensus.cc:2243] T d3218bc2bfe94d5f81b06f2fd09c1934 P 20c10f8bb9404efea93b7709bff70f8f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:20.716661 28889 raft_consensus.cc:2272] T d3218bc2bfe94d5f81b06f2fd09c1934 P 20c10f8bb9404efea93b7709bff70f8f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.718329 28889 tablet_replica.cc:333] T c56044a4794e4299af4ee1d462580192 P 20c10f8bb9404efea93b7709bff70f8f: stopping tablet replica
I20260709 13:13:20.718825 28889 raft_consensus.cc:2243] T c56044a4794e4299af4ee1d462580192 P 20c10f8bb9404efea93b7709bff70f8f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:20.719522 28889 raft_consensus.cc:2272] T c56044a4794e4299af4ee1d462580192 P 20c10f8bb9404efea93b7709bff70f8f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.721460 28889 tablet_replica.cc:333] T 965bdbceb0374f3994b3f4efa9482f4b P 20c10f8bb9404efea93b7709bff70f8f: stopping tablet replica
I20260709 13:13:20.721961 28889 raft_consensus.cc:2243] T 965bdbceb0374f3994b3f4efa9482f4b P 20c10f8bb9404efea93b7709bff70f8f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:20.722340 28889 raft_consensus.cc:2272] T 965bdbceb0374f3994b3f4efa9482f4b P 20c10f8bb9404efea93b7709bff70f8f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.723904 28889 tablet_replica.cc:333] T 35090704c57b43d494666e056fade162 P 20c10f8bb9404efea93b7709bff70f8f: stopping tablet replica
I20260709 13:13:20.724380 28889 raft_consensus.cc:2243] T 35090704c57b43d494666e056fade162 P 20c10f8bb9404efea93b7709bff70f8f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:20.724800 28889 raft_consensus.cc:2272] T 35090704c57b43d494666e056fade162 P 20c10f8bb9404efea93b7709bff70f8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.726938 28889 tablet_replica.cc:333] T 4efb7f98e10844e7bc2aac9284cbc6ed P 20c10f8bb9404efea93b7709bff70f8f: stopping tablet replica
I20260709 13:13:20.727392 28889 raft_consensus.cc:2243] T 4efb7f98e10844e7bc2aac9284cbc6ed P 20c10f8bb9404efea93b7709bff70f8f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:20.727831 28889 raft_consensus.cc:2272] T 4efb7f98e10844e7bc2aac9284cbc6ed P 20c10f8bb9404efea93b7709bff70f8f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.729394 28889 tablet_replica.cc:333] T 619fadedef99424fb02cb2220e11f71d P 20c10f8bb9404efea93b7709bff70f8f: stopping tablet replica
I20260709 13:13:20.729955 28889 raft_consensus.cc:2243] T 619fadedef99424fb02cb2220e11f71d P 20c10f8bb9404efea93b7709bff70f8f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:20.730315 28889 raft_consensus.cc:2272] T 619fadedef99424fb02cb2220e11f71d P 20c10f8bb9404efea93b7709bff70f8f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.733877 28889 tablet_replica.cc:333] T ae428dc990694b0ba45113e7211e332b P 20c10f8bb9404efea93b7709bff70f8f: stopping tablet replica
I20260709 13:13:20.734632 28889 raft_consensus.cc:2243] T ae428dc990694b0ba45113e7211e332b P 20c10f8bb9404efea93b7709bff70f8f [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:20.735561 28889 raft_consensus.cc:2272] T ae428dc990694b0ba45113e7211e332b P 20c10f8bb9404efea93b7709bff70f8f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.737995 28889 tablet_replica.cc:333] T 85f195d86c444318a3b33ec5c008e238 P 20c10f8bb9404efea93b7709bff70f8f: stopping tablet replica
I20260709 13:13:20.738608 28889 raft_consensus.cc:2243] T 85f195d86c444318a3b33ec5c008e238 P 20c10f8bb9404efea93b7709bff70f8f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:20.739127 28889 raft_consensus.cc:2272] T 85f195d86c444318a3b33ec5c008e238 P 20c10f8bb9404efea93b7709bff70f8f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:20.741986 28889 tablet_replica.cc:333] T c45195d3728449a1813e1bbe3ce5a981 P 20c10f8bb9404efea93b7709bff70f8f: stopping tablet replica
I20260709 13:13:20.742601 28889 raft_consensus.cc:2243] T c45195d3728449a1813e1bbe3ce5a981 P 20c10f8bb9404efea93b7709bff70f8f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:20.743095 28889 raft_consensus.cc:2272] T c45195d3728449a1813e1bbe3ce5a981 P 20c10f8bb9404efea93b7709bff70f8f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:20.812796  5287 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36789: connect: Connection refused (error 111) [suppressed 11 similar messages]
W20260709 13:13:20.816107  5287 consensus_peers.cc:597] T c45195d3728449a1813e1bbe3ce5a981 P 00e3ba273af645d881fe92b48b615951 -> Peer 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789): Couldn't send request to peer 20c10f8bb9404efea93b7709bff70f8f. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36789: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:20.821115  5213 consensus_peers.cc:597] T 965bdbceb0374f3994b3f4efa9482f4b P faf57cab004346baae3fe74487d12316 -> Peer 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789): Couldn't send request to peer 20c10f8bb9404efea93b7709bff70f8f. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36789: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:20.835318  5213 consensus_peers.cc:597] T a4a20c8585a445b78ff71276699f1693 P faf57cab004346baae3fe74487d12316 -> Peer 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789): Couldn't send request to peer 20c10f8bb9404efea93b7709bff70f8f. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36789: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:20.860989  5213 consensus_peers.cc:597] T 35090704c57b43d494666e056fade162 P faf57cab004346baae3fe74487d12316 -> Peer 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789): Couldn't send request to peer 20c10f8bb9404efea93b7709bff70f8f. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36789: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:20.863611  5213 consensus_peers.cc:597] T 016eb0d72e0e4e1d843a82e390ce83bc P faf57cab004346baae3fe74487d12316 -> Peer 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789): Couldn't send request to peer 20c10f8bb9404efea93b7709bff70f8f. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36789: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:20.874610  5213 consensus_peers.cc:597] T fbb576f6df1d4ea899f4e15ca176a28b P faf57cab004346baae3fe74487d12316 -> Peer 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789): Couldn't send request to peer 20c10f8bb9404efea93b7709bff70f8f. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36789: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:20.879300  5287 consensus_peers.cc:597] T 4efb7f98e10844e7bc2aac9284cbc6ed P 00e3ba273af645d881fe92b48b615951 -> Peer 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789): Couldn't send request to peer 20c10f8bb9404efea93b7709bff70f8f. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36789: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:20.898310  5213 consensus_peers.cc:597] T f1e891d4721f42eca4e337499ecdede2 P faf57cab004346baae3fe74487d12316 -> Peer 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789): Couldn't send request to peer 20c10f8bb9404efea93b7709bff70f8f. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36789: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:20.927332  5213 consensus_peers.cc:597] T d3218bc2bfe94d5f81b06f2fd09c1934 P faf57cab004346baae3fe74487d12316 -> Peer 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789): Couldn't send request to peer 20c10f8bb9404efea93b7709bff70f8f. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36789: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:20.948828  5287 consensus_peers.cc:597] T 619fadedef99424fb02cb2220e11f71d P 00e3ba273af645d881fe92b48b615951 -> Peer 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789): Couldn't send request to peer 20c10f8bb9404efea93b7709bff70f8f. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36789: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:21.089445  5287 consensus_peers.cc:597] T 85f195d86c444318a3b33ec5c008e238 P 00e3ba273af645d881fe92b48b615951 -> Peer 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789): Couldn't send request to peer 20c10f8bb9404efea93b7709bff70f8f. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.65:36789: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 13:13:21.773702 28889 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 5193)
I20260709 13:13:21.791085  5635 raft_consensus.cc:493] T 02b61ce2481342a58d8418df35ed4fdd P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c10f8bb9404efea93b7709bff70f8f)
I20260709 13:13:21.791726  5635 raft_consensus.cc:515] T 02b61ce2481342a58d8418df35ed4fdd P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } }
I20260709 13:13:21.793893  5635 leader_election.cc:290] T 02b61ce2481342a58d8418df35ed4fdd P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 00e3ba273af645d881fe92b48b615951 (127.28.54.67:44205), 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789)
I20260709 13:13:21.794760  5318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02b61ce2481342a58d8418df35ed4fdd" candidate_uuid: "faf57cab004346baae3fe74487d12316" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "00e3ba273af645d881fe92b48b615951" is_pre_election: true
W20260709 13:13:21.799060  5213 leader_election.cc:336] T 02b61ce2481342a58d8418df35ed4fdd P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789): Network error: Client connection negotiation failed: client connection to 127.28.54.65:36789: connect: Connection refused (error 111)
I20260709 13:13:21.799747  5213 leader_election.cc:304] T 02b61ce2481342a58d8418df35ed4fdd P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: faf57cab004346baae3fe74487d12316; no voters: 00e3ba273af645d881fe92b48b615951, 20c10f8bb9404efea93b7709bff70f8f
I20260709 13:13:21.800455  5635 raft_consensus.cc:2749] T 02b61ce2481342a58d8418df35ed4fdd P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:21.831730  5636 raft_consensus.cc:493] T 33f2bd13db554c9397573a6c81ceb5d1 P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20c10f8bb9404efea93b7709bff70f8f)
I20260709 13:13:21.832337  5636 raft_consensus.cc:515] T 33f2bd13db554c9397573a6c81ceb5d1 P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:21.834390  5636 leader_election.cc:290] T 33f2bd13db554c9397573a6c81ceb5d1 P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789), faf57cab004346baae3fe74487d12316 (127.28.54.66:33871)
I20260709 13:13:21.835466  5244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f2bd13db554c9397573a6c81ceb5d1" candidate_uuid: "00e3ba273af645d881fe92b48b615951" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "faf57cab004346baae3fe74487d12316" is_pre_election: true
I20260709 13:13:21.837415 28889 tablet_server.cc:196] TabletServer@127.28.54.65:0 shutdown complete.
W20260709 13:13:21.837708  5287 leader_election.cc:336] T 33f2bd13db554c9397573a6c81ceb5d1 P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789): Network error: Client connection negotiation failed: client connection to 127.28.54.65:36789: connect: Connection refused (error 111)
I20260709 13:13:21.838169  5287 leader_election.cc:304] T 33f2bd13db554c9397573a6c81ceb5d1 P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00e3ba273af645d881fe92b48b615951; no voters: 20c10f8bb9404efea93b7709bff70f8f, faf57cab004346baae3fe74487d12316
I20260709 13:13:21.838742  5636 raft_consensus.cc:2749] T 33f2bd13db554c9397573a6c81ceb5d1 P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:21.844372  5636 raft_consensus.cc:493] T dbe4243871d147358837895129c7dd45 P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20c10f8bb9404efea93b7709bff70f8f)
I20260709 13:13:21.844741  5636 raft_consensus.cc:515] T dbe4243871d147358837895129c7dd45 P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:21.847689  5244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbe4243871d147358837895129c7dd45" candidate_uuid: "00e3ba273af645d881fe92b48b615951" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "faf57cab004346baae3fe74487d12316" is_pre_election: true
I20260709 13:13:21.849977  5636 leader_election.cc:290] T dbe4243871d147358837895129c7dd45 P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789), faf57cab004346baae3fe74487d12316 (127.28.54.66:33871)
W20260709 13:13:21.850595  5287 leader_election.cc:336] T dbe4243871d147358837895129c7dd45 P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789): Network error: Client connection negotiation failed: client connection to 127.28.54.65:36789: connect: Connection refused (error 111)
I20260709 13:13:21.851164  5287 leader_election.cc:304] T dbe4243871d147358837895129c7dd45 P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00e3ba273af645d881fe92b48b615951; no voters: 20c10f8bb9404efea93b7709bff70f8f, faf57cab004346baae3fe74487d12316
I20260709 13:13:21.851852  5636 raft_consensus.cc:2749] T dbe4243871d147358837895129c7dd45 P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 13:13:21.858534  5636 raft_consensus.cc:493] T b0a40b61c1b744e399aa024aac76f1f9 P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c10f8bb9404efea93b7709bff70f8f)
I20260709 13:13:21.858951  5636 raft_consensus.cc:515] T b0a40b61c1b744e399aa024aac76f1f9 P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:21.860659  5636 leader_election.cc:290] T b0a40b61c1b744e399aa024aac76f1f9 P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789), faf57cab004346baae3fe74487d12316 (127.28.54.66:33871)
I20260709 13:13:21.861625  5244 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b0a40b61c1b744e399aa024aac76f1f9" candidate_uuid: "00e3ba273af645d881fe92b48b615951" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "faf57cab004346baae3fe74487d12316" is_pre_election: true
W20260709 13:13:21.865032  5287 leader_election.cc:336] T b0a40b61c1b744e399aa024aac76f1f9 P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789): Network error: Client connection negotiation failed: client connection to 127.28.54.65:36789: connect: Connection refused (error 111)
I20260709 13:13:21.865520  5287 leader_election.cc:304] T b0a40b61c1b744e399aa024aac76f1f9 P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00e3ba273af645d881fe92b48b615951; no voters: 20c10f8bb9404efea93b7709bff70f8f, faf57cab004346baae3fe74487d12316
I20260709 13:13:21.866319  5636 raft_consensus.cc:2749] T b0a40b61c1b744e399aa024aac76f1f9 P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:21.875348 28889 tablet_server.cc:179] TabletServer@127.28.54.66:0 shutting down...
I20260709 13:13:21.888233  5636 raft_consensus.cc:493] T 01fd91b8fb9049d181045604bba46353 P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c10f8bb9404efea93b7709bff70f8f)
I20260709 13:13:21.889247  5636 raft_consensus.cc:515] T 01fd91b8fb9049d181045604bba46353 P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:21.892925  5636 leader_election.cc:290] T 01fd91b8fb9049d181045604bba46353 P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789), faf57cab004346baae3fe74487d12316 (127.28.54.66:33871)
W20260709 13:13:21.896514  5284 leader_election.cc:336] T 01fd91b8fb9049d181045604bba46353 P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer faf57cab004346baae3fe74487d12316 (127.28.54.66:33871): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 13:13:21.899574  5287 leader_election.cc:336] T 01fd91b8fb9049d181045604bba46353 P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789): Network error: Client connection negotiation failed: client connection to 127.28.54.65:36789: connect: Connection refused (error 111)
I20260709 13:13:21.900033  5287 leader_election.cc:304] T 01fd91b8fb9049d181045604bba46353 P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00e3ba273af645d881fe92b48b615951; no voters: 20c10f8bb9404efea93b7709bff70f8f, faf57cab004346baae3fe74487d12316
I20260709 13:13:21.900657  5636 raft_consensus.cc:2749] T 01fd91b8fb9049d181045604bba46353 P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:21.902871 28889 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:21.903731 28889 tablet_replica.cc:333] T b0a40b61c1b744e399aa024aac76f1f9 P faf57cab004346baae3fe74487d12316: stopping tablet replica
I20260709 13:13:21.904510 28889 raft_consensus.cc:2243] T b0a40b61c1b744e399aa024aac76f1f9 P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:21.904848  5637 raft_consensus.cc:493] T 02b61ce2481342a58d8418df35ed4fdd P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 20c10f8bb9404efea93b7709bff70f8f)
I20260709 13:13:21.905179 28889 raft_consensus.cc:2272] T b0a40b61c1b744e399aa024aac76f1f9 P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.905360  5637 raft_consensus.cc:515] T 02b61ce2481342a58d8418df35ed4fdd P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } }
I20260709 13:13:21.907352  5637 leader_election.cc:290] T 02b61ce2481342a58d8418df35ed4fdd P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers faf57cab004346baae3fe74487d12316 (127.28.54.66:33871), 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789)
I20260709 13:13:21.907732 28889 tablet_replica.cc:333] T 01fd91b8fb9049d181045604bba46353 P faf57cab004346baae3fe74487d12316: stopping tablet replica
I20260709 13:13:21.908566 28889 raft_consensus.cc:2243] T 01fd91b8fb9049d181045604bba46353 P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:21.909068 28889 raft_consensus.cc:2272] T 01fd91b8fb9049d181045604bba46353 P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:21.911404  5284 consensus_peers.cc:597] T 85f195d86c444318a3b33ec5c008e238 P 00e3ba273af645d881fe92b48b615951 -> Peer faf57cab004346baae3fe74487d12316 (127.28.54.66:33871): Couldn't send request to peer faf57cab004346baae3fe74487d12316. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:21.911726 28889 tablet_replica.cc:333] T f1e891d4721f42eca4e337499ecdede2 P faf57cab004346baae3fe74487d12316: stopping tablet replica
W20260709 13:13:21.912860  5287 leader_election.cc:336] T 02b61ce2481342a58d8418df35ed4fdd P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789): Network error: Client connection negotiation failed: client connection to 127.28.54.65:36789: connect: Connection refused (error 111)
I20260709 13:13:21.913806 28889 raft_consensus.cc:2243] T f1e891d4721f42eca4e337499ecdede2 P faf57cab004346baae3fe74487d12316 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:13:21.914516  5284 leader_election.cc:336] T 02b61ce2481342a58d8418df35ed4fdd P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer faf57cab004346baae3fe74487d12316 (127.28.54.66:33871): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 13:13:21.914775 28889 raft_consensus.cc:2272] T f1e891d4721f42eca4e337499ecdede2 P faf57cab004346baae3fe74487d12316 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.915022  5284 leader_election.cc:304] T 02b61ce2481342a58d8418df35ed4fdd P 00e3ba273af645d881fe92b48b615951 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 00e3ba273af645d881fe92b48b615951; no voters: 20c10f8bb9404efea93b7709bff70f8f, faf57cab004346baae3fe74487d12316
I20260709 13:13:21.915735  5637 raft_consensus.cc:2749] T 02b61ce2481342a58d8418df35ed4fdd P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 13:13:21.916920 28889 tablet_replica.cc:333] T 016eb0d72e0e4e1d843a82e390ce83bc P faf57cab004346baae3fe74487d12316: stopping tablet replica
I20260709 13:13:21.917487 28889 raft_consensus.cc:2243] T 016eb0d72e0e4e1d843a82e390ce83bc P faf57cab004346baae3fe74487d12316 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:21.918182 28889 raft_consensus.cc:2272] T 016eb0d72e0e4e1d843a82e390ce83bc P faf57cab004346baae3fe74487d12316 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.919936 28889 tablet_replica.cc:333] T dbe4243871d147358837895129c7dd45 P faf57cab004346baae3fe74487d12316: stopping tablet replica
I20260709 13:13:21.920457 28889 raft_consensus.cc:2243] T dbe4243871d147358837895129c7dd45 P faf57cab004346baae3fe74487d12316 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:21.920840 28889 raft_consensus.cc:2272] T dbe4243871d147358837895129c7dd45 P faf57cab004346baae3fe74487d12316 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.921263  5635 raft_consensus.cc:493] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 20c10f8bb9404efea93b7709bff70f8f)
I20260709 13:13:21.921622  5635 raft_consensus.cc:515] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:21.922624 28889 tablet_replica.cc:333] T c45195d3728449a1813e1bbe3ce5a981 P faf57cab004346baae3fe74487d12316: stopping tablet replica
I20260709 13:13:21.923210  5635 leader_election.cc:290] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789), 00e3ba273af645d881fe92b48b615951 (127.28.54.67:44205)
I20260709 13:13:21.923420 28889 raft_consensus.cc:2243] T c45195d3728449a1813e1bbe3ce5a981 P faf57cab004346baae3fe74487d12316 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:21.924012 28889 raft_consensus.cc:2272] T c45195d3728449a1813e1bbe3ce5a981 P faf57cab004346baae3fe74487d12316 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.924575  5318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f2bd13db554c9397573a6c81ceb5d1" candidate_uuid: "faf57cab004346baae3fe74487d12316" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "00e3ba273af645d881fe92b48b615951" is_pre_election: true
I20260709 13:13:21.925247  5318 raft_consensus.cc:2468] T 33f2bd13db554c9397573a6c81ceb5d1 P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate faf57cab004346baae3fe74487d12316 in term 2.
I20260709 13:13:21.926281  5213 leader_election.cc:304] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 00e3ba273af645d881fe92b48b615951, faf57cab004346baae3fe74487d12316; no voters: 
I20260709 13:13:21.926590 28889 tablet_replica.cc:333] T 02b61ce2481342a58d8418df35ed4fdd P faf57cab004346baae3fe74487d12316: stopping tablet replica
I20260709 13:13:21.926983  5635 raft_consensus.cc:2804] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 13:13:21.927002  5213 leader_election.cc:336] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789): Network error: Client connection negotiation failed: client connection to 127.28.54.65:36789: connect: Connection refused (error 111)
I20260709 13:13:21.927374 28889 raft_consensus.cc:2243] T 02b61ce2481342a58d8418df35ed4fdd P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:21.927489  5635 raft_consensus.cc:493] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 20c10f8bb9404efea93b7709bff70f8f)
I20260709 13:13:21.927930  5635 raft_consensus.cc:3060] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:21.927989 28889 raft_consensus.cc:2272] T 02b61ce2481342a58d8418df35ed4fdd P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.930708 28889 tablet_replica.cc:333] T a4a20c8585a445b78ff71276699f1693 P faf57cab004346baae3fe74487d12316: stopping tablet replica
I20260709 13:13:21.931470 28889 raft_consensus.cc:2243] T a4a20c8585a445b78ff71276699f1693 P faf57cab004346baae3fe74487d12316 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:21.932386 28889 raft_consensus.cc:2272] T a4a20c8585a445b78ff71276699f1693 P faf57cab004346baae3fe74487d12316 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.934985 28889 tablet_replica.cc:333] T fbb576f6df1d4ea899f4e15ca176a28b P faf57cab004346baae3fe74487d12316: stopping tablet replica
I20260709 13:13:21.935266  5635 raft_consensus.cc:515] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:21.935732 28889 raft_consensus.cc:2243] T fbb576f6df1d4ea899f4e15ca176a28b P faf57cab004346baae3fe74487d12316 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:21.936731 28889 raft_consensus.cc:2272] T fbb576f6df1d4ea899f4e15ca176a28b P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.937304  5635 leader_election.cc:290] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 3 election: Requested vote from peers 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789), 00e3ba273af645d881fe92b48b615951 (127.28.54.67:44205)
I20260709 13:13:21.938603  5318 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "33f2bd13db554c9397573a6c81ceb5d1" candidate_uuid: "faf57cab004346baae3fe74487d12316" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "00e3ba273af645d881fe92b48b615951"
I20260709 13:13:21.939247 28889 tablet_replica.cc:333] T 965bdbceb0374f3994b3f4efa9482f4b P faf57cab004346baae3fe74487d12316: stopping tablet replica
I20260709 13:13:21.939199  5318 raft_consensus.cc:3060] T 33f2bd13db554c9397573a6c81ceb5d1 P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Advancing to term 3
I20260709 13:13:21.940094 28889 raft_consensus.cc:2243] T 965bdbceb0374f3994b3f4efa9482f4b P faf57cab004346baae3fe74487d12316 [term 2 LEADER]: Raft consensus shutting down.
W20260709 13:13:21.940491  5213 leader_election.cc:336] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 20c10f8bb9404efea93b7709bff70f8f (127.28.54.65:36789): Network error: Client connection negotiation failed: client connection to 127.28.54.65:36789: connect: Connection refused (error 111)
I20260709 13:13:21.941052 28889 raft_consensus.cc:2272] T 965bdbceb0374f3994b3f4efa9482f4b P faf57cab004346baae3fe74487d12316 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.943454 28889 tablet_replica.cc:333] T 35090704c57b43d494666e056fade162 P faf57cab004346baae3fe74487d12316: stopping tablet replica
I20260709 13:13:21.944159 28889 raft_consensus.cc:2243] T 35090704c57b43d494666e056fade162 P faf57cab004346baae3fe74487d12316 [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:21.945111 28889 raft_consensus.cc:2272] T 35090704c57b43d494666e056fade162 P faf57cab004346baae3fe74487d12316 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.946048  5318 raft_consensus.cc:2468] T 33f2bd13db554c9397573a6c81ceb5d1 P 00e3ba273af645d881fe92b48b615951 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate faf57cab004346baae3fe74487d12316 in term 3.
I20260709 13:13:21.947091  5213 leader_election.cc:304] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 00e3ba273af645d881fe92b48b615951, faf57cab004346baae3fe74487d12316; no voters: 20c10f8bb9404efea93b7709bff70f8f
I20260709 13:13:21.947574 28889 tablet_replica.cc:333] T 85f195d86c444318a3b33ec5c008e238 P faf57cab004346baae3fe74487d12316: stopping tablet replica
I20260709 13:13:21.947665  5635 raft_consensus.cc:2804] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 13:13:21.948203  5635 raft_consensus.cc:697] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316 [term 3 LEADER]: Becoming Leader. State: Replica: faf57cab004346baae3fe74487d12316, State: Running, Role: LEADER
I20260709 13:13:21.948443 28889 raft_consensus.cc:2243] T 85f195d86c444318a3b33ec5c008e238 P faf57cab004346baae3fe74487d12316 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:21.948977 28889 raft_consensus.cc:2272] T 85f195d86c444318a3b33ec5c008e238 P faf57cab004346baae3fe74487d12316 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.948994  5635 consensus_queue.cc:237] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "20c10f8bb9404efea93b7709bff70f8f" member_type: VOTER last_known_addr { host: "127.28.54.65" port: 36789 } } peers { permanent_uuid: "faf57cab004346baae3fe74487d12316" member_type: VOTER last_known_addr { host: "127.28.54.66" port: 33871 } } peers { permanent_uuid: "00e3ba273af645d881fe92b48b615951" member_type: VOTER last_known_addr { host: "127.28.54.67" port: 44205 } }
I20260709 13:13:21.951764 28889 tablet_replica.cc:333] T ae428dc990694b0ba45113e7211e332b P faf57cab004346baae3fe74487d12316: stopping tablet replica
I20260709 13:13:21.952550 28889 raft_consensus.cc:2243] T ae428dc990694b0ba45113e7211e332b P faf57cab004346baae3fe74487d12316 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:21.953027 28889 raft_consensus.cc:2272] T ae428dc990694b0ba45113e7211e332b P faf57cab004346baae3fe74487d12316 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.954924 28889 tablet_replica.cc:333] T 4efb7f98e10844e7bc2aac9284cbc6ed P faf57cab004346baae3fe74487d12316: stopping tablet replica
I20260709 13:13:21.955459 28889 raft_consensus.cc:2243] T 4efb7f98e10844e7bc2aac9284cbc6ed P faf57cab004346baae3fe74487d12316 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:21.955834 28889 raft_consensus.cc:2272] T 4efb7f98e10844e7bc2aac9284cbc6ed P faf57cab004346baae3fe74487d12316 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.957412 28889 tablet_replica.cc:333] T 619fadedef99424fb02cb2220e11f71d P faf57cab004346baae3fe74487d12316: stopping tablet replica
I20260709 13:13:21.957926 28889 raft_consensus.cc:2243] T 619fadedef99424fb02cb2220e11f71d P faf57cab004346baae3fe74487d12316 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:21.958305 28889 raft_consensus.cc:2272] T 619fadedef99424fb02cb2220e11f71d P faf57cab004346baae3fe74487d12316 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.959993 28889 tablet_replica.cc:333] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316: stopping tablet replica
I20260709 13:13:21.960484 28889 raft_consensus.cc:2243] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:21.961036 28889 pending_rounds.cc:70] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316: Trying to abort 1 pending ops.
I20260709 13:13:21.961208 28889 pending_rounds.cc:77] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305637076792901632 op_type: NO_OP noop_request { }
I20260709 13:13:21.961469 28889 raft_consensus.cc:2889] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 13:13:21.961710 28889 raft_consensus.cc:2272] T 33f2bd13db554c9397573a6c81ceb5d1 P faf57cab004346baae3fe74487d12316 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.963712 28889 tablet_replica.cc:333] T d3218bc2bfe94d5f81b06f2fd09c1934 P faf57cab004346baae3fe74487d12316: stopping tablet replica
I20260709 13:13:21.964175 28889 raft_consensus.cc:2243] T d3218bc2bfe94d5f81b06f2fd09c1934 P faf57cab004346baae3fe74487d12316 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:21.964862 28889 raft_consensus.cc:2272] T d3218bc2bfe94d5f81b06f2fd09c1934 P faf57cab004346baae3fe74487d12316 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:21.966506 28889 tablet_replica.cc:333] T c56044a4794e4299af4ee1d462580192 P faf57cab004346baae3fe74487d12316: stopping tablet replica
I20260709 13:13:21.966917 28889 raft_consensus.cc:2243] T c56044a4794e4299af4ee1d462580192 P faf57cab004346baae3fe74487d12316 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:21.967329 28889 raft_consensus.cc:2272] T c56044a4794e4299af4ee1d462580192 P faf57cab004346baae3fe74487d12316 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 13:13:21.992079  5284 consensus_peers.cc:597] T 619fadedef99424fb02cb2220e11f71d P 00e3ba273af645d881fe92b48b615951 -> Peer faf57cab004346baae3fe74487d12316 (127.28.54.66:33871): Couldn't send request to peer faf57cab004346baae3fe74487d12316. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.66:33871: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:22.005324 28889 tablet_server.cc:196] TabletServer@127.28.54.66:0 shutdown complete.
W20260709 13:13:22.023533  5284 consensus_peers.cc:597] T c45195d3728449a1813e1bbe3ce5a981 P 00e3ba273af645d881fe92b48b615951 -> Peer faf57cab004346baae3fe74487d12316 (127.28.54.66:33871): Couldn't send request to peer faf57cab004346baae3fe74487d12316. Status: Network error: Client connection negotiation failed: client connection to 127.28.54.66:33871: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 13:13:22.035985 28889 tablet_server.cc:179] TabletServer@127.28.54.67:0 shutting down...
I20260709 13:13:22.060566 28889 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 13:13:22.061237 28889 tablet_replica.cc:333] T f1e891d4721f42eca4e337499ecdede2 P 00e3ba273af645d881fe92b48b615951: stopping tablet replica
I20260709 13:13:22.061877 28889 raft_consensus.cc:2243] T f1e891d4721f42eca4e337499ecdede2 P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.062325 28889 raft_consensus.cc:2272] T f1e891d4721f42eca4e337499ecdede2 P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.064396 28889 tablet_replica.cc:333] T 016eb0d72e0e4e1d843a82e390ce83bc P 00e3ba273af645d881fe92b48b615951: stopping tablet replica
I20260709 13:13:22.064951 28889 raft_consensus.cc:2243] T 016eb0d72e0e4e1d843a82e390ce83bc P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.065361 28889 raft_consensus.cc:2272] T 016eb0d72e0e4e1d843a82e390ce83bc P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.067128 28889 tablet_replica.cc:333] T dbe4243871d147358837895129c7dd45 P 00e3ba273af645d881fe92b48b615951: stopping tablet replica
I20260709 13:13:22.067623 28889 raft_consensus.cc:2243] T dbe4243871d147358837895129c7dd45 P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.068025 28889 raft_consensus.cc:2272] T dbe4243871d147358837895129c7dd45 P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.069743 28889 tablet_replica.cc:333] T 01fd91b8fb9049d181045604bba46353 P 00e3ba273af645d881fe92b48b615951: stopping tablet replica
I20260709 13:13:22.070291 28889 raft_consensus.cc:2243] T 01fd91b8fb9049d181045604bba46353 P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.070676 28889 raft_consensus.cc:2272] T 01fd91b8fb9049d181045604bba46353 P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.072347 28889 tablet_replica.cc:333] T fbb576f6df1d4ea899f4e15ca176a28b P 00e3ba273af645d881fe92b48b615951: stopping tablet replica
I20260709 13:13:22.072840 28889 raft_consensus.cc:2243] T fbb576f6df1d4ea899f4e15ca176a28b P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.073227 28889 raft_consensus.cc:2272] T fbb576f6df1d4ea899f4e15ca176a28b P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.075057 28889 tablet_replica.cc:333] T 02b61ce2481342a58d8418df35ed4fdd P 00e3ba273af645d881fe92b48b615951: stopping tablet replica
I20260709 13:13:22.075580 28889 raft_consensus.cc:2243] T 02b61ce2481342a58d8418df35ed4fdd P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.076033 28889 raft_consensus.cc:2272] T 02b61ce2481342a58d8418df35ed4fdd P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.077829 28889 tablet_replica.cc:333] T a4a20c8585a445b78ff71276699f1693 P 00e3ba273af645d881fe92b48b615951: stopping tablet replica
I20260709 13:13:22.078341 28889 raft_consensus.cc:2243] T a4a20c8585a445b78ff71276699f1693 P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.078742 28889 raft_consensus.cc:2272] T a4a20c8585a445b78ff71276699f1693 P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.080528 28889 tablet_replica.cc:333] T d3218bc2bfe94d5f81b06f2fd09c1934 P 00e3ba273af645d881fe92b48b615951: stopping tablet replica
I20260709 13:13:22.081023 28889 raft_consensus.cc:2243] T d3218bc2bfe94d5f81b06f2fd09c1934 P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.081408 28889 raft_consensus.cc:2272] T d3218bc2bfe94d5f81b06f2fd09c1934 P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.083012 28889 tablet_replica.cc:333] T c56044a4794e4299af4ee1d462580192 P 00e3ba273af645d881fe92b48b615951: stopping tablet replica
I20260709 13:13:22.083499 28889 raft_consensus.cc:2243] T c56044a4794e4299af4ee1d462580192 P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.083922 28889 raft_consensus.cc:2272] T c56044a4794e4299af4ee1d462580192 P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.085671 28889 tablet_replica.cc:333] T 33f2bd13db554c9397573a6c81ceb5d1 P 00e3ba273af645d881fe92b48b615951: stopping tablet replica
I20260709 13:13:22.086287 28889 raft_consensus.cc:2243] T 33f2bd13db554c9397573a6c81ceb5d1 P 00e3ba273af645d881fe92b48b615951 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.086678 28889 raft_consensus.cc:2272] T 33f2bd13db554c9397573a6c81ceb5d1 P 00e3ba273af645d881fe92b48b615951 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.088385 28889 tablet_replica.cc:333] T 965bdbceb0374f3994b3f4efa9482f4b P 00e3ba273af645d881fe92b48b615951: stopping tablet replica
I20260709 13:13:22.088865 28889 raft_consensus.cc:2243] T 965bdbceb0374f3994b3f4efa9482f4b P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.089248 28889 raft_consensus.cc:2272] T 965bdbceb0374f3994b3f4efa9482f4b P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.090858 28889 tablet_replica.cc:333] T 35090704c57b43d494666e056fade162 P 00e3ba273af645d881fe92b48b615951: stopping tablet replica
I20260709 13:13:22.091331 28889 raft_consensus.cc:2243] T 35090704c57b43d494666e056fade162 P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.091691 28889 raft_consensus.cc:2272] T 35090704c57b43d494666e056fade162 P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.093461 28889 tablet_replica.cc:333] T 4efb7f98e10844e7bc2aac9284cbc6ed P 00e3ba273af645d881fe92b48b615951: stopping tablet replica
I20260709 13:13:22.093935 28889 raft_consensus.cc:2243] T 4efb7f98e10844e7bc2aac9284cbc6ed P 00e3ba273af645d881fe92b48b615951 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.094614 28889 raft_consensus.cc:2272] T 4efb7f98e10844e7bc2aac9284cbc6ed P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.096191 28889 tablet_replica.cc:333] T 619fadedef99424fb02cb2220e11f71d P 00e3ba273af645d881fe92b48b615951: stopping tablet replica
I20260709 13:13:22.096642 28889 raft_consensus.cc:2243] T 619fadedef99424fb02cb2220e11f71d P 00e3ba273af645d881fe92b48b615951 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.097314 28889 raft_consensus.cc:2272] T 619fadedef99424fb02cb2220e11f71d P 00e3ba273af645d881fe92b48b615951 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.099148 28889 tablet_replica.cc:333] T ae428dc990694b0ba45113e7211e332b P 00e3ba273af645d881fe92b48b615951: stopping tablet replica
I20260709 13:13:22.099622 28889 raft_consensus.cc:2243] T ae428dc990694b0ba45113e7211e332b P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.100000 28889 raft_consensus.cc:2272] T ae428dc990694b0ba45113e7211e332b P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.101719 28889 tablet_replica.cc:333] T 85f195d86c444318a3b33ec5c008e238 P 00e3ba273af645d881fe92b48b615951: stopping tablet replica
I20260709 13:13:22.102226 28889 raft_consensus.cc:2243] T 85f195d86c444318a3b33ec5c008e238 P 00e3ba273af645d881fe92b48b615951 [term 3 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.102893 28889 raft_consensus.cc:2272] T 85f195d86c444318a3b33ec5c008e238 P 00e3ba273af645d881fe92b48b615951 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.104667 28889 tablet_replica.cc:333] T b0a40b61c1b744e399aa024aac76f1f9 P 00e3ba273af645d881fe92b48b615951: stopping tablet replica
I20260709 13:13:22.105147 28889 raft_consensus.cc:2243] T b0a40b61c1b744e399aa024aac76f1f9 P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 13:13:22.105495 28889 raft_consensus.cc:2272] T b0a40b61c1b744e399aa024aac76f1f9 P 00e3ba273af645d881fe92b48b615951 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.107209 28889 tablet_replica.cc:333] T c45195d3728449a1813e1bbe3ce5a981 P 00e3ba273af645d881fe92b48b615951: stopping tablet replica
I20260709 13:13:22.107601 28889 raft_consensus.cc:2243] T c45195d3728449a1813e1bbe3ce5a981 P 00e3ba273af645d881fe92b48b615951 [term 2 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.108266 28889 raft_consensus.cc:2272] T c45195d3728449a1813e1bbe3ce5a981 P 00e3ba273af645d881fe92b48b615951 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.146239 28889 tablet_server.cc:196] TabletServer@127.28.54.67:0 shutdown complete.
I20260709 13:13:22.175130 28889 master.cc:562] Master@127.28.54.126:39035 shutting down...
I20260709 13:13:22.194031 28889 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 5c6ac1e6dd6f4564b1a2b2385ff3355c [term 1 LEADER]: Raft consensus shutting down.
I20260709 13:13:22.194564 28889 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 5c6ac1e6dd6f4564b1a2b2385ff3355c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 13:13:22.194873 28889 tablet_replica.cc:333] T 00000000000000000000000000000000 P 5c6ac1e6dd6f4564b1a2b2385ff3355c: stopping tablet replica
I20260709 13:13:22.213438 28889 master.cc:584] Master@127.28.54.126:39035 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (12277 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (24114 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (243348 ms total)
[  PASSED  ] 8 tests.
I20260709 13:13:22.262149 28889 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 474 messages since previous log ~15 seconds ago
I20260709 13:13:22.262349 28889 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 474 messages since previous log ~15 seconds ago
I20260709 13:13:22.262495 28889 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 474 messages since previous log ~15 seconds ago
I20260709 13:13:22.262641 28889 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~32 seconds ago
I20260709 13:13:22.262779 28889 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~32 seconds ago
I20260709 13:13:22.262926 28889 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 6 messages since previous log ~135 seconds ago
I20260709 13:13:22.263126 28889 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 44 messages since previous log ~1 seconds ago
I20260709 13:13:22.263376 28889 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 26 messages since previous log ~7 seconds ago
